Review of HP Service Test 11

API Testing Published on:
UFT API Cover

Unlike QTP 11, Service Test 11 is a major upgrade from Service Test 9.53. HP is touting ST 11 as “an extensibility framework for construction and execution of a functional test of headless systems that do not have a user interface.” Some of the notable changes:

  • Visual Test Designer — A canvas that creates and configures a visual representation of the steps in a test. Tests are created by dragging activities from a toolbox, and configuring their properties.
  • Multiple Technologies — Support for a variety of technologies such as Web Services, REST, .NET, Java, and more.
  • Flexible Data Handling — The ability to link to a variety of data sources, or store data locally with a test. Support for Excel data sheets.
  • Extensibility — The behavior of existing activities can be customized using event handlers. For greater control over the flow of a test, program code activities can be programmed at any point during a test.

New API Focused UI

My thoughts are that Service Test is no longer built on Loadrunner’s Vugen. Instead, it has been re-designed from the ground up, beginning with a new “modern” drag-and-drop user interface.

Use C# for Your API Tests

Unlike QuickTest Pro, which uses wimpy VBScript, ST 11 uses C#, which is a full-blown, “real man’s” programming language. HP has even revamped the famous Mercury Tours website sample to utilize web services.

I have to be honest here — I’m personally on the fence about HP’s decision to move away from Vugen. I kind of liked having a one-script solution (LR) that used the same protocol for both functional and performance testing. ST 11 scripts can still be used for load tests, but since it uses C#, I’m not clear as to how scalable tests will be compared to the Vugen equivalent.

Integrate API tests with QTP an ALM

I also like the ST 9.53 “business component” script functionality that could be integrated with Quality Center; ST 11 does not have this feature. So, it appears as though testers who have built up a large test suite of web service business components will be out of luck if they move forward with ST 11.00.

In any case, I can see why HP decided to make the change. After working with the new version, I have to admit that it’s considerably more user-friendly. QTP engineers will most likely need a minimal learning curve to get up to speed with it. QTP 11 has the ability to call ST 11 scripts, making it easier to do end-to-end testing of an application. I’ll need a little more time to evaluate the changes, but so far I say, “Well done, HP.”

To see a video demo of HP Service Test 11 check out my post https://testguild.com/?p=131

73 responses to “Review of HP Service Test 11”

  1. ST 11.0 has much much more than a new user-friendly designer for composing tests. It has a solid framework which supports easy extensibility of the product (the ability to add new technologies, activities and user interface) , Lean API for composing tests without using the UI which is great for system integrations and automation pro, Application Life-cycle Management integration, superb support for data driven tests and ability to add you custom hooks using modern C# (.net 3.5) code. In addition the web services parser was redesigned and now can handle even the largest WSDLs available.
    Composing headless tests is fun with the new ST :)

  2. Hello Joe,

    Can you test a web service using Service Test 11, if you have an XML file instead of a WSDL? Other words, does ST 11 require that you have a WSDL file for enter input data? I ask this because we want to use JMS instead of using SOAP. Thanks in advance for your help.

    • @MaRenins Collins: Hi MaRenins, Yes — you can test JMS Service Test 11. ST was built not only for SOA testing but any kind of headless technologies. I have not tried testing JMS yet but under the ST’s toolbox they have a JMS folder that contains the following activities that you can perform:

      JMS:

      Publish Message to Topic – Publishes a message to multiple subscribers using a JMS topic
      Receive Message from Queue – Receives a message from a JMS queue
      Receive Message from Topic -Receives a message through a JMS topic
      Send Message to Queue – Send Message to Queue
      Send and Receive Message from Queue – Publishes messages to multiple subscribers and receives them using a JMS queue
      Subscribe to Topic – Subscribes to messages using a JMS topic

      Hope this helps. Thanks for your question! Joe

    • Hi MaRenins Collins,

      Did you get any success on configuring HP Service Test for soap over Jms call? If yes, can you please share the steps to do the same as i am facing issue while doing the same. Getting error- Failed to invoke JMS service, initial context factory is missing or wrong eventhough they are correct as in tested the same with Jmeter.

      • Sunny Chalotra » Hi – yes I did get it to work with ActiveMQ. IF you send me your email I will forward you the eBook I’m writing that includes a chapter on using ST with JMS.

        • Hi Joe,

          Presently, I am facing the same issue as Sunny faced. Can you please send me the eBook where I can follow the steps and do the set up. I appreciate your help on this. Thanks…!!

        • THanks Joe.

          I need to test API Service forn which i am trying to make a JMS connection with the help of Standard Protocols. I selected JMS – send and receive message from Queue. each time i am getting an error- Initial context factory is missing or wrong.
          When i Tested the same service with Jmeter, it worked.
          Not sure where i am making mistake. Can you please send me a sample service for whcih you created a JMS call and also please let me know if connection is ssl, where to intall certs for successful connection.

  3. Hi Joe,

    I would like to know if multiple requirements can be mapped to a single test in service test. Also, I see that there is a option called “solution” where in you can import multiple tests (Existing/new pointing to different requirements). But i also see that i have to run each tests in a solution manually one after the other. Is there an option in service test to trigger these tests automatically one by one without me running it everytime one after the other?

    Regards.
    Sen

    • Sen » Hi Sen – Are you using Quality Center? I know you can link multiple requirements to QTP or service test and can string test together using the QC test lab. If you don’t have QC you should be able to use ST command line options in a .bat file to string test together. Take a look at pg 251 in the User guide for command line syntax. I have not done anything with Service Test solutions options – sorry hope this helped. thanks for your question. Cheers ~ Joe

    • Victor » Sorry it took me so long to get back to you — for some reason your comment was in my Spam folder:( I have not tried it but as long as you have a valid WSDL I think you should be able to test a Tibco service in Service Test 11.

  4. hello Joe Colantonio
    What is advantage or difference between QTP(addin Web service) and HP service test while automating the web service

  5. RE: ST components, as of May 1st of this year, QTP licensing moved from Functional Test (QTP with all add ins) to ONLY being sold as Unified Functional Testing (QTP with all add ins, plus Service Test, the Service Test Management QC plug in module, and a new UI between the two that supports calling Service Tests from QTP tests). So even though ST 11 doesn’t support direct components anymore, QTP 11 can now call ST 11 from within a component, execute both from within BPT, and let you know what layer (process, application or headless) a bug is found in in the new execution reporting tool. I just got my hands on it, and am looking forward to proving out that it works as well for us as I’m hoping based on all the data papers.

    • Bryan Linder » Thanks Bryan for this update! I hope you’ll let use know what you find with “Functional Test”. I know that Service Test 11.10 added BPT functionality. What I’m confused by is ‘Functional Test” is simply a name change for using both QTP and ST or is it a new separate product all together? For example if I currently have QTP 11 and ST 11.10 installed is this the same as “Functional Test”?? I’m going to download it myself and see – maybe it will inspire a new blog post. Cheers ~Joe

  6. Hi Joe,

    What is the difference b/w SoapUI Pro and HP Service test 11.0 and which is a better tool for Web Services testing?

    Thanks

    • Ashok » Hi Ahok this is a great question. I think I should actually do a blog post on it. My quick answer is it depends. SoapUI Pro cost a lot less then ST. But ST dies integrate nicely with QTP. If you are currently don’t use any HP products like QC or QTP and you want to just test web services then I would choose SoapUI Pro. Thanks for the question! Cheers~Joe

  7. Hi Joe

    Is there a way to develop a web based UI which would interact with HPST and provide a rich GUI for the end users?
    Also, is there a way to have a J2EE application interact with HPST?

    • Partho » Anything is possible :) ST can read database,text files and java jar files. One approach might be (I have not tried) that you could create a web front-end that writes data to a db and create a st framework that reads from the db and takes appropriate action. Also instead of reinventing the wheel I would check out business process testing with ST and Quality Center. In ST 11.20 you can now create Business Components with Service Test which allow you to use QC as a user friendly web front-end. Hope this helps. Cheers~Joe

  8. Hi Joe,
    In my case, we have changing environment with every build. So here we have to change WSDL also, provide me the way to do this, like we do in QTP. Setting inputs in Configuration file.
    Please do revert on this.

    Many Thanks !
    Sachin

  9. Joe,

    Good to see your response all the queries on HPST11.20. I have one query here that, Is there any way(API) we can interact with HPST 11.20 tool for test step creation, data driven and Execution without Drag and Drop Interface? And also, is that possible to execute 9.5.3 version of scripts using 11.20 version thru QC?. Your reply for these queries are greatly appreciated.

    Thanks,
    Madhusudhan

  10. I have tons of ST 9.5 Vugen scripts. In order to reuse these Vugen scipts, I

    1. Downloaded HP loadrunner with just Vugen.
    2. Opened the Vugen script using HP load runner (only once)
    3. Opened ST11 and created a new test
    4. Dragged the ‘Call Virtual User generator script’ from the Unified Functional Testing activity
    5. Selected the Vugen script to run
    6. Execute the ST11 script.

    I haven’t been successful in printing the Vugen script output to ST 11 output window. Appreciate if someone would help me.

    Thanks
    Mathews

  11. Hey Joe,

    Actually I need the way to Configure Endpoint information dynamically. That is my test case whe running should take endpoint from config file.

    Thanks !
    Sachin

    • Sachin Walukar » I guess I don’t understand what you are trying to do. The post shows how to read (take) an endpoint value from a file to use as an endpoint value in ST.

  12. Hi Joe,

    I have a problem in Hp service test.

    Hp Service test 11 is crashed during excel upload.
    1. Open the Hp service test tool.
    2. Created service test with available services in the WSDL.
    3. Go View -> Data window.
    4. Click downward arrow after “New” and click on Excel option.
    5. Browse the excel file.( the file is in the Share drive and i have tried with the file in local drive)
    6. With the default options, click on OK button.

    After step 6 HP service test 11 is closed automatically.
    Is there anything am i missing or is it a problem in Hp service test?

    • Vijay » Hi Vijay what version of HP Service Test are you using? The earlier version’s of ST are buggy – you should have at least ST 11.20 with patch 5 installed.

    • Vijay » Yes – HP recommends everyone upgrades to at least 11.20 with Patch 5 as it contains multiple critical fixes.

  13. Thanks Joe…!

    Here I am facing problem during Endpoint set up. I got one solution for this, I think it is posted by you only. FInd below link:https://testguild.com/2012/05/08/hp-service-test-how-to-setup-servicetest-to-run-against-multiple-environments/

    Actually I am able to set up dynamic endpoint, but there we also need to configure same endpoint in WS Addressing as a part of security settings. But there I didnt find any solution to configure it as like dyanamic endpoint set up.

    As there is no any way to link WS Addressing endpoint to file or anything.

    Please suggest on the same. Because we have done a lot in this tool, also we have brought this tool in production but only because of this issue, we are stuck.

    Thanks !
    Sachin Walukar

    • Sachin Walukar » Hi Sachin – sounds like you should be able to do this using custom code. I’m able to set user permissions using ST’s HttpRequestHeaders.Add method. Would you be you able to use this for the WS addressing?

  14. Can I compare response of two services in Service Test?If yes, if you could explain us how can we do it,that will be great.
    e.g I have a services for getting responses from midtier and SAP.I want to validate that response from midtier and SAP returned same value.

  15. With Service Test can you do multiple check points on the same test? (I have a value which will be for Loop 4 times for different year (2009,2010,2011,2012) and I want to validate as it goes to each loop for year I can validate a point in 2009, another in 2010 and so on?

    • Shoid » When you data-drive a test in Service Test using the ‘Data Drive’ option under the Property Sheet you should be given and option to Data Drive “Both Input and Checkpoints’. Under the data window should appear a spreadsheet for _Input and _Checkpoints. Is this feature not working for you?

  16. Hi

    I am new to the HP service test and started the REST service testing. I could able to create the sample REST request for adding the fax number and receiving all the fax number added to the DB. Based on the response, i want to make sure that Test4 is added successfully.

    [{“Number”:”1101″,”recipient”:”Test1″,”faxId”:”1″},{“Number”:”1002″,”recipient”:”Test2″,”faxId”:”2″},
    {“Number”:”1003″,”recipient”:”Test3″,”faxId”:”3″},{“Number”:”1004″,”recipient”:”Test4″,”faxId”:”4″}]

    In Vugen, I can able capture the specific value from the response by using lr_web_reg_save_param… Do we have any option like this on Service test?

    • Balaji » Hi Balaji if I understand your issue correctly I think you should be able to use a checkpoint to verify that the value appears in the response. Under the property sheet for the HTTP Request there are some “Response Body” options for Checkpoints that you can add. If that does not work you can also create Custom Code and use the args.Checkpoint object to create a custom Checkpoint event. Hope this helps you. Cheers~Joe

  17. Joe

    I have few question on the service testing.
    1. How to call the Data source value in custom coding to compare the response with data source value.
    2. I have defined one method, in that URL field, i have include some static text and also some predefined data from Local table. Is it possible to map at the template level. Bcoz i can able to do that from Canvas once i drag that into here.

    Thanks
    Balaji

  18. Hi Joe,

    I need to check the particular value from entire xml,not by using node number.
    How to put the check points using built check points in or using Xpath

    Best Regards,
    Preeti

  19. Hi Joe,

    I’m trying to execute test scripts created using HP Service Test 11.20 from Test Lab of QC 10.0.0.2240. However HP Service Test scripts are not being executed and getting the following error
    “object reference not set to an instance of an object”

    I have tried after installing all of these patches but it didn’t work
    SOAST_00064.EXE
    SOAST_00065.EXE
    SOAST_00066.EXE
    SOAST_00076.EXE
    SOAST_00078.EXE
    SOAST_00080.EXE
    SOAST_00084.EXE

    What could be the reason ? Does QC 10 allow HP Service Test scripts created in version 11.20 to be executed from test lab ?

    • Kaushik » Not sure why you are getting this error. It should works since I’m able to run ST 11.20 test from QC. Does this happen for all tests? Does it happen against all lab machines?

  20. Hi All,

    I would say SOAPUI is far far better than this i believe as i worked on both the tools i prefer to use SOAPUI..

    Sandeep

  21. Hi,

    I’m trying to create data-driven tests for HTTP requests. I would like to create requestheaders dynamically based upon the given data. Please let me know if there is any provision for this.

    • Upendra » Hi would something like this work for you? In Service Test, click on your Web Service activity and navigate to the “Events” property sheet. Within the “Events” property sheet, for the event named “OnSendRequest” select the handler named “OnsendReq”. By double-clicking on “OnsendReq” you be taken to an editor window for the file TestUserCode.cs where you will be able to add custom code to the “OnsendReq” event. To add HTTP header information use the following code syntax:

      public void OnsendReq(object sender, HP.ST.Ext.WebServicesActivities.ActivityProcessRawMessageEventArgs args)
      {
      this.StServiceCallActivity4.HttpRequestHeaders.Add(“My_key”, “My_value”);
      }

  22. I have a different issue not sure whether anyone has faced this issue before in HP service test 11.2. In one of my service, the response XML differs from SOAPUI and HP service test 11.2. For example the response with 10 different cars, the SOAPUI displays all the 10 car details whereas ST displays only 3 car details only.

    Any help is highly appreciated.

    Thanks
    Pratt

    • annapurna » When you say ESB I assume it stands for (Enterprise service bus)- I have not tried. If the ESB exposes an API/web/REST Service that allows you to interact with it than I would say ST might work

  23. Hi Joe,

    Nice to see all your posting with replies and solutions.I need a kind of document from which we can easily understand the HP ST. Could you please share if you have something with you.

    Regards,
    Mahendra K

    • Mahendra K » I’m working on my first e-book for how to use HP UFT API (AKA service test). Its taking me awhile but it’s almost done. If you join my email list you should receive an update when I finally release it.

  24. Joe ,
    Wanted to know on the QTP usage and feasibility along with any specific features and commands for a scenario on :
    1. Machine A which has the QTP software installed.
    2. Machine B which needs to be remotely connected from Machine A. This machine B has the Web applications, primarily an ERP like PeopleSoft applications. The interfaces, functionalities and process[like payroll, job code addition] needs to be tested [Functional Testing] for a Regression kind of scenario. This Machine B doesnot have the QTP software installed.
    3. The machine B which needs to be remotely connected keeps changing. Eg Machine B at one point of time can be a peoplesoft 8.0 version and at other times this Machine B could be actually Machine C with different version of Peoplesoft 8.5 etc.
    In essence the remotely connected machines keep changing for each test case execution.
    Does QTP or its versions support this kind of automation of functional testing. If yes would appreciate any heads-up information on the same.What kind of challenges or tips/tricks one needs to be aware of in this case of test automation. Thank you.

    • Kumar » If I understand correctly you want to be able to run a QTP script against a machine that does not have QTP installed on it? IF this is correct QTP needs to be run locally on every machine.

  25. Joe > Thanks for your reply.
    Wanted to understand if any tool or QTP supports the scenario stated.
    To clarify further, QTP or automation software can be installed in one machine and this doesnot have the web application.
    Web application to test and record is in another machine which doesnot have a QTP software installed.

    One remotely connects to this machine to launch the web application.Application is accessed from the browser of the remote machine and not from the browser of the local machine.

    In this case, can we record or script the actions and process of the remote machine from the local machine where the QTP is installed. Any known challenges or this framework of scripting and recording is not possible.

    Thank you.

  26. Hey Joe, I need to understand the workflow of JMS with UFT-ST. I want to understand the steps as to how can retrieve message from a JMS queue. Since, I am making asynchronous service calls, it results in storing the actual response in to that JMS queue. Please let me know the procedure to retrieve the message from JMS queue as there are hardly any documentation for the same and that API guide hardly helps. Thanks in advance :)

  27. Hi Joe,

    I am trying to create a load test for web services. What exactly should I be preparing to start with? if the web service has to be .wsdl only?

    Need some guidance from you. Please suggest.

  28. Hello Joe,
    I wanted to modify the XML parameter values before loading it and sending the request,
    I am able to modify the XML (Before Execution)but it doesnt change the value while executing
    Regards,
    Supriya

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

UFT API Cover