Integrate Visual Studio Coded UI Test with VSTS/TF

Question

I need to integrate VS Coded UI Test in VSTS/TFS build pipeline to test a Visual Studio Extension, however I could not find reference for this in MSDN, Is this possible with TFS 2015.2 and VSTS?

Answer 1

TL;DR You can use the Run Functional Test task. This task will distribute your tests with test method granularity to a pool of test agent machines.

Description of usage of this task:

• Copy the assemblies of the Coded UI to the machines where you run the tests; on this machines you will install the test agents too;
• Before the Run Functional test you must use the Deploy Test Agent which will download/install/configure the test agent on all target machines.
• Since you need to run Coded UI test you need to set the checkbox for "Interactive Process", as the agent will run as an interactive process (and not as a service) in order to interoperate with the desktop entities.
• After the deployment, invoke the Run Functional test by either:
  • selecting with an appropriate minimatch the assemblies you to run you previously copied to the test machines;
  • select the test plan and the test suite containing the test cases with a filled Associated Automation.

For the prerequisites to run the tasks check the documentation by following the links above.

Answer 2

The recommended way is to use Visual Studio Test Task since Run Functional Test Task is deprecated.

Use version 2.x or higher of the Visual Studio Test task together with phases to run unit and functional tests on the universal agent.

For more details, see Testing with unified agents and phases.