Tutorial: Create a pipeline that tests your iOS app with Amazon Device Farm

Create or use an S3 bucket with versioning enabled. Follow the instructions in Step 1: Create an S3 bucket for your application to create an S3 bucket.

In the Amazon S3 console for your bucket, choose Upload, and follow the instructions to upload your .zip file.

Your sample application must be packaged in a .zip file.

To create your pipeline and add a source stage, do the following:

1. Sign in to the Amazon Web Services Management Console and open the CodePipeline console at https://console.amazonaws.cn/codepipeline/.

2. Choose Create pipeline. On the Step 1: Choose pipeline settings page, in Pipeline name, enter the name for your pipeline.

3. In Pipeline type, choose V1 for the purposes of this tutorial. You can also choose V2; however, note that pipeline types differ in characteristics and price. For more information, see Pipeline types.

4. In Service role, leave New service role selected, and leave Role name unchanged. You can also choose to use an existing service role, if you have one.

   Note

   If you use a CodePipeline service role that was created before July 2018, you must add permissions for Device Farm. To do this, open the IAM console, find the role, and then add the following permissions to the role's policy. For more information, see Add permissions to the CodePipeline service role.

   {
        "Effect": "Allow",
        "Action": [
           "devicefarm:ListProjects",
           "devicefarm:ListDevicePools",
           "devicefarm:GetRun",
           "devicefarm:GetUpload",
           "devicefarm:CreateUpload",
           "devicefarm:ScheduleRun"
        ],
        "Resource": "*"
   }

5. Leave the settings under Advanced settings at their defaults, and then choose Next.

6. On the Step 2: Add source stage page, in Source provider, choose Amazon S3.

7. In Amazon S3 location, enter the bucket, such as my-storage-bucket, and object key, such as s3-ios-test-1.zip for your .zip file.

8. Choose Next.

In Build, create a placeholder build stage for your pipeline. This allows you to create the pipeline in the wizard. After you use the wizard to create your two-stage pipeline, you no longer need this placeholder build stage. After the pipeline is completed, this second stage is deleted and the new test stage is added in step 5.

1. In Build provider, choose Add Jenkins. This build selection is a placeholder. It is not used.

2. In Provider name, enter a name. The name is a placeholder. It is not used.

3. In Server URL, enter text. The text is a placeholder. It is not used.

4. In Project name, enter a name. The name is a placeholder. It is not used.

5. Choose Next.

6. On the Step 4: Add deploy stage page, choose Skip deploy stage, and then accept the warning message by choosing Skip again.

7. On Step 5: Review, choose Create pipeline. You should see a diagram that shows the source and build stages.

   

Add a Device Farm test action to your pipeline as follows:

1. In the upper right, choose Edit.

2. Choose Edit stage. Choose Delete. This deletes the placeholder stage now that you no longer need it for pipeline creation.

3. At the bottom of the diagram, choose + Add stage.

4. In Stage name, enter a name for the stage, such as Test, and then choose Add stage.

5. Choose + Add action group.

6. In Action name, enter a name, such as DeviceFarmTest.

7. In Action provider, choose Amazon Device Farm. Allow Region to default to the pipeline Region.

8. In Input artifacts, choose the input artifact that matches the output artifact of the stage that comes before the test stage, such as SourceArtifact.

   In the Amazon CodePipeline console, you can find the name of the output artifact for each stage by hovering over the information icon in the pipeline diagram. If your pipeline tests your app directly from the Source stage, choose SourceArtifact. If the pipeline includes a Build stage, choose BuildArtifact.

9. In ProjectId, choose your Device Farm project ID. Use the steps at the start of this tutorial to retrieve your project ID.

10. In DevicePoolArn, enter the ARN for the device pool. To get the available device pool ARNs for the project, including the ARN for Top Devices, use the Amazon CLI to enter the following command:

    aws devicefarm list-device-pools --arn arn:aws:devicefarm:us-west-2:account_ID:project:project_ID

11. In AppType, enter iOS.

    The following is a list of valid values for AppType:

    • iOS

    • Android

    • Web

12. In App, enter the path of the compiled app package. The path is relative to the root of the input artifact for the test stage. Typically, this path is similar to ios-test.ipa.

13. In TestType, enter your type of test, and then in Test, enter the path of the test definition file. The path is relative to the root of the input artifact for your test.

    If you're using one of the built-in Device Farm tests, enter the type of test configured in your Device Farm project, such as BUILTIN_FUZZ. In FuzzEventCount, enter a time in milliseconds, such as 6000. In FuzzEventThrottle, enter a time in milliseconds, such as 50.

    If you aren't using one of the built-in Device Farm tests, enter your type of test, and then in Test, enter the path of the test definition file. The path is relative to the root of the input artifact for your test.

    The following is a list of valid values for TestType:

    • APPIUM_JAVA_JUNIT

    • APPIUM_JAVA_TESTNG

    • APPIUM_NODE

    • APPIUM_RUBY

    • APPIUM_PYTHON

    • APPIUM_WEB_JAVA_JUNIT

    • APPIUM_WEB_JAVA_TESTNG

    • APPIUM_WEB_NODE

    • APPIUM_WEB_RUBY

    • APPIUM_WEB_PYTHON

    • BUILTIN_FUZZ

    • INSTRUMENTATION

    • XCTEST

    • XCTEST_UI

    Note

    Custom environment nodes are not supported.

14. In the remaining fields, provide the configuration that is appropriate for your test and application type.

15. (Optional) In Advanced, provide configuration information for your test run.

16. Choose Save.

17. On the stage you are editing, choose Done. In the Amazon CodePipeline pane, choose Save, and then choose Save on the warning message.

18. To submit your changes and start a pipeline execution, choose Release change, and then choose Release.