New to AWS Device Farm and have a few questions about test runs

0

I have a few newbie questions about AWS Device Farm.

  1. Probably a really dumb question, but how do I delete a test run?

On the list of test runs under the "Automated tests" tab, I can't seem to find an option to delete a run. Even on the results page, there doesn't seem to be an option to delete the run either. Is there a way to delete a specific run without having to delete the entire project or use a third-party tool?

  1. I noticed that when a run doesn't have a 100% pass rate, the results page shows which specific tests passed or failed. But when all tests pass, all the tests are grouped together into a single "Tests Suite." How to I expand the suite to show all test cases?

  2. The results page only shows the test specification log when all tests pass. But in test runs where there is a failure, the log doesn't appear. How do I enable the test specification log for all runs?

Edited by: DannyChiaIntel on Sep 18, 2019 12:29 PM

asked 5 years ago342 views
2 Answers
0

Hello,

1: In we do not offer the ability to delete a specific run in the console; however, this can be done using our CLI
https://docs.aws.amazon.com/cli/latest/reference/devicefarm/delete-run.html

I'm going to group 2 and 3 together.
Tests are grouped together as "Tests Suite." when you run using Custom Environments, and the individual reporting when ran in Standard Environments

When using the console, you can choose either Standard or Custom Environments in the Configure step after you select your test package.

Some benefits of using Custom Environments include

  • Being able to configure specifically how your tests run in the yaml file
  • Being able to download dependancies in the yaml file
  • generally faster test executions
  • live log and video streaming

But Custom Environments does not have individual test reporting yet.

Hope this answers your questions, and let us know if there's anything else we can help you with.
Scott

answered 5 years ago
0

This answers my questions. Thank you so much!

answered 5 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions