New to AWS Device Farm and have a few questions about test runs

Question

I have a few newbie questions about AWS Device Farm.  
  
1. Probably a really dumb question, but how do I delete a test run?  
  
On the list of test runs under the "Automated tests" tab, I can't seem to find an option to delete a run. Even on the results page, there doesn't seem to be an option to delete the run either. Is there a way to delete a specific run without having to delete the entire project or use a third-party tool?  
  
2. I noticed that when a run doesn't have a 100% pass rate, the results page shows which specific tests passed or failed. But when all tests pass, all the tests are grouped together into a single "Tests Suite." How to I expand the suite to show all test cases?  
  
3. The results page only shows the test specification log when all tests pass. But in test runs where there is a failure, the log doesn't appear. How do I enable the test specification log for all runs?  
  
Edited by: DannyChiaIntel on Sep 18, 2019 12:29 PM

Answer

This answers my questions. Thank you so much!

Answer

Hello,  
  
1: In we do not offer the ability to delete a specific run in the console; however, this can be done using our CLI  
https://docs.aws.amazon.com/cli/latest/reference/devicefarm/delete-run.html  
  
I'm going to group 2 and 3 together.  
Tests are grouped together as "Tests Suite." when you run using Custom Environments, and the individual reporting when ran in Standard Environments  
  
When using the console, you can choose either Standard or Custom Environments in the `Configure` step after you select your test package.  
  
Some benefits of using Custom Environments include  
- Being able to configure specifically how your tests run in the yaml file  
- Being able to download dependancies in the yaml file  
- generally faster test executions  
- live log and video streaming  
  
But Custom Environments does not have individual test reporting yet.

Hope this answers your questions, and let us know if there's anything else we can help you with.  
Scott

New to AWS Device Farm and have a few questions about test runs

相關內容