Durations become a point of consideration once your test suites begin to scale and costs are increased. Initially, most teams prioritize achieving high coverage rates, leaving duration-related conversations for later. When the time comes to consider these durations, ideas typically circle around enhancing test run parallelism and minimizing unnecessary waits in our code.
However, as your test suite expands, these solutions often fall short. Upon closer investigation, you may realize that the failures are frequently the most time-consuming aspects of test suites. Standard strategies such as asynchronous checks with timeouts or reruns upon failures can cause the same test to consume up to 100% more time compared to when it passes successfully. That's why it's essential to focus on testing the right system.
To that end, we've developed a system to "mute" these tests, reducing both our pipeline durations and noise from unrelated failures. This practice has also enhanced test result reviews by developers, making potential issues more noticeable, and thus, easier to resolve. If you'd like to learn more, I wrote an article about the strategies we used: "Managing iOS Tests at Scale."
I'd love to hear your thoughts. You can reach out to me via Twitter, Linkedin, or email.
Now, let's move on to this week's episode.
Reddit recently shared an in-depth overview of their end-to-end UI testing strategies which were written by Lakshya Kapoor, Parth Parikh, and Abey Thomas.
🔗https://www.reddit.com/r/RedditEng/comments/14gd9gc/ios_ui_testing_strategy_and_tooling/
“The most effective way to change your habits is to focus not on what you want to achieve, but on who you wish to become.” — James Clear, Atomic Habits
If you often find it hard to get things done, this article by Nicole Janz might be a useful read for you.
🔗 https://betterhumans.pub/why-challenges-help-us-get-stuff-done-f64706b5c5a0
Snapshot testing is indeed set to become a gold standard for mobile testing in the near future. If you have not already, start your journey with this insightful article by Beyza Budak.
🔗 https://medium.com/cstech/ui-test-automation-snapshot-testing-in-ios-bd8bcb595cf8
No posts
Comments
Nothing yet. Say the first thing.
Sign in to join the conversation.