Hello Product Hunt! 👋
I've been working on a product that helps teams manage flaky tests. If you or your team ever feel like you need to spend more time re-running tests on pull requests, this product was made for you!
The app's main feature is the 'mute' feature. It allows you to silence a flaky test without any code changes. A muted test continues to run on your CI, collecting errors, but it won't fail your entire build until it's unmuted (which happens automatically after a week by default). This way, your team can maintain control without being overwhelmed by forgotten skipped tests.
Besides the mute feature, the product has all the other bells and whistles you'd expect: statistics, graphs, breakdown per test, error logs, etc.
I've also tried to make the setup as simple as possible, so all you need to do is install a package and add an environment variable in your CI.
I focused on Python 🐍 for the initial launch, but I'll add support for other languages and frameworks based on feedback.
This is my first product launch on Product Hunt, so I appreciate any feedback, thank you 🙏
@sentry_co Hey, yes, it does It should run in any CI just as long as you have the flakytest plugin pip package installed and the FLAKYTEST_SECRET_TOKEN env variable set.
I haven't gotten around to writing instructions for other CI systems yet, but if you let me know what you are using I'll make sure to prioritize writing docs for that!
@sentry_co I think I misread your original comment. I thought you were asking if it works anywhere else besides GitHub Actions. I do have a doc explaining how to set up GitHub Actions: https://flakytest.dev/ci/ since yes, I think it's the most common option these days!
FlakyTest.dev
Brizy
FlakyTest.dev
FlakyTest.dev
FlakyTest.dev