TestRelic AI LogoTestRelic AI
Back to Blog
Best Practices

Getting Started with TestRelic AI in 15 Minutes

Emily ThompsonFebruary 2, 20268 min read

This guide walks you through setting up TestRelic AI with your Playwright test suite. By the end you will have test results streaming to a live dashboard with AI-powered failure analysis.

Prerequisites

  • A Playwright project with at least one test
  • Node.js 18 or later
  • A free TestRelic AI account (sign up at app.testrelic.ai)

Step 1 — Install the reporter

Open your terminal in the project root and run:

npm install @testrelic/playwright-reporter

Step 2 — Configure playwright.config.ts

Add the TestRelic AI reporter alongside your existing reporters:

export default defineConfig({ reporter: [ ['html'], ['@testrelic/playwright-reporter'] ], }); ```

The reporter reads your API key from the TESTRELIC_API_KEY environment variable. Set it in your shell or CI secrets.

Step 3 — Run your tests

Execute your suite as usual:

npx playwright test

Results stream to TestRelic AI in real time. Open your dashboard at app.testrelic.ai to see them appear.

Step 4 — Explore the dashboard

Your dashboard shows:

  • **Pass rate trend** — daily pass/fail ratio over the last 30 days.
  • **Failure categories** — AI-classified breakdown (infrastructure, application, test code, flaky).
  • **Flaky test tracker** — tests with inconsistent results and retry analysis.
  • **Slowest tests** — specs ranked by average execution time.

Click any failed test to jump into the Playwright trace viewer with network logs, DOM snapshots, and action timelines.

Step 5 — Ask a question

Use the Ask AI bar at the top of the dashboard. Try:

  • "Which tests failed in the last run?"
  • "Show me flaky tests from this week"
  • "Compare test duration between main and my-feature-branch"

TestRelic AI translates your question into a query and returns the answer in seconds.

Next steps

  • Set up CI integration so results flow automatically from GitHub Actions, GitLab CI, or Jenkins.
  • Invite your team — TestRelic AI includes unlimited seats on every plan.
  • Explore Voice AI for hands-free triage during standups.

That is it — you are up and running. Happy testing!

Back to all posts