Pytest plugins for AI-era testing.
Two packages on PyPI, one shared memory layer. Your DeepEval evals and your Playwright runs feed the same context store every AI coding agent reads from.
Both packages
Two pytest plugins. One memory layer.
Install whichever fits your stack — both feed the same TestRelic context store, so your AI coding agents see eval scores and browser-test failures side by side.
testrelic-deepeval
Pytest plugin that captures DeepEval evaluation results — every metric, score, and reason — into TestRelic's shared application memory layer.
pip install testrelic-deepevaltestrelic-playwright
Pytest + Playwright analytics reporter — navigation timelines, API tracking, network stats, failure diagnostics, interactive HTML reports.
pip install testrelic-playwrightOne command, both pipelines
Pip in, pytest out, memory updated.
Both plugins auto-attach via pytest entry points — no conftest edits, no reporter wiring. Run your suite and the TestRelic memory layer fills in.
$ pip install testrelic-playwright testrelic-deepeval && pytest
test session report
47
Suites uploaded
12
Eval runs captured
1.3s
Avg latency
Both packages auto-detect CI metadata (GitHub Actions, GitLab, Jenkins, CircleCI, Buildkite).
Quickstarts
Three commands. Live in memory.
Side-by-side quickstarts — copy a block and paste it into your terminal. Both work with any pytest layout.
DeepEval pytest plugin
testrelic-deepeval
pip install testrelic-deepeval
testrelic login
deepeval test run tests/$ pip install testrelic-deepeval
Playwright pytest plugin
testrelic-playwright
pip install pytest-playwright testrelic-playwright
playwright install
pytest$ pip install testrelic-playwright
Tested on CPython 3.10, 3.11, 3.12, and 3.13 against the latest pytest 8.x.
Both packages register via pytest entry points — no conftest plumbing required.
testrelic-playwright is MIT-licensed. testrelic-deepeval inherits DeepEval's AGPL-3.0 surface where it wraps the upstream runner.
Honest status disclosure
testrelic-deepeval is Alpha (v0.1.2) — production-ready for pytest integration, CLI, and dataset operations. testrelic-playwright is Beta (v0.2.0). Tracing and prompt-versioning are not yet shipped — we'll announce when they are.