# TestChimp Documentation > TestChimp is an AI-native QA workflow layer for fast-moving startups: markdown test plans in Git, Playwright SmartTests (optional ai.act/ai.verify), ExploreChimp UX analytics, TrueCoverage (RUM ↔ test runs), and agent-orchestrated `/testchimp init|test|explore|evolve` on every PR. Audience: growth-stage engineering and QA teams shipping web (Playwright) and native mobile (Mobilewright). Signup: https://prod.testchimp.io/signup ## Start here - [What is TestChimp?](https://docs.testchimp.io/introduction/quick-intro): TestChimp is a QA workflow layer that connects test plans, Playwright SmartTests, CI, and TrueCoverage so AI agents a… - [Quick Start](https://docs.testchimp.io/introduction/quick-start): Get TestChimp running by connecting Git, installing the TestChimp skill on Claude or Cursor, running /testchimp init … - [Organization & projects](https://docs.testchimp.io/introduction/organization): Configure your TestChimp organization and projects with Git folder mapping, environments, releases, and team roles so… - [QA on Autopilot (Claude / Cursor)](https://docs.testchimp.io/qa-autopilot-claude/intro): TestChimp upskills Claude into a first-class QA participant—managing plans, infra, SmartTests, CI reporting, ExploreC… ## Agent commands (/testchimp skill) - [/testchimp init — bootstrap repo QA harness](https://docs.testchimp.io/qa-autopilot-claude/init): /testchimp init establishes enterprise-grade QA infrastructure in your repository—CI, fixtures, seeds, mocks, TrueCov… - [/testchimp test — per-PR scenario + SmartTest work](https://docs.testchimp.io/qa-autopilot-claude/test): /testchimp test drives PR-scoped QA: the agent reads plans and intelligence, updates infra, authors or repairs SmartT… - [/testchimp explore — ExploreChimp on SmartTest paths](https://docs.testchimp.io/qa-autopilot-claude/explore): /testchimp explore runs ExploreChimp along your SmartTests, analyzing screen-state checkpoints for UX bugs, visual re… - [/testchimp evolve — close coverage gaps post-deploy](https://docs.testchimp.io/qa-autopilot-claude/evolve): /testchimp evolve closes the loop after deploys by summarizing production behaviour and coverage gaps, then directing… - [Arrange / Act / Assert (expired-coupon pattern)](https://docs.testchimp.io/qa-autopilot-claude/testchimps-approach-to-test-automation): TestChimp combines deterministic Playwright execution with runtime intelligence, requirement traceability, and produc… - [Playwright runtime plugin & test-run reporting](https://docs.testchimp.io/qa-autopilot-claude/runtime-plugin): The @testchimp/playwright plugin reports runs to TestChimp, correlates user events during tests for TrueCoverage, and… ## SmartTests & automation - [SmartTests overview](https://docs.testchimp.io/smart-tests/intro): A SmartTest is standard Playwright on web (Mobilewright on native mobile) enhanced with scenario links, screen-state … - [Creating SmartTests](https://docs.testchimp.io/smart-tests/creating): Create SmartTests in your mapped tests/ folder using Playwright patterns plus TestChimp fixtures, scenario comments, … - [Link tests to scenarios (// @Scenario:)](https://docs.testchimp.io/smart-tests/linking-scenarios): Add // @Scenario: plans/path/scenario.md in SmartTests to declare requirement coverage; TestChimp rolls up linked and… - [Screen-state annotations (markScreenState)](https://docs.testchimp.io/smart-tests/screen-state-annotations): The markScreenState Playwright fixture records screen and state at checkpoints so ExploreChimp and Atlas attribute bu… - [Run SmartTests in CI](https://docs.testchimp.io/smart-tests/run-in-ci-playwright): SmartTests run in standard Playwright CI pipelines; add @testchimp/playwright so executions report to TestChimp and t… - [Mobile testing (Mobilewright)](https://docs.testchimp.io/smart-tests/mobile-testing): TestChimp supports native iOS and Android with Mobilewright scripts sharing markdown plans, // @Scenario links, TrueC… - [Branch-specific test execution](https://docs.testchimp.io/smart-tests/branch-specific-test-execution): Branch-aware SmartTest execution ties CI and explorations to feature branches so startup teams catch regressions on p… ## Test planning & traceability - [Test planning overview](https://docs.testchimp.io/test-planning/intro): TestChimp treats test plans as version-controlled markdown files—not locked database records—so Claude, CI, and your … - [Authoring user stories](https://docs.testchimp.io/test-planning/authoring-user-stories): User stories in TestChimp are markdown files with structured frontmatter—priority, status, labels, and acceptance cri… - [Authoring test scenarios](https://docs.testchimp.io/test-planning/authoring-test-scenarios): Test scenarios capture executable intent as markdown files; SmartTests reference them with // @Scenario comments so T… - [Requirement traceability](https://docs.testchimp.io/test-planning/requirement-traceability): TestChimp traceability is code-native: SmartTests declare which scenario files they cover, enabling live coverage vie… - [Test runs (manual + automated)](https://docs.testchimp.io/test-planning/test-runs): Test runs let teams execute scenarios from plans, record results against environments and releases, and feed QA intel… - [Export plans to Git](https://docs.testchimp.io/test-planning/export-to-git): TestChimp bi-directionally syncs markdown plans to your mapped Git folder so agents, developers, and the web app alwa… - [Import from TestRail & external TMS](https://docs.testchimp.io/test-planning/import-from-external-sources): Import plans from external systems into TestChimp markdown format, organize in folders, and sync to Git so agents and… ## Exploratory testing & ExploreChimp - [Exploratory testing overview](https://docs.testchimp.io/explorations/intro): An exploration is a set of ExploreChimp journeys following SmartTest paths with a recipe that defines analysis focus—… - [How to run explorations](https://docs.testchimp.io/explorations/how-to-run): Configure an exploration by selecting SmartTest scope, recipe, target environment/release, journey limits, and option… - [Git branch exploratory runs](https://docs.testchimp.io/explorations/git-branch-exploratory-runs): Git-branch exploratory runs aim ExploreChimp at the same preview environments as branch-specific SmartTests so UX iss… - [Recipe: Form Validation Tester](https://docs.testchimp.io/explorations/recipes/form-validation-tester): Form Validation Tester prioritizes invalid inputs, boundary values, and error UX at forms encountered on SmartTest pa… - [Recipe: Theme Tester](https://docs.testchimp.io/explorations/recipes/theme-tester): The Theme Tester recipe repeats guided journeys under different themes to catch layout breaks, missing assets, and in… - [UX bug traceability](https://docs.testchimp.io/explorations/ux-bug-traceability): UX bugs found in explorations attach to markScreenState checkpoints and Atlas screens so developers see visual, perfo… ## TrueCoverage & QA Intelligence - [TrueCoverage overview](https://docs.testchimp.io/truecoverage/intro): TrueCoverage overlays the same user-event taxonomy from production and test runs so teams see which real pathways lac… - [Instrumentation (web, iOS, Android)](https://docs.testchimp.io/truecoverage/instrumentation): Instrument web and native apps with TestChimp RUM SDKs and wire SmartTest runs with @testchimp/playwright so producti… - [How TrueCoverage metrics work](https://docs.testchimp.io/truecoverage/how-it-works): TrueCoverage compares event streams from a base scope (e.g. production) to a coverage scope (test runs)—computing fre… - [QA Intelligence dashboard](https://docs.testchimp.io/qa_intel/intro): QA intelligence unifies test planning, SmartTest executions, ExploreChimp findings, and TrueCoverage in one model—lin… - [Atlas SiteMap](https://docs.testchimp.io/qa_intel/sitemap): Atlas is TestChimp app-structure view—screens and states discovered via SmartTests and explorations—with bugs and vis… - [Behaviour map](https://docs.testchimp.io/qa_intel/behaviour-map): Behaviour Map visualizes flows covered by selected SmartTests—helping teams see which behavioural paths are tested an… ## Chrome extension - [Chrome extension overview](https://docs.testchimp.io/chrome-extension/intro): The TestChimp Chrome extension connects browser work to your project—recording flows, creating SmartTests, reporting … - [Manual test capture → SmartTest](https://docs.testchimp.io/chrome-extension/manual-test-capture): Manual test capture logs what testers do in-product— preserving steps and artifacts for test runs, scenario updates, … - [Creating tests from the browser](https://docs.testchimp.io/chrome-extension/creating-tests): Use the extension to capture real user flows as SmartTest scaffolding—then refine in your repo with // @Scenario link… ## Integrations - [Code repository overview](https://docs.testchimp.io/integrations/code-repository/overview): Code repository integrations map tests/ and plans/ folders, webhooks, and OAuth so TestChimp, CI, and Claude share on… - [GitHub integration](https://docs.testchimp.io/integrations/code-repository/github): GitHub integration wires TestChimp to your repositories for folder mapping, branch-aware sync, and the PR-centric wor… - [GitLab integration](https://docs.testchimp.io/integrations/code-repository/gitlab): GitLab integration mirrors GitHub capabilities—repo mapping, bi-directional sync, and merge-request scoped QA for tea… - [Bunnyshell preview environments](https://docs.testchimp.io/integrations/bunnyshell): Bunnyshell plus TestChimp provisions preview URLs per branch so shift-left SmartTests and explorations run against re… - [OpenHands integration](https://docs.testchimp.io/integrations/openhands): OpenHands integration fits teams running coding agents in parallel with TestChimp—same Git-backed SmartTests and plan… ## Comparisons (approach) - [Comparisons hub](https://docs.testchimp.io/comparisons/intro): TestChimp comparison guides explain why markdown plans in Git, hybrid SmartTests, TrueCoverage, and ExploreChimp beat… - [Pure Playwright vs SmartTests](https://docs.testchimp.io/comparisons/pure-scripts-vs-smarttests): SmartTests are Playwright plus optional runtime AI, // @Scenario traceability, markScreenState for ExploreChimp, and … - [Pure agentic tests vs SmartTests](https://docs.testchimp.io/comparisons/pure-agentic-tests-vs-smarttests): Pure agentic tests invoke AI every step—non-deterministic and costly. SmartTests keep Playwright speed with optional … - [Record-replay vs TestChimp](https://docs.testchimp.io/comparisons/record-replay-vs-testchimp): Record-replay excels at quick captures but rots without traceability and infra; TestChimp converts captures into main… - [ExploreChimp vs URL-only explorers](https://docs.testchimp.io/comparisons/explorechimp-vs-typical-agentic-explorers): Typical agentic explorers wander randomly; ExploreChimp uses SmartTests as deterministic paths, screen-state tagging,… - [Traditional traceability vs TestChimp](https://docs.testchimp.io/comparisons/requirement-traceability-traditional-vs-testchimp): Traditional traceability lives in external tools disconnected from tests; TestChimp embeds links in Playwright code a… ## Vendor comparisons (TestChimp vs …) - [All vendor comparisons hub](https://docs.testchimp.io/comparisons/vendors/intro): TestChimp differs from point vendors by orchestrating markdown plans, SmartTests, TrueCoverage, ExploreChimp, and /te… - [TestChimp vs Selenium](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-selenium): Compare TestChimp with Selenium for startup QA. - [TestChimp vs Cypress](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-cypress): Compare TestChimp with Cypress for startup QA. - [TestChimp vs Playwright](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-playwright): Compare TestChimp with Playwright for startup QA. - [TestChimp vs Katalon](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-katalon-studio): Compare TestChimp with Katalon for startup QA. - [TestChimp vs Testim](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-testim): Compare TestChimp with Testim for startup QA. - [TestChimp vs mabl](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-mabl): Compare TestChimp with mabl for startup QA. - [TestChimp vs testRigor](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-testrigor): Compare TestChimp with testRigor for startup QA. - [TestChimp vs Testsigma](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-testsigma): Compare TestChimp with Testsigma for startup QA. - [TestChimp vs Momentic](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-momentic): Compare TestChimp with Momentic for startup QA. - [TestChimp vs ContextQA](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-contextqa): Compare TestChimp with ContextQA for startup QA. - [TestChimp vs SpurTest](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-spurtest): Compare TestChimp with SpurTest for startup QA. - [TestChimp vs ACCELQ](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-accelq): Compare TestChimp with ACCELQ for startup QA. - [TestChimp vs Functionize](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-functionize): Compare TestChimp with Functionize for startup QA. - [TestChimp vs QA Wolf](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-qa-wolf): Compare TestChimp with QA Wolf for startup QA. - [TestChimp vs Reflect](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-reflect): Compare TestChimp with Reflect for startup QA. - [TestChimp vs Tricentis Tosca](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-tricentis-tosca): Compare TestChimp with Tricentis Tosca for startup QA. - [TestChimp vs Leapwork](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-leapwork): Compare TestChimp with Leapwork for startup QA. - [TestChimp vs BrowserStack](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-browserstack): Compare TestChimp with BrowserStack for startup QA. - [TestChimp vs LambdaTest](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-lambdatest): Compare TestChimp with LambdaTest for startup QA. - [TestChimp vs Sauce Labs](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-sauce-labs): Compare TestChimp with Sauce Labs for startup QA. - [TestChimp vs TestRail](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-testrail): Compare TestChimp with TestRail for startup QA. - [TestChimp vs Bugasura](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-bugasura): Compare TestChimp with Bugasura for startup QA. - [TestChimp vs XRay](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-xray): Compare TestChimp with XRay for startup QA. - [TestChimp vs Zephyr](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-zephyr): Compare TestChimp with Zephyr for startup QA. - [TestChimp vs PractiTest](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-practitest): Compare TestChimp with PractiTest for startup QA. - [TestChimp vs Qase](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-qase): Compare TestChimp with Qase for startup QA. - [TestChimp vs Claude](https://docs.testchimp.io/comparisons/vendors/testchimp-vs-claude): Compare TestChimp with Claude for startup QA. ## Alternatives (switching to TestChimp) - [Alternatives hub](https://docs.testchimp.io/alternatives/intro): Best alternatives to popular QA and test management tools. - [Best Selenium alternative](https://docs.testchimp.io/alternatives/selenium-alternative): Why teams switch from Selenium to TestChimp. - [Best Cypress alternative](https://docs.testchimp.io/alternatives/cypress-alternative): Why teams switch from Cypress to TestChimp. - [Best Playwright alternative](https://docs.testchimp.io/alternatives/playwright-alternative): Why teams switch from Playwright to TestChimp. - [Best Katalon alternative](https://docs.testchimp.io/alternatives/katalon-studio-alternative): Why teams switch from Katalon to TestChimp. - [Best Testim alternative](https://docs.testchimp.io/alternatives/testim-alternative): Why teams switch from Testim to TestChimp. - [Best mabl alternative](https://docs.testchimp.io/alternatives/mabl-alternative): Why teams switch from mabl to TestChimp. - [Best testRigor alternative](https://docs.testchimp.io/alternatives/testrigor-alternative): Why teams switch from testRigor to TestChimp. - [Best Testsigma alternative](https://docs.testchimp.io/alternatives/testsigma-alternative): Why teams switch from Testsigma to TestChimp. - [Best Momentic alternative](https://docs.testchimp.io/alternatives/momentic-alternative): Why teams switch from Momentic to TestChimp. - [Best ContextQA alternative](https://docs.testchimp.io/alternatives/contextqa-alternative): Why teams switch from ContextQA to TestChimp. - [Best SpurTest alternative](https://docs.testchimp.io/alternatives/spurtest-alternative): Why teams switch from SpurTest to TestChimp. - [Best ACCELQ alternative](https://docs.testchimp.io/alternatives/accelq-alternative): Why teams switch from ACCELQ to TestChimp. - [Best Functionize alternative](https://docs.testchimp.io/alternatives/functionize-alternative): Why teams switch from Functionize to TestChimp. - [Best QA Wolf alternative](https://docs.testchimp.io/alternatives/qa-wolf-alternative): Why teams switch from QA Wolf to TestChimp. - [Best Reflect alternative](https://docs.testchimp.io/alternatives/reflect-alternative): Why teams switch from Reflect to TestChimp. - [Best Tricentis Tosca alternative](https://docs.testchimp.io/alternatives/tricentis-tosca-alternative): Why teams switch from Tricentis Tosca to TestChimp. - [Best Leapwork alternative](https://docs.testchimp.io/alternatives/leapwork-alternative): Why teams switch from Leapwork to TestChimp. - [Best BrowserStack alternative](https://docs.testchimp.io/alternatives/browserstack-alternative): Why teams switch from BrowserStack to TestChimp. - [Best LambdaTest alternative](https://docs.testchimp.io/alternatives/lambdatest-alternative): Why teams switch from LambdaTest to TestChimp. - [Best Sauce Labs alternative](https://docs.testchimp.io/alternatives/sauce-labs-alternative): Why teams switch from Sauce Labs to TestChimp. - [Best TestRail alternative](https://docs.testchimp.io/alternatives/testrail-alternative): Why teams switch from TestRail to TestChimp. - [Best Bugasura alternative](https://docs.testchimp.io/alternatives/bugasura-alternative): Why teams switch from Bugasura to TestChimp. - [Best XRay alternative](https://docs.testchimp.io/alternatives/xray-alternative): Why teams switch from XRay to TestChimp. - [Best Zephyr alternative](https://docs.testchimp.io/alternatives/zephyr-alternative): Why teams switch from Zephyr to TestChimp. - [Best PractiTest alternative](https://docs.testchimp.io/alternatives/practitest-alternative): Why teams switch from PractiTest to TestChimp. - [Best Qase alternative](https://docs.testchimp.io/alternatives/qase-alternative): Why teams switch from Qase to TestChimp. - [Best Claude alternative](https://docs.testchimp.io/alternatives/claude-alternative): Why teams switch from Claude to TestChimp. ## Testing guides — common gotchas - [Common E2E Testing Gotchas](https://docs.testchimp.io/guides/gotchas/intro): Selector drift, world-state pollution, flaky waits, and UI-only asserts—symptom-first fixes for Playwright maintenanc… - [E2E Tests Break When UI Selectors Change](https://docs.testchimp.io/guides/gotchas/e2e-selector-changed-breaking-test): Fix Playwright locator failures after refactors—stable data-testid and role locators, plus surgical ai.act only where… - [One E2E Test Breaks Another (World-State Mutation)](https://docs.testchimp.io/guides/gotchas/e2e-tests-mutating-shared-world-state): Stop E2E tests from polluting shared data—per-run seed routes, runId-scoped fixtures, and probe Assert so parallel CI… - [When to Use ai.act and ai.verify in Playwright](https://docs.testchimp.io/guides/gotchas/when-to-use-ai-act-ai-verify): Use TestChimp ai.act and ai.verify sparingly for genuine product variance—never replace probe Assert or stable data-t… - [UI-Only Assertions Miss Backend Bugs](https://docs.testchimp.io/guides/gotchas/ui-only-assertions-miss-backend-bugs): Why success toasts lie in E2E—use probe Assert on API/DB state; keep UI checks optional. - [Flaky Waits and Timing in Playwright](https://docs.testchimp.io/guides/gotchas/playwright-flaky-waits-and-timing): Replace waitForTimeout with expect.poll and locator auto-wait—fix timing flakes without slowing CI. - [Shared Login State Pollutes E2E Tests](https://docs.testchimp.io/guides/gotchas/e2e-shared-auth-state-pollution): Fix wrong user context and surprise 403s—storageState per worker, seed a user per runId, never reuse global admin in … - [E2E Tests Collide in Parallel CI](https://docs.testchimp.io/guides/gotchas/parallel-ci-test-data-collisions): Same email, SKU, or coupon across workers—use parallel index + unique runId seeds; never share staging users. - [Hardcoded Test Data Causes CI Flakes](https://docs.testchimp.io/guides/gotchas/hardcoded-test-data-flakes-in-ci): Expired coupons, deleted SKUs, taken emails—fixture factories and time-independent seeds beat literals in specs. - [Tests Pass Only in a Specific Order](https://docs.testchimp.io/guides/gotchas/e2e-test-order-dependency): Serial suite masks isolation bugs—independent Arrange per spec; enable parallel mode after runId seeds exist. - [Snapshot Tests Break on Benign UI Changes](https://docs.testchimp.io/guides/gotchas/snapshot-testing-too-brittle): Huge snapshot diffs on copy/CSS—structure asserts and probes beat full-page snapshots for E2E. - [Feature Flags Break E2E After Deploy](https://docs.testchimp.io/guides/gotchas/missing-feature-flag-seed-in-e2e): New variant untested; wrong funnel in CI—seed flag state in Arrange and document variants in markdown plans. - [Staging and Local E2E Drift](https://docs.testchimp.io/guides/gotchas/e2e-environment-drift-staging-vs-local): Tests pass locally but fail on preview—BASE_URL, env vars, feature flags, and API keys must match per-environment pos… - [Logging In Before Every Test Is Slow and Flaky](https://docs.testchimp.io/guides/gotchas/playwright-login-every-test-slow-flaky): UI login in beforeEach burns CI minutes and races sessions—use storageState, API token Arrange, or seed routes instead. - [Missing Teardown Leaks Test Data](https://docs.testchimp.io/guides/gotchas/e2e-missing-teardown-leaks-data): Leftover rows break later specs—prefer runId isolation over delete teardown; probe counts to catch leaks. - [Over-Mocking Hides Integration Bugs](https://docs.testchimp.io/guides/gotchas/over-mocking-e2e-misses-integration-bugs): route.fulfill on every API call passes green while prod breaks—mock LLM only; hit real routes with test env stubs at … ## Testing guides — E2E foundations - [E2E Testing Foundations](https://docs.testchimp.io/guides/foundations/intro): Seed routes, probe Assert, fixtures, and requirement traceability—the Arrange/Act/Assert building blocks behind relia… - [How to Build Seed Routes and Probe Assert for E2E](https://docs.testchimp.io/guides/foundations/testing-seed-routes-and-probe-assert): E2E test data management with per-run seed routes, probe endpoints, and // @Scenario: traceability—the expired-coupon… ## Testing guides — E2E in CI - [E2E Testing in CI](https://docs.testchimp.io/guides/ci/intro): GitHub Actions, parallel Playwright, sharding, traces, and reporter wiring for reliable per-PR E2E. - [How to Run Playwright E2E in GitHub Actions (Parallel, Sharding, Traces)](https://docs.testchimp.io/guides/ci/testing-playwright-github-actions-parallel): Playwright GitHub Actions CI—parallel workers, sharding, artifacts, and @testchimp/playwright reporting without flaky… ## Testing guides — business flows - [Testing Guides by Business Flow](https://docs.testchimp.io/guides/flows/intro): Payment, subscription, inventory, licensing, and admin flow testing—checkout to seat limits. - [How to Test Stripe Payments in Playwright (3DS, Webhooks)](https://docs.testchimp.io/guides/flows/testing-stripe-payments): Test Stripe Checkout, Elements, and 3DS in Playwright using test mode, frameLocator, webhook probes, and CI-safe fixt… - [How to Test Apple Pay, Google Pay, and PayPal Flows](https://docs.testchimp.io/guides/flows/testing-wallet-payments): E2E patterns for wallet payments—sandbox tokens, device availability, fallback to card, and probe-backed order confir… - [How to Test Subscription Billing, Trials, and Renewals](https://docs.testchimp.io/guides/flows/testing-subscriptions-billing): Test SaaS billing lifecycles—trials, proration, dunning, plan changes—with Stripe test mode, clock fixtures, and webh… - [How to Test Inventory Updates and Stock Reservations](https://docs.testchimp.io/guides/flows/testing-inventory-stock): Parallel-safe inventory E2E—oversell races, reservation timeouts, backorder paths—with seed SKUs and probe Assert. - [How to Test Tax, VAT, and Country-Specific Pricing](https://docs.testchimp.io/guides/flows/testing-tax-regional-pricing): Regional pricing and tax E2E—VAT/GST, exempt accounts, currency rounding—with geo fixtures and probe line items. - [How to Test Returns, Refunds, and Partial Credits](https://docs.testchimp.io/guides/flows/testing-returns-refunds): Refund flow testing—partial credits, store credit, return windows—with Stripe test refunds and webhook probes. - [How to Test Shipping Rates and Fulfillment Status](https://docs.testchimp.io/guides/flows/testing-shipping-fulfillment): Shipping E2E—zone tables, free-shipping thresholds, split shipments—with weight fixtures and status probes. - [How to Test Multi-Vendor Marketplace Checkout](https://docs.testchimp.io/guides/flows/testing-marketplace-flows): Marketplace E2E—multi-vendor carts, split payouts, vendor shipping—with vendor seeds and commission probes. - [How to Test Product Configurators and Custom Builds](https://docs.testchimp.io/guides/flows/testing-product-configurators): Configurator E2E—invalid combinations, price recalc, saved builds—with option fixtures and price probes. - [How to Test Free Trial to Paid Conversion](https://docs.testchimp.io/guides/flows/testing-trial-to-paid): Trial conversion E2E—expiry without card, mid-trial upgrade, feature lock—with billing seeds and entitlement probes. - [How to Test Seat Limits, Invites, and Team Growth](https://docs.testchimp.io/guides/flows/testing-seat-licensing): Seat licensing E2E—at-limit invites, seat reclaim, overage billing—with org fixtures and seat-count probes. - [How to Test Plan Limits and Feature Flags](https://docs.testchimp.io/guides/flows/testing-feature-entitlements): Entitlement E2E—gated UI vs API 403, metered limits, grandfathered features—with plan seeds and probes. - [How to Test Admin Dashboards and Role Permissions](https://docs.testchimp.io/guides/flows/testing-admin-rbac): Admin RBAC E2E—impersonation, privilege escalation negatives, audit trails—with role fixture users and probes. - [How to Test Usage-Based Billing Meters](https://docs.testchimp.io/guides/flows/testing-usage-metering): Usage metering E2E—rollover credits, burst limits, period boundaries—with clock fixtures and meter probes. - [How to Test BNPL Checkout (Klarna, Affirm, Afterpay)](https://docs.testchimp.io/guides/flows/testing-bnpl-checkout): BNPL E2E—redirect flows, approval/denial, webhook settlement, and probe Assert when payment is not immediate card cap… - [How to Test Referral and Invite Programs](https://docs.testchimp.io/guides/flows/testing-referral-invite-programs): Referral E2E—invite links, attribution cookies, double-redemption, and probe Assert on reward ledger—not vanity UI co… - [How to Test Plaid and Open Banking Flows in E2E](https://docs.testchimp.io/guides/flows/testing-plaid-open-banking): Plaid Link E2E—sandbox institutions, OAuth redirect, account selection, and probe Assert on linked accounts and balan… ## Testing guides — auth & identity - [Testing Guides for Auth and Identity](https://docs.testchimp.io/guides/auth/intro): Firebase, OAuth, MFA, CAPTCHA, RBAC, and session testing—enterprise-grade auth E2E patterns. - [How to Test Firebase Authentication Flows](https://docs.testchimp.io/guides/auth/testing-firebase-auth): Test Firebase Auth in E2E with the Auth emulator, custom tokens, email verification, and CI-safe per-run users—withou… - [How to Test Auth0 and Okta SSO in E2E](https://docs.testchimp.io/guides/auth/testing-auth0-okta-sso): Enterprise SSO E2E—test tenants, programmatic login, connection routing, and session refresh without brittle UI-only … - [How to Test Google, GitHub, and Social OAuth](https://docs.testchimp.io/guides/auth/testing-oauth-social-login): Social OAuth E2E—popup vs redirect, denied consent, account linking—with sandbox apps and session probes. - [How to Test Magic Links and Passwordless Login](https://docs.testchimp.io/guides/auth/testing-magic-link-passwordless): Passwordless E2E—Mailtrap inboxes, link expiry, bot prefetch—with disposable emails and probe session creation. - [How to Test MFA and 2FA Flows](https://docs.testchimp.io/guides/auth/testing-mfa-2fa): MFA E2E—TOTP seeds, backup codes, SMS stubs, recovery flows—with clock-aware fixtures and probe enforcement. - [How to Test CAPTCHA-Enabled Flows Without Flakiness](https://docs.testchimp.io/guides/auth/testing-captcha-flows): CAPTCHA E2E—reCAPTCHA test keys, hCaptcha test mode, invisible CAPTCHA—without brittle solver hacks in CI. - [How to Test Role-Based Access Control Matrices](https://docs.testchimp.io/guides/auth/testing-rbac-permissions): RBAC E2E—role × resource × action matrices, 403 vs hidden UI, inherited roles—with fixture users and probes. - [How to Test Session Expiry, Refresh Tokens, and Idle Logout](https://docs.testchimp.io/guides/auth/testing-session-timeout): Session lifecycle E2E—idle timeout, refresh rotation, concurrent sessions—with Playwright clock and token probes. - [How to Test Clerk Authentication in Playwright](https://docs.testchimp.io/guides/auth/testing-clerk-auth-playwright): Clerk E2E—programmatic sign-in, org switching, session tokens, and per-run users without brittle hosted UI clicks in … - [How to Test Passkeys and WebAuthn in Playwright](https://docs.testchimp.io/guides/auth/testing-passkeys-webauthn-playwright): Passkey E2E—virtual authenticators, registration vs login, and fallback paths when WebAuthn is unavailable in CI. ## Testing guides — AI & conversational UX - [Testing Guides for AI and Conversational UX](https://docs.testchimp.io/guides/ai/intro): Chatbots, agents, RAG, LLM output validation, streaming, and canvas—evals plus E2E with AIMock, ai.act/ai.verify, and… - [How to Test Chatbots and Conversational UIs](https://docs.testchimp.io/guides/ai/testing-conversational-ui): Test chatbots and conversational UI with hybrid Playwright, AIMock golden responses, offline evals, and probe Assert—… - [How to Test AI Agent Workflows and Tool Calling](https://docs.testchimp.io/guides/ai/testing-ai-agent-workflows): Agent workflow E2E—tool failure, retries, idempotent side effects, human approval—with stub APIs and probe Assert. - [How to Test RAG and Knowledge-Base Search](https://docs.testchimp.io/guides/ai/testing-rag-search): RAG E2E—fixture corpora, citation checks, empty retrieval, access control—with evals for recall and probes for retrie… - [How to Test LLM Output Quality in E2E](https://docs.testchimp.io/guides/ai/testing-llm-output-validation): LLM output validation—structured JSON, semantic checks, golden sets—with evals for regression and AIMock for determin… - [How to Test Streaming AI Responses](https://docs.testchimp.io/guides/ai/testing-ai-streaming-responses): Streaming LLM UI E2E—partial render, abort, error mid-stream—with completion waits and final-state asserts. - [How to Test Canvas, Charts, and Visual Widgets](https://docs.testchimp.io/guides/ai/testing-canvas-visual-interactions): Canvas and chart E2E—coordinate-free ai.act, WebGL stability, drill-down—with probes for data state over pixel clicks. ## Testing guides — integrations - [Testing Guides for Integrations](https://docs.testchimp.io/guides/integrations/intro): Stripe webhooks, email, SMS, maps, PDFs, Supabase—third-party integration E2E. - [How to Test Stripe Webhooks in CI](https://docs.testchimp.io/guides/integrations/testing-stripe-webhooks): Stripe webhook E2E—signature verification, idempotency, missed events, out-of-order delivery—with Stripe CLI and prob… - [How to Test Transactional Email Flows](https://docs.testchimp.io/guides/integrations/testing-transactional-email): Email E2E with Mailtrap or similar—verification, OTP, password reset—with disposable inboxes and parallel-safe workers. - [How to Test SMS and OTP Verification](https://docs.testchimp.io/guides/integrations/testing-sms-otp): SMS OTP E2E—Twilio test credentials, virtual numbers, resend cooldown—with API inbox or stub provider. - [How to Test Webhooks and Async Event Processing](https://docs.testchimp.io/guides/integrations/testing-webhooks-async): Generic webhook E2E—idempotency, out-of-order events, poison messages—with polling probes and DLQ patterns. - [How to Test Map Interactions and Geolocation](https://docs.testchimp.io/guides/integrations/testing-google-maps): Map E2E—geolocation mock, Places autocomplete, marker clicks—with stable seeds and ai.act for pan/zoom. - [How to Test PDF Generation and Downloads](https://docs.testchimp.io/guides/integrations/testing-pdf-downloads): PDF E2E—waitForEvent download, pdf-parse text assert, dynamic dates—with probe and file validation. - [How to Test File Upload Flows (CSV, Images, Docs)](https://docs.testchimp.io/guides/integrations/testing-file-uploads): File upload E2E—setInputFiles, size limits, MIME rejection, virus-scan pending—with fixture files and probes. - [How to Test CSV Import and Export](https://docs.testchimp.io/guides/integrations/testing-csv-import-export): CSV E2E—malformed rows, header mismatch, export encoding—with seed files and parsed Assert. - [How to Test Web Push Notification Preferences](https://docs.testchimp.io/guides/integrations/testing-push-notifications): Push notification E2E—permission prompts, unsubscribe, payload deep links—with service worker stubs. - [How to Test Embedded Widgets and iFrames](https://docs.testchimp.io/guides/integrations/testing-third-party-embeds): iframe E2E—frameLocator, cross-origin embeds, SDK load race—for Stripe-like widgets and partner embeds. - [How to Test Supabase Apps with Playwright](https://docs.testchimp.io/guides/integrations/testing-supabase-playwright): Supabase E2E—Auth, RLS, and Realtime with service-role seeds, per-run users, and probe Assert for Lovable and Next.js… - [How to Test Next.js App Router and Server Actions in E2E](https://docs.testchimp.io/guides/integrations/testing-nextjs-app-router-server-actions): Next.js E2E—App Router navigation, Server Actions, route handlers, and probe Assert for mutations RSC UI cannot prove… - [How to Test Algolia and Elasticsearch Search in E2E](https://docs.testchimp.io/guides/integrations/testing-algolia-elasticsearch-search): Search index E2E—seed catalog, wait for indexing, assert result sets via probe or stable DOM—with debounce and facet … ## Testing guides — UI patterns - [Testing Guides for UI Patterns](https://docs.testchimp.io/guides/patterns/intro): Forms, search, i18n, websockets, grids, GDPR, non-functional—cross-cutting UI pattern testing. - [How to Test Form Validation and Error States](https://docs.testchimp.io/guides/patterns/testing-form-validation): Form validation E2E—client vs server rules, async errors, accessibility—with field-level scenarios and probe Assert. - [How to Test Search, Filters, and Faceted Navigation](https://docs.testchimp.io/guides/patterns/testing-search-filters): Search and filter E2E—URL state, zero results, filter combos—with seed catalog and result-count probes. - [How to Test Infinite Scroll and Pagination](https://docs.testchimp.io/guides/patterns/testing-infinite-scroll): Infinite scroll E2E—duplicate fetch prevention, end-of-list, scroll container—with network wait patterns. - [How to Test Drag-and-Drop and Sortable Lists](https://docs.testchimp.io/guides/patterns/testing-drag-and-drop): Drag-and-drop E2E—dragTo, library-specific handlers, touch—with probe order Assert. - [How to Test Rich Text and WYSIWYG Editors](https://docs.testchimp.io/guides/patterns/testing-rich-text-editors): WYSIWYG E2E—contenteditable, toolbar, paste sanitization—with probe stored HTML Assert. - [How to Test Dates, Timezones, and Scheduling](https://docs.testchimp.io/guides/patterns/testing-date-time-timezones): Date/time E2E—Playwright clock, DST boundaries, UTC vs local display—with frozen time fixtures. - [How to Test Localization and i18n Flows](https://docs.testchimp.io/guides/patterns/testing-localization-i18n): i18n E2E—locale switch, RTL, currency format—with locale fixtures and ExploreChimp for layout breaks. - [How to Test WebSockets and Live UI Updates](https://docs.testchimp.io/guides/patterns/testing-websockets-live-updates): WebSocket E2E—event ordering, reconnect, stale UI—with message fixtures and probe fallback. - [How to Test Video and Audio Player Controls](https://docs.testchimp.io/guides/patterns/testing-video-audio-players): Media player E2E—play/pause, seek, captions, autoplay policies—with stub media assets. - [How to Test Data Grids, Sorting, and Bulk Actions](https://docs.testchimp.io/guides/patterns/testing-data-grids-tables): Data grid E2E—virtual scroll, sort+filter combos, bulk select—with row-id probes. - [How to Test Calendar Booking and Scheduling](https://docs.testchimp.io/guides/patterns/testing-calendar-scheduling): Scheduling E2E—slot availability, timezone, double-booking prevention—with slot seeds and booking probes. - [How to Test GDPR Export, Delete, and Consent Flows](https://docs.testchimp.io/guides/patterns/testing-gdpr-privacy): Privacy E2E—data export completeness, delete cascade, consent version—with audit probes and regulatory fixtures. - [How to Catch Non-Functional Bugs in E2E (UX, Performance, Accessibility)](https://docs.testchimp.io/guides/patterns/testing-non-functional-bugs-e2e): Beyond functional asserts—ExploreChimp on SmartTest paths for latency, confusing errors, accessibility gaps, and visu… - [How to Test Mobile Web and Responsive Checkout](https://docs.testchimp.io/guides/patterns/testing-mobile-web-responsive-checkout): Mobile viewport E2E—touch targets, sticky CTAs, Apple Pay/Google Pay, and probe Assert—bridge to Mobilewright for nat… ## Testing guides — by industry - [Industry guides hub](https://docs.testchimp.io/guides/verticals/intro): Industry-specific QA guides—ecommerce, fintech, AI apps, and SaaS. - [How to Test Ecommerce Checkout Flows Without Flaky Tests](https://docs.testchimp.io/guides/verticals/testing-ecommerce-checkout-flows): Reliable checkout automation with fixture-backed Arrange, probe assertions, and test runs. - [How to Test Cart and Promo Code Scenarios](https://docs.testchimp.io/guides/verticals/testing-ecommerce-cart-and-coupons): Parallel-safe coupon and cart tests for startups. - [How Startups Test Fintech Web Apps](https://docs.testchimp.io/guides/verticals/testing-fintech-web-apps): Fixture-backed transfers, probes, and form validation for fintech QA. - [Why E2E Tests Flake and How Startups Fix Them](https://docs.testchimp.io/guides/verticals/testing-flaky-e2e-tests-startups): World-state, fixtures, and hybrid SmartTests for reliable CI. - [How to Test AI-Powered Web Applications](https://docs.testchimp.io/guides/verticals/testing-ai-web-apps): Hybrid Playwright with surgical ai.act/ai.verify for non-deterministic UI. - [How to Test SaaS Onboarding Flows](https://docs.testchimp.io/guides/verticals/testing-saas-onboarding-flows): Screen-state annotations and ExploreChimp for onboarding QA. - [How to Test HR and Applicant Tracking Flows](https://docs.testchimp.io/guides/verticals/testing-hr-applications): HR/ATS E2E—multi-stage pipelines, knock-out questions, PII handling—with stage fixtures and compliance-aware probes. - [How to Test Healthcare Patient Portals](https://docs.testchimp.io/guides/verticals/testing-healthcare-portals): Patient portal E2E—role separation, appointment policies, PHI-safe test data—with HIPAA-aware fixtures. - [How to Test EdTech Course Enrollment and Progress](https://docs.testchimp.io/guides/verticals/testing-edtech-enrollment): EdTech E2E—prerequisites, waitlist, progress tracking—with enrollment seeds and progress probes. - [How to Test Insurance Quote and Bind Flows](https://docs.testchimp.io/guides/verticals/testing-insurance-quotes): Insurance quote E2E—multi-step wizards, rating tables, bind vs quote-only—with rate fixture seeds. - [How to Test Real Estate Search and Listing Flows](https://docs.testchimp.io/guides/verticals/testing-real-estate-listings): Real estate E2E—map+list sync, saved searches, filters—with geo listing seeds. - [How to Test E-Signature and Document Workflows](https://docs.testchimp.io/guides/verticals/testing-legal-esignatures): E-sign E2E—sign order, envelope expiry, witness flows—with DocuSign sandbox and PDF Assert. - [How to Test CMS Content Publishing Workflows](https://docs.testchimp.io/guides/verticals/testing-cms-publishing): CMS E2E—draft, preview, scheduled publish, rollback—with content state probes. - [How to Test Audit Logs and Compliance Trails](https://docs.testchimp.io/guides/verticals/testing-audit-compliance-logs): Audit log E2E—immutable trails, who-did-what, retention—with probe on log entries. - [How to Test Travel and Booking Flows](https://docs.testchimp.io/guides/verticals/testing-travel-booking-flows): Travel E2E—date-bound inventory, cancellation policies, fare holds, and timezone-aware probes for hotels and flights. - [How to Test Multi-Tenant SaaS Data Isolation](https://docs.testchimp.io/guides/verticals/testing-multi-tenant-saas-isolation): Tenant isolation E2E—IDOR via guessed URLs, cross-org API access, RLS leaks—with negative probes per tenant runId. ## Testing guides — built with (Lovable, Cursor, agents) - [Testing Apps Built With…](https://docs.testchimp.io/guides/built-with/intro): QA for apps built with Lovable, Cursor, Claude Code, Bolt, Replit, and other agent tools. - [Testing Vibe-Coded Apps](https://docs.testchimp.io/guides/built-with/testing-vibe-coded-apps): Why E2E and per-PR QA matter when you ship via vibe coding. - [Testing Apps Built with Lovable](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-lovable): Per-PR TestChimp QA for Lovable apps—beyond happy-path demos. - [Testing Apps Built with Replit](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-replit): Preview URL testing and SmartTests for Replit-shipped apps. - [Testing Apps Built with Cursor](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-cursor): TestChimp skill + per-PR /testchimp test for Cursor-built codebases. - [Testing Apps Built with Claude Code](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-claude-code): Autonomous QA with Claude Code and the TestChimp skill. - [Testing Apps Built with GitHub Copilot](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-github-copilot): From Copilot one-off tests to orchestrated per-PR QA. - [Testing Apps Built with Windsurf](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-windsurf): Per-PR TestChimp QA for Windsurf Cascade-built codebases. - [Testing Apps Built with OpenAI Codex](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-codex): SmartTests and orchestration for Codex-assisted repos. - [QA Workflow for Agent-Built Apps](https://docs.testchimp.io/guides/built-with/agent-built-apps-qa-workflow): Per-PR loop: requirements, TrueCoverage, test runs, and SmartTests. - [Testing Apps Built with Bolt](https://docs.testchimp.io/guides/built-with/testing-apps-built-with-bolt): Per-PR E2E QA for Bolt.new apps—seed routes, probes, and SmartTests beyond preview demos. ## QA in the Age of AI (thought leadership) - [QA in the Age of AI hub](https://docs.testchimp.io/qa-in-the-age-of-ai/intro): Modern QA is shifting to AI-driven test creation and execution. - [What is AI in QA testing?](https://docs.testchimp.io/qa-in-the-age-of-ai/what-is-ai-in-qa-testing): AI in QA—from test generation to runtime intelligence in SmartTests. - [AI test generation explained](https://docs.testchimp.io/qa-in-the-age-of-ai/ai-test-generation-explained): How AI test generation works with Playwright SmartTests and agents. - [Why traditional QA breaks in fast teams](https://docs.testchimp.io/qa-in-the-age-of-ai/why-traditional-qa-breaks-in-fast-teams): Spreadsheets, record-replay, and slow TMS fail when you ship daily. - [E2E testing for startups — practical framework](https://docs.testchimp.io/qa-in-the-age-of-ai/e2e-testing-startups-practical-framework): Lean E2E QA strategy—seed routes, probe Assert, markdown plans, and the /testchimp loop. - [Probe Assert vs UI assertions](https://docs.testchimp.io/qa-in-the-age-of-ai/probe-assert-vs-ui-assertions): When probe endpoints beat UI checks—the expired-coupon pattern and assertion methodology. - [QA without a dedicated team](https://docs.testchimp.io/qa-in-the-age-of-ai/qa-without-dedicated-team): Developer-led QA—automate quality without hiring via SmartTests and agent orchestration. ## Commercial / high-intent pages - [Solutions hub](https://docs.testchimp.io/landing/intro): Commercial intent pages for AI testing and autonomous QA. - [AI testing tool for startups](https://docs.testchimp.io/landing/ai-testing-tool): TestChimp—AI-native QA with SmartTests, planning, and TrueCoverage for fast teams. - [Autonomous QA platform](https://docs.testchimp.io/landing/autonomous-qa-platform): Agent-orchestrated QA with /testchimp init, test, explore, and evolve. - [AI test generation tool](https://docs.testchimp.io/landing/ai-test-generation-tool): Generate and maintain Playwright SmartTests with AI—without vendor lock-in. - [Selenium replacement tool](https://docs.testchimp.io/landing/selenium-replacement-tool): Modern Playwright SmartTests with AI steps for teams outgrowing Selenium. - [Modern QA automation platform](https://docs.testchimp.io/landing/modern-qa-automation-platform): Planning, automation, exploration, and TrueCoverage in one workflow. ## QA Solutions (services) - [QA Solutions overview](https://docs.testchimp.io/qa-solutions/intro): TestChimp QA Solutions help startups stand up agent-ready QA—coverage intelligence, repo bootstrap, dedicated executi… - [QA infra bootstrap](https://docs.testchimp.io/qa-solutions/qa-infra-bootstrap): QA infra bootstrap accelerates what /testchimp init delivers—CI pipelines, seed/teardown endpoints, fixtures, mocking… - [TrueCoverage setup](https://docs.testchimp.io/qa-solutions/truecoverage-setup): TrueCoverage setup implements consistent event emits on web/iOS/Android, wires @testchimp/playwright, and configures … ## Blog - [Blog index](https://docs.testchimp.io/blog): Product updates, TrueCoverage, fixtures, shift-left QA, and agent workflows ## Optional / unlisted (reachable but not in sitemap) - [Quiz](https://docs.testchimp.io/quiz): Interactive docs quiz (unlisted) - [Import from Jira](https://docs.testchimp.io/test-planning/import-from-jira): Legacy import doc (unlisted) ## Crawling - Full sitemap (indexed docs + blog, ~241 URLs): https://docs.testchimp.io/sitemap.xml - Excluded from sitemap (unlisted): quiz, test-planning/import-from-jira, chrome-extension/bug-analytics, reporting-bugs, visual-vibe-coding - Robots: https://docs.testchimp.io/robots.txt (allows GPTBot, OAI-SearchBot) - This file: https://docs.testchimp.io/llms.txt ## External - TestChimp app: https://prod.testchimp.io - Signup: https://prod.testchimp.io/signup - TestChimp skill (agents): https://github.com/testchimphq/testchimp-skills - GitHub: https://github.com/testchimphq