What is TestChimp?

TestChimp is an Agentic UX tester that uses SmartTests for guided, precise explorations. During explorations, it builds a rich understanding about your app's runtime behavior - which we call Atlas - that is utilized for providing context-aware AI assistance to QA workflows.

Core Components: Explorations, Atlas, and SmartTests

TestChimp consists of three interconnected components:

1. Explorations: AI-driven journeys through your application that identify bugs by analyzing DOM, screenshots, network activity, console logs, and browser metrics. Explorations are the primary mechanism for catching UX issues.

2. Atlas: The knowledge base that TestChimp builds during explorations. It captures your application's structure (screens and states in the SiteMap) and behavior (navigation pathways in the Behaviour Map). Atlas provides the context needed for intelligent QA assistance.

3. SmartTests: Playwright scripts that guide explorations methodically. SmartTests enable deterministic, repeatable explorations by defining the baseline journeys the agent follows, while still allowing intelligent branching when issues are detected.

How they work together: SmartTests guide Explorations → Explorations build Atlas → Atlas provides context for future Explorations and QA workflows. This creates a continuous learning cycle that improves over time.

How TestChimp Catches Bugs

TestChimp catches bugs by running Explorations across your real UI. During these explorations, the agent navigates through your application and identifies issues by analyzing multiple data sources:

• DOM (Document Object Model)
• Screenshots
• Network activity
• Console logs
• Browser metrics

ExploreChimp navigating through your application

Examples of Bugs Caught

TestChimp identifies various types of bugs across multiple categories:

• Visual and Layout Issues: Layout breakages, visual polish issues, alignment problems, missing images
• Performance Issues: Slow interactions, long tasks blocking the main thread, slow load times, janky animations
• Performance Regressions: Performance metric degradations detected by comparing against baseline thresholds
• Usability and Accessibility: Confusing flows, unclear UI elements, missing alt texts, labels, and tab indexes
• Content Issues: Ambiguous content, dangling template strings, grammar/spelling errors
• Security Issues: Missing security headers, vulnerabilities detected in network analysis
• Visual Regressions: Unintended UI changes detected by comparing against baseline images

Explorations can be:

• Guided by SmartTests: Deterministic, script-driven journeys that walk through critical flows in a controlled, repeatable way.
• Autonomous explorations based on a prompt: The agent explores more freely based on a high-level goal you provide.

SmartTests are what make explorations methodical and controlled: they define the baseline journeys, give you repeatable coverage you can trust, and still allow the agent to branch off intelligently when it sees interesting behavior or potential issues.

Bugs are tagged at the specific screen-state where they were identified, providing contextual understanding of where issues occur. All bugs can be viewed in the Atlas SiteMap.

SmartTests: The Foundation

SmartTests are Playwright scripts that power TestChimp's guided explorations, optionally enhanced with:

• Intent comments: Human-readable descriptions that help the agent understand test steps (optional)
• AI-native steps: Natural language actions (ai.act) and verifications (ai.verify) that adapt to UI changes
• Screen-state annotations: Tags that identify where bugs occur in your application (optional)

This combination enables SmartTests to be both fast and deterministic (like traditional scripts) while remaining adaptable when things change (like AI agents). The explore agent uses SmartTests to deterministically navigate through your application, enabling rich, repeatable explorations that identify UX issues.

TestChimp Web IDE for creating and managing SmartTests

Two-Fold Learnings

TestChimp builds knowledge in two key areas:

1. Structure: The distinct screens and states of your application, captured in the Atlas SiteMap
2. Behavior: The navigational pathways through your app, captured in the Atlas Behaviour Map

Atlas SiteMap showing application structure and bugs

Collectively, this knowledge enables TestChimp to provide intelligent assistance across your QA workflow.