Skip to main content

Test Plan Generation

Generating Test Plans from User Stories​

TestChimp can generate comprehensive test plans from user stories:

  1. Open a user story in the User Stories section
  2. Click "Test with ExploreChimp" at the bottom left
  3. TestChimp will first generate a thorough test plan
  4. The test plan is formulated as a set of journeys the agent will take to verify different expectations

Test Plan Structure and Components​

A test plan consists of:

Journeys​

Each journey represents a path through your application to verify specific expectations:

  • Journey description: What this journey is testing
  • Steps: The sequence of actions to take
  • Verifications: What to check at each step
  • Expected outcomes: What should happen

Test Scenarios​

The test plan includes multiple test scenarios:

  • Happy path: The primary user flow
  • Error scenarios: What happens when things go wrong
  • Edge cases: Unusual but valid inputs or conditions
  • Boundary conditions: Limits and boundaries

Coverage Areas​

The test plan identifies:

  • Which screens and states to test
  • Which features to verify
  • Which user flows to cover

Editing Test Plans​

After TestChimp generates a test plan:

  1. Review the plan: Examine each journey and scenario
  2. Edit as needed: Modify journeys, add or remove scenarios, adjust verifications
  3. Add context: Include additional context if needed
  4. Save changes: Your edits are saved before execution

Executing Test Plans with ExploreChimp​

Once you're satisfied with the test plan:

  1. Click "Run" to start execution
  2. ExploreChimp executes the exploration using a journey plan based exploration recipe
  3. The agent follows the journeys defined in the test plan, executing the steps and performing the verifications identified in the plan
  4. It checks for the verifications identified in the plan
  5. Results are displayed in real-time
  6. Bugs and issues are tagged at the appropriate screen-states

Note: The journey plan based exploration recipe is used internally by TestChimp for executing test plans generated from user stories. This recipe guides ExploreChimp through the specific journeys and verifications defined in your test plan, ensuring comprehensive coverage of the user story requirements.

Test Plan Workflow and Best Practices​

Workflow​

  1. Create user story: Author or import a user story
  2. Generate test plan: Use "Test with ExploreChimp" to generate a plan
  3. Review and edit: Review the plan and make adjustments
  4. Execute: Run the test plan with ExploreChimp
  5. Review results: Examine bugs and issues found
  6. Iterate: Update the test plan based on results if needed

Best Practices​

  1. Start with clear user stories: Well-defined user stories lead to better test plans
  2. Review generated plans: Always review and adjust the generated plan
  3. Include edge cases: Ensure the plan covers error scenarios and edge cases
  4. Use context: Leverage the Context Window to provide additional context
  5. Iterate: Update test plans based on what you learn from execution
  6. Document decisions: Note why certain scenarios are included or excluded

Test plan generation automates the creation of comprehensive test plans while allowing you to maintain control and make adjustments as needed.