Synthesized QA

From Discovery to Tests

Now that discovery has analyzed your application and identified testable components, you can generate test cases automatically. The AI will create both UI and API tests based on the artifacts discovered in the previous step.

Step 1: Click "Generate Tests"

From the Discovery Results page, locate the green "Generate Tests" button. This button appears after a successful discovery session and opens the test generation modal.

Alternatively, you can:

Navigate to the Tests page and click "Generate More"
Use the AI Chat assistant to request test generation conversationally

Step 2: Choose Generation Mode

The test generation modal presents three modes, each with different coverage and time requirements. Choose the mode that best fits your current needs:

Speed Mode

Tests generated: 15-30 tests
Estimated time: ~5-10 minutes
Best for: Quick validation of critical flows
Coverage: Essential functionality and happy paths

Use Speed mode when you need rapid feedback on core functionality or want to quickly validate that the test generation process works with your application.

Balance Mode (Recommended)

Tests generated: 50-100 tests
Estimated time: ~20-40 minutes
Best for: Balanced coverage of major features
Coverage: Most important functionality including positive and negative scenarios

Recommended for first-time users. Balance mode provides comprehensive coverage without taking excessive time. It generates enough tests to validate all major features while completing in a reasonable timeframe.

Coverage Mode

Tests generated: 100+ tests
Estimated time: ~1+ hours
Best for: Comprehensive test coverage
Coverage: Extensive testing including edge cases, error conditions, and boundary values

Use Coverage mode for production-grade test suites or when you need exhaustive validation across all discovered functionality.

Step 3: Select Artifacts

After choosing a generation mode, you'll see a list of artifact categories with selection options. Choose which discovered components should be used as the basis for test generation.

Detected UI Pages

Expand this section to see all UI pages discovered during system discovery. Select the pages you want to generate tests for:

Check individual pages to test specific functionality
Use "Select All" to generate tests for every discovered page
Tests will validate page loading, key elements, and user interactions

Detected API Methods

Shows all REST API endpoints discovered from your API specification. Select endpoints to generate:

Request validation tests (correct parameters, authentication)
Response validation tests (status codes, response schemas)
Error handling tests (invalid inputs, missing authentication)
Data integrity tests (CRUD operations)

Jira User Stories

If you connected Jira during discovery, select user stories to generate behavior-driven tests that validate acceptance criteria.

Discovered Entities

Select business entities (User, Order, Product, etc.) to generate tests for data operations:

Create entity instances
Read and validate entity data
Update entity properties
Delete entities

User Flows

Choose multi-step workflows to generate end-to-end integration tests that validate complete user journeys from start to finish.

Step 4: Start Generation

Once you've selected your artifacts and generation mode, click the "Generate Test"button at the bottom of the modal. The system will begin generating tests based on your selections.

Step 5: Monitor Generation Progress

Test generation runs in the background. You'll see:

A progress indicator showing generation status
Real-time updates as tests are created
Estimated time remaining

You can navigate away from the page during generation - the process will continue running. Return to the Tests page to check progress at any time.

Step 6: Review Generated Tests

When generation completes, navigate to the Tests page. You'll see all generated tests listed with the following details:

Test Name - Descriptive name indicating what the test validates
Type - Either "UI" or "API"
Status - Initially "Review" (pending acceptance)
Based On - The artifact used to generate this test
Last Update - When the test was generated

Step 7: Accept Tests

Generated tests start in "Review" status and must be accepted before they can be run. Review the test descriptions and accept the ones you want to include in your test suite.

Accept Individual Tests

Click on a test name to view its details
Review the test description, steps, and expected results
Click the "Accept" button if the test looks good
Or click "Decline" to reject tests that aren't relevant

Bulk Accept Tests

To quickly accept multiple tests:

On the Tests page, look for the "Ungrouped" section containing all new tests
Click the "Accept Group" button to accept all tests in the group at once
Or select individual checkboxes and click "Accept Selected"

Tip: Start with Balance mode and accept the generated tests. You can always generate more tests later or create custom tests manually.

Step 8: Navigate to Tests Page

Once you've accepted tests, they'll appear in the main Tests list with "Pending" status. The Tests page shows:

Total Tests: Count of all tests in the project
Status Breakdown: Tests by status (Passing, Failing, Pending, Review)
Test List: Sortable and filterable table of all tests

Step 9: Run Your First Test

Now for the exciting part - running your test! You have several options:

Run a Single Test

Find the test you want to run in the Tests list
Click the play button (▶) in the Actions column
Select the target environment from the dropdown
Click "Run Test"

Run Multiple Tests

Check the boxes next to the tests you want to run
Click "Run Selected" at the top of the list
Choose the environment
Click "Run Tests"

Run All Tests

Click the green "Run All" button in the top-right corner
Select the environment (ensure it's the one you configured earlier)
Confirm to start execution

Step 10: View Test Results

While tests are running, you can monitor their progress in real-time:

Status updates - Watch as test status changes from "Pending" to "Running"
Live logs - See execution details as tests proceed
Run progress - Track how many tests have completed

Understanding Test Status

After execution, each test will have one of these statuses:

✅ Passing - Test completed successfully, all assertions passed
❌ Failing - Test completed but one or more assertions failed
⏳ Pending - Test hasn't been run yet
🔍 Review - New test awaiting acceptance

View Detailed Results

Click on any test run to see:

Execution timeline - Step-by-step breakdown of test execution
Screenshots - Visual captures at key points (for UI tests)
Logs - Detailed execution logs and error messages
Request/Response data - API call details (for API tests)
Failure reason - If the test failed, why it failed

Test Run History

Navigate to Run History in the sidebar to see:

All past test executions
Run duration and timestamp
Pass/fail rates over time
Environment used for each run

Congratulations!

You've successfully completed the core workflow of Synthesized QA:

✅ Created a project
✅ Configured an environment
✅ Ran discovery to analyze your application
✅ Generated tests from discovered artifacts
✅ Executed tests and viewed results

What's Next?

Now that you understand the basics, explore these advanced features:

AI Chat Assistant - Create and manage tests conversationally
Reports Dashboard - Analyze test trends and quality metrics
Environment Components - Configure additional environment settings (API keys, OAuth, custom scripts)
Test Management - Organize tests into groups, edit test definitions, manage test lifecycle
Multiple Environments - Test the same suite across dev, staging, and production

Tips for Success

Start with Balance mode for your first test generation
Accept and run tests incrementally rather than all at once
Review failing tests to understand what needs fixing in your application
Re-run discovery when your application changes significantly
Use the Chat assistant for quick test modifications or questions

Generate & Run Your First Test