Core Concepts
Test Runs
Understanding Test Execution and Results in Iris
Test runs represent individual executions of tests by Iris agents. Each test run captures the complete journey of a test, including interactions, validations, and results.
Understanding Test Runs
Execution History
Complete record of test progression
Agent Activity
Detailed agent interactions and decisions
Visual Evidence
Screenshots and recordings
Results
Performance metrics and outcomes
Test Run Lifecycle
1
Initialization
Agent preparation
Environment setup
Resource allocation
Configuration loading
2
Execution
Step-by-step progression
Real-time monitoring
Error handling
State management
3
Completion
Result compilation
Resource cleanup
Report generation
Notification dispatch
Test Run Data
Timing
Execution timestamps and duration
Actions
Detailed agent activities
Responses
System feedback and states
Evidence
Visual proof and logs
Real-time Monitoring
Monitoring Features
Live Tracking
Progress monitoring
Agent activity tracking
Error detection
Performance analysis
Control Options
Interventions
Pause execution
Manual override
Debug mode
Emergency stop
Results and Reporting
Troubleshooting
Known Problems
Failed executions
Timeout issues
Resource constraints
Integration errors
Historical Data
Storage
Data Management
Result archival
Log retention
Evidence backup
Analysis
Analytical Tools
Trend visualization
Performance graphs
Coverage mapping