Two ways to run Verify
Pull request runs donât use your saved user journeys, and user journey runs donât post on pull requests. See Test pull requests and User journeys.
How a run works
A run moves through these stages. On the Activity page, a waiting run shows Queued, then In progress with the stage name.- Queued: the run waits for its turn, for example while another run on the same pull request finishes or while a sandbox becomes available.
- Inspecting and Preparing: Verify finds the repositoryâs environment and restores its prepared snapshot in a new sandbox, with the code to test checked out.
- Generating (pull request runs only): Verify reads the diff and explores the repository, and writes test scenarios for the behavior the change affects. If the change has no material effect, Verify can select no scenarios, and the run is Skipped.
- Testing: Verify starts your app with the environmentâs startup script, confirms that it is ready, and works through each scenario or user journey. It takes screenshots and records the browser session as it goes.
- Aggregating and Publishing: Verify gives each scenario or journey one outcome, links each bug to the same bug found in earlier runs of the repository, and publishes the results.
Key concepts
Where Verify lives
- In the CodeRabbit app: select Verify in the sidebar to open the list of repositories youâve added. A repositoryâs page has two groups: Pull Requests, with PR runs and Settings, and Journey Testing, with User journeys, Run history, Bugs, Blockers, Schedules, and Settings.
- Pull request testing settings: select Review > Verify in the sidebar, or Pull Requests > Settings on the repositoryâs page.
- Activity: runs and outcomes across all your repositories, at app.coderabbit.ai/verify/activity.
- On the pull request: one CodeRabbit Verify comment that Verify keeps up to date, with links to the pull requestâs Verify tab in Change Stack.
.coderabbit.yaml settings. You add and configure each repository in the app.
Availability
- Verify is available on CodeRabbit Cloud for GitHub Cloud, GitLab.com, and Bitbucket Cloud repositories. See Access and billing.
- Verify tests web apps and services. Native mobile apps arenât supported.
- Verify is in beta and free during the beta. The sidebar shows Free during beta next to Verify.
- Verify uses the Coding Agent permissions. Admins and Members can use it by default; users with the Billing Admin role canât. See Permissions.
- If Verify doesnât appear in your sidebar, it isnât available for your organization yet. See Troubleshooting.
Whatâs next
Set up Verify
Prepare an environment, add a repository, and choose when Verify runs.
Test pull requests
Start a run with a comment or automatically, and read the Verify comment.
User journeys
Build a library of critical flows and test them on demand or on a schedule.