Start with a case, then choose how its steps are authored, run, checked, and retained. The map below links to the full AI test suite guide.
SUITE DESIGNDescribe the app and reusable setup
Group cases under a suite with a target package, agent instructions, goals, and preconditions. Reuse shared step sequences in cases or setup and teardown hooks; named suite values are included as plain context for the agent. Suite guide.
AUTHORINGChoose how to build each case
Add steps by hand, draft them with AI, record a device workflow, paste log lines as checks, improve saved steps, or rewrite a retained recording. Review and edit previews before applying them. Authoring guide.
STEP TYPESMix AI and direct device work
Steps can be performed by an AI agent, a tester, a script, or eligible recorded-input replay. Optional steps run only when their condition is present. Set step timeouts and retries, then stop, continue, create a draft issue, or pause after a failure. Step types.
CHECKSCombine direct checks and AI judgment
Check for matching or absent logs, script results, and device state. Screen judge and Ask the judge checks use AI and need a configured judge. Add golden screenshots or reference logs as examples for a step. Checks and examples.
RUN CONTROLSSet up lanes and repeat behavior
Choose agent profiles, model and reasoning effort, or an external MCP lane. Up to four distinct devices can run in parallel; lanes sharing a device run in sequence. Repeat cases 1, 3, or 5 times, set case and step retries plus tool-call budgets, and choose no judge, failed-step or every-step judging with inline, after-case, or background timing. Run guide.
EVIDENCE AND REPORTSFollow progress and compare outcomes
Inspect live screenshots, logcat, and agent activity. Choose capture tabs and saved evidence. Reports include a case-and-step matrix, attempts, agent/judge disagreements, and flaky outcomes; compare runs, rerun failed cases or through a step, or export JSON, Markdown, and evidence ZIPs. Reports.
SCRIPTS AND ISSUESAdd custom tools and follow-up
Expose typed-parameter scripts from the host shell or adb shell with ask-first, automatic, or setup/teardown-only permissions. Keep issues locally, add them to Notes, copy Markdown, or file through a configured tracker MCP server. Scripts · Issues.
STORAGE AND MCPKeep libraries and evidence where you choose
Configure separate suite, run, and issue folders. The Free edition allows one suite with five cases; additional entries are locked, not deleted. MCP clients can author, run, compare, export reports, and handle issue evidence, with approval required for gated actions. Limits · MCP guide.