Skip to content

Connect a Test Management Tool

Run the suites you already maintain in TestRail, Zephyr Scale, Xray, or Azure Test Plans, and write results back.

Certyn runs the test cases your team already maintains in TestRail, Zephyr Scale, Xray, or Azure Test Plans. It pulls the cases at run time, executes them in a real browser, and writes the results back as a run in your tool. There is no import and no copy to keep in sync: your test management tool stays the source of truth for the cases.

How it works

Connect your account

Open Connections (or pick your tool during onboarding) and enter the credentials below. Certyn stores them encrypted and validates the connection.

Pick a project and suites

Choose the external project, then select one or more suites. Each selected suite becomes a Certyn process you can run, schedule, or trigger from CI.

Run and write back

When the process runs, Certyn pulls the current cases, executes them, and pushes each result back to a run in your tool. Only the latest attempt per case is written, and pushes are idempotent, so retries never double-post.

Credentials by system

TestRail

  • Base URL: e.g. https://yourco.testrail.io
  • User email: the account Certyn authenticates as
  • API key: from My Settings → API Keys in TestRail (API access must be enabled under Administration → Site Settings → API)

Results write back with add_result_for_case. Cases without a numeric TestRail id are skipped when opening a run.

Zephyr Scale

  • API token: a Zephyr Scale access token
  • Base URL: only for Server / Data Center; leave blank for Zephyr Cloud

Xray

  • Client ID and Client secret: from an Xray API key pair

Xray project and suite lists

Xray's GraphQL API cannot enumerate Jira projects, so the picker asks you to type the project key (for example ABC) instead of choosing from a list. Suites resolve once the project key is set.

Azure Test Plans

  • Organization URL: e.g. https://dev.azure.com/your-org
  • Personal access token: a PAT with Test Plans read and write scope

What write-back records

Each Certyn outcome maps to a result in your tool:

Certyn outcomeExternal result
PassedPassed
Failed / ErrorFailed
BlockedBlocked
Aborted / SkippedLeft untested

Run it from CI too

A connected suite is a normal Certyn process. Trigger it from your pipeline with the GitHub Action or the CI Runs API, or put it on a schedule.