
BrowserStack Automate
Cross-browser test automation on 3500+ real browser/OS combinations
Discover top open-source software, updated regularly with real-world adoption signals.

Write and run AI-driven natural language E2E tests
Shortest lets developers author end-to-end tests in plain English, leveraging Anthropic Claude to execute them via Playwright, with built-in GitHub 2FA and email validation support.

Shortest is a testing framework that lets developers describe end‑to‑end scenarios in natural language. By sending those descriptions to Anthropic Claude, the AI translates them into Playwright actions, handling browser automation, authentication flows, and API calls without hand‑written scripts.
The CLI (shortest init) bootstraps configuration, installs the package, and creates environment placeholders for required keys. Tests can include callbacks, lifecycle hooks, and chaining for complex user journeys. Built‑in support for GitHub two‑factor authentication and Mailosaur email validation expands coverage to security‑critical flows. Running pnpm shortest --headless integrates smoothly into CI/CD pipelines, provided the Anthropic API key is stored securely. The framework is ideal for teams that want rapid test authoring while retaining the power and reliability of Playwright.
When teams consider Shortest, these hosted platforms usually appear on the same shortlist.
Looking for a hosted option? These are the services engineering teams benchmark against before choosing open source.
Login flow with GitHub 2FA
Validate end‑to‑end authentication including OTP handling without writing Playwright code
API endpoint validation
Assert that a GET request returns only active users using a single natural language description
Sequential user actions
Chain multiple business‑logic steps (login, invoice creation, view) in a readable list
Database verification after UI actions
Run custom callbacks to query the database and assert state after UI interactions
Yes, an Anthropic API key is required; the key is supplied via ANTHROPIC_API_KEY or SHORTEST_ANTHROPIC_API_KEY environment variables.
Yes, use the --headless flag or set headless:true in the config to execute tests in CI pipelines.
It supports GitHub 2FA by accepting a TOTP secret; the CLI can prompt for the OTP code during login.
Currently Shortest is built on Playwright, so tests run using Playwright’s supported browsers.
Yes, you can provide callback functions or lifecycle hooks to run additional code and assertions.
Project at a glance
StableLast synced 4 days ago