AWT
Open Source ยท MIT License

Test Smarter, Fix Faster

AI-Powered E2E Testing That Heals Itself

AWT scans your site, generates test scenarios with AI, executes them with Playwright, and auto-fixes failures. The DevQA loop that never sleeps.

awt โ€” zsh โ€” 80ร—24

See It In Action

Watch AWT scan a site, generate scenarios, and execute tests โ€” all from the browser.

AWT Cloud โ€” Live Demo
AWT Demo โ€” AI scanning and testing a website
Core Architecture

The Self-Healing DevQA Loop

Most testing tools stop at failure. AWT keeps going โ€” analyzing, fixing, and retesting until everything passes.

Step 01

Scan

Crawl your site, analyze DOM structure, detect features like login forms and shopping carts

Step 02

Plan

AI generates test scenarios as declarative YAML โ€” no code required

Step 03

Review

Review, edit, or approve AI-generated scenarios before execution

Step 04

Execute

Playwright runs tests with live screenshots, human-like mouse movements

Step 05

Heal

Failed? AI analyzes the cause, suggests fixes, creates a PR, and re-tests automatically

Auto PR creation coming soon
Failed? Loop back to Step 01 automatically
scenario.yamlNo-Code
id: "SC-002"name: "User Login"steps:  - step: 1    action: navigate    value: "{{url}}/login"ย   - step: 2    action: find_and_type    target:      text: "Email"      match_method: ocr    value: "test@example.com"    humanize: trueย   - step: 3    action: find_and_click    target:      text: "Login"ย   - step: 4    action: assert    assert_type: text_visible    expected:      - type: text_visible        value: "Welcome back"
No-Code

Define Tests in Plain YAML

No programming required. Anyone on your team can read, edit, and maintain test scenarios.

  • โ†’navigate, click, type, assert โ€” intuitive action verbs
  • โ†’OCR, template, feature matching โ€” find elements visually
  • โ†’humanize: true โ€” Bezier mouse + random typing delays
  • โ†’Variable substitution for environment-agnostic tests

Generate Scenarios from Natural Language

Describe what you want to test in plain language โ€” AI converts it to YAML scenarios automatically.

"Login, then go to My Page and check if profile editing works"

โ†’ AI generates 3 scenarios, 12 steps automatically

Differentiators

Why AWT?

What makes AWT different from every other testing tool

No-Code

Declarative YAML Scenarios

No code required. Define tests in plain YAML that anyone on your team can read and edit.

Auto-Fix

Self-Healing Loop

Test fails โ†’ AI analyzes โ†’ code fix โ†’ PR created โ†’ re-test. The loop repeats until green.

Auto PR: Coming Soon
Visual

Vision AI Matching

CSS selectors break. AWT uses OpenCV template matching, OCR, and feature detection to find elements visually.

Adaptive

Learning Memory

Every successful match is stored in SQLite. AWT gets smarter with each test run โ€” same mistakes never happen twice.

Features

Everything You Need

Built for developers who care about testing quality

Human-Like Interaction

Bezier curve mouse movement at 60fps, variable typing delays (50-300ms). Passes bot detection that linear automation fails.

Smart Site Scanner

Auto-detects login forms, shopping carts, search bars, pagination โ€” then generates targeted tests for each feature.

4 AI Providers

Claude, OpenAI, DeepSeek, Ollama. Bring your own key or run fully offline with local LLMs.

3 Approval Modes

Manual (terminal prompt), Branch (git isolation + auto-merge), Auto (direct fix + retest). Choose your risk level.

Real-Time Dashboard

WebSocket-powered live screenshots (960ร—540), step-by-step progress, event log โ€” watch AI test your site in real time.

Multi-Language OCR

Pytesseract with 10+ languages. Find buttons and text in English, Korean, Japanese, Thai โ€” no selectors needed.

Desktop Engine

PyAutoGUI for OS-level testing โ€” native app screenshots, system keyboard input, multi-monitor support.

Git Branch Isolation

AI fixes go to aat/fix-### branches. Auto-commit, auto-retest, auto-merge on pass. Full audit trail.

Economics

Cost-Optimized AI Testing

We obsess over token efficiency so you don't have to

$0.02โ€“$0.05
per test run
52โ€“69%
token reduction via DOM minification
3-tier
scenario builder: deterministic โ†’ heuristic โ†’ AI fallback
  • โœ“Prompt caching โ€” repeat tests cost near zero
  • โœ“DOM minification strips 52โ€“69% of tokens
  • โœ“Pattern-based scenarios avoid AI calls entirely
  • โœ“Fuzzy cache matching with 24h TTL
Modes

Three Ways to Use AWT

Choose how AWT fits your workflow

Recommended

Agent Skill

Your AI coding tool is the brain. AWT is the eyes and hands. No extra AI API key needed.

  • โœ“Your AI designs test scenarios
  • โœ“AWT executes with real browser
  • โœ“Your AI reads failures + source code
  • โœ“Your AI fixes the code directly
  • โœ“No additional AI cost
npx skills add ksgisang/awt-skill --skill awt -g
View on GitHub โ†’

Cloud

No install needed. Sign up, enter a URL, and watch AI generate and execute tests.

  • โœ“Zero setup โ€” works in browser
  • โœ“Real-time dashboard with live screenshots
  • โœ“Document upload (PDF/DOCX/MD)
  • โœ“BYOK โ€” bring your own AI key
  • โœ“Free tier: 5 tests/month

CLI Mode

AWT handles everything independently. Best for CI/CD pipelines and automation.

  • โœ“aat generate creates scenarios via AI
  • โœ“aat loop auto-heals on failure
  • โœ“5 AI providers supported
  • โœ“Cost tracking with aat cost
  • โœ“Requires AI API key
Stack

Built With

PlaywrightBrowser automation
OpenCVVisual matching
PytesseractOCR engine
OpenAIGPT-4o Vision
ClaudeAnthropic AI
DeepSeekCost-optimized
OllamaLocal LLM
FastAPICloud backend
Next.jsFrontend
SupabaseAuth & DB
PostgreSQLCloud storage
SQLiteLearning DB
Plans

Pricing

Free

$0

Try AI testing with basic features

  • โœ“5 tests / month
  • โœ“1 concurrent test
  • โœ“AI scenario generation
  • โœ“Screenshot reports
Get Started Free
Most Popular

Pro

$28.99/mo

For professional developers and small teams

  • โœ“100 tests / month
  • โœ“3 concurrent tests
  • โœ“CI/CD API keys
  • โœ“Source code analysis
  • โœ“AI auto-fix PRs
Start Pro

Team

$98.99/mo

For teams that need high volume testing

  • โœ“500 tests / month
  • โœ“10 concurrent tests
  • โœ“Everything in Pro
  • โœ“Priority support
Start Team

Ship with confidence.

Start testing in under 5 minutes. No credit card required.