Breaking Apps Hackathon

Passmark is an open-source AI testing library by Bug0. You describe what to test in plain English. Passmark uses AI to run those tests via Playwright. No selectors. No page objects.

Here's what a test looks like:

import { test, expect } from "@playwright/test";
import { runSteps } from "passmark";

test("Add to cart", async ({ page }) => {
  test.setTimeout(60_000);
  await runSteps({
    page,
    userFlow: "Add product to cart",
    steps: [
      { description: "Navigate to https://demo.vercel.store" },
      { description: "Click Acme Circles T-Shirt" },
      { description: "Select color", data: { value: "White" } },
      { description: "Select size", data: { value: "S" } },
      { description: "Add to cart", waitUntil: "My Cart is visible" },
    ],
    assertions: [
      { assertion: "You can see My Cart with Acme Circles T-Shirt" },
    ],
    test,
    expect,
  });
});

This hackathon runs for 4 weeks. Pick any web app you can access without bot checks, write a Passmark test suite for it, publish a Hashnode article about what you built, and share it on social. $4,000+ in prizes. Every registered participant gets free AI credits via OpenRouter. Open to everyone.

Getting started

1. Register and get your API key. Register on this hackathon page. You'll get a free OpenRouter API key with a preset credit limit. No credit card required.

2. Star and fork the repo. Star and fork bug0inc/passmark so you get release notifications during the hackathon.

3. Set up your project. Create a new Playwright project and install Passmark:

npm init playwright@latest my-hackathon-tests
cd my-hackathon-tests
npm install passmark dotenv

Create a .env file with the OpenRouter API key you received after registering:

OPENROUTER_API_KEY=sk-or-...

Configure Passmark to use OpenRouter as the AI gateway. This routes all AI calls through OpenRouter, so you don't need separate Anthropic or Google API keys.

Add to your playwright.config.ts:

import dotenv from "dotenv";
import path from "path";
import { configure } from "passmark";

dotenv.config({ path: path.resolve(__dirname, ".env") });

configure({
  ai: {
    gateway: "openrouter"
  }
});

4. Run your first test. Run the example test:

npx playwright test --project chromium

Run npx playwright show-report to see the test report.