IRIS TestOps Hub

IRIS TestOps Hub is a full‑stack application for ingesting automated test results and turning them into actionable insights (top errors, flaky tests, run‑to‑run regressions).

Built for the InterSystems Full Stack Contest:

✅ Backend: InterSystems IRIS (ObjectScript REST + SQL)
✅ Full CRUD from the UI (projects)
✅ Data ingest via REST (runs, tests, errors)
✅ Analytics & dashboards in IRIS
✅ Embedded Python inside IRIS (fingerprinting, similarity, flaky scoring)
✅ Open‑source, Docker‑first

Features

Projects CRUD (create/rename/delete)
Secure API (bearer session tokens)
Ingest token per project (rotation supported)
Dashboard: pass rate, totals
Recent runs list + Run details page
Diff vs previous run: new failures, fixed failures, new error fingerprints
Top errors grouped by fingerprint
Similar errors (TF‑IDF cosine similarity via Embedded Python)
Flaky tests: fail rate + flaky transitions score (Embedded Python)
Run attachments: upload/download logs or artifacts (stored on Docker volume)
Test annotations: mark tests as known-issue, flaky, xfail, etc.

Quick start

docker compose up --build

Open:

Web UI: http://localhost:8080
IRIS Management Portal: http://localhost:52773/csp/sys/UtilHome.csp (login: _SYSTEM / SYS)

Default admin is created on first boot:

email: admin@testops.local
password: admin123

Demo ingestion

Login → create a project → copy ingestToken
Ingest sample data:

bash demo/ingest-example.sh

To generate history for flaky + diff:

bash demo/ingest-multi.sh

API (high level)

Base URL (inside Docker): http://localhost:52773/csp/testops/api

POST /api/auth/register / POST /api/auth/login
GET/POST /api/projects
PATCH/DELETE /api/projects/:id
POST /api/projects/:id/rotate-token
GET /api/projects/:id/dashboard
GET /api/projects/:id/runs
GET /api/runs/:id
GET /api/runs/:id/diff
GET /api/projects/:id/errors/top
GET /api/projects/:id/errors/:fingerprint/similar
GET /api/projects/:id/flaky
POST /api/testcases/:id/annotate
POST /api/runs/:id/attachments (JSON base64)
GET /api/attachments/:id/download

Architecture

IRIS: REST endpoints in ObjectScript, persistence via IRIS SQL tables/views.
Embedded Python: used for error fingerprinting, similarity ranking, and flaky scoring.
Web: React SPA (Vite) served by Nginx, /api/* proxied to IRIS.

Contest checklist

Runs on IRIS Community Edition in containers.
Full‑stack (web UI + CRUD + ingest + analytics).
Open source (MIT License).
README in English with install + demo steps.

Demo video

Record a 2–3 minute video:

Login
Create project
Run demo ingest
Show dashboard + runs + run diff
Open “top errors” and “similar errors”
Show flaky tests
Upload an attachment on a run

iris-testops-hub Awaiting Review