Benchmark

FlowBench

Can a tool follow every entry point of a real codebase, call by call, to the end? We ran vivibe on 25 well-known open-source projects to find out.

Run vivibe-app ce5fab0eDeterministic, no AI
100%Trace completenessof 6,258 entry points
25/25Projects with no broken flow5 languages, pinned commits
71%Of entry points in FlowBench Verified7 hand-audited projects, 0 open wrong calls
Flow tracingFlowBench (n = 6,258 entry points)
  1. 100%
    Javan = 5,084
  2. 100%
    Gon = 581
  3. 100%
    JS/TSn = 477
  4. 100%
    Pythonn = 50
  5. 100%
    C#n = 66
Checked by peopleFlowBench Verified (n = 7 projects, 17 audit rounds)
  • Wrong calls found21
  • Fixed and locked by a test21
  • Still open0

Every wrong call found was fixed in the analyzer and kept fixed by a golden test.

Results by project

From reference apps with 4 entry points to platforms with 3,299.

#LanguageCompletenessAudit
1ruoyi-vue-proAdmin and business platformJava3,299100%Verified
2thingsboardIoT platformJava559100%Automated
3haloWebsite builderJava475100%Verified
4documensoOpen-source DocuSign alternativeJS/TS414100%Automated
5mallE-commerce systemJava246100%Verified
6apolloConfiguration serviceJava232100%Verified
7gin-vue-adminAdmin platformGo209100%Automated
8photoprismPhoto appGo179100%Automated
9eladminAdmin systemJava139100%Verified
10go-adminAdmin starter kitGo111100%Automated
11eShop.NET reference appC#66100%Automated
12spring-boot-realworld-example-appRealWorld example appJava48100%Verified
13jhipster-sample-appJHipster sample appJava39100%Automated
14full-stack-fastapi-templateOfficial FastAPI templatePython31100%Automated
15memosNote-taking appGo27100%Automated
16golang-gin-realworld-example-appRealWorld example appGo27100%Automated
17go-clean-templateService templateGo24100%Automated
18taxonomyNext.js example appJS/TS22100%Automated
19nestjs-realworld-example-appRealWorld example APIJS/TS21100%Automated
20node-express-realworld-example-appRealWorld example APIJS/TS20100%Automated
21fastapi-realworld-example-appRealWorld example APIPython19100%Automated
22spring-petclinicOfficial Spring sampleJava17100%Automated
23spring-petclinic-microservicesSpring Cloud sampleJava17100%Automated
24piggymetricsMicroservices demoJava13100%Verified
25go-clean-archClean Architecture exampleGo4100%Automated

25 of 25 projects. Names open the code at the exact commit we read.

Methodology

Task
For every entry point a project has (an HTTP route, job, consumer, command or page), follow the flow call by call until it ends in code or a known resource such as a database or queue.
Trace completeness
The share of entry points whose flow is whole. A flow fails if it stops at a gap or at a call that cannot be resolved; guessing an edge is not allowed.
Dataset
25 open-source projects in 5 languages, each read at a pinned commit. A project with even one broken flow is left out of FlowBench, so the set shows where vivibe is whole today, not every project tried.
FlowBench Verified
The 7 projects where people sampled call edges and read them against the source, over 17 rounds. Each wrong edge became a fix and a golden test.
Setup
vivibe-app ce5fab0e, 8 Nov 2026. The analysis is deterministic (tree-sitter, plus libclang and Roslyn); no model is involved, so a run gives the same result every time.
  1. Hand audits ran on analyzer versions 0.5 to 0.8, before 26 Oct 2026; the trace run used that day's build.
  2. Analysis time is not reported: the bench machine was overloaded during the run.
  3. Projects still being measured on the run date are not listed until they have a result.

Try it on your own code.

Open any repo on your Mac, or compare a branch, PR or working tree. vivibe is in private beta: ask to join, and sign in with the same email once you are in.