Benchmarks
Benchmark results and methodology comparing Runners against GitHub-hosted runners across real open-source build workloads.
Our runners run on modern bare-metal hardware, so the same jobs finish faster than on GitHub-hosted runners with the same number of cores. The per-minute rate is lower too, so each run costs less.
How we benchmarked
- Runners:
tenki-standard-large-8c-16g(8 vCPU, 16 GB) against GitHub's 8-core larger runner (8 vCPU, 32 GB). Kubernetes ran on 16 vCPU on both sides. - Workloads: each project's own CI job or standard build at a pinned commit, with identical steps on both sides and only
runs-onchanged. - Caches: dependency caches are warm on both sides. Build caches (sccache, Docker layers, the Gradle build cache) are off, so every run compiles in full.
- Timing: the whole job as GitHub reports it, including setup and checkout.
- Runs: the suite ran several times on November 11, 2026. Each row is the project's fastest run relative to GitHub among runs where both sides succeeded.
Results vs GitHub-hosted runners
To have a specific workload reproduced, write to hello@luxor.ai.
Cost
GitHub charges $0.022/min for its 8-core runner and $0.042/min for 16-core, and rounds each job up to the next whole minute. Luxor Agent Cloud charges $0.002 per vCPU-minute, billed per second with no startup surcharge. See the pricing page for the full rate card.