collab/1brc
the one billion row challenge
git clone https://git.julia.blue/collab/1brc
dd0a778
julia-baseline
files
| .cargo/ | |
| misc/ | |
| src/ | |
| .envrc | 10 B |
| .gitignore | 43 B |
| Cargo.lock | 1.0 KiB |
| Cargo.toml | 197 B |
| README.md | 2.1 KiB |
| flake.lock | 2.0 KiB |
| flake.nix | 12.2 KiB |
| rust-toolchain.toml | 129 B |
One Billion Row Challenge
See here.
results
On an E-2378G w/o SMT w/turbo.
| name | details | result (ms) | result: 10k stations (ms) |
|---|---|---|---|
| upstream baseline | nix run .#bench.baseline.1br | 135835 ± 1866 | 169128 ± 1378 |
| upstream #1 | nix run .#bench.1stAvx10.1br | 1583 ± 18 | 5773 ± 143 |
how to run?
runnables:
nix run .#bench.<impl name>.<input name>- benchmarks a particular implemetnation on a particular input
- i.e.
nix run .#bench.baseline.small
nix run .#testRunners.<input name> -- <args to run an implementation>- tests that the implementation's outputs match reference outputs, for a particular input
nix run .#testRunners.all -- <args to run an implementation>- test an implementation on all inputs
nix run .#benchRunners.<input name> -- <args to run an implementation>- benchmarks (
hyperfine) the implementation when run on a particular input
- benchmarks (
nix run .#impls.<impl name>- run a particular implementation
- you probably do not want to do this directly (impls expect
measurements.txtin cwd)- using
.#testRunner/.#benchRunneror.#bench.<impl name>.<input name>will handle this for you
- using
notable impls:
baseline: baseline Java implementation from upstream1st-avx2: 1st place Java implementation, compiled (graalvm) forx86_64-v31st-avx10: ^ but compiled forx86_64-v4(AVX512)
notable inputs:
1br: default billion row input1br-many-stations: billion row input with 10K stationssmall: 100K row input