<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>README.md - collab/1brc @ julia-baseline</title>
<meta name="description" content="README.md in collab/1brc at julia-baseline.">
<meta property="og:title" content="README.md - collab/1brc @ julia-baseline">
<meta property="og:description" content="README.md in collab/1brc at julia-baseline.">
<meta property="og:type" content="website">
<meta property="og:site_name" content="git.julia.blue">
<link rel="stylesheet" href="/css/style.css?v=62">
<script type="module" src="/js/main.js?v=62"></script>
</head>
<body>
<main data-ref="julia-baseline" data-tip="dd0a77818db4a04456a2f2629c2d2f5b729ce4c5">
<noscript>
  <div class="callout">
    <p>
      hey! this is a static git repo viewer. commit diffs, file history,
      older commits and other revisions won't load without javascript.
    </p>
    <p>
      you are still able to view source files on branch/tag tips,
      but the experience is degraded.
    </p>
  </div>
</noscript>
<header class="repo"><div>
<h1>collab/1brc</h1>
<p class="desc">the one billion row challenge</p>
</div>
<pre class="clone">git clone https://git.julia.blue/collab/1brc</pre>
</header>
<p class="snapshot-commit"><span class="commit-author">Julia Ryan</span><span class="commit-message" data-commit="1e4a8906a883450ca2549f738b43bc7a5454e619">initial</span><span class="snapshot-sha sha" data-commit="1e4a8906a883450ca2549f738b43bc7a5454e619">1e4a890</span><time datetime="2025-12-28T00:52:06-05:00" title="2025-12-28 00:52:06 -0500">2025-12-28</time></p>
<header class="topbar"><details class="switcher"><summary>julia-baseline</summary><div class="menu"><strong>branches</strong><a href="/collab/1brc/ref/back-to-mmap/">back-to-mmap</a><a class="current" href="/collab/1brc/ref/julia-baseline/">julia-baseline</a><a href="/collab/1brc/ref/main/">main</a><a class="all" href="/collab/1brc/refs">all refs →</a></div></details><nav class="crumbs"><a href="/collab/1brc/">1brc</a> / <span class="cur">README.md</span></nav>
<span class="view-stats"><span>2.1 KiB</span><span>43 lines</span></span><span class="actions"><a class="raw" href="/collab/1brc/raw/7911de9c050147f6f1e3230081a3896205794588/README.md">raw</a></span></header>
<div class="markdown-view"><input type="radio" name="markdown-view" id="markdown-rendered" checked><label for="markdown-rendered">rendered</label><input type="radio" name="markdown-view" id="markdown-code"><label for="markdown-code">code</label><section class="readme rendered"><h1>One Billion Row Challenge</h1>
<p>See <a href="https://github.com/gunnarmorling/1brc">here</a>.</p>
<hr />
<h2>results</h2>
<blockquote>
<p>On an <a href="https://www.intel.com/content/www/us/en/products/sku/212262/intel-xeon-e2378g-processor-16m-cache-2-80-ghz/specifications.html">E-2378G</a> w/o SMT w/turbo.</p>
</blockquote>
<table><thead><tr><th style="text-align: center">name</th><th style="text-align: center">details</th><th style="text-align: center">result (ms)</th><th style="text-align: center">result: 10k stations (ms)</th></tr></thead><tbody>
<tr><td style="text-align: center"><a href="https://github.com/gunnarmorling/1brc/blob/db064194be375edc02d6dbcd21268ad40f7e2869/src/main/java/dev/morling/onebrc/CalculateAverage_baseline.java">upstream baseline</a></td><td style="text-align: center"><code>nix run .#bench.baseline.1br</code></td><td style="text-align: center">135835 ± 1866</td><td style="text-align: center">169128 ± 1378</td></tr>
<tr><td style="text-align: center"><a href="https://github.com/gunnarmorling/1brc/blob/db064194be375edc02d6dbcd21268ad40f7e2869/src/main/java/dev/morling/onebrc/CalculateAverage_thomaswue.java">upstream #1</a></td><td style="text-align: center"><code>nix run .#bench.1stAvx10.1br</code></td><td style="text-align: center">1583 ± 18</td><td style="text-align: center">5773 ± 143</td></tr>
</tbody></table>
<h2>how to run?</h2>
<p>runnables:</p>
<ul>
<li><code>nix run .#bench.&lt;impl name&gt;.&lt;input name&gt;</code>
<ul>
<li>benchmarks a particular implemetnation on a particular input</li>
<li>i.e. <code>nix run .#bench.baseline.small</code></li>
</ul>
</li>
<li><code>nix run .#testRunners.&lt;input name&gt; -- &lt;args to run an implementation&gt;</code>
<ul>
<li>tests that the implementation's outputs match reference outputs, for a particular input</li>
</ul>
</li>
<li><code>nix run .#testRunners.all -- &lt;args to run an implementation&gt;</code>
<ul>
<li>test an implementation on <em>all</em> inputs</li>
</ul>
</li>
<li><code>nix run .#benchRunners.&lt;input name&gt; -- &lt;args to run an implementation&gt;</code>
<ul>
<li>benchmarks (<code>hyperfine</code>) the implementation when run on a particular input</li>
</ul>
</li>
<li><code>nix run .#impls.&lt;impl name&gt;</code>
<ul>
<li>run a particular implementation</li>
<li>you probably do not want to do this directly (impls expect <code>measurements.txt</code> in cwd)
<ul>
<li>using <code>.#testRunner</code>/<code>.#benchRunner</code> or <code>.#bench.&lt;impl name&gt;.&lt;input name&gt;</code> will handle this for you</li>
</ul>
</li>
</ul>
</li>
</ul>
<p>notable impls:</p>
<ul>
<li><code>baseline</code>: baseline Java implementation from upstream</li>
<li><code>1st-avx2</code>: 1st place Java implementation, compiled (graalvm) for <code>x86_64-v3</code></li>
<li><code>1st-avx10</code>: ^ but compiled for <code>x86_64-v4</code> (AVX512)</li>
</ul>
<p>notable inputs:</p>
<ul>
<li><code>1br</code>: default billion row input</li>
<li><code>1br-many-stations</code>: billion row input with 10K stations</li>
<li><code>small</code>: 100K row input</li>
</ul>
<h2>details</h2>
</section><div class="code-panel"><pre class="code src language-markdown"><span class="code-line"><a class="ln" id="L1" href="#L1">1</a><span class="code-text"><a-p>#</a-p> <a-tt>One Billion Row Challenge</a-tt></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L2" href="#L2">2</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L3" href="#L3">3</a><span class="code-text">See [here](https://github.com/gunnarmorling/1brc).</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L4" href="#L4">4</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L5" href="#L5">5</a><span class="code-text"><a-p>---</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L6" href="#L6">6</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L7" href="#L7">7</a><span class="code-text"><a-p>##</a-p> <a-tt>results</a-tt></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L8" href="#L8">8</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L9" href="#L9">9</a><span class="code-text"><a-p>&gt; </a-p>On an [E-2378G](https://www.intel.com/content/www/us/en/products/sku/212262/intel-xeon-e2378g-processor-16m-cache-2-80-ghz/specifications.html) w/o SMT w/turbo.</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L10" href="#L10">10</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L11" href="#L11">11</a><span class="code-text">| name | details | result (ms) |  result: 10k stations (ms) |</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L12" href="#L12">12</a><span class="code-text">|:----:|:-------:|:-----------:|:--------------------------:|</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L13" href="#L13">13</a><span class="code-text">| [upstream baseline](https://github.com/gunnarmorling/1brc/blob/db064194be375edc02d6dbcd21268ad40f7e2869/src/main/java/dev/morling/onebrc/CalculateAverage_baseline.java) | `nix run .#bench.baseline.1br` | 135835 ± 1866 | 169128 ± 1378 |</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L14" href="#L14">14</a><span class="code-text">| [upstream #1](https://github.com/gunnarmorling/1brc/blob/db064194be375edc02d6dbcd21268ad40f7e2869/src/main/java/dev/morling/onebrc/CalculateAverage_thomaswue.java) | `nix run .#bench.1stAvx10.1br` | 1583 ± 18 | 5773 ± 143 |</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L15" href="#L15">15</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L16" href="#L16">16</a><span class="code-text"><a-p>##</a-p> <a-tt>how to run?</a-tt></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L17" href="#L17">17</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L18" href="#L18">18</a><span class="code-text">runnables:</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L19" href="#L19">19</a><span class="code-text"><a-p>  - </a-p>`nix run .#bench.&lt;impl name&gt;.&lt;input name&gt;`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L20" href="#L20">20</a><span class="code-text"><a-p>    + </a-p>benchmarks a particular implemetnation on a particular input</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L21" href="#L21">21</a><span class="code-text"><a-p>    + </a-p>i.e. `nix run .#bench.baseline.small`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L22" href="#L22">22</a><span class="code-text">  <a-p>- </a-p>`nix run .#testRunners.&lt;input name&gt; -- &lt;args to run an implementation&gt;`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L23" href="#L23">23</a><span class="code-text"><a-p>    + </a-p>tests that the implementation&#39;s outputs match reference outputs, for a particular input</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L24" href="#L24">24</a><span class="code-text">  <a-p>- </a-p>`nix run .#testRunners.all -- &lt;args to run an implementation&gt;`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L25" href="#L25">25</a><span class="code-text"><a-p>    + </a-p>test an implementation on _all_ inputs</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L26" href="#L26">26</a><span class="code-text">  <a-p>- </a-p>`nix run .#benchRunners.&lt;input name&gt; -- &lt;args to run an implementation&gt;`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L27" href="#L27">27</a><span class="code-text"><a-p>    + </a-p>benchmarks (`hyperfine`) the implementation when run on a particular input</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L28" href="#L28">28</a><span class="code-text">  <a-p>- </a-p>`nix run .#impls.&lt;impl name&gt;`</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L29" href="#L29">29</a><span class="code-text"><a-p>    + </a-p>run a particular implementation</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L30" href="#L30">30</a><span class="code-text"><a-p>    + </a-p>you probably do not want to do this directly (impls expect `measurements.txt` in cwd)</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L31" href="#L31">31</a><span class="code-text"><a-p>      * </a-p>using `.#testRunner`/`.#benchRunner` or `.#bench.&lt;impl name&gt;.&lt;input name&gt;` will handle this for you</span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L32" href="#L32">32</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L33" href="#L33">33</a><span class="code-text"><a-p>notable impls:</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L34" href="#L34">34</a><span class="code-text"><a-p>  - `baseline`: baseline Java implementation from upstream</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L35" href="#L35">35</a><span class="code-text"><a-p>  - `1st-avx2`: 1st place Java implementation, compiled (graalvm) for `x86_64-v3`</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L36" href="#L36">36</a><span class="code-text"><a-p>  - `1st-avx10`: ^ but compiled for `x86_64-v4` (AVX512)</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L37" href="#L37">37</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L38" href="#L38">38</a><span class="code-text"><a-p>notable inputs:</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L39" href="#L39">39</a><span class="code-text"><a-p>  - `1br`: default billion row input</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L40" href="#L40">40</a><span class="code-text"><a-p>  - `1br-many-stations`: billion row input with 10K stations</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L41" href="#L41">41</a><span class="code-text"><a-p>  - `small`: 100K row input</a-p></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L42" href="#L42">42</a><span class="code-text"></span><span class="code-break">
</span></span><span class="code-line"><a class="ln" id="L43" href="#L43">43</a><span class="code-text"><a-p>## </a-p><a-tt>details</a-tt></span></span></pre></div></div>
</main>
</body>
</html>
