fork/rust_serialization_benchmark

git clone https://git.julia.blue/fork/rust_serialization_benchmark

David KoloskiUpdate benchmarks, fix CIf964c08

master
95.2 KiB1771 linesraw
1
2running 0 tests
3
4test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s
5
6WARNING: HTML report generation will become a non-default optional feature in Criterion.rs 0.4.0.
7This feature is being moved to cargo-criterion (https://github.com/bheisler/cargo-criterion) and will be optional in a future version of Criterion.rs. To silence this warning, either switch to cargo-criterion or enable the 'html_reports' feature in your Cargo.toml.
8
9Gnuplot not found, using plotters backend
10Benchmarking log/abomonation/serialize
11Benchmarking log/abomonation/serialize: Warming up for 3.0000 s
12Benchmarking log/abomonation/serialize: Collecting 100 samples in estimated 5.8888 s (20k iterations)
13Benchmarking log/abomonation/serialize: Analyzing
14log/abomonation/serialize
15                        time:   [293.09 µs 294.24 µs 295.50 µs]
16                        change: [+6.8274% +8.1725% +9.4864%] (p = 0.00 < 0.05)
17                        Performance has regressed.
18Found 3 outliers among 100 measurements (3.00%)
19  2 (2.00%) low mild
20  1 (1.00%) high mild
21Benchmarking log/abomonation/access (unvalidated)
22Benchmarking log/abomonation/access (unvalidated): Warming up for 3.0000 s
23Benchmarking log/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.1099 s (116k iterations)
24Benchmarking log/abomonation/access (unvalidated): Analyzing
25log/abomonation/access (unvalidated)
26                        time:   [44.231 µs 44.347 µs 44.461 µs]
27                        change: [-36.125% -35.362% -34.622%] (p = 0.00 < 0.05)
28                        Performance has improved.
29Found 3 outliers among 100 measurements (3.00%)
30  1 (1.00%) low mild
31  2 (2.00%) high mild
32Benchmarking log/abomonation/read (unvalidated)
33Benchmarking log/abomonation/read (unvalidated): Warming up for 3.0000 s
34Benchmarking log/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.2601 s (71k iterations)
35Benchmarking log/abomonation/read (unvalidated): Analyzing
36log/abomonation/read (unvalidated)
37                        time:   [71.378 µs 71.832 µs 72.315 µs]
38                        change: [-33.260% -32.447% -31.629%] (p = 0.00 < 0.05)
39                        Performance has improved.
40Found 3 outliers among 100 measurements (3.00%)
41  1 (1.00%) low mild
42  2 (2.00%) high mild
43Benchmarking log/abomonation/deserialize (unvalidated)
44Benchmarking log/abomonation/deserialize (unvalidated): Warming up for 3.0000 s
45Benchmarking log/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.1986 s (2000 iterations)
46Benchmarking log/abomonation/deserialize (unvalidated): Analyzing
47log/abomonation/deserialize (unvalidated)
48                        time:   [2.6374 ms 2.6656 ms 2.6939 ms]
49                        change: [-8.2208% -6.9751% -5.7578%] (p = 0.00 < 0.05)
50                        Performance has improved.
51log/abomonation/size 1705800
52log/abomonation/zlib 506933
53log/abomonation/zstd 404238
54
55Benchmarking log/bare/serialize
56Benchmarking log/bare/serialize: Warming up for 3.0000 s
57Benchmarking log/bare/serialize: Collecting 100 samples in estimated 7.3113 s (10k iterations)
58Benchmarking log/bare/serialize: Analyzing
59log/bare/serialize      time:   [699.59 µs 704.87 µs 710.96 µs]
60                        change: [-16.786% -15.739% -14.592%] (p = 0.00 < 0.05)
61                        Performance has improved.
62Found 6 outliers among 100 measurements (6.00%)
63  6 (6.00%) high mild
64Benchmarking log/bare/deserialize
65Benchmarking log/bare/deserialize: Warming up for 3.0000 s
66Benchmarking log/bare/deserialize: Collecting 100 samples in estimated 5.3558 s (1500 iterations)
67Benchmarking log/bare/deserialize: Analyzing
68log/bare/deserialize    time:   [3.4704 ms 3.4983 ms 3.5279 ms]
69                        change: [-14.339% -13.109% -11.941%] (p = 0.00 < 0.05)
70                        Performance has improved.
71Found 1 outliers among 100 measurements (1.00%)
72  1 (1.00%) high severe
73log/bare/size 765778
74log/bare/zlib 312739
75log/bare/zstd 264630
76
77Benchmarking log/bincode/serialize
78Benchmarking log/bincode/serialize: Warming up for 3.0000 s
79Benchmarking log/bincode/serialize: Collecting 100 samples in estimated 6.0318 s (10k iterations)
80Benchmarking log/bincode/serialize: Analyzing
81log/bincode/serialize   time:   [581.55 µs 586.93 µs 592.54 µs]
82                        change: [-11.243% -10.087% -9.0018%] (p = 0.00 < 0.05)
83                        Performance has improved.
84Found 1 outliers among 100 measurements (1.00%)
85  1 (1.00%) high mild
86Benchmarking log/bincode/deserialize
87Benchmarking log/bincode/deserialize: Warming up for 3.0000 s
88Benchmarking log/bincode/deserialize: Collecting 100 samples in estimated 5.2350 s (1500 iterations)
89Benchmarking log/bincode/deserialize: Analyzing
90log/bincode/deserialize time:   [3.6019 ms 3.6365 ms 3.6711 ms]
91                        change: [-9.8688% -8.1423% -6.4925%] (p = 0.00 < 0.05)
92                        Performance has improved.
93Found 1 outliers among 100 measurements (1.00%)
94  1 (1.00%) high mild
95log/bincode/size 1045784
96log/bincode/zlib 374305
97log/bincode/zstd 311761
98
99Benchmarking log/borsh/serialize
100Benchmarking log/borsh/serialize: Warming up for 3.0000 s
101Benchmarking log/borsh/serialize: Collecting 100 samples in estimated 5.1807 s (10k iterations)
102Benchmarking log/borsh/serialize: Analyzing
103log/borsh/serialize     time:   [503.13 µs 507.42 µs 512.09 µs]
104                        change: [-10.620% -9.3916% -8.1666%] (p = 0.00 < 0.05)
105                        Performance has improved.
106Found 7 outliers among 100 measurements (7.00%)
107  7 (7.00%) high mild
108Benchmarking log/borsh/deserialize
109Benchmarking log/borsh/deserialize: Warming up for 3.0000 s
110Benchmarking log/borsh/deserialize: Collecting 100 samples in estimated 5.2013 s (1500 iterations)
111Benchmarking log/borsh/deserialize: Analyzing
112log/borsh/deserialize   time:   [3.4473 ms 3.4736 ms 3.4997 ms]
113                        change: [-9.3658% -8.2456% -7.1334%] (p = 0.00 < 0.05)
114                        Performance has improved.
115log/borsh/size 885780
116log/borsh/zlib 363280
117log/borsh/zstd 286514
118
119Benchmarking log/bson/serialize
120Benchmarking log/bson/serialize: Warming up for 3.0000 s
121Benchmarking log/bson/serialize: Collecting 100 samples in estimated 5.1289 s (1600 iterations)
122Benchmarking log/bson/serialize: Analyzing
123log/bson/serialize      time:   [3.1015 ms 3.1261 ms 3.1515 ms]
124                        change: [-13.308% -12.113% -10.953%] (p = 0.00 < 0.05)
125                        Performance has improved.
126Found 4 outliers among 100 measurements (4.00%)
127  4 (4.00%) high mild
128Benchmarking log/bson/deserialize
129Benchmarking log/bson/deserialize: Warming up for 3.0000 s
130Benchmarking log/bson/deserialize: Collecting 100 samples in estimated 5.6974 s (500 iterations)
131Benchmarking log/bson/deserialize: Analyzing
132log/bson/deserialize    time:   [11.357 ms 11.444 ms 11.534 ms]
133                        change: [-14.056% -12.927% -11.755%] (p = 0.00 < 0.05)
134                        Performance has improved.
135Found 2 outliers among 100 measurements (2.00%)
136  2 (2.00%) high mild
137log/bson/size 1924682
138log/bson/zlib 537661
139log/bson/zstd 376270
140
141Benchmarking log/capnp/serialize
142Benchmarking log/capnp/serialize: Warming up for 3.0000 s
143
144Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.6s, enable flat sampling, or reduce sample count to 60.
145Benchmarking log/capnp/serialize: Collecting 100 samples in estimated 6.5654 s (5050 iterations)
146Benchmarking log/capnp/serialize: Analyzing
147log/capnp/serialize     time:   [1.3051 ms 1.3144 ms 1.3245 ms]
148                        change: [-13.534% -12.742% -11.947%] (p = 0.00 < 0.05)
149                        Performance has improved.
150Found 1 outliers among 100 measurements (1.00%)
151  1 (1.00%) high mild
152Benchmarking log/capnp/access (validated on-demand with error)
153Benchmarking log/capnp/access (validated on-demand with error): Warming up for 3.0000 s
154Benchmarking log/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0003 s (40M iterations)
155Benchmarking log/capnp/access (validated on-demand with error): Analyzing
156log/capnp/access (validated on-demand with error)
157                        time:   [122.68 ns 123.74 ns 124.79 ns]
158                        change: [-17.637% -16.730% -15.848%] (p = 0.00 < 0.05)
159                        Performance has improved.
160Benchmarking log/capnp/read (validated on-demand with error)
161Benchmarking log/capnp/read (validated on-demand with error): Warming up for 3.0000 s
162Benchmarking log/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.0222 s (10k iterations)
163Benchmarking log/capnp/read (validated on-demand with error): Analyzing
164log/capnp/read (validated on-demand with error)
165                        time:   [481.03 µs 485.91 µs 490.76 µs]
166                        change: [-15.074% -13.769% -12.580%] (p = 0.00 < 0.05)
167                        Performance has improved.
168Found 1 outliers among 100 measurements (1.00%)
169  1 (1.00%) high mild
170log/capnp/size 1443216
171log/capnp/zlib 509618
172log/capnp/zstd 428649
173
174Benchmarking log/cbor/serialize
175Benchmarking log/cbor/serialize: Warming up for 3.0000 s
176Benchmarking log/cbor/serialize: Collecting 100 samples in estimated 5.1815 s (2500 iterations)
177Benchmarking log/cbor/serialize: Analyzing
178log/cbor/serialize      time:   [1.9900 ms 2.0059 ms 2.0217 ms]
179                        change: [-10.444% -9.1640% -7.9894%] (p = 0.00 < 0.05)
180                        Performance has improved.
181Benchmarking log/cbor/deserialize
182Benchmarking log/cbor/deserialize: Warming up for 3.0000 s
183Benchmarking log/cbor/deserialize: Collecting 100 samples in estimated 5.1440 s (800 iterations)
184Benchmarking log/cbor/deserialize: Analyzing
185log/cbor/deserialize    time:   [6.2040 ms 6.2495 ms 6.2963 ms]
186                        change: [-19.264% -18.422% -17.540%] (p = 0.00 < 0.05)
187                        Performance has improved.
188Found 1 outliers among 100 measurements (1.00%)
189  1 (1.00%) high mild
190log/cbor/size 1407835
191log/cbor/zlib 407372
192log/cbor/zstd 324081
193
194Benchmarking log/flatbuffers/serialize
195Benchmarking log/flatbuffers/serialize: Warming up for 3.0000 s
196
197Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.8s, enable flat sampling, or reduce sample count to 50.
198Benchmarking log/flatbuffers/serialize: Collecting 100 samples in estimated 9.8406 s (5050 iterations)
199Benchmarking log/flatbuffers/serialize: Analyzing
200log/flatbuffers/serialize
201                        time:   [1.9596 ms 1.9725 ms 1.9862 ms]
202                        change: [-18.502% -17.503% -16.522%] (p = 0.00 < 0.05)
203                        Performance has improved.
204Found 6 outliers among 100 measurements (6.00%)
205  1 (1.00%) low severe
206  5 (5.00%) high mild
207Benchmarking log/flatbuffers/access (unvalidated)
208Benchmarking log/flatbuffers/access (unvalidated): Warming up for 3.0000 s
209Benchmarking log/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.5B iterations)
210Benchmarking log/flatbuffers/access (unvalidated): Analyzing
211log/flatbuffers/access (unvalidated)
212                        time:   [3.2051 ns 3.2465 ns 3.2890 ns]
213                        change: [-8.6788% -7.4388% -6.1323%] (p = 0.00 < 0.05)
214                        Performance has improved.
215Found 3 outliers among 100 measurements (3.00%)
216  1 (1.00%) low mild
217  2 (2.00%) high mild
218Benchmarking log/flatbuffers/access (validated upfront with error)
219Benchmarking log/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s
220Benchmarking log/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.0298 s (1900 iterations)
221Benchmarking log/flatbuffers/access (validated upfront with error): Analyzing
222log/flatbuffers/access (validated upfront with error)
223                        time:   [2.5799 ms 2.6021 ms 2.6253 ms]
224                        change: [-23.712% -22.767% -21.869%] (p = 0.00 < 0.05)
225                        Performance has improved.
226Found 5 outliers among 100 measurements (5.00%)
227  5 (5.00%) high mild
228Benchmarking log/flatbuffers/read (unvalidated)
229Benchmarking log/flatbuffers/read (unvalidated): Warming up for 3.0000 s
230Benchmarking log/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.4084 s (56k iterations)
231Benchmarking log/flatbuffers/read (unvalidated): Analyzing
232log/flatbuffers/read (unvalidated)
233                        time:   [96.788 µs 97.539 µs 98.347 µs]
234                        change: [-16.670% -15.535% -14.387%] (p = 0.00 < 0.05)
235                        Performance has improved.
236Found 2 outliers among 100 measurements (2.00%)
237  2 (2.00%) high mild
238Benchmarking log/flatbuffers/read (validated upfront with error)
239Benchmarking log/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s
240Benchmarking log/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.0408 s (1900 iterations)
241Benchmarking log/flatbuffers/read (validated upfront with error): Analyzing
242log/flatbuffers/read (validated upfront with error)
243                        time:   [2.6225 ms 2.6439 ms 2.6664 ms]
244                        change: [-23.691% -22.657% -21.640%] (p = 0.00 < 0.05)
245                        Performance has improved.
246Found 5 outliers among 100 measurements (5.00%)
247  5 (5.00%) high mild
248log/flatbuffers/size 1276368
249log/flatbuffers/zlib 469962
250log/flatbuffers/zstd 388832
251
252Benchmarking log/nachricht/serialize
253Benchmarking log/nachricht/serialize: Warming up for 3.0000 s
254Benchmarking log/nachricht/serialize: Collecting 100 samples in estimated 5.1007 s (700 iterations)
255Benchmarking log/nachricht/serialize: Analyzing
256log/nachricht/serialize time:   [7.4453 ms 7.5272 ms 7.6093 ms]
257                        change: [-11.200% -9.8135% -8.4017%] (p = 0.00 < 0.05)
258                        Performance has improved.
259Benchmarking log/nachricht/deserialize
260Benchmarking log/nachricht/deserialize: Warming up for 3.0000 s
261Benchmarking log/nachricht/deserialize: Collecting 100 samples in estimated 5.0011 s (800 iterations)
262Benchmarking log/nachricht/deserialize: Analyzing
263log/nachricht/deserialize
264                        time:   [5.8732 ms 5.9315 ms 5.9895 ms]
265                        change: [-7.5747% -6.0718% -4.6243%] (p = 0.00 < 0.05)
266                        Performance has improved.
267log/nachricht/size 818669
268log/nachricht/zlib 334639
269log/nachricht/zstd 285514
270
271Benchmarking log/postcard/serialize
272Benchmarking log/postcard/serialize: Warming up for 3.0000 s
273Benchmarking log/postcard/serialize: Collecting 100 samples in estimated 6.2243 s (15k iterations)
274Benchmarking log/postcard/serialize: Analyzing
275log/postcard/serialize  time:   [401.22 µs 405.10 µs 409.48 µs]
276                        change: [-13.467% -10.081% -7.3904%] (p = 0.00 < 0.05)
277                        Performance has improved.
278Found 6 outliers among 100 measurements (6.00%)
279  6 (6.00%) high mild
280Benchmarking log/postcard/deserialize
281Benchmarking log/postcard/deserialize: Warming up for 3.0000 s
282Benchmarking log/postcard/deserialize: Collecting 100 samples in estimated 5.2658 s (1600 iterations)
283Benchmarking log/postcard/deserialize: Analyzing
284log/postcard/deserialize
285                        time:   [3.2268 ms 3.2539 ms 3.2822 ms]
286                        change: [-13.274% -12.007% -10.790%] (p = 0.00 < 0.05)
287                        Performance has improved.
288Found 2 outliers among 100 measurements (2.00%)
289  2 (2.00%) high mild
290log/postcard/size 724953
291log/postcard/zlib 303462
292log/postcard/zstd 253747
293
294Benchmarking log/prost/serialize (populate + encode)
295Benchmarking log/prost/serialize (populate + encode): Warming up for 3.0000 s
296Benchmarking log/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.2196 s (1700 iterations)
297Benchmarking log/prost/serialize (populate + encode): Analyzing
298log/prost/serialize (populate + encode)
299                        time:   [3.0896 ms 3.1138 ms 3.1404 ms]
300                        change: [-10.321% -9.0501% -7.7655%] (p = 0.00 < 0.05)
301                        Performance has improved.
302Found 7 outliers among 100 measurements (7.00%)
303  6 (6.00%) high mild
304  1 (1.00%) high severe
305Benchmarking log/prost/serialize (encode)
306Benchmarking log/prost/serialize (encode): Warming up for 3.0000 s
307Benchmarking log/prost/serialize (encode): Collecting 100 samples in estimated 5.8632 s (10k iterations)
308Benchmarking log/prost/serialize (encode): Analyzing
309log/prost/serialize (encode)
310                        time:   [576.94 µs 582.69 µs 589.05 µs]
311                        change: [-9.0728% -7.4407% -5.8235%] (p = 0.00 < 0.05)
312                        Performance has improved.
313Found 6 outliers among 100 measurements (6.00%)
314  6 (6.00%) high mild
315Benchmarking log/prost/deserialize
316Benchmarking log/prost/deserialize: Warming up for 3.0000 s
317Benchmarking log/prost/deserialize: Collecting 100 samples in estimated 5.3766 s (1400 iterations)
318Benchmarking log/prost/deserialize: Analyzing
319log/prost/deserialize   time:   [3.9276 ms 3.9637 ms 4.0017 ms]
320                        change: [-11.655% -10.389% -9.1298%] (p = 0.00 < 0.05)
321                        Performance has improved.
322Found 7 outliers among 100 measurements (7.00%)
323  7 (7.00%) high mild
324log/prost/size 764951
325log/prost/zlib 269811
326log/prost/zstd 227947
327
328Benchmarking log/rkyv/serialize
329Benchmarking log/rkyv/serialize: Warming up for 3.0000 s
330Benchmarking log/rkyv/serialize: Collecting 100 samples in estimated 5.4212 s (15k iterations)
331Benchmarking log/rkyv/serialize: Analyzing
332log/rkyv/serialize      time:   [381.19 µs 383.40 µs 385.58 µs]
333                        change: [-1.8924% -0.7032% +0.4232%] (p = 0.24 > 0.05)
334                        No change in performance detected.
335Found 8 outliers among 100 measurements (8.00%)
336  7 (7.00%) low mild
337  1 (1.00%) high mild
338Benchmarking log/rkyv/access (unvalidated)
339Benchmarking log/rkyv/access (unvalidated): Warming up for 3.0000 s
340Benchmarking log/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (2.8B iterations)
341Benchmarking log/rkyv/access (unvalidated): Analyzing
342log/rkyv/access (unvalidated)
343                        time:   [1.7989 ns 1.8134 ns 1.8278 ns]
344                        change: [-0.2811% +1.6249% +3.3287%] (p = 0.08 > 0.05)
345                        No change in performance detected.
346Found 3 outliers among 100 measurements (3.00%)
347  3 (3.00%) low mild
348Benchmarking log/rkyv/access (validated upfront with error)
349Benchmarking log/rkyv/access (validated upfront with error): Warming up for 3.0000 s
350Benchmarking log/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 9.2724 s (10k iterations)
351Benchmarking log/rkyv/access (validated upfront with error): Analyzing
352log/rkyv/access (validated upfront with error)
353                        time:   [927.92 µs 934.58 µs 941.60 µs]
354                        change: [+15.695% +16.838% +17.922%] (p = 0.00 < 0.05)
355                        Performance has regressed.
356Found 2 outliers among 100 measurements (2.00%)
357  2 (2.00%) low mild
358Benchmarking log/rkyv/read (unvalidated)
359Benchmarking log/rkyv/read (unvalidated): Warming up for 3.0000 s
360Benchmarking log/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0138 s (293k iterations)
361Benchmarking log/rkyv/read (unvalidated): Analyzing
362log/rkyv/read (unvalidated)
363                        time:   [17.046 µs 17.190 µs 17.356 µs]
364                        change: [-18.840% -17.584% -16.398%] (p = 0.00 < 0.05)
365                        Performance has improved.
366Found 3 outliers among 100 measurements (3.00%)
367  2 (2.00%) high mild
368  1 (1.00%) high severe
369Benchmarking log/rkyv/read (validated upfront with error)
370Benchmarking log/rkyv/read (validated upfront with error): Warming up for 3.0000 s
371Benchmarking log/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 9.0833 s (10k iterations)
372Benchmarking log/rkyv/read (validated upfront with error): Analyzing
373log/rkyv/read (validated upfront with error)
374                        time:   [886.19 µs 893.62 µs 901.87 µs]
375                        change: [+6.9158% +8.4743% +9.9616%] (p = 0.00 < 0.05)
376                        Performance has regressed.
377Benchmarking log/rkyv/update
378Benchmarking log/rkyv/update: Warming up for 3.0000 s
379Benchmarking log/rkyv/update: Collecting 100 samples in estimated 5.0295 s (338k iterations)
380Benchmarking log/rkyv/update: Analyzing
381log/rkyv/update         time:   [14.883 µs 14.968 µs 15.060 µs]
382                        change: [-36.989% -36.184% -35.401%] (p = 0.00 < 0.05)
383                        Performance has improved.
384Benchmarking log/rkyv/deserialize (unvalidated)
385Benchmarking log/rkyv/deserialize (unvalidated): Warming up for 3.0000 s
386Benchmarking log/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 5.1287 s (1900 iterations)
387Benchmarking log/rkyv/deserialize (unvalidated): Analyzing
388log/rkyv/deserialize (unvalidated)
389                        time:   [2.7911 ms 2.8086 ms 2.8261 ms]
390                        change: [+3.0894% +4.4755% +5.8423%] (p = 0.00 < 0.05)
391                        Performance has regressed.
392Found 1 outliers among 100 measurements (1.00%)
393  1 (1.00%) low mild
394Benchmarking log/rkyv/deserialize (validated upfront with error)
395Benchmarking log/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s
396Benchmarking log/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.1977 s (1300 iterations)
397Benchmarking log/rkyv/deserialize (validated upfront with error): Analyzing
398log/rkyv/deserialize (validated upfront with error)
399                        time:   [3.9051 ms 3.9313 ms 3.9584 ms]
400                        change: [+9.0096% +10.326% +11.658%] (p = 0.00 < 0.05)
401                        Performance has regressed.
402Found 2 outliers among 100 measurements (2.00%)
403  2 (2.00%) high mild
404log/rkyv/size 1011488
405log/rkyv/zlib 392809
406log/rkyv/zstd 331932
407
408Benchmarking log/rmp/serialize
409Benchmarking log/rmp/serialize: Warming up for 3.0000 s
410
411Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.0s, enable flat sampling, or reduce sample count to 50.
412Benchmarking log/rmp/serialize: Collecting 100 samples in estimated 8.0482 s (5050 iterations)
413Benchmarking log/rmp/serialize: Analyzing
414log/rmp/serialize       time:   [1.5109 ms 1.5228 ms 1.5359 ms]
415                        change: [-7.6586% -6.6813% -5.6225%] (p = 0.00 < 0.05)
416                        Performance has improved.
417Found 2 outliers among 100 measurements (2.00%)
418  2 (2.00%) high mild
419Benchmarking log/rmp/deserialize
420Benchmarking log/rmp/deserialize: Warming up for 3.0000 s
421Benchmarking log/rmp/deserialize: Collecting 100 samples in estimated 5.2291 s (1100 iterations)
422Benchmarking log/rmp/deserialize: Analyzing
423log/rmp/deserialize     time:   [4.6893 ms 4.7238 ms 4.7595 ms]
424                        change: [-5.5977% -4.4648% -3.2597%] (p = 0.00 < 0.05)
425                        Performance has improved.
426Found 2 outliers among 100 measurements (2.00%)
427  2 (2.00%) high mild
428log/rmp/size 784997
429log/rmp/zlib 326654
430log/rmp/zstd 278219
431
432Benchmarking log/ron/serialize
433Benchmarking log/ron/serialize: Warming up for 3.0000 s
434Benchmarking log/ron/serialize: Collecting 100 samples in estimated 5.4323 s (300 iterations)
435Benchmarking log/ron/serialize: Analyzing
436log/ron/serialize       time:   [18.027 ms 18.174 ms 18.324 ms]
437                        change: [-4.6892% -3.5558% -2.4639%] (p = 0.00 < 0.05)
438                        Performance has improved.
439Found 2 outliers among 100 measurements (2.00%)
440  2 (2.00%) high mild
441Benchmarking log/ron/deserialize
442Benchmarking log/ron/deserialize: Warming up for 3.0000 s
443Benchmarking log/ron/deserialize: Collecting 100 samples in estimated 5.4451 s (300 iterations)
444Benchmarking log/ron/deserialize: Analyzing
445log/ron/deserialize     time:   [19.587 ms 19.748 ms 19.910 ms]
446                        change: [+9.0428% +10.430% +11.793%] (p = 0.00 < 0.05)
447                        Performance has regressed.
448log/ron/size 1607459
449log/ron/zlib 452648
450log/ron/zstd 349713
451
452Benchmarking log/serde_json/serialize
453Benchmarking log/serde_json/serialize: Warming up for 3.0000 s
454Benchmarking log/serde_json/serialize: Collecting 100 samples in estimated 5.4668 s (1100 iterations)
455Benchmarking log/serde_json/serialize: Analyzing
456log/serde_json/serialize
457                        time:   [4.7562 ms 4.7979 ms 4.8394 ms]
458                        change: [-3.8828% -2.3932% -0.9381%] (p = 0.00 < 0.05)
459                        Change within noise threshold.
460Benchmarking log/serde_json/deserialize
461Benchmarking log/serde_json/deserialize: Warming up for 3.0000 s
462Benchmarking log/serde_json/deserialize: Collecting 100 samples in estimated 5.4980 s (600 iterations)
463Benchmarking log/serde_json/deserialize: Analyzing
464log/serde_json/deserialize
465                        time:   [8.9873 ms 9.0660 ms 9.1465 ms]
466                        change: [-12.954% -11.723% -10.481%] (p = 0.00 < 0.05)
467                        Performance has improved.
468log/serde_json/size 1827461
469log/serde_json/zlib 474358
470log/serde_json/zstd 361090
471
472Benchmarking log/simd-json/serialize
473Benchmarking log/simd-json/serialize: Warming up for 3.0000 s
474Benchmarking log/simd-json/serialize: Collecting 100 samples in estimated 5.0119 s (1100 iterations)
475Benchmarking log/simd-json/serialize: Analyzing
476log/simd-json/serialize time:   [4.4547 ms 4.5000 ms 4.5456 ms]
477                        change: [-6.8795% -5.4307% -4.0819%] (p = 0.00 < 0.05)
478                        Performance has improved.
479Benchmarking log/simd-json/deserialize
480Benchmarking log/simd-json/deserialize: Warming up for 3.0000 s
481Benchmarking log/simd-json/deserialize: Collecting 100 samples in estimated 5.6480 s (700 iterations)
482Benchmarking log/simd-json/deserialize: Analyzing
483log/simd-json/deserialize
484                        time:   [7.4340 ms 7.4627 ms 7.4916 ms]
485                        change: [+12.370% +13.576% +14.723%] (p = 0.00 < 0.05)
486                        Performance has regressed.
487Found 1 outliers among 100 measurements (1.00%)
488  1 (1.00%) high mild
489log/simd-json/size 1827461
490log/simd-json/zlib 474358
491log/simd-json/zstd 361090
492
493Benchmarking log/speedy/serialize
494Benchmarking log/speedy/serialize: Warming up for 3.0000 s
495Benchmarking log/speedy/serialize: Collecting 100 samples in estimated 5.5973 s (15k iterations)
496Benchmarking log/speedy/serialize: Analyzing
497log/speedy/serialize    time:   [370.71 µs 371.19 µs 371.79 µs]
498                        change: [+25.011% +25.933% +26.831%] (p = 0.00 < 0.05)
499                        Performance has regressed.
500Found 4 outliers among 100 measurements (4.00%)
501  1 (1.00%) low severe
502  1 (1.00%) low mild
503  1 (1.00%) high mild
504  1 (1.00%) high severe
505Benchmarking log/speedy/deserialize
506Benchmarking log/speedy/deserialize: Warming up for 3.0000 s
507Benchmarking log/speedy/deserialize: Collecting 100 samples in estimated 5.2186 s (1500 iterations)
508Benchmarking log/speedy/deserialize: Analyzing
509log/speedy/deserialize  time:   [3.4206 ms 3.4305 ms 3.4392 ms]
510                        change: [+13.306% +14.102% +14.879%] (p = 0.00 < 0.05)
511                        Performance has regressed.
512Found 6 outliers among 100 measurements (6.00%)
513  2 (2.00%) low severe
514  4 (4.00%) low mild
515log/speedy/size 885780
516log/speedy/zlib 363280
517log/speedy/zstd 286514
518
519Benchmarking log/alkahest/serialize
520Benchmarking log/alkahest/serialize: Warming up for 3.0000 s
521Benchmarking log/alkahest/serialize: Collecting 100 samples in estimated 5.7451 s (20k iterations)
522Benchmarking log/alkahest/serialize: Analyzing
523log/alkahest/serialize  time:   [286.65 µs 287.99 µs 289.51 µs]
524                        change: [+8.6065% +9.8972% +11.081%] (p = 0.00 < 0.05)
525                        Performance has regressed.
526Found 11 outliers among 100 measurements (11.00%)
527  2 (2.00%) low severe
528  4 (4.00%) low mild
529  2 (2.00%) high mild
530  3 (3.00%) high severe
531Benchmarking log/alkahest/access (validated on-demand with panic)
532Benchmarking log/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s
533Benchmarking log/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.8B iterations)
534Benchmarking log/alkahest/access (validated on-demand with panic): Analyzing
535log/alkahest/access (validated on-demand with panic)
536                        time:   [2.7414 ns 2.7619 ns 2.7813 ns]
537                        change: [+15.081% +16.214% +17.239%] (p = 0.00 < 0.05)
538                        Performance has regressed.
539Found 5 outliers among 100 measurements (5.00%)
540  1 (1.00%) low severe
541  3 (3.00%) low mild
542  1 (1.00%) high mild
543Benchmarking log/alkahest/read (validated on-demand with panic)
544Benchmarking log/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s
545Benchmarking log/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.0282 s (81k iterations)
546Benchmarking log/alkahest/read (validated on-demand with panic): Analyzing
547log/alkahest/read (validated on-demand with panic)
548                        time:   [62.903 µs 63.281 µs 63.694 µs]
549                        change: [+47.242% +48.372% +49.532%] (p = 0.00 < 0.05)
550                        Performance has regressed.
551Found 7 outliers among 100 measurements (7.00%)
552  4 (4.00%) low mild
553  3 (3.00%) high mild
554log/alkahest/size 1045784
555log/alkahest/zlib 454748
556log/alkahest/zstd 389424
557
558Benchmarking log/dlhn/serialize
559Benchmarking log/dlhn/serialize: Warming up for 3.0000 s
560Benchmarking log/dlhn/serialize: Collecting 100 samples in estimated 8.7744 s (10k iterations)
561Benchmarking log/dlhn/serialize: Analyzing
562log/dlhn/serialize      time:   [851.98 µs 854.45 µs 857.19 µs]
563                        change: [-0.6273% +0.8424% +2.2124%] (p = 0.25 > 0.05)
564                        No change in performance detected.
565Found 1 outliers among 100 measurements (1.00%)
566  1 (1.00%) low mild
567Benchmarking log/dlhn/deserialize
568Benchmarking log/dlhn/deserialize: Warming up for 3.0000 s
569Benchmarking log/dlhn/deserialize: Collecting 100 samples in estimated 5.3582 s (1200 iterations)
570Benchmarking log/dlhn/deserialize: Analyzing
571log/dlhn/deserialize    time:   [4.4371 ms 4.4512 ms 4.4653 ms]
572                        change: [+2.7402% +4.2453% +5.6117%] (p = 0.00 < 0.05)
573                        Performance has regressed.
574Found 1 outliers among 100 measurements (1.00%)
575  1 (1.00%) low mild
576log/dlhn/size 724953
577log/dlhn/zlib 302512
578log/dlhn/zstd 253629
579
580Benchmarking mesh/abomonation/serialize
581Benchmarking mesh/abomonation/serialize: Warming up for 3.0000 s
582Benchmarking mesh/abomonation/serialize: Collecting 100 samples in estimated 5.3756 s (10k iterations)
583Benchmarking mesh/abomonation/serialize: Analyzing
584mesh/abomonation/serialize
585                        time:   [533.46 µs 534.19 µs 535.20 µs]
586                        change: [+17.119% +18.108% +19.054%] (p = 0.00 < 0.05)
587                        Performance has regressed.
588Found 4 outliers among 100 measurements (4.00%)
589  3 (3.00%) low mild
590  1 (1.00%) high severe
591Benchmarking mesh/abomonation/access (unvalidated)
592Benchmarking mesh/abomonation/access (unvalidated): Warming up for 3.0000 s
593Benchmarking mesh/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.6B iterations)
594Benchmarking mesh/abomonation/access (unvalidated): Analyzing
595mesh/abomonation/access (unvalidated)
596                        time:   [3.1536 ns 3.1660 ns 3.1783 ns]
597                        change: [+3.9693% +5.1019% +6.2013%] (p = 0.00 < 0.05)
598                        Performance has regressed.
599Found 5 outliers among 100 measurements (5.00%)
600  4 (4.00%) low mild
601  1 (1.00%) high severe
602Benchmarking mesh/abomonation/read (unvalidated)
603Benchmarking mesh/abomonation/read (unvalidated): Warming up for 3.0000 s
604Benchmarking mesh/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.8658 s (20k iterations)
605Benchmarking mesh/abomonation/read (unvalidated): Analyzing
606mesh/abomonation/read (unvalidated)
607                        time:   [288.10 µs 288.88 µs 289.64 µs]
608                        change: [+18.898% +19.802% +20.677%] (p = 0.00 < 0.05)
609                        Performance has regressed.
610Found 5 outliers among 100 measurements (5.00%)
611  3 (3.00%) low mild
612  2 (2.00%) high mild
613Benchmarking mesh/abomonation/deserialize (unvalidated)
614Benchmarking mesh/abomonation/deserialize (unvalidated): Warming up for 3.0000 s
615Benchmarking mesh/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.3151 s (10k iterations)
616Benchmarking mesh/abomonation/deserialize (unvalidated): Analyzing
617mesh/abomonation/deserialize (unvalidated)
618                        time:   [525.38 µs 526.09 µs 527.00 µs]
619                        change: [+17.759% +18.778% +19.711%] (p = 0.00 < 0.05)
620                        Performance has regressed.
621Found 6 outliers among 100 measurements (6.00%)
622  4 (4.00%) low mild
623  1 (1.00%) high mild
624  1 (1.00%) high severe
625mesh/abomonation/size 6000024
626mesh/abomonation/zlib 5380836
627mesh/abomonation/zstd 5345889
628
629Benchmarking mesh/bare/serialize
630Benchmarking mesh/bare/serialize: Warming up for 3.0000 s
631Benchmarking mesh/bare/serialize: Collecting 100 samples in estimated 5.7937 s (700 iterations)
632Benchmarking mesh/bare/serialize: Analyzing
633mesh/bare/serialize     time:   [8.2039 ms 8.2287 ms 8.2526 ms]
634                        change: [+3.9284% +4.9120% +5.8269%] (p = 0.00 < 0.05)
635                        Performance has regressed.
636Found 1 outliers among 100 measurements (1.00%)
637  1 (1.00%) low mild
638Benchmarking mesh/bare/deserialize
639Benchmarking mesh/bare/deserialize: Warming up for 3.0000 s
640Benchmarking mesh/bare/deserialize: Collecting 100 samples in estimated 5.5391 s (800 iterations)
641Benchmarking mesh/bare/deserialize: Analyzing
642mesh/bare/deserialize   time:   [6.8450 ms 6.8687 ms 6.8937 ms]
643                        change: [+4.0201% +5.1203% +6.1581%] (p = 0.00 < 0.05)
644                        Performance has regressed.
645Found 4 outliers among 100 measurements (4.00%)
646  1 (1.00%) low mild
647  2 (2.00%) high mild
648  1 (1.00%) high severe
649mesh/bare/size 6000003
650mesh/bare/zlib 5380817
651mesh/bare/zstd 5345900
652
653Benchmarking mesh/bincode/serialize
654Benchmarking mesh/bincode/serialize: Warming up for 3.0000 s
655Benchmarking mesh/bincode/serialize: Collecting 100 samples in estimated 5.0776 s (800 iterations)
656Benchmarking mesh/bincode/serialize: Analyzing
657mesh/bincode/serialize  time:   [6.4235 ms 6.4404 ms 6.4581 ms]
658                        change: [+11.781% +12.905% +13.998%] (p = 0.00 < 0.05)
659                        Performance has regressed.
660Found 2 outliers among 100 measurements (2.00%)
661  2 (2.00%) high mild
662Benchmarking mesh/bincode/deserialize
663Benchmarking mesh/bincode/deserialize: Warming up for 3.0000 s
664Benchmarking mesh/bincode/deserialize: Collecting 100 samples in estimated 5.0359 s (800 iterations)
665Benchmarking mesh/bincode/deserialize: Analyzing
666mesh/bincode/deserialize
667                        time:   [6.2341 ms 6.2545 ms 6.2762 ms]
668                        change: [+10.527% +11.469% +12.401%] (p = 0.00 < 0.05)
669                        Performance has regressed.
670Found 1 outliers among 100 measurements (1.00%)
671  1 (1.00%) high severe
672mesh/bincode/size 6000008
673mesh/bincode/zlib 5380823
674mesh/bincode/zstd 5345890
675
676Benchmarking mesh/borsh/serialize
677Benchmarking mesh/borsh/serialize: Warming up for 3.0000 s
678Benchmarking mesh/borsh/serialize: Collecting 100 samples in estimated 5.2210 s (600 iterations)
679Benchmarking mesh/borsh/serialize: Analyzing
680mesh/borsh/serialize    time:   [8.7891 ms 8.8123 ms 8.8338 ms]
681                        change: [+21.022% +22.324% +23.604%] (p = 0.00 < 0.05)
682                        Performance has regressed.
683Found 5 outliers among 100 measurements (5.00%)
684  3 (3.00%) low severe
685  2 (2.00%) low mild
686Benchmarking mesh/borsh/deserialize
687Benchmarking mesh/borsh/deserialize: Warming up for 3.0000 s
688Benchmarking mesh/borsh/deserialize: Collecting 100 samples in estimated 5.3085 s (800 iterations)
689Benchmarking mesh/borsh/deserialize: Analyzing
690mesh/borsh/deserialize  time:   [6.6540 ms 6.6706 ms 6.6869 ms]
691                        change: [+11.710% +13.513% +15.072%] (p = 0.00 < 0.05)
692                        Performance has regressed.
693Found 6 outliers among 100 measurements (6.00%)
694  3 (3.00%) low mild
695  3 (3.00%) high mild
696mesh/borsh/size 6000004
697mesh/borsh/zlib 5380818
698mesh/borsh/zstd 5345889
699
700Benchmarking mesh/bson/serialize
701Benchmarking mesh/bson/serialize: Warming up for 3.0000 s
702
703Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.5s, or reduce sample count to 70.
704Benchmarking mesh/bson/serialize: Collecting 100 samples in estimated 6.5110 s (100 iterations)
705Benchmarking mesh/bson/serialize: Analyzing
706mesh/bson/serialize     time:   [64.826 ms 65.038 ms 65.311 ms]
707                        change: [+1.2210% +3.2636% +5.1003%] (p = 0.00 < 0.05)
708                        Performance has regressed.
709Found 16 outliers among 100 measurements (16.00%)
710  5 (5.00%) low severe
711  9 (9.00%) low mild
712  2 (2.00%) high severe
713Benchmarking mesh/bson/deserialize
714Benchmarking mesh/bson/deserialize: Warming up for 3.0000 s
715
716Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.6s, or reduce sample count to 30.
717Benchmarking mesh/bson/deserialize: Collecting 100 samples in estimated 15.600 s (100 iterations)
718Benchmarking mesh/bson/deserialize: Analyzing
719mesh/bson/deserialize   time:   [155.29 ms 155.44 ms 155.62 ms]
720                        change: [+6.2237% +6.9118% +7.5809%] (p = 0.00 < 0.05)
721                        Performance has regressed.
722Found 6 outliers among 100 measurements (6.00%)
723  2 (2.00%) high mild
724  4 (4.00%) high severe
725mesh/bson/size 23013911
726mesh/bson/zlib 9211138
727mesh/bson/zstd 7497811
728
729Benchmarking mesh/capnp/serialize
730Benchmarking mesh/capnp/serialize: Warming up for 3.0000 s
731Benchmarking mesh/capnp/serialize: Collecting 100 samples in estimated 6.5986 s (400 iterations)
732Benchmarking mesh/capnp/serialize: Analyzing
733mesh/capnp/serialize    time:   [16.478 ms 16.565 ms 16.656 ms]
734                        change: [+35.848% +37.716% +39.517%] (p = 0.00 < 0.05)
735                        Performance has regressed.
736Found 2 outliers among 100 measurements (2.00%)
737  2 (2.00%) high mild
738Benchmarking mesh/capnp/access (validated on-demand with error)
739Benchmarking mesh/capnp/access (validated on-demand with error): Warming up for 3.0000 s
740Benchmarking mesh/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0005 s (22M iterations)
741Benchmarking mesh/capnp/access (validated on-demand with error): Analyzing
742mesh/capnp/access (validated on-demand with error)
743                        time:   [227.94 ns 228.39 ns 229.18 ns]
744                        change: [+7.4151% +8.8049% +10.063%] (p = 0.00 < 0.05)
745                        Performance has regressed.
746Found 14 outliers among 100 measurements (14.00%)
747  1 (1.00%) low mild
748  8 (8.00%) high mild
749  5 (5.00%) high severe
750Benchmarking mesh/capnp/read (validated on-demand with error)
751Benchmarking mesh/capnp/read (validated on-demand with error): Warming up for 3.0000 s
752Benchmarking mesh/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.2756 s (700 iterations)
753Benchmarking mesh/capnp/read (validated on-demand with error): Analyzing
754mesh/capnp/read (validated on-demand with error)
755                        time:   [7.6090 ms 7.6195 ms 7.6313 ms]
756                        change: [+11.337% +12.062% +12.781%] (p = 0.00 < 0.05)
757                        Performance has regressed.
758Found 1 outliers among 100 measurements (1.00%)
759  1 (1.00%) high severe
760mesh/capnp/size 14000088
761mesh/capnp/zlib 6729881
762mesh/capnp/zstd 6051062
763
764Benchmarking mesh/cbor/serialize
765Benchmarking mesh/cbor/serialize: Warming up for 3.0000 s
766
767Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, or reduce sample count to 90.
768Benchmarking mesh/cbor/serialize: Collecting 100 samples in estimated 5.2658 s (100 iterations)
769Benchmarking mesh/cbor/serialize: Analyzing
770mesh/cbor/serialize     time:   [52.506 ms 52.548 ms 52.588 ms]
771                        change: [+13.668% +14.435% +15.157%] (p = 0.00 < 0.05)
772                        Performance has regressed.
773Found 8 outliers among 100 measurements (8.00%)
774  4 (4.00%) low severe
775  1 (1.00%) low mild
776  2 (2.00%) high mild
777  1 (1.00%) high severe
778Benchmarking mesh/cbor/deserialize
779Benchmarking mesh/cbor/deserialize: Warming up for 3.0000 s
780
781Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.3s, or reduce sample count to 70.
782Benchmarking mesh/cbor/deserialize: Collecting 100 samples in estimated 6.3004 s (100 iterations)
783Benchmarking mesh/cbor/deserialize: Analyzing
784mesh/cbor/deserialize   time:   [62.660 ms 62.742 ms 62.819 ms]
785                        change: [+10.055% +11.016% +11.938%] (p = 0.00 < 0.05)
786                        Performance has regressed.
787Found 3 outliers among 100 measurements (3.00%)
788  3 (3.00%) low mild
789mesh/cbor/size 13122324
790mesh/cbor/zlib 7527423
791mesh/cbor/zstd 6759658
792
793Benchmarking mesh/flatbuffers/serialize
794Benchmarking mesh/flatbuffers/serialize: Warming up for 3.0000 s
795
796Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60.
797Benchmarking mesh/flatbuffers/serialize: Collecting 100 samples in estimated 5.2696 s (5050 iterations)
798Benchmarking mesh/flatbuffers/serialize: Analyzing
799mesh/flatbuffers/serialize
800                        time:   [1.1108 ms 1.1173 ms 1.1258 ms]
801                        change: [-7.2666% -6.4275% -5.4915%] (p = 0.00 < 0.05)
802                        Performance has improved.
803Found 6 outliers among 100 measurements (6.00%)
804  2 (2.00%) high mild
805  4 (4.00%) high severe
806Benchmarking mesh/flatbuffers/access (unvalidated)
807Benchmarking mesh/flatbuffers/access (unvalidated): Warming up for 3.0000 s
808Benchmarking mesh/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.3B iterations)
809Benchmarking mesh/flatbuffers/access (unvalidated): Analyzing
810mesh/flatbuffers/access (unvalidated)
811                        time:   [3.9269 ns 3.9283 ns 3.9303 ns]
812                        change: [+7.9476% +15.051% +19.550%] (p = 0.00 < 0.05)
813                        Performance has regressed.
814Found 11 outliers among 100 measurements (11.00%)
815  1 (1.00%) low severe
816  4 (4.00%) high mild
817  6 (6.00%) high severe
818Benchmarking mesh/flatbuffers/access (validated upfront with error)
819Benchmarking mesh/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s
820Benchmarking mesh/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.0002 s (65M iterations)
821Benchmarking mesh/flatbuffers/access (validated upfront with error): Analyzing
822mesh/flatbuffers/access (validated upfront with error)
823                        time:   [76.768 ns 76.794 ns 76.832 ns]
824                        change: [+3.2739% +4.2281% +5.1383%] (p = 0.00 < 0.05)
825                        Performance has regressed.
826Found 7 outliers among 100 measurements (7.00%)
827  2 (2.00%) low mild
828  3 (3.00%) high mild
829  2 (2.00%) high severe
830Benchmarking mesh/flatbuffers/read (unvalidated)
831Benchmarking mesh/flatbuffers/read (unvalidated): Warming up for 3.0000 s
832Benchmarking mesh/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.1459 s (91k iterations)
833Benchmarking mesh/flatbuffers/read (unvalidated): Analyzing
834mesh/flatbuffers/read (unvalidated)
835                        time:   [56.302 µs 56.468 µs 56.603 µs]
836                        change: [+24.608% +26.557% +28.191%] (p = 0.00 < 0.05)
837                        Performance has regressed.
838Found 11 outliers among 100 measurements (11.00%)
839  3 (3.00%) low severe
840  7 (7.00%) low mild
841  1 (1.00%) high mild
842Benchmarking mesh/flatbuffers/read (validated upfront with error)
843Benchmarking mesh/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s
844Benchmarking mesh/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.1147 s (106k iterations)
845Benchmarking mesh/flatbuffers/read (validated upfront with error): Analyzing
846mesh/flatbuffers/read (validated upfront with error)
847                        time:   [48.118 µs 48.350 µs 48.599 µs]
848                        change: [+7.5702% +8.7987% +9.9867%] (p = 0.00 < 0.05)
849                        Performance has regressed.
850Found 6 outliers among 100 measurements (6.00%)
851  2 (2.00%) low severe
852  3 (3.00%) low mild
853  1 (1.00%) high severe
854mesh/flatbuffers/size 6000024
855mesh/flatbuffers/zlib 5380800
856mesh/flatbuffers/zstd 5345910
857
858Benchmarking mesh/nachricht/serialize
859Benchmarking mesh/nachricht/serialize: Warming up for 3.0000 s
860
861Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 18.2s, or reduce sample count to 20.
862Benchmarking mesh/nachricht/serialize: Collecting 100 samples in estimated 18.196 s (100 iterations)
863Benchmarking mesh/nachricht/serialize: Analyzing
864mesh/nachricht/serialize
865                        time:   [182.15 ms 182.65 ms 183.14 ms]
866                        change: [+4.3032% +5.0440% +5.7336%] (p = 0.00 < 0.05)
867                        Performance has regressed.
868Found 1 outliers among 100 measurements (1.00%)
869  1 (1.00%) low mild
870Benchmarking mesh/nachricht/deserialize
871Benchmarking mesh/nachricht/deserialize: Warming up for 3.0000 s
872
873Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, or reduce sample count to 90.
874Benchmarking mesh/nachricht/deserialize: Collecting 100 samples in estimated 5.3059 s (100 iterations)
875Benchmarking mesh/nachricht/deserialize: Analyzing
876mesh/nachricht/deserialize
877                        time:   [52.374 ms 52.550 ms 52.723 ms]
878                        change: [+5.1793% +6.5704% +7.9010%] (p = 0.00 < 0.05)
879                        Performance has regressed.
880Found 1 outliers among 100 measurements (1.00%)
881  1 (1.00%) low mild
882mesh/nachricht/size 8125037
883mesh/nachricht/zlib 6495174
884mesh/nachricht/zstd 6386940
885
886Benchmarking mesh/postcard/serialize
887Benchmarking mesh/postcard/serialize: Warming up for 3.0000 s
888
889Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60.
890Benchmarking mesh/postcard/serialize: Collecting 100 samples in estimated 5.6966 s (5050 iterations)
891Benchmarking mesh/postcard/serialize: Analyzing
892mesh/postcard/serialize time:   [1.1343 ms 1.1384 ms 1.1427 ms]
893                        change: [+45.689% +48.195% +50.306%] (p = 0.00 < 0.05)
894                        Performance has regressed.
895Found 5 outliers among 100 measurements (5.00%)
896  1 (1.00%) low severe
897  3 (3.00%) low mild
898  1 (1.00%) high mild
899Benchmarking mesh/postcard/deserialize
900Benchmarking mesh/postcard/deserialize: Warming up for 3.0000 s
901
902Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.0s, enable flat sampling, or reduce sample count to 50.
903Benchmarking mesh/postcard/deserialize: Collecting 100 samples in estimated 9.0355 s (5050 iterations)
904Benchmarking mesh/postcard/deserialize: Analyzing
905mesh/postcard/deserialize
906                        time:   [1.7711 ms 1.7790 ms 1.7867 ms]
907                        change: [+19.139% +22.745% +25.340%] (p = 0.00 < 0.05)
908                        Performance has regressed.
909Found 5 outliers among 100 measurements (5.00%)
910  1 (1.00%) low severe
911  4 (4.00%) low mild
912mesh/postcard/size 6000003
913mesh/postcard/zlib 5380817
914mesh/postcard/zstd 5345900
915
916Benchmarking mesh/prost/serialize (populate + encode)
917Benchmarking mesh/prost/serialize (populate + encode): Warming up for 3.0000 s
918Benchmarking mesh/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.9609 s (400 iterations)
919Benchmarking mesh/prost/serialize (populate + encode): Analyzing
920mesh/prost/serialize (populate + encode)
921                        time:   [14.483 ms 14.555 ms 14.626 ms]
922                        change: [-5.9181% -4.8056% -3.6688%] (p = 0.00 < 0.05)
923                        Performance has improved.
924Found 1 outliers among 100 measurements (1.00%)
925  1 (1.00%) low mild
926Benchmarking mesh/prost/serialize (encode)
927Benchmarking mesh/prost/serialize (encode): Warming up for 3.0000 s
928Benchmarking mesh/prost/serialize (encode): Collecting 100 samples in estimated 5.8932 s (500 iterations)
929Benchmarking mesh/prost/serialize (encode): Analyzing
930mesh/prost/serialize (encode)
931                        time:   [11.148 ms 11.223 ms 11.300 ms]
932                        change: [-14.818% -13.784% -12.745%] (p = 0.00 < 0.05)
933                        Performance has improved.
934Benchmarking mesh/prost/deserialize
935Benchmarking mesh/prost/deserialize: Warming up for 3.0000 s
936Benchmarking mesh/prost/deserialize: Collecting 100 samples in estimated 6.3383 s (300 iterations)
937Benchmarking mesh/prost/deserialize: Analyzing
938mesh/prost/deserialize  time:   [20.506 ms 20.870 ms 21.262 ms]
939                        change: [-8.1130% -6.2720% -4.3761%] (p = 0.00 < 0.05)
940                        Performance has improved.
941Found 8 outliers among 100 measurements (8.00%)
942  7 (7.00%) high mild
943  1 (1.00%) high severe
944mesh/prost/size 8750000
945mesh/prost/zlib 6683814
946mesh/prost/zstd 6421871
947
948Benchmarking mesh/rkyv/serialize
949Benchmarking mesh/rkyv/serialize: Warming up for 3.0000 s
950Benchmarking mesh/rkyv/serialize: Collecting 100 samples in estimated 5.9845 s (10k iterations)
951Benchmarking mesh/rkyv/serialize: Analyzing
952mesh/rkyv/serialize     time:   [584.04 µs 588.74 µs 593.99 µs]
953                        change: [-36.513% -35.267% -34.173%] (p = 0.00 < 0.05)
954                        Performance has improved.
955Found 3 outliers among 100 measurements (3.00%)
956  2 (2.00%) high mild
957  1 (1.00%) high severe
958Benchmarking mesh/rkyv/access (unvalidated)
959Benchmarking mesh/rkyv/access (unvalidated): Warming up for 3.0000 s
960Benchmarking mesh/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (3.1B iterations)
961Benchmarking mesh/rkyv/access (unvalidated): Analyzing
962mesh/rkyv/access (unvalidated)
963                        time:   [1.6239 ns 1.6431 ns 1.6636 ns]
964                        change: [-10.571% -9.1964% -7.6480%] (p = 0.00 < 0.05)
965                        Performance has improved.
966Found 7 outliers among 100 measurements (7.00%)
967  5 (5.00%) high mild
968  2 (2.00%) high severe
969Benchmarking mesh/rkyv/access (validated upfront with error)
970Benchmarking mesh/rkyv/access (validated upfront with error): Warming up for 3.0000 s
971Benchmarking mesh/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 5.0001 s (278M iterations)
972Benchmarking mesh/rkyv/access (validated upfront with error): Analyzing
973mesh/rkyv/access (validated upfront with error)
974                        time:   [19.092 ns 19.362 ns 19.630 ns]
975                        change: [+13.449% +15.231% +17.099%] (p = 0.00 < 0.05)
976                        Performance has regressed.
977Found 4 outliers among 100 measurements (4.00%)
978  1 (1.00%) low severe
979  3 (3.00%) low mild
980Benchmarking mesh/rkyv/read (unvalidated)
981Benchmarking mesh/rkyv/read (unvalidated): Warming up for 3.0000 s
982Benchmarking mesh/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0093 s (111k iterations)
983Benchmarking mesh/rkyv/read (unvalidated): Analyzing
984mesh/rkyv/read (unvalidated)
985                        time:   [46.195 µs 46.623 µs 47.053 µs]
986                        change: [+1.5832% +2.9565% +4.3495%] (p = 0.00 < 0.05)
987                        Performance has regressed.
988Found 3 outliers among 100 measurements (3.00%)
989  1 (1.00%) low mild
990  2 (2.00%) high mild
991Benchmarking mesh/rkyv/read (validated upfront with error)
992Benchmarking mesh/rkyv/read (validated upfront with error): Warming up for 3.0000 s
993Benchmarking mesh/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 5.0451 s (121k iterations)
994Benchmarking mesh/rkyv/read (validated upfront with error): Analyzing
995mesh/rkyv/read (validated upfront with error)
996                        time:   [40.889 µs 41.336 µs 41.834 µs]
997                        change: [-7.0101% -5.8267% -4.7083%] (p = 0.00 < 0.05)
998                        Performance has improved.
999Found 10 outliers among 100 measurements (10.00%)
1000  2 (2.00%) low mild
1001  7 (7.00%) high mild
1002  1 (1.00%) high severe
1003Benchmarking mesh/rkyv/update
1004Benchmarking mesh/rkyv/update: Warming up for 3.0000 s
1005Benchmarking mesh/rkyv/update: Collecting 100 samples in estimated 5.2141 s (20k iterations)
1006Benchmarking mesh/rkyv/update: Analyzing
1007mesh/rkyv/update        time:   [257.80 µs 258.63 µs 259.54 µs]
1008                        change: [-16.024% -14.459% -13.045%] (p = 0.00 < 0.05)
1009                        Performance has improved.
1010Found 2 outliers among 100 measurements (2.00%)
1011  2 (2.00%) high mild
1012Benchmarking mesh/rkyv/deserialize (unvalidated)
1013Benchmarking mesh/rkyv/deserialize (unvalidated): Warming up for 3.0000 s
1014Benchmarking mesh/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 5.1267 s (10k iterations)
1015Benchmarking mesh/rkyv/deserialize (unvalidated): Analyzing
1016mesh/rkyv/deserialize (unvalidated)
1017                        time:   [506.92 µs 508.27 µs 509.75 µs]
1018                        change: [+3.4445% +4.7218% +5.9216%] (p = 0.00 < 0.05)
1019                        Performance has regressed.
1020Found 3 outliers among 100 measurements (3.00%)
1021  3 (3.00%) high mild
1022Benchmarking mesh/rkyv/deserialize (validated upfront with error)
1023Benchmarking mesh/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s
1024Benchmarking mesh/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.0819 s (10k iterations)
1025Benchmarking mesh/rkyv/deserialize (validated upfront with error): Analyzing
1026mesh/rkyv/deserialize (validated upfront with error)
1027                        time:   [509.28 µs 511.63 µs 514.41 µs]
1028                        change: [+4.0346% +4.8316% +5.6660%] (p = 0.00 < 0.05)
1029                        Performance has regressed.
1030Found 3 outliers among 100 measurements (3.00%)
1031  3 (3.00%) high severe
1032mesh/rkyv/size 6000008
1033mesh/rkyv/zlib 5380822
1034mesh/rkyv/zstd 5345892
1035
1036Benchmarking mesh/rmp/serialize
1037Benchmarking mesh/rmp/serialize: Warming up for 3.0000 s
1038Benchmarking mesh/rmp/serialize: Collecting 100 samples in estimated 5.8593 s (300 iterations)
1039Benchmarking mesh/rmp/serialize: Analyzing
1040mesh/rmp/serialize      time:   [19.648 ms 19.776 ms 19.906 ms]
1041                        change: [+2.8318% +4.1186% +5.4159%] (p = 0.00 < 0.05)
1042                        Performance has regressed.
1043Found 4 outliers among 100 measurements (4.00%)
1044  1 (1.00%) low mild
1045  3 (3.00%) high mild
1046Benchmarking mesh/rmp/deserialize
1047Benchmarking mesh/rmp/deserialize: Warming up for 3.0000 s
1048Benchmarking mesh/rmp/deserialize: Collecting 100 samples in estimated 5.9773 s (300 iterations)
1049Benchmarking mesh/rmp/deserialize: Analyzing
1050mesh/rmp/deserialize    time:   [20.370 ms 20.499 ms 20.630 ms]
1051                        change: [+4.8668% +6.2927% +7.6781%] (p = 0.00 < 0.05)
1052                        Performance has regressed.
1053Found 2 outliers among 100 measurements (2.00%)
1054  2 (2.00%) high mild
1055mesh/rmp/size 8125006
1056mesh/rmp/zlib 6496879
1057mesh/rmp/zstd 6391037
1058
1059Benchmarking mesh/ron/serialize
1060Benchmarking mesh/ron/serialize: Warming up for 3.0000 s
1061
1062Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 24.4s, or reduce sample count to 20.
1063Benchmarking mesh/ron/serialize: Collecting 100 samples in estimated 24.391 s (100 iterations)
1064Benchmarking mesh/ron/serialize: Analyzing
1065mesh/ron/serialize      time:   [236.28 ms 237.80 ms 239.35 ms]
1066                        change: [-13.179% -12.074% -10.925%] (p = 0.00 < 0.05)
1067                        Performance has improved.
1068Found 1 outliers among 100 measurements (1.00%)
1069  1 (1.00%) high mild
1070Benchmarking mesh/ron/deserialize
1071Benchmarking mesh/ron/deserialize: Warming up for 3.0000 s
1072
1073Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 32.4s, or reduce sample count to 10.
1074Benchmarking mesh/ron/deserialize: Collecting 100 samples in estimated 32.437 s (100 iterations)
1075Benchmarking mesh/ron/deserialize: Analyzing
1076mesh/ron/deserialize    time:   [310.92 ms 313.07 ms 315.33 ms]
1077                        change: [-3.5691% -2.4281% -1.3384%] (p = 0.00 < 0.05)
1078                        Performance has improved.
1079Found 2 outliers among 100 measurements (2.00%)
1080  2 (2.00%) high mild
1081mesh/ron/size 22192885
1082mesh/ron/zlib 9009575
1083mesh/ron/zstd 8138755
1084
1085Benchmarking mesh/serde_json/serialize
1086Benchmarking mesh/serde_json/serialize: Warming up for 3.0000 s
1087
1088Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 11.0s, or reduce sample count to 40.
1089Benchmarking mesh/serde_json/serialize: Collecting 100 samples in estimated 11.017 s (100 iterations)
1090Benchmarking mesh/serde_json/serialize: Analyzing
1091mesh/serde_json/serialize
1092                        time:   [110.70 ms 111.61 ms 112.57 ms]
1093                        change: [-19.159% -18.111% -17.103%] (p = 0.00 < 0.05)
1094                        Performance has improved.
1095Found 6 outliers among 100 measurements (6.00%)
1096  5 (5.00%) high mild
1097  1 (1.00%) high severe
1098Benchmarking mesh/serde_json/deserialize
1099Benchmarking mesh/serde_json/deserialize: Warming up for 3.0000 s
1100
1101Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.2s, or reduce sample count to 40.
1102Benchmarking mesh/serde_json/deserialize: Collecting 100 samples in estimated 10.152 s (100 iterations)
1103Benchmarking mesh/serde_json/deserialize: Analyzing
1104mesh/serde_json/deserialize
1105                        time:   [96.039 ms 96.813 ms 97.606 ms]
1106                        change: [-28.179% -27.408% -26.527%] (p = 0.00 < 0.05)
1107                        Performance has improved.
1108mesh/serde_json/size 26192883
1109mesh/serde_json/zlib 9612105
1110mesh/serde_json/zstd 8586741
1111
1112Benchmarking mesh/simd-json/serialize
1113Benchmarking mesh/simd-json/serialize: Warming up for 3.0000 s
1114
1115Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.8s, or reduce sample count to 40.
1116Benchmarking mesh/simd-json/serialize: Collecting 100 samples in estimated 10.810 s (100 iterations)
1117Benchmarking mesh/simd-json/serialize: Analyzing
1118mesh/simd-json/serialize
1119                        time:   [105.55 ms 106.46 ms 107.44 ms]
1120                        change: [-14.706% -13.687% -12.571%] (p = 0.00 < 0.05)
1121                        Performance has improved.
1122Found 5 outliers among 100 measurements (5.00%)
1123  4 (4.00%) high mild
1124  1 (1.00%) high severe
1125Benchmarking mesh/simd-json/deserialize
1126Benchmarking mesh/simd-json/deserialize: Warming up for 3.0000 s
1127
1128Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 16.8s, or reduce sample count to 20.
1129Benchmarking mesh/simd-json/deserialize: Collecting 100 samples in estimated 16.756 s (100 iterations)
1130Benchmarking mesh/simd-json/deserialize: Analyzing
1131mesh/simd-json/deserialize
1132                        time:   [150.38 ms 150.97 ms 151.57 ms]
1133                        change: [+0.1292% +0.8187% +1.4984%] (p = 0.02 < 0.05)
1134                        Change within noise threshold.
1135Found 2 outliers among 100 measurements (2.00%)
1136  2 (2.00%) high mild
1137mesh/simd-json/size 39152823
1138mesh/simd-json/zlib 16587283
1139mesh/simd-json/zstd 14549214
1140
1141Benchmarking mesh/speedy/serialize
1142Benchmarking mesh/speedy/serialize: Warming up for 3.0000 s
1143
1144Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.2s, enable flat sampling, or reduce sample count to 50.
1145Benchmarking mesh/speedy/serialize: Collecting 100 samples in estimated 9.2474 s (5050 iterations)
1146Benchmarking mesh/speedy/serialize: Analyzing
1147mesh/speedy/serialize   time:   [1.8273 ms 1.8451 ms 1.8646 ms]
1148                        change: [-1.0200% +0.2584% +1.5364%] (p = 0.69 > 0.05)
1149                        No change in performance detected.
1150Found 8 outliers among 100 measurements (8.00%)
1151  2 (2.00%) low mild
1152  6 (6.00%) high mild
1153Benchmarking mesh/speedy/deserialize
1154Benchmarking mesh/speedy/deserialize: Warming up for 3.0000 s
1155
1156Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.0s, enable flat sampling, or reduce sample count to 70.
1157Benchmarking mesh/speedy/deserialize: Collecting 100 samples in estimated 5.0028 s (5050 iterations)
1158Benchmarking mesh/speedy/deserialize: Analyzing
1159mesh/speedy/deserialize time:   [984.50 µs 992.83 µs 1.0014 ms]
1160                        change: [-17.018% -15.571% -14.039%] (p = 0.00 < 0.05)
1161                        Performance has improved.
1162Found 6 outliers among 100 measurements (6.00%)
1163  1 (1.00%) low mild
1164  4 (4.00%) high mild
1165  1 (1.00%) high severe
1166mesh/speedy/size 6000004
1167mesh/speedy/zlib 5380818
1168mesh/speedy/zstd 5345889
1169
1170Benchmarking mesh/alkahest/serialize
1171Benchmarking mesh/alkahest/serialize: Warming up for 3.0000 s
1172Benchmarking mesh/alkahest/serialize: Collecting 100 samples in estimated 5.2225 s (10k iterations)
1173Benchmarking mesh/alkahest/serialize: Analyzing
1174mesh/alkahest/serialize time:   [520.22 µs 521.43 µs 522.71 µs]
1175                        change: [-2.0742% -1.1674% -0.2785%] (p = 0.01 < 0.05)
1176                        Change within noise threshold.
1177Found 3 outliers among 100 measurements (3.00%)
1178  1 (1.00%) low mild
1179  2 (2.00%) high mild
1180Benchmarking mesh/alkahest/access (validated on-demand with panic)
1181Benchmarking mesh/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s
1182Benchmarking mesh/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.9B iterations)
1183Benchmarking mesh/alkahest/access (validated on-demand with panic): Analyzing
1184mesh/alkahest/access (validated on-demand with panic)
1185                        time:   [2.4017 ns 2.4242 ns 2.4490 ns]
1186                        change: [-0.6757% +0.7156% +2.0572%] (p = 0.30 > 0.05)
1187                        No change in performance detected.
1188Benchmarking mesh/alkahest/read (validated on-demand with panic)
1189Benchmarking mesh/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s
1190Benchmarking mesh/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.1940 s (61k iterations)
1191Benchmarking mesh/alkahest/read (validated on-demand with panic): Analyzing
1192mesh/alkahest/read (validated on-demand with panic)
1193                        time:   [88.199 µs 88.944 µs 89.673 µs]
1194                        change: [-7.7482% -5.9464% -4.3116%] (p = 0.00 < 0.05)
1195                        Performance has improved.
1196mesh/alkahest/size 6000008
1197mesh/alkahest/zlib 5380823
1198mesh/alkahest/zstd 5345890
1199
1200Benchmarking mesh/dlhn/serialize
1201Benchmarking mesh/dlhn/serialize: Warming up for 3.0000 s
1202Benchmarking mesh/dlhn/serialize: Collecting 100 samples in estimated 5.0702 s (700 iterations)
1203Benchmarking mesh/dlhn/serialize: Analyzing
1204mesh/dlhn/serialize     time:   [7.1709 ms 7.2275 ms 7.2858 ms]
1205                        change: [-17.749% -16.792% -15.831%] (p = 0.00 < 0.05)
1206                        Performance has improved.
1207Found 1 outliers among 100 measurements (1.00%)
1208  1 (1.00%) high mild
1209Benchmarking mesh/dlhn/deserialize
1210Benchmarking mesh/dlhn/deserialize: Warming up for 3.0000 s
1211Benchmarking mesh/dlhn/deserialize: Collecting 100 samples in estimated 5.4712 s (700 iterations)
1212Benchmarking mesh/dlhn/deserialize: Analyzing
1213mesh/dlhn/deserialize   time:   [7.8223 ms 7.9229 ms 8.0371 ms]
1214                        change: [-14.754% -13.360% -11.788%] (p = 0.00 < 0.05)
1215                        Performance has improved.
1216Found 9 outliers among 100 measurements (9.00%)
1217  7 (7.00%) high mild
1218  2 (2.00%) high severe
1219mesh/dlhn/size 6000003
1220mesh/dlhn/zlib 5380817
1221mesh/dlhn/zstd 5345900
1222
1223Benchmarking minecraft_savedata/abomonation/serialize
1224Benchmarking minecraft_savedata/abomonation/serialize: Warming up for 3.0000 s
1225Benchmarking minecraft_savedata/abomonation/serialize: Collecting 100 samples in estimated 5.6846 s (20k iterations)
1226Benchmarking minecraft_savedata/abomonation/serialize: Analyzing
1227minecraft_savedata/abomonation/serialize
1228                        time:   [284.40 µs 286.23 µs 288.09 µs]
1229                        change: [+2.5735% +3.5219% +4.4622%] (p = 0.00 < 0.05)
1230                        Performance has regressed.
1231Benchmarking minecraft_savedata/abomonation/access (unvalidated)
1232Benchmarking minecraft_savedata/abomonation/access (unvalidated): Warming up for 3.0000 s
1233Benchmarking minecraft_savedata/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.0745 s (101k iterations)
1234Benchmarking minecraft_savedata/abomonation/access (unvalidated): Analyzing
1235minecraft_savedata/abomonation/access (unvalidated)
1236                        time:   [49.223 µs 49.561 µs 49.927 µs]
1237                        change: [-29.501% -28.569% -27.592%] (p = 0.00 < 0.05)
1238                        Performance has improved.
1239Found 1 outliers among 100 measurements (1.00%)
1240  1 (1.00%) high mild
1241Benchmarking minecraft_savedata/abomonation/read (unvalidated)
1242Benchmarking minecraft_savedata/abomonation/read (unvalidated): Warming up for 3.0000 s
1243Benchmarking minecraft_savedata/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.0090 s (96k iterations)
1244Benchmarking minecraft_savedata/abomonation/read (unvalidated): Analyzing
1245minecraft_savedata/abomonation/read (unvalidated)
1246                        time:   [51.835 µs 52.204 µs 52.585 µs]
1247                        change: [-32.466% -30.935% -29.620%] (p = 0.00 < 0.05)
1248                        Performance has improved.
1249Found 1 outliers among 100 measurements (1.00%)
1250  1 (1.00%) low mild
1251Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated)
1252Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Warming up for 3.0000 s
1253Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.0970 s (2500 iterations)
1254Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Analyzing
1255minecraft_savedata/abomonation/deserialize (unvalidated)
1256                        time:   [1.9931 ms 2.0057 ms 2.0185 ms]
1257                        change: [-6.6668% -5.4618% -4.4087%] (p = 0.00 < 0.05)
1258                        Performance has improved.
1259Found 1 outliers among 100 measurements (1.00%)
1260  1 (1.00%) high mild
1261minecraft_savedata/abomonation/size 1290592
1262minecraft_savedata/abomonation/zlib 394008
1263minecraft_savedata/abomonation/zstd 330146
1264
1265Benchmarking minecraft_savedata/bare/serialize
1266Benchmarking minecraft_savedata/bare/serialize: Warming up for 3.0000 s
1267Benchmarking minecraft_savedata/bare/serialize: Collecting 100 samples in estimated 9.1643 s (10k iterations)
1268Benchmarking minecraft_savedata/bare/serialize: Analyzing
1269minecraft_savedata/bare/serialize
1270                        time:   [900.75 µs 908.82 µs 916.88 µs]
1271                        change: [-2.6106% -1.0320% +0.4126%] (p = 0.19 > 0.05)
1272                        No change in performance detected.
1273Found 5 outliers among 100 measurements (5.00%)
1274  5 (5.00%) low mild
1275Benchmarking minecraft_savedata/bare/deserialize
1276Benchmarking minecraft_savedata/bare/deserialize: Warming up for 3.0000 s
1277Benchmarking minecraft_savedata/bare/deserialize: Collecting 100 samples in estimated 5.1629 s (1500 iterations)
1278Benchmarking minecraft_savedata/bare/deserialize: Analyzing
1279minecraft_savedata/bare/deserialize
1280                        time:   [3.3316 ms 3.3590 ms 3.3871 ms]
1281                        change: [-12.770% -11.717% -10.651%] (p = 0.00 < 0.05)
1282                        Performance has improved.
1283minecraft_savedata/bare/size 356311
1284minecraft_savedata/bare/zlib 213270
1285minecraft_savedata/bare/zstd 198488
1286
1287Benchmarking minecraft_savedata/bincode/serialize
1288Benchmarking minecraft_savedata/bincode/serialize: Warming up for 3.0000 s
1289Benchmarking minecraft_savedata/bincode/serialize: Collecting 100 samples in estimated 7.3266 s (10k iterations)
1290Benchmarking minecraft_savedata/bincode/serialize: Analyzing
1291minecraft_savedata/bincode/serialize
1292                        time:   [714.53 µs 721.90 µs 729.58 µs]
1293                        change: [-3.4672% -2.3385% -1.2244%] (p = 0.00 < 0.05)
1294                        Performance has improved.
1295Benchmarking minecraft_savedata/bincode/deserialize
1296Benchmarking minecraft_savedata/bincode/deserialize: Warming up for 3.0000 s
1297Benchmarking minecraft_savedata/bincode/deserialize: Collecting 100 samples in estimated 5.1613 s (1900 iterations)
1298Benchmarking minecraft_savedata/bincode/deserialize: Analyzing
1299minecraft_savedata/bincode/deserialize
1300                        time:   [2.6441 ms 2.6703 ms 2.6981 ms]
1301                        change: [-12.219% -11.071% -9.8131%] (p = 0.00 < 0.05)
1302                        Performance has improved.
1303Found 8 outliers among 100 measurements (8.00%)
1304  6 (6.00%) high mild
1305  2 (2.00%) high severe
1306minecraft_savedata/bincode/size 569975
1307minecraft_savedata/bincode/zlib 240897
1308minecraft_savedata/bincode/zstd 232423
1309
1310Benchmarking minecraft_savedata/borsh/serialize
1311Benchmarking minecraft_savedata/borsh/serialize: Warming up for 3.0000 s
1312Benchmarking minecraft_savedata/borsh/serialize: Collecting 100 samples in estimated 6.3447 s (10k iterations)
1313Benchmarking minecraft_savedata/borsh/serialize: Analyzing
1314minecraft_savedata/borsh/serialize
1315                        time:   [610.91 µs 617.53 µs 624.18 µs]
1316                        change: [-4.6331% -3.1818% -1.7612%] (p = 0.00 < 0.05)
1317                        Performance has improved.
1318Found 1 outliers among 100 measurements (1.00%)
1319  1 (1.00%) high mild
1320Benchmarking minecraft_savedata/borsh/deserialize
1321Benchmarking minecraft_savedata/borsh/deserialize: Warming up for 3.0000 s
1322Benchmarking minecraft_savedata/borsh/deserialize: Collecting 100 samples in estimated 5.0699 s (1900 iterations)
1323Benchmarking minecraft_savedata/borsh/deserialize: Analyzing
1324minecraft_savedata/borsh/deserialize
1325                        time:   [2.6191 ms 2.6380 ms 2.6576 ms]
1326                        change: [-12.982% -11.677% -10.396%] (p = 0.00 < 0.05)
1327                        Performance has improved.
1328Found 2 outliers among 100 measurements (2.00%)
1329  2 (2.00%) high mild
1330minecraft_savedata/borsh/size 446595
1331minecraft_savedata/borsh/zlib 234395
1332minecraft_savedata/borsh/zstd 210008
1333
1334Benchmarking minecraft_savedata/bson/serialize
1335Benchmarking minecraft_savedata/bson/serialize: Warming up for 3.0000 s
1336Benchmarking minecraft_savedata/bson/serialize: Collecting 100 samples in estimated 5.4189 s (1200 iterations)
1337Benchmarking minecraft_savedata/bson/serialize: Analyzing
1338minecraft_savedata/bson/serialize
1339                        time:   [4.4981 ms 4.5307 ms 4.5628 ms]
1340                        change: [-11.001% -9.5812% -8.1511%] (p = 0.00 < 0.05)
1341                        Performance has improved.
1342Benchmarking minecraft_savedata/bson/deserialize
1343Benchmarking minecraft_savedata/bson/deserialize: Warming up for 3.0000 s
1344Benchmarking minecraft_savedata/bson/deserialize: Collecting 100 samples in estimated 5.2296 s (400 iterations)
1345Benchmarking minecraft_savedata/bson/deserialize: Analyzing
1346minecraft_savedata/bson/deserialize
1347                        time:   [11.763 ms 11.877 ms 11.997 ms]
1348                        change: [-17.214% -16.009% -14.761%] (p = 0.00 < 0.05)
1349                        Performance has improved.
1350Found 6 outliers among 100 measurements (6.00%)
1351  6 (6.00%) high mild
1352minecraft_savedata/bson/size 1619653
1353minecraft_savedata/bson/zlib 506953
1354minecraft_savedata/bson/zstd 328399
1355
1356Benchmarking minecraft_savedata/capnp/serialize
1357Benchmarking minecraft_savedata/capnp/serialize: Warming up for 3.0000 s
1358Benchmarking minecraft_savedata/capnp/serialize: Collecting 100 samples in estimated 9.3110 s (10k iterations)
1359Benchmarking minecraft_savedata/capnp/serialize: Analyzing
1360minecraft_savedata/capnp/serialize
1361                        time:   [889.85 µs 896.45 µs 903.81 µs]
1362                        change: [-10.852% -9.7681% -8.6264%] (p = 0.00 < 0.05)
1363                        Performance has improved.
1364Found 2 outliers among 100 measurements (2.00%)
1365  2 (2.00%) high mild
1366Benchmarking minecraft_savedata/capnp/access (validated on-demand with error)
1367Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Warming up for 3.0000 s
1368Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0002 s (42M iterations)
1369Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Analyzing
1370minecraft_savedata/capnp/access (validated on-demand with error)
1371                        time:   [116.70 ns 117.69 ns 118.80 ns]
1372                        change: [-17.524% -16.422% -15.334%] (p = 0.00 < 0.05)
1373                        Performance has improved.
1374Found 6 outliers among 100 measurements (6.00%)
1375  1 (1.00%) low mild
1376  5 (5.00%) high mild
1377Benchmarking minecraft_savedata/capnp/read (validated on-demand with error)
1378Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Warming up for 3.0000 s
1379Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.0031 s (6.2M iterations)
1380Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Analyzing
1381minecraft_savedata/capnp/read (validated on-demand with error)
1382                        time:   [827.04 ns 837.94 ns 847.80 ns]
1383                        change: [+16.979% +19.042% +21.064%] (p = 0.00 < 0.05)
1384                        Performance has regressed.
1385minecraft_savedata/capnp/size 803896
1386minecraft_savedata/capnp/zlib 336655
1387minecraft_savedata/capnp/zstd 280851
1388
1389Benchmarking minecraft_savedata/cbor/serialize
1390Benchmarking minecraft_savedata/cbor/serialize: Warming up for 3.0000 s
1391Benchmarking minecraft_savedata/cbor/serialize: Collecting 100 samples in estimated 5.1845 s (2400 iterations)
1392Benchmarking minecraft_savedata/cbor/serialize: Analyzing
1393minecraft_savedata/cbor/serialize
1394                        time:   [2.0547 ms 2.0712 ms 2.0875 ms]
1395                        change: [-8.7915% -7.4067% -6.0585%] (p = 0.00 < 0.05)
1396                        Performance has improved.
1397Found 1 outliers among 100 measurements (1.00%)
1398  1 (1.00%) low mild
1399Benchmarking minecraft_savedata/cbor/deserialize
1400Benchmarking minecraft_savedata/cbor/deserialize: Warming up for 3.0000 s
1401Benchmarking minecraft_savedata/cbor/deserialize: Collecting 100 samples in estimated 5.5738 s (900 iterations)
1402Benchmarking minecraft_savedata/cbor/deserialize: Analyzing
1403minecraft_savedata/cbor/deserialize
1404                        time:   [6.2352 ms 6.2772 ms 6.3212 ms]
1405                        change: [-13.998% -13.064% -12.127%] (p = 0.00 < 0.05)
1406                        Performance has improved.
1407Found 2 outliers among 100 measurements (2.00%)
1408  2 (2.00%) high mild
1409minecraft_savedata/cbor/size 1109821
1410minecraft_savedata/cbor/zlib 347812
1411minecraft_savedata/cbor/zstd 274526
1412
1413Benchmarking minecraft_savedata/flatbuffers/serialize
1414Benchmarking minecraft_savedata/flatbuffers/serialize: Warming up for 3.0000 s
1415Benchmarking minecraft_savedata/flatbuffers/serialize: Collecting 100 samples in estimated 5.0254 s (1400 iterations)
1416Benchmarking minecraft_savedata/flatbuffers/serialize: Analyzing
1417minecraft_savedata/flatbuffers/serialize
1418                        time:   [3.5777 ms 3.6071 ms 3.6381 ms]
1419                        change: [-19.790% -18.957% -18.044%] (p = 0.00 < 0.05)
1420                        Performance has improved.
1421Found 1 outliers among 100 measurements (1.00%)
1422  1 (1.00%) high mild
1423Benchmarking minecraft_savedata/flatbuffers/access (unvalidated)
1424Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Warming up for 3.0000 s
1425Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.6B iterations)
1426Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Analyzing
1427minecraft_savedata/flatbuffers/access (unvalidated)
1428                        time:   [3.1270 ns 3.1576 ns 3.1881 ns]
1429                        change: [-12.718% -11.643% -10.512%] (p = 0.00 < 0.05)
1430                        Performance has improved.
1431Found 3 outliers among 100 measurements (3.00%)
1432  1 (1.00%) low mild
1433  1 (1.00%) high mild
1434  1 (1.00%) high severe
1435Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error)
1436Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s
1437Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.1064 s (1800 iterations)
1438Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Analyzing
1439minecraft_savedata/flatbuffers/access (validated upfront with error)
1440                        time:   [2.8311 ms 2.8539 ms 2.8766 ms]
1441                        change: [-6.4041% -5.1601% -3.9141%] (p = 0.00 < 0.05)
1442                        Performance has improved.
1443Benchmarking minecraft_savedata/flatbuffers/read (unvalidated)
1444Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Warming up for 3.0000 s
1445Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.0082 s (1.8M iterations)
1446Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Analyzing
1447minecraft_savedata/flatbuffers/read (unvalidated)
1448                        time:   [2.9042 µs 2.9315 µs 2.9579 µs]
1449                        change: [-14.050% -12.680% -11.432%] (p = 0.00 < 0.05)
1450                        Performance has improved.
1451Found 1 outliers among 100 measurements (1.00%)
1452  1 (1.00%) low mild
1453Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error)
1454Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s
1455Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.0352 s (1800 iterations)
1456Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Analyzing
1457minecraft_savedata/flatbuffers/read (validated upfront with error)
1458                        time:   [2.9310 ms 2.9533 ms 2.9757 ms]
1459                        change: [-5.1469% -4.1679% -3.1977%] (p = 0.00 < 0.05)
1460                        Performance has improved.
1461Found 1 outliers among 100 measurements (1.00%)
1462  1 (1.00%) high mild
1463minecraft_savedata/flatbuffers/size 844168
1464minecraft_savedata/flatbuffers/zlib 346957
1465minecraft_savedata/flatbuffers/zstd 294015
1466
1467Benchmarking minecraft_savedata/nachricht/serialize
1468Benchmarking minecraft_savedata/nachricht/serialize: Warming up for 3.0000 s
1469Benchmarking minecraft_savedata/nachricht/serialize: Collecting 100 samples in estimated 5.0588 s (700 iterations)
1470Benchmarking minecraft_savedata/nachricht/serialize: Analyzing
1471minecraft_savedata/nachricht/serialize
1472                        time:   [6.9946 ms 7.0567 ms 7.1196 ms]
1473                        change: [-10.223% -9.0578% -7.8901%] (p = 0.00 < 0.05)
1474                        Performance has improved.
1475Benchmarking minecraft_savedata/nachricht/deserialize
1476Benchmarking minecraft_savedata/nachricht/deserialize: Warming up for 3.0000 s
1477Benchmarking minecraft_savedata/nachricht/deserialize: Collecting 100 samples in estimated 5.0056 s (900 iterations)
1478Benchmarking minecraft_savedata/nachricht/deserialize: Analyzing
1479minecraft_savedata/nachricht/deserialize
1480                        time:   [5.6266 ms 5.6754 ms 5.7249 ms]
1481                        change: [-10.191% -8.8256% -7.4347%] (p = 0.00 < 0.05)
1482                        Performance has improved.
1483minecraft_savedata/nachricht/size 449745
1484minecraft_savedata/nachricht/zlib 252743
1485minecraft_savedata/nachricht/zstd 231110
1486
1487Benchmarking minecraft_savedata/postcard/serialize
1488Benchmarking minecraft_savedata/postcard/serialize: Warming up for 3.0000 s
1489Benchmarking minecraft_savedata/postcard/serialize: Collecting 100 samples in estimated 7.2407 s (15k iterations)
1490Benchmarking minecraft_savedata/postcard/serialize: Analyzing
1491minecraft_savedata/postcard/serialize
1492                        time:   [484.26 µs 487.82 µs 491.36 µs]
1493                        change: [-9.6158% -8.2722% -6.9970%] (p = 0.00 < 0.05)
1494                        Performance has improved.
1495Found 2 outliers among 100 measurements (2.00%)
1496  1 (1.00%) low mild
1497  1 (1.00%) high mild
1498Benchmarking minecraft_savedata/postcard/deserialize
1499Benchmarking minecraft_savedata/postcard/deserialize: Warming up for 3.0000 s
1500Benchmarking minecraft_savedata/postcard/deserialize: Collecting 100 samples in estimated 5.2566 s (1800 iterations)
1501Benchmarking minecraft_savedata/postcard/deserialize: Analyzing
1502minecraft_savedata/postcard/deserialize
1503                        time:   [2.9446 ms 2.9694 ms 2.9950 ms]
1504                        change: [-3.9458% -2.5868% -1.2319%] (p = 0.00 < 0.05)
1505                        Performance has improved.
1506Found 3 outliers among 100 measurements (3.00%)
1507  3 (3.00%) high mild
1508minecraft_savedata/postcard/size 367489
1509minecraft_savedata/postcard/zlib 222144
1510minecraft_savedata/postcard/zstd 207344
1511
1512Benchmarking minecraft_savedata/prost/serialize (populate + encode)
1513Benchmarking minecraft_savedata/prost/serialize (populate + encode): Warming up for 3.0000 s
1514Benchmarking minecraft_savedata/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.0219 s (1200 iterations)
1515Benchmarking minecraft_savedata/prost/serialize (populate + encode): Analyzing
1516minecraft_savedata/prost/serialize (populate + encode)
1517                        time:   [4.1423 ms 4.1798 ms 4.2179 ms]
1518                        change: [-6.7602% -5.4275% -4.1270%] (p = 0.00 < 0.05)
1519                        Performance has improved.
1520Benchmarking minecraft_savedata/prost/serialize (encode)
1521Benchmarking minecraft_savedata/prost/serialize (encode): Warming up for 3.0000 s
1522
1523Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.5s, enable flat sampling, or reduce sample count to 50.
1524Benchmarking minecraft_savedata/prost/serialize (encode): Collecting 100 samples in estimated 7.4693 s (5050 iterations)
1525Benchmarking minecraft_savedata/prost/serialize (encode): Analyzing
1526minecraft_savedata/prost/serialize (encode)
1527                        time:   [1.4514 ms 1.4675 ms 1.4836 ms]
1528                        change: [-13.222% -11.266% -9.3765%] (p = 0.00 < 0.05)
1529                        Performance has improved.
1530Found 1 outliers among 100 measurements (1.00%)
1531  1 (1.00%) high mild
1532Benchmarking minecraft_savedata/prost/deserialize
1533Benchmarking minecraft_savedata/prost/deserialize: Warming up for 3.0000 s
1534Benchmarking minecraft_savedata/prost/deserialize: Collecting 100 samples in estimated 5.3944 s (1100 iterations)
1535Benchmarking minecraft_savedata/prost/deserialize: Analyzing
1536minecraft_savedata/prost/deserialize
1537                        time:   [4.9605 ms 5.0108 ms 5.0605 ms]
1538                        change: [-4.8730% -3.5672% -2.2572%] (p = 0.00 < 0.05)
1539                        Performance has improved.
1540minecraft_savedata/prost/size 596811
1541minecraft_savedata/prost/zlib 306728
1542minecraft_savedata/prost/zstd 269310
1543
1544Benchmarking minecraft_savedata/rkyv/serialize
1545Benchmarking minecraft_savedata/rkyv/serialize: Warming up for 3.0000 s
1546Benchmarking minecraft_savedata/rkyv/serialize: Collecting 100 samples in estimated 7.1879 s (15k iterations)
1547Benchmarking minecraft_savedata/rkyv/serialize: Analyzing
1548minecraft_savedata/rkyv/serialize
1549                        time:   [494.40 µs 500.03 µs 505.35 µs]
1550                        change: [+0.0558% +2.2867% +4.2217%] (p = 0.02 < 0.05)
1551                        Change within noise threshold.
1552Found 2 outliers among 100 measurements (2.00%)
1553  2 (2.00%) high mild
1554Benchmarking minecraft_savedata/rkyv/access (unvalidated)
1555Benchmarking minecraft_savedata/rkyv/access (unvalidated): Warming up for 3.0000 s
1556Benchmarking minecraft_savedata/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (2.8B iterations)
1557Benchmarking minecraft_savedata/rkyv/access (unvalidated): Analyzing
1558minecraft_savedata/rkyv/access (unvalidated)
1559                        time:   [1.6924 ns 1.7161 ns 1.7407 ns]
1560                        change: [-4.7036% -3.3631% -2.0404%] (p = 0.00 < 0.05)
1561                        Performance has improved.
1562Found 1 outliers among 100 measurements (1.00%)
1563  1 (1.00%) low mild
1564Benchmarking minecraft_savedata/rkyv/access (validated upfront with error)
1565Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Warming up for 3.0000 s
1566Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 6.9709 s (10k iterations)
1567Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Analyzing
1568minecraft_savedata/rkyv/access (validated upfront with error)
1569                        time:   [675.83 µs 683.50 µs 691.87 µs]
1570                        change: [-2.5270% -1.1810% +0.0706%] (p = 0.09 > 0.05)
1571                        No change in performance detected.
1572Found 3 outliers among 100 measurements (3.00%)
1573  3 (3.00%) high mild
1574Benchmarking minecraft_savedata/rkyv/read (unvalidated)
1575Benchmarking minecraft_savedata/rkyv/read (unvalidated): Warming up for 3.0000 s
1576Benchmarking minecraft_savedata/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0008 s (27M iterations)
1577Benchmarking minecraft_savedata/rkyv/read (unvalidated): Analyzing
1578minecraft_savedata/rkyv/read (unvalidated)
1579                        time:   [191.12 ns 193.03 ns 194.72 ns]
1580                        change: [-1.6352% -0.2149% +1.0814%] (p = 0.76 > 0.05)
1581                        No change in performance detected.
1582Benchmarking minecraft_savedata/rkyv/read (validated upfront with error)
1583Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Warming up for 3.0000 s
1584Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 6.9871 s (10k iterations)
1585Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Analyzing
1586minecraft_savedata/rkyv/read (validated upfront with error)
1587                        time:   [675.47 µs 681.60 µs 688.51 µs]
1588                        change: [-2.5928% -1.5240% -0.4326%] (p = 0.00 < 0.05)
1589                        Change within noise threshold.
1590Found 3 outliers among 100 measurements (3.00%)
1591  1 (1.00%) low mild
1592  2 (2.00%) high mild
1593Benchmarking minecraft_savedata/rkyv/update
1594Benchmarking minecraft_savedata/rkyv/update: Warming up for 3.0000 s
1595Benchmarking minecraft_savedata/rkyv/update: Collecting 100 samples in estimated 5.0050 s (3.4M iterations)
1596Benchmarking minecraft_savedata/rkyv/update: Analyzing
1597minecraft_savedata/rkyv/update
1598                        time:   [1.5091 µs 1.5292 µs 1.5507 µs]
1599                        change: [-35.322% -33.830% -32.344%] (p = 0.00 < 0.05)
1600                        Performance has improved.
1601Found 1 outliers among 100 measurements (1.00%)
1602  1 (1.00%) low mild
1603Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated)
1604Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Warming up for 3.0000 s
1605
1606Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.3s, enable flat sampling, or reduce sample count to 50.
1607Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 9.2840 s (5050 iterations)
1608Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Analyzing
1609minecraft_savedata/rkyv/deserialize (unvalidated)
1610                        time:   [1.8215 ms 1.8361 ms 1.8518 ms]
1611                        change: [-7.9058% -6.9271% -5.9014%] (p = 0.00 < 0.05)
1612                        Performance has improved.
1613Found 2 outliers among 100 measurements (2.00%)
1614  2 (2.00%) low mild
1615Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error)
1616Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s
1617Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.2427 s (1900 iterations)
1618Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Analyzing
1619minecraft_savedata/rkyv/deserialize (validated upfront with error)
1620                        time:   [2.6894 ms 2.7131 ms 2.7363 ms]
1621                        change: [-0.1391% +1.2183% +2.4944%] (p = 0.07 > 0.05)
1622                        No change in performance detected.
1623minecraft_savedata/rkyv/size 596952
1624minecraft_savedata/rkyv/zlib 254571
1625minecraft_savedata/rkyv/zstd 219976
1626
1627Benchmarking minecraft_savedata/rmp/serialize
1628Benchmarking minecraft_savedata/rmp/serialize: Warming up for 3.0000 s
1629
1630Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.4s, enable flat sampling, or reduce sample count to 50.
1631Benchmarking minecraft_savedata/rmp/serialize: Collecting 100 samples in estimated 8.4462 s (5050 iterations)
1632Benchmarking minecraft_savedata/rmp/serialize: Analyzing
1633minecraft_savedata/rmp/serialize
1634                        time:   [1.6492 ms 1.6617 ms 1.6746 ms]
1635                        change: [-7.6362% -6.5695% -5.5124%] (p = 0.00 < 0.05)
1636                        Performance has improved.
1637Found 4 outliers among 100 measurements (4.00%)
1638  1 (1.00%) low mild
1639  3 (3.00%) high mild
1640Benchmarking minecraft_savedata/rmp/deserialize
1641Benchmarking minecraft_savedata/rmp/deserialize: Warming up for 3.0000 s
1642Benchmarking minecraft_savedata/rmp/deserialize: Collecting 100 samples in estimated 5.0860 s (1300 iterations)
1643Benchmarking minecraft_savedata/rmp/deserialize: Analyzing
1644minecraft_savedata/rmp/deserialize
1645                        time:   [3.9141 ms 3.9549 ms 3.9984 ms]
1646                        change: [-12.541% -10.851% -9.2454%] (p = 0.00 < 0.05)
1647                        Performance has improved.
1648Found 13 outliers among 100 measurements (13.00%)
1649  11 (11.00%) high mild
1650  2 (2.00%) high severe
1651minecraft_savedata/rmp/size 424533
1652minecraft_savedata/rmp/zlib 245594
1653minecraft_savedata/rmp/zstd 226188
1654
1655Benchmarking minecraft_savedata/ron/serialize
1656Benchmarking minecraft_savedata/ron/serialize: Warming up for 3.0000 s
1657Benchmarking minecraft_savedata/ron/serialize: Collecting 100 samples in estimated 5.9863 s (600 iterations)
1658Benchmarking minecraft_savedata/ron/serialize: Analyzing
1659minecraft_savedata/ron/serialize
1660                        time:   [9.9036 ms 9.9961 ms 10.092 ms]
1661                        change: [-11.704% -10.589% -9.4660%] (p = 0.00 < 0.05)
1662                        Performance has improved.
1663Found 3 outliers among 100 measurements (3.00%)
1664  3 (3.00%) high mild
1665Benchmarking minecraft_savedata/ron/deserialize
1666Benchmarking minecraft_savedata/ron/deserialize: Warming up for 3.0000 s
1667Benchmarking minecraft_savedata/ron/deserialize: Collecting 100 samples in estimated 5.8720 s (300 iterations)
1668Benchmarking minecraft_savedata/ron/deserialize: Analyzing
1669minecraft_savedata/ron/deserialize
1670                        time:   [19.095 ms 19.224 ms 19.354 ms]
1671                        change: [-1.4401% -0.0165% +1.4309%] (p = 0.98 > 0.05)
1672                        No change in performance detected.
1673minecraft_savedata/ron/size 1465223
1674minecraft_savedata/ron/zlib 439761
1675minecraft_savedata/ron/zstd 343338
1676
1677Benchmarking minecraft_savedata/serde_json/serialize
1678Benchmarking minecraft_savedata/serde_json/serialize: Warming up for 3.0000 s
1679Benchmarking minecraft_savedata/serde_json/serialize: Collecting 100 samples in estimated 5.0309 s (1000 iterations)
1680Benchmarking minecraft_savedata/serde_json/serialize: Analyzing
1681minecraft_savedata/serde_json/serialize
1682                        time:   [4.7813 ms 4.8292 ms 4.8775 ms]
1683                        change: [-2.5375% -1.1858% +0.1144%] (p = 0.09 > 0.05)
1684                        No change in performance detected.
1685Benchmarking minecraft_savedata/serde_json/deserialize
1686Benchmarking minecraft_savedata/serde_json/deserialize: Warming up for 3.0000 s
1687Benchmarking minecraft_savedata/serde_json/deserialize: Collecting 100 samples in estimated 5.2541 s (500 iterations)
1688Benchmarking minecraft_savedata/serde_json/deserialize: Analyzing
1689minecraft_savedata/serde_json/deserialize
1690                        time:   [10.960 ms 11.032 ms 11.102 ms]
1691                        change: [-1.0475% +0.0526% +1.1194%] (p = 0.93 > 0.05)
1692                        No change in performance detected.
1693minecraft_savedata/serde_json/size 1623191
1694minecraft_savedata/serde_json/zlib 472275
1695minecraft_savedata/serde_json/zstd 359623
1696
1697Benchmarking minecraft_savedata/simd-json/serialize
1698Benchmarking minecraft_savedata/simd-json/serialize: Warming up for 3.0000 s
1699Benchmarking minecraft_savedata/simd-json/serialize: Collecting 100 samples in estimated 5.2808 s (1100 iterations)
1700Benchmarking minecraft_savedata/simd-json/serialize: Analyzing
1701minecraft_savedata/simd-json/serialize
1702                        time:   [4.6428 ms 4.6787 ms 4.7150 ms]
1703                        change: [+0.7105% +2.0496% +3.4176%] (p = 0.00 < 0.05)
1704                        Change within noise threshold.
1705Benchmarking minecraft_savedata/simd-json/deserialize
1706Benchmarking minecraft_savedata/simd-json/deserialize: Warming up for 3.0000 s
1707Benchmarking minecraft_savedata/simd-json/deserialize: Collecting 100 samples in estimated 5.1905 s (700 iterations)
1708Benchmarking minecraft_savedata/simd-json/deserialize: Analyzing
1709minecraft_savedata/simd-json/deserialize
1710                        time:   [6.7074 ms 6.7544 ms 6.8024 ms]
1711                        change: [+4.0119% +5.5639% +6.9996%] (p = 0.00 < 0.05)
1712                        Performance has regressed.
1713minecraft_savedata/simd-json/size 1663769
1714minecraft_savedata/simd-json/zlib 496401
1715minecraft_savedata/simd-json/zstd 383682
1716
1717Benchmarking minecraft_savedata/speedy/serialize
1718Benchmarking minecraft_savedata/speedy/serialize: Warming up for 3.0000 s
1719Benchmarking minecraft_savedata/speedy/serialize: Collecting 100 samples in estimated 6.8727 s (15k iterations)
1720Benchmarking minecraft_savedata/speedy/serialize: Analyzing
1721minecraft_savedata/speedy/serialize
1722                        time:   [446.90 µs 450.65 µs 454.62 µs]
1723                        change: [+15.744% +17.280% +18.795%] (p = 0.00 < 0.05)
1724                        Performance has regressed.
1725Benchmarking minecraft_savedata/speedy/deserialize
1726Benchmarking minecraft_savedata/speedy/deserialize: Warming up for 3.0000 s
1727Benchmarking minecraft_savedata/speedy/deserialize: Collecting 100 samples in estimated 5.0731 s (2100 iterations)
1728Benchmarking minecraft_savedata/speedy/deserialize: Analyzing
1729minecraft_savedata/speedy/deserialize
1730                        time:   [2.4058 ms 2.4272 ms 2.4485 ms]
1731                        change: [+3.5147% +4.8102% +6.1485%] (p = 0.00 < 0.05)
1732                        Performance has regressed.
1733minecraft_savedata/speedy/size 449595
1734minecraft_savedata/speedy/zlib 235136
1735minecraft_savedata/speedy/zstd 210361
1736
1737Benchmarking minecraft_savedata/alkahest/serialize
1738Benchmarking minecraft_savedata/alkahest/serialize: Warming up for 3.0000 s
1739Benchmarking minecraft_savedata/alkahest/serialize: Collecting 100 samples in estimated 5.1368 s (15k iterations)
1740Benchmarking minecraft_savedata/alkahest/serialize: Analyzing
1741minecraft_savedata/alkahest/serialize
1742                        time:   [330.59 µs 334.23 µs 338.08 µs]
1743                        change: [+2.4915% +4.1722% +5.7750%] (p = 0.00 < 0.05)
1744                        Performance has regressed.
1745Found 1 outliers among 100 measurements (1.00%)
1746  1 (1.00%) high mild
1747Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic)
1748Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s
1749Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.9B iterations)
1750Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Analyzing
1751minecraft_savedata/alkahest/access (validated on-demand with panic)
1752                        time:   [2.5610 ns 2.5830 ns 2.6052 ns]
1753                        change: [+6.3549% +7.9111% +9.3748%] (p = 0.00 < 0.05)
1754                        Performance has regressed.
1755Found 1 outliers among 100 measurements (1.00%)
1756  1 (1.00%) low mild
1757Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic)
1758Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s
1759Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.2241 s (111k iterations)
1760Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Analyzing
1761minecraft_savedata/alkahest/read (validated on-demand with panic)
1762                        time:   [46.510 µs 46.844 µs 47.207 µs]
1763                        change: [-5.1633% -3.8799% -2.4781%] (p = 0.00 < 0.05)
1764                        Performance has improved.
1765Found 6 outliers among 100 measurements (6.00%)
1766  3 (3.00%) low mild
1767  3 (3.00%) high mild
1768minecraft_savedata/alkahest/size 667570
1769minecraft_savedata/alkahest/zlib 325536
1770minecraft_savedata/alkahest/zstd 320452
1771