fork/rust_serialization_benchmark
git clone https://git.julia.blue/fork/rust_serialization_benchmark
f964c08
master
1 2running 0 tests 3 4test result: ok. 0 passed; 0 failed; 0 ignored; 0 measured; 0 filtered out; finished in 0.00s 5 6WARNING: HTML report generation will become a non-default optional feature in Criterion.rs 0.4.0. 7This feature is being moved to cargo-criterion (https://github.com/bheisler/cargo-criterion) and will be optional in a future version of Criterion.rs. To silence this warning, either switch to cargo-criterion or enable the 'html_reports' feature in your Cargo.toml. 8 9Gnuplot not found, using plotters backend 10Benchmarking log/abomonation/serialize 11Benchmarking log/abomonation/serialize: Warming up for 3.0000 s 12Benchmarking log/abomonation/serialize: Collecting 100 samples in estimated 5.8888 s (20k iterations) 13Benchmarking log/abomonation/serialize: Analyzing 14log/abomonation/serialize 15 time: [293.09 µs 294.24 µs 295.50 µs] 16 change: [+6.8274% +8.1725% +9.4864%] (p = 0.00 < 0.05) 17 Performance has regressed. 18Found 3 outliers among 100 measurements (3.00%) 19 2 (2.00%) low mild 20 1 (1.00%) high mild 21Benchmarking log/abomonation/access (unvalidated) 22Benchmarking log/abomonation/access (unvalidated): Warming up for 3.0000 s 23Benchmarking log/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.1099 s (116k iterations) 24Benchmarking log/abomonation/access (unvalidated): Analyzing 25log/abomonation/access (unvalidated) 26 time: [44.231 µs 44.347 µs 44.461 µs] 27 change: [-36.125% -35.362% -34.622%] (p = 0.00 < 0.05) 28 Performance has improved. 29Found 3 outliers among 100 measurements (3.00%) 30 1 (1.00%) low mild 31 2 (2.00%) high mild 32Benchmarking log/abomonation/read (unvalidated) 33Benchmarking log/abomonation/read (unvalidated): Warming up for 3.0000 s 34Benchmarking log/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.2601 s (71k iterations) 35Benchmarking log/abomonation/read (unvalidated): Analyzing 36log/abomonation/read (unvalidated) 37 time: [71.378 µs 71.832 µs 72.315 µs] 38 change: [-33.260% -32.447% -31.629%] (p = 0.00 < 0.05) 39 Performance has improved. 40Found 3 outliers among 100 measurements (3.00%) 41 1 (1.00%) low mild 42 2 (2.00%) high mild 43Benchmarking log/abomonation/deserialize (unvalidated) 44Benchmarking log/abomonation/deserialize (unvalidated): Warming up for 3.0000 s 45Benchmarking log/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.1986 s (2000 iterations) 46Benchmarking log/abomonation/deserialize (unvalidated): Analyzing 47log/abomonation/deserialize (unvalidated) 48 time: [2.6374 ms 2.6656 ms 2.6939 ms] 49 change: [-8.2208% -6.9751% -5.7578%] (p = 0.00 < 0.05) 50 Performance has improved. 51log/abomonation/size 1705800 52log/abomonation/zlib 506933 53log/abomonation/zstd 404238 54 55Benchmarking log/bare/serialize 56Benchmarking log/bare/serialize: Warming up for 3.0000 s 57Benchmarking log/bare/serialize: Collecting 100 samples in estimated 7.3113 s (10k iterations) 58Benchmarking log/bare/serialize: Analyzing 59log/bare/serialize time: [699.59 µs 704.87 µs 710.96 µs] 60 change: [-16.786% -15.739% -14.592%] (p = 0.00 < 0.05) 61 Performance has improved. 62Found 6 outliers among 100 measurements (6.00%) 63 6 (6.00%) high mild 64Benchmarking log/bare/deserialize 65Benchmarking log/bare/deserialize: Warming up for 3.0000 s 66Benchmarking log/bare/deserialize: Collecting 100 samples in estimated 5.3558 s (1500 iterations) 67Benchmarking log/bare/deserialize: Analyzing 68log/bare/deserialize time: [3.4704 ms 3.4983 ms 3.5279 ms] 69 change: [-14.339% -13.109% -11.941%] (p = 0.00 < 0.05) 70 Performance has improved. 71Found 1 outliers among 100 measurements (1.00%) 72 1 (1.00%) high severe 73log/bare/size 765778 74log/bare/zlib 312739 75log/bare/zstd 264630 76 77Benchmarking log/bincode/serialize 78Benchmarking log/bincode/serialize: Warming up for 3.0000 s 79Benchmarking log/bincode/serialize: Collecting 100 samples in estimated 6.0318 s (10k iterations) 80Benchmarking log/bincode/serialize: Analyzing 81log/bincode/serialize time: [581.55 µs 586.93 µs 592.54 µs] 82 change: [-11.243% -10.087% -9.0018%] (p = 0.00 < 0.05) 83 Performance has improved. 84Found 1 outliers among 100 measurements (1.00%) 85 1 (1.00%) high mild 86Benchmarking log/bincode/deserialize 87Benchmarking log/bincode/deserialize: Warming up for 3.0000 s 88Benchmarking log/bincode/deserialize: Collecting 100 samples in estimated 5.2350 s (1500 iterations) 89Benchmarking log/bincode/deserialize: Analyzing 90log/bincode/deserialize time: [3.6019 ms 3.6365 ms 3.6711 ms] 91 change: [-9.8688% -8.1423% -6.4925%] (p = 0.00 < 0.05) 92 Performance has improved. 93Found 1 outliers among 100 measurements (1.00%) 94 1 (1.00%) high mild 95log/bincode/size 1045784 96log/bincode/zlib 374305 97log/bincode/zstd 311761 98 99Benchmarking log/borsh/serialize 100Benchmarking log/borsh/serialize: Warming up for 3.0000 s 101Benchmarking log/borsh/serialize: Collecting 100 samples in estimated 5.1807 s (10k iterations) 102Benchmarking log/borsh/serialize: Analyzing 103log/borsh/serialize time: [503.13 µs 507.42 µs 512.09 µs] 104 change: [-10.620% -9.3916% -8.1666%] (p = 0.00 < 0.05) 105 Performance has improved. 106Found 7 outliers among 100 measurements (7.00%) 107 7 (7.00%) high mild 108Benchmarking log/borsh/deserialize 109Benchmarking log/borsh/deserialize: Warming up for 3.0000 s 110Benchmarking log/borsh/deserialize: Collecting 100 samples in estimated 5.2013 s (1500 iterations) 111Benchmarking log/borsh/deserialize: Analyzing 112log/borsh/deserialize time: [3.4473 ms 3.4736 ms 3.4997 ms] 113 change: [-9.3658% -8.2456% -7.1334%] (p = 0.00 < 0.05) 114 Performance has improved. 115log/borsh/size 885780 116log/borsh/zlib 363280 117log/borsh/zstd 286514 118 119Benchmarking log/bson/serialize 120Benchmarking log/bson/serialize: Warming up for 3.0000 s 121Benchmarking log/bson/serialize: Collecting 100 samples in estimated 5.1289 s (1600 iterations) 122Benchmarking log/bson/serialize: Analyzing 123log/bson/serialize time: [3.1015 ms 3.1261 ms 3.1515 ms] 124 change: [-13.308% -12.113% -10.953%] (p = 0.00 < 0.05) 125 Performance has improved. 126Found 4 outliers among 100 measurements (4.00%) 127 4 (4.00%) high mild 128Benchmarking log/bson/deserialize 129Benchmarking log/bson/deserialize: Warming up for 3.0000 s 130Benchmarking log/bson/deserialize: Collecting 100 samples in estimated 5.6974 s (500 iterations) 131Benchmarking log/bson/deserialize: Analyzing 132log/bson/deserialize time: [11.357 ms 11.444 ms 11.534 ms] 133 change: [-14.056% -12.927% -11.755%] (p = 0.00 < 0.05) 134 Performance has improved. 135Found 2 outliers among 100 measurements (2.00%) 136 2 (2.00%) high mild 137log/bson/size 1924682 138log/bson/zlib 537661 139log/bson/zstd 376270 140 141Benchmarking log/capnp/serialize 142Benchmarking log/capnp/serialize: Warming up for 3.0000 s 143 144Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.6s, enable flat sampling, or reduce sample count to 60. 145Benchmarking log/capnp/serialize: Collecting 100 samples in estimated 6.5654 s (5050 iterations) 146Benchmarking log/capnp/serialize: Analyzing 147log/capnp/serialize time: [1.3051 ms 1.3144 ms 1.3245 ms] 148 change: [-13.534% -12.742% -11.947%] (p = 0.00 < 0.05) 149 Performance has improved. 150Found 1 outliers among 100 measurements (1.00%) 151 1 (1.00%) high mild 152Benchmarking log/capnp/access (validated on-demand with error) 153Benchmarking log/capnp/access (validated on-demand with error): Warming up for 3.0000 s 154Benchmarking log/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0003 s (40M iterations) 155Benchmarking log/capnp/access (validated on-demand with error): Analyzing 156log/capnp/access (validated on-demand with error) 157 time: [122.68 ns 123.74 ns 124.79 ns] 158 change: [-17.637% -16.730% -15.848%] (p = 0.00 < 0.05) 159 Performance has improved. 160Benchmarking log/capnp/read (validated on-demand with error) 161Benchmarking log/capnp/read (validated on-demand with error): Warming up for 3.0000 s 162Benchmarking log/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.0222 s (10k iterations) 163Benchmarking log/capnp/read (validated on-demand with error): Analyzing 164log/capnp/read (validated on-demand with error) 165 time: [481.03 µs 485.91 µs 490.76 µs] 166 change: [-15.074% -13.769% -12.580%] (p = 0.00 < 0.05) 167 Performance has improved. 168Found 1 outliers among 100 measurements (1.00%) 169 1 (1.00%) high mild 170log/capnp/size 1443216 171log/capnp/zlib 509618 172log/capnp/zstd 428649 173 174Benchmarking log/cbor/serialize 175Benchmarking log/cbor/serialize: Warming up for 3.0000 s 176Benchmarking log/cbor/serialize: Collecting 100 samples in estimated 5.1815 s (2500 iterations) 177Benchmarking log/cbor/serialize: Analyzing 178log/cbor/serialize time: [1.9900 ms 2.0059 ms 2.0217 ms] 179 change: [-10.444% -9.1640% -7.9894%] (p = 0.00 < 0.05) 180 Performance has improved. 181Benchmarking log/cbor/deserialize 182Benchmarking log/cbor/deserialize: Warming up for 3.0000 s 183Benchmarking log/cbor/deserialize: Collecting 100 samples in estimated 5.1440 s (800 iterations) 184Benchmarking log/cbor/deserialize: Analyzing 185log/cbor/deserialize time: [6.2040 ms 6.2495 ms 6.2963 ms] 186 change: [-19.264% -18.422% -17.540%] (p = 0.00 < 0.05) 187 Performance has improved. 188Found 1 outliers among 100 measurements (1.00%) 189 1 (1.00%) high mild 190log/cbor/size 1407835 191log/cbor/zlib 407372 192log/cbor/zstd 324081 193 194Benchmarking log/flatbuffers/serialize 195Benchmarking log/flatbuffers/serialize: Warming up for 3.0000 s 196 197Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.8s, enable flat sampling, or reduce sample count to 50. 198Benchmarking log/flatbuffers/serialize: Collecting 100 samples in estimated 9.8406 s (5050 iterations) 199Benchmarking log/flatbuffers/serialize: Analyzing 200log/flatbuffers/serialize 201 time: [1.9596 ms 1.9725 ms 1.9862 ms] 202 change: [-18.502% -17.503% -16.522%] (p = 0.00 < 0.05) 203 Performance has improved. 204Found 6 outliers among 100 measurements (6.00%) 205 1 (1.00%) low severe 206 5 (5.00%) high mild 207Benchmarking log/flatbuffers/access (unvalidated) 208Benchmarking log/flatbuffers/access (unvalidated): Warming up for 3.0000 s 209Benchmarking log/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.5B iterations) 210Benchmarking log/flatbuffers/access (unvalidated): Analyzing 211log/flatbuffers/access (unvalidated) 212 time: [3.2051 ns 3.2465 ns 3.2890 ns] 213 change: [-8.6788% -7.4388% -6.1323%] (p = 0.00 < 0.05) 214 Performance has improved. 215Found 3 outliers among 100 measurements (3.00%) 216 1 (1.00%) low mild 217 2 (2.00%) high mild 218Benchmarking log/flatbuffers/access (validated upfront with error) 219Benchmarking log/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s 220Benchmarking log/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.0298 s (1900 iterations) 221Benchmarking log/flatbuffers/access (validated upfront with error): Analyzing 222log/flatbuffers/access (validated upfront with error) 223 time: [2.5799 ms 2.6021 ms 2.6253 ms] 224 change: [-23.712% -22.767% -21.869%] (p = 0.00 < 0.05) 225 Performance has improved. 226Found 5 outliers among 100 measurements (5.00%) 227 5 (5.00%) high mild 228Benchmarking log/flatbuffers/read (unvalidated) 229Benchmarking log/flatbuffers/read (unvalidated): Warming up for 3.0000 s 230Benchmarking log/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.4084 s (56k iterations) 231Benchmarking log/flatbuffers/read (unvalidated): Analyzing 232log/flatbuffers/read (unvalidated) 233 time: [96.788 µs 97.539 µs 98.347 µs] 234 change: [-16.670% -15.535% -14.387%] (p = 0.00 < 0.05) 235 Performance has improved. 236Found 2 outliers among 100 measurements (2.00%) 237 2 (2.00%) high mild 238Benchmarking log/flatbuffers/read (validated upfront with error) 239Benchmarking log/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s 240Benchmarking log/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.0408 s (1900 iterations) 241Benchmarking log/flatbuffers/read (validated upfront with error): Analyzing 242log/flatbuffers/read (validated upfront with error) 243 time: [2.6225 ms 2.6439 ms 2.6664 ms] 244 change: [-23.691% -22.657% -21.640%] (p = 0.00 < 0.05) 245 Performance has improved. 246Found 5 outliers among 100 measurements (5.00%) 247 5 (5.00%) high mild 248log/flatbuffers/size 1276368 249log/flatbuffers/zlib 469962 250log/flatbuffers/zstd 388832 251 252Benchmarking log/nachricht/serialize 253Benchmarking log/nachricht/serialize: Warming up for 3.0000 s 254Benchmarking log/nachricht/serialize: Collecting 100 samples in estimated 5.1007 s (700 iterations) 255Benchmarking log/nachricht/serialize: Analyzing 256log/nachricht/serialize time: [7.4453 ms 7.5272 ms 7.6093 ms] 257 change: [-11.200% -9.8135% -8.4017%] (p = 0.00 < 0.05) 258 Performance has improved. 259Benchmarking log/nachricht/deserialize 260Benchmarking log/nachricht/deserialize: Warming up for 3.0000 s 261Benchmarking log/nachricht/deserialize: Collecting 100 samples in estimated 5.0011 s (800 iterations) 262Benchmarking log/nachricht/deserialize: Analyzing 263log/nachricht/deserialize 264 time: [5.8732 ms 5.9315 ms 5.9895 ms] 265 change: [-7.5747% -6.0718% -4.6243%] (p = 0.00 < 0.05) 266 Performance has improved. 267log/nachricht/size 818669 268log/nachricht/zlib 334639 269log/nachricht/zstd 285514 270 271Benchmarking log/postcard/serialize 272Benchmarking log/postcard/serialize: Warming up for 3.0000 s 273Benchmarking log/postcard/serialize: Collecting 100 samples in estimated 6.2243 s (15k iterations) 274Benchmarking log/postcard/serialize: Analyzing 275log/postcard/serialize time: [401.22 µs 405.10 µs 409.48 µs] 276 change: [-13.467% -10.081% -7.3904%] (p = 0.00 < 0.05) 277 Performance has improved. 278Found 6 outliers among 100 measurements (6.00%) 279 6 (6.00%) high mild 280Benchmarking log/postcard/deserialize 281Benchmarking log/postcard/deserialize: Warming up for 3.0000 s 282Benchmarking log/postcard/deserialize: Collecting 100 samples in estimated 5.2658 s (1600 iterations) 283Benchmarking log/postcard/deserialize: Analyzing 284log/postcard/deserialize 285 time: [3.2268 ms 3.2539 ms 3.2822 ms] 286 change: [-13.274% -12.007% -10.790%] (p = 0.00 < 0.05) 287 Performance has improved. 288Found 2 outliers among 100 measurements (2.00%) 289 2 (2.00%) high mild 290log/postcard/size 724953 291log/postcard/zlib 303462 292log/postcard/zstd 253747 293 294Benchmarking log/prost/serialize (populate + encode) 295Benchmarking log/prost/serialize (populate + encode): Warming up for 3.0000 s 296Benchmarking log/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.2196 s (1700 iterations) 297Benchmarking log/prost/serialize (populate + encode): Analyzing 298log/prost/serialize (populate + encode) 299 time: [3.0896 ms 3.1138 ms 3.1404 ms] 300 change: [-10.321% -9.0501% -7.7655%] (p = 0.00 < 0.05) 301 Performance has improved. 302Found 7 outliers among 100 measurements (7.00%) 303 6 (6.00%) high mild 304 1 (1.00%) high severe 305Benchmarking log/prost/serialize (encode) 306Benchmarking log/prost/serialize (encode): Warming up for 3.0000 s 307Benchmarking log/prost/serialize (encode): Collecting 100 samples in estimated 5.8632 s (10k iterations) 308Benchmarking log/prost/serialize (encode): Analyzing 309log/prost/serialize (encode) 310 time: [576.94 µs 582.69 µs 589.05 µs] 311 change: [-9.0728% -7.4407% -5.8235%] (p = 0.00 < 0.05) 312 Performance has improved. 313Found 6 outliers among 100 measurements (6.00%) 314 6 (6.00%) high mild 315Benchmarking log/prost/deserialize 316Benchmarking log/prost/deserialize: Warming up for 3.0000 s 317Benchmarking log/prost/deserialize: Collecting 100 samples in estimated 5.3766 s (1400 iterations) 318Benchmarking log/prost/deserialize: Analyzing 319log/prost/deserialize time: [3.9276 ms 3.9637 ms 4.0017 ms] 320 change: [-11.655% -10.389% -9.1298%] (p = 0.00 < 0.05) 321 Performance has improved. 322Found 7 outliers among 100 measurements (7.00%) 323 7 (7.00%) high mild 324log/prost/size 764951 325log/prost/zlib 269811 326log/prost/zstd 227947 327 328Benchmarking log/rkyv/serialize 329Benchmarking log/rkyv/serialize: Warming up for 3.0000 s 330Benchmarking log/rkyv/serialize: Collecting 100 samples in estimated 5.4212 s (15k iterations) 331Benchmarking log/rkyv/serialize: Analyzing 332log/rkyv/serialize time: [381.19 µs 383.40 µs 385.58 µs] 333 change: [-1.8924% -0.7032% +0.4232%] (p = 0.24 > 0.05) 334 No change in performance detected. 335Found 8 outliers among 100 measurements (8.00%) 336 7 (7.00%) low mild 337 1 (1.00%) high mild 338Benchmarking log/rkyv/access (unvalidated) 339Benchmarking log/rkyv/access (unvalidated): Warming up for 3.0000 s 340Benchmarking log/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (2.8B iterations) 341Benchmarking log/rkyv/access (unvalidated): Analyzing 342log/rkyv/access (unvalidated) 343 time: [1.7989 ns 1.8134 ns 1.8278 ns] 344 change: [-0.2811% +1.6249% +3.3287%] (p = 0.08 > 0.05) 345 No change in performance detected. 346Found 3 outliers among 100 measurements (3.00%) 347 3 (3.00%) low mild 348Benchmarking log/rkyv/access (validated upfront with error) 349Benchmarking log/rkyv/access (validated upfront with error): Warming up for 3.0000 s 350Benchmarking log/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 9.2724 s (10k iterations) 351Benchmarking log/rkyv/access (validated upfront with error): Analyzing 352log/rkyv/access (validated upfront with error) 353 time: [927.92 µs 934.58 µs 941.60 µs] 354 change: [+15.695% +16.838% +17.922%] (p = 0.00 < 0.05) 355 Performance has regressed. 356Found 2 outliers among 100 measurements (2.00%) 357 2 (2.00%) low mild 358Benchmarking log/rkyv/read (unvalidated) 359Benchmarking log/rkyv/read (unvalidated): Warming up for 3.0000 s 360Benchmarking log/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0138 s (293k iterations) 361Benchmarking log/rkyv/read (unvalidated): Analyzing 362log/rkyv/read (unvalidated) 363 time: [17.046 µs 17.190 µs 17.356 µs] 364 change: [-18.840% -17.584% -16.398%] (p = 0.00 < 0.05) 365 Performance has improved. 366Found 3 outliers among 100 measurements (3.00%) 367 2 (2.00%) high mild 368 1 (1.00%) high severe 369Benchmarking log/rkyv/read (validated upfront with error) 370Benchmarking log/rkyv/read (validated upfront with error): Warming up for 3.0000 s 371Benchmarking log/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 9.0833 s (10k iterations) 372Benchmarking log/rkyv/read (validated upfront with error): Analyzing 373log/rkyv/read (validated upfront with error) 374 time: [886.19 µs 893.62 µs 901.87 µs] 375 change: [+6.9158% +8.4743% +9.9616%] (p = 0.00 < 0.05) 376 Performance has regressed. 377Benchmarking log/rkyv/update 378Benchmarking log/rkyv/update: Warming up for 3.0000 s 379Benchmarking log/rkyv/update: Collecting 100 samples in estimated 5.0295 s (338k iterations) 380Benchmarking log/rkyv/update: Analyzing 381log/rkyv/update time: [14.883 µs 14.968 µs 15.060 µs] 382 change: [-36.989% -36.184% -35.401%] (p = 0.00 < 0.05) 383 Performance has improved. 384Benchmarking log/rkyv/deserialize (unvalidated) 385Benchmarking log/rkyv/deserialize (unvalidated): Warming up for 3.0000 s 386Benchmarking log/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 5.1287 s (1900 iterations) 387Benchmarking log/rkyv/deserialize (unvalidated): Analyzing 388log/rkyv/deserialize (unvalidated) 389 time: [2.7911 ms 2.8086 ms 2.8261 ms] 390 change: [+3.0894% +4.4755% +5.8423%] (p = 0.00 < 0.05) 391 Performance has regressed. 392Found 1 outliers among 100 measurements (1.00%) 393 1 (1.00%) low mild 394Benchmarking log/rkyv/deserialize (validated upfront with error) 395Benchmarking log/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s 396Benchmarking log/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.1977 s (1300 iterations) 397Benchmarking log/rkyv/deserialize (validated upfront with error): Analyzing 398log/rkyv/deserialize (validated upfront with error) 399 time: [3.9051 ms 3.9313 ms 3.9584 ms] 400 change: [+9.0096% +10.326% +11.658%] (p = 0.00 < 0.05) 401 Performance has regressed. 402Found 2 outliers among 100 measurements (2.00%) 403 2 (2.00%) high mild 404log/rkyv/size 1011488 405log/rkyv/zlib 392809 406log/rkyv/zstd 331932 407 408Benchmarking log/rmp/serialize 409Benchmarking log/rmp/serialize: Warming up for 3.0000 s 410 411Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.0s, enable flat sampling, or reduce sample count to 50. 412Benchmarking log/rmp/serialize: Collecting 100 samples in estimated 8.0482 s (5050 iterations) 413Benchmarking log/rmp/serialize: Analyzing 414log/rmp/serialize time: [1.5109 ms 1.5228 ms 1.5359 ms] 415 change: [-7.6586% -6.6813% -5.6225%] (p = 0.00 < 0.05) 416 Performance has improved. 417Found 2 outliers among 100 measurements (2.00%) 418 2 (2.00%) high mild 419Benchmarking log/rmp/deserialize 420Benchmarking log/rmp/deserialize: Warming up for 3.0000 s 421Benchmarking log/rmp/deserialize: Collecting 100 samples in estimated 5.2291 s (1100 iterations) 422Benchmarking log/rmp/deserialize: Analyzing 423log/rmp/deserialize time: [4.6893 ms 4.7238 ms 4.7595 ms] 424 change: [-5.5977% -4.4648% -3.2597%] (p = 0.00 < 0.05) 425 Performance has improved. 426Found 2 outliers among 100 measurements (2.00%) 427 2 (2.00%) high mild 428log/rmp/size 784997 429log/rmp/zlib 326654 430log/rmp/zstd 278219 431 432Benchmarking log/ron/serialize 433Benchmarking log/ron/serialize: Warming up for 3.0000 s 434Benchmarking log/ron/serialize: Collecting 100 samples in estimated 5.4323 s (300 iterations) 435Benchmarking log/ron/serialize: Analyzing 436log/ron/serialize time: [18.027 ms 18.174 ms 18.324 ms] 437 change: [-4.6892% -3.5558% -2.4639%] (p = 0.00 < 0.05) 438 Performance has improved. 439Found 2 outliers among 100 measurements (2.00%) 440 2 (2.00%) high mild 441Benchmarking log/ron/deserialize 442Benchmarking log/ron/deserialize: Warming up for 3.0000 s 443Benchmarking log/ron/deserialize: Collecting 100 samples in estimated 5.4451 s (300 iterations) 444Benchmarking log/ron/deserialize: Analyzing 445log/ron/deserialize time: [19.587 ms 19.748 ms 19.910 ms] 446 change: [+9.0428% +10.430% +11.793%] (p = 0.00 < 0.05) 447 Performance has regressed. 448log/ron/size 1607459 449log/ron/zlib 452648 450log/ron/zstd 349713 451 452Benchmarking log/serde_json/serialize 453Benchmarking log/serde_json/serialize: Warming up for 3.0000 s 454Benchmarking log/serde_json/serialize: Collecting 100 samples in estimated 5.4668 s (1100 iterations) 455Benchmarking log/serde_json/serialize: Analyzing 456log/serde_json/serialize 457 time: [4.7562 ms 4.7979 ms 4.8394 ms] 458 change: [-3.8828% -2.3932% -0.9381%] (p = 0.00 < 0.05) 459 Change within noise threshold. 460Benchmarking log/serde_json/deserialize 461Benchmarking log/serde_json/deserialize: Warming up for 3.0000 s 462Benchmarking log/serde_json/deserialize: Collecting 100 samples in estimated 5.4980 s (600 iterations) 463Benchmarking log/serde_json/deserialize: Analyzing 464log/serde_json/deserialize 465 time: [8.9873 ms 9.0660 ms 9.1465 ms] 466 change: [-12.954% -11.723% -10.481%] (p = 0.00 < 0.05) 467 Performance has improved. 468log/serde_json/size 1827461 469log/serde_json/zlib 474358 470log/serde_json/zstd 361090 471 472Benchmarking log/simd-json/serialize 473Benchmarking log/simd-json/serialize: Warming up for 3.0000 s 474Benchmarking log/simd-json/serialize: Collecting 100 samples in estimated 5.0119 s (1100 iterations) 475Benchmarking log/simd-json/serialize: Analyzing 476log/simd-json/serialize time: [4.4547 ms 4.5000 ms 4.5456 ms] 477 change: [-6.8795% -5.4307% -4.0819%] (p = 0.00 < 0.05) 478 Performance has improved. 479Benchmarking log/simd-json/deserialize 480Benchmarking log/simd-json/deserialize: Warming up for 3.0000 s 481Benchmarking log/simd-json/deserialize: Collecting 100 samples in estimated 5.6480 s (700 iterations) 482Benchmarking log/simd-json/deserialize: Analyzing 483log/simd-json/deserialize 484 time: [7.4340 ms 7.4627 ms 7.4916 ms] 485 change: [+12.370% +13.576% +14.723%] (p = 0.00 < 0.05) 486 Performance has regressed. 487Found 1 outliers among 100 measurements (1.00%) 488 1 (1.00%) high mild 489log/simd-json/size 1827461 490log/simd-json/zlib 474358 491log/simd-json/zstd 361090 492 493Benchmarking log/speedy/serialize 494Benchmarking log/speedy/serialize: Warming up for 3.0000 s 495Benchmarking log/speedy/serialize: Collecting 100 samples in estimated 5.5973 s (15k iterations) 496Benchmarking log/speedy/serialize: Analyzing 497log/speedy/serialize time: [370.71 µs 371.19 µs 371.79 µs] 498 change: [+25.011% +25.933% +26.831%] (p = 0.00 < 0.05) 499 Performance has regressed. 500Found 4 outliers among 100 measurements (4.00%) 501 1 (1.00%) low severe 502 1 (1.00%) low mild 503 1 (1.00%) high mild 504 1 (1.00%) high severe 505Benchmarking log/speedy/deserialize 506Benchmarking log/speedy/deserialize: Warming up for 3.0000 s 507Benchmarking log/speedy/deserialize: Collecting 100 samples in estimated 5.2186 s (1500 iterations) 508Benchmarking log/speedy/deserialize: Analyzing 509log/speedy/deserialize time: [3.4206 ms 3.4305 ms 3.4392 ms] 510 change: [+13.306% +14.102% +14.879%] (p = 0.00 < 0.05) 511 Performance has regressed. 512Found 6 outliers among 100 measurements (6.00%) 513 2 (2.00%) low severe 514 4 (4.00%) low mild 515log/speedy/size 885780 516log/speedy/zlib 363280 517log/speedy/zstd 286514 518 519Benchmarking log/alkahest/serialize 520Benchmarking log/alkahest/serialize: Warming up for 3.0000 s 521Benchmarking log/alkahest/serialize: Collecting 100 samples in estimated 5.7451 s (20k iterations) 522Benchmarking log/alkahest/serialize: Analyzing 523log/alkahest/serialize time: [286.65 µs 287.99 µs 289.51 µs] 524 change: [+8.6065% +9.8972% +11.081%] (p = 0.00 < 0.05) 525 Performance has regressed. 526Found 11 outliers among 100 measurements (11.00%) 527 2 (2.00%) low severe 528 4 (4.00%) low mild 529 2 (2.00%) high mild 530 3 (3.00%) high severe 531Benchmarking log/alkahest/access (validated on-demand with panic) 532Benchmarking log/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s 533Benchmarking log/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.8B iterations) 534Benchmarking log/alkahest/access (validated on-demand with panic): Analyzing 535log/alkahest/access (validated on-demand with panic) 536 time: [2.7414 ns 2.7619 ns 2.7813 ns] 537 change: [+15.081% +16.214% +17.239%] (p = 0.00 < 0.05) 538 Performance has regressed. 539Found 5 outliers among 100 measurements (5.00%) 540 1 (1.00%) low severe 541 3 (3.00%) low mild 542 1 (1.00%) high mild 543Benchmarking log/alkahest/read (validated on-demand with panic) 544Benchmarking log/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s 545Benchmarking log/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.0282 s (81k iterations) 546Benchmarking log/alkahest/read (validated on-demand with panic): Analyzing 547log/alkahest/read (validated on-demand with panic) 548 time: [62.903 µs 63.281 µs 63.694 µs] 549 change: [+47.242% +48.372% +49.532%] (p = 0.00 < 0.05) 550 Performance has regressed. 551Found 7 outliers among 100 measurements (7.00%) 552 4 (4.00%) low mild 553 3 (3.00%) high mild 554log/alkahest/size 1045784 555log/alkahest/zlib 454748 556log/alkahest/zstd 389424 557 558Benchmarking log/dlhn/serialize 559Benchmarking log/dlhn/serialize: Warming up for 3.0000 s 560Benchmarking log/dlhn/serialize: Collecting 100 samples in estimated 8.7744 s (10k iterations) 561Benchmarking log/dlhn/serialize: Analyzing 562log/dlhn/serialize time: [851.98 µs 854.45 µs 857.19 µs] 563 change: [-0.6273% +0.8424% +2.2124%] (p = 0.25 > 0.05) 564 No change in performance detected. 565Found 1 outliers among 100 measurements (1.00%) 566 1 (1.00%) low mild 567Benchmarking log/dlhn/deserialize 568Benchmarking log/dlhn/deserialize: Warming up for 3.0000 s 569Benchmarking log/dlhn/deserialize: Collecting 100 samples in estimated 5.3582 s (1200 iterations) 570Benchmarking log/dlhn/deserialize: Analyzing 571log/dlhn/deserialize time: [4.4371 ms 4.4512 ms 4.4653 ms] 572 change: [+2.7402% +4.2453% +5.6117%] (p = 0.00 < 0.05) 573 Performance has regressed. 574Found 1 outliers among 100 measurements (1.00%) 575 1 (1.00%) low mild 576log/dlhn/size 724953 577log/dlhn/zlib 302512 578log/dlhn/zstd 253629 579 580Benchmarking mesh/abomonation/serialize 581Benchmarking mesh/abomonation/serialize: Warming up for 3.0000 s 582Benchmarking mesh/abomonation/serialize: Collecting 100 samples in estimated 5.3756 s (10k iterations) 583Benchmarking mesh/abomonation/serialize: Analyzing 584mesh/abomonation/serialize 585 time: [533.46 µs 534.19 µs 535.20 µs] 586 change: [+17.119% +18.108% +19.054%] (p = 0.00 < 0.05) 587 Performance has regressed. 588Found 4 outliers among 100 measurements (4.00%) 589 3 (3.00%) low mild 590 1 (1.00%) high severe 591Benchmarking mesh/abomonation/access (unvalidated) 592Benchmarking mesh/abomonation/access (unvalidated): Warming up for 3.0000 s 593Benchmarking mesh/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.6B iterations) 594Benchmarking mesh/abomonation/access (unvalidated): Analyzing 595mesh/abomonation/access (unvalidated) 596 time: [3.1536 ns 3.1660 ns 3.1783 ns] 597 change: [+3.9693% +5.1019% +6.2013%] (p = 0.00 < 0.05) 598 Performance has regressed. 599Found 5 outliers among 100 measurements (5.00%) 600 4 (4.00%) low mild 601 1 (1.00%) high severe 602Benchmarking mesh/abomonation/read (unvalidated) 603Benchmarking mesh/abomonation/read (unvalidated): Warming up for 3.0000 s 604Benchmarking mesh/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.8658 s (20k iterations) 605Benchmarking mesh/abomonation/read (unvalidated): Analyzing 606mesh/abomonation/read (unvalidated) 607 time: [288.10 µs 288.88 µs 289.64 µs] 608 change: [+18.898% +19.802% +20.677%] (p = 0.00 < 0.05) 609 Performance has regressed. 610Found 5 outliers among 100 measurements (5.00%) 611 3 (3.00%) low mild 612 2 (2.00%) high mild 613Benchmarking mesh/abomonation/deserialize (unvalidated) 614Benchmarking mesh/abomonation/deserialize (unvalidated): Warming up for 3.0000 s 615Benchmarking mesh/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.3151 s (10k iterations) 616Benchmarking mesh/abomonation/deserialize (unvalidated): Analyzing 617mesh/abomonation/deserialize (unvalidated) 618 time: [525.38 µs 526.09 µs 527.00 µs] 619 change: [+17.759% +18.778% +19.711%] (p = 0.00 < 0.05) 620 Performance has regressed. 621Found 6 outliers among 100 measurements (6.00%) 622 4 (4.00%) low mild 623 1 (1.00%) high mild 624 1 (1.00%) high severe 625mesh/abomonation/size 6000024 626mesh/abomonation/zlib 5380836 627mesh/abomonation/zstd 5345889 628 629Benchmarking mesh/bare/serialize 630Benchmarking mesh/bare/serialize: Warming up for 3.0000 s 631Benchmarking mesh/bare/serialize: Collecting 100 samples in estimated 5.7937 s (700 iterations) 632Benchmarking mesh/bare/serialize: Analyzing 633mesh/bare/serialize time: [8.2039 ms 8.2287 ms 8.2526 ms] 634 change: [+3.9284% +4.9120% +5.8269%] (p = 0.00 < 0.05) 635 Performance has regressed. 636Found 1 outliers among 100 measurements (1.00%) 637 1 (1.00%) low mild 638Benchmarking mesh/bare/deserialize 639Benchmarking mesh/bare/deserialize: Warming up for 3.0000 s 640Benchmarking mesh/bare/deserialize: Collecting 100 samples in estimated 5.5391 s (800 iterations) 641Benchmarking mesh/bare/deserialize: Analyzing 642mesh/bare/deserialize time: [6.8450 ms 6.8687 ms 6.8937 ms] 643 change: [+4.0201% +5.1203% +6.1581%] (p = 0.00 < 0.05) 644 Performance has regressed. 645Found 4 outliers among 100 measurements (4.00%) 646 1 (1.00%) low mild 647 2 (2.00%) high mild 648 1 (1.00%) high severe 649mesh/bare/size 6000003 650mesh/bare/zlib 5380817 651mesh/bare/zstd 5345900 652 653Benchmarking mesh/bincode/serialize 654Benchmarking mesh/bincode/serialize: Warming up for 3.0000 s 655Benchmarking mesh/bincode/serialize: Collecting 100 samples in estimated 5.0776 s (800 iterations) 656Benchmarking mesh/bincode/serialize: Analyzing 657mesh/bincode/serialize time: [6.4235 ms 6.4404 ms 6.4581 ms] 658 change: [+11.781% +12.905% +13.998%] (p = 0.00 < 0.05) 659 Performance has regressed. 660Found 2 outliers among 100 measurements (2.00%) 661 2 (2.00%) high mild 662Benchmarking mesh/bincode/deserialize 663Benchmarking mesh/bincode/deserialize: Warming up for 3.0000 s 664Benchmarking mesh/bincode/deserialize: Collecting 100 samples in estimated 5.0359 s (800 iterations) 665Benchmarking mesh/bincode/deserialize: Analyzing 666mesh/bincode/deserialize 667 time: [6.2341 ms 6.2545 ms 6.2762 ms] 668 change: [+10.527% +11.469% +12.401%] (p = 0.00 < 0.05) 669 Performance has regressed. 670Found 1 outliers among 100 measurements (1.00%) 671 1 (1.00%) high severe 672mesh/bincode/size 6000008 673mesh/bincode/zlib 5380823 674mesh/bincode/zstd 5345890 675 676Benchmarking mesh/borsh/serialize 677Benchmarking mesh/borsh/serialize: Warming up for 3.0000 s 678Benchmarking mesh/borsh/serialize: Collecting 100 samples in estimated 5.2210 s (600 iterations) 679Benchmarking mesh/borsh/serialize: Analyzing 680mesh/borsh/serialize time: [8.7891 ms 8.8123 ms 8.8338 ms] 681 change: [+21.022% +22.324% +23.604%] (p = 0.00 < 0.05) 682 Performance has regressed. 683Found 5 outliers among 100 measurements (5.00%) 684 3 (3.00%) low severe 685 2 (2.00%) low mild 686Benchmarking mesh/borsh/deserialize 687Benchmarking mesh/borsh/deserialize: Warming up for 3.0000 s 688Benchmarking mesh/borsh/deserialize: Collecting 100 samples in estimated 5.3085 s (800 iterations) 689Benchmarking mesh/borsh/deserialize: Analyzing 690mesh/borsh/deserialize time: [6.6540 ms 6.6706 ms 6.6869 ms] 691 change: [+11.710% +13.513% +15.072%] (p = 0.00 < 0.05) 692 Performance has regressed. 693Found 6 outliers among 100 measurements (6.00%) 694 3 (3.00%) low mild 695 3 (3.00%) high mild 696mesh/borsh/size 6000004 697mesh/borsh/zlib 5380818 698mesh/borsh/zstd 5345889 699 700Benchmarking mesh/bson/serialize 701Benchmarking mesh/bson/serialize: Warming up for 3.0000 s 702 703Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.5s, or reduce sample count to 70. 704Benchmarking mesh/bson/serialize: Collecting 100 samples in estimated 6.5110 s (100 iterations) 705Benchmarking mesh/bson/serialize: Analyzing 706mesh/bson/serialize time: [64.826 ms 65.038 ms 65.311 ms] 707 change: [+1.2210% +3.2636% +5.1003%] (p = 0.00 < 0.05) 708 Performance has regressed. 709Found 16 outliers among 100 measurements (16.00%) 710 5 (5.00%) low severe 711 9 (9.00%) low mild 712 2 (2.00%) high severe 713Benchmarking mesh/bson/deserialize 714Benchmarking mesh/bson/deserialize: Warming up for 3.0000 s 715 716Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.6s, or reduce sample count to 30. 717Benchmarking mesh/bson/deserialize: Collecting 100 samples in estimated 15.600 s (100 iterations) 718Benchmarking mesh/bson/deserialize: Analyzing 719mesh/bson/deserialize time: [155.29 ms 155.44 ms 155.62 ms] 720 change: [+6.2237% +6.9118% +7.5809%] (p = 0.00 < 0.05) 721 Performance has regressed. 722Found 6 outliers among 100 measurements (6.00%) 723 2 (2.00%) high mild 724 4 (4.00%) high severe 725mesh/bson/size 23013911 726mesh/bson/zlib 9211138 727mesh/bson/zstd 7497811 728 729Benchmarking mesh/capnp/serialize 730Benchmarking mesh/capnp/serialize: Warming up for 3.0000 s 731Benchmarking mesh/capnp/serialize: Collecting 100 samples in estimated 6.5986 s (400 iterations) 732Benchmarking mesh/capnp/serialize: Analyzing 733mesh/capnp/serialize time: [16.478 ms 16.565 ms 16.656 ms] 734 change: [+35.848% +37.716% +39.517%] (p = 0.00 < 0.05) 735 Performance has regressed. 736Found 2 outliers among 100 measurements (2.00%) 737 2 (2.00%) high mild 738Benchmarking mesh/capnp/access (validated on-demand with error) 739Benchmarking mesh/capnp/access (validated on-demand with error): Warming up for 3.0000 s 740Benchmarking mesh/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0005 s (22M iterations) 741Benchmarking mesh/capnp/access (validated on-demand with error): Analyzing 742mesh/capnp/access (validated on-demand with error) 743 time: [227.94 ns 228.39 ns 229.18 ns] 744 change: [+7.4151% +8.8049% +10.063%] (p = 0.00 < 0.05) 745 Performance has regressed. 746Found 14 outliers among 100 measurements (14.00%) 747 1 (1.00%) low mild 748 8 (8.00%) high mild 749 5 (5.00%) high severe 750Benchmarking mesh/capnp/read (validated on-demand with error) 751Benchmarking mesh/capnp/read (validated on-demand with error): Warming up for 3.0000 s 752Benchmarking mesh/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.2756 s (700 iterations) 753Benchmarking mesh/capnp/read (validated on-demand with error): Analyzing 754mesh/capnp/read (validated on-demand with error) 755 time: [7.6090 ms 7.6195 ms 7.6313 ms] 756 change: [+11.337% +12.062% +12.781%] (p = 0.00 < 0.05) 757 Performance has regressed. 758Found 1 outliers among 100 measurements (1.00%) 759 1 (1.00%) high severe 760mesh/capnp/size 14000088 761mesh/capnp/zlib 6729881 762mesh/capnp/zstd 6051062 763 764Benchmarking mesh/cbor/serialize 765Benchmarking mesh/cbor/serialize: Warming up for 3.0000 s 766 767Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, or reduce sample count to 90. 768Benchmarking mesh/cbor/serialize: Collecting 100 samples in estimated 5.2658 s (100 iterations) 769Benchmarking mesh/cbor/serialize: Analyzing 770mesh/cbor/serialize time: [52.506 ms 52.548 ms 52.588 ms] 771 change: [+13.668% +14.435% +15.157%] (p = 0.00 < 0.05) 772 Performance has regressed. 773Found 8 outliers among 100 measurements (8.00%) 774 4 (4.00%) low severe 775 1 (1.00%) low mild 776 2 (2.00%) high mild 777 1 (1.00%) high severe 778Benchmarking mesh/cbor/deserialize 779Benchmarking mesh/cbor/deserialize: Warming up for 3.0000 s 780 781Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 6.3s, or reduce sample count to 70. 782Benchmarking mesh/cbor/deserialize: Collecting 100 samples in estimated 6.3004 s (100 iterations) 783Benchmarking mesh/cbor/deserialize: Analyzing 784mesh/cbor/deserialize time: [62.660 ms 62.742 ms 62.819 ms] 785 change: [+10.055% +11.016% +11.938%] (p = 0.00 < 0.05) 786 Performance has regressed. 787Found 3 outliers among 100 measurements (3.00%) 788 3 (3.00%) low mild 789mesh/cbor/size 13122324 790mesh/cbor/zlib 7527423 791mesh/cbor/zstd 6759658 792 793Benchmarking mesh/flatbuffers/serialize 794Benchmarking mesh/flatbuffers/serialize: Warming up for 3.0000 s 795 796Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, enable flat sampling, or reduce sample count to 60. 797Benchmarking mesh/flatbuffers/serialize: Collecting 100 samples in estimated 5.2696 s (5050 iterations) 798Benchmarking mesh/flatbuffers/serialize: Analyzing 799mesh/flatbuffers/serialize 800 time: [1.1108 ms 1.1173 ms 1.1258 ms] 801 change: [-7.2666% -6.4275% -5.4915%] (p = 0.00 < 0.05) 802 Performance has improved. 803Found 6 outliers among 100 measurements (6.00%) 804 2 (2.00%) high mild 805 4 (4.00%) high severe 806Benchmarking mesh/flatbuffers/access (unvalidated) 807Benchmarking mesh/flatbuffers/access (unvalidated): Warming up for 3.0000 s 808Benchmarking mesh/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.3B iterations) 809Benchmarking mesh/flatbuffers/access (unvalidated): Analyzing 810mesh/flatbuffers/access (unvalidated) 811 time: [3.9269 ns 3.9283 ns 3.9303 ns] 812 change: [+7.9476% +15.051% +19.550%] (p = 0.00 < 0.05) 813 Performance has regressed. 814Found 11 outliers among 100 measurements (11.00%) 815 1 (1.00%) low severe 816 4 (4.00%) high mild 817 6 (6.00%) high severe 818Benchmarking mesh/flatbuffers/access (validated upfront with error) 819Benchmarking mesh/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s 820Benchmarking mesh/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.0002 s (65M iterations) 821Benchmarking mesh/flatbuffers/access (validated upfront with error): Analyzing 822mesh/flatbuffers/access (validated upfront with error) 823 time: [76.768 ns 76.794 ns 76.832 ns] 824 change: [+3.2739% +4.2281% +5.1383%] (p = 0.00 < 0.05) 825 Performance has regressed. 826Found 7 outliers among 100 measurements (7.00%) 827 2 (2.00%) low mild 828 3 (3.00%) high mild 829 2 (2.00%) high severe 830Benchmarking mesh/flatbuffers/read (unvalidated) 831Benchmarking mesh/flatbuffers/read (unvalidated): Warming up for 3.0000 s 832Benchmarking mesh/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.1459 s (91k iterations) 833Benchmarking mesh/flatbuffers/read (unvalidated): Analyzing 834mesh/flatbuffers/read (unvalidated) 835 time: [56.302 µs 56.468 µs 56.603 µs] 836 change: [+24.608% +26.557% +28.191%] (p = 0.00 < 0.05) 837 Performance has regressed. 838Found 11 outliers among 100 measurements (11.00%) 839 3 (3.00%) low severe 840 7 (7.00%) low mild 841 1 (1.00%) high mild 842Benchmarking mesh/flatbuffers/read (validated upfront with error) 843Benchmarking mesh/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s 844Benchmarking mesh/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.1147 s (106k iterations) 845Benchmarking mesh/flatbuffers/read (validated upfront with error): Analyzing 846mesh/flatbuffers/read (validated upfront with error) 847 time: [48.118 µs 48.350 µs 48.599 µs] 848 change: [+7.5702% +8.7987% +9.9867%] (p = 0.00 < 0.05) 849 Performance has regressed. 850Found 6 outliers among 100 measurements (6.00%) 851 2 (2.00%) low severe 852 3 (3.00%) low mild 853 1 (1.00%) high severe 854mesh/flatbuffers/size 6000024 855mesh/flatbuffers/zlib 5380800 856mesh/flatbuffers/zstd 5345910 857 858Benchmarking mesh/nachricht/serialize 859Benchmarking mesh/nachricht/serialize: Warming up for 3.0000 s 860 861Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 18.2s, or reduce sample count to 20. 862Benchmarking mesh/nachricht/serialize: Collecting 100 samples in estimated 18.196 s (100 iterations) 863Benchmarking mesh/nachricht/serialize: Analyzing 864mesh/nachricht/serialize 865 time: [182.15 ms 182.65 ms 183.14 ms] 866 change: [+4.3032% +5.0440% +5.7336%] (p = 0.00 < 0.05) 867 Performance has regressed. 868Found 1 outliers among 100 measurements (1.00%) 869 1 (1.00%) low mild 870Benchmarking mesh/nachricht/deserialize 871Benchmarking mesh/nachricht/deserialize: Warming up for 3.0000 s 872 873Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.3s, or reduce sample count to 90. 874Benchmarking mesh/nachricht/deserialize: Collecting 100 samples in estimated 5.3059 s (100 iterations) 875Benchmarking mesh/nachricht/deserialize: Analyzing 876mesh/nachricht/deserialize 877 time: [52.374 ms 52.550 ms 52.723 ms] 878 change: [+5.1793% +6.5704% +7.9010%] (p = 0.00 < 0.05) 879 Performance has regressed. 880Found 1 outliers among 100 measurements (1.00%) 881 1 (1.00%) low mild 882mesh/nachricht/size 8125037 883mesh/nachricht/zlib 6495174 884mesh/nachricht/zstd 6386940 885 886Benchmarking mesh/postcard/serialize 887Benchmarking mesh/postcard/serialize: Warming up for 3.0000 s 888 889Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.7s, enable flat sampling, or reduce sample count to 60. 890Benchmarking mesh/postcard/serialize: Collecting 100 samples in estimated 5.6966 s (5050 iterations) 891Benchmarking mesh/postcard/serialize: Analyzing 892mesh/postcard/serialize time: [1.1343 ms 1.1384 ms 1.1427 ms] 893 change: [+45.689% +48.195% +50.306%] (p = 0.00 < 0.05) 894 Performance has regressed. 895Found 5 outliers among 100 measurements (5.00%) 896 1 (1.00%) low severe 897 3 (3.00%) low mild 898 1 (1.00%) high mild 899Benchmarking mesh/postcard/deserialize 900Benchmarking mesh/postcard/deserialize: Warming up for 3.0000 s 901 902Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.0s, enable flat sampling, or reduce sample count to 50. 903Benchmarking mesh/postcard/deserialize: Collecting 100 samples in estimated 9.0355 s (5050 iterations) 904Benchmarking mesh/postcard/deserialize: Analyzing 905mesh/postcard/deserialize 906 time: [1.7711 ms 1.7790 ms 1.7867 ms] 907 change: [+19.139% +22.745% +25.340%] (p = 0.00 < 0.05) 908 Performance has regressed. 909Found 5 outliers among 100 measurements (5.00%) 910 1 (1.00%) low severe 911 4 (4.00%) low mild 912mesh/postcard/size 6000003 913mesh/postcard/zlib 5380817 914mesh/postcard/zstd 5345900 915 916Benchmarking mesh/prost/serialize (populate + encode) 917Benchmarking mesh/prost/serialize (populate + encode): Warming up for 3.0000 s 918Benchmarking mesh/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.9609 s (400 iterations) 919Benchmarking mesh/prost/serialize (populate + encode): Analyzing 920mesh/prost/serialize (populate + encode) 921 time: [14.483 ms 14.555 ms 14.626 ms] 922 change: [-5.9181% -4.8056% -3.6688%] (p = 0.00 < 0.05) 923 Performance has improved. 924Found 1 outliers among 100 measurements (1.00%) 925 1 (1.00%) low mild 926Benchmarking mesh/prost/serialize (encode) 927Benchmarking mesh/prost/serialize (encode): Warming up for 3.0000 s 928Benchmarking mesh/prost/serialize (encode): Collecting 100 samples in estimated 5.8932 s (500 iterations) 929Benchmarking mesh/prost/serialize (encode): Analyzing 930mesh/prost/serialize (encode) 931 time: [11.148 ms 11.223 ms 11.300 ms] 932 change: [-14.818% -13.784% -12.745%] (p = 0.00 < 0.05) 933 Performance has improved. 934Benchmarking mesh/prost/deserialize 935Benchmarking mesh/prost/deserialize: Warming up for 3.0000 s 936Benchmarking mesh/prost/deserialize: Collecting 100 samples in estimated 6.3383 s (300 iterations) 937Benchmarking mesh/prost/deserialize: Analyzing 938mesh/prost/deserialize time: [20.506 ms 20.870 ms 21.262 ms] 939 change: [-8.1130% -6.2720% -4.3761%] (p = 0.00 < 0.05) 940 Performance has improved. 941Found 8 outliers among 100 measurements (8.00%) 942 7 (7.00%) high mild 943 1 (1.00%) high severe 944mesh/prost/size 8750000 945mesh/prost/zlib 6683814 946mesh/prost/zstd 6421871 947 948Benchmarking mesh/rkyv/serialize 949Benchmarking mesh/rkyv/serialize: Warming up for 3.0000 s 950Benchmarking mesh/rkyv/serialize: Collecting 100 samples in estimated 5.9845 s (10k iterations) 951Benchmarking mesh/rkyv/serialize: Analyzing 952mesh/rkyv/serialize time: [584.04 µs 588.74 µs 593.99 µs] 953 change: [-36.513% -35.267% -34.173%] (p = 0.00 < 0.05) 954 Performance has improved. 955Found 3 outliers among 100 measurements (3.00%) 956 2 (2.00%) high mild 957 1 (1.00%) high severe 958Benchmarking mesh/rkyv/access (unvalidated) 959Benchmarking mesh/rkyv/access (unvalidated): Warming up for 3.0000 s 960Benchmarking mesh/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (3.1B iterations) 961Benchmarking mesh/rkyv/access (unvalidated): Analyzing 962mesh/rkyv/access (unvalidated) 963 time: [1.6239 ns 1.6431 ns 1.6636 ns] 964 change: [-10.571% -9.1964% -7.6480%] (p = 0.00 < 0.05) 965 Performance has improved. 966Found 7 outliers among 100 measurements (7.00%) 967 5 (5.00%) high mild 968 2 (2.00%) high severe 969Benchmarking mesh/rkyv/access (validated upfront with error) 970Benchmarking mesh/rkyv/access (validated upfront with error): Warming up for 3.0000 s 971Benchmarking mesh/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 5.0001 s (278M iterations) 972Benchmarking mesh/rkyv/access (validated upfront with error): Analyzing 973mesh/rkyv/access (validated upfront with error) 974 time: [19.092 ns 19.362 ns 19.630 ns] 975 change: [+13.449% +15.231% +17.099%] (p = 0.00 < 0.05) 976 Performance has regressed. 977Found 4 outliers among 100 measurements (4.00%) 978 1 (1.00%) low severe 979 3 (3.00%) low mild 980Benchmarking mesh/rkyv/read (unvalidated) 981Benchmarking mesh/rkyv/read (unvalidated): Warming up for 3.0000 s 982Benchmarking mesh/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0093 s (111k iterations) 983Benchmarking mesh/rkyv/read (unvalidated): Analyzing 984mesh/rkyv/read (unvalidated) 985 time: [46.195 µs 46.623 µs 47.053 µs] 986 change: [+1.5832% +2.9565% +4.3495%] (p = 0.00 < 0.05) 987 Performance has regressed. 988Found 3 outliers among 100 measurements (3.00%) 989 1 (1.00%) low mild 990 2 (2.00%) high mild 991Benchmarking mesh/rkyv/read (validated upfront with error) 992Benchmarking mesh/rkyv/read (validated upfront with error): Warming up for 3.0000 s 993Benchmarking mesh/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 5.0451 s (121k iterations) 994Benchmarking mesh/rkyv/read (validated upfront with error): Analyzing 995mesh/rkyv/read (validated upfront with error) 996 time: [40.889 µs 41.336 µs 41.834 µs] 997 change: [-7.0101% -5.8267% -4.7083%] (p = 0.00 < 0.05) 998 Performance has improved. 999Found 10 outliers among 100 measurements (10.00%) 1000 2 (2.00%) low mild 1001 7 (7.00%) high mild 1002 1 (1.00%) high severe 1003Benchmarking mesh/rkyv/update 1004Benchmarking mesh/rkyv/update: Warming up for 3.0000 s 1005Benchmarking mesh/rkyv/update: Collecting 100 samples in estimated 5.2141 s (20k iterations) 1006Benchmarking mesh/rkyv/update: Analyzing 1007mesh/rkyv/update time: [257.80 µs 258.63 µs 259.54 µs] 1008 change: [-16.024% -14.459% -13.045%] (p = 0.00 < 0.05) 1009 Performance has improved. 1010Found 2 outliers among 100 measurements (2.00%) 1011 2 (2.00%) high mild 1012Benchmarking mesh/rkyv/deserialize (unvalidated) 1013Benchmarking mesh/rkyv/deserialize (unvalidated): Warming up for 3.0000 s 1014Benchmarking mesh/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 5.1267 s (10k iterations) 1015Benchmarking mesh/rkyv/deserialize (unvalidated): Analyzing 1016mesh/rkyv/deserialize (unvalidated) 1017 time: [506.92 µs 508.27 µs 509.75 µs] 1018 change: [+3.4445% +4.7218% +5.9216%] (p = 0.00 < 0.05) 1019 Performance has regressed. 1020Found 3 outliers among 100 measurements (3.00%) 1021 3 (3.00%) high mild 1022Benchmarking mesh/rkyv/deserialize (validated upfront with error) 1023Benchmarking mesh/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s 1024Benchmarking mesh/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.0819 s (10k iterations) 1025Benchmarking mesh/rkyv/deserialize (validated upfront with error): Analyzing 1026mesh/rkyv/deserialize (validated upfront with error) 1027 time: [509.28 µs 511.63 µs 514.41 µs] 1028 change: [+4.0346% +4.8316% +5.6660%] (p = 0.00 < 0.05) 1029 Performance has regressed. 1030Found 3 outliers among 100 measurements (3.00%) 1031 3 (3.00%) high severe 1032mesh/rkyv/size 6000008 1033mesh/rkyv/zlib 5380822 1034mesh/rkyv/zstd 5345892 1035 1036Benchmarking mesh/rmp/serialize 1037Benchmarking mesh/rmp/serialize: Warming up for 3.0000 s 1038Benchmarking mesh/rmp/serialize: Collecting 100 samples in estimated 5.8593 s (300 iterations) 1039Benchmarking mesh/rmp/serialize: Analyzing 1040mesh/rmp/serialize time: [19.648 ms 19.776 ms 19.906 ms] 1041 change: [+2.8318% +4.1186% +5.4159%] (p = 0.00 < 0.05) 1042 Performance has regressed. 1043Found 4 outliers among 100 measurements (4.00%) 1044 1 (1.00%) low mild 1045 3 (3.00%) high mild 1046Benchmarking mesh/rmp/deserialize 1047Benchmarking mesh/rmp/deserialize: Warming up for 3.0000 s 1048Benchmarking mesh/rmp/deserialize: Collecting 100 samples in estimated 5.9773 s (300 iterations) 1049Benchmarking mesh/rmp/deserialize: Analyzing 1050mesh/rmp/deserialize time: [20.370 ms 20.499 ms 20.630 ms] 1051 change: [+4.8668% +6.2927% +7.6781%] (p = 0.00 < 0.05) 1052 Performance has regressed. 1053Found 2 outliers among 100 measurements (2.00%) 1054 2 (2.00%) high mild 1055mesh/rmp/size 8125006 1056mesh/rmp/zlib 6496879 1057mesh/rmp/zstd 6391037 1058 1059Benchmarking mesh/ron/serialize 1060Benchmarking mesh/ron/serialize: Warming up for 3.0000 s 1061 1062Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 24.4s, or reduce sample count to 20. 1063Benchmarking mesh/ron/serialize: Collecting 100 samples in estimated 24.391 s (100 iterations) 1064Benchmarking mesh/ron/serialize: Analyzing 1065mesh/ron/serialize time: [236.28 ms 237.80 ms 239.35 ms] 1066 change: [-13.179% -12.074% -10.925%] (p = 0.00 < 0.05) 1067 Performance has improved. 1068Found 1 outliers among 100 measurements (1.00%) 1069 1 (1.00%) high mild 1070Benchmarking mesh/ron/deserialize 1071Benchmarking mesh/ron/deserialize: Warming up for 3.0000 s 1072 1073Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 32.4s, or reduce sample count to 10. 1074Benchmarking mesh/ron/deserialize: Collecting 100 samples in estimated 32.437 s (100 iterations) 1075Benchmarking mesh/ron/deserialize: Analyzing 1076mesh/ron/deserialize time: [310.92 ms 313.07 ms 315.33 ms] 1077 change: [-3.5691% -2.4281% -1.3384%] (p = 0.00 < 0.05) 1078 Performance has improved. 1079Found 2 outliers among 100 measurements (2.00%) 1080 2 (2.00%) high mild 1081mesh/ron/size 22192885 1082mesh/ron/zlib 9009575 1083mesh/ron/zstd 8138755 1084 1085Benchmarking mesh/serde_json/serialize 1086Benchmarking mesh/serde_json/serialize: Warming up for 3.0000 s 1087 1088Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 11.0s, or reduce sample count to 40. 1089Benchmarking mesh/serde_json/serialize: Collecting 100 samples in estimated 11.017 s (100 iterations) 1090Benchmarking mesh/serde_json/serialize: Analyzing 1091mesh/serde_json/serialize 1092 time: [110.70 ms 111.61 ms 112.57 ms] 1093 change: [-19.159% -18.111% -17.103%] (p = 0.00 < 0.05) 1094 Performance has improved. 1095Found 6 outliers among 100 measurements (6.00%) 1096 5 (5.00%) high mild 1097 1 (1.00%) high severe 1098Benchmarking mesh/serde_json/deserialize 1099Benchmarking mesh/serde_json/deserialize: Warming up for 3.0000 s 1100 1101Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.2s, or reduce sample count to 40. 1102Benchmarking mesh/serde_json/deserialize: Collecting 100 samples in estimated 10.152 s (100 iterations) 1103Benchmarking mesh/serde_json/deserialize: Analyzing 1104mesh/serde_json/deserialize 1105 time: [96.039 ms 96.813 ms 97.606 ms] 1106 change: [-28.179% -27.408% -26.527%] (p = 0.00 < 0.05) 1107 Performance has improved. 1108mesh/serde_json/size 26192883 1109mesh/serde_json/zlib 9612105 1110mesh/serde_json/zstd 8586741 1111 1112Benchmarking mesh/simd-json/serialize 1113Benchmarking mesh/simd-json/serialize: Warming up for 3.0000 s 1114 1115Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 10.8s, or reduce sample count to 40. 1116Benchmarking mesh/simd-json/serialize: Collecting 100 samples in estimated 10.810 s (100 iterations) 1117Benchmarking mesh/simd-json/serialize: Analyzing 1118mesh/simd-json/serialize 1119 time: [105.55 ms 106.46 ms 107.44 ms] 1120 change: [-14.706% -13.687% -12.571%] (p = 0.00 < 0.05) 1121 Performance has improved. 1122Found 5 outliers among 100 measurements (5.00%) 1123 4 (4.00%) high mild 1124 1 (1.00%) high severe 1125Benchmarking mesh/simd-json/deserialize 1126Benchmarking mesh/simd-json/deserialize: Warming up for 3.0000 s 1127 1128Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 16.8s, or reduce sample count to 20. 1129Benchmarking mesh/simd-json/deserialize: Collecting 100 samples in estimated 16.756 s (100 iterations) 1130Benchmarking mesh/simd-json/deserialize: Analyzing 1131mesh/simd-json/deserialize 1132 time: [150.38 ms 150.97 ms 151.57 ms] 1133 change: [+0.1292% +0.8187% +1.4984%] (p = 0.02 < 0.05) 1134 Change within noise threshold. 1135Found 2 outliers among 100 measurements (2.00%) 1136 2 (2.00%) high mild 1137mesh/simd-json/size 39152823 1138mesh/simd-json/zlib 16587283 1139mesh/simd-json/zstd 14549214 1140 1141Benchmarking mesh/speedy/serialize 1142Benchmarking mesh/speedy/serialize: Warming up for 3.0000 s 1143 1144Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.2s, enable flat sampling, or reduce sample count to 50. 1145Benchmarking mesh/speedy/serialize: Collecting 100 samples in estimated 9.2474 s (5050 iterations) 1146Benchmarking mesh/speedy/serialize: Analyzing 1147mesh/speedy/serialize time: [1.8273 ms 1.8451 ms 1.8646 ms] 1148 change: [-1.0200% +0.2584% +1.5364%] (p = 0.69 > 0.05) 1149 No change in performance detected. 1150Found 8 outliers among 100 measurements (8.00%) 1151 2 (2.00%) low mild 1152 6 (6.00%) high mild 1153Benchmarking mesh/speedy/deserialize 1154Benchmarking mesh/speedy/deserialize: Warming up for 3.0000 s 1155 1156Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 5.0s, enable flat sampling, or reduce sample count to 70. 1157Benchmarking mesh/speedy/deserialize: Collecting 100 samples in estimated 5.0028 s (5050 iterations) 1158Benchmarking mesh/speedy/deserialize: Analyzing 1159mesh/speedy/deserialize time: [984.50 µs 992.83 µs 1.0014 ms] 1160 change: [-17.018% -15.571% -14.039%] (p = 0.00 < 0.05) 1161 Performance has improved. 1162Found 6 outliers among 100 measurements (6.00%) 1163 1 (1.00%) low mild 1164 4 (4.00%) high mild 1165 1 (1.00%) high severe 1166mesh/speedy/size 6000004 1167mesh/speedy/zlib 5380818 1168mesh/speedy/zstd 5345889 1169 1170Benchmarking mesh/alkahest/serialize 1171Benchmarking mesh/alkahest/serialize: Warming up for 3.0000 s 1172Benchmarking mesh/alkahest/serialize: Collecting 100 samples in estimated 5.2225 s (10k iterations) 1173Benchmarking mesh/alkahest/serialize: Analyzing 1174mesh/alkahest/serialize time: [520.22 µs 521.43 µs 522.71 µs] 1175 change: [-2.0742% -1.1674% -0.2785%] (p = 0.01 < 0.05) 1176 Change within noise threshold. 1177Found 3 outliers among 100 measurements (3.00%) 1178 1 (1.00%) low mild 1179 2 (2.00%) high mild 1180Benchmarking mesh/alkahest/access (validated on-demand with panic) 1181Benchmarking mesh/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s 1182Benchmarking mesh/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.9B iterations) 1183Benchmarking mesh/alkahest/access (validated on-demand with panic): Analyzing 1184mesh/alkahest/access (validated on-demand with panic) 1185 time: [2.4017 ns 2.4242 ns 2.4490 ns] 1186 change: [-0.6757% +0.7156% +2.0572%] (p = 0.30 > 0.05) 1187 No change in performance detected. 1188Benchmarking mesh/alkahest/read (validated on-demand with panic) 1189Benchmarking mesh/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s 1190Benchmarking mesh/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.1940 s (61k iterations) 1191Benchmarking mesh/alkahest/read (validated on-demand with panic): Analyzing 1192mesh/alkahest/read (validated on-demand with panic) 1193 time: [88.199 µs 88.944 µs 89.673 µs] 1194 change: [-7.7482% -5.9464% -4.3116%] (p = 0.00 < 0.05) 1195 Performance has improved. 1196mesh/alkahest/size 6000008 1197mesh/alkahest/zlib 5380823 1198mesh/alkahest/zstd 5345890 1199 1200Benchmarking mesh/dlhn/serialize 1201Benchmarking mesh/dlhn/serialize: Warming up for 3.0000 s 1202Benchmarking mesh/dlhn/serialize: Collecting 100 samples in estimated 5.0702 s (700 iterations) 1203Benchmarking mesh/dlhn/serialize: Analyzing 1204mesh/dlhn/serialize time: [7.1709 ms 7.2275 ms 7.2858 ms] 1205 change: [-17.749% -16.792% -15.831%] (p = 0.00 < 0.05) 1206 Performance has improved. 1207Found 1 outliers among 100 measurements (1.00%) 1208 1 (1.00%) high mild 1209Benchmarking mesh/dlhn/deserialize 1210Benchmarking mesh/dlhn/deserialize: Warming up for 3.0000 s 1211Benchmarking mesh/dlhn/deserialize: Collecting 100 samples in estimated 5.4712 s (700 iterations) 1212Benchmarking mesh/dlhn/deserialize: Analyzing 1213mesh/dlhn/deserialize time: [7.8223 ms 7.9229 ms 8.0371 ms] 1214 change: [-14.754% -13.360% -11.788%] (p = 0.00 < 0.05) 1215 Performance has improved. 1216Found 9 outliers among 100 measurements (9.00%) 1217 7 (7.00%) high mild 1218 2 (2.00%) high severe 1219mesh/dlhn/size 6000003 1220mesh/dlhn/zlib 5380817 1221mesh/dlhn/zstd 5345900 1222 1223Benchmarking minecraft_savedata/abomonation/serialize 1224Benchmarking minecraft_savedata/abomonation/serialize: Warming up for 3.0000 s 1225Benchmarking minecraft_savedata/abomonation/serialize: Collecting 100 samples in estimated 5.6846 s (20k iterations) 1226Benchmarking minecraft_savedata/abomonation/serialize: Analyzing 1227minecraft_savedata/abomonation/serialize 1228 time: [284.40 µs 286.23 µs 288.09 µs] 1229 change: [+2.5735% +3.5219% +4.4622%] (p = 0.00 < 0.05) 1230 Performance has regressed. 1231Benchmarking minecraft_savedata/abomonation/access (unvalidated) 1232Benchmarking minecraft_savedata/abomonation/access (unvalidated): Warming up for 3.0000 s 1233Benchmarking minecraft_savedata/abomonation/access (unvalidated): Collecting 100 samples in estimated 5.0745 s (101k iterations) 1234Benchmarking minecraft_savedata/abomonation/access (unvalidated): Analyzing 1235minecraft_savedata/abomonation/access (unvalidated) 1236 time: [49.223 µs 49.561 µs 49.927 µs] 1237 change: [-29.501% -28.569% -27.592%] (p = 0.00 < 0.05) 1238 Performance has improved. 1239Found 1 outliers among 100 measurements (1.00%) 1240 1 (1.00%) high mild 1241Benchmarking minecraft_savedata/abomonation/read (unvalidated) 1242Benchmarking minecraft_savedata/abomonation/read (unvalidated): Warming up for 3.0000 s 1243Benchmarking minecraft_savedata/abomonation/read (unvalidated): Collecting 100 samples in estimated 5.0090 s (96k iterations) 1244Benchmarking minecraft_savedata/abomonation/read (unvalidated): Analyzing 1245minecraft_savedata/abomonation/read (unvalidated) 1246 time: [51.835 µs 52.204 µs 52.585 µs] 1247 change: [-32.466% -30.935% -29.620%] (p = 0.00 < 0.05) 1248 Performance has improved. 1249Found 1 outliers among 100 measurements (1.00%) 1250 1 (1.00%) low mild 1251Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated) 1252Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Warming up for 3.0000 s 1253Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Collecting 100 samples in estimated 5.0970 s (2500 iterations) 1254Benchmarking minecraft_savedata/abomonation/deserialize (unvalidated): Analyzing 1255minecraft_savedata/abomonation/deserialize (unvalidated) 1256 time: [1.9931 ms 2.0057 ms 2.0185 ms] 1257 change: [-6.6668% -5.4618% -4.4087%] (p = 0.00 < 0.05) 1258 Performance has improved. 1259Found 1 outliers among 100 measurements (1.00%) 1260 1 (1.00%) high mild 1261minecraft_savedata/abomonation/size 1290592 1262minecraft_savedata/abomonation/zlib 394008 1263minecraft_savedata/abomonation/zstd 330146 1264 1265Benchmarking minecraft_savedata/bare/serialize 1266Benchmarking minecraft_savedata/bare/serialize: Warming up for 3.0000 s 1267Benchmarking minecraft_savedata/bare/serialize: Collecting 100 samples in estimated 9.1643 s (10k iterations) 1268Benchmarking minecraft_savedata/bare/serialize: Analyzing 1269minecraft_savedata/bare/serialize 1270 time: [900.75 µs 908.82 µs 916.88 µs] 1271 change: [-2.6106% -1.0320% +0.4126%] (p = 0.19 > 0.05) 1272 No change in performance detected. 1273Found 5 outliers among 100 measurements (5.00%) 1274 5 (5.00%) low mild 1275Benchmarking minecraft_savedata/bare/deserialize 1276Benchmarking minecraft_savedata/bare/deserialize: Warming up for 3.0000 s 1277Benchmarking minecraft_savedata/bare/deserialize: Collecting 100 samples in estimated 5.1629 s (1500 iterations) 1278Benchmarking minecraft_savedata/bare/deserialize: Analyzing 1279minecraft_savedata/bare/deserialize 1280 time: [3.3316 ms 3.3590 ms 3.3871 ms] 1281 change: [-12.770% -11.717% -10.651%] (p = 0.00 < 0.05) 1282 Performance has improved. 1283minecraft_savedata/bare/size 356311 1284minecraft_savedata/bare/zlib 213270 1285minecraft_savedata/bare/zstd 198488 1286 1287Benchmarking minecraft_savedata/bincode/serialize 1288Benchmarking minecraft_savedata/bincode/serialize: Warming up for 3.0000 s 1289Benchmarking minecraft_savedata/bincode/serialize: Collecting 100 samples in estimated 7.3266 s (10k iterations) 1290Benchmarking minecraft_savedata/bincode/serialize: Analyzing 1291minecraft_savedata/bincode/serialize 1292 time: [714.53 µs 721.90 µs 729.58 µs] 1293 change: [-3.4672% -2.3385% -1.2244%] (p = 0.00 < 0.05) 1294 Performance has improved. 1295Benchmarking minecraft_savedata/bincode/deserialize 1296Benchmarking minecraft_savedata/bincode/deserialize: Warming up for 3.0000 s 1297Benchmarking minecraft_savedata/bincode/deserialize: Collecting 100 samples in estimated 5.1613 s (1900 iterations) 1298Benchmarking minecraft_savedata/bincode/deserialize: Analyzing 1299minecraft_savedata/bincode/deserialize 1300 time: [2.6441 ms 2.6703 ms 2.6981 ms] 1301 change: [-12.219% -11.071% -9.8131%] (p = 0.00 < 0.05) 1302 Performance has improved. 1303Found 8 outliers among 100 measurements (8.00%) 1304 6 (6.00%) high mild 1305 2 (2.00%) high severe 1306minecraft_savedata/bincode/size 569975 1307minecraft_savedata/bincode/zlib 240897 1308minecraft_savedata/bincode/zstd 232423 1309 1310Benchmarking minecraft_savedata/borsh/serialize 1311Benchmarking minecraft_savedata/borsh/serialize: Warming up for 3.0000 s 1312Benchmarking minecraft_savedata/borsh/serialize: Collecting 100 samples in estimated 6.3447 s (10k iterations) 1313Benchmarking minecraft_savedata/borsh/serialize: Analyzing 1314minecraft_savedata/borsh/serialize 1315 time: [610.91 µs 617.53 µs 624.18 µs] 1316 change: [-4.6331% -3.1818% -1.7612%] (p = 0.00 < 0.05) 1317 Performance has improved. 1318Found 1 outliers among 100 measurements (1.00%) 1319 1 (1.00%) high mild 1320Benchmarking minecraft_savedata/borsh/deserialize 1321Benchmarking minecraft_savedata/borsh/deserialize: Warming up for 3.0000 s 1322Benchmarking minecraft_savedata/borsh/deserialize: Collecting 100 samples in estimated 5.0699 s (1900 iterations) 1323Benchmarking minecraft_savedata/borsh/deserialize: Analyzing 1324minecraft_savedata/borsh/deserialize 1325 time: [2.6191 ms 2.6380 ms 2.6576 ms] 1326 change: [-12.982% -11.677% -10.396%] (p = 0.00 < 0.05) 1327 Performance has improved. 1328Found 2 outliers among 100 measurements (2.00%) 1329 2 (2.00%) high mild 1330minecraft_savedata/borsh/size 446595 1331minecraft_savedata/borsh/zlib 234395 1332minecraft_savedata/borsh/zstd 210008 1333 1334Benchmarking minecraft_savedata/bson/serialize 1335Benchmarking minecraft_savedata/bson/serialize: Warming up for 3.0000 s 1336Benchmarking minecraft_savedata/bson/serialize: Collecting 100 samples in estimated 5.4189 s (1200 iterations) 1337Benchmarking minecraft_savedata/bson/serialize: Analyzing 1338minecraft_savedata/bson/serialize 1339 time: [4.4981 ms 4.5307 ms 4.5628 ms] 1340 change: [-11.001% -9.5812% -8.1511%] (p = 0.00 < 0.05) 1341 Performance has improved. 1342Benchmarking minecraft_savedata/bson/deserialize 1343Benchmarking minecraft_savedata/bson/deserialize: Warming up for 3.0000 s 1344Benchmarking minecraft_savedata/bson/deserialize: Collecting 100 samples in estimated 5.2296 s (400 iterations) 1345Benchmarking minecraft_savedata/bson/deserialize: Analyzing 1346minecraft_savedata/bson/deserialize 1347 time: [11.763 ms 11.877 ms 11.997 ms] 1348 change: [-17.214% -16.009% -14.761%] (p = 0.00 < 0.05) 1349 Performance has improved. 1350Found 6 outliers among 100 measurements (6.00%) 1351 6 (6.00%) high mild 1352minecraft_savedata/bson/size 1619653 1353minecraft_savedata/bson/zlib 506953 1354minecraft_savedata/bson/zstd 328399 1355 1356Benchmarking minecraft_savedata/capnp/serialize 1357Benchmarking minecraft_savedata/capnp/serialize: Warming up for 3.0000 s 1358Benchmarking minecraft_savedata/capnp/serialize: Collecting 100 samples in estimated 9.3110 s (10k iterations) 1359Benchmarking minecraft_savedata/capnp/serialize: Analyzing 1360minecraft_savedata/capnp/serialize 1361 time: [889.85 µs 896.45 µs 903.81 µs] 1362 change: [-10.852% -9.7681% -8.6264%] (p = 0.00 < 0.05) 1363 Performance has improved. 1364Found 2 outliers among 100 measurements (2.00%) 1365 2 (2.00%) high mild 1366Benchmarking minecraft_savedata/capnp/access (validated on-demand with error) 1367Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Warming up for 3.0000 s 1368Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Collecting 100 samples in estimated 5.0002 s (42M iterations) 1369Benchmarking minecraft_savedata/capnp/access (validated on-demand with error): Analyzing 1370minecraft_savedata/capnp/access (validated on-demand with error) 1371 time: [116.70 ns 117.69 ns 118.80 ns] 1372 change: [-17.524% -16.422% -15.334%] (p = 0.00 < 0.05) 1373 Performance has improved. 1374Found 6 outliers among 100 measurements (6.00%) 1375 1 (1.00%) low mild 1376 5 (5.00%) high mild 1377Benchmarking minecraft_savedata/capnp/read (validated on-demand with error) 1378Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Warming up for 3.0000 s 1379Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Collecting 100 samples in estimated 5.0031 s (6.2M iterations) 1380Benchmarking minecraft_savedata/capnp/read (validated on-demand with error): Analyzing 1381minecraft_savedata/capnp/read (validated on-demand with error) 1382 time: [827.04 ns 837.94 ns 847.80 ns] 1383 change: [+16.979% +19.042% +21.064%] (p = 0.00 < 0.05) 1384 Performance has regressed. 1385minecraft_savedata/capnp/size 803896 1386minecraft_savedata/capnp/zlib 336655 1387minecraft_savedata/capnp/zstd 280851 1388 1389Benchmarking minecraft_savedata/cbor/serialize 1390Benchmarking minecraft_savedata/cbor/serialize: Warming up for 3.0000 s 1391Benchmarking minecraft_savedata/cbor/serialize: Collecting 100 samples in estimated 5.1845 s (2400 iterations) 1392Benchmarking minecraft_savedata/cbor/serialize: Analyzing 1393minecraft_savedata/cbor/serialize 1394 time: [2.0547 ms 2.0712 ms 2.0875 ms] 1395 change: [-8.7915% -7.4067% -6.0585%] (p = 0.00 < 0.05) 1396 Performance has improved. 1397Found 1 outliers among 100 measurements (1.00%) 1398 1 (1.00%) low mild 1399Benchmarking minecraft_savedata/cbor/deserialize 1400Benchmarking minecraft_savedata/cbor/deserialize: Warming up for 3.0000 s 1401Benchmarking minecraft_savedata/cbor/deserialize: Collecting 100 samples in estimated 5.5738 s (900 iterations) 1402Benchmarking minecraft_savedata/cbor/deserialize: Analyzing 1403minecraft_savedata/cbor/deserialize 1404 time: [6.2352 ms 6.2772 ms 6.3212 ms] 1405 change: [-13.998% -13.064% -12.127%] (p = 0.00 < 0.05) 1406 Performance has improved. 1407Found 2 outliers among 100 measurements (2.00%) 1408 2 (2.00%) high mild 1409minecraft_savedata/cbor/size 1109821 1410minecraft_savedata/cbor/zlib 347812 1411minecraft_savedata/cbor/zstd 274526 1412 1413Benchmarking minecraft_savedata/flatbuffers/serialize 1414Benchmarking minecraft_savedata/flatbuffers/serialize: Warming up for 3.0000 s 1415Benchmarking minecraft_savedata/flatbuffers/serialize: Collecting 100 samples in estimated 5.0254 s (1400 iterations) 1416Benchmarking minecraft_savedata/flatbuffers/serialize: Analyzing 1417minecraft_savedata/flatbuffers/serialize 1418 time: [3.5777 ms 3.6071 ms 3.6381 ms] 1419 change: [-19.790% -18.957% -18.044%] (p = 0.00 < 0.05) 1420 Performance has improved. 1421Found 1 outliers among 100 measurements (1.00%) 1422 1 (1.00%) high mild 1423Benchmarking minecraft_savedata/flatbuffers/access (unvalidated) 1424Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Warming up for 3.0000 s 1425Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (1.6B iterations) 1426Benchmarking minecraft_savedata/flatbuffers/access (unvalidated): Analyzing 1427minecraft_savedata/flatbuffers/access (unvalidated) 1428 time: [3.1270 ns 3.1576 ns 3.1881 ns] 1429 change: [-12.718% -11.643% -10.512%] (p = 0.00 < 0.05) 1430 Performance has improved. 1431Found 3 outliers among 100 measurements (3.00%) 1432 1 (1.00%) low mild 1433 1 (1.00%) high mild 1434 1 (1.00%) high severe 1435Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error) 1436Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Warming up for 3.0000 s 1437Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Collecting 100 samples in estimated 5.1064 s (1800 iterations) 1438Benchmarking minecraft_savedata/flatbuffers/access (validated upfront with error): Analyzing 1439minecraft_savedata/flatbuffers/access (validated upfront with error) 1440 time: [2.8311 ms 2.8539 ms 2.8766 ms] 1441 change: [-6.4041% -5.1601% -3.9141%] (p = 0.00 < 0.05) 1442 Performance has improved. 1443Benchmarking minecraft_savedata/flatbuffers/read (unvalidated) 1444Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Warming up for 3.0000 s 1445Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Collecting 100 samples in estimated 5.0082 s (1.8M iterations) 1446Benchmarking minecraft_savedata/flatbuffers/read (unvalidated): Analyzing 1447minecraft_savedata/flatbuffers/read (unvalidated) 1448 time: [2.9042 µs 2.9315 µs 2.9579 µs] 1449 change: [-14.050% -12.680% -11.432%] (p = 0.00 < 0.05) 1450 Performance has improved. 1451Found 1 outliers among 100 measurements (1.00%) 1452 1 (1.00%) low mild 1453Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error) 1454Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Warming up for 3.0000 s 1455Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Collecting 100 samples in estimated 5.0352 s (1800 iterations) 1456Benchmarking minecraft_savedata/flatbuffers/read (validated upfront with error): Analyzing 1457minecraft_savedata/flatbuffers/read (validated upfront with error) 1458 time: [2.9310 ms 2.9533 ms 2.9757 ms] 1459 change: [-5.1469% -4.1679% -3.1977%] (p = 0.00 < 0.05) 1460 Performance has improved. 1461Found 1 outliers among 100 measurements (1.00%) 1462 1 (1.00%) high mild 1463minecraft_savedata/flatbuffers/size 844168 1464minecraft_savedata/flatbuffers/zlib 346957 1465minecraft_savedata/flatbuffers/zstd 294015 1466 1467Benchmarking minecraft_savedata/nachricht/serialize 1468Benchmarking minecraft_savedata/nachricht/serialize: Warming up for 3.0000 s 1469Benchmarking minecraft_savedata/nachricht/serialize: Collecting 100 samples in estimated 5.0588 s (700 iterations) 1470Benchmarking minecraft_savedata/nachricht/serialize: Analyzing 1471minecraft_savedata/nachricht/serialize 1472 time: [6.9946 ms 7.0567 ms 7.1196 ms] 1473 change: [-10.223% -9.0578% -7.8901%] (p = 0.00 < 0.05) 1474 Performance has improved. 1475Benchmarking minecraft_savedata/nachricht/deserialize 1476Benchmarking minecraft_savedata/nachricht/deserialize: Warming up for 3.0000 s 1477Benchmarking minecraft_savedata/nachricht/deserialize: Collecting 100 samples in estimated 5.0056 s (900 iterations) 1478Benchmarking minecraft_savedata/nachricht/deserialize: Analyzing 1479minecraft_savedata/nachricht/deserialize 1480 time: [5.6266 ms 5.6754 ms 5.7249 ms] 1481 change: [-10.191% -8.8256% -7.4347%] (p = 0.00 < 0.05) 1482 Performance has improved. 1483minecraft_savedata/nachricht/size 449745 1484minecraft_savedata/nachricht/zlib 252743 1485minecraft_savedata/nachricht/zstd 231110 1486 1487Benchmarking minecraft_savedata/postcard/serialize 1488Benchmarking minecraft_savedata/postcard/serialize: Warming up for 3.0000 s 1489Benchmarking minecraft_savedata/postcard/serialize: Collecting 100 samples in estimated 7.2407 s (15k iterations) 1490Benchmarking minecraft_savedata/postcard/serialize: Analyzing 1491minecraft_savedata/postcard/serialize 1492 time: [484.26 µs 487.82 µs 491.36 µs] 1493 change: [-9.6158% -8.2722% -6.9970%] (p = 0.00 < 0.05) 1494 Performance has improved. 1495Found 2 outliers among 100 measurements (2.00%) 1496 1 (1.00%) low mild 1497 1 (1.00%) high mild 1498Benchmarking minecraft_savedata/postcard/deserialize 1499Benchmarking minecraft_savedata/postcard/deserialize: Warming up for 3.0000 s 1500Benchmarking minecraft_savedata/postcard/deserialize: Collecting 100 samples in estimated 5.2566 s (1800 iterations) 1501Benchmarking minecraft_savedata/postcard/deserialize: Analyzing 1502minecraft_savedata/postcard/deserialize 1503 time: [2.9446 ms 2.9694 ms 2.9950 ms] 1504 change: [-3.9458% -2.5868% -1.2319%] (p = 0.00 < 0.05) 1505 Performance has improved. 1506Found 3 outliers among 100 measurements (3.00%) 1507 3 (3.00%) high mild 1508minecraft_savedata/postcard/size 367489 1509minecraft_savedata/postcard/zlib 222144 1510minecraft_savedata/postcard/zstd 207344 1511 1512Benchmarking minecraft_savedata/prost/serialize (populate + encode) 1513Benchmarking minecraft_savedata/prost/serialize (populate + encode): Warming up for 3.0000 s 1514Benchmarking minecraft_savedata/prost/serialize (populate + encode): Collecting 100 samples in estimated 5.0219 s (1200 iterations) 1515Benchmarking minecraft_savedata/prost/serialize (populate + encode): Analyzing 1516minecraft_savedata/prost/serialize (populate + encode) 1517 time: [4.1423 ms 4.1798 ms 4.2179 ms] 1518 change: [-6.7602% -5.4275% -4.1270%] (p = 0.00 < 0.05) 1519 Performance has improved. 1520Benchmarking minecraft_savedata/prost/serialize (encode) 1521Benchmarking minecraft_savedata/prost/serialize (encode): Warming up for 3.0000 s 1522 1523Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 7.5s, enable flat sampling, or reduce sample count to 50. 1524Benchmarking minecraft_savedata/prost/serialize (encode): Collecting 100 samples in estimated 7.4693 s (5050 iterations) 1525Benchmarking minecraft_savedata/prost/serialize (encode): Analyzing 1526minecraft_savedata/prost/serialize (encode) 1527 time: [1.4514 ms 1.4675 ms 1.4836 ms] 1528 change: [-13.222% -11.266% -9.3765%] (p = 0.00 < 0.05) 1529 Performance has improved. 1530Found 1 outliers among 100 measurements (1.00%) 1531 1 (1.00%) high mild 1532Benchmarking minecraft_savedata/prost/deserialize 1533Benchmarking minecraft_savedata/prost/deserialize: Warming up for 3.0000 s 1534Benchmarking minecraft_savedata/prost/deserialize: Collecting 100 samples in estimated 5.3944 s (1100 iterations) 1535Benchmarking minecraft_savedata/prost/deserialize: Analyzing 1536minecraft_savedata/prost/deserialize 1537 time: [4.9605 ms 5.0108 ms 5.0605 ms] 1538 change: [-4.8730% -3.5672% -2.2572%] (p = 0.00 < 0.05) 1539 Performance has improved. 1540minecraft_savedata/prost/size 596811 1541minecraft_savedata/prost/zlib 306728 1542minecraft_savedata/prost/zstd 269310 1543 1544Benchmarking minecraft_savedata/rkyv/serialize 1545Benchmarking minecraft_savedata/rkyv/serialize: Warming up for 3.0000 s 1546Benchmarking minecraft_savedata/rkyv/serialize: Collecting 100 samples in estimated 7.1879 s (15k iterations) 1547Benchmarking minecraft_savedata/rkyv/serialize: Analyzing 1548minecraft_savedata/rkyv/serialize 1549 time: [494.40 µs 500.03 µs 505.35 µs] 1550 change: [+0.0558% +2.2867% +4.2217%] (p = 0.02 < 0.05) 1551 Change within noise threshold. 1552Found 2 outliers among 100 measurements (2.00%) 1553 2 (2.00%) high mild 1554Benchmarking minecraft_savedata/rkyv/access (unvalidated) 1555Benchmarking minecraft_savedata/rkyv/access (unvalidated): Warming up for 3.0000 s 1556Benchmarking minecraft_savedata/rkyv/access (unvalidated): Collecting 100 samples in estimated 5.0000 s (2.8B iterations) 1557Benchmarking minecraft_savedata/rkyv/access (unvalidated): Analyzing 1558minecraft_savedata/rkyv/access (unvalidated) 1559 time: [1.6924 ns 1.7161 ns 1.7407 ns] 1560 change: [-4.7036% -3.3631% -2.0404%] (p = 0.00 < 0.05) 1561 Performance has improved. 1562Found 1 outliers among 100 measurements (1.00%) 1563 1 (1.00%) low mild 1564Benchmarking minecraft_savedata/rkyv/access (validated upfront with error) 1565Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Warming up for 3.0000 s 1566Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Collecting 100 samples in estimated 6.9709 s (10k iterations) 1567Benchmarking minecraft_savedata/rkyv/access (validated upfront with error): Analyzing 1568minecraft_savedata/rkyv/access (validated upfront with error) 1569 time: [675.83 µs 683.50 µs 691.87 µs] 1570 change: [-2.5270% -1.1810% +0.0706%] (p = 0.09 > 0.05) 1571 No change in performance detected. 1572Found 3 outliers among 100 measurements (3.00%) 1573 3 (3.00%) high mild 1574Benchmarking minecraft_savedata/rkyv/read (unvalidated) 1575Benchmarking minecraft_savedata/rkyv/read (unvalidated): Warming up for 3.0000 s 1576Benchmarking minecraft_savedata/rkyv/read (unvalidated): Collecting 100 samples in estimated 5.0008 s (27M iterations) 1577Benchmarking minecraft_savedata/rkyv/read (unvalidated): Analyzing 1578minecraft_savedata/rkyv/read (unvalidated) 1579 time: [191.12 ns 193.03 ns 194.72 ns] 1580 change: [-1.6352% -0.2149% +1.0814%] (p = 0.76 > 0.05) 1581 No change in performance detected. 1582Benchmarking minecraft_savedata/rkyv/read (validated upfront with error) 1583Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Warming up for 3.0000 s 1584Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Collecting 100 samples in estimated 6.9871 s (10k iterations) 1585Benchmarking minecraft_savedata/rkyv/read (validated upfront with error): Analyzing 1586minecraft_savedata/rkyv/read (validated upfront with error) 1587 time: [675.47 µs 681.60 µs 688.51 µs] 1588 change: [-2.5928% -1.5240% -0.4326%] (p = 0.00 < 0.05) 1589 Change within noise threshold. 1590Found 3 outliers among 100 measurements (3.00%) 1591 1 (1.00%) low mild 1592 2 (2.00%) high mild 1593Benchmarking minecraft_savedata/rkyv/update 1594Benchmarking minecraft_savedata/rkyv/update: Warming up for 3.0000 s 1595Benchmarking minecraft_savedata/rkyv/update: Collecting 100 samples in estimated 5.0050 s (3.4M iterations) 1596Benchmarking minecraft_savedata/rkyv/update: Analyzing 1597minecraft_savedata/rkyv/update 1598 time: [1.5091 µs 1.5292 µs 1.5507 µs] 1599 change: [-35.322% -33.830% -32.344%] (p = 0.00 < 0.05) 1600 Performance has improved. 1601Found 1 outliers among 100 measurements (1.00%) 1602 1 (1.00%) low mild 1603Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated) 1604Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Warming up for 3.0000 s 1605 1606Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.3s, enable flat sampling, or reduce sample count to 50. 1607Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Collecting 100 samples in estimated 9.2840 s (5050 iterations) 1608Benchmarking minecraft_savedata/rkyv/deserialize (unvalidated): Analyzing 1609minecraft_savedata/rkyv/deserialize (unvalidated) 1610 time: [1.8215 ms 1.8361 ms 1.8518 ms] 1611 change: [-7.9058% -6.9271% -5.9014%] (p = 0.00 < 0.05) 1612 Performance has improved. 1613Found 2 outliers among 100 measurements (2.00%) 1614 2 (2.00%) low mild 1615Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error) 1616Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Warming up for 3.0000 s 1617Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Collecting 100 samples in estimated 5.2427 s (1900 iterations) 1618Benchmarking minecraft_savedata/rkyv/deserialize (validated upfront with error): Analyzing 1619minecraft_savedata/rkyv/deserialize (validated upfront with error) 1620 time: [2.6894 ms 2.7131 ms 2.7363 ms] 1621 change: [-0.1391% +1.2183% +2.4944%] (p = 0.07 > 0.05) 1622 No change in performance detected. 1623minecraft_savedata/rkyv/size 596952 1624minecraft_savedata/rkyv/zlib 254571 1625minecraft_savedata/rkyv/zstd 219976 1626 1627Benchmarking minecraft_savedata/rmp/serialize 1628Benchmarking minecraft_savedata/rmp/serialize: Warming up for 3.0000 s 1629 1630Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 8.4s, enable flat sampling, or reduce sample count to 50. 1631Benchmarking minecraft_savedata/rmp/serialize: Collecting 100 samples in estimated 8.4462 s (5050 iterations) 1632Benchmarking minecraft_savedata/rmp/serialize: Analyzing 1633minecraft_savedata/rmp/serialize 1634 time: [1.6492 ms 1.6617 ms 1.6746 ms] 1635 change: [-7.6362% -6.5695% -5.5124%] (p = 0.00 < 0.05) 1636 Performance has improved. 1637Found 4 outliers among 100 measurements (4.00%) 1638 1 (1.00%) low mild 1639 3 (3.00%) high mild 1640Benchmarking minecraft_savedata/rmp/deserialize 1641Benchmarking minecraft_savedata/rmp/deserialize: Warming up for 3.0000 s 1642Benchmarking minecraft_savedata/rmp/deserialize: Collecting 100 samples in estimated 5.0860 s (1300 iterations) 1643Benchmarking minecraft_savedata/rmp/deserialize: Analyzing 1644minecraft_savedata/rmp/deserialize 1645 time: [3.9141 ms 3.9549 ms 3.9984 ms] 1646 change: [-12.541% -10.851% -9.2454%] (p = 0.00 < 0.05) 1647 Performance has improved. 1648Found 13 outliers among 100 measurements (13.00%) 1649 11 (11.00%) high mild 1650 2 (2.00%) high severe 1651minecraft_savedata/rmp/size 424533 1652minecraft_savedata/rmp/zlib 245594 1653minecraft_savedata/rmp/zstd 226188 1654 1655Benchmarking minecraft_savedata/ron/serialize 1656Benchmarking minecraft_savedata/ron/serialize: Warming up for 3.0000 s 1657Benchmarking minecraft_savedata/ron/serialize: Collecting 100 samples in estimated 5.9863 s (600 iterations) 1658Benchmarking minecraft_savedata/ron/serialize: Analyzing 1659minecraft_savedata/ron/serialize 1660 time: [9.9036 ms 9.9961 ms 10.092 ms] 1661 change: [-11.704% -10.589% -9.4660%] (p = 0.00 < 0.05) 1662 Performance has improved. 1663Found 3 outliers among 100 measurements (3.00%) 1664 3 (3.00%) high mild 1665Benchmarking minecraft_savedata/ron/deserialize 1666Benchmarking minecraft_savedata/ron/deserialize: Warming up for 3.0000 s 1667Benchmarking minecraft_savedata/ron/deserialize: Collecting 100 samples in estimated 5.8720 s (300 iterations) 1668Benchmarking minecraft_savedata/ron/deserialize: Analyzing 1669minecraft_savedata/ron/deserialize 1670 time: [19.095 ms 19.224 ms 19.354 ms] 1671 change: [-1.4401% -0.0165% +1.4309%] (p = 0.98 > 0.05) 1672 No change in performance detected. 1673minecraft_savedata/ron/size 1465223 1674minecraft_savedata/ron/zlib 439761 1675minecraft_savedata/ron/zstd 343338 1676 1677Benchmarking minecraft_savedata/serde_json/serialize 1678Benchmarking minecraft_savedata/serde_json/serialize: Warming up for 3.0000 s 1679Benchmarking minecraft_savedata/serde_json/serialize: Collecting 100 samples in estimated 5.0309 s (1000 iterations) 1680Benchmarking minecraft_savedata/serde_json/serialize: Analyzing 1681minecraft_savedata/serde_json/serialize 1682 time: [4.7813 ms 4.8292 ms 4.8775 ms] 1683 change: [-2.5375% -1.1858% +0.1144%] (p = 0.09 > 0.05) 1684 No change in performance detected. 1685Benchmarking minecraft_savedata/serde_json/deserialize 1686Benchmarking minecraft_savedata/serde_json/deserialize: Warming up for 3.0000 s 1687Benchmarking minecraft_savedata/serde_json/deserialize: Collecting 100 samples in estimated 5.2541 s (500 iterations) 1688Benchmarking minecraft_savedata/serde_json/deserialize: Analyzing 1689minecraft_savedata/serde_json/deserialize 1690 time: [10.960 ms 11.032 ms 11.102 ms] 1691 change: [-1.0475% +0.0526% +1.1194%] (p = 0.93 > 0.05) 1692 No change in performance detected. 1693minecraft_savedata/serde_json/size 1623191 1694minecraft_savedata/serde_json/zlib 472275 1695minecraft_savedata/serde_json/zstd 359623 1696 1697Benchmarking minecraft_savedata/simd-json/serialize 1698Benchmarking minecraft_savedata/simd-json/serialize: Warming up for 3.0000 s 1699Benchmarking minecraft_savedata/simd-json/serialize: Collecting 100 samples in estimated 5.2808 s (1100 iterations) 1700Benchmarking minecraft_savedata/simd-json/serialize: Analyzing 1701minecraft_savedata/simd-json/serialize 1702 time: [4.6428 ms 4.6787 ms 4.7150 ms] 1703 change: [+0.7105% +2.0496% +3.4176%] (p = 0.00 < 0.05) 1704 Change within noise threshold. 1705Benchmarking minecraft_savedata/simd-json/deserialize 1706Benchmarking minecraft_savedata/simd-json/deserialize: Warming up for 3.0000 s 1707Benchmarking minecraft_savedata/simd-json/deserialize: Collecting 100 samples in estimated 5.1905 s (700 iterations) 1708Benchmarking minecraft_savedata/simd-json/deserialize: Analyzing 1709minecraft_savedata/simd-json/deserialize 1710 time: [6.7074 ms 6.7544 ms 6.8024 ms] 1711 change: [+4.0119% +5.5639% +6.9996%] (p = 0.00 < 0.05) 1712 Performance has regressed. 1713minecraft_savedata/simd-json/size 1663769 1714minecraft_savedata/simd-json/zlib 496401 1715minecraft_savedata/simd-json/zstd 383682 1716 1717Benchmarking minecraft_savedata/speedy/serialize 1718Benchmarking minecraft_savedata/speedy/serialize: Warming up for 3.0000 s 1719Benchmarking minecraft_savedata/speedy/serialize: Collecting 100 samples in estimated 6.8727 s (15k iterations) 1720Benchmarking minecraft_savedata/speedy/serialize: Analyzing 1721minecraft_savedata/speedy/serialize 1722 time: [446.90 µs 450.65 µs 454.62 µs] 1723 change: [+15.744% +17.280% +18.795%] (p = 0.00 < 0.05) 1724 Performance has regressed. 1725Benchmarking minecraft_savedata/speedy/deserialize 1726Benchmarking minecraft_savedata/speedy/deserialize: Warming up for 3.0000 s 1727Benchmarking minecraft_savedata/speedy/deserialize: Collecting 100 samples in estimated 5.0731 s (2100 iterations) 1728Benchmarking minecraft_savedata/speedy/deserialize: Analyzing 1729minecraft_savedata/speedy/deserialize 1730 time: [2.4058 ms 2.4272 ms 2.4485 ms] 1731 change: [+3.5147% +4.8102% +6.1485%] (p = 0.00 < 0.05) 1732 Performance has regressed. 1733minecraft_savedata/speedy/size 449595 1734minecraft_savedata/speedy/zlib 235136 1735minecraft_savedata/speedy/zstd 210361 1736 1737Benchmarking minecraft_savedata/alkahest/serialize 1738Benchmarking minecraft_savedata/alkahest/serialize: Warming up for 3.0000 s 1739Benchmarking minecraft_savedata/alkahest/serialize: Collecting 100 samples in estimated 5.1368 s (15k iterations) 1740Benchmarking minecraft_savedata/alkahest/serialize: Analyzing 1741minecraft_savedata/alkahest/serialize 1742 time: [330.59 µs 334.23 µs 338.08 µs] 1743 change: [+2.4915% +4.1722% +5.7750%] (p = 0.00 < 0.05) 1744 Performance has regressed. 1745Found 1 outliers among 100 measurements (1.00%) 1746 1 (1.00%) high mild 1747Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic) 1748Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Warming up for 3.0000 s 1749Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Collecting 100 samples in estimated 5.0000 s (1.9B iterations) 1750Benchmarking minecraft_savedata/alkahest/access (validated on-demand with panic): Analyzing 1751minecraft_savedata/alkahest/access (validated on-demand with panic) 1752 time: [2.5610 ns 2.5830 ns 2.6052 ns] 1753 change: [+6.3549% +7.9111% +9.3748%] (p = 0.00 < 0.05) 1754 Performance has regressed. 1755Found 1 outliers among 100 measurements (1.00%) 1756 1 (1.00%) low mild 1757Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic) 1758Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Warming up for 3.0000 s 1759Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Collecting 100 samples in estimated 5.2241 s (111k iterations) 1760Benchmarking minecraft_savedata/alkahest/read (validated on-demand with panic): Analyzing 1761minecraft_savedata/alkahest/read (validated on-demand with panic) 1762 time: [46.510 µs 46.844 µs 47.207 µs] 1763 change: [-5.1633% -3.8799% -2.4781%] (p = 0.00 < 0.05) 1764 Performance has improved. 1765Found 6 outliers among 100 measurements (6.00%) 1766 3 (3.00%) low mild 1767 3 (3.00%) high mild 1768minecraft_savedata/alkahest/size 667570 1769minecraft_savedata/alkahest/zlib 325536 1770minecraft_savedata/alkahest/zstd 320452 1771