Programming Language and compiler
Benchmarks

Crystal VS Rust benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1541ms 5.5ms 66.2MB 1840ms 17ms crystal 1.5.1
rust 4.rs 1550ms 7.8ms 33.7MB 1523ms 10ms rustc 1.64.0
rust 5.rs 1712ms 13ms 33.8MB 1693ms 0ms rustc 1.64.0
rust 3.rs 1852ms 32ms 49.8MB 1823ms 10ms rustc 1.64.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 131ms 0.2ms 13.1MB 140ms 0ms crystal 1.5.1
rust 4.rs 143ms 3.4ms 5.7MB 130ms 0ms rustc 1.64.0
rust 5.rs 155ms 1.4ms 5.7MB 147ms 0ms rustc 1.64.0
rust 3.rs 163ms 3.1ms 7.7MB 147ms 0ms rustc 1.64.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-m.rs 915ms 116ms 5.2MB 1747ms 30ms rustc 1.64.0
rust 3-m.rs 935ms 70ms 6.3MB 1773ms 27ms rustc 1.64.0
rust 3.rs 1829ms 16ms 6.5MB 1780ms 30ms rustc 1.64.0
crystal 1.cr 1972ms 20ms 22.3MB 1920ms 30ms crystal 1.5.1
rust 1-m.rs 2570ms 16ms 5.2MB 4930ms 123ms rustc 1.64.0
rust 4.rs 3185ms 4.4ms 4.4MB 3170ms 0ms rustc 1.64.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 72ms 4.5ms 2.9MB 113ms 3ms rustc 1.64.0
rust 5-m.rs 93ms 16ms 3.0MB 153ms 7ms rustc 1.64.0
crystal 1.cr 110ms 4.1ms 7.6MB 97ms 3ms crystal 1.5.1
rust 3.rs 117ms 0.7ms 3.1MB 107ms 0ms rustc 1.64.0
rust 1-m.rs 192ms 1.5ms 2.9MB 327ms 27ms rustc 1.64.0
rust 4.rs 210ms 0.6ms 2.6MB 197ms 0ms rustc 1.64.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 85ms 3.4ms 9.2MB 70ms 0ms crystal 1.5.1
rust 1.rs 146ms 0.9ms 3.7MB 140ms 0ms rustc 1.64.0
rust 2.rs 599ms 0.4ms 4.1MB 587ms 0ms rustc 1.64.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 0.4ms 7.0MB 20ms 0ms crystal 1.5.1
rust 1.rs 41ms 0.2ms 3.0MB 30ms 0ms rustc 1.64.0
rust 2.rs 114ms 1.3ms 3.3MB 100ms 0ms rustc 1.64.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 738ms 20ms 0.7MB 1410ms 0ms rustc 1.64.0
rust 2-im.rs 1077ms 9.7ms 0.7MB 2073ms 0ms rustc 1.64.0
rust 5-m.rs 1228ms 11ms 0.7MB 2377ms 0ms rustc 1.64.0
rust 3-i.rs 1374ms 0.6ms 0.6MB 1363ms 0ms rustc 1.64.0
rust 1-m.rs 1946ms 14ms 0.6MB 3797ms 0ms rustc 1.64.0
rust 2-i.rs 1997ms 1.5ms 0.6MB 1987ms 0ms rustc 1.64.0
rust 1.rs 3938ms 225ms 0.6MB 3927ms 0ms rustc 1.64.0
crystal 1.cr 3970ms 6.7ms 3.0MB 3957ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 67ms 0.8ms 0.7MB 110ms 0ms rustc 1.64.0
rust 2-im.rs 97ms 0.1ms 0.7MB 160ms 0ms rustc 1.64.0
rust 3-i.rs 117ms 0.5ms 0.6MB 110ms 0ms rustc 1.64.0
rust 5-m.rs 118ms 12ms 0.7MB 190ms 0ms rustc 1.64.0
rust 2-i.rs 167ms 0.3ms 0.6MB 160ms 0ms rustc 1.64.0
rust 1-m.rs 177ms 2.0ms 0.7MB 310ms 0ms rustc 1.64.0
rust 1.rs 322ms 0.2ms 0.6MB 310ms 0ms rustc 1.64.0
crystal 1.cr 323ms 0.4ms 3.0MB 310ms 0ms crystal 1.5.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 179ms 1.2ms 1.2MB 320ms 0ms rustc 1.66.0-nightly
rust 5-m.rs 205ms 1.4ms 1.3MB 370ms 0ms rustc 1.64.0
rust 1c.rs 231ms 0.9ms 0.7MB 220ms 0ms rustc 1.66.0-nightly
rust 1.rs 315ms 0.4ms 0.6MB 303ms 0ms rustc 1.64.0
crystal 2.cr 859ms 3.2ms 5.6MB 750ms 97ms crystal 1.5.1
crystal 1.cr 1059ms 1.3ms 16.7MB 903ms 140ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 28ms 1.5ms 0.7MB 10ms 0ms rustc 1.66.0-nightly
rust 5-m.rs 29ms 0.4ms 1.3MB 40ms 0ms rustc 1.64.0
rust 5c-m.rs 30ms 1.4ms 1.3MB 33ms 0ms rustc 1.66.0-nightly
rust 1.rs 34ms 0.2ms 0.6MB 23ms 0ms rustc 1.64.0
crystal 2.cr 91ms 1.0ms 5.3MB 70ms 3ms crystal 1.5.1
crystal 1.cr 111ms 0.2ms 4.6MB 87ms 10ms crystal 1.5.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.7ms 0.6ms 0.6MB 0ms 0ms rustc 1.66.0-nightly
rust 1.rs 1.7ms 0.6ms 0.6MB 0ms 0ms rustc 1.64.0
crystal 1.cr 4.6ms 2.2ms 3.1MB 0ms 0ms crystal 1.5.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 132ms 13ms 20.4MB 80ms 80ms rustc 1.64.0
rust 2-http2.rs 321ms 53ms 49.8MB 420ms 113ms rustc 1.64.0
rust 2-m.rs 492ms 1.1ms 116.3MB 307ms 447ms rustc 1.64.0
rust 1-http2.rs 882ms 136ms 97.1MB 1097ms 433ms rustc 1.64.0
crystal 1.cr 3369ms 198ms 152.7MB 297ms 283ms crystal 1.5.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 63ms 9.8ms 18.2MB 17ms 27ms rustc 1.64.0
rust 2.rs 132ms 4.8ms 28.9MB 47ms 73ms rustc 1.64.0
rust 2-http2.rs 347ms 13ms 28.5MB 520ms 87ms rustc 1.64.0
rust 1-http2.rs 369ms 48ms 30.6MB 470ms 110ms rustc 1.64.0
crystal 1.cr 1173ms 102ms 32.3MB 40ms 40ms crystal 1.5.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 58ms 2.1ms 0.6MB 50ms 0ms rustc 1.64.0
crystal 0-unsafe.cr 61ms 0.9ms 5.0MB 50ms 0ms crystal 1.5.1
rust 1.rs 78ms 8.4ms 2.0MB 67ms 0ms rustc 1.64.0
crystal 1.cr 108ms 0.4ms 3.0MB 97ms 0ms crystal 1.5.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 174ms 0.5ms 3.1MB 160ms 0ms crystal 1.5.1
rust 0-unsafe.rs 202ms 7.7ms 0.6MB 193ms 0ms rustc 1.64.0
crystal 1.cr 312ms 1.3ms 3.0MB 300ms 0ms crystal 1.5.1
rust 1.rs 333ms 16ms 2.2MB 323ms 0ms rustc 1.64.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 31ms 0.8ms 5.0MB 20ms 0ms crystal 1.5.1
rust 0-unsafe.rs 37ms 0.5ms 0.6MB 23ms 0ms rustc 1.64.0
rust 1.rs 46ms 2.0ms 0.6MB 37ms 0ms rustc 1.64.0
crystal 1.cr 55ms 2.1ms 3.1MB 47ms 0ms crystal 1.5.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 414ms 0.4ms 5.0MB 400ms 0ms rustc 1.66.0-nightly
rust 8.rs 581ms 0.1ms 5.0MB 563ms 0ms rustc 1.64.0
crystal 1.cr 994ms 0.9ms 7.6MB 980ms 0ms crystal 1.5.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 20ms 0.2ms 0.6MB 10ms 0ms rustc 1.66.0-nightly
rust 8.rs 27ms 0.6ms 0.6MB 20ms 0ms rustc 1.64.0
crystal 1.cr 46ms 0.5ms 6.4MB 40ms 0ms crystal 1.5.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 896ms 7.1ms 33.9MB 873ms 7ms rustc 1.64.0
crystal 1.cr 1083ms 49ms 64.3MB 1230ms 23ms crystal 1.5.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 186ms 1.0ms 9.8MB 170ms 0ms rustc 1.64.0
crystal 1.cr 207ms 6.9ms 17.5MB 223ms 3ms crystal 1.5.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 252ms 0.0ms 0.6MB 240ms 0ms rustc 1.64.0
rust 7-i.rs 305ms 0.6ms 0.6MB 297ms 0ms rustc 1.64.0
rust 3.rs 339ms 0.4ms 0.7MB 330ms 0ms rustc 1.66.0-nightly
rust 2.rs 345ms 1.7ms 0.6MB 333ms 0ms rustc 1.64.0
rust 1.rs 387ms 6.1ms 0.6MB 373ms 0ms rustc 1.64.0
crystal 1.cr 516ms 4.8ms 2.9MB 500ms 0ms crystal 1.5.1
crystal 2.cr 540ms 0.7ms 2.9MB 530ms 0ms crystal 1.5.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 28ms 0.2ms 0.6MB 20ms 0ms rustc 1.64.0
rust 7-i.rs 34ms 1.1ms 0.6MB 23ms 0ms rustc 1.64.0
rust 3.rs 36ms 0.4ms 0.6MB 30ms 0ms rustc 1.66.0-nightly
rust 2.rs 37ms 0.5ms 0.6MB 27ms 0ms rustc 1.64.0
rust 1.rs 41ms 0.7ms 0.6MB 30ms 0ms rustc 1.64.0
crystal 1.cr 56ms 1.6ms 3.0MB 50ms 0ms crystal 1.5.1
crystal 2.cr 60ms 2.8ms 2.9MB 43ms 0ms crystal 1.5.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 462ms 2.0ms 6.6MB 450ms 0ms rustc 1.64.0
crystal 2.cr 467ms 2.2ms 9.8MB 453ms 0ms crystal 1.5.1
rust 1.rs 847ms 5.7ms 40.8MB 820ms 7ms rustc 1.64.0
crystal 1.cr 851ms 16ms 42.7MB 827ms 7ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 106ms 0.5ms 3.2MB 93ms 0ms rustc 1.64.0
crystal 2.cr 108ms 0.2ms 4.4MB 97ms 0ms crystal 1.5.1
rust 1.rs 130ms 1.7ms 11.7MB 117ms 0ms rustc 1.64.0
crystal 1.cr 151ms 1.6ms 12.9MB 137ms 0ms crystal 1.5.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 1838ms 1.3ms 2.9MB 1770ms 50ms rustc 1.64.0
rust 1.rs 1854ms 1.9ms 2.8MB 1703ms 137ms rustc 1.64.0
crystal 1.cr 2779ms 53ms 9.0MB 3030ms 280ms crystal 1.5.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 395ms 3.1ms 2.5MB 373ms 7ms rustc 1.64.0
rust 2.rs 410ms 0.3ms 2.6MB 397ms 0ms rustc 1.64.0
crystal 1.cr 644ms 5.5ms 5.3MB 670ms 70ms crystal 1.5.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 566ms 3.5ms 77.9MB 710ms 20ms rustc 1.64.0
crystal 1.cr 2474ms 0.8ms 196.1MB 2397ms 57ms crystal 1.5.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 64ms 2.4ms 11.7MB 73ms 0ms rustc 1.64.0
crystal 1.cr 256ms 2.5ms 24.5MB 237ms 3ms crystal 1.5.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 1065ms 2.8ms 2.6MB 2060ms 0ms rustc 1.66.0-nightly
rust 7-m.rs 1066ms 4.5ms 2.2MB 2060ms 0ms rustc 1.64.0
rust 8.rs 2063ms 3.3ms 2.5MB 2050ms 0ms rustc 1.66.0-nightly
rust 7.rs 2065ms 5.3ms 2.0MB 2050ms 0ms rustc 1.64.0
rust 2-m.rs 2151ms 4.0ms 2.1MB 4187ms 0ms rustc 1.64.0
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
rust 2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 275ms 0.4ms 0.7MB 507ms 3ms rustc 1.64.0
rust 8-m.rs 277ms 2.7ms 2.4MB 510ms 0ms rustc 1.66.0-nightly
rust 7.rs 517ms 0.3ms 0.6MB 507ms 0ms rustc 1.64.0
rust 8.rs 518ms 0.1ms 2.2MB 510ms 0ms rustc 1.66.0-nightly
rust 2-m.rs 545ms 0.6ms 2.1MB 1040ms 0ms rustc 1.64.0
crystal 1.cr 1510ms 2.5ms 5.8MB 1493ms 0ms crystal 1.5.1
rust 2.rs 1707ms 1.1ms 0.6MB 1697ms 0ms rustc 1.64.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 75ms 1.2ms 2.1MB 130ms 0ms rustc 1.64.0
rust 8-m.rs 77ms 3.5ms 2.2MB 123ms 0ms rustc 1.66.0-nightly
rust 8.rs 132ms 0.8ms 2.1MB 120ms 0ms rustc 1.66.0-nightly
rust 7.rs 132ms 0.8ms 0.6MB 120ms 0ms rustc 1.64.0
rust 2-m.rs 145ms 1.3ms 0.7MB 257ms 0ms rustc 1.64.0
crystal 1.cr 382ms 1.3ms 3.8MB 370ms 0ms crystal 1.5.1
rust 2.rs 429ms 0.2ms 0.6MB 420ms 0ms rustc 1.64.0