Programming Language and compiler
Benchmarks

Rust VS Crystal benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 180ms 3.2ms 1.3MB 313ms 3ms rustc 1.63.0
rust 5-m.rs 206ms 1.1ms 1.3MB 370ms 0ms rustc 1.61.0
rust 1c.rs 234ms 0.2ms 0.7MB 227ms 0ms rustc 1.63.0
rust 1.rs 315ms 0.7ms 0.6MB 307ms 0ms rustc 1.61.0
crystal 2.cr 842ms 6.9ms 3.6MB 683ms 143ms crystal 1.4.1
crystal 1.cr 1030ms 0.5ms 14.8MB 857ms 160ms crystal 1.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 28ms 2.3ms 0.7MB 20ms 0ms rustc 1.63.0
rust 5c-m.rs 29ms 2.8ms 1.3MB 33ms 0ms rustc 1.63.0
rust 5-m.rs 29ms 1.4ms 1.3MB 33ms 0ms rustc 1.61.0
rust 1.rs 35ms 1.1ms 2.1MB 23ms 0ms rustc 1.61.0
crystal 2.cr 88ms 0.7ms 3.5MB 70ms 10ms crystal 1.4.1
crystal 1.cr 109ms 2.2ms 4.6MB 83ms 13ms crystal 1.4.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 2.1ms 1.0ms 0.6MB 0ms 0ms rustc 1.63.0
crystal 1.cr 3.0ms 0.6ms 3.0MB 0ms 0ms crystal 1.4.1
rust 1.rs 6.1ms 9.2ms 0.6MB 0ms 0ms rustc 1.61.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 415ms 1.0ms 5.0MB 403ms 0ms rustc 1.63.0
rust 8.rs 581ms 0.7ms 4.9MB 570ms 0ms rustc 1.61.0
crystal 1.cr 996ms 1.0ms 9.6MB 980ms 0ms crystal 1.4.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 21ms 0.6ms 2.1MB 10ms 0ms rustc 1.63.0
rust 8.rs 30ms 2.5ms 2.0MB 17ms 0ms rustc 1.61.0
crystal 1.cr 46ms 0.6ms 5.0MB 33ms 0ms crystal 1.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 253ms 0.8ms 0.6MB 240ms 0ms rustc 1.61.0
rust 7-i.rs 305ms 0.2ms 0.6MB 290ms 0ms rustc 1.61.0
rust 3.rs 319ms 0.2ms 0.6MB 310ms 0ms rustc 1.63.0
rust 2.rs 347ms 9.0ms 0.6MB 337ms 0ms rustc 1.61.0
rust 1.rs 390ms 11ms 0.6MB 377ms 0ms rustc 1.61.0
crystal 1.cr 510ms 0.8ms 3.1MB 500ms 0ms crystal 1.4.1
crystal 2.cr 540ms 0.7ms 3.1MB 530ms 0ms crystal 1.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 29ms 1.4ms 0.6MB 20ms 0ms rustc 1.61.0
rust 7-i.rs 33ms 1.1ms 0.6MB 23ms 0ms rustc 1.61.0
rust 3.rs 35ms 1.8ms 0.6MB 30ms 0ms rustc 1.63.0
rust 1.rs 42ms 1.4ms 0.6MB 30ms 0ms rustc 1.61.0
rust 2.rs 50ms 12ms 0.6MB 40ms 0ms rustc 1.61.0
crystal 1.cr 55ms 1.3ms 3.0MB 43ms 0ms crystal 1.4.1
crystal 2.cr 59ms 2.2ms 5.1MB 47ms 0ms crystal 1.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 1065ms 1.3ms 2.2MB 2063ms 0ms rustc 1.61.0
rust 8-m.rs 1067ms 3.9ms 2.3MB 2060ms 3ms rustc 1.63.0
rust 8.rs 2062ms 1.0ms 2.5MB 2050ms 0ms rustc 1.63.0
rust 7.rs 2063ms 0.4ms 2.1MB 2050ms 0ms rustc 1.61.0
rust 2-m.rs 2152ms 7.6ms 2.2MB 4170ms 3ms rustc 1.61.0
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.4.1
rust 2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.61.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 275ms 1.2ms 0.7MB 510ms 0ms rustc 1.61.0
rust 8-m.rs 275ms 1.1ms 2.2MB 507ms 0ms rustc 1.63.0
rust 8.rs 518ms 0.3ms 2.2MB 510ms 0ms rustc 1.63.0
rust 7.rs 518ms 0.9ms 0.6MB 510ms 0ms rustc 1.61.0
rust 2-m.rs 543ms 1.0ms 2.1MB 1033ms 0ms rustc 1.61.0
crystal 1.cr 1507ms 2.2ms 5.6MB 1497ms 0ms crystal 1.4.1
rust 2.rs 1704ms 0.1ms 0.6MB 1690ms 0ms rustc 1.61.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 76ms 0.9ms 2.2MB 127ms 0ms rustc 1.63.0
rust 7-m.rs 76ms 1.2ms 0.7MB 127ms 0ms rustc 1.61.0
rust 8.rs 132ms 1.4ms 2.1MB 120ms 0ms rustc 1.63.0
rust 7.rs 133ms 1.1ms 0.6MB 120ms 0ms rustc 1.61.0
rust 2-m.rs 144ms 0.6ms 0.7MB 257ms 0ms rustc 1.61.0
crystal 1.cr 381ms 1.5ms 3.8MB 367ms 0ms crystal 1.4.1
rust 2.rs 429ms 1.3ms 0.6MB 417ms 0ms rustc 1.61.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1614ms 6.4ms 64.4MB 1927ms 20ms crystal 1.4.1
rust 4.rs 1792ms 160ms 33.7MB 1770ms 7ms rustc 1.61.0
rust 3.rs 1864ms 18ms 49.8MB 1833ms 17ms rustc 1.61.0
rust 5.rs 2061ms 144ms 33.9MB 2040ms 3ms rustc 1.61.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 138ms 0.3ms 11.0MB 143ms 0ms crystal 1.4.1
rust 4.rs 155ms 13ms 5.8MB 140ms 0ms rustc 1.61.0
rust 5.rs 171ms 15ms 5.9MB 157ms 0ms rustc 1.61.0
rust 3.rs 182ms 1.8ms 7.8MB 170ms 0ms rustc 1.61.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 926ms 44ms 6.2MB 1777ms 27ms rustc 1.61.0
rust 5-m.rs 1068ms 96ms 5.5MB 2043ms 30ms rustc 1.61.0
rust 3.rs 1836ms 5.8ms 6.5MB 1803ms 13ms rustc 1.61.0
crystal 1.cr 1979ms 40ms 20.5MB 1940ms 23ms crystal 1.4.1
rust 1-m.rs 2854ms 48ms 5.6MB 5457ms 143ms rustc 1.61.0
rust 4.rs 3338ms 1.9ms 4.7MB 3330ms 0ms rustc 1.61.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 74ms 1.5ms 3.0MB 120ms 0ms rustc 1.61.0
rust 5-m.rs 94ms 26ms 3.2MB 153ms 3ms rustc 1.61.0
crystal 1.cr 111ms 1.9ms 7.6MB 97ms 3ms crystal 1.4.1
rust 3.rs 128ms 12ms 3.1MB 110ms 3ms rustc 1.61.0
rust 1-m.rs 203ms 7.2ms 2.8MB 353ms 20ms rustc 1.61.0
rust 4.rs 221ms 0.3ms 2.7MB 207ms 0ms rustc 1.61.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 84ms 3.2ms 9.3MB 67ms 3ms crystal 1.4.1
rust 1.rs 147ms 0.3ms 3.7MB 140ms 0ms rustc 1.61.0
rust 2.rs 585ms 1.3ms 3.8MB 570ms 0ms rustc 1.61.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 0.3ms 7.0MB 20ms 0ms crystal 1.4.1
rust 1.rs 41ms 0.9ms 3.0MB 30ms 0ms rustc 1.61.0
rust 2.rs 110ms 1.6ms 3.3MB 100ms 0ms rustc 1.61.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 726ms 2.1ms 0.7MB 1407ms 0ms rustc 1.61.0
rust 2-im.rs 1043ms 7.2ms 0.6MB 2010ms 0ms rustc 1.61.0
rust 5-m.rs 1222ms 14ms 0.7MB 2350ms 0ms rustc 1.61.0
rust 3-i.rs 1429ms 4.8ms 0.6MB 1417ms 0ms rustc 1.61.0
rust 2-i.rs 1865ms 8.9ms 0.6MB 1857ms 0ms rustc 1.61.0
rust 1-m.rs 2009ms 8.0ms 0.7MB 3873ms 0ms rustc 1.61.0
rust 1.rs 3709ms 24ms 0.6MB 3697ms 0ms rustc 1.61.0
crystal 1.cr 3816ms 3.5ms 3.0MB 3800ms 0ms crystal 1.4.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 67ms 0.7ms 0.7MB 110ms 0ms rustc 1.61.0
rust 2-im.rs 94ms 1.9ms 0.7MB 160ms 0ms rustc 1.61.0
rust 5-m.rs 112ms 0.6ms 0.7MB 190ms 0ms rustc 1.61.0
rust 3-i.rs 121ms 1.5ms 0.6MB 110ms 0ms rustc 1.61.0
rust 2-i.rs 156ms 1.3ms 0.6MB 147ms 0ms rustc 1.61.0
rust 1-m.rs 178ms 3.1ms 0.7MB 317ms 0ms rustc 1.61.0
crystal 1.cr 315ms 1.6ms 3.0MB 303ms 0ms crystal 1.4.1
rust 1.rs 326ms 12ms 0.6MB 317ms 0ms rustc 1.61.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 149ms 13ms 21.0MB 90ms 87ms rustc 1.61.0
rust 2-m.rs 470ms 50ms 114.0MB 220ms 500ms rustc 1.61.0
rust 1-http2.rs 915ms 119ms 87.8MB 1123ms 477ms rustc 1.61.0
crystal 1.cr 2833ms 1054ms 131.4MB 303ms 290ms crystal 1.4.1
rust 2-http2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.61.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 80ms 16ms 17.2MB 17ms 23ms rustc 1.61.0
rust 2.rs 132ms 11ms 27.9MB 37ms 87ms rustc 1.61.0
rust 1-http2.rs 404ms 19ms 32.1MB 583ms 120ms rustc 1.61.0
crystal 1.cr 1242ms 112ms 32.7MB 20ms 63ms crystal 1.4.1
rust 2-http2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.61.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3.rs 77ms 1.0ms 36.3MB 57ms 7ms rustc 1.61.0
rust 2.rs 77ms 1.7ms 38.1MB 53ms 7ms rustc 1.61.0
rust 1.rs 120ms 2.9ms 75.4MB 73ms 33ms rustc 1.61.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 496ms 0.9ms 258.4MB 383ms 97ms rustc 1.61.0
rust 3.rs 499ms 3.7ms 257.7MB 377ms 107ms rustc 1.61.0
rust 1.rs 828ms 1.8ms 605.3MB 583ms 227ms rustc 1.61.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 350ms 7.7ms 29.1MB 603ms 17ms rustc 1.61.0
rust 8.rs 615ms 8.3ms 23.2MB 593ms 10ms rustc 1.61.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 50ms 2.3ms 16.0MB 70ms 3ms rustc 1.61.0
rust 8.rs 76ms 0.9ms 11.6MB 57ms 3ms rustc 1.61.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 53ms 6.9ms 0.6MB 43ms 0ms rustc 1.61.0
crystal 0-unsafe.cr 63ms 2.1ms 5.0MB 50ms 0ms crystal 1.4.1
rust 1.rs 80ms 1.6ms 2.1MB 70ms 0ms rustc 1.61.0
crystal 1.cr 108ms 1.8ms 3.0MB 100ms 0ms crystal 1.4.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 175ms 1.0ms 3.0MB 163ms 0ms crystal 1.4.1
rust 0-unsafe.rs 208ms 2.4ms 0.6MB 200ms 0ms rustc 1.61.0
rust 1.rs 301ms 19ms 2.0MB 290ms 0ms rustc 1.61.0
crystal 1.cr 313ms 0.4ms 3.1MB 300ms 0ms crystal 1.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 32ms 2.1ms 3.1MB 20ms 0ms crystal 1.4.1
rust 0-unsafe.rs 36ms 2.1ms 0.6MB 23ms 0ms rustc 1.61.0
rust 1.rs 46ms 1.2ms 0.7MB 40ms 0ms rustc 1.61.0
crystal 1.cr 55ms 1.2ms 5.1MB 47ms 0ms crystal 1.4.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 927ms 16ms 33.8MB 903ms 7ms rustc 1.61.0
crystal 1.cr 1119ms 48ms 66.2MB 1287ms 13ms crystal 1.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 192ms 2.1ms 9.8MB 180ms 0ms rustc 1.61.0
crystal 1.cr 226ms 4.8ms 19.4MB 250ms 3ms crystal 1.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 465ms 0.8ms 6.5MB 450ms 0ms rustc 1.61.0
crystal 2.cr 466ms 1.2ms 10.1MB 450ms 0ms crystal 1.4.1
crystal 1.cr 878ms 62ms 44.5MB 853ms 10ms crystal 1.4.1
rust 1.rs 898ms 26ms 41.0MB 870ms 10ms rustc 1.61.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 108ms 1.9ms 3.1MB 100ms 0ms rustc 1.61.0
crystal 2.cr 108ms 1.9ms 4.4MB 100ms 0ms crystal 1.4.1
rust 1.rs 131ms 1.0ms 11.7MB 117ms 0ms rustc 1.61.0
crystal 1.cr 147ms 1.5ms 14.8MB 133ms 0ms crystal 1.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 1829ms 0.8ms 2.8MB 1750ms 67ms rustc 1.61.0
rust 1.rs 1829ms 0.7ms 2.9MB 1670ms 143ms rustc 1.61.0
crystal 1.cr 2771ms 83ms 6.8MB 3037ms 267ms crystal 1.4.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 390ms 0.6ms 2.6MB 373ms 0ms rustc 1.61.0
rust 2.rs 409ms 0.9ms 2.6MB 397ms 0ms rustc 1.61.0
crystal 1.cr 653ms 3.5ms 5.4MB 680ms 73ms crystal 1.4.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 564ms 4.9ms 77.1MB 713ms 20ms rustc 1.61.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 66ms 3.2ms 11.9MB 73ms 0ms rustc 1.61.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 146ms 0.7ms 0.6MB 140ms 0ms rustc 1.61.0
rust 1.rs 1857ms 16ms 0.7MB 1843ms 0ms rustc 1.61.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 39ms 0.9ms 0.7MB 30ms 0ms rustc 1.61.0
rust 1.rs 467ms 1.7ms 0.7MB 457ms 0ms rustc 1.61.0