Programming Language and compiler
Benchmarks

Ruby VS Crystal benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1947ms 17ms 66.1MB 2307ms 23ms crystal 1.5.1
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 142ms 1.2ms 11.0MB 143ms 0ms crystal 1.5.1
ruby 1.rb 1035ms 3.3ms 292.0MB 857ms 163ms ruby/yjit 3.1.2
ruby 1.rb 1079ms 3.4ms 35.5MB 1033ms 27ms ruby 3.1.2
ruby 1-m.rb 1143ms 28ms 386.2MB 1847ms 157ms truffleruby 22.2.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2179ms 23ms 20.2MB 2120ms 43ms crystal 1.5.1
ruby 1.rb 3425ms 53ms 336.7MB 3213ms 193ms ruby/yjit 3.1.2
ruby 1.rb 4508ms 91ms 80.1MB 4427ms 60ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 127ms 2.5ms 9.6MB 107ms 3ms crystal 1.5.1
ruby 1.rb 290ms 3.0ms 42.2MB 250ms 20ms ruby 3.1.2
ruby 1.rb 428ms 4.6ms 298.7MB 273ms 137ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 764ms 1.8ms 3.6MB 660ms 93ms crystal 1.5.1
crystal 1.cr 1006ms 0.6ms 16.7MB 890ms 100ms crystal 1.5.1
ruby 6.rb 2890ms 6.9ms 295.3MB 2730ms 143ms ruby/yjit 3.1.2
ruby 6.rb 4559ms 42ms 39.4MB 4527ms 13ms ruby 3.1.2
ruby 6.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 82ms 0.5ms 5.5MB 60ms 7ms crystal 1.5.1
crystal 1.cr 105ms 0.7ms 4.6MB 87ms 3ms crystal 1.5.1
ruby 6.rb 517ms 5.9ms 31.1MB 490ms 13ms ruby 3.1.2
ruby 6.rb 530ms 2.3ms 287.7MB 373ms 137ms ruby/yjit 3.1.2
ruby 6-m.rb 1710ms 5.1ms 368.7MB 3030ms 150ms truffleruby 22.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 4.3ms 1.4ms 2.8MB 0ms 0ms crystal 1.5.1
ruby 1.rb 48ms 0.8ms 145.7MB 22ms 24ms truffleruby 22.2.0
ruby 1.rb 73ms 0.7ms 30.0MB 50ms 10ms ruby 3.1.2
ruby 1.rb 259ms 0.7ms 286.6MB 106ms 136ms ruby/yjit 3.1.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 448ms 12ms 48.7MB 413ms 10ms ruby 3.1.2
ruby 1.rb 627ms 2.2ms 305.0MB 440ms 167ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3913ms 2.7ms 162.4MB 3813ms 83ms ruby 3.1.2
ruby 1.rb 4091ms 3.2ms 419.6MB 3837ms 237ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 62ms 1.0ms 3.0MB 50ms 0ms crystal 1.5.1
crystal 1.cr 111ms 1.3ms 3.1MB 100ms 0ms crystal 1.5.1
ruby 1.rb 660ms 1.2ms 286.7MB 510ms 133ms ruby/yjit 3.1.2
ruby 1.rb 676ms 6.3ms 30.1MB 653ms 3ms ruby 3.1.2
ruby 1-m.rb 937ms 23ms 313.9MB 1377ms 110ms truffleruby 22.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 177ms 0.1ms 3.1MB 170ms 0ms crystal 1.5.1
crystal 1.cr 320ms 1.7ms 3.1MB 307ms 0ms crystal 1.5.1
ruby 1.rb 1460ms 4.2ms 286.7MB 1310ms 130ms ruby/yjit 3.1.2
ruby 1.rb 1804ms 16ms 343.9MB 2420ms 137ms truffleruby 22.2.0
ruby 1.rb 1879ms 3.5ms 30.2MB 1850ms 13ms ruby 3.1.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 30ms 0.4ms 2.9MB 20ms 0ms crystal 1.5.1
crystal 1.cr 56ms 0.8ms 3.1MB 50ms 0ms crystal 1.5.1
ruby 1.rb 373ms 2.8ms 29.8MB 353ms 7ms ruby 3.1.2
ruby 1.rb 459ms 1.0ms 286.7MB 297ms 143ms ruby/yjit 3.1.2
ruby 1-m.rb 646ms 3.5ms 299.9MB 960ms 113ms truffleruby 22.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1445ms 5.3ms 64.4MB 1670ms 37ms crystal 1.5.1
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 246ms 3.1ms 17.5MB 267ms 10ms crystal 1.5.1
ruby 1-m.rb 3686ms 45ms 554.1MB 6717ms 240ms truffleruby 22.2.0
ruby 1.rb 4073ms 11ms 300.7MB 3900ms 160ms ruby/yjit 3.1.2
ruby 1.rb 4835ms 18ms 44.4MB 4800ms 23ms ruby 3.1.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 594ms 1.5ms 4.8MB 577ms 0ms crystal 1.5.1
crystal 2.cr 623ms 0.7ms 3.0MB 610ms 0ms crystal 1.5.1
ruby 2.rb 1295ms 5.6ms 306.8MB 1593ms 117ms truffleruby 22.2.0
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 65ms 2.6ms 4.9MB 50ms 0ms crystal 1.5.1
crystal 2.cr 67ms 1.7ms 3.0MB 57ms 0ms crystal 1.5.1
ruby 2-m.rb 493ms 6.7ms 304.9MB 767ms 113ms truffleruby 22.2.0
ruby 2.rb 2395ms 10ms 286.8MB 2240ms 133ms ruby/yjit 3.1.2
ruby 2.rb 3243ms 20ms 29.9MB 3217ms 13ms ruby 3.1.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 428ms 1.0ms 9.9MB 417ms 0ms crystal 1.5.1
crystal 1.cr 1267ms 39ms 44.0MB 1243ms 7ms crystal 1.5.1
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 95ms 1.1ms 4.3MB 80ms 0ms crystal 1.5.1
crystal 1.cr 159ms 2.7ms 14.8MB 147ms 0ms crystal 1.5.1
ruby 1.rb 4157ms 8.2ms 458.8MB 4563ms 180ms truffleruby 22.2.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2816ms 90ms 8.7MB 3030ms 323ms crystal 1.5.1
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 654ms 9.8ms 5.4MB 687ms 73ms crystal 1.5.1
ruby 1-m.rb 2343ms 8.7ms 410.5MB 4263ms 187ms truffleruby 22.2.0
ruby 1.rb 2950ms 4.1ms 162.2MB 2857ms 77ms ruby 3.1.2
ruby 1.rb 3100ms 8.3ms 420.7MB 2860ms 223ms ruby/yjit 3.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1425ms 3.3ms 4.1MB 1410ms 0ms crystal 1.5.1
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 361ms 0.6ms 5.5MB 350ms 0ms crystal 1.5.1
ruby 4.rb 3041ms 38ms 368.9MB 3677ms 137ms truffleruby 22.2.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2