Programming Language and compiler
Benchmarks

Crystal VS Ruby benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1267ms 4.6ms 64.3MB 1247ms 7ms crystal 1.14.0
ruby 1-m.rb 4344ms 5.3ms 826.4MB 6090ms 430ms truffleruby 24.1.1
ruby 1.rb 4409ms 29ms 110.3MB 4317ms 80ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4953ms 33ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 102ms 0.9ms 11.1MB 90ms 0ms crystal 1.14.0
ruby 1.rb 455ms 2.2ms 20.4MB 437ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 553ms 55ms 431.2MB 1113ms 147ms truffleruby 24.1.1
ruby 1.rb 906ms 20ms 19.8MB 883ms 7ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1297ms 25ms 20.1MB 1213ms 63ms crystal 1.14.0
ruby 1.rb 1314ms 25ms 63.9MB 1223ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1787ms 48ms 63.1MB 1703ms 70ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 724.7MB 4503ms 1623ms truffleruby 24.1.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 69ms 2.7ms 7.5MB 47ms 10ms crystal 1.14.0
ruby 1.rb 146ms 0.8ms 25.6MB 120ms 13ms ruby/yjit 3.4.1
ruby 1.rb 171ms 2.8ms 25.3MB 137ms 27ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 721.5MB 4623ms 1523ms truffleruby 24.1.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 58ms 2.4ms 6.6MB 37ms 7ms crystal 1.14.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 21ms 0.3ms 5.4MB 10ms 0ms crystal 1.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2357ms 18ms 3.0MB 2343ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 195ms 0.7ms 3.0MB 190ms 0ms crystal 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 515ms 7.3ms 3.4MB 413ms 90ms crystal 1.14.0
crystal 1.cr 693ms 6.0ms 14.7MB 553ms 127ms crystal 1.14.0
ruby 6.rb 1932ms 6.9ms 23.1MB 1903ms 13ms ruby/yjit 3.4.1
ruby 6-m.rb 2232ms 278ms 405.0MB 5723ms 367ms truffleruby 24.1.1
ruby 6.rb 3470ms 35ms 22.4MB 3443ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 55ms 0.3ms 3.4MB 33ms 10ms crystal 1.14.0
crystal 1.cr 72ms 1.1ms 4.5MB 50ms 10ms crystal 1.14.0
ruby 6.rb 245ms 2.3ms 15.2MB 227ms 3ms ruby/yjit 3.4.1
ruby 6.rb 395ms 4.5ms 14.5MB 377ms 3ms ruby 3.4.1
ruby 6-m.rb 782ms 23ms 404.7MB 1910ms 177ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.0ms 0.1ms 3.0MB 0ms 0ms crystal 1.14.0
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2050ms 398ms 189.3MB 260ms 487ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1162ms 112ms 53.7MB 40ms 63ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 35ms 1.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 62ms 2.8ms 3.1MB 50ms 0ms crystal 1.14.0
ruby 1.rb 317ms 3.7ms 13.6MB 300ms 3ms ruby/yjit 3.4.1
ruby 1.rb 504ms 6.4ms 13.0MB 487ms 3ms ruby 3.4.1
ruby 1-m.rb 663ms 42ms 381.4MB 1143ms 123ms truffleruby 24.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 94ms 2.9ms 3.1MB 83ms 0ms crystal 1.14.0
crystal 1.cr 173ms 1.9ms 3.1MB 163ms 0ms crystal 1.14.0
ruby 1.rb 841ms 7.5ms 13.6MB 820ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 1156ms 5.6ms 420.8MB 1593ms 157ms truffleruby 24.1.1
ruby 1.rb 1442ms 62ms 13.0MB 1423ms 7ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 17ms 0.4ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 28ms 0.6ms 3.0MB 20ms 0ms crystal 1.14.0
ruby 1.rb 181ms 1.5ms 13.6MB 163ms 3ms ruby/yjit 3.4.1
ruby 1.rb 277ms 2.6ms 12.9MB 263ms 0ms ruby 3.4.1
ruby 1-m.rb 486ms 24ms 373.9MB 930ms 130ms truffleruby 24.1.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 300ms 7.0ms 9.2MB 287ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 16ms 0.1ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 756ms 9.3ms 81.6MB 727ms 13ms crystal 1.14.0
ruby 1-m.rb 4396ms 209ms 539.7MB 11230ms 353ms truffleruby 24.1.1
ruby 1.rb timeout 0.0ms 93.6MB 4950ms 37ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 149ms 3.4ms 22.3MB 133ms 0ms crystal 1.14.0
ruby 1-m.rb 2130ms 105ms 524.5MB 5493ms 237ms truffleruby 24.1.1
ruby 1.rb 3111ms 12ms 38.4MB 3073ms 20ms ruby/yjit 3.4.1
ruby 1.rb 4124ms 30ms 37.8MB 4083ms 23ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 327ms 5.3ms 3.4MB 313ms 0ms crystal 1.14.0
crystal 2.cr 327ms 8.1ms 3.4MB 313ms 0ms crystal 1.14.0
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 36ms 0.6ms 3.4MB 23ms 0ms crystal 1.14.0
crystal 1.cr 36ms 0.8ms 3.4MB 30ms 0ms crystal 1.14.0
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 327ms 5.2ms 8.4MB 313ms 0ms crystal 1.14.0
crystal 1.cr 348ms 6.2ms 43.1MB 337ms 0ms crystal 1.14.0
ruby 1.rb timeout 0.0ms 325.3MB 4843ms 140ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4863ms 123ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 785.4MB 5060ms 150ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 74ms 2.1ms 13.3MB 60ms 0ms crystal 1.14.0
crystal 2.cr 82ms 1.0ms 4.6MB 70ms 0ms crystal 1.14.0
ruby 1-m.rb 1601ms 15ms 491.7MB 2290ms 177ms truffleruby 24.1.1
ruby 1.rb 3191ms 32ms 131.9MB 3100ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4269ms 40ms 131.1MB 4180ms 73ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1879ms 34ms 6.5MB 1837ms 23ms crystal 1.14.0
ruby 1.rb timeout 0.0ms 46.6MB 4940ms 43ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.7MB 4900ms 83ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 465.7MB 13040ms 457ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 415ms 2.5ms 5.4MB 403ms 0ms crystal 1.14.0
ruby 1.rb 1574ms 13ms 46.1MB 1533ms 30ms ruby 3.4.1
ruby 1-m.rb 1703ms 16ms 424.0MB 4463ms 207ms truffleruby 24.1.1
ruby 1.rb 1721ms 12ms 124.3MB 1573ms 133ms ruby/yjit 3.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3700ms 16ms 4.6MB 3683ms 3ms crystal 1.14.0
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 933ms 19ms 4.5MB 923ms 0ms crystal 1.14.0
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 237ms 1.8ms 4.0MB 223ms 0ms crystal 1.14.0
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1