Programming Language and compiler
Benchmarks

Crystal VS Ruby benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1316ms 80ms 64.1MB 1290ms 10ms crystal 1.15.0
ruby 1.rb 4697ms 14ms 109.5MB 4587ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 50ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 782.5MB 6640ms 683ms truffleruby 24.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 9.3ms 10.9MB 100ms 0ms crystal 1.15.0
ruby 1.rb 478ms 0.8ms 20.4MB 460ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 593ms 65ms 442.1MB 1223ms 143ms truffleruby 24.1.2
ruby 1.rb 945ms 11ms 19.6MB 920ms 13ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1367ms 11ms 19.8MB 1300ms 50ms crystal 1.15.0
ruby 1.rb 1399ms 20ms 63.9MB 1310ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1850ms 15ms 63.3MB 1773ms 60ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 720.1MB 4753ms 1447ms truffleruby 24.1.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 76ms 1.4ms 7.1MB 57ms 7ms crystal 1.15.0
ruby 1.rb 160ms 5.4ms 25.8MB 120ms 27ms ruby/yjit 3.4.1
ruby 1.rb 181ms 4.2ms 25.1MB 147ms 20ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 698.9MB 4753ms 1487ms truffleruby 24.1.2

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 62ms 1.9ms 6.4MB 43ms 3ms crystal 1.15.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.6ms 5.1MB 10ms 0ms crystal 1.15.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2495ms 6.5ms 2.8MB 2483ms 0ms crystal 1.15.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 1.5ms 2.8MB 193ms 0ms crystal 1.15.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 573ms 3.5ms 3.5MB 450ms 107ms crystal 1.15.0
crystal 1.cr 720ms 0.6ms 14.6MB 573ms 127ms crystal 1.15.0
ruby 6.rb 2040ms 8.8ms 23.1MB 2023ms 0ms ruby/yjit 3.4.1
ruby 6-m.rb 2230ms 140ms 416.5MB 5760ms 373ms truffleruby 24.1.2
ruby 6.rb 3691ms 41ms 22.5MB 3663ms 13ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 61ms 1.2ms 3.5MB 43ms 7ms crystal 1.15.0
crystal 1.cr 76ms 0.8ms 4.9MB 53ms 7ms crystal 1.15.0
ruby 6.rb 281ms 27ms 15.2MB 257ms 10ms ruby/yjit 3.4.1
ruby 6.rb 424ms 3.1ms 14.5MB 403ms 3ms ruby 3.4.1
ruby 6-m.rb 803ms 10ms 383.2MB 1957ms 183ms truffleruby 24.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.2ms 2.9MB 0ms 0ms crystal 1.15.0
ruby 1.rb 39ms 0.6ms 162.9MB 12ms 28ms truffleruby 24.1.2
ruby 1.rb 52ms 1.6ms 13.3MB 34ms 6ms ruby/yjit 3.4.1
ruby 1.rb 54ms 1.5ms 12.9MB 40ms 2ms ruby 3.4.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2547ms 222ms 197.7MB 403ms 490ms crystal 1.15.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1102ms 0.9ms 36.6MB 47ms 77ms crystal 1.15.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.0ms 2.9MB 23ms 0ms crystal 1.15.0
crystal 1.cr 65ms 1.7ms 3.0MB 57ms 0ms crystal 1.15.0
ruby 1.rb 332ms 2.7ms 13.6MB 317ms 0ms ruby/yjit 3.4.1
ruby 1.rb 528ms 2.0ms 13.0MB 507ms 3ms ruby 3.4.1
ruby 1-m.rb 687ms 26ms 371.7MB 1250ms 123ms truffleruby 24.1.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 101ms 1.0ms 2.9MB 90ms 0ms crystal 1.15.0
crystal 1.cr 184ms 2.6ms 2.9MB 170ms 0ms crystal 1.15.0
ruby 1.rb 879ms 7.2ms 13.6MB 860ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 1238ms 26ms 415.6MB 1737ms 157ms truffleruby 24.1.2
ruby 1.rb 1475ms 7.8ms 13.0MB 1457ms 3ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 0.6ms 2.9MB 10ms 0ms crystal 1.15.0
crystal 1.cr 30ms 1.5ms 2.9MB 20ms 0ms crystal 1.15.0
ruby 1.rb 193ms 0.3ms 13.6MB 177ms 3ms ruby/yjit 3.4.1
ruby 1.rb 294ms 3.6ms 12.9MB 273ms 7ms ruby 3.4.1
ruby 1-m.rb 519ms 28ms 368.2MB 1017ms 127ms truffleruby 24.1.2

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 3.9ms 9.2MB 303ms 0ms crystal 1.15.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 5.8MB 10ms 0ms crystal 1.15.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 860ms 29ms 64.1MB 830ms 10ms crystal 1.15.0
ruby 1-m.rb 4708ms 225ms 552.6MB 12003ms 397ms truffleruby 24.1.2
ruby 1.rb timeout 0.0ms 93.6MB 4947ms 40ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 178ms 4.4ms 22.0MB 160ms 3ms crystal 1.15.0
ruby 1-m.rb 2277ms 144ms 640.9MB 5863ms 277ms truffleruby 24.1.2
ruby 1.rb 3244ms 3.3ms 38.4MB 3200ms 23ms ruby/yjit 3.4.1
ruby 1.rb 4268ms 4.5ms 37.6MB 4237ms 17ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 2.4ms 3.3MB 330ms 0ms crystal 1.15.0
crystal 2.cr 342ms 1.6ms 3.3MB 330ms 0ms crystal 1.15.0
ruby 2.rb 837ms 3.1ms 329.6MB 1080ms 117ms truffleruby 24.1.2
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.7ms 3.3MB 23ms 0ms crystal 1.15.0
crystal 1.cr 38ms 1.4ms 3.3MB 30ms 0ms crystal 1.15.0
ruby 2-m.rb 321ms 1.6ms 325.2MB 553ms 120ms truffleruby 24.1.2
ruby 2.rb 1057ms 1.2ms 13.6MB 1037ms 7ms ruby/yjit 3.4.1
ruby 2.rb 2773ms 54ms 12.9MB 2760ms 0ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 299ms 3.7ms 8.2MB 287ms 0ms crystal 1.15.0
crystal 1.cr 419ms 1.3ms 42.8MB 403ms 0ms crystal 1.15.0
ruby 1.rb timeout 0.0ms 325.4MB 4850ms 137ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.0MB 4850ms 130ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 756.9MB 5047ms 177ms truffleruby 24.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 75ms 1.4ms 4.4MB 67ms 0ms crystal 1.15.0
crystal 1.cr 89ms 2.6ms 13.0MB 77ms 0ms crystal 1.15.0
ruby 1-m.rb 1816ms 30ms 491.5MB 2583ms 167ms truffleruby 24.1.2
ruby 1.rb 3401ms 20ms 131.9MB 3310ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4444ms 10ms 131.1MB 4360ms 70ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1907ms 10ms 6.2MB 1877ms 13ms crystal 1.15.0
ruby 1.rb timeout 0.0ms 46.4MB 4927ms 60ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.6MB 4890ms 93ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 468.1MB 13257ms 403ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 449ms 18ms 5.1MB 430ms 0ms crystal 1.15.0
ruby 1.rb 1642ms 9.1ms 46.0MB 1593ms 33ms ruby 3.4.1
ruby 1.rb 1760ms 12ms 127.6MB 1617ms 130ms ruby/yjit 3.4.1
ruby 1-m.rb 1824ms 19ms 420.6MB 4793ms 207ms truffleruby 24.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3801ms 27ms 4.4MB 3787ms 0ms crystal 1.15.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 448.7MB 5180ms 220ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 955ms 2.5ms 4.3MB 943ms 0ms crystal 1.15.0
ruby 4.rb 4530ms 33ms 454.5MB 4833ms 187ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 10ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 245ms 2.9ms 3.8MB 237ms 0ms crystal 1.15.0
ruby 4.rb 1303ms 67ms 435.1MB 1637ms 147ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 13.0MB 4977ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4977ms 10ms ruby/yjit 3.4.1