Programming Language and compiler
Benchmarks

OCaml VS Ruby benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2977ms 13ms 132.6MB 2900ms 60ms ocaml 5.3.0
ruby 1.rb 4697ms 14ms 109.5MB 4587ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 50ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 782.5MB 6640ms 683ms truffleruby 24.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 214ms 3.1ms 19.2MB 197ms 3ms ocaml 5.3.0
ruby 1.rb 478ms 0.8ms 20.4MB 460ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 593ms 65ms 442.1MB 1223ms 143ms truffleruby 24.1.2
ruby 1.rb 945ms 11ms 19.6MB 920ms 13ms ruby 3.4.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2911ms 3.1ms 4.9MB 2900ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 4.0ms 4.9MB 233ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 2.4ms 24.9MB 333ms 0ms ocaml 5.3.0
ruby 6.rb 2040ms 8.8ms 23.1MB 2023ms 0ms ruby/yjit 3.4.1
ruby 6-m.rb 2230ms 140ms 416.5MB 5760ms 373ms truffleruby 24.1.2
ruby 6.rb 3691ms 41ms 22.5MB 3663ms 13ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.2ms 7.5MB 23ms 0ms ocaml 5.3.0
ruby 6.rb 281ms 27ms 15.2MB 257ms 10ms ruby/yjit 3.4.1
ruby 6.rb 424ms 3.1ms 14.5MB 403ms 3ms ruby 3.4.1
ruby 6-m.rb 803ms 10ms 383.2MB 1957ms 183ms truffleruby 24.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.2ms 5.0MB 0ms 0ms ocaml 5.3.0
ruby 1.rb 39ms 0.6ms 162.9MB 12ms 28ms truffleruby 24.1.2
ruby 1.rb 52ms 1.6ms 13.3MB 34ms 6ms ruby/yjit 3.4.1
ruby 1.rb 54ms 1.5ms 12.9MB 40ms 2ms ruby 3.4.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 181ms 7.0ms 6.5MB 167ms 0ms ocaml 5.3.0
ruby 1.rb 332ms 2.7ms 13.6MB 317ms 0ms ruby/yjit 3.4.1
ruby 1.rb 528ms 2.0ms 13.0MB 507ms 3ms ruby 3.4.1
ruby 1-m.rb 687ms 26ms 371.7MB 1250ms 123ms truffleruby 24.1.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 540ms 16ms 6.6MB 527ms 0ms ocaml 5.3.0
ruby 1.rb 879ms 7.2ms 13.6MB 860ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 1238ms 26ms 415.6MB 1737ms 157ms truffleruby 24.1.2
ruby 1.rb 1475ms 7.8ms 13.0MB 1457ms 3ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 77ms 0.8ms 6.0MB 63ms 0ms ocaml 5.3.0
ruby 1.rb 193ms 0.3ms 13.6MB 177ms 3ms ruby/yjit 3.4.1
ruby 1.rb 294ms 3.6ms 12.9MB 273ms 7ms ruby 3.4.1
ruby 1-m.rb 519ms 28ms 368.2MB 1017ms 127ms truffleruby 24.1.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1060ms 22ms 71.2MB 1023ms 27ms ocaml 5.3.0
ocaml 2.ml 2025ms 10ms 91.8MB 1973ms 37ms ocaml 5.3.0
ruby 1-m.rb 4708ms 225ms 552.6MB 12003ms 397ms truffleruby 24.1.2
ruby 1.rb timeout 0.0ms 93.6MB 4947ms 40ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 148ms 2.0ms 21.6MB 133ms 0ms ocaml 5.3.0
ocaml 2.ml 352ms 1.6ms 27.7MB 327ms 7ms ocaml 5.3.0
ruby 1-m.rb 2277ms 144ms 640.9MB 5863ms 277ms truffleruby 24.1.2
ruby 1.rb 3244ms 3.3ms 38.4MB 3200ms 23ms ruby/yjit 3.4.1
ruby 1.rb 4268ms 4.5ms 37.6MB 4237ms 17ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 373ms 4.8ms 5.3MB 363ms 0ms ocaml 5.3.0
ruby 2.rb 837ms 3.1ms 329.6MB 1080ms 117ms truffleruby 24.1.2
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 40ms 0.1ms 5.3MB 30ms 0ms ocaml 5.3.0
ruby 2-m.rb 321ms 1.6ms 325.2MB 553ms 120ms truffleruby 24.1.2
ruby 2.rb 1057ms 1.2ms 13.6MB 1037ms 7ms ruby/yjit 3.4.1
ruby 2.rb 2773ms 54ms 12.9MB 2760ms 0ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 914ms 6.3ms 552.5MB 853ms 43ms ocaml 5.3.0
ocaml 2.ml 1875ms 8.7ms 18.6MB 1857ms 0ms ocaml 5.3.0
ruby 1.rb timeout 0.0ms 325.4MB 4850ms 137ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.0MB 4850ms 130ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 756.9MB 5047ms 177ms truffleruby 24.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 176ms 3.5ms 142.3MB 153ms 7ms ocaml 5.3.0
ocaml 2.ml 466ms 4.9ms 9.1MB 453ms 0ms ocaml 5.3.0
ruby 1-m.rb 1816ms 30ms 491.5MB 2583ms 167ms truffleruby 24.1.2
ruby 1.rb 3401ms 20ms 131.9MB 3310ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4444ms 10ms 131.1MB 4360ms 70ms ruby 3.4.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 484.8MB 4803ms 180ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 545ms 6.3ms 57.2MB 507ms 27ms ocaml 5.3.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4564ms 17ms 6.3MB 4553ms 0ms ocaml 5.3.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 448.7MB 5180ms 220ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1141ms 5.8ms 6.1MB 1130ms 0ms ocaml 5.3.0
ruby 4.rb 4530ms 33ms 454.5MB 4833ms 187ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 10ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 292ms 4.1ms 5.3MB 283ms 0ms ocaml 5.3.0
ruby 4.rb 1303ms 67ms 435.1MB 1637ms 147ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 13.0MB 4977ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4977ms 10ms ruby/yjit 3.4.1