Programming Language and compiler
Benchmarks

OCaml VS Ruby benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2855ms 30ms 132.4MB 2783ms 53ms ocaml 5.2.1
ruby 1-m.rb 4344ms 5.3ms 826.4MB 6090ms 430ms truffleruby 24.1.1
ruby 1.rb 4409ms 29ms 110.3MB 4317ms 80ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4953ms 33ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 205ms 3.3ms 19.1MB 187ms 0ms ocaml 5.2.1
ruby 1.rb 455ms 2.2ms 20.4MB 437ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 553ms 55ms 431.2MB 1113ms 147ms truffleruby 24.1.1
ruby 1.rb 906ms 20ms 19.8MB 883ms 7ms ruby 3.4.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2795ms 29ms 4.9MB 2783ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 234ms 2.1ms 4.9MB 223ms 0ms ocaml 5.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 329ms 3.1ms 24.9MB 313ms 0ms ocaml 5.2.1
ruby 6.rb 1932ms 6.9ms 23.1MB 1903ms 13ms ruby/yjit 3.4.1
ruby 6-m.rb 2232ms 278ms 405.0MB 5723ms 367ms truffleruby 24.1.1
ruby 6.rb 3470ms 35ms 22.4MB 3443ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 37ms 0.4ms 7.4MB 27ms 0ms ocaml 5.2.1
ruby 6.rb 245ms 2.3ms 15.2MB 227ms 3ms ruby/yjit 3.4.1
ruby 6.rb 395ms 4.5ms 14.5MB 377ms 3ms ruby 3.4.1
ruby 6-m.rb 782ms 23ms 404.7MB 1910ms 177ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.7ms 0.2ms 4.9MB 0ms 0ms ocaml 5.2.1
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 165ms 2.2ms 6.4MB 157ms 0ms ocaml 5.2.1
ruby 1.rb 317ms 3.7ms 13.6MB 300ms 3ms ruby/yjit 3.4.1
ruby 1.rb 504ms 6.4ms 13.0MB 487ms 3ms ruby 3.4.1
ruby 1-m.rb 663ms 42ms 381.4MB 1143ms 123ms truffleruby 24.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 496ms 9.3ms 6.6MB 483ms 0ms ocaml 5.2.1
ruby 1.rb 841ms 7.5ms 13.6MB 820ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 1156ms 5.6ms 420.8MB 1593ms 157ms truffleruby 24.1.1
ruby 1.rb 1442ms 62ms 13.0MB 1423ms 7ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 73ms 2.1ms 5.9MB 60ms 0ms ocaml 5.2.1
ruby 1.rb 181ms 1.5ms 13.6MB 163ms 3ms ruby/yjit 3.4.1
ruby 1.rb 277ms 2.6ms 12.9MB 263ms 0ms ruby 3.4.1
ruby 1-m.rb 486ms 24ms 373.9MB 930ms 130ms truffleruby 24.1.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1039ms 0.6ms 70.2MB 997ms 27ms ocaml 5.2.1
ocaml 2.ml 1948ms 8.6ms 91.8MB 1900ms 30ms ocaml 5.2.1
ruby 1-m.rb 4396ms 209ms 539.7MB 11230ms 353ms truffleruby 24.1.1
ruby 1.rb timeout 0.0ms 93.6MB 4950ms 37ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 143ms 1.0ms 21.7MB 130ms 3ms ocaml 5.2.1
ocaml 2.ml 342ms 3.9ms 27.7MB 317ms 7ms ocaml 5.2.1
ruby 1-m.rb 2130ms 105ms 524.5MB 5493ms 237ms truffleruby 24.1.1
ruby 1.rb 3111ms 12ms 38.4MB 3073ms 20ms ruby/yjit 3.4.1
ruby 1.rb 4124ms 30ms 37.8MB 4083ms 23ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 351ms 2.4ms 5.2MB 340ms 0ms ocaml 5.2.1
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 40ms 1.6ms 5.2MB 30ms 0ms ocaml 5.2.1
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 887ms 4.5ms 550.8MB 827ms 43ms ocaml 5.2.1
ocaml 2.ml 1822ms 17ms 18.6MB 1810ms 0ms ocaml 5.2.1
ruby 1.rb timeout 0.0ms 325.3MB 4843ms 140ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4863ms 123ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 785.4MB 5060ms 150ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 171ms 3.0ms 142.3MB 147ms 10ms ocaml 5.2.1
ocaml 2.ml 451ms 8.0ms 9.1MB 437ms 0ms ocaml 5.2.1
ruby 1-m.rb 1601ms 15ms 491.7MB 2290ms 177ms truffleruby 24.1.1
ruby 1.rb 3191ms 32ms 131.9MB 3100ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4269ms 40ms 131.1MB 4180ms 73ms ruby 3.4.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4814ms 25ms 484.9MB 4640ms 157ms ocaml 5.2.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 488ms 5.4ms 57.1MB 447ms 30ms ocaml 5.2.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4270ms 34ms 6.3MB 4260ms 0ms ocaml 5.2.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1068ms 1.5ms 5.9MB 1057ms 0ms ocaml 5.2.1
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 269ms 1.8ms 5.2MB 257ms 0ms ocaml 5.2.1
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1