Programming Language and compiler
Benchmarks

OCaml VS Ruby benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 4918ms 27ms 153.4MB 4853ms 47ms ocaml 5.0.0
ruby 1.rb timeout 0.0ms 72.6MB 4943ms 40ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 115.6MB 4917ms 60ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 612.7MB 8020ms 290ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 343ms 1.5ms 22.9MB 327ms 3ms ocaml 5.0.0
ruby 1.rb 565ms 6.7ms 40.7MB 530ms 17ms ruby/yjit 3.2.0
ruby 1.rb 1011ms 5.8ms 40.3MB 973ms 20ms ruby 3.2.0
ruby 1-m.rb 1081ms 25ms 419.3MB 1780ms 140ms truffleruby 22.3.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3975ms 4.3ms 2.8MB 3963ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 330ms 1.2ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 421ms 0.7ms 22.7MB 403ms 0ms ocaml 5.0.0
ruby 6.rb 2359ms 2.6ms 43.6MB 2327ms 17ms ruby/yjit 3.2.0
ruby 6-m.rb 2687ms 54ms 389.5MB 4817ms 267ms truffleruby 22.3.1
ruby 6.rb 4361ms 91ms 43.0MB 4323ms 20ms ruby 3.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 46ms 0.5ms 4.9MB 33ms 0ms ocaml 5.0.0
ruby 6.rb 313ms 1.0ms 34.9MB 287ms 13ms ruby/yjit 3.2.0
ruby 6.rb 502ms 1.2ms 34.4MB 467ms 20ms ruby 3.2.0
ruby 6-m.rb 887ms 40ms 341.9MB 1497ms 120ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.5ms 0.7ms 2.9MB 0ms 0ms ocaml 5.0.0
ruby 1.rb 45ms 2.4ms 154.4MB 18ms 30ms truffleruby 22.3.1
ruby 1.rb 72ms 1.0ms 32.2MB 50ms 10ms ruby 3.2.0
ruby 1.rb 77ms 0.9ms 32.3MB 50ms 12ms ruby/yjit 3.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 259ms 0.2ms 6.8MB 250ms 0ms ocaml 5.0.0
ruby 1.rb 448ms 2.7ms 33.0MB 420ms 13ms ruby/yjit 3.2.0
ruby 1.rb 602ms 5.0ms 32.3MB 580ms 3ms ruby 3.2.0
ruby 1-m.rb 832ms 33ms 335.1MB 1183ms 100ms truffleruby 22.3.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 769ms 4.3ms 6.8MB 757ms 0ms ocaml 5.0.0
ruby 1.rb 1183ms 7.0ms 33.0MB 1157ms 10ms ruby/yjit 3.2.0
ruby 1.rb 1478ms 87ms 370.8MB 1977ms 150ms truffleruby 22.3.1
ruby 1.rb 1648ms 12ms 32.4MB 1620ms 10ms ruby 3.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 115ms 0.5ms 5.9MB 107ms 0ms ocaml 5.0.0
ruby 1.rb 264ms 2.9ms 32.9MB 233ms 13ms ruby/yjit 3.2.0
ruby 1.rb 334ms 3.9ms 32.3MB 307ms 17ms ruby 3.2.0
ruby 1-m.rb 619ms 11ms 311.7MB 913ms 103ms truffleruby 22.3.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1528ms 14ms 69.1MB 1497ms 13ms ocaml 5.0.0
ocaml 2.ml 3201ms 10ms 74.3MB 3160ms 27ms ocaml 5.0.0
ruby 1.rb timeout 0.0ms 96.4MB 4933ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 97.0MB 4927ms 57ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 562.9MB 9010ms 220ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 223ms 0.9ms 25.6MB 207ms 3ms ocaml 5.0.0
ocaml 2.ml 572ms 3.4ms 30.1MB 550ms 3ms ocaml 5.0.0
ruby 1-m.rb 3464ms 95ms 580.1MB 6290ms 240ms truffleruby 22.3.1
ruby 1.rb 4125ms 19ms 53.7MB 4087ms 23ms ruby/yjit 3.2.0
ruby 1.rb 4936ms 27ms 52.7MB 4890ms 23ms ruby 3.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 468ms 0.1ms 3.0MB 460ms 0ms ocaml 5.0.0
ruby 2.rb 1036ms 17ms 305.8MB 1233ms 93ms truffleruby 22.3.1
ruby 2.rb timeout 0.0ms 32.1MB 4977ms 7ms ruby 3.2.0
ruby 2.rb timeout 0.0ms 33.0MB 4973ms 10ms ruby/yjit 3.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 1.2ms 2.9MB 40ms 0ms ocaml 5.0.0
ruby 2-m.rb 471ms 46ms 316.8MB 680ms 137ms truffleruby 22.3.1
ruby 2.rb 2176ms 4.7ms 33.0MB 2153ms 7ms ruby/yjit 3.2.0
ruby 2.rb 3381ms 35ms 32.3MB 3360ms 3ms ruby 3.2.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1942ms 9.7ms 550.6MB 1843ms 83ms ocaml 5.0.0
ocaml 2.ml 2416ms 46ms 19.0MB 2403ms 0ms ocaml 5.0.0
ruby 1.rb timeout 0.0ms 344.6MB 4840ms 133ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 345.0MB 4827ms 150ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 685.1MB 5010ms 183ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 354ms 17ms 140.4MB 323ms 13ms ocaml 5.0.0
ocaml 2.ml 602ms 21ms 9.1MB 583ms 0ms ocaml 5.0.0
ruby 1.rb 3156ms 53ms 419.9MB 3677ms 137ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4920ms 53ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 151.5MB 4923ms 57ms ruby/yjit 3.2.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 181.9MB 4913ms 67ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 715ms 2.1ms 52.5MB 687ms 13ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 4.2MB 4990ms 0ms ocaml 5.0.0
ruby 4.rb timeout 0.0ms 32.1MB 4967ms 13ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 566.4MB 5240ms 247ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1634ms 0.6ms 3.7MB 1620ms 0ms ocaml 5.0.0
ruby 4.rb timeout 0.0ms 32.2MB 4973ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4973ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 562.1MB 5453ms 223ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 412ms 0.8ms 3.4MB 400ms 0ms ocaml 5.0.0
ruby 4.rb 2585ms 15ms 476.7MB 3107ms 167ms truffleruby 22.3.1
ruby 4.rb timeout 0.0ms 32.4MB 4967ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.7MB 4967ms 13ms ruby/yjit 3.2.0