Programming Language and compiler
Benchmarks

OCaml VS Ruby benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 3017ms 20ms 150.6MB 2940ms 63ms ocaml 5.1.1
ruby 1.rb 4037ms 417ms 123.9MB 3920ms 100ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 85.3MB 4930ms 53ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 679.9MB 9080ms 607ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 222ms 2.9ms 18.8MB 203ms 3ms ocaml 5.1.1
ruby 1.rb 408ms 6.3ms 36.4MB 367ms 27ms ruby/yjit 3.3.0
ruby 1.rb 856ms 5.9ms 36.4MB 813ms 20ms ruby 3.3.0
ruby 1-m.rb 910ms 25ms 437.3MB 2027ms 183ms truffleruby 23.1.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2911ms 3.0ms 3.0MB 2897ms 0ms ocaml 5.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 2.5ms 3.0MB 233ms 0ms ocaml 5.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 0.3ms 22.7MB 330ms 3ms ocaml 5.1.1
ruby 6.rb 1457ms 11ms 39.1MB 1407ms 33ms ruby/yjit 3.3.0
ruby 6-m.rb 2178ms 87ms 420.2MB 5517ms 327ms truffleruby 23.1.2
ruby 6.rb 3794ms 10ms 37.6MB 3760ms 20ms ruby 3.3.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.7ms 5.4MB 27ms 0ms ocaml 5.1.1
ruby 6.rb 223ms 11ms 30.4MB 190ms 17ms ruby/yjit 3.3.0
ruby 6.rb 445ms 0.8ms 30.0MB 407ms 23ms ruby 3.3.0
ruby 6-m.rb 835ms 23ms 372.2MB 2033ms 187ms truffleruby 23.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.7ms 0.1ms 3.0MB 0ms 0ms ocaml 5.1.1
ruby 1.rb 41ms 0.2ms 161.9MB 8ms 32ms truffleruby 23.1.2
ruby 1.rb 70ms 2.0ms 28.3MB 46ms 12ms ruby 3.3.0
ruby 1.rb 72ms 1.8ms 28.4MB 46ms 16ms ruby/yjit 3.3.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 186ms 5.8ms 6.5MB 177ms 0ms ocaml 5.1.1
ruby 1.rb 335ms 1.4ms 28.6MB 307ms 13ms ruby/yjit 3.3.0
ruby 1.rb 536ms 12ms 28.4MB 503ms 20ms ruby 3.3.0
ruby 1-m.rb 658ms 38ms 365.9MB 1090ms 147ms truffleruby 23.1.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 540ms 18ms 6.4MB 527ms 0ms ocaml 5.1.1
ruby 1.rb 860ms 11ms 28.6MB 823ms 20ms ruby/yjit 3.3.0
ruby 1.rb 1229ms 22ms 408.0MB 1667ms 170ms truffleruby 23.1.2
ruby 1.rb 1440ms 9.3ms 28.3MB 1403ms 23ms ruby 3.3.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 79ms 1.6ms 6.0MB 70ms 0ms ocaml 5.1.1
ruby 1.rb 202ms 0.6ms 28.6MB 177ms 13ms ruby/yjit 3.3.0
ruby 1.rb 299ms 2.9ms 28.3MB 270ms 17ms ruby 3.3.0
ruby 1-m.rb 526ms 34ms 355.4MB 967ms 143ms truffleruby 23.1.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1178ms 8.6ms 74.8MB 1140ms 23ms ocaml 5.1.1
ocaml 2.ml 2124ms 11ms 85.5MB 2077ms 27ms ocaml 5.1.1
ruby 1.rb timeout 0.0ms 87.8MB 4917ms 73ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 88.2MB 4917ms 67ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 575.9MB 12800ms 437ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 153ms 1.9ms 23.1MB 133ms 0ms ocaml 5.1.1
ocaml 2.ml 371ms 4.0ms 24.9MB 347ms 7ms ocaml 5.1.1
ruby 1-m.rb 2642ms 152ms 618.4MB 6900ms 303ms truffleruby 23.1.2
ruby 1.rb 3031ms 1.4ms 46.8MB 2987ms 30ms ruby/yjit 3.3.0
ruby 1.rb 4013ms 75ms 46.5MB 3970ms 23ms ruby 3.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 373ms 3.1ms 3.3MB 360ms 0ms ocaml 5.1.1
ruby 2.rb 953ms 118ms 319.9MB 1190ms 110ms truffleruby 23.1.2
ruby 2.rb timeout 0.0ms 28.1MB 4967ms 17ms ruby 3.3.0
ruby 2.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 40ms 0.9ms 3.3MB 30ms 0ms ocaml 5.1.1
ruby 2-m.rb 319ms 5.4ms 312.4MB 540ms 113ms truffleruby 23.1.2
ruby 2.rb 1455ms 8.4ms 28.4MB 1423ms 17ms ruby/yjit 3.3.0
ruby 2.rb 2876ms 37ms 28.1MB 2840ms 20ms ruby 3.3.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 989ms 6.1ms 550.4MB 923ms 50ms ocaml 5.1.1
ocaml 2.ml 2043ms 6.1ms 18.5MB 2030ms 0ms ocaml 5.1.1
ruby 1.rb timeout 0.0ms 340.6MB 4840ms 150ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 342.0MB 4843ms 140ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 743.0MB 5043ms 167ms truffleruby 23.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 212ms 19ms 139.7MB 190ms 7ms ocaml 5.1.1
ocaml 2.ml 502ms 3.3ms 9.0MB 487ms 0ms ocaml 5.1.1
ruby 1-m.rb 1665ms 20ms 472.9MB 2357ms 177ms truffleruby 23.1.2
ruby 1.rb 3530ms 47ms 146.6MB 3423ms 87ms ruby/yjit 3.3.0
ruby 1.rb 4855ms 12ms 146.4MB 4753ms 83ms ruby 3.3.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 466.4MB 4807ms 173ms ocaml 5.1.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 554ms 9.9ms 57.1MB 520ms 17ms ocaml 5.1.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4552ms 0.3ms 4.4MB 4537ms 0ms ocaml 5.1.1
ruby 4.rb timeout 0.0ms 28.1MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 17ms ruby/yjit 3.3.0
ruby 4.rb timeout 0.0ms 527.7MB 5150ms 253ms truffleruby 23.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1148ms 4.4ms 4.0MB 1137ms 0ms ocaml 5.1.1
ruby 4.rb 4605ms 65ms 509.3MB 4857ms 220ms truffleruby 23.1.2
ruby 4.rb timeout 0.0ms 28.1MB 4967ms 20ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 296ms 9.9ms 3.4MB 287ms 0ms ocaml 5.1.1
ruby 4.rb 1257ms 60ms 358.6MB 1563ms 133ms truffleruby 23.1.2
ruby 4.rb timeout 0.0ms 28.3MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.4MB 4970ms 13ms ruby/yjit 3.3.0