Programming Language and compiler
Benchmarks

Ruby VS Chapel benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1855ms 24ms 66.3MB 1843ms 3ms chpl 1.31.0
chapel 3.chpl 1925ms 21ms 66.3MB 1917ms 0ms chpl 1.31.0
ruby 1-m.rb 4344ms 5.3ms 826.4MB 6090ms 430ms truffleruby 24.1.1
ruby 1.rb 4409ms 29ms 110.3MB 4317ms 80ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4953ms 33ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 183ms 2.0ms 36.3MB 173ms 0ms chpl 1.31.0
chapel 4.chpl 185ms 4.8ms 36.4MB 180ms 0ms chpl 1.31.0
ruby 1.rb 455ms 2.2ms 20.4MB 437ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 553ms 55ms 431.2MB 1113ms 147ms truffleruby 24.1.1
ruby 1.rb 906ms 20ms 19.8MB 883ms 7ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1314ms 25ms 63.9MB 1223ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1787ms 48ms 63.1MB 1703ms 70ms ruby 3.4.1
chapel 1-m.chpl 2149ms 35ms 527.8MB 4187ms 63ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 724.7MB 4503ms 1623ms truffleruby 24.1.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 146ms 0.8ms 25.6MB 120ms 13ms ruby/yjit 3.4.1
ruby 1.rb 171ms 2.8ms 25.3MB 137ms 27ms ruby 3.4.1
chapel 1-m.chpl 183ms 18ms 488.7MB 287ms 40ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 721.5MB 4623ms 1523ms truffleruby 24.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 110ms 2.4ms 32.4MB 183ms 3ms chpl 1.31.0
ruby 6.rb 1932ms 6.9ms 23.1MB 1903ms 13ms ruby/yjit 3.4.1
ruby 6-m.rb 2232ms 278ms 405.0MB 5723ms 367ms truffleruby 24.1.1
ruby 6.rb 3470ms 35ms 22.4MB 3443ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 27ms 0.7ms 32.4MB 23ms 0ms chpl 1.31.0
ruby 6.rb 245ms 2.3ms 15.2MB 227ms 3ms ruby/yjit 3.4.1
ruby 6.rb 395ms 4.5ms 14.5MB 377ms 3ms ruby 3.4.1
ruby 6-m.rb 782ms 23ms 404.7MB 1910ms 177ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 17ms 1.9ms 32.8MB 10ms 0ms chpl 1.31.0
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 233ms 2.1ms 30.2MB 207ms 13ms ruby/yjit 3.4.1
ruby 1.rb 239ms 6.8ms 28.5MB 203ms 27ms ruby 3.4.1
ruby 1-m.rb 4775ms 26ms 570.2MB 12360ms 407ms truffleruby 24.1.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1968ms 14ms 133.1MB 1873ms 80ms ruby 3.4.1
ruby 1.rb 1969ms 6.9ms 165.4MB 1863ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 545.5MB 13123ms 380ms truffleruby 24.1.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 317ms 3.7ms 13.6MB 300ms 3ms ruby/yjit 3.4.1
ruby 1.rb 504ms 6.4ms 13.0MB 487ms 3ms ruby 3.4.1
ruby 1-m.rb 663ms 42ms 381.4MB 1143ms 123ms truffleruby 24.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 841ms 7.5ms 13.6MB 820ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 1156ms 5.6ms 420.8MB 1593ms 157ms truffleruby 24.1.1
ruby 1.rb 1442ms 62ms 13.0MB 1423ms 7ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 181ms 1.5ms 13.6MB 163ms 3ms ruby/yjit 3.4.1
ruby 1.rb 277ms 2.6ms 12.9MB 263ms 0ms ruby 3.4.1
ruby 1-m.rb 486ms 24ms 373.9MB 930ms 130ms truffleruby 24.1.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4396ms 209ms 539.7MB 11230ms 353ms truffleruby 24.1.1
ruby 1.rb timeout 0.0ms 93.6MB 4950ms 37ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2130ms 105ms 524.5MB 5493ms 237ms truffleruby 24.1.1
ruby 1.rb 3111ms 12ms 38.4MB 3073ms 20ms ruby/yjit 3.4.1
ruby 1.rb 4124ms 30ms 37.8MB 4083ms 23ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 310ms 1.1ms 32.8MB 300ms 0ms chpl 1.31.0
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 49ms 1.1ms 32.9MB 43ms 0ms chpl 1.31.0
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 325.3MB 4843ms 140ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4863ms 123ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 785.4MB 5060ms 150ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1601ms 15ms 491.7MB 2290ms 177ms truffleruby 24.1.1
ruby 1.rb 3191ms 32ms 131.9MB 3100ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4269ms 40ms 131.1MB 4180ms 73ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 428ms 1.0ms 34.2MB 417ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.6MB 4940ms 43ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.7MB 4900ms 83ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 465.7MB 13040ms 457ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 115ms 2.9ms 34.4MB 103ms 7ms chpl 1.31.0
ruby 1.rb 1574ms 13ms 46.1MB 1533ms 30ms ruby 3.4.1
ruby 1-m.rb 1703ms 16ms 424.0MB 4463ms 207ms truffleruby 24.1.1
ruby 1.rb 1721ms 12ms 124.3MB 1573ms 133ms ruby/yjit 3.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1822ms 10.0ms 32.9MB 3613ms 0ms chpl 1.31.0
chapel 1.chpl 3541ms 31ms 32.8MB 3530ms 3ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 467ms 2.3ms 32.8MB 897ms 3ms chpl 1.31.0
chapel 1.chpl 893ms 7.1ms 32.8MB 887ms 0ms chpl 1.31.0
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 132ms 0.7ms 32.8MB 230ms 0ms chpl 1.31.0
chapel 1.chpl 241ms 1.9ms 32.9MB 230ms 3ms chpl 1.31.0
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1