Programming Language and compiler
Benchmarks

Ruby VS Chapel benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 2288ms 12ms 46.2MB 2260ms 7ms chpl 1.29.0
chapel 3.chpl 2449ms 12ms 46.2MB 2427ms 13ms chpl 1.29.0
ruby 1.rb timeout 0.0ms 72.6MB 4943ms 40ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 115.6MB 4917ms 60ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 612.7MB 8020ms 290ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 219ms 3.7ms 14.0MB 207ms 0ms chpl 1.29.0
chapel 3.chpl 226ms 0.3ms 14.0MB 220ms 0ms chpl 1.29.0
ruby 1.rb 565ms 6.7ms 40.7MB 530ms 17ms ruby/yjit 3.2.0
ruby 1.rb 1011ms 5.8ms 40.3MB 973ms 20ms ruby 3.2.0
ruby 1-m.rb 1081ms 25ms 419.3MB 1780ms 140ms truffleruby 22.3.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3205ms 134ms 82.8MB 3133ms 50ms ruby/yjit 3.2.0
ruby 1.rb 3867ms 456ms 82.1MB 3787ms 60ms ruby 3.2.0
chapel 1-m.chpl 3927ms 97ms 59.5MB 7640ms 30ms chpl 1.29.0
ruby 1.rb timeout 0.0ms 942.2MB 4210ms 1413ms truffleruby 22.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 231ms 3.0ms 44.9MB 190ms 27ms ruby/yjit 3.2.0
ruby 1.rb 240ms 0.5ms 44.5MB 203ms 20ms ruby 3.2.0
chapel 1-m.chpl 270ms 6.8ms 20.4MB 480ms 7ms chpl 1.29.0
ruby 1.rb timeout 0.0ms 908.0MB 4197ms 1183ms truffleruby 22.3.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 145ms 1.2ms 9.5MB 250ms 3ms chpl 1.29.0
ruby 6.rb 2359ms 2.6ms 43.6MB 2327ms 17ms ruby/yjit 3.2.0
ruby 6-m.rb 2687ms 54ms 389.5MB 4817ms 267ms truffleruby 22.3.1
ruby 6.rb 4361ms 91ms 43.0MB 4323ms 20ms ruby 3.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 28ms 0.9ms 10.6MB 23ms 0ms chpl 1.29.0
ruby 6.rb 313ms 1.0ms 34.9MB 287ms 13ms ruby/yjit 3.2.0
ruby 6.rb 502ms 1.2ms 34.4MB 467ms 20ms ruby 3.2.0
ruby 6-m.rb 887ms 40ms 341.9MB 1497ms 120ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 15ms 2.8ms 10.2MB 13ms 0ms chpl 1.29.0
ruby 1.rb 45ms 2.4ms 154.4MB 18ms 30ms truffleruby 22.3.1
ruby 1.rb 72ms 1.0ms 32.2MB 50ms 10ms ruby 3.2.0
ruby 1.rb 77ms 0.9ms 32.3MB 50ms 12ms ruby/yjit 3.2.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 440ms 2.6ms 52.9MB 400ms 23ms ruby 3.2.0
ruby 1.rb 461ms 9.3ms 54.5MB 410ms 30ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 465.4MB 9110ms 200ms truffleruby 22.3.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 4007ms 6.6ms 174.0MB 3903ms 87ms ruby/yjit 3.2.0
ruby 1.rb 4060ms 98ms 173.9MB 3957ms 90ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 432.6MB 9203ms 197ms truffleruby 22.3.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 448ms 2.7ms 33.0MB 420ms 13ms ruby/yjit 3.2.0
ruby 1.rb 602ms 5.0ms 32.3MB 580ms 3ms ruby 3.2.0
ruby 1-m.rb 832ms 33ms 335.1MB 1183ms 100ms truffleruby 22.3.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1183ms 7.0ms 33.0MB 1157ms 10ms ruby/yjit 3.2.0
ruby 1.rb 1478ms 87ms 370.8MB 1977ms 150ms truffleruby 22.3.1
ruby 1.rb 1648ms 12ms 32.4MB 1620ms 10ms ruby 3.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 264ms 2.9ms 32.9MB 233ms 13ms ruby/yjit 3.2.0
ruby 1.rb 334ms 3.9ms 32.3MB 307ms 17ms ruby 3.2.0
ruby 1-m.rb 619ms 11ms 311.7MB 913ms 103ms truffleruby 22.3.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 96.4MB 4933ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 97.0MB 4927ms 57ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 562.9MB 9010ms 220ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3464ms 95ms 580.1MB 6290ms 240ms truffleruby 22.3.1
ruby 1.rb 4125ms 19ms 53.7MB 4087ms 23ms ruby/yjit 3.2.0
ruby 1.rb 4936ms 27ms 52.7MB 4890ms 23ms ruby 3.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 374ms 1.0ms 2.6MB 363ms 0ms chpl 1.29.0
ruby 2.rb 1036ms 17ms 305.8MB 1233ms 93ms truffleruby 22.3.1
ruby 2.rb timeout 0.0ms 32.1MB 4977ms 7ms ruby 3.2.0
ruby 2.rb timeout 0.0ms 33.0MB 4973ms 10ms ruby/yjit 3.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 52ms 1.1ms 20.2MB 47ms 0ms chpl 1.29.0
ruby 2-m.rb 471ms 46ms 316.8MB 680ms 137ms truffleruby 22.3.1
ruby 2.rb 2176ms 4.7ms 33.0MB 2153ms 7ms ruby/yjit 3.2.0
ruby 2.rb 3381ms 35ms 32.3MB 3360ms 3ms ruby 3.2.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 344.6MB 4840ms 133ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 345.0MB 4827ms 150ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 685.1MB 5010ms 183ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3156ms 53ms 419.9MB 3677ms 137ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4920ms 53ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 151.5MB 4923ms 57ms ruby/yjit 3.2.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 593ms 3.5ms 4.1MB 577ms 3ms chpl 1.29.0
ruby 1.rb timeout 0.0ms 157.9MB 4937ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 159.9MB 4923ms 53ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 461.5MB 9333ms 257ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 147ms 0.9ms 3.8MB 140ms 0ms chpl 1.29.0
ruby 1-m.rb 2020ms 26ms 435.4MB 3657ms 173ms truffleruby 22.3.1
ruby 1.rb 2424ms 8.0ms 158.0MB 2343ms 63ms ruby 3.2.0
ruby 1.rb 2426ms 8.8ms 159.8MB 2343ms 67ms ruby/yjit 3.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2300ms 88ms 32.3MB 4430ms 7ms chpl 1.29.0
chapel 1.chpl 4374ms 2.3ms 32.4MB 4363ms 3ms chpl 1.29.0
ruby 4.rb timeout 0.0ms 32.1MB 4967ms 13ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 566.4MB 5240ms 247ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 0.8ms 32.3MB 1110ms 0ms chpl 1.29.0
chapel 1.chpl 1111ms 1.9ms 32.3MB 1100ms 0ms chpl 1.29.0
ruby 4.rb timeout 0.0ms 32.2MB 4973ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4973ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 562.1MB 5453ms 223ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 164ms 3.6ms 32.3MB 287ms 3ms chpl 1.29.0
chapel 1.chpl 297ms 1.7ms 32.3MB 287ms 0ms chpl 1.29.0
ruby 4.rb 2585ms 15ms 476.7MB 3107ms 167ms truffleruby 22.3.1
ruby 4.rb timeout 0.0ms 32.4MB 4967ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.7MB 4967ms 13ms ruby/yjit 3.2.0