Programming Language and compiler
Benchmarks

Ruby VS Chapel benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1949ms 7.9ms 66.2MB 1943ms 0ms chpl 1.31.0
chapel 3.chpl 2033ms 5.5ms 66.3MB 2020ms 3ms chpl 1.31.0
ruby 1.rb 4697ms 14ms 109.5MB 4587ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 50ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 782.5MB 6640ms 683ms truffleruby 24.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 191ms 2.9ms 36.4MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 199ms 3.7ms 34.3MB 187ms 3ms chpl 1.31.0
ruby 1.rb 478ms 0.8ms 20.4MB 460ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 593ms 65ms 442.1MB 1223ms 143ms truffleruby 24.1.2
ruby 1.rb 945ms 11ms 19.6MB 920ms 13ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1399ms 20ms 63.9MB 1310ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1850ms 15ms 63.3MB 1773ms 60ms ruby 3.4.1
chapel 1-m.chpl 2257ms 56ms 518.0MB 4400ms 70ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 720.1MB 4753ms 1447ms truffleruby 24.1.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 160ms 5.4ms 25.8MB 120ms 27ms ruby/yjit 3.4.1
ruby 1.rb 181ms 4.2ms 25.1MB 147ms 20ms ruby 3.4.1
chapel 1-m.chpl 192ms 11ms 444.7MB 303ms 37ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 698.9MB 4753ms 1487ms truffleruby 24.1.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 112ms 0.7ms 32.4MB 187ms 3ms chpl 1.31.0
ruby 6.rb 2040ms 8.8ms 23.1MB 2023ms 0ms ruby/yjit 3.4.1
ruby 6-m.rb 2230ms 140ms 416.5MB 5760ms 373ms truffleruby 24.1.2
ruby 6.rb 3691ms 41ms 22.5MB 3663ms 13ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 29ms 0.2ms 32.4MB 23ms 0ms chpl 1.31.0
ruby 6.rb 281ms 27ms 15.2MB 257ms 10ms ruby/yjit 3.4.1
ruby 6.rb 424ms 3.1ms 14.5MB 403ms 3ms ruby 3.4.1
ruby 6-m.rb 803ms 10ms 383.2MB 1957ms 183ms truffleruby 24.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 16ms 0.5ms 32.8MB 7ms 3ms chpl 1.31.0
ruby 1.rb 39ms 0.6ms 162.9MB 12ms 28ms truffleruby 24.1.2
ruby 1.rb 52ms 1.6ms 13.3MB 34ms 6ms ruby/yjit 3.4.1
ruby 1.rb 54ms 1.5ms 12.9MB 40ms 2ms ruby 3.4.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 248ms 0.9ms 30.0MB 227ms 10ms ruby/yjit 3.4.1
ruby 1.rb 252ms 5.7ms 29.5MB 220ms 17ms ruby 3.4.1
ruby 1-m.rb 4601ms 279ms 548.8MB 12067ms 347ms truffleruby 24.1.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2071ms 5.8ms 133.2MB 1977ms 77ms ruby 3.4.1
ruby 1.rb 2092ms 22ms 132.9MB 2007ms 70ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 493.0MB 13207ms 337ms truffleruby 24.1.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 332ms 2.7ms 13.6MB 317ms 0ms ruby/yjit 3.4.1
ruby 1.rb 528ms 2.0ms 13.0MB 507ms 3ms ruby 3.4.1
ruby 1-m.rb 687ms 26ms 371.7MB 1250ms 123ms truffleruby 24.1.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 879ms 7.2ms 13.6MB 860ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 1238ms 26ms 415.6MB 1737ms 157ms truffleruby 24.1.2
ruby 1.rb 1475ms 7.8ms 13.0MB 1457ms 3ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 193ms 0.3ms 13.6MB 177ms 3ms ruby/yjit 3.4.1
ruby 1.rb 294ms 3.6ms 12.9MB 273ms 7ms ruby 3.4.1
ruby 1-m.rb 519ms 28ms 368.2MB 1017ms 127ms truffleruby 24.1.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4708ms 225ms 552.6MB 12003ms 397ms truffleruby 24.1.2
ruby 1.rb timeout 0.0ms 93.6MB 4947ms 40ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2277ms 144ms 640.9MB 5863ms 277ms truffleruby 24.1.2
ruby 1.rb 3244ms 3.3ms 38.4MB 3200ms 23ms ruby/yjit 3.4.1
ruby 1.rb 4268ms 4.5ms 37.6MB 4237ms 17ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 329ms 2.4ms 32.8MB 320ms 0ms chpl 1.31.0
ruby 2.rb 837ms 3.1ms 329.6MB 1080ms 117ms truffleruby 24.1.2
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 52ms 0.4ms 32.8MB 40ms 7ms chpl 1.31.0
ruby 2-m.rb 321ms 1.6ms 325.2MB 553ms 120ms truffleruby 24.1.2
ruby 2.rb 1057ms 1.2ms 13.6MB 1037ms 7ms ruby/yjit 3.4.1
ruby 2.rb 2773ms 54ms 12.9MB 2760ms 0ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 325.4MB 4850ms 137ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.0MB 4850ms 130ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 756.9MB 5047ms 177ms truffleruby 24.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1816ms 30ms 491.5MB 2583ms 167ms truffleruby 24.1.2
ruby 1.rb 3401ms 20ms 131.9MB 3310ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4444ms 10ms 131.1MB 4360ms 70ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.6ms 34.4MB 440ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.4MB 4927ms 60ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.6MB 4890ms 93ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 468.1MB 13257ms 403ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 121ms 1.3ms 34.4MB 113ms 0ms chpl 1.31.0
ruby 1.rb 1642ms 9.1ms 46.0MB 1593ms 33ms ruby 3.4.1
ruby 1.rb 1760ms 12ms 127.6MB 1617ms 130ms ruby/yjit 3.4.1
ruby 1-m.rb 1824ms 19ms 420.6MB 4793ms 207ms truffleruby 24.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1913ms 0.6ms 32.8MB 3787ms 0ms chpl 1.31.0
chapel 1.chpl 3715ms 5.7ms 32.8MB 3700ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 448.7MB 5180ms 220ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 497ms 2.2ms 32.9MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 945ms 2.0ms 32.8MB 937ms 0ms chpl 1.31.0
ruby 4.rb 4530ms 33ms 454.5MB 4833ms 187ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 10ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 140ms 2.4ms 32.9MB 247ms 0ms chpl 1.31.0
chapel 1.chpl 255ms 3.6ms 32.8MB 247ms 3ms chpl 1.31.0
ruby 4.rb 1303ms 67ms 435.1MB 1637ms 147ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 13.0MB 4977ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4977ms 10ms ruby/yjit 3.4.1