Chapel VS Ruby benchmarks

Current benchmark data was generated on Mon May 19 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1952ms 9.9ms 62.3MB 1943ms 3ms chpl 1.31.0
chapel 3.chpl 2127ms 36ms 62.3MB 2120ms 0ms chpl 1.31.0
ruby 1-m.rb 4550ms 58ms 807.5MB 6423ms 470ms truffleruby 24.2.1
ruby 1.rb 4702ms 91ms 150.6MB 4603ms 87ms ruby/yjit 3.4.4
ruby 1.rb timeout 0.0ms 70.4MB 4947ms 40ms ruby 3.4.4

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 184ms 1.8ms 30.3MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 186ms 1.6ms 32.3MB 183ms 0ms chpl 1.31.0
ruby 1.rb 493ms 7.5ms 20.3MB 467ms 10ms ruby/yjit 3.4.4
ruby 1-m.rb 536ms 62ms 418.0MB 1057ms 167ms truffleruby 24.2.1
ruby 1.rb 939ms 7.1ms 19.5MB 917ms 13ms ruby 3.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1437ms 31ms 63.8MB 1357ms 67ms ruby/yjit 3.4.4
ruby 1.rb 1867ms 6.6ms 63.0MB 1790ms 63ms ruby 3.4.4
chapel 1-m.chpl 2280ms 43ms 659.8MB 4437ms 87ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 340.6MB 4643ms 1510ms truffleruby 24.2.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 152ms 2.8ms 25.8MB 120ms 20ms ruby/yjit 3.4.4
ruby 1.rb 181ms 2.5ms 25.0MB 147ms 17ms ruby 3.4.4
chapel 1-m.chpl 206ms 4.4ms 630.1MB 320ms 60ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 353.7MB 4770ms 1417ms truffleruby 24.2.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 71ms 1.6ms 32.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 33ms 3.0ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 105ms 0.9ms 28.4MB 190ms 0ms chpl 1.31.0
ruby 6.rb 2027ms 13ms 23.0MB 1997ms 10ms ruby/yjit 3.4.4
ruby 6-m.rb 2068ms 126ms 407.9MB 5310ms 330ms truffleruby 24.2.1
ruby 6.rb 3712ms 34ms 22.4MB 3683ms 13ms ruby 3.4.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 22ms 2.1ms 28.4MB 20ms 0ms chpl 1.31.0
ruby 6.rb 259ms 3.2ms 15.2MB 237ms 7ms ruby/yjit 3.4.4
ruby 6.rb 421ms 2.0ms 14.4MB 400ms 7ms ruby 3.4.4
ruby 6-m.rb 817ms 16ms 366.6MB 2047ms 163ms truffleruby 24.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.3ms 28.8MB 0ms 0ms chpl 1.31.0
ruby 1.rb 35ms 0.5ms 141.3MB 14ms 24ms truffleruby 24.2.1
ruby 1.rb 51ms 1.3ms 12.9MB 36ms 2ms ruby/yjit 3.4.4
ruby 1.rb 51ms 1.6ms 12.8MB 38ms 4ms ruby 3.4.4

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 749ms 3.1ms 86.9MB 1420ms 7ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 115ms 1.4ms 77.0MB 200ms 0ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 322ms 4.1ms 28.9MB 317ms 0ms chpl 1.31.0
ruby 2.rb 816ms 4.0ms 312.1MB 1050ms 113ms truffleruby 24.2.1
ruby 2.rb timeout 0.0ms 12.8MB 4987ms 0ms ruby 3.4.4
ruby 2.rb timeout 0.0ms 13.5MB 4980ms 7ms ruby/yjit 3.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 0.3ms 28.9MB 40ms 0ms chpl 1.31.0
ruby 2-m.rb 308ms 14ms 317.9MB 567ms 110ms truffleruby 24.2.1
ruby 2.rb 1025ms 1.2ms 13.5MB 1003ms 10ms ruby/yjit 3.4.4
ruby 2.rb 2921ms 95ms 12.8MB 2903ms 3ms ruby 3.4.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 445ms 2.1ms 30.4MB 440ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 130.1MB 4853ms 137ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 131.0MB 4833ms 157ms ruby/yjit 3.4.4
ruby 1.rb timeout 0.0ms 441.9MB 13307ms 403ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 115ms 0.6ms 30.4MB 110ms 0ms chpl 1.31.0
ruby 1.rb 1737ms 69ms 130.2MB 1657ms 63ms ruby 3.4.4
ruby 1-m.rb 1762ms 210ms 387.2MB 4653ms 207ms truffleruby 24.2.1
ruby 1.rb 1805ms 4.1ms 131.2MB 1680ms 113ms ruby/yjit 3.4.4

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1396ms 9.0ms 220.1MB 1353ms 37ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 163ms 2.2ms 48.9MB 140ms 13ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1184ms 16ms 29.1MB 1177ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 315ms 8.4ms 29.1MB 310ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1912ms 1.5ms 28.9MB 3800ms 0ms chpl 1.31.0
chapel 1.chpl 3730ms 9.2ms 28.8MB 3720ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.4
ruby 4.rb timeout 0.0ms 442.8MB 5163ms 247ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 1.7ms 28.8MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 3.7ms 28.8MB 933ms 0ms chpl 1.31.0
ruby 4.rb 4839ms 22ms 427.6MB 5120ms 207ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 0.9ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 249ms 2.0ms 28.8MB 243ms 0ms chpl 1.31.0
ruby 4.rb 1449ms 47ms 375.2MB 1810ms 133ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 0ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 7ms ruby/yjit 3.4.4