Programming Language and compiler
Benchmarks

Chapel VS Ruby benchmarks

Current benchmark data was generated on Mon Mar 31 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1962ms 44ms 60.3MB 1950ms 0ms chpl 1.31.0
chapel 3.chpl 2019ms 12ms 60.3MB 2010ms 0ms chpl 1.31.0
ruby 1.rb 4874ms 16ms 109.4MB 4770ms 90ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 43ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 793.7MB 6597ms 650ms truffleruby 24.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 185ms 1.2ms 32.4MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 188ms 2.8ms 32.4MB 180ms 0ms chpl 1.31.0
ruby 1.rb 494ms 2.7ms 20.3MB 470ms 10ms ruby/yjit 3.4.2
ruby 1-m.rb 575ms 60ms 422.2MB 1147ms 167ms truffleruby 24.2.0
ruby 1.rb 937ms 6.7ms 19.6MB 910ms 13ms ruby 3.4.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1478ms 22ms 63.8MB 1397ms 67ms ruby/yjit 3.4.2
ruby 1.rb 1855ms 2.6ms 63.1MB 1780ms 60ms ruby 3.4.2
chapel 1-m.chpl 2192ms 58ms 470.2MB 4273ms 73ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 347.0MB 4763ms 1433ms truffleruby 24.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 159ms 1.0ms 25.6MB 127ms 17ms ruby/yjit 3.4.2
chapel 1-m.chpl 181ms 1.3ms 427.0MB 293ms 37ms chpl 1.31.0
ruby 1.rb 185ms 1.3ms 25.1MB 153ms 17ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 353.2MB 4600ms 1553ms truffleruby 24.2.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 71ms 3.7ms 32.4MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 32ms 1.2ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 104ms 1.2ms 28.4MB 190ms 0ms chpl 1.31.0
ruby 6.rb 2060ms 10ms 23.0MB 2030ms 13ms ruby/yjit 3.4.2
ruby 6-m.rb 2165ms 97ms 405.7MB 5593ms 363ms truffleruby 24.2.0
ruby 6.rb 3848ms 36ms 22.5MB 3820ms 10ms ruby 3.4.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 22ms 2.2ms 28.4MB 20ms 0ms chpl 1.31.0
ruby 6.rb 266ms 4.3ms 15.0MB 247ms 10ms ruby/yjit 3.4.2
ruby 6.rb 437ms 2.4ms 14.5MB 420ms 7ms ruby 3.4.2
ruby 6-m.rb 815ms 10ms 363.4MB 2020ms 177ms truffleruby 24.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
ruby 1.rb 35ms 0.4ms 142.2MB 14ms 28ms truffleruby 24.2.0
ruby 1.rb 52ms 3.5ms 12.9MB 34ms 2ms ruby 3.4.2
ruby 1.rb 53ms 0.9ms 13.0MB 34ms 6ms ruby/yjit 3.4.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 746ms 3.8ms 97.0MB 1413ms 10ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 112ms 0.7ms 76.9MB 197ms 3ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 319ms 3.7ms 28.8MB 313ms 0ms chpl 1.31.0
ruby 2.rb 830ms 8.7ms 322.7MB 1090ms 113ms truffleruby 24.2.0
ruby 2.rb timeout 0.0ms 12.9MB 4987ms 0ms ruby 3.4.2
ruby 2.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 0.9ms 28.9MB 40ms 0ms chpl 1.31.0
ruby 2-m.rb 310ms 2.6ms 310.1MB 543ms 113ms truffleruby 24.2.0
ruby 2.rb 1066ms 0.5ms 13.5MB 1047ms 3ms ruby/yjit 3.4.2
ruby 2.rb 2789ms 66ms 12.9MB 2773ms 0ms ruby 3.4.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 442ms 11ms 30.3MB 437ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.7MB 4923ms 67ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 126.8MB 4890ms 100ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 457.8MB 13330ms 427ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 113ms 0.5ms 30.4MB 110ms 0ms chpl 1.31.0
ruby 1-m.rb 1582ms 157ms 399.4MB 4173ms 207ms truffleruby 24.2.0
ruby 1.rb 1703ms 3.1ms 46.2MB 1657ms 33ms ruby 3.4.2
ruby 1.rb 1706ms 60ms 127.5MB 1643ms 50ms ruby/yjit 3.4.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1382ms 4.7ms 222.1MB 1337ms 37ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 159ms 3.1ms 48.9MB 140ms 10ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1172ms 4.9ms 29.2MB 1167ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 314ms 9.4ms 29.2MB 310ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1917ms 12ms 28.9MB 3807ms 0ms chpl 1.31.0
chapel 1.chpl 3719ms 32ms 28.8MB 3710ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.2
ruby 4.rb timeout 0.0ms 463.4MB 5177ms 250ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 489ms 4.6ms 29.0MB 953ms 0ms chpl 1.31.0
chapel 1.chpl 934ms 6.5ms 28.8MB 927ms 0ms chpl 1.31.0
ruby 4.rb 4892ms 24ms 472.1MB 5177ms 213ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 0ms ruby/yjit 3.4.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 2.1ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 248ms 6.1ms 28.8MB 243ms 0ms chpl 1.31.0
ruby 4.rb 1453ms 12ms 389.8MB 1777ms 143ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.8MB 4983ms 0ms ruby/yjit 3.4.2