Programming Language and compiler
Benchmarks

Chapel VS Ruby benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1604ms 2779ms 798.2MB 6547ms 637ms truffleruby 24.2.0
chapel 3.chpl 2069ms 6.5ms 60.3MB 2057ms 0ms chpl 1.31.0
chapel 4.chpl 2076ms 200ms 62.2MB 2063ms 3ms chpl 1.31.0
ruby 1.rb 4929ms 11ms 110.0MB 4830ms 87ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 70.6MB 4943ms 43ms ruby 3.4.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 188ms 1.6ms 32.2MB 180ms 0ms chpl 1.31.0
chapel 4.chpl 196ms 21ms 32.3MB 190ms 0ms chpl 1.31.0
ruby 1.rb 497ms 4.3ms 20.3MB 473ms 10ms ruby/yjit 3.4.2
ruby 1-m.rb 605ms 52ms 425.3MB 1203ms 173ms truffleruby 24.2.0
ruby 1.rb 935ms 7.2ms 19.6MB 910ms 10ms ruby 3.4.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1467ms 40ms 63.8MB 1387ms 63ms ruby/yjit 3.4.2
ruby 1.rb 1869ms 46ms 63.1MB 1790ms 63ms ruby 3.4.2
chapel 1-m.chpl 2266ms 93ms 525.8MB 4393ms 80ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 336.9MB 4703ms 1443ms truffleruby 24.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 160ms 2.1ms 25.6MB 123ms 20ms ruby/yjit 3.4.2
ruby 1.rb 180ms 2.8ms 25.1MB 150ms 20ms ruby 3.4.2
chapel 1-m.chpl 198ms 4.8ms 494.6MB 317ms 50ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 333.3MB 4763ms 1447ms truffleruby 24.2.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 73ms 2.7ms 32.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 1.3ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 106ms 1.8ms 28.3MB 190ms 0ms chpl 1.31.0
ruby 6.rb 2067ms 17ms 23.0MB 2040ms 13ms ruby/yjit 3.4.2
ruby 6-m.rb 2128ms 75ms 365.9MB 5427ms 350ms truffleruby 24.2.0
ruby 6.rb 3896ms 43ms 22.5MB 3870ms 17ms ruby 3.4.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.3ms 28.4MB 20ms 0ms chpl 1.31.0
ruby 6.rb 262ms 3.7ms 15.0MB 243ms 7ms ruby/yjit 3.4.2
ruby 6.rb 440ms 7.9ms 14.5MB 420ms 3ms ruby 3.4.2
ruby 6-m.rb 787ms 58ms 380.4MB 1943ms 177ms truffleruby 24.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
ruby 1.rb 38ms 1.6ms 142.2MB 14ms 28ms truffleruby 24.2.0
ruby 1.rb 52ms 1.2ms 12.9MB 38ms 4ms ruby 3.4.2
ruby 1.rb 54ms 2.1ms 13.0MB 40ms 2ms ruby/yjit 3.4.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 747ms 1.1ms 87.0MB 1410ms 10ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 116ms 0.5ms 87.0MB 200ms 3ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 326ms 5.3ms 28.9MB 317ms 0ms chpl 1.31.0
ruby 2.rb 846ms 5.3ms 311.6MB 1087ms 127ms truffleruby 24.2.0
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 7ms ruby 3.4.2
ruby 2.rb timeout 0.0ms 13.5MB 4987ms 0ms ruby/yjit 3.4.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 2.3ms 28.8MB 40ms 0ms chpl 1.31.0
ruby 2-m.rb 313ms 8.1ms 310.0MB 540ms 123ms truffleruby 24.2.0
ruby 2.rb 1065ms 2.9ms 13.5MB 1043ms 0ms ruby/yjit 3.4.2
ruby 2.rb 2836ms 76ms 12.9MB 2817ms 3ms ruby 3.4.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 446ms 2.3ms 28.4MB 440ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.7MB 4920ms 67ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 123.9MB 4887ms 100ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 457.3MB 13323ms 400ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 116ms 1.2ms 30.3MB 110ms 0ms chpl 1.31.0
ruby 1.rb 1685ms 6.0ms 46.0MB 1633ms 37ms ruby 3.4.2
ruby 1-m.rb 1729ms 252ms 405.1MB 4537ms 220ms truffleruby 24.2.0
ruby 1.rb 1798ms 0.8ms 127.8MB 1647ms 133ms ruby/yjit 3.4.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1399ms 7.7ms 222.1MB 1347ms 43ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 164ms 2.9ms 49.0MB 150ms 10ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1181ms 3.6ms 29.2MB 1177ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 308ms 2.9ms 29.0MB 303ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1928ms 19ms 28.8MB 3830ms 0ms chpl 1.31.0
chapel 1.chpl 3725ms 17ms 28.8MB 3720ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 3ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.2
ruby 4.rb timeout 0.0ms 454.8MB 5133ms 270ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 0.6ms 28.5MB 957ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 1.1ms 28.8MB 933ms 0ms chpl 1.31.0
ruby 4.rb 4888ms 24ms 442.4MB 5167ms 227ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 3ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 0ms ruby/yjit 3.4.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 135ms 1.0ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 2.4ms 28.8MB 240ms 0ms chpl 1.31.0
ruby 4.rb 1433ms 18ms 370.1MB 1793ms 130ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 7ms ruby/yjit 3.4.2