Programming Language and compiler
Benchmarks

Chapel VS Ruby benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1953ms 5.8ms 62.4MB 1947ms 0ms chpl 1.31.0
chapel 3.chpl 2034ms 5.7ms 62.3MB 2027ms 0ms chpl 1.31.0
ruby 1.rb 4679ms 84ms 150.6MB 4570ms 97ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 70.0MB 4950ms 40ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 780.8MB 6557ms 723ms truffleruby 24.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 184ms 0.5ms 32.3MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 189ms 2.4ms 32.3MB 183ms 0ms chpl 1.31.0
ruby 1.rb 481ms 3.0ms 20.3MB 460ms 10ms ruby/yjit 3.4.3
ruby 1-m.rb 537ms 62ms 414.1MB 1070ms 150ms truffleruby 24.2.1
ruby 1.rb 931ms 3.2ms 19.5MB 910ms 7ms ruby 3.4.3

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1461ms 14ms 63.8MB 1383ms 63ms ruby/yjit 3.4.3
ruby 1.rb 1891ms 53ms 63.0MB 1813ms 63ms ruby 3.4.3
chapel 1-m.chpl 2236ms 75ms 571.9MB 4350ms 80ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 342.0MB 4683ms 1473ms truffleruby 24.2.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 156ms 2.7ms 25.8MB 127ms 13ms ruby/yjit 3.4.3
ruby 1.rb 181ms 2.9ms 25.0MB 153ms 13ms ruby 3.4.3
chapel 1-m.chpl 193ms 3.2ms 540.5MB 307ms 50ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 351.9MB 4730ms 1453ms truffleruby 24.2.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 74ms 1.0ms 32.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 0.7ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 107ms 2.2ms 28.4MB 190ms 0ms chpl 1.31.0
ruby 6.rb 2030ms 11ms 23.0MB 2007ms 10ms ruby/yjit 3.4.3
ruby 6-m.rb 2048ms 68ms 387.2MB 5343ms 347ms truffleruby 24.2.1
ruby 6.rb 3729ms 21ms 22.4MB 3707ms 10ms ruby 3.4.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.7ms 28.4MB 20ms 0ms chpl 1.31.0
ruby 6.rb 257ms 3.2ms 15.0MB 240ms 7ms ruby/yjit 3.4.3
ruby 6.rb 431ms 3.1ms 14.4MB 410ms 7ms ruby 3.4.3
ruby 6-m.rb 771ms 87ms 365.8MB 1910ms 180ms truffleruby 24.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
ruby 1.rb 34ms 0.6ms 140.7MB 12ms 24ms truffleruby 24.2.1
ruby 1.rb 50ms 0.5ms 13.0MB 36ms 4ms ruby/yjit 3.4.3
ruby 1.rb 52ms 1.7ms 12.8MB 38ms 0ms ruby 3.4.3

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 751ms 2.2ms 85.0MB 1420ms 10ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 116ms 1.0ms 87.0MB 200ms 7ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 324ms 3.1ms 28.8MB 320ms 0ms chpl 1.31.0
ruby 2.rb 820ms 8.8ms 310.7MB 1043ms 117ms truffleruby 24.2.1
ruby 2.rb timeout 0.0ms 12.8MB 4987ms 3ms ruby 3.4.3
ruby 2.rb timeout 0.0ms 13.5MB 4983ms 0ms ruby/yjit 3.4.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 1.4ms 28.8MB 40ms 0ms chpl 1.31.0
ruby 2-m.rb 312ms 9.0ms 309.6MB 540ms 117ms truffleruby 24.2.1
ruby 2.rb 1025ms 2.6ms 13.5MB 1010ms 0ms ruby/yjit 3.4.3
ruby 2.rb 2856ms 28ms 12.8MB 2840ms 0ms ruby 3.4.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 448ms 1.7ms 30.4MB 440ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 130.2MB 4847ms 140ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 130.7MB 4873ms 113ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 461.2MB 13320ms 417ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 114ms 1.1ms 30.3MB 110ms 0ms chpl 1.31.0
ruby 1-m.rb 1612ms 177ms 390.8MB 4260ms 207ms truffleruby 24.2.1
ruby 1.rb 1803ms 20ms 131.0MB 1673ms 117ms ruby/yjit 3.4.3
ruby 1.rb 1805ms 5.0ms 130.1MB 1683ms 103ms ruby 3.4.3

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1396ms 9.5ms 220.2MB 1350ms 40ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 162ms 3.8ms 48.9MB 140ms 17ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1187ms 11ms 29.1MB 1183ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 307ms 3.0ms 29.0MB 303ms 0ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1928ms 23ms 28.9MB 3827ms 0ms chpl 1.31.0
chapel 1.chpl 3719ms 13ms 28.8MB 3713ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.3
ruby 4.rb timeout 0.0ms 412.4MB 5180ms 223ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 2.8ms 28.8MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 944ms 3.9ms 28.8MB 937ms 0ms chpl 1.31.0
ruby 4.rb 4838ms 9.1ms 424.1MB 5130ms 203ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.3

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 1.5ms 28.9MB 247ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 2.2ms 28.8MB 240ms 0ms chpl 1.31.0
ruby 4.rb 1417ms 19ms 373.9MB 1763ms 130ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.3