Programming Language and compiler
Benchmarks

Chapel VS Ruby benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1949ms 7.9ms 66.2MB 1943ms 0ms chpl 1.31.0
chapel 3.chpl 2033ms 5.5ms 66.3MB 2020ms 3ms chpl 1.31.0
ruby 1.rb 4697ms 14ms 109.5MB 4587ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 50ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 782.5MB 6640ms 683ms truffleruby 24.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 191ms 2.9ms 36.4MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 199ms 3.7ms 34.3MB 187ms 3ms chpl 1.31.0
ruby 1.rb 478ms 0.8ms 20.4MB 460ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 593ms 65ms 442.1MB 1223ms 143ms truffleruby 24.1.2
ruby 1.rb 945ms 11ms 19.6MB 920ms 13ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1399ms 20ms 63.9MB 1310ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1850ms 15ms 63.3MB 1773ms 60ms ruby 3.4.1
chapel 1-m.chpl 2257ms 56ms 518.0MB 4400ms 70ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 720.1MB 4753ms 1447ms truffleruby 24.1.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 160ms 5.4ms 25.8MB 120ms 27ms ruby/yjit 3.4.1
ruby 1.rb 181ms 4.2ms 25.1MB 147ms 20ms ruby 3.4.1
chapel 1-m.chpl 192ms 11ms 444.7MB 303ms 37ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 698.9MB 4753ms 1487ms truffleruby 24.1.2

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 80ms 0.6ms 36.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 40ms 0.2ms 34.5MB 33ms 3ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 112ms 0.7ms 32.4MB 187ms 3ms chpl 1.31.0
ruby 6.rb 2040ms 8.8ms 23.1MB 2023ms 0ms ruby/yjit 3.4.1
ruby 6-m.rb 2230ms 140ms 416.5MB 5760ms 373ms truffleruby 24.1.2
ruby 6.rb 3691ms 41ms 22.5MB 3663ms 13ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 29ms 0.2ms 32.4MB 23ms 0ms chpl 1.31.0
ruby 6.rb 281ms 27ms 15.2MB 257ms 10ms ruby/yjit 3.4.1
ruby 6.rb 424ms 3.1ms 14.5MB 403ms 3ms ruby 3.4.1
ruby 6-m.rb 803ms 10ms 383.2MB 1957ms 183ms truffleruby 24.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 16ms 0.5ms 32.8MB 7ms 3ms chpl 1.31.0
ruby 1.rb 39ms 0.6ms 162.9MB 12ms 28ms truffleruby 24.1.2
ruby 1.rb 52ms 1.6ms 13.3MB 34ms 6ms ruby/yjit 3.4.1
ruby 1.rb 54ms 1.5ms 12.9MB 40ms 2ms ruby 3.4.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 750ms 2.0ms 101.0MB 1407ms 10ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 122ms 1.7ms 81.1MB 197ms 10ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 329ms 2.4ms 32.8MB 320ms 0ms chpl 1.31.0
ruby 2.rb 837ms 3.1ms 329.6MB 1080ms 117ms truffleruby 24.1.2
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 52ms 0.4ms 32.8MB 40ms 7ms chpl 1.31.0
ruby 2-m.rb 321ms 1.6ms 325.2MB 553ms 120ms truffleruby 24.1.2
ruby 2.rb 1057ms 1.2ms 13.6MB 1037ms 7ms ruby/yjit 3.4.1
ruby 2.rb 2773ms 54ms 12.9MB 2760ms 0ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.6ms 34.4MB 440ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.4MB 4927ms 60ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.6MB 4890ms 93ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 468.1MB 13257ms 403ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 121ms 1.3ms 34.4MB 113ms 0ms chpl 1.31.0
ruby 1.rb 1642ms 9.1ms 46.0MB 1593ms 33ms ruby 3.4.1
ruby 1.rb 1760ms 12ms 127.6MB 1617ms 130ms ruby/yjit 3.4.1
ruby 1-m.rb 1824ms 19ms 420.6MB 4793ms 207ms truffleruby 24.1.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1392ms 7.7ms 224.2MB 1343ms 37ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 168ms 1.8ms 52.9MB 153ms 7ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1187ms 3.1ms 33.1MB 1177ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 318ms 2.7ms 33.1MB 307ms 3ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1913ms 0.6ms 32.8MB 3787ms 0ms chpl 1.31.0
chapel 1.chpl 3715ms 5.7ms 32.8MB 3700ms 0ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 448.7MB 5180ms 220ms truffleruby 24.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 497ms 2.2ms 32.9MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 945ms 2.0ms 32.8MB 937ms 0ms chpl 1.31.0
ruby 4.rb 4530ms 33ms 454.5MB 4833ms 187ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 10ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 140ms 2.4ms 32.9MB 247ms 0ms chpl 1.31.0
chapel 1.chpl 255ms 3.6ms 32.8MB 247ms 3ms chpl 1.31.0
ruby 4.rb 1303ms 67ms 435.1MB 1637ms 147ms truffleruby 24.1.2
ruby 4.rb timeout 0.0ms 13.0MB 4977ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4977ms 10ms ruby/yjit 3.4.1