Programming Language and compiler
Benchmarks

Chapel VS Ruby benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 4.chpl 1855ms 24ms 66.3MB 1843ms 3ms chpl 1.31.0
chapel 3.chpl 1925ms 21ms 66.3MB 1917ms 0ms chpl 1.31.0
ruby 1-m.rb 4344ms 5.3ms 826.4MB 6090ms 430ms truffleruby 24.1.1
ruby 1.rb 4409ms 29ms 110.3MB 4317ms 80ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 70.1MB 4953ms 33ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 183ms 2.0ms 36.3MB 173ms 0ms chpl 1.31.0
chapel 4.chpl 185ms 4.8ms 36.4MB 180ms 0ms chpl 1.31.0
ruby 1.rb 455ms 2.2ms 20.4MB 437ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 553ms 55ms 431.2MB 1113ms 147ms truffleruby 24.1.1
ruby 1.rb 906ms 20ms 19.8MB 883ms 7ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1314ms 25ms 63.9MB 1223ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1787ms 48ms 63.1MB 1703ms 70ms ruby 3.4.1
chapel 1-m.chpl 2149ms 35ms 527.8MB 4187ms 63ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 724.7MB 4503ms 1623ms truffleruby 24.1.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 146ms 0.8ms 25.6MB 120ms 13ms ruby/yjit 3.4.1
ruby 1.rb 171ms 2.8ms 25.3MB 137ms 27ms ruby 3.4.1
chapel 1-m.chpl 183ms 18ms 488.7MB 287ms 40ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 721.5MB 4623ms 1523ms truffleruby 24.1.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 75ms 2.3ms 36.4MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 38ms 0.3ms 34.5MB 27ms 7ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 110ms 2.4ms 32.4MB 183ms 3ms chpl 1.31.0
ruby 6.rb 1932ms 6.9ms 23.1MB 1903ms 13ms ruby/yjit 3.4.1
ruby 6-m.rb 2232ms 278ms 405.0MB 5723ms 367ms truffleruby 24.1.1
ruby 6.rb 3470ms 35ms 22.4MB 3443ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 27ms 0.7ms 32.4MB 23ms 0ms chpl 1.31.0
ruby 6.rb 245ms 2.3ms 15.2MB 227ms 3ms ruby/yjit 3.4.1
ruby 6.rb 395ms 4.5ms 14.5MB 377ms 3ms ruby 3.4.1
ruby 6-m.rb 782ms 23ms 404.7MB 1910ms 177ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 17ms 1.9ms 32.8MB 10ms 0ms chpl 1.31.0
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 719ms 7.0ms 102.9MB 1350ms 7ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 118ms 3.2ms 81.0MB 200ms 0ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 310ms 1.1ms 32.8MB 300ms 0ms chpl 1.31.0
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 49ms 1.1ms 32.9MB 43ms 0ms chpl 1.31.0
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 428ms 1.0ms 34.2MB 417ms 0ms chpl 1.31.0
ruby 1.rb timeout 0.0ms 46.6MB 4940ms 43ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.7MB 4900ms 83ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 465.7MB 13040ms 457ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 115ms 2.9ms 34.4MB 103ms 7ms chpl 1.31.0
ruby 1.rb 1574ms 13ms 46.1MB 1533ms 30ms ruby 3.4.1
ruby 1-m.rb 1703ms 16ms 424.0MB 4463ms 207ms truffleruby 24.1.1
ruby 1.rb 1721ms 12ms 124.3MB 1573ms 133ms ruby/yjit 3.4.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1315ms 8.8ms 224.1MB 1263ms 40ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 161ms 3.9ms 52.9MB 140ms 10ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1147ms 46ms 33.1MB 1137ms 0ms chpl 1.31.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 297ms 3.2ms 33.0MB 287ms 3ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1822ms 10.0ms 32.9MB 3613ms 0ms chpl 1.31.0
chapel 1.chpl 3541ms 31ms 32.8MB 3530ms 3ms chpl 1.31.0
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 467ms 2.3ms 32.8MB 897ms 3ms chpl 1.31.0
chapel 1.chpl 893ms 7.1ms 32.8MB 887ms 0ms chpl 1.31.0
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 132ms 0.7ms 32.8MB 230ms 0ms chpl 1.31.0
chapel 1.chpl 241ms 1.9ms 32.9MB 230ms 3ms chpl 1.31.0
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1