Programming Language and compiler
Benchmarks

Ruby VS Acton benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4344ms 5.3ms 826.4MB 6090ms 430ms truffleruby 24.1.1
ruby 1.rb 4409ms 29ms 110.3MB 4317ms 80ms ruby/yjit 3.4.1
acton 1.act timeout 0.0ms 68.8MB 5927ms 67ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 70.1MB 4953ms 33ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 455ms 2.2ms 20.4MB 437ms 3ms ruby/yjit 3.4.1
ruby 1-m.rb 553ms 55ms 431.2MB 1113ms 147ms truffleruby 24.1.1
acton 1.act 794ms 30ms 13.9MB 923ms 60ms actonc 0.24.1
ruby 1.rb 906ms 20ms 19.8MB 883ms 7ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1314ms 25ms 63.9MB 1223ms 70ms ruby/yjit 3.4.1
ruby 1.rb 1787ms 48ms 63.1MB 1703ms 70ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 724.7MB 4503ms 1623ms truffleruby 24.1.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 146ms 0.8ms 25.6MB 120ms 13ms ruby/yjit 3.4.1
ruby 1.rb 171ms 2.8ms 25.3MB 137ms 27ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 721.5MB 4623ms 1523ms truffleruby 24.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 1932ms 6.9ms 23.1MB 1903ms 13ms ruby/yjit 3.4.1
ruby 6-m.rb 2232ms 278ms 405.0MB 5723ms 367ms truffleruby 24.1.1
ruby 6.rb 3470ms 35ms 22.4MB 3443ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 245ms 2.3ms 15.2MB 227ms 3ms ruby/yjit 3.4.1
ruby 6.rb 395ms 4.5ms 14.5MB 377ms 3ms ruby 3.4.1
ruby 6-m.rb 782ms 23ms 404.7MB 1910ms 177ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 3.6ms 0.3ms 4.1MB 0ms 0ms actonc 0.24.1
ruby 1.rb 38ms 1.4ms 162.3MB 16ms 26ms truffleruby 24.1.1
ruby 1.rb 48ms 1.5ms 12.9MB 34ms 2ms ruby 3.4.1
ruby 1.rb 50ms 1.0ms 13.1MB 36ms 4ms ruby/yjit 3.4.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 233ms 2.1ms 30.2MB 207ms 13ms ruby/yjit 3.4.1
ruby 1.rb 239ms 6.8ms 28.5MB 203ms 27ms ruby 3.4.1
ruby 1-m.rb 4775ms 26ms 570.2MB 12360ms 407ms truffleruby 24.1.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1968ms 14ms 133.1MB 1873ms 80ms ruby 3.4.1
ruby 1.rb 1969ms 6.9ms 165.4MB 1863ms 90ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 545.5MB 13123ms 380ms truffleruby 24.1.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 317ms 3.7ms 13.6MB 300ms 3ms ruby/yjit 3.4.1
ruby 1.rb 504ms 6.4ms 13.0MB 487ms 3ms ruby 3.4.1
ruby 1-m.rb 663ms 42ms 381.4MB 1143ms 123ms truffleruby 24.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 841ms 7.5ms 13.6MB 820ms 7ms ruby/yjit 3.4.1
ruby 1-m.rb 1156ms 5.6ms 420.8MB 1593ms 157ms truffleruby 24.1.1
ruby 1.rb 1442ms 62ms 13.0MB 1423ms 7ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 181ms 1.5ms 13.6MB 163ms 3ms ruby/yjit 3.4.1
ruby 1.rb 277ms 2.6ms 12.9MB 263ms 0ms ruby 3.4.1
ruby 1-m.rb 486ms 24ms 373.9MB 930ms 130ms truffleruby 24.1.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 3058ms 12ms 101.9MB 3330ms 47ms actonc 0.24.1
ruby 1-m.rb 4396ms 209ms 539.7MB 11230ms 353ms truffleruby 24.1.1
ruby 1.rb timeout 0.0ms 93.6MB 4950ms 37ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.4MB 4930ms 53ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 676ms 47ms 32.3MB 707ms 20ms actonc 0.24.1
ruby 1-m.rb 2130ms 105ms 524.5MB 5493ms 237ms truffleruby 24.1.1
ruby 1.rb 3111ms 12ms 38.4MB 3073ms 20ms ruby/yjit 3.4.1
ruby 1.rb 4124ms 30ms 37.8MB 4083ms 23ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 801ms 6.0ms 328.7MB 1027ms 110ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2-m.rb 305ms 2.6ms 328.7MB 530ms 113ms truffleruby 24.1.1
ruby 2.rb 999ms 5.7ms 13.6MB 980ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2623ms 37ms 12.9MB 2607ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act timeout 0.0ms 561.0MB 6733ms 113ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 325.3MB 4843ms 140ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4863ms 123ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 785.4MB 5060ms 150ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1601ms 15ms 491.7MB 2290ms 177ms truffleruby 24.1.1
acton 1.act 2260ms 73ms 229.8MB 2830ms 30ms actonc 0.24.1
ruby 1.rb 3191ms 32ms 131.9MB 3100ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4269ms 40ms 131.1MB 4180ms 73ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 2853ms 97ms 8.6MB 2510ms 1970ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 46.6MB 4940ms 43ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 127.7MB 4900ms 83ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 465.7MB 13040ms 457ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 811ms 6.4ms 5.8MB 710ms 577ms actonc 0.24.1
ruby 1.rb 1574ms 13ms 46.1MB 1533ms 30ms ruby 3.4.1
ruby 1-m.rb 1703ms 16ms 424.0MB 4463ms 207ms truffleruby 24.1.1
ruby 1.rb 1721ms 12ms 124.3MB 1573ms 133ms ruby/yjit 3.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4983ms 3ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 452.3MB 5147ms 223ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4148ms 29ms 427.7MB 4383ms 190ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 0ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1193ms 53ms 393.2MB 1497ms 130ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4977ms 3ms ruby/yjit 3.4.1