Programming Language and compiler
Benchmarks

Ruby VS Acton benchmarks

Current benchmark data was generated on Mon Dec 30 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4559ms 99ms 826.4MB 6440ms 460ms truffleruby 24.1.1
ruby 1.rb 4582ms 104ms 110.1MB 4487ms 73ms ruby/yjit 3.4.1
acton 1.act timeout 0.0ms 67.0MB 5963ms 77ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 70.5MB 4947ms 37ms ruby 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 478ms 0.9ms 20.4MB 450ms 20ms ruby/yjit 3.4.1
ruby 1-m.rb 600ms 8.2ms 437.8MB 1227ms 167ms truffleruby 24.1.1
acton 1.act 829ms 36ms 12.0MB 960ms 70ms actonc 0.24.1
ruby 1.rb 940ms 8.6ms 19.6MB 913ms 10ms ruby 3.4.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1426ms 6.5ms 63.9MB 1353ms 57ms ruby/yjit 3.4.1
ruby 1.rb 1877ms 44ms 63.1MB 1780ms 83ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 725.4MB 4653ms 1547ms truffleruby 24.1.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 155ms 1.0ms 25.8MB 123ms 17ms ruby/yjit 3.4.1
ruby 1.rb 178ms 2.1ms 25.1MB 143ms 17ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 741.3MB 4710ms 1493ms truffleruby 24.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2042ms 9.8ms 23.1MB 2013ms 10ms ruby/yjit 3.4.1
ruby 6-m.rb 2044ms 111ms 402.5MB 5243ms 363ms truffleruby 24.1.1
ruby 6.rb 3669ms 34ms 22.5MB 3643ms 10ms ruby 3.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 256ms 0.8ms 15.2MB 230ms 13ms ruby/yjit 3.4.1
ruby 6.rb 419ms 6.7ms 14.5MB 400ms 7ms ruby 3.4.1
ruby 6-m.rb 819ms 5.3ms 387.6MB 1987ms 200ms truffleruby 24.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 3.9ms 0.2ms 8.3MB 0ms 0ms actonc 0.24.1
ruby 1.rb 39ms 0.5ms 165.1MB 12ms 32ms truffleruby 24.1.1
ruby 1.rb 51ms 1.2ms 13.1MB 38ms 2ms ruby/yjit 3.4.1
ruby 1.rb 53ms 0.7ms 12.9MB 40ms 4ms ruby 3.4.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 247ms 1.2ms 28.6MB 217ms 20ms ruby 3.4.1
ruby 1.rb 250ms 5.0ms 31.1MB 217ms 17ms ruby/yjit 3.4.1
ruby 1-m.rb 4304ms 152ms 528.0MB 11207ms 323ms truffleruby 24.1.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2089ms 23ms 134.4MB 1993ms 80ms ruby 3.4.1
ruby 1.rb 2090ms 42ms 135.4MB 2010ms 67ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 595.9MB 13137ms 367ms truffleruby 24.1.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 330ms 1.9ms 13.6MB 307ms 10ms ruby/yjit 3.4.1
ruby 1.rb 537ms 2.5ms 13.0MB 523ms 3ms ruby 3.4.1
ruby 1-m.rb 717ms 35ms 391.9MB 1247ms 167ms truffleruby 24.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 882ms 5.3ms 13.6MB 853ms 17ms ruby/yjit 3.4.1
ruby 1-m.rb 1201ms 51ms 421.0MB 1657ms 177ms truffleruby 24.1.1
ruby 1.rb 1493ms 8.9ms 12.9MB 1473ms 7ms ruby 3.4.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 196ms 4.3ms 13.5MB 177ms 3ms ruby/yjit 3.4.1
ruby 1.rb 292ms 5.8ms 12.9MB 273ms 0ms ruby 3.4.1
ruby 1-m.rb 515ms 25ms 371.7MB 1013ms 110ms truffleruby 24.1.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 3310ms 185ms 101.9MB 3583ms 63ms actonc 0.24.1
ruby 1-m.rb 4577ms 143ms 578.9MB 11673ms 380ms truffleruby 24.1.1
ruby 1.rb timeout 0.0ms 94.0MB 4940ms 40ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 97.5MB 4920ms 63ms ruby/yjit 3.4.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 699ms 28ms 30.4MB 727ms 37ms actonc 0.24.1
ruby 1-m.rb 2187ms 101ms 525.8MB 5677ms 230ms truffleruby 24.1.1
ruby 1.rb 3238ms 7.5ms 38.4MB 3203ms 17ms ruby/yjit 3.4.1
ruby 1.rb 4306ms 3.3ms 37.8MB 4267ms 23ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 835ms 6.7ms 327.0MB 1073ms 117ms truffleruby 24.1.1
ruby 2.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2-m.rb 322ms 4.0ms 333.7MB 590ms 100ms truffleruby 24.1.1
ruby 2.rb 1053ms 5.8ms 13.6MB 1037ms 3ms ruby/yjit 3.4.1
ruby 2.rb 2816ms 74ms 12.9MB 2800ms 3ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act timeout 0.0ms 562.9MB 6753ms 110ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 325.4MB 4850ms 133ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.1MB 4843ms 133ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 762.9MB 5063ms 167ms truffleruby 24.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1740ms 47ms 486.8MB 2463ms 153ms truffleruby 24.1.1
acton 1.act 2333ms 30ms 192.4MB 2833ms 50ms actonc 0.24.1
ruby 1.rb 3441ms 129ms 131.9MB 3357ms 70ms ruby/yjit 3.4.1
ruby 1.rb 4493ms 12ms 131.1MB 4407ms 73ms ruby 3.4.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 3082ms 51ms 6.6MB 2720ms 2220ms actonc 0.24.1
ruby 1.rb timeout 0.0ms 46.5MB 4910ms 77ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 47.2MB 4937ms 47ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 467.9MB 13150ms 400ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1-m.act 868ms 22ms 5.6MB 723ms 653ms actonc 0.24.1
ruby 1.rb 1638ms 12ms 46.1MB 1587ms 37ms ruby 3.4.1
ruby 1.rb 1713ms 72ms 127.8MB 1603ms 93ms ruby/yjit 3.4.1
ruby 1-m.rb 1790ms 18ms 406.6MB 4713ms 200ms truffleruby 24.1.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 3ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 7ms ruby/yjit 3.4.1
ruby 4.rb timeout 0.0ms 467.6MB 5170ms 207ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4492ms 21ms 467.4MB 4820ms 187ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 3ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.6MB 4973ms 13ms ruby/yjit 3.4.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1289ms 48ms 390.0MB 1640ms 137ms truffleruby 24.1.1
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 7ms ruby 3.4.1
ruby 4.rb timeout 0.0ms 13.9MB 4980ms 3ms ruby/yjit 3.4.1