Programming Language and compiler
Benchmarks

Ruby VS Codon benchmarks

Current benchmark data was generated on Mon Apr 14 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 4815ms 21ms 109.4MB 4710ms 90ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 70.5MB 4953ms 37ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 758.8MB 6567ms 693ms truffleruby 24.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 492ms 5.0ms 20.4MB 467ms 10ms ruby/yjit 3.4.2
ruby 1-m.rb 537ms 66ms 418.7MB 1060ms 157ms truffleruby 24.2.0
ruby 1.rb 937ms 8.8ms 19.6MB 910ms 13ms ruby 3.4.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1460ms 7.9ms 63.8MB 1380ms 63ms ruby/yjit 3.4.2
ruby 1.rb 1856ms 18ms 63.1MB 1783ms 60ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 357.5MB 4680ms 1437ms truffleruby 24.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 155ms 0.2ms 25.8MB 127ms 17ms ruby/yjit 3.4.2
ruby 1.rb 180ms 0.8ms 25.1MB 150ms 17ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 332.3MB 4803ms 1357ms truffleruby 24.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2050ms 4.6ms 23.0MB 2020ms 13ms ruby/yjit 3.4.2
ruby 6-m.rb 2229ms 245ms 437.5MB 5773ms 363ms truffleruby 24.2.0
ruby 6.rb 3848ms 19ms 22.4MB 3823ms 13ms ruby 3.4.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 267ms 5.3ms 15.0MB 250ms 0ms ruby/yjit 3.4.2
ruby 6.rb 439ms 1.1ms 14.5MB 420ms 3ms ruby 3.4.2
ruby 6-m.rb 828ms 16ms 375.5MB 2057ms 180ms truffleruby 24.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 11ms 0.4ms 8.5MB 20ms 0ms codon 0.18.2
ruby 1.rb 35ms 0.5ms 141.8MB 14ms 24ms truffleruby 24.2.0
ruby 1.rb 51ms 1.1ms 12.9MB 38ms 0ms ruby 3.4.2
ruby 1.rb 53ms 1.6ms 13.1MB 38ms 2ms ruby/yjit 3.4.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 249ms 0.3ms 29.0MB 220ms 13ms ruby/yjit 3.4.2
ruby 1.rb 254ms 0.5ms 27.4MB 220ms 20ms ruby 3.4.2
ruby 1-m.rb 4445ms 295ms 567.1MB 11670ms 337ms truffleruby 24.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2093ms 6.5ms 135.0MB 2003ms 77ms ruby/yjit 3.4.2
ruby 1.rb 2093ms 7.0ms 134.5MB 2003ms 73ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 522.9MB 13260ms 347ms truffleruby 24.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 334ms 6.3ms 13.5MB 317ms 3ms ruby/yjit 3.4.2
ruby 1.rb 528ms 4.6ms 12.9MB 513ms 3ms ruby 3.4.2
ruby 1-m.rb 680ms 43ms 373.6MB 1197ms 137ms truffleruby 24.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 883ms 3.5ms 13.5MB 860ms 10ms ruby/yjit 3.4.2
ruby 1-m.rb 1207ms 46ms 407.2MB 1677ms 157ms truffleruby 24.2.0
ruby 1.rb 1475ms 9.5ms 13.0MB 1453ms 10ms ruby 3.4.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 192ms 1.4ms 13.5MB 177ms 7ms ruby/yjit 3.4.2
ruby 1.rb 294ms 2.8ms 12.9MB 280ms 3ms ruby 3.4.2
ruby 1-m.rb 515ms 15ms 357.6MB 1040ms 137ms truffleruby 24.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4155ms 538ms 542.6MB 10537ms 360ms truffleruby 24.2.0
ruby 1.rb timeout 0.0ms 93.6MB 4933ms 50ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 94.1MB 4943ms 40ms ruby/yjit 3.4.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2026ms 131ms 594.1MB 5157ms 270ms truffleruby 24.2.0
ruby 1.rb 3422ms 26ms 38.3MB 3383ms 23ms ruby/yjit 3.4.2
ruby 1.rb 4463ms 59ms 37.8MB 4427ms 27ms ruby 3.4.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 825ms 4.5ms 309.8MB 1053ms 117ms truffleruby 24.2.0
codon 1.py 1325ms 8.3ms 8.9MB 1637ms 0ms codon 0.18.2
ruby 2.rb timeout 0.0ms 12.9MB 4987ms 0ms ruby 3.4.2
ruby 2.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 186ms 16ms 8.8MB 493ms 0ms codon 0.18.2
ruby 2-m.rb 308ms 6.2ms 310.0MB 540ms 117ms truffleruby 24.2.0
ruby 2.rb 1062ms 3.2ms 13.5MB 1047ms 3ms ruby/yjit 3.4.2
ruby 2.rb 2806ms 75ms 12.9MB 2787ms 3ms ruby 3.4.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 439ms 1.9ms 47.6MB 740ms 3ms codon 0.18.2
codon 2.py 1566ms 35ms 100.8MB 1870ms 27ms codon 0.18.2
ruby 1.rb timeout 0.0ms 325.4MB 4860ms 130ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 327.0MB 4853ms 137ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 703.0MB 5090ms 140ms truffleruby 24.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 127ms 2.2ms 18.3MB 430ms 0ms codon 0.18.2
codon 2-m.py 396ms 4.4ms 27.2MB 707ms 3ms codon 0.18.2
ruby 1.rb 1725ms 19ms 476.7MB 2387ms 160ms truffleruby 24.2.0
ruby 1.rb 3412ms 46ms 131.8MB 3323ms 73ms ruby/yjit 3.4.2
ruby 1.rb 4494ms 36ms 131.1MB 4403ms 77ms ruby 3.4.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 46.6MB 4920ms 60ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 127.6MB 4830ms 157ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 437.3MB 13257ms 400ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1663ms 2.6ms 46.0MB 1623ms 27ms ruby 3.4.2
ruby 1.rb 1695ms 86ms 126.8MB 1620ms 60ms ruby/yjit 3.4.2
ruby 1-m.rb 1731ms 175ms 412.7MB 4540ms 227ms truffleruby 24.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 3ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 7ms ruby/yjit 3.4.2
ruby 4.rb timeout 0.0ms 434.6MB 5167ms 233ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4868ms 23ms 439.6MB 5153ms 217ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4987ms 3ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1435ms 5.1ms 375.6MB 1770ms 137ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 3ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.2