Programming Language and compiler
Benchmarks

Ruby VS Codon benchmarks

Current benchmark data was generated on Mon Mar 31 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 4874ms 16ms 109.4MB 4770ms 90ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 70.1MB 4937ms 43ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 793.7MB 6597ms 650ms truffleruby 24.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 494ms 2.7ms 20.3MB 470ms 10ms ruby/yjit 3.4.2
ruby 1-m.rb 575ms 60ms 422.2MB 1147ms 167ms truffleruby 24.2.0
ruby 1.rb 937ms 6.7ms 19.6MB 910ms 13ms ruby 3.4.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1478ms 22ms 63.8MB 1397ms 67ms ruby/yjit 3.4.2
ruby 1.rb 1855ms 2.6ms 63.1MB 1780ms 60ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 347.0MB 4763ms 1433ms truffleruby 24.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 159ms 1.0ms 25.6MB 127ms 17ms ruby/yjit 3.4.2
ruby 1.rb 185ms 1.3ms 25.1MB 153ms 17ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 353.2MB 4600ms 1553ms truffleruby 24.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2060ms 10ms 23.0MB 2030ms 13ms ruby/yjit 3.4.2
ruby 6-m.rb 2165ms 97ms 405.7MB 5593ms 363ms truffleruby 24.2.0
ruby 6.rb 3848ms 36ms 22.5MB 3820ms 10ms ruby 3.4.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 266ms 4.3ms 15.0MB 247ms 10ms ruby/yjit 3.4.2
ruby 6.rb 437ms 2.4ms 14.5MB 420ms 7ms ruby 3.4.2
ruby 6-m.rb 815ms 10ms 363.4MB 2020ms 177ms truffleruby 24.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 11ms 0.6ms 9.0MB 20ms 0ms codon 0.18.2
ruby 1.rb 35ms 0.4ms 142.2MB 14ms 28ms truffleruby 24.2.0
ruby 1.rb 52ms 3.5ms 12.9MB 34ms 2ms ruby 3.4.2
ruby 1.rb 53ms 0.9ms 13.0MB 34ms 6ms ruby/yjit 3.4.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 252ms 3.6ms 29.1MB 220ms 20ms ruby 3.4.2
ruby 1.rb 256ms 3.5ms 28.4MB 227ms 17ms ruby/yjit 3.4.2
ruby 1-m.rb 4493ms 172ms 518.1MB 11833ms 350ms truffleruby 24.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2091ms 5.7ms 132.7MB 2000ms 77ms ruby 3.4.2
ruby 1.rb 2116ms 29ms 135.1MB 2017ms 83ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 495.0MB 13197ms 370ms truffleruby 24.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 338ms 2.7ms 13.5MB 320ms 7ms ruby/yjit 3.4.2
ruby 1.rb 534ms 7.9ms 13.0MB 517ms 7ms ruby 3.4.2
ruby 1-m.rb 679ms 33ms 375.8MB 1217ms 147ms truffleruby 24.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 880ms 3.0ms 13.5MB 857ms 7ms ruby/yjit 3.4.2
ruby 1-m.rb 1252ms 51ms 416.2MB 1803ms 183ms truffleruby 24.2.0
ruby 1.rb 1490ms 12ms 13.0MB 1470ms 7ms ruby 3.4.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 196ms 2.7ms 13.5MB 177ms 7ms ruby/yjit 3.4.2
ruby 1.rb 292ms 5.2ms 12.9MB 273ms 0ms ruby 3.4.2
ruby 1-m.rb 513ms 36ms 360.4MB 1000ms 140ms truffleruby 24.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4071ms 251ms 628.9MB 10250ms 363ms truffleruby 24.2.0
ruby 1.rb timeout 0.0ms 94.3MB 4930ms 50ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 94.8MB 4937ms 50ms ruby/yjit 3.4.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2113ms 104ms 582.3MB 5393ms 277ms truffleruby 24.2.0
ruby 1.rb 3439ms 28ms 38.3MB 3403ms 23ms ruby/yjit 3.4.2
ruby 1.rb 4410ms 17ms 37.8MB 4373ms 23ms ruby 3.4.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 830ms 8.7ms 322.7MB 1090ms 113ms truffleruby 24.2.0
codon 1.py 1453ms 222ms 9.0MB 1763ms 0ms codon 0.18.2
ruby 2.rb timeout 0.0ms 12.9MB 4987ms 0ms ruby 3.4.2
ruby 2.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 174ms 3.5ms 8.9MB 483ms 0ms codon 0.18.2
ruby 2-m.rb 310ms 2.6ms 310.1MB 543ms 113ms truffleruby 24.2.0
ruby 2.rb 1066ms 0.5ms 13.5MB 1047ms 3ms ruby/yjit 3.4.2
ruby 2.rb 2789ms 66ms 12.9MB 2773ms 0ms ruby 3.4.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 419ms 4.2ms 47.6MB 723ms 0ms codon 0.18.2
codon 2.py 1525ms 10ms 100.8MB 1833ms 17ms codon 0.18.2
ruby 1.rb timeout 0.0ms 325.4MB 4847ms 140ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 327.0MB 4853ms 137ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 709.5MB 5073ms 150ms truffleruby 24.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 127ms 2.6ms 18.5MB 433ms 0ms codon 0.18.2
codon 2-m.py 394ms 3.1ms 27.1MB 703ms 3ms codon 0.18.2
ruby 1-m.rb 1735ms 26ms 487.2MB 2477ms 167ms truffleruby 24.2.0
ruby 1.rb 3439ms 35ms 131.8MB 3347ms 77ms ruby/yjit 3.4.2
ruby 1.rb 4550ms 60ms 131.1MB 4463ms 77ms ruby 3.4.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 46.7MB 4923ms 67ms ruby 3.4.2
ruby 1.rb timeout 0.0ms 126.8MB 4890ms 100ms ruby/yjit 3.4.2
ruby 1.rb timeout 0.0ms 457.8MB 13330ms 427ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1582ms 157ms 399.4MB 4173ms 207ms truffleruby 24.2.0
ruby 1.rb 1703ms 3.1ms 46.2MB 1657ms 33ms ruby 3.4.2
ruby 1.rb 1706ms 60ms 127.5MB 1643ms 50ms ruby/yjit 3.4.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 13.0MB 4983ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.2
ruby 4.rb timeout 0.0ms 463.4MB 5177ms 250ms truffleruby 24.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4892ms 24ms 472.1MB 5177ms 213ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 0ms ruby/yjit 3.4.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1453ms 12ms 389.8MB 1777ms 143ms truffleruby 24.2.0
ruby 4.rb timeout 0.0ms 13.0MB 4980ms 0ms ruby 3.4.2
ruby 4.rb timeout 0.0ms 13.8MB 4983ms 0ms ruby/yjit 3.4.2