Programming Language and compiler
Benchmarks

Ruby VS Codon benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 4679ms 84ms 150.6MB 4570ms 97ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 70.0MB 4950ms 40ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 780.8MB 6557ms 723ms truffleruby 24.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 481ms 3.0ms 20.3MB 460ms 10ms ruby/yjit 3.4.3
ruby 1-m.rb 537ms 62ms 414.1MB 1070ms 150ms truffleruby 24.2.1
ruby 1.rb 931ms 3.2ms 19.5MB 910ms 7ms ruby 3.4.3

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1461ms 14ms 63.8MB 1383ms 63ms ruby/yjit 3.4.3
ruby 1.rb 1891ms 53ms 63.0MB 1813ms 63ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 342.0MB 4683ms 1473ms truffleruby 24.2.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 156ms 2.7ms 25.8MB 127ms 13ms ruby/yjit 3.4.3
ruby 1.rb 181ms 2.9ms 25.0MB 153ms 13ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 351.9MB 4730ms 1453ms truffleruby 24.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2030ms 11ms 23.0MB 2007ms 10ms ruby/yjit 3.4.3
ruby 6-m.rb 2048ms 68ms 387.2MB 5343ms 347ms truffleruby 24.2.1
ruby 6.rb 3729ms 21ms 22.4MB 3707ms 10ms ruby 3.4.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 257ms 3.2ms 15.0MB 240ms 7ms ruby/yjit 3.4.3
ruby 6.rb 431ms 3.1ms 14.4MB 410ms 7ms ruby 3.4.3
ruby 6-m.rb 771ms 87ms 365.8MB 1910ms 180ms truffleruby 24.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 11ms 0.6ms 9.0MB 20ms 0ms codon 0.18.2
ruby 1.rb 34ms 0.6ms 140.7MB 12ms 24ms truffleruby 24.2.1
ruby 1.rb 50ms 0.5ms 13.0MB 36ms 4ms ruby/yjit 3.4.3
ruby 1.rb 52ms 1.7ms 12.8MB 38ms 0ms ruby 3.4.3

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 247ms 2.4ms 29.9MB 220ms 10ms ruby/yjit 3.4.3
ruby 1.rb 249ms 4.9ms 28.5MB 217ms 17ms ruby 3.4.3
ruby 1-m.rb 4260ms 110ms 489.7MB 11213ms 330ms truffleruby 24.2.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2070ms 4.8ms 135.1MB 1983ms 73ms ruby/yjit 3.4.3
ruby 1.rb 2088ms 5.1ms 134.1MB 2000ms 77ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 649.0MB 13303ms 360ms truffleruby 24.2.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 336ms 3.0ms 13.5MB 320ms 7ms ruby/yjit 3.4.3
ruby 1.rb 528ms 0.6ms 12.9MB 510ms 0ms ruby 3.4.3
ruby 1-m.rb 649ms 12ms 361.2MB 1150ms 143ms truffleruby 24.2.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 891ms 5.7ms 13.5MB 873ms 3ms ruby/yjit 3.4.3
ruby 1-m.rb 1218ms 28ms 399.4MB 1703ms 157ms truffleruby 24.2.1
ruby 1.rb 1472ms 6.0ms 12.9MB 1453ms 3ms ruby 3.4.3

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 194ms 4.2ms 13.4MB 177ms 7ms ruby/yjit 3.4.3
ruby 1.rb 288ms 3.8ms 12.8MB 270ms 3ms ruby 3.4.3
ruby 1-m.rb 516ms 39ms 354.9MB 993ms 137ms truffleruby 24.2.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4011ms 237ms 549.1MB 10167ms 373ms truffleruby 24.2.1
ruby 1.rb timeout 0.0ms 93.5MB 4940ms 50ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 97.2MB 4940ms 50ms ruby/yjit 3.4.3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2063ms 65ms 556.4MB 5307ms 257ms truffleruby 24.2.1
ruby 1.rb 3317ms 15ms 38.3MB 3287ms 17ms ruby/yjit 3.4.3
ruby 1.rb 4340ms 9.9ms 37.6MB 4307ms 20ms ruby 3.4.3

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 820ms 8.8ms 310.7MB 1043ms 117ms truffleruby 24.2.1
codon 1.py 1317ms 2.2ms 8.9MB 1623ms 0ms codon 0.18.2
ruby 2.rb timeout 0.0ms 12.8MB 4987ms 3ms ruby 3.4.3
ruby 2.rb timeout 0.0ms 13.5MB 4983ms 0ms ruby/yjit 3.4.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 174ms 3.5ms 8.8MB 483ms 0ms codon 0.18.2
ruby 2-m.rb 312ms 9.0ms 309.6MB 540ms 117ms truffleruby 24.2.1
ruby 2.rb 1025ms 2.6ms 13.5MB 1010ms 0ms ruby/yjit 3.4.3
ruby 2.rb 2856ms 28ms 12.8MB 2840ms 0ms ruby 3.4.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 444ms 7.4ms 47.7MB 747ms 0ms codon 0.18.2
codon 2.py 1528ms 20ms 100.8MB 1827ms 30ms codon 0.18.2
ruby 1.rb timeout 0.0ms 325.3MB 4853ms 133ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 327.0MB 4860ms 130ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 731.8MB 5057ms 157ms truffleruby 24.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 127ms 3.2ms 18.4MB 427ms 0ms codon 0.18.2
codon 2-m.py 398ms 9.8ms 27.1MB 707ms 3ms codon 0.18.2
ruby 1-m.rb 1692ms 8.3ms 475.4MB 2483ms 163ms truffleruby 24.2.1
ruby 1.rb 3437ms 77ms 131.8MB 3337ms 83ms ruby/yjit 3.4.3
ruby 1.rb 4403ms 32ms 131.0MB 4307ms 80ms ruby 3.4.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 130.2MB 4847ms 140ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 130.7MB 4873ms 113ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 461.2MB 13320ms 417ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1612ms 177ms 390.8MB 4260ms 207ms truffleruby 24.2.1
ruby 1.rb 1803ms 20ms 131.0MB 1673ms 117ms ruby/yjit 3.4.3
ruby 1.rb 1805ms 5.0ms 130.1MB 1683ms 103ms ruby 3.4.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.3
ruby 4.rb timeout 0.0ms 412.4MB 5180ms 223ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4838ms 9.1ms 424.1MB 5130ms 203ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.3

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1417ms 19ms 373.9MB 1763ms 130ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 7ms ruby 3.4.3
ruby 4.rb timeout 0.0ms 13.8MB 4980ms 3ms ruby/yjit 3.4.3