Programming Language and compiler
Benchmarks

Ruby VS Codon benchmarks

Current benchmark data was generated on Mon May 19 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4550ms 58ms 807.5MB 6423ms 470ms truffleruby 24.2.1
ruby 1.rb 4702ms 91ms 150.6MB 4603ms 87ms ruby/yjit 3.4.4
ruby 1.rb timeout 0.0ms 70.4MB 4947ms 40ms ruby 3.4.4

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 493ms 7.5ms 20.3MB 467ms 10ms ruby/yjit 3.4.4
ruby 1-m.rb 536ms 62ms 418.0MB 1057ms 167ms truffleruby 24.2.1
ruby 1.rb 939ms 7.1ms 19.5MB 917ms 13ms ruby 3.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1437ms 31ms 63.8MB 1357ms 67ms ruby/yjit 3.4.4
ruby 1.rb 1867ms 6.6ms 63.0MB 1790ms 63ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 340.6MB 4643ms 1510ms truffleruby 24.2.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 152ms 2.8ms 25.8MB 120ms 20ms ruby/yjit 3.4.4
ruby 1.rb 181ms 2.5ms 25.0MB 147ms 17ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 353.7MB 4770ms 1417ms truffleruby 24.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2027ms 13ms 23.0MB 1997ms 10ms ruby/yjit 3.4.4
ruby 6-m.rb 2068ms 126ms 407.9MB 5310ms 330ms truffleruby 24.2.1
ruby 6.rb 3712ms 34ms 22.4MB 3683ms 13ms ruby 3.4.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 259ms 3.2ms 15.2MB 237ms 7ms ruby/yjit 3.4.4
ruby 6.rb 421ms 2.0ms 14.4MB 400ms 7ms ruby 3.4.4
ruby 6-m.rb 817ms 16ms 366.6MB 2047ms 163ms truffleruby 24.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 12ms 0.7ms 8.8MB 20ms 0ms codon 0.18.2
ruby 1.rb 35ms 0.5ms 141.3MB 14ms 24ms truffleruby 24.2.1
ruby 1.rb 51ms 1.3ms 12.9MB 36ms 2ms ruby/yjit 3.4.4
ruby 1.rb 51ms 1.6ms 12.8MB 38ms 4ms ruby 3.4.4

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 251ms 4.9ms 27.8MB 223ms 17ms ruby 3.4.4
ruby 1.rb 254ms 3.9ms 29.0MB 227ms 13ms ruby/yjit 3.4.4
ruby 1-m.rb 4221ms 61ms 553.6MB 11127ms 323ms truffleruby 24.2.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 2088ms 11ms 135.5MB 2000ms 73ms ruby/yjit 3.4.4
ruby 1.rb 2089ms 18ms 130.9MB 2003ms 70ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 486.0MB 13307ms 333ms truffleruby 24.2.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 346ms 5.9ms 13.5MB 327ms 7ms ruby/yjit 3.4.4
ruby 1.rb 528ms 2.9ms 12.9MB 510ms 10ms ruby 3.4.4
ruby 1-m.rb 672ms 40ms 371.0MB 1197ms 137ms truffleruby 24.2.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 910ms 1.8ms 13.5MB 890ms 3ms ruby/yjit 3.4.4
ruby 1-m.rb 1245ms 2.3ms 411.8MB 1757ms 167ms truffleruby 24.2.1
ruby 1.rb 1482ms 5.6ms 12.9MB 1460ms 10ms ruby 3.4.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 197ms 3.9ms 13.4MB 183ms 3ms ruby/yjit 3.4.4
ruby 1.rb 290ms 4.2ms 12.8MB 273ms 0ms ruby 3.4.4
ruby 1-m.rb 503ms 50ms 362.6MB 967ms 137ms truffleruby 24.2.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3839ms 65ms 570.9MB 9800ms 350ms truffleruby 24.2.1
ruby 1.rb timeout 0.0ms 94.1MB 4943ms 47ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 97.2MB 4943ms 43ms ruby/yjit 3.4.4

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2093ms 126ms 535.8MB 5357ms 270ms truffleruby 24.2.1
ruby 1.rb 3224ms 7.7ms 38.3MB 3190ms 17ms ruby/yjit 3.4.4
ruby 1.rb 4324ms 12ms 37.6MB 4293ms 13ms ruby 3.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 816ms 4.0ms 312.1MB 1050ms 113ms truffleruby 24.2.1
codon 1.py 1323ms 14ms 8.9MB 1630ms 0ms codon 0.18.2
ruby 2.rb timeout 0.0ms 12.8MB 4987ms 0ms ruby 3.4.4
ruby 2.rb timeout 0.0ms 13.5MB 4980ms 7ms ruby/yjit 3.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 177ms 3.9ms 8.8MB 487ms 0ms codon 0.18.2
ruby 2-m.rb 308ms 14ms 317.9MB 567ms 110ms truffleruby 24.2.1
ruby 2.rb 1025ms 1.2ms 13.5MB 1003ms 10ms ruby/yjit 3.4.4
ruby 2.rb 2921ms 95ms 12.8MB 2903ms 3ms ruby 3.4.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 455ms 9.2ms 47.7MB 757ms 0ms codon 0.18.2
codon 2.py 1561ms 6.3ms 100.8MB 1870ms 23ms codon 0.18.2
ruby 1.rb timeout 0.0ms 325.3MB 4857ms 133ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 327.0MB 4853ms 130ms ruby/yjit 3.4.4
ruby 1.rb timeout 0.0ms 732.0MB 5073ms 150ms truffleruby 24.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 126ms 3.4ms 18.4MB 433ms 0ms codon 0.18.2
codon 2-m.py 398ms 2.8ms 27.2MB 707ms 10ms codon 0.18.2
ruby 1-m.rb 1691ms 6.2ms 486.6MB 2437ms 163ms truffleruby 24.2.1
ruby 1.rb 3458ms 150ms 131.6MB 3363ms 80ms ruby/yjit 3.4.4
ruby 1.rb 4471ms 23ms 131.1MB 4383ms 73ms ruby 3.4.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 130.1MB 4853ms 137ms ruby 3.4.4
ruby 1.rb timeout 0.0ms 131.0MB 4833ms 157ms ruby/yjit 3.4.4
ruby 1.rb timeout 0.0ms 441.9MB 13307ms 403ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1737ms 69ms 130.2MB 1657ms 63ms ruby 3.4.4
ruby 1-m.rb 1762ms 210ms 387.2MB 4653ms 207ms truffleruby 24.2.1
ruby 1.rb 1805ms 4.1ms 131.2MB 1680ms 113ms ruby/yjit 3.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.5MB 4980ms 3ms ruby/yjit 3.4.4
ruby 4.rb timeout 0.0ms 442.8MB 5163ms 247ms truffleruby 24.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 4839ms 22ms 427.6MB 5120ms 207ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 3ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.5MB 4983ms 3ms ruby/yjit 3.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb 1449ms 47ms 375.2MB 1810ms 133ms truffleruby 24.2.1
ruby 4.rb timeout 0.0ms 12.9MB 4980ms 0ms ruby 3.4.4
ruby 4.rb timeout 0.0ms 13.6MB 4980ms 7ms ruby/yjit 3.4.4