Codon VS Ruby benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 11ms 0.6ms 9.0MB 20ms 0ms codon 0.18.2
ruby 1.rb 34ms 0.6ms 140.7MB 12ms 24ms truffleruby 24.2.1
ruby 1.rb 50ms 0.5ms 13.0MB 36ms 4ms ruby/yjit 3.4.3
ruby 1.rb 52ms 1.7ms 12.8MB 38ms 0ms ruby 3.4.3

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 820ms 8.8ms 310.7MB 1043ms 117ms truffleruby 24.2.1
codon 1.py 1317ms 2.2ms 8.9MB 1623ms 0ms codon 0.18.2
ruby 2.rb timeout 0.0ms 12.8MB 4987ms 3ms ruby 3.4.3
ruby 2.rb timeout 0.0ms 13.5MB 4983ms 0ms ruby/yjit 3.4.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 174ms 3.5ms 8.8MB 483ms 0ms codon 0.18.2
ruby 2-m.rb 312ms 9.0ms 309.6MB 540ms 117ms truffleruby 24.2.1
ruby 2.rb 1025ms 2.6ms 13.5MB 1010ms 0ms ruby/yjit 3.4.3
ruby 2.rb 2856ms 28ms 12.8MB 2840ms 0ms ruby 3.4.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 444ms 7.4ms 47.7MB 747ms 0ms codon 0.18.2
codon 2.py 1528ms 20ms 100.8MB 1827ms 30ms codon 0.18.2
ruby 1.rb timeout 0.0ms 325.3MB 4853ms 133ms ruby 3.4.3
ruby 1.rb timeout 0.0ms 327.0MB 4860ms 130ms ruby/yjit 3.4.3
ruby 1.rb timeout 0.0ms 731.8MB 5057ms 157ms truffleruby 24.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1-m.py 127ms 3.2ms 18.4MB 427ms 0ms codon 0.18.2
codon 2-m.py 398ms 9.8ms 27.1MB 707ms 3ms codon 0.18.2
ruby 1-m.rb 1692ms 8.3ms 475.4MB 2483ms 163ms truffleruby 24.2.1
ruby 1.rb 3437ms 77ms 131.8MB 3337ms 83ms ruby/yjit 3.4.3
ruby 1.rb 4403ms 32ms 131.0MB 4307ms 80ms ruby 3.4.3