Codon VS Ruby benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.1ms 0.5ms 5.5MB 0ms 0ms codon 0.17.0
ruby 1.rb 39ms 0.6ms 162.9MB 12ms 28ms truffleruby 24.1.2
ruby 1.rb 52ms 1.6ms 13.3MB 34ms 6ms ruby/yjit 3.4.1
ruby 1.rb 54ms 1.5ms 12.9MB 40ms 2ms ruby 3.4.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 837ms 3.1ms 329.6MB 1080ms 117ms truffleruby 24.1.2
codon 1.py 1371ms 99ms 7.9MB 1357ms 0ms codon 0.17.0
ruby 2.rb timeout 0.0ms 12.9MB 4983ms 3ms ruby 3.4.1
ruby 2.rb timeout 0.0ms 13.6MB 4980ms 3ms ruby/yjit 3.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 135ms 1.9ms 7.9MB 123ms 0ms codon 0.17.0
ruby 2-m.rb 321ms 1.6ms 325.2MB 553ms 120ms truffleruby 24.1.2
ruby 2.rb 1057ms 1.2ms 13.6MB 1037ms 7ms ruby/yjit 3.4.1
ruby 2.rb 2773ms 54ms 12.9MB 2760ms 0ms ruby 3.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 368ms 5.0ms 46.5MB 357ms 0ms codon 0.17.0
codon 2.py 848ms 3.7ms 100.0MB 830ms 13ms codon 0.17.0
ruby 1.rb timeout 0.0ms 325.4MB 4850ms 137ms ruby 3.4.1
ruby 1.rb timeout 0.0ms 327.0MB 4850ms 130ms ruby/yjit 3.4.1
ruby 1.rb timeout 0.0ms 756.9MB 5047ms 177ms truffleruby 24.1.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 71ms 1.3ms 15.3MB 60ms 0ms codon 0.17.0
codon 2.py 198ms 1.5ms 25.9MB 187ms 3ms codon 0.17.0
ruby 1-m.rb 1816ms 30ms 491.5MB 2583ms 167ms truffleruby 24.1.2
ruby 1.rb 3401ms 20ms 131.9MB 3310ms 77ms ruby/yjit 3.4.1
ruby 1.rb 4444ms 10ms 131.1MB 4360ms 70ms ruby 3.4.1