Programming Language and compiler
Benchmarks

Codon VS Ruby benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.0ms 0.6ms 5.1MB 0ms 0ms codon 0.16.2
ruby 1.rb 43ms 2.1ms 157.2MB 16ms 26ms truffleruby 22.3.1
ruby 1.rb 71ms 1.0ms 32.2MB 48ms 10ms ruby/yjit 3.2.2
ruby 1.rb 71ms 0.6ms 32.0MB 50ms 8ms ruby 3.2.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 1022ms 5.5ms 306.4MB 1213ms 87ms truffleruby 22.3.1
codon 1.py 1947ms 41ms 7.2MB 1933ms 0ms codon 0.16.2
ruby 2.rb timeout 0.0ms 32.2MB 4967ms 17ms ruby 3.2.2
ruby 2.rb timeout 0.0ms 32.9MB 4977ms 3ms ruby/yjit 3.2.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 198ms 2.4ms 7.3MB 190ms 0ms codon 0.16.2
ruby 2-m.rb 387ms 13ms 323.0MB 587ms 87ms truffleruby 22.3.1
ruby 2.rb 2106ms 0.9ms 32.9MB 2080ms 10ms ruby/yjit 3.2.2
ruby 2.rb 3217ms 21ms 32.3MB 3187ms 10ms ruby 3.2.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 682ms 64ms 44.5MB 657ms 10ms codon 0.16.2
codon 2.py 911ms 35ms 104.9MB 883ms 13ms codon 0.16.2
ruby 1.rb timeout 0.0ms 344.6MB 4853ms 123ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 345.2MB 4850ms 127ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 683.4MB 5050ms 130ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 150ms 1.1ms 15.1MB 140ms 0ms codon 0.16.2
codon 2.py 202ms 0.9ms 25.6MB 183ms 7ms codon 0.16.2
ruby 1.rb 2793ms 82ms 427.2MB 3267ms 127ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4927ms 50ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 151.4MB 4923ms 60ms ruby/yjit 3.2.2