Programming Language and compiler
Benchmarks

Ruby VS C benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 959ms 4.8ms 35.5MB 927ms 20ms ruby 3.1.2
ruby 1.rb 1007ms 63ms 292.1MB 833ms 157ms ruby/yjit 3.1.2
ruby 1-m.rb 1154ms 16ms 374.0MB 1910ms 153ms truffleruby 22.1.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3734ms 38ms 336.8MB 3510ms 207ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 274ms 3.5ms 42.3MB 230ms 23ms ruby 3.1.2
ruby 1.rb 439ms 2.5ms 298.8MB 270ms 150ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2592ms 2.6ms 296.0MB 2430ms 143ms ruby/yjit 3.1.2
ruby 6.rb 4521ms 77ms 39.5MB 4483ms 23ms ruby 3.1.2
ruby 6.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 520ms 7.9ms 31.2MB 493ms 13ms ruby 3.1.2
ruby 6.rb 534ms 1.0ms 287.7MB 367ms 147ms ruby/yjit 3.1.2
ruby 6-m.rb 1815ms 39ms 324.3MB 3240ms 147ms truffleruby 22.1.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.8ms 0.7ms 0.9MB 0ms 0ms gcc 12.1.0
c 1.c 2.2ms 0.7ms 1.1MB 0ms 0ms clang 11.0.0
c 1.c 2.9ms 1.6ms 0.6MB 0ms 0ms zigcc 0.10.0
ruby 1.rb 47ms 1.2ms 138.4MB 20ms 30ms truffleruby 22.1.0
ruby 1.rb 68ms 3.3ms 29.9MB 46ms 8ms ruby 3.1.2
ruby 1.rb 255ms 11ms 286.7MB 106ms 136ms ruby/yjit 3.1.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 395ms 1.2ms 48.4MB 353ms 27ms ruby 3.1.2
ruby 1.rb 572ms 1.1ms 305.6MB 413ms 140ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3803ms 283ms 419.3MB 3567ms 220ms ruby/yjit 3.1.2
ruby 1.rb 3923ms 1.6ms 162.5MB 3800ms 103ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 601ms 3.2ms 30.2MB 573ms 13ms ruby 3.1.2
ruby 1.rb 668ms 1.4ms 286.7MB 507ms 147ms ruby/yjit 3.1.2
ruby 1-m.rb 1118ms 34ms 324.3MB 1683ms 130ms truffleruby 22.1.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1454ms 1.2ms 286.8MB 1283ms 153ms ruby/yjit 3.1.2
ruby 1.rb 1827ms 148ms 30.2MB 1800ms 10ms ruby 3.1.2
ruby 1-m.rb 1929ms 66ms 366.3MB 2780ms 180ms truffleruby 22.1.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 334ms 0.5ms 30.0MB 313ms 3ms ruby 3.1.2
ruby 1.rb 419ms 1.1ms 286.8MB 280ms 123ms ruby/yjit 3.1.2
ruby 1-m.rb 801ms 86ms 311.0MB 1277ms 97ms truffleruby 22.1.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3899ms 12ms 522.4MB 7130ms 253ms truffleruby 22.1.0
ruby 1.rb 3919ms 269ms 300.9MB 3750ms 147ms ruby/yjit 3.1.2
ruby 1.rb 4824ms 19ms 44.4MB 4790ms 17ms ruby 3.1.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 318ms 4.5ms 1.1MB 300ms 0ms clang 11.0.0
c 8-i.c 320ms 17ms 1.0MB 310ms 0ms gcc 12.1.0
c 5.c 334ms 0.4ms 1.0MB 320ms 0ms gcc 12.1.0
c 8-i.c 339ms 0.3ms 0.6MB 330ms 0ms zigcc 0.10.0
c 5.c 361ms 4.0ms 1.1MB 350ms 0ms clang 11.0.0
c 5.c 426ms 0.4ms 0.6MB 413ms 0ms zigcc 0.10.0
c 2.c 431ms 3.8ms 0.6MB 420ms 0ms zigcc 0.10.0
c 2.c 458ms 12ms 1.1MB 437ms 0ms clang 11.0.0
c 2.c 478ms 5.8ms 1.0MB 467ms 0ms gcc 12.1.0
ruby 2.rb 1453ms 19ms 300.6MB 1823ms 127ms truffleruby 22.1.0
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 36ms 0.4ms 0.6MB 30ms 0ms zigcc 0.10.0
c 8-i.c 36ms 0.3ms 0.9MB 23ms 0ms gcc 12.1.0
c 8-i.c 37ms 2.3ms 1.1MB 23ms 0ms clang 11.0.0
c 5.c 37ms 2.9ms 1.1MB 30ms 0ms clang 11.0.0
c 5.c 37ms 2.0ms 1.0MB 23ms 0ms gcc 12.1.0
c 5.c 45ms 0.2ms 0.6MB 37ms 0ms zigcc 0.10.0
c 2.c 45ms 0.1ms 0.6MB 33ms 0ms zigcc 0.10.0
c 2.c 47ms 3.4ms 1.1MB 37ms 0ms clang 11.0.0
c 2.c 50ms 0.4ms 1.0MB 40ms 0ms gcc 12.1.0
ruby 2-m.rb 547ms 17ms 293.9MB 873ms 107ms truffleruby 22.1.0
ruby 2.rb 2300ms 157ms 286.8MB 2147ms 137ms ruby/yjit 3.1.2
ruby 2.rb 2985ms 224ms 30.0MB 2960ms 10ms ruby 3.1.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1127ms 26ms 41.1MB 1097ms 13ms gcc 12.1.0
c 1.c 1128ms 19ms 40.2MB 1097ms 13ms zigcc 0.10.0
c 1.c 1187ms 31ms 40.9MB 1150ms 20ms clang 11.0.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 117ms 1.8ms 11.6MB 103ms 0ms clang 11.0.0
c 1.c 117ms 5.1ms 11.8MB 100ms 0ms gcc 12.1.0
c 1.c 117ms 3.6ms 10.9MB 100ms 0ms zigcc 0.10.0
ruby 1.rb 4255ms 11ms 450.1MB 4693ms 197ms truffleruby 22.1.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 2398ms 14ms 380.8MB 4403ms 170ms truffleruby 22.1.0
ruby 1.rb 2920ms 118ms 162.8MB 2817ms 83ms ruby 3.1.2
ruby 1.rb 3138ms 10ms 420.7MB 2910ms 213ms ruby/yjit 3.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1271ms 6.7ms 1.0MB 2483ms 0ms gcc 12.1.0
c 6-im.c 1437ms 4.1ms 3.1MB 2810ms 3ms clang 11.0.0
c 6-im.c 1518ms 1.7ms 0.9MB 2970ms 0ms gcc 12.1.0
c 4-m.c 1537ms 7.1ms 3.0MB 3007ms 3ms clang 11.0.0
c 5-im.c 1582ms 3.4ms 1.0MB 3097ms 0ms gcc 12.1.0
c 5-im.c 1742ms 4.8ms 3.1MB 3407ms 0ms clang 11.0.0
c 3-m.c 1874ms 2.0ms 0.9MB 3670ms 3ms gcc 12.1.0
c 3-m.c 1889ms 6.2ms 3.0MB 3700ms 0ms clang 11.0.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 329ms 6.5ms 2.4MB 620ms 0ms gcc 12.1.0
c 6-im.c 372ms 3.6ms 3.1MB 703ms 0ms clang 11.0.0
c 4-m.c 395ms 2.9ms 2.9MB 757ms 0ms clang 11.0.0
c 6-im.c 401ms 15ms 0.9MB 747ms 0ms gcc 12.1.0
c 5-im.c 411ms 1.9ms 1.0MB 787ms 0ms gcc 12.1.0
c 5-im.c 453ms 15ms 3.1MB 857ms 0ms clang 11.0.0
c 3-m.c 484ms 2.2ms 1.0MB 920ms 0ms gcc 12.1.0
c 3-m.c 488ms 12ms 3.1MB 927ms 0ms clang 11.0.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.1.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 90ms 0.5ms 1.0MB 160ms 0ms gcc 12.1.0
c 6-im.c 101ms 1.2ms 2.9MB 180ms 0ms clang 11.0.0
c 6-im.c 105ms 0.8ms 1.0MB 190ms 0ms gcc 12.1.0
c 4-m.c 107ms 0.4ms 3.0MB 190ms 0ms clang 11.0.0
c 5-im.c 111ms 0.5ms 1.0MB 200ms 0ms gcc 12.1.0
c 5-im.c 128ms 9.1ms 2.9MB 220ms 0ms clang 11.0.0
c 3-m.c 130ms 1.0ms 0.9MB 233ms 0ms gcc 12.1.0
c 3-m.c 132ms 4.3ms 3.1MB 230ms 0ms clang 11.0.0
ruby 4.rb 2702ms 3.9ms 365.9MB 3373ms 150ms truffleruby 22.1.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2