Programming Language and compiler
Benchmarks

Ruby VS C benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 895ms 44ms 398.0MB 1443ms 123ms truffleruby 22.2.0
ruby 1.rb 905ms 6.4ms 292.0MB 750ms 140ms ruby/yjit 3.1.2
ruby 1.rb 973ms 7.5ms 35.5MB 940ms 13ms ruby 3.1.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3004ms 31ms 336.7MB 2820ms 170ms ruby/yjit 3.1.2
ruby 1.rb 3497ms 38ms 80.1MB 3437ms 47ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 238ms 2.6ms 42.3MB 213ms 10ms ruby 3.1.2
ruby 1.rb 385ms 0.9ms 298.8MB 220ms 147ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2830ms 20ms 294.2MB 2673ms 143ms ruby/yjit 3.1.2
ruby 6.rb 4361ms 42ms 39.5MB 4333ms 13ms ruby 3.1.2
ruby 6.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 505ms 0.8ms 287.7MB 347ms 140ms ruby/yjit 3.1.2
ruby 6.rb 507ms 3.5ms 31.1MB 483ms 10ms ruby 3.1.2
ruby 6-m.rb 1309ms 25ms 359.3MB 2303ms 120ms truffleruby 22.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.9ms 0.7ms 1.0MB 0ms 0ms gcc 12.2.0
c 1.c 2.4ms 0.7ms 0.6MB 0ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 1.c 2.8ms 0.9ms 1.1MB 0ms 0ms clang 11.0.0
ruby 1.rb 42ms 2.5ms 148.7MB 18ms 22ms truffleruby 22.2.0
ruby 1.rb 70ms 0.2ms 30.0MB 48ms 6ms ruby 3.1.2
ruby 1.rb 238ms 0.3ms 286.6MB 94ms 134ms ruby/yjit 3.1.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 437ms 10.0ms 49.4MB 397ms 20ms ruby 3.1.2
ruby 1.rb 601ms 0.7ms 306.3MB 437ms 143ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3871ms 3.8ms 163.2MB 3773ms 80ms ruby 3.1.2
ruby 1.rb 4038ms 3.0ms 419.5MB 3827ms 193ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 615ms 14ms 30.1MB 593ms 10ms ruby 3.1.2
ruby 1.rb 628ms 4.4ms 286.7MB 473ms 137ms ruby/yjit 3.1.2
ruby 1-m.rb 773ms 57ms 312.0MB 1127ms 97ms truffleruby 22.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1391ms 9.5ms 286.8MB 1243ms 130ms ruby/yjit 3.1.2
ruby 1.rb 1431ms 73ms 353.1MB 1917ms 123ms truffleruby 22.2.0
ruby 1.rb 1660ms 16ms 30.2MB 1640ms 7ms ruby 3.1.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 337ms 2.5ms 29.9MB 317ms 7ms ruby 3.1.2
ruby 1.rb 433ms 1.4ms 286.6MB 270ms 140ms ruby/yjit 3.1.2
ruby 1-m.rb 568ms 48ms 298.6MB 857ms 90ms truffleruby 22.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3172ms 18ms 560.6MB 5827ms 207ms truffleruby 22.2.0
ruby 1.rb 3949ms 15ms 300.8MB 3790ms 140ms ruby/yjit 3.1.2
ruby 1.rb 4772ms 16ms 44.3MB 4743ms 13ms ruby 3.1.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 308ms 0.4ms 0.6MB 300ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 5.c 320ms 0.4ms 1.0MB 310ms 0ms gcc 12.2.0
c 5.c 330ms 2.3ms 0.6MB 320ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 2.c 337ms 0.0ms 0.6MB 330ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 8-i.c 348ms 3.3ms 1.1MB 333ms 0ms clang 11.0.0
c 8-i.c 365ms 0.7ms 0.9MB 357ms 0ms gcc 12.2.0
c 5.c 370ms 1.6ms 1.1MB 360ms 0ms clang 11.0.0
c 2.c 408ms 0.6ms 1.1MB 400ms 0ms clang 11.0.0
c 2.c 625ms 0.5ms 0.9MB 613ms 0ms gcc 12.2.0
ruby 2.rb 1111ms 6.0ms 308.1MB 1390ms 97ms truffleruby 22.2.0
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 2.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 33ms 0.4ms 0.6MB 20ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 5.c 35ms 0.4ms 1.0MB 30ms 0ms gcc 12.2.0
c 5.c 35ms 0.6ms 0.6MB 23ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 2.c 36ms 0.5ms 0.6MB 30ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 8-i.c 39ms 1.5ms 1.1MB 27ms 0ms clang 11.0.0
c 8-i.c 39ms 0.6ms 0.9MB 30ms 0ms gcc 12.2.0
c 5.c 41ms 2.4ms 1.1MB 30ms 0ms clang 11.0.0
c 2.c 43ms 0.3ms 1.1MB 33ms 0ms clang 11.0.0
c 2.c 65ms 0.5ms 1.0MB 53ms 0ms gcc 12.2.0
ruby 2-m.rb 423ms 4.0ms 302.6MB 670ms 80ms truffleruby 22.2.0
ruby 2.rb 2352ms 4.8ms 286.8MB 2207ms 127ms ruby/yjit 3.1.2
ruby 2.rb 3223ms 7.6ms 29.9MB 3193ms 10ms ruby 3.1.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 650ms 12ms 41.1MB 620ms 17ms gcc 12.2.0
c 1.c 662ms 5.3ms 40.2MB 633ms 13ms zigcc 0.10.0-dev.4213+91b05ad47
c 1.c 736ms 9.4ms 41.0MB 697ms 13ms clang 11.0.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 119ms 3.3ms 11.6MB 107ms 0ms clang 11.0.0
c 1.c 119ms 0.8ms 10.9MB 103ms 0ms zigcc 0.10.0-dev.4213+91b05ad47
c 1.c 122ms 5.9ms 11.7MB 110ms 0ms gcc 12.2.0
ruby 1.rb 3126ms 96ms 474.9MB 3563ms 120ms truffleruby 22.2.0
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 1.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1926ms 9.5ms 380.4MB 3533ms 143ms truffleruby 22.2.0
ruby 1.rb 2511ms 13ms 162.8MB 2427ms 63ms ruby 3.1.2
ruby 1.rb 2672ms 16ms 420.8MB 2457ms 203ms ruby/yjit 3.1.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1429ms 39ms 1.0MB 2740ms 0ms gcc 12.2.0
c 6-im.c 1589ms 17ms 1.0MB 3113ms 3ms gcc 12.2.0
c 6-im.c 1731ms 10.0ms 3.2MB 3390ms 0ms clang 11.0.0
c 4-m.c 1751ms 13ms 2.9MB 3413ms 7ms clang 11.0.0
c 5-im.c 1849ms 7.8ms 1.0MB 3633ms 0ms gcc 12.2.0
c 5-im.c 2037ms 18ms 3.2MB 3997ms 0ms clang 11.0.0
c 3-m.c 2203ms 0.8ms 0.9MB 4330ms 0ms gcc 12.2.0
c 3-m.c 2211ms 7.3ms 2.9MB 4340ms 3ms clang 11.0.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 361ms 2.5ms 1.0MB 687ms 0ms gcc 12.2.0
c 6-im.c 405ms 0.6ms 0.9MB 777ms 0ms gcc 12.2.0
c 6-im.c 446ms 3.1ms 3.1MB 853ms 0ms clang 11.0.0
c 4-m.c 446ms 2.0ms 3.0MB 850ms 0ms clang 11.0.0
c 5-im.c 471ms 0.6ms 1.0MB 910ms 0ms gcc 12.2.0
c 5-im.c 520ms 2.2ms 3.1MB 1000ms 0ms clang 11.0.0
c 3-m.c 569ms 14ms 1.0MB 1090ms 0ms gcc 12.2.0
c 3-m.c 574ms 11ms 3.0MB 1093ms 0ms clang 11.0.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms truffleruby 22.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 97ms 0.8ms 1.0MB 170ms 0ms gcc 12.2.0
c 6-im.c 110ms 2.4ms 1.0MB 193ms 0ms gcc 12.2.0
c 6-im.c 118ms 0.7ms 3.1MB 210ms 0ms clang 11.0.0
c 4-m.c 120ms 0.8ms 3.1MB 210ms 0ms clang 11.0.0
c 5-im.c 129ms 2.7ms 2.9MB 230ms 0ms gcc 12.2.0
c 5-im.c 143ms 5.6ms 3.1MB 253ms 0ms clang 11.0.0
c 3-m.c 150ms 1.0ms 1.0MB 280ms 0ms gcc 12.2.0
c 3-m.c 152ms 1.8ms 2.9MB 270ms 0ms clang 11.0.0
ruby 4.rb 2469ms 15ms 445.3MB 3007ms 143ms truffleruby 22.2.0
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby 3.1.2
ruby 4.rb timeout 0.0ms 0.0MB 0ms 0ms ruby/yjit 3.1.2