Programming Language and compiler
Benchmarks

Ruby VS C benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 72.7MB 4953ms 33ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 115.5MB 4917ms 63ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 769.5MB 7713ms 377ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 533ms 1.9ms 40.7MB 503ms 13ms ruby/yjit 3.2.2
ruby 1.rb 969ms 5.3ms 40.2MB 943ms 10ms ruby 3.2.2
ruby 1-m.rb 984ms 52ms 414.6MB 1597ms 140ms truffleruby 22.3.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3206ms 100ms 82.7MB 3143ms 47ms ruby/yjit 3.2.2
ruby 1.rb 3619ms 125ms 82.2MB 3550ms 53ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 1163.0MB 4197ms 1267ms truffleruby 22.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 224ms 4.0ms 44.8MB 180ms 27ms ruby/yjit 3.2.2
ruby 1.rb 233ms 1.7ms 44.4MB 207ms 10ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 1158.9MB 4150ms 1270ms truffleruby 22.3.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 2359ms 7.6ms 43.6MB 2317ms 23ms ruby/yjit 3.2.2
ruby 6-m.rb 2525ms 40ms 381.9MB 4587ms 233ms truffleruby 22.3.1
ruby 6.rb 4204ms 50ms 43.0MB 4180ms 13ms ruby 3.2.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 6.rb 307ms 0.5ms 35.0MB 280ms 10ms ruby/yjit 3.2.2
ruby 6.rb 494ms 8.7ms 34.5MB 467ms 13ms ruby 3.2.2
ruby 6-m.rb 806ms 12ms 314.0MB 1380ms 100ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.8ms 0.5ms 1.4MB 0ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 1.c 1.9ms 0.8ms 1.3MB 0ms 0ms gcc 13.1.0
c 1.c 1.9ms 0.5ms 1.4MB 0ms 0ms clang 14.0.0
ruby 1.rb 43ms 2.1ms 157.2MB 16ms 26ms truffleruby 22.3.1
ruby 1.rb 71ms 1.0ms 32.2MB 48ms 10ms ruby/yjit 3.2.2
ruby 1.rb 71ms 0.6ms 32.0MB 50ms 8ms ruby 3.2.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 433ms 0.1ms 51.6MB 410ms 7ms ruby/yjit 3.2.2
ruby 1.rb 436ms 1.6ms 48.8MB 397ms 27ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 453.7MB 9193ms 197ms truffleruby 22.3.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3991ms 0.7ms 175.2MB 3900ms 77ms ruby 3.2.2
ruby 1.rb 4015ms 44ms 174.0MB 3923ms 73ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 426.7MB 9293ms 180ms truffleruby 22.3.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 442ms 0.6ms 32.9MB 417ms 10ms ruby/yjit 3.2.2
ruby 1.rb 589ms 3.1ms 32.4MB 563ms 13ms ruby 3.2.2
ruby 1-m.rb 771ms 15ms 330.4MB 1130ms 100ms truffleruby 22.3.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1177ms 4.0ms 32.9MB 1150ms 13ms ruby/yjit 3.2.2
ruby 1.rb 1410ms 33ms 359.6MB 1697ms 150ms truffleruby 22.3.1
ruby 1.rb 1639ms 13ms 32.4MB 1613ms 10ms ruby 3.2.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 255ms 0.9ms 32.8MB 227ms 13ms ruby/yjit 3.2.2
ruby 1.rb 329ms 2.7ms 32.3MB 307ms 10ms ruby 3.2.2
ruby 1-m.rb 556ms 34ms 309.0MB 833ms 97ms truffleruby 22.3.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 96.5MB 4927ms 60ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 97.0MB 4930ms 50ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 572.5MB 9213ms 233ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3266ms 25ms 595.8MB 5983ms 230ms truffleruby 22.3.1
ruby 1.rb 4134ms 16ms 53.6MB 4087ms 30ms ruby/yjit 3.2.2
ruby 1.rb 4915ms 13ms 52.8MB 4870ms 30ms ruby 3.2.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 2.c 312ms 0.6ms 1.3MB 300ms 0ms gcc 13.1.0
c 5.c 315ms 2.8ms 1.0MB 307ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 320ms 0.8ms 1.3MB 310ms 0ms gcc 13.1.0
c 8-i.c 320ms 0.4ms 1.3MB 310ms 0ms gcc 13.1.0
c 2.c 320ms 0.2ms 1.0MB 310ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 331ms 2.0ms 1.4MB 320ms 0ms clang 14.0.0
c 2.c 341ms 0.6ms 1.4MB 327ms 0ms clang 14.0.0
c 8-i.c 361ms 0.1ms 1.0MB 350ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 367ms 5.2ms 1.4MB 357ms 0ms clang 14.0.0
ruby 2.rb 1022ms 5.5ms 306.4MB 1213ms 87ms truffleruby 22.3.1
ruby 2.rb timeout 0.0ms 32.2MB 4967ms 17ms ruby 3.2.2
ruby 2.rb timeout 0.0ms 32.9MB 4977ms 3ms ruby/yjit 3.2.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 5.c 34ms 0.5ms 1.0MB 23ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 34ms 0.1ms 1.3MB 30ms 0ms gcc 13.1.0
c 5.c 34ms 0.3ms 1.3MB 27ms 0ms gcc 13.1.0
c 2.c 35ms 1.7ms 1.3MB 23ms 0ms gcc 13.1.0
c 2.c 35ms 0.1ms 1.0MB 23ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 36ms 0.5ms 1.4MB 30ms 0ms clang 14.0.0
c 2.c 37ms 0.3ms 1.4MB 30ms 0ms clang 14.0.0
c 8-i.c 38ms 0.2ms 1.0MB 30ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 40ms 1.2ms 1.4MB 30ms 0ms clang 14.0.0
ruby 2-m.rb 387ms 13ms 323.0MB 587ms 87ms truffleruby 22.3.1
ruby 2.rb 2106ms 0.9ms 32.9MB 2080ms 10ms ruby/yjit 3.2.2
ruby 2.rb 3217ms 21ms 32.3MB 3187ms 10ms ruby 3.2.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 604ms 35ms 40.8MB 577ms 10ms clang 14.0.0
c 1.c 610ms 8.4ms 40.9MB 580ms 13ms gcc 13.1.0
c 1.c 642ms 41ms 40.1MB 613ms 13ms zigcc 0.11.0-dev.3978+711b4e93e
ruby 1.rb timeout 0.0ms 344.6MB 4853ms 123ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 345.2MB 4850ms 127ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 683.4MB 5050ms 130ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 123ms 3.8ms 11.6MB 107ms 0ms clang 14.0.0
c 1.c 124ms 3.7ms 11.0MB 107ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 1.c 127ms 4.4ms 11.7MB 117ms 0ms gcc 13.1.0
ruby 1.rb 2793ms 82ms 427.2MB 3267ms 127ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4927ms 50ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 151.4MB 4923ms 60ms ruby/yjit 3.2.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 159.2MB 4917ms 60ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 159.8MB 4930ms 57ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 416.1MB 9323ms 203ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 1948ms 37ms 408.1MB 3603ms 127ms truffleruby 22.3.1
ruby 1.rb 2372ms 5.3ms 159.8MB 2293ms 67ms ruby/yjit 3.2.2
ruby 1.rb 2392ms 10.0ms 159.3MB 2323ms 53ms ruby 3.2.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1388ms 5.9ms 1.3MB 2723ms 0ms gcc 13.1.0
c 6-im.c 1655ms 1.8ms 1.2MB 3250ms 0ms gcc 13.1.0
c 6-im.c 1681ms 1.9ms 5.2MB 3297ms 0ms clang 14.0.0
c 4-m.c 1696ms 0.6ms 3.3MB 3330ms 0ms clang 14.0.0
c 5-im.c 1852ms 16ms 1.3MB 3630ms 0ms gcc 13.1.0
c 5-im.c 2158ms 12ms 3.2MB 4240ms 0ms clang 14.0.0
c 3-m.c 2211ms 13ms 3.2MB 4343ms 0ms clang 14.0.0
c 3-m.c 2214ms 25ms 1.3MB 4343ms 0ms gcc 13.1.0
ruby 4.rb timeout 0.0ms 32.1MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 10ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 533.5MB 5240ms 213ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 358ms 1.2ms 1.3MB 680ms 0ms gcc 13.1.0
c 6-im.c 425ms 3.0ms 1.3MB 813ms 0ms gcc 13.1.0
c 6-im.c 431ms 1.8ms 3.3MB 823ms 0ms clang 14.0.0
c 4-m.c 433ms 0.8ms 3.2MB 830ms 3ms clang 14.0.0
c 5-im.c 472ms 1.8ms 1.3MB 907ms 0ms gcc 13.1.0
c 5-im.c 558ms 12ms 3.2MB 1067ms 0ms clang 14.0.0
c 3-m.c 559ms 2.5ms 1.2MB 1083ms 0ms gcc 13.1.0
c 3-m.c 563ms 4.0ms 3.2MB 1087ms 0ms clang 14.0.0
ruby 4.rb timeout 0.0ms 32.2MB 4977ms 3ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 7ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 591.7MB 5390ms 237ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 99ms 1.6ms 1.3MB 170ms 0ms gcc 13.1.0
c 6-im.c 114ms 1.0ms 3.2MB 207ms 0ms gcc 13.1.0
c 6-im.c 116ms 1.1ms 3.2MB 200ms 0ms clang 14.0.0
c 4-m.c 116ms 0.5ms 3.2MB 203ms 0ms clang 14.0.0
c 5-im.c 129ms 2.7ms 1.3MB 230ms 0ms gcc 13.1.0
c 5-im.c 148ms 2.0ms 3.1MB 267ms 0ms clang 14.0.0
c 3-m.c 150ms 3.9ms 1.3MB 273ms 0ms gcc 13.1.0
c 3-m.c 159ms 15ms 3.5MB 287ms 0ms clang 14.0.0
ruby 4.rb 2469ms 3.3ms 477.2MB 2927ms 177ms truffleruby 22.3.1
ruby 4.rb timeout 0.0ms 32.4MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.2