Programming Language and compiler
Benchmarks

Ruby VS V benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1286ms 4.6ms 37.1MB 1260ms 13ms v/clang+gc 0.3.2
v 1.v 1296ms 49ms 37.2MB 1277ms 3ms v/clang 0.3.2
ruby 1.rb timeout 0.0ms 72.6MB 4943ms 40ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 115.6MB 4917ms 60ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 612.7MB 8020ms 290ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 94ms 1.4ms 5.6MB 83ms 0ms v/clang+gc 0.3.2
v 1.v 95ms 1.3ms 5.5MB 83ms 0ms v/clang 0.3.2
ruby 1.rb 565ms 6.7ms 40.7MB 530ms 17ms ruby/yjit 3.2.0
ruby 1.rb 1011ms 5.8ms 40.3MB 973ms 20ms ruby 3.2.0
ruby 1-m.rb 1081ms 25ms 419.3MB 1780ms 140ms truffleruby 22.3.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 3205ms 134ms 82.8MB 3133ms 50ms ruby/yjit 3.2.0
ruby 1.rb 3867ms 456ms 82.1MB 3787ms 60ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 942.2MB 4210ms 1413ms truffleruby 22.3.1
v 1.v timeout 0.0ms 16.6MB 5250ms 4327ms v/clang 0.3.2
v 1.v timeout 0.0ms 21.1MB 5033ms 4270ms v/clang+gc 0.3.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 231ms 3.0ms 44.9MB 190ms 27ms ruby/yjit 3.2.0
ruby 1.rb 240ms 0.5ms 44.5MB 203ms 20ms ruby 3.2.0
v 1-m.v 3602ms 203ms 24.5MB 3690ms 3160ms v/clang+gc 0.3.2
v 1-m.v 3937ms 909ms 16.5MB 3953ms 3430ms v/clang 0.3.2
ruby 1.rb timeout 0.0ms 908.0MB 4197ms 1183ms truffleruby 22.3.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 651ms 2.0ms 2.0MB 633ms 0ms v/clang+gc 0.3.2
v 1.v 653ms 3.2ms 2.0MB 637ms 0ms v/clang 0.3.2
ruby 6.rb 2359ms 2.6ms 43.6MB 2327ms 17ms ruby/yjit 3.2.0
ruby 6-m.rb 2687ms 54ms 389.5MB 4817ms 267ms truffleruby 22.3.1
ruby 6.rb 4361ms 91ms 43.0MB 4323ms 20ms ruby 3.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 68ms 0.6ms 2.0MB 60ms 0ms v/clang+gc 0.3.2
v 1.v 70ms 1.7ms 2.1MB 60ms 0ms v/clang 0.3.2
ruby 6.rb 313ms 1.0ms 34.9MB 287ms 13ms ruby/yjit 3.2.0
ruby 6.rb 502ms 1.2ms 34.4MB 467ms 20ms ruby 3.2.0
ruby 6-m.rb 887ms 40ms 341.9MB 1497ms 120ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1.8ms 0.6ms 2.0MB 0ms 0ms v/clang+gc 0.3.2
v 1.v 1.8ms 0.6ms 2.1MB 0ms 0ms v/clang 0.3.2
ruby 1.rb 45ms 2.4ms 154.4MB 18ms 30ms truffleruby 22.3.1
ruby 1.rb 72ms 1.0ms 32.2MB 50ms 10ms ruby 3.2.0
ruby 1.rb 77ms 0.9ms 32.3MB 50ms 12ms ruby/yjit 3.2.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 440ms 2.6ms 52.9MB 400ms 23ms ruby 3.2.0
ruby 1.rb 461ms 9.3ms 54.5MB 410ms 30ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 465.4MB 9110ms 200ms truffleruby 22.3.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 4007ms 6.6ms 174.0MB 3903ms 87ms ruby/yjit 3.2.0
ruby 1.rb 4060ms 98ms 173.9MB 3957ms 90ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 432.6MB 9203ms 197ms truffleruby 22.3.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 403ms 1.5ms 2.2MB 390ms 0ms v/clang+gc 0.3.2
v 1.v 424ms 0.3ms 2.2MB 410ms 0ms v/clang 0.3.2
ruby 1.rb 448ms 2.7ms 33.0MB 420ms 13ms ruby/yjit 3.2.0
ruby 1.rb 602ms 5.0ms 32.3MB 580ms 3ms ruby 3.2.0
ruby 1-m.rb 832ms 33ms 335.1MB 1183ms 100ms truffleruby 22.3.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb 1183ms 7.0ms 33.0MB 1157ms 10ms ruby/yjit 3.2.0
v 1.v 1205ms 2.4ms 2.3MB 1193ms 0ms v/clang+gc 0.3.2
v 1.v 1265ms 1.6ms 2.3MB 1257ms 0ms v/clang 0.3.2
ruby 1.rb 1478ms 87ms 370.8MB 1977ms 150ms truffleruby 22.3.1
ruby 1.rb 1648ms 12ms 32.4MB 1620ms 10ms ruby 3.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 134ms 1.0ms 2.3MB 123ms 0ms v/clang+gc 0.3.2
v 1.v 140ms 0.3ms 2.3MB 130ms 0ms v/clang 0.3.2
ruby 1.rb 264ms 2.9ms 32.9MB 233ms 13ms ruby/yjit 3.2.0
ruby 1.rb 334ms 3.9ms 32.3MB 307ms 17ms ruby 3.2.0
ruby 1-m.rb 619ms 11ms 311.7MB 913ms 103ms truffleruby 22.3.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1.rb timeout 0.0ms 96.4MB 4933ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 97.0MB 4927ms 57ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 562.9MB 9010ms 220ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3464ms 95ms 580.1MB 6290ms 240ms truffleruby 22.3.1
ruby 1.rb 4125ms 19ms 53.7MB 4087ms 23ms ruby/yjit 3.2.0
ruby 1.rb 4936ms 27ms 52.7MB 4890ms 23ms ruby 3.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 871ms 0.8ms 2.3MB 860ms 0ms v/clang 0.3.2
v 1.v 879ms 6.2ms 2.3MB 863ms 0ms v/clang+gc 0.3.2
ruby 2.rb 1036ms 17ms 305.8MB 1233ms 93ms truffleruby 22.3.1
ruby 2.rb timeout 0.0ms 32.1MB 4977ms 7ms ruby 3.2.0
ruby 2.rb timeout 0.0ms 33.0MB 4973ms 10ms ruby/yjit 3.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 90ms 0.2ms 2.3MB 80ms 0ms v/clang+gc 0.3.2
v 1.v 91ms 1.3ms 2.3MB 80ms 0ms v/clang 0.3.2
ruby 2-m.rb 471ms 46ms 316.8MB 680ms 137ms truffleruby 22.3.1
ruby 2.rb 2176ms 4.7ms 33.0MB 2153ms 7ms ruby/yjit 3.2.0
ruby 2.rb 3381ms 35ms 32.3MB 3360ms 3ms ruby 3.2.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 507ms 3.1ms 11.0MB 497ms 0ms v/clang 0.3.2
v 2.v 510ms 3.1ms 10.7MB 493ms 3ms v/clang+gc 0.3.2
v 1.v 1164ms 113ms 41.1MB 1143ms 7ms v/clang+gc 0.3.2
v 1.v 1352ms 95ms 41.2MB 1330ms 7ms v/clang 0.3.2
ruby 1.rb timeout 0.0ms 344.6MB 4840ms 133ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 345.0MB 4827ms 150ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 685.1MB 5010ms 183ms truffleruby 22.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 116ms 0.4ms 4.0MB 107ms 0ms v/clang+gc 0.3.2
v 2.v 117ms 0.7ms 4.1MB 107ms 0ms v/clang 0.3.2
v 1.v 122ms 1.8ms 20.0MB 110ms 0ms v/clang+gc 0.3.2
v 1.v 129ms 2.2ms 20.8MB 113ms 0ms v/clang 0.3.2
ruby 1.rb 3156ms 53ms 419.9MB 3677ms 137ms truffleruby 22.3.1
ruby 1.rb timeout 0.0ms 151.0MB 4920ms 53ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 151.5MB 4923ms 57ms ruby/yjit 3.2.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3901ms 88ms 3.2MB 3873ms 10ms v/clang+gc 0.3.2
ruby 1.rb timeout 0.0ms 157.9MB 4937ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 159.9MB 4923ms 53ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 461.5MB 9333ms 257ms truffleruby 22.3.1
v 1.v timeout 0.0ms 4.0MB 4980ms 7ms v/clang 0.3.2
v 2.v timeout 0.0ms 3.3MB 4983ms 7ms v/clang+gc 0.3.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 959ms 2.4ms 2.9MB 947ms 0ms v/clang+gc 0.3.2
v 1.v 1425ms 42ms 2.9MB 1410ms 0ms v/clang 0.3.2
v 2.v 1737ms 35ms 2.7MB 1723ms 0ms v/clang+gc 0.3.2
ruby 1-m.rb 2020ms 26ms 435.4MB 3657ms 173ms truffleruby 22.3.1
ruby 1.rb 2424ms 8.0ms 158.0MB 2343ms 63ms ruby 3.2.0
ruby 1.rb 2426ms 8.8ms 159.8MB 2343ms 67ms ruby/yjit 3.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 4.rb timeout 0.0ms 32.1MB 4967ms 13ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 566.4MB 5240ms 247ms truffleruby 22.3.1
v 1.v timeout 0.0ms 3.0MB 4983ms 0ms v/clang 0.3.2
v 1.v timeout 0.0ms 3.1MB 4987ms 0ms v/clang+gc 0.3.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1551ms 0.4ms 2.8MB 1537ms 0ms v/clang 0.3.2
v 1.v 1556ms 5.3ms 2.8MB 1543ms 0ms v/clang+gc 0.3.2
ruby 4.rb timeout 0.0ms 32.2MB 4973ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4973ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 562.1MB 5453ms 223ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 393ms 0.4ms 2.6MB 380ms 0ms v/clang+gc 0.3.2
v 1.v 400ms 9.6ms 2.5MB 380ms 0ms v/clang 0.3.2
ruby 4.rb 2585ms 15ms 476.7MB 3107ms 167ms truffleruby 22.3.1
ruby 4.rb timeout 0.0ms 32.4MB 4967ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.7MB 4967ms 13ms ruby/yjit 3.2.0