Programming Language and compiler
Benchmarks

Lua VS Ruby benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 119.5MB 4937ms 47ms lua 5.4.4
lua 1.lua timeout 0.0ms 174.6MB 4930ms 50ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 72.6MB 4943ms 40ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 115.6MB 4917ms 60ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 612.7MB 8020ms 290ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 404ms 4.7ms 25.0MB 383ms 7ms luajit 2.1.0-beta3
ruby 1.rb 565ms 6.7ms 40.7MB 530ms 17ms ruby/yjit 3.2.0
ruby 1.rb 1011ms 5.8ms 40.3MB 973ms 20ms ruby 3.2.0
lua 1.lua 1057ms 15ms 17.3MB 1043ms 0ms lua 5.4.4
ruby 1-m.rb 1081ms 25ms 419.3MB 1780ms 140ms truffleruby 22.3.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.9ms 0.4ms 2.3MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 2.1ms 0.8ms 1.5MB 0ms 0ms lua 5.4.4
ruby 1.rb 45ms 2.4ms 154.4MB 18ms 30ms truffleruby 22.3.1
ruby 1.rb 72ms 1.0ms 32.2MB 50ms 10ms ruby 3.2.0
ruby 1.rb 77ms 0.9ms 32.3MB 50ms 12ms ruby/yjit 3.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 159.2MB 4920ms 60ms lua 5.4.4
lua 1.lua timeout 0.0ms 180.9MB 4913ms 70ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 96.4MB 4933ms 47ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 97.0MB 4927ms 57ms ruby/yjit 3.2.0
ruby 1.rb timeout 0.0ms 562.9MB 9010ms 220ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1517ms 29ms 36.2MB 1490ms 13ms luajit 2.1.0-beta3
lua 1.lua 2818ms 14ms 41.6MB 2790ms 10ms lua 5.4.4
ruby 1-m.rb 3464ms 95ms 580.1MB 6290ms 240ms truffleruby 22.3.1
ruby 1.rb 4125ms 19ms 53.7MB 4087ms 23ms ruby/yjit 3.2.0
ruby 1.rb 4936ms 27ms 52.7MB 4890ms 23ms ruby 3.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 1036ms 17ms 305.8MB 1233ms 93ms truffleruby 22.3.1
lua 4.lua 1105ms 6.1ms 1.4MB 1097ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.5MB 4990ms 0ms lua 5.4.4
ruby 2.rb timeout 0.0ms 32.1MB 4977ms 7ms ruby 3.2.0
ruby 2.rb timeout 0.0ms 33.0MB 4973ms 10ms ruby/yjit 3.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 115ms 2.8ms 1.4MB 103ms 0ms luajit 2.1.0-beta3
ruby 2-m.rb 471ms 46ms 316.8MB 680ms 137ms truffleruby 22.3.1
lua 4.lua 1205ms 19ms 1.5MB 1193ms 0ms lua 5.4.4
ruby 2.rb 2176ms 4.7ms 33.0MB 2153ms 7ms ruby/yjit 3.2.0
ruby 2.rb 3381ms 35ms 32.3MB 3360ms 3ms ruby 3.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.6MB 4990ms 0ms luajit 2.1.0-beta3
ruby 4.rb timeout 0.0ms 32.1MB 4967ms 13ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 566.4MB 5240ms 247ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1559ms 3.6ms 2.6MB 1550ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.2MB 4987ms 0ms lua 5.4.4
ruby 4.rb timeout 0.0ms 32.2MB 4973ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.8MB 4973ms 13ms ruby/yjit 3.2.0
ruby 4.rb timeout 0.0ms 562.1MB 5453ms 223ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 394ms 0.9ms 1.4MB 380ms 0ms luajit 2.1.0-beta3
ruby 4.rb 2585ms 15ms 476.7MB 3107ms 167ms truffleruby 22.3.1
lua 1.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4
ruby 4.rb timeout 0.0ms 32.4MB 4967ms 10ms ruby 3.2.0
ruby 4.rb timeout 0.0ms 32.7MB 4967ms 13ms ruby/yjit 3.2.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 557ms 2.6ms 5.0MB 543ms 0ms luajit 2.1.0-beta3
ruby 1.rb 3205ms 134ms 82.8MB 3133ms 50ms ruby/yjit 3.2.0
ruby 1.rb 3867ms 456ms 82.1MB 3787ms 60ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 942.2MB 4210ms 1413ms truffleruby 22.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 39ms 1.3ms 3.1MB 30ms 0ms luajit 2.1.0-beta3
ruby 1.rb 231ms 3.0ms 44.9MB 190ms 27ms ruby/yjit 3.2.0
ruby 1.rb 240ms 0.5ms 44.5MB 203ms 20ms ruby 3.2.0
ruby 1.rb timeout 0.0ms 908.0MB 4197ms 1183ms truffleruby 22.3.1