Lua VS Ruby benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 119.5MB 4953ms 27ms lua 5.4.4
lua 1.lua timeout 0.0ms 209.4MB 4930ms 50ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 72.7MB 4953ms 33ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 115.5MB 4917ms 63ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 769.5MB 7713ms 377ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 416ms 5.6ms 25.2MB 393ms 10ms luajit 2.1.0-beta3
ruby 1.rb 533ms 1.9ms 40.7MB 503ms 13ms ruby/yjit 3.2.2
ruby 1.rb 969ms 5.3ms 40.2MB 943ms 10ms ruby 3.2.2
ruby 1-m.rb 984ms 52ms 414.6MB 1597ms 140ms truffleruby 22.3.1
lua 1.lua 1062ms 12ms 17.4MB 1040ms 3ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.9ms 0.2ms 2.3MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 3.0ms 2.4ms 1.5MB 0ms 0ms lua 5.4.4
ruby 1.rb 43ms 2.1ms 157.2MB 16ms 26ms truffleruby 22.3.1
ruby 1.rb 71ms 1.0ms 32.2MB 48ms 10ms ruby/yjit 3.2.2
ruby 1.rb 71ms 0.6ms 32.0MB 50ms 8ms ruby 3.2.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 159.2MB 4940ms 43ms lua 5.4.4
lua 1.lua timeout 0.0ms 183.3MB 4927ms 53ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 96.5MB 4927ms 60ms ruby 3.2.2
ruby 1.rb timeout 0.0ms 97.0MB 4930ms 50ms ruby/yjit 3.2.2
ruby 1.rb timeout 0.0ms 572.5MB 9213ms 233ms truffleruby 22.3.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1526ms 27ms 36.0MB 1503ms 7ms luajit 2.1.0-beta3
lua 1.lua 2805ms 35ms 41.6MB 2773ms 13ms lua 5.4.4
ruby 1-m.rb 3266ms 25ms 595.8MB 5983ms 230ms truffleruby 22.3.1
ruby 1.rb 4134ms 16ms 53.6MB 4087ms 30ms ruby/yjit 3.2.2
ruby 1.rb 4915ms 13ms 52.8MB 4870ms 30ms ruby 3.2.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 2.rb 1022ms 5.5ms 306.4MB 1213ms 87ms truffleruby 22.3.1
lua 4.lua 1109ms 7.7ms 1.4MB 1097ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4
ruby 2.rb timeout 0.0ms 32.2MB 4967ms 17ms ruby 3.2.2
ruby 2.rb timeout 0.0ms 32.9MB 4977ms 3ms ruby/yjit 3.2.2

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 118ms 7.0ms 1.4MB 110ms 0ms luajit 2.1.0-beta3
ruby 2-m.rb 387ms 13ms 323.0MB 587ms 87ms truffleruby 22.3.1
lua 4.lua 1211ms 12ms 1.4MB 1200ms 0ms lua 5.4.4
ruby 2.rb 2106ms 0.9ms 32.9MB 2080ms 10ms ruby/yjit 3.2.2
ruby 2.rb 3217ms 21ms 32.3MB 3187ms 10ms ruby 3.2.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms luajit 2.1.0-beta3
ruby 4.rb timeout 0.0ms 32.1MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 10ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 533.5MB 5240ms 213ms truffleruby 22.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1559ms 1.5ms 2.5MB 1547ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4
ruby 4.rb timeout 0.0ms 32.2MB 4977ms 3ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.7MB 4973ms 7ms ruby/yjit 3.2.2
ruby 4.rb timeout 0.0ms 591.7MB 5390ms 237ms truffleruby 22.3.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 393ms 0.7ms 1.4MB 383ms 0ms luajit 2.1.0-beta3
ruby 4.rb 2469ms 3.3ms 477.2MB 2927ms 177ms truffleruby 22.3.1
lua 1.lua timeout 0.0ms 1.5MB 4987ms 0ms lua 5.4.4
ruby 4.rb timeout 0.0ms 32.4MB 4973ms 7ms ruby 3.2.2
ruby 4.rb timeout 0.0ms 32.8MB 4970ms 13ms ruby/yjit 3.2.2