Lua VS Ruby benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 3037ms 2639ms 793.8MB 6587ms 477ms truffleruby 24.1.1
lua 1.lua 3498ms 64ms 172.9MB 3367ms 120ms luajit 2.1.0-beta3
ruby 1.rb 3763ms 40ms 113.5MB 3657ms 90ms ruby/yjit 3.3.6
lua 1.lua timeout 0.0ms 104.9MB 4943ms 40ms lua 5.4.7
ruby 1.rb timeout 0.0ms 78.9MB 4930ms 50ms ruby 3.3.6

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 294ms 1.7ms 15.8MB 273ms 7ms luajit 2.1.0-beta3
ruby 1.rb 411ms 3.8ms 36.4MB 370ms 23ms ruby/yjit 3.3.6
ruby 1-m.rb 587ms 83ms 434.3MB 1170ms 163ms truffleruby 24.1.1
lua 1.lua 809ms 6.7ms 16.9MB 787ms 3ms lua 5.4.7
ruby 1.rb 847ms 11ms 36.3MB 807ms 27ms ruby 3.3.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.2ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.5ms 0.1ms 2.1MB 0ms 0ms lua 5.4.7
ruby 1.rb 41ms 0.8ms 168.5MB 20ms 26ms truffleruby 24.1.1
ruby 1.rb 69ms 1.8ms 28.0MB 48ms 12ms ruby 3.3.6
ruby 1.rb 70ms 0.6ms 28.1MB 42ms 14ms ruby/yjit 3.3.6

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ruby 1-m.rb 4499ms 14ms 553.8MB 11583ms 350ms truffleruby 24.1.1
lua 1.lua timeout 0.0ms 107.4MB 4943ms 37ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.4MB 4927ms 57ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 88.0MB 4917ms 70ms ruby 3.3.6
ruby 1.rb timeout 0.0ms 88.2MB 4910ms 70ms ruby/yjit 3.3.6

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1219ms 75ms 31.1MB 1190ms 13ms luajit 2.1.0-beta3
ruby 1-m.rb 2205ms 87ms 510.9MB 5660ms 270ms truffleruby 24.1.1
lua 1.lua 2236ms 90ms 28.6MB 2217ms 3ms lua 5.4.7
ruby 1.rb 3025ms 9.5ms 47.1MB 2983ms 27ms ruby/yjit 3.3.6
ruby 1.rb 4035ms 24ms 46.9MB 3990ms 30ms ruby 3.3.6

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 716ms 2.9ms 2.4MB 707ms 0ms luajit 2.1.0-beta3
ruby 2.rb 861ms 20ms 329.1MB 1117ms 120ms truffleruby 24.1.1
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7
ruby 2.rb timeout 0.0ms 28.0MB 4967ms 17ms ruby 3.3.6
ruby 2.rb timeout 0.0ms 28.3MB 4963ms 17ms ruby/yjit 3.3.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 75ms 2.5ms 2.3MB 67ms 0ms luajit 2.1.0-beta3
ruby 2-m.rb 323ms 3.4ms 328.9MB 570ms 107ms truffleruby 24.1.1
lua 4.lua 1124ms 21ms 2.3MB 1113ms 0ms lua 5.4.7
ruby 2.rb 1450ms 8.5ms 28.3MB 1413ms 23ms ruby/yjit 3.3.6
ruby 2.rb 2881ms 59ms 28.1MB 2850ms 20ms ruby 3.3.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 4048ms 11ms 2.5MB 4037ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.5MB 4990ms 0ms lua 5.4.7
ruby 4.rb timeout 0.0ms 28.1MB 4970ms 20ms ruby 3.3.6
ruby 4.rb timeout 0.0ms 28.3MB 4967ms 17ms ruby/yjit 3.3.6
ruby 4.rb timeout 0.0ms 455.7MB 5143ms 237ms truffleruby 24.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1016ms 1.5ms 2.4MB 1003ms 0ms luajit 2.1.0-beta3
ruby 4.rb 4475ms 23ms 439.6MB 4760ms 200ms truffleruby 24.1.1
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7
ruby 4.rb timeout 0.0ms 28.0MB 4960ms 20ms ruby 3.3.6
ruby 4.rb timeout 0.0ms 28.3MB 4963ms 20ms ruby/yjit 3.3.6

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 257ms 0.8ms 2.3MB 243ms 0ms luajit 2.1.0-beta3
ruby 4.rb 1235ms 59ms 393.4MB 1547ms 143ms truffleruby 24.1.1
lua 1.lua timeout 0.0ms 2.0MB 4990ms 0ms lua 5.4.7
ruby 4.rb timeout 0.0ms 28.1MB 4973ms 13ms ruby 3.3.6
ruby 4.rb timeout 0.0ms 28.3MB 4963ms 20ms ruby/yjit 3.3.6