Programming Language and compiler
Benchmarks

Lua VS Ruby benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 3568ms 87ms 172.9MB 3433ms 120ms luajit 2.1.0-beta3
ruby 1.rb 4037ms 417ms 123.9MB 3920ms 100ms ruby/yjit 3.3.0
lua 1.lua timeout 0.0ms 105.0MB 4950ms 40ms lua 5.4.6
ruby 1.rb timeout 0.0ms 85.3MB 4930ms 53ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 679.9MB 9080ms 607ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 290ms 1.7ms 15.6MB 270ms 7ms luajit 2.1.0-beta3
ruby 1.rb 408ms 6.3ms 36.4MB 367ms 27ms ruby/yjit 3.3.0
lua 1.lua 855ms 12ms 17.0MB 840ms 3ms lua 5.4.6
ruby 1.rb 856ms 5.9ms 36.4MB 813ms 20ms ruby 3.3.0
ruby 1-m.rb 910ms 25ms 437.3MB 2027ms 183ms truffleruby 23.1.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.1ms 2.1MB 0ms 0ms lua 5.4.6
lua 1.lua 1.5ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
ruby 1.rb 41ms 0.2ms 161.9MB 8ms 32ms truffleruby 23.1.2
ruby 1.rb 70ms 2.0ms 28.3MB 46ms 12ms ruby 3.3.0
ruby 1.rb 72ms 1.8ms 28.4MB 46ms 16ms ruby/yjit 3.3.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua timeout 0.0ms 107.4MB 4950ms 40ms lua 5.4.6
lua 1.lua timeout 0.0ms 149.3MB 4937ms 53ms luajit 2.1.0-beta3
ruby 1.rb timeout 0.0ms 87.8MB 4917ms 73ms ruby 3.3.0
ruby 1.rb timeout 0.0ms 88.2MB 4917ms 67ms ruby/yjit 3.3.0
ruby 1.rb timeout 0.0ms 575.9MB 12800ms 437ms truffleruby 23.1.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1196ms 6.5ms 31.3MB 1160ms 20ms luajit 2.1.0-beta3
lua 1.lua 2323ms 26ms 28.8MB 2303ms 3ms lua 5.4.6
ruby 1-m.rb 2642ms 152ms 618.4MB 6900ms 303ms truffleruby 23.1.2
ruby 1.rb 3031ms 1.4ms 46.8MB 2987ms 30ms ruby/yjit 3.3.0
ruby 1.rb 4013ms 75ms 46.5MB 3970ms 23ms ruby 3.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 707ms 1.1ms 2.4MB 697ms 0ms luajit 2.1.0-beta3
ruby 2.rb 953ms 118ms 319.9MB 1190ms 110ms truffleruby 23.1.2
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6
ruby 2.rb timeout 0.0ms 28.1MB 4967ms 17ms ruby 3.3.0
ruby 2.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 4.lua 76ms 2.8ms 2.4MB 63ms 0ms luajit 2.1.0-beta3
ruby 2-m.rb 319ms 5.4ms 312.4MB 540ms 113ms truffleruby 23.1.2
lua 4.lua 1138ms 22ms 2.3MB 1127ms 0ms lua 5.4.6
ruby 2.rb 1455ms 8.4ms 28.4MB 1423ms 17ms ruby/yjit 3.3.0
ruby 2.rb 2876ms 37ms 28.1MB 2840ms 20ms ruby 3.3.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 4049ms 5.8ms 2.5MB 4037ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.4MB 4990ms 0ms lua 5.4.6
ruby 4.rb timeout 0.0ms 28.1MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 17ms ruby/yjit 3.3.0
ruby 4.rb timeout 0.0ms 527.7MB 5150ms 253ms truffleruby 23.1.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1015ms 1.6ms 2.4MB 1003ms 0ms luajit 2.1.0-beta3
ruby 4.rb 4605ms 65ms 509.3MB 4857ms 220ms truffleruby 23.1.2
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6
ruby 4.rb timeout 0.0ms 28.1MB 4967ms 20ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.5MB 4963ms 20ms ruby/yjit 3.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 259ms 2.7ms 2.3MB 250ms 0ms luajit 2.1.0-beta3
ruby 4.rb 1257ms 60ms 358.6MB 1563ms 133ms truffleruby 23.1.2
lua 1.lua timeout 0.0ms 2.0MB 4993ms 0ms lua 5.4.6
ruby 4.rb timeout 0.0ms 28.3MB 4973ms 10ms ruby 3.3.0
ruby 4.rb timeout 0.0ms 28.4MB 4970ms 13ms ruby/yjit 3.3.0