Lua VS Wasm benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1832ms 18ms 82.0MB 1817ms 23ms node 18.19.0
wasm 5.rs 1873ms 10ms 65.7MB 1860ms 20ms node 18.19.0
wasm 4.rs 1910ms 6.6ms 34.9MB 1893ms 3ms wasmtime 17.0.0
wasm 3.rs 1959ms 30ms 50.9MB 1923ms 20ms wasmtime 17.0.0
wasm 5.rs 2022ms 10ms 34.9MB 1997ms 3ms wasmtime 17.0.0
wasm 4.rs 2156ms 42ms 66.8MB 2137ms 20ms node 18.19.0
lua 1.lua 3568ms 87ms 172.9MB 3433ms 120ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 105.0MB 4950ms 40ms lua 5.4.6

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 4.rs 184ms 4.7ms 20.9MB 167ms 0ms wasmtime 17.0.0
wasm 3.rs 186ms 4.3ms 22.9MB 167ms 0ms wasmtime 17.0.0
wasm 5.rs 194ms 1.5ms 20.9MB 180ms 0ms wasmtime 17.0.0
wasm 3.rs 208ms 1.9ms 53.2MB 190ms 23ms node 18.19.0
wasm 5.rs 215ms 1.7ms 53.0MB 210ms 7ms node 18.19.0
wasm 4.rs 252ms 15ms 53.0MB 240ms 13ms node 18.19.0
lua 1.lua 290ms 1.7ms 15.6MB 270ms 7ms luajit 2.1.0-beta3
lua 1.lua 855ms 12ms 17.0MB 840ms 3ms lua 5.4.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.1ms 2.1MB 0ms 0ms lua 5.4.6
lua 1.lua 1.5ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
wasm 1.rs 6.8ms 0.2ms 19.0MB 0ms 0ms wasmtime 17.0.0
wasm 1.rs 37ms 0.7ms 48.6MB 24ms 4ms node 18.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 994ms 15ms 42.9MB 967ms 13ms wasmtime 17.0.0
wasm 1.rs 1049ms 26ms 74.0MB 1027ms 20ms node 18.19.0
lua 1.lua timeout 0.0ms 107.4MB 4950ms 40ms lua 5.4.6
lua 1.lua timeout 0.0ms 149.3MB 4937ms 53ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 222ms 0.8ms 24.9MB 210ms 0ms wasmtime 17.0.0
wasm 1.rs 258ms 2.2ms 55.9MB 243ms 17ms node 18.19.0
lua 1.lua 1196ms 6.5ms 31.3MB 1160ms 20ms luajit 2.1.0-beta3
lua 1.lua 2323ms 26ms 28.8MB 2303ms 3ms lua 5.4.6

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 448ms 1.3ms 18.8MB 430ms 0ms wasmtime 17.0.0
wasm 2.rs 569ms 0.7ms 18.8MB 557ms 0ms wasmtime 17.0.0
lua 4.lua 707ms 1.1ms 2.4MB 697ms 0ms luajit 2.1.0-beta3
wasm 1.rs 787ms 145ms 50.0MB 773ms 7ms node 18.19.0
wasm 2.rs 871ms 3.1ms 51.1MB 860ms 7ms node 18.19.0
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 54ms 1.0ms 18.8MB 40ms 3ms wasmtime 17.0.0
wasm 2.rs 66ms 0.7ms 18.8MB 53ms 0ms wasmtime 17.0.0
lua 4.lua 76ms 2.8ms 2.4MB 63ms 0ms luajit 2.1.0-beta3
wasm 1.rs 104ms 2.6ms 50.1MB 93ms 10ms node 18.19.0
wasm 2.rs 122ms 0.7ms 50.8MB 110ms 7ms node 18.19.0
lua 4.lua 1138ms 22ms 2.3MB 1127ms 0ms lua 5.4.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 7.rs 3705ms 9.4ms 49.9MB 3690ms 7ms node 18.19.0
wasm 2.rs 3742ms 13ms 18.3MB 3727ms 0ms wasmtime 17.0.0
wasm 2.rs 3746ms 4.9ms 49.7MB 3730ms 7ms node 18.19.0
lua 1.lua 4049ms 5.8ms 2.5MB 4037ms 0ms luajit 2.1.0-beta3
wasm 7.rs 4973ms 5.7ms 18.3MB 4957ms 3ms wasmtime 17.0.0
lua 1.lua timeout 0.0ms 2.4MB 4990ms 0ms lua 5.4.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 942ms 1.0ms 18.3MB 930ms 0ms wasmtime 17.0.0
wasm 7.rs 954ms 2.8ms 49.9MB 937ms 10ms node 18.19.0
wasm 2.rs 963ms 1.3ms 49.4MB 953ms 3ms node 18.19.0
lua 1.lua 1015ms 1.6ms 2.4MB 1003ms 0ms luajit 2.1.0-beta3
wasm 7.rs 1251ms 3.1ms 18.2MB 1237ms 0ms wasmtime 17.0.0
lua 1.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.6

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 245ms 0.7ms 18.7MB 230ms 0ms wasmtime 17.0.0
lua 1.lua 259ms 2.7ms 2.3MB 250ms 0ms luajit 2.1.0-beta3
wasm 7.rs 268ms 1.8ms 49.7MB 253ms 10ms node 18.19.0
wasm 2.rs 271ms 2.4ms 49.3MB 263ms 3ms node 18.19.0
wasm 7.rs 320ms 1.0ms 18.2MB 303ms 0ms wasmtime 17.0.0
lua 1.lua timeout 0.0ms 2.0MB 4993ms 0ms lua 5.4.6