Lua VS Wasm benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 2274ms 4.1ms 30.8MB 2253ms 7ms wasmedgec 0.11.2
wasm 3.rs 2299ms 23ms 47.3MB 2267ms 17ms wasmedgec 0.11.2
wasm 4.rs 2410ms 3.3ms 31.3MB 2390ms 7ms wasmedgec 0.11.2
wasm 5.rs 2774ms 29ms 59.2MB 2767ms 17ms node 16.19.0
wasm 5.rs 2891ms 59ms 26.6MB 2873ms 7ms wasmtime 5.0.0
wasm 4.rs 2914ms 11ms 59.2MB 2917ms 7ms node 16.19.0
wasm 3.rs 2930ms 48ms 74.3MB 2913ms 20ms node 16.19.0
wasm 4.rs 2960ms 14ms 26.5MB 2943ms 3ms wasmtime 5.0.0
wasm 3.rs 3131ms 15ms 42.6MB 3103ms 13ms wasmtime 5.0.0
lua 1.lua timeout 0.0ms 119.6MB 4927ms 57ms lua 5.4.4
lua 1.lua timeout 0.0ms 176.2MB 4913ms 67ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 211ms 2.5ms 19.6MB 190ms 0ms wasmedgec 0.11.2
wasm 5.rs 215ms 2.0ms 17.9MB 200ms 0ms wasmedgec 0.11.2
wasm 4.rs 229ms 0.4ms 17.2MB 213ms 0ms wasmedgec 0.11.2
wasm 5.rs 265ms 0.7ms 12.7MB 250ms 0ms wasmtime 5.0.0
wasm 4.rs 273ms 0.2ms 12.7MB 260ms 0ms wasmtime 5.0.0
wasm 3.rs 284ms 3.3ms 14.8MB 270ms 0ms wasmtime 5.0.0
wasm 5.rs 327ms 2.8ms 44.8MB 323ms 7ms node 16.19.0
wasm 3.rs 329ms 7.8ms 46.1MB 323ms 13ms node 16.19.0
wasm 4.rs 346ms 4.9ms 45.1MB 347ms 3ms node 16.19.0
lua 1.lua 478ms 3.0ms 24.7MB 453ms 7ms luajit 2.1.0-beta3
lua 1.lua 1214ms 12ms 17.3MB 1197ms 0ms lua 5.4.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.0ms 0.4ms 2.5MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 2.3ms 0.7ms 1.4MB 0ms 0ms lua 5.4.4
wasm 1.rs 5.9ms 0.8ms 11.2MB 0ms 0ms wasmtime 5.0.0
wasm 1.rs 6.8ms 0.7ms 15.9MB 0ms 0ms wasmedgec 0.11.2
wasm 1.rs 84ms 1.8ms 43.4MB 96ms 4ms node 16.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1256ms 2.7ms 38.6MB 1230ms 10ms wasmedgec 0.11.2
wasm 1.rs 1440ms 29ms 34.9MB 1413ms 10ms wasmtime 5.0.0
wasm 1.rs 1447ms 17ms 66.9MB 1437ms 17ms node 16.19.0
lua 1.lua timeout 0.0ms 159.1MB 4917ms 63ms lua 5.4.4
lua 1.lua timeout 0.0ms 180.9MB 4890ms 90ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 267ms 1.2ms 21.9MB 250ms 0ms wasmedgec 0.11.2
wasm 1.rs 301ms 1.9ms 17.0MB 287ms 0ms wasmtime 5.0.0
wasm 1.rs 368ms 1.8ms 49.4MB 363ms 10ms node 16.19.0
lua 1.lua 1836ms 89ms 36.3MB 1813ms 3ms luajit 2.1.0-beta3
lua 1.lua 3056ms 30ms 41.6MB 3020ms 17ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 569ms 1.1ms 9.4MB 553ms 0ms wasmtime 5.0.0
wasm 1.rs 606ms 0.3ms 15.8MB 590ms 0ms wasmedgec 0.11.2
wasm 1.rs 660ms 3.1ms 48.1MB 677ms 7ms node 16.19.0
wasm 2.rs 802ms 3.5ms 11.2MB 787ms 0ms wasmtime 5.0.0
wasm 2.rs 836ms 4.9ms 15.4MB 820ms 0ms wasmedgec 0.11.2
wasm 2.rs 892ms 2.1ms 48.8MB 907ms 13ms node 16.19.0
lua 4.lua 1110ms 1.0ms 1.4MB 1100ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 1.4MB 4987ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 66ms 1.8ms 11.3MB 50ms 0ms wasmtime 5.0.0
wasm 1.rs 69ms 0.9ms 15.8MB 57ms 0ms wasmedgec 0.11.2
wasm 2.rs 90ms 1.2ms 11.3MB 77ms 0ms wasmtime 5.0.0
wasm 2.rs 91ms 0.3ms 15.5MB 80ms 0ms wasmedgec 0.11.2
lua 4.lua 117ms 2.1ms 1.4MB 103ms 0ms luajit 2.1.0-beta3
wasm 1.rs 157ms 2.7ms 48.1MB 177ms 3ms node 16.19.0
wasm 2.rs 183ms 1.1ms 48.6MB 200ms 7ms node 16.19.0
lua 4.lua 1567ms 89ms 1.5MB 1557ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3638ms 1.8ms 15.6MB 3623ms 0ms wasmedgec 0.11.2
wasm 7.rs 3675ms 0.2ms 16.7MB 3660ms 0ms wasmedgec 0.11.2
wasm 2.rs 4011ms 8.8ms 11.2MB 3997ms 0ms wasmtime 5.0.0
wasm 7.rs 4036ms 4.9ms 11.3MB 4023ms 0ms wasmtime 5.0.0
wasm 7.rs 4129ms 1.5ms 48.7MB 4140ms 10ms node 16.19.0
wasm 2.rs 4441ms 10ms 48.7MB 4450ms 17ms node 16.19.0
lua 1.lua timeout 0.0ms 2.2MB 4990ms 0ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.6MB 4987ms 0ms luajit 2.1.0-beta3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 920ms 1.0ms 15.3MB 907ms 0ms wasmedgec 0.11.2
wasm 7.rs 927ms 0.9ms 16.4MB 910ms 0ms wasmedgec 0.11.2
wasm 2.rs 1015ms 3.7ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1015ms 1.0ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1117ms 2.5ms 48.7MB 1133ms 10ms node 16.19.0
wasm 2.rs 1190ms 5.4ms 52.2MB 1193ms 17ms node 16.19.0
lua 1.lua 1405ms 0.1ms 2.5MB 1390ms 0ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 2.2MB 4983ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 238ms 1.7ms 15.8MB 230ms 0ms wasmedgec 0.11.2
wasm 7.rs 239ms 1.9ms 15.2MB 223ms 0ms wasmedgec 0.11.2
wasm 2.rs 260ms 0.8ms 11.2MB 243ms 3ms wasmtime 5.0.0
wasm 7.rs 261ms 0.7ms 9.4MB 247ms 0ms wasmtime 5.0.0
wasm 7.rs 358ms 3.4ms 48.6MB 370ms 13ms node 16.19.0
lua 1.lua 360ms 6.5ms 1.4MB 347ms 0ms luajit 2.1.0-beta3
wasm 2.rs 375ms 4.5ms 48.4MB 390ms 10ms node 16.19.0
lua 1.lua timeout 0.0ms 1.4MB 4980ms 0ms lua 5.4.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 579ms 2.4ms 5.1MB 563ms 0ms luajit 2.1.0-beta3
wasm 3.rs 1543ms 32ms 50.6MB 1583ms 10ms node 16.19.0
wasm 3.rs 1657ms 2.8ms 12.6MB 1647ms 0ms wasmtime 5.0.0
wasm 3.rs 2076ms 4.9ms 17.2MB 2057ms 0ms wasmedgec 0.11.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 36ms 1.0ms 3.1MB 30ms 0ms luajit 2.1.0-beta3
wasm 3.rs 110ms 1.7ms 11.2MB 100ms 0ms wasmtime 5.0.0
wasm 3.rs 146ms 13ms 17.0MB 127ms 0ms wasmedgec 0.11.2
wasm 3.rs 214ms 4.5ms 48.8MB 250ms 10ms node 16.19.0