Lua VS Wasm benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1735ms 38ms 51.3MB 1700ms 17ms wasmtime 29.0.1
wasm 4.rs 1755ms 3.5ms 35.3MB 1730ms 13ms wasmtime 29.0.1
wasm 5.rs 1769ms 18ms 37.2MB 1753ms 3ms wasmtime 29.0.1
lua 1.lua 3542ms 27ms 172.9MB 3407ms 117ms luajit 2.1.0-beta3
lua 1.lua timeout 0.0ms 104.9MB 4943ms 40ms lua 5.4.7

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 170ms 0.9ms 21.3MB 160ms 0ms wasmtime 29.0.1
wasm 4.rs 171ms 2.2ms 23.3MB 160ms 0ms wasmtime 29.0.1
wasm 3.rs 172ms 6.1ms 23.3MB 160ms 3ms wasmtime 29.0.1
lua 1.lua 291ms 1.8ms 15.8MB 267ms 3ms luajit 2.1.0-beta3
lua 1.lua 819ms 1.8ms 16.9MB 803ms 7ms lua 5.4.7

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 1.5ms 0.1ms 2.4MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 1.8ms 0.4ms 2.1MB 0ms 0ms lua 5.4.7
wasm 1.rs 7.3ms 0.2ms 20.6MB 0ms 0ms wasmtime 29.0.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 886ms 9.9ms 45.3MB 853ms 17ms wasmtime 29.0.1
lua 1.lua timeout 0.0ms 107.5MB 4940ms 47ms lua 5.4.7
lua 1.lua timeout 0.0ms 149.3MB 4933ms 47ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 192ms 0.4ms 25.3MB 177ms 3ms wasmtime 29.0.1
lua 1.lua 1152ms 5.2ms 31.1MB 1120ms 17ms luajit 2.1.0-beta3
lua 1.lua 2299ms 31ms 28.6MB 2263ms 20ms lua 5.4.7

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 407ms 1.8ms 19.2MB 390ms 0ms wasmtime 29.0.1
wasm 2.rs 579ms 1.4ms 19.2MB 563ms 0ms wasmtime 29.0.1
lua 4.lua 725ms 27ms 2.3MB 717ms 0ms luajit 2.1.0-beta3
lua 4.lua timeout 0.0ms 2.3MB 4990ms 0ms lua 5.4.7

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 49ms 0.4ms 21.2MB 37ms 0ms wasmtime 29.0.1
wasm 2.rs 66ms 1.1ms 19.2MB 57ms 0ms wasmtime 29.0.1
lua 4.lua 74ms 1.2ms 2.3MB 67ms 0ms luajit 2.1.0-beta3
lua 4.lua 1103ms 17ms 2.3MB 1090ms 0ms lua 5.4.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3585ms 7.0ms 19.0MB 3567ms 0ms wasmtime 29.0.1
lua 1.lua 4060ms 12ms 2.5MB 4047ms 0ms luajit 2.1.0-beta3
wasm 7.rs 4890ms 13ms 21.0MB 4873ms 0ms wasmtime 29.0.1
lua 1.lua timeout 0.0ms 2.5MB 4987ms 0ms lua 5.4.7

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 905ms 2.5ms 20.9MB 890ms 3ms wasmtime 29.0.1
lua 1.lua 1017ms 2.5ms 2.4MB 1010ms 0ms luajit 2.1.0-beta3
wasm 7.rs 1227ms 3.4ms 20.7MB 1210ms 0ms wasmtime 29.0.1
lua 1.lua timeout 0.0ms 2.1MB 4990ms 0ms lua 5.4.7

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 243ms 13ms 18.8MB 230ms 0ms wasmtime 29.0.1
lua 1.lua 257ms 0.2ms 2.3MB 247ms 0ms luajit 2.1.0-beta3
wasm 7.rs 315ms 2.2ms 20.7MB 300ms 0ms wasmtime 29.0.1
lua 1.lua timeout 0.0ms 2.0MB 4987ms 0ms lua 5.4.7