Hack VS Wasm benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1991ms 14ms 51.1MB 1967ms 7ms wasmedgec 0.11.0
wasm 3.rs 2042ms 6.2ms 37.8MB 2010ms 17ms wasmer/llvm 2.3.0
wasm 5.rs 2143ms 150ms 35.0MB 2123ms 0ms wasmedgec 0.11.0
wasm 4.rs 2223ms 3.6ms 34.4MB 2203ms 7ms wasmedgec 0.11.0
wasm 4.rs 2416ms 8.0ms 21.7MB 2390ms 7ms wasmer/llvm 2.3.0
wasm 3.rs 2477ms 19ms 42.5MB 2457ms 0ms wasmtime 1.0.0
wasm 5.rs 2565ms 1.4ms 21.9MB 2547ms 10ms wasmer/llvm 2.3.0
wasm 5.rs 2651ms 56ms 59.5MB 2637ms 17ms node 16.17.0
wasm 4.rs 2771ms 42ms 58.6MB 2777ms 13ms node 16.17.0
wasm 3.rs 2796ms 31ms 78.0MB 2793ms 20ms node 16.17.0
wasm 5.rs 2916ms 20ms 26.6MB 2893ms 7ms wasmtime 1.0.0
wasm 4.rs 3153ms 28ms 26.5MB 3130ms 7ms wasmtime 1.0.0
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 192ms 0.5ms 9.8MB 173ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 194ms 7.6ms 23.0MB 180ms 0ms wasmedgec 0.11.0
wasm 5.rs 211ms 19ms 21.0MB 197ms 0ms wasmedgec 0.11.0
wasm 4.rs 222ms 11ms 20.8MB 210ms 0ms wasmedgec 0.11.0
wasm 4.rs 227ms 0.3ms 8.0MB 217ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 234ms 1.5ms 14.5MB 220ms 0ms wasmtime 1.0.0
wasm 5.rs 244ms 0.1ms 7.9MB 230ms 0ms wasmer/llvm 2.3.0
wasm 5.rs 280ms 8.4ms 12.6MB 263ms 0ms wasmtime 1.0.0
wasm 4.rs 301ms 4.3ms 12.6MB 283ms 3ms wasmtime 1.0.0
wasm 3.rs 332ms 5.2ms 46.4MB 340ms 3ms node 16.17.0
wasm 4.rs 339ms 8.9ms 44.0MB 353ms 7ms node 16.17.0
wasm 5.rs 369ms 16ms 45.6MB 347ms 10ms node 16.17.0
hacklang 1.hack 1624ms 5.4ms 192.3MB 1550ms 47ms hhvm 4.169.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1268ms 0.5ms 8.0MB 1257ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 1530ms 20ms 48.2MB 1570ms 20ms node 16.17.0
wasm 3.rs 1588ms 41ms 12.6MB 1573ms 0ms wasmtime 1.0.0
wasm 3.rs 1938ms 4.0ms 22.6MB 1920ms 3ms wasmedgec 0.11.0
hacklang 1.hack 1966ms 4.0ms 178.7MB 1893ms 37ms hhvm 4.169.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 84ms 0.8ms 7.0MB 70ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 105ms 3.6ms 11.2MB 93ms 0ms wasmtime 1.0.0
wasm 3.rs 134ms 0.6ms 19.8MB 123ms 0ms wasmedgec 0.11.0
wasm 3.rs 216ms 4.3ms 48.2MB 267ms 7ms node 16.17.0
hacklang 1.hack 970ms 4.1ms 182.9MB 913ms 23ms hhvm 4.169.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 2.7ms 0.5ms 4.9MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 6.0ms 0.9ms 9.2MB 0ms 0ms wasmtime 1.0.0
wasm 1.rs 8.5ms 2.6ms 18.4MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs 83ms 1.1ms 43.5MB 94ms 6ms node 16.17.0
hacklang 1.hack 777ms 2.5ms 169.9MB 716ms 34ms hhvm 4.169.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1079ms 4.2ms 42.4MB 1055ms 10ms wasmedgec 0.11.0
wasm 1.rs 1246ms 3.1ms 29.8MB 1213ms 17ms wasmer/llvm 2.3.0
wasm 1.rs 1372ms 11ms 67.5MB 1373ms 17ms node 16.17.0
wasm 1.rs 1434ms 9.1ms 34.5MB 1407ms 7ms wasmtime 1.0.0
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 235ms 1.5ms 24.4MB 217ms 3ms wasmedgec 0.11.0
wasm 1.rs 267ms 1.0ms 11.7MB 257ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 308ms 0.9ms 16.7MB 297ms 0ms wasmtime 1.0.0
wasm 1.rs 355ms 5.1ms 49.2MB 363ms 7ms node 16.17.0
hacklang 1.hack 1805ms 7.5ms 201.3MB 1740ms 40ms hhvm 4.169.0