Wasm VS Hack benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 2145ms 13ms 37.8MB 2103ms 23ms wasmer/llvm 2.3.0
wasm 5.rs 2189ms 15ms 21.8MB 2157ms 13ms wasmer/llvm 2.3.0
wasm 4.rs 2200ms 0.5ms 21.8MB 2173ms 7ms wasmer/llvm 2.3.0
wasm 5.rs 2220ms 5.4ms 34.7MB 2200ms 0ms wasmedgec 0.11.0
wasm 3.rs 2260ms 12ms 50.8MB 2233ms 7ms wasmedgec 0.11.0
wasm 4.rs 2377ms 24ms 35.0MB 2353ms 10ms wasmedgec 0.11.0
wasm 5.rs 2737ms 25ms 59.4MB 2733ms 20ms node 16.17.0
wasm 3.rs 2803ms 16ms 75.3MB 2783ms 20ms node 16.17.0
wasm 4.rs 2835ms 15ms 59.4MB 2840ms 10ms node 16.17.0
wasm 5.rs 2879ms 21ms 26.8MB 2857ms 7ms wasmtime 1.0.1
wasm 3.rs 2932ms 12ms 42.7MB 2897ms 10ms wasmtime 1.0.1
wasm 4.rs 2950ms 24ms 26.8MB 2930ms 7ms wasmtime 1.0.1
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 198ms 0.7ms 9.8MB 183ms 3ms wasmer/llvm 2.3.0
wasm 5.rs 204ms 0.8ms 7.9MB 193ms 0ms wasmer/llvm 2.3.0
wasm 4.rs 206ms 1.3ms 7.9MB 190ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 210ms 0.3ms 22.7MB 190ms 0ms wasmedgec 0.11.0
wasm 5.rs 215ms 6.4ms 20.9MB 200ms 0ms wasmedgec 0.11.0
wasm 4.rs 226ms 1.3ms 22.1MB 210ms 0ms wasmedgec 0.11.0
wasm 5.rs 271ms 1.9ms 12.9MB 260ms 0ms wasmtime 1.0.1
wasm 3.rs 275ms 2.3ms 14.7MB 263ms 0ms wasmtime 1.0.1
wasm 4.rs 279ms 3.2ms 12.8MB 267ms 0ms wasmtime 1.0.1
wasm 5.rs 326ms 3.4ms 45.1MB 333ms 7ms node 16.17.0
wasm 3.rs 327ms 2.9ms 46.3MB 330ms 10ms node 16.17.0
wasm 4.rs 341ms 5.0ms 44.8MB 347ms 7ms node 16.17.0
hacklang 1.hack 1764ms 90ms 189.8MB 1690ms 43ms hhvm 4.169.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1270ms 3.8ms 8.2MB 1257ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 1495ms 38ms 48.2MB 1543ms 10ms node 16.17.0
wasm 3.rs 1534ms 10ms 12.7MB 1520ms 0ms wasmtime 1.0.1
hacklang 1.hack 2017ms 5.3ms 176.5MB 1947ms 40ms hhvm 4.169.0
wasm 3.rs 2050ms 24ms 20.9MB 2037ms 0ms wasmedgec 0.11.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 83ms 1.7ms 6.4MB 70ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 104ms 2.4ms 11.6MB 93ms 0ms wasmtime 1.0.1
wasm 3.rs 142ms 1.2ms 19.6MB 130ms 0ms wasmedgec 0.11.0
wasm 3.rs 212ms 3.9ms 47.8MB 250ms 10ms node 16.17.0
hacklang 1.hack 985ms 5.2ms 173.6MB 903ms 47ms hhvm 4.169.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 435ms 1.2ms 7.2MB 423ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 472ms 0.8ms 19.9MB 457ms 0ms wasmedgec 0.11.0
wasm 1.rs 572ms 0.3ms 12.1MB 557ms 0ms wasmtime 1.0.1
wasm 1.rs 662ms 0.2ms 48.5MB 703ms 10ms node 16.17.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 114ms 0.9ms 6.6MB 107ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 129ms 0.5ms 19.2MB 120ms 0ms wasmedgec 0.11.0
wasm 1.rs 151ms 0.4ms 11.7MB 137ms 0ms wasmtime 1.0.1
wasm 1.rs 260ms 2.9ms 48.8MB 300ms 13ms node 16.17.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms node 16.17.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmtime 1.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 426ms 0.4ms 4.7MB 413ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 436ms 3.4ms 9.2MB 423ms 0ms wasmtime 1.0.1
wasm 1.rs 455ms 1.0ms 18.5MB 440ms 0ms wasmedgec 0.11.0
wasm 1.rs 499ms 6.0ms 44.2MB 503ms 7ms node 16.17.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 296ms 1.0ms 6.0MB 280ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 304ms 0.4ms 18.6MB 290ms 0ms wasmedgec 0.11.0
wasm 1.rs 317ms 0.2ms 9.4MB 300ms 0ms wasmtime 1.0.1
wasm 1.rs 415ms 2.8ms 43.8MB 423ms 7ms node 16.17.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 33ms 0.9ms 6.1MB 23ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 39ms 0.9ms 11.5MB 30ms 0ms wasmtime 1.0.1
wasm 1.rs 41ms 0.3ms 18.9MB 23ms 3ms wasmedgec 0.11.0
wasm 1.rs 123ms 0.8ms 43.3MB 137ms 7ms node 16.17.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 2.5ms 0.2ms 4.9MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 6.6ms 1.7ms 9.2MB 0ms 0ms wasmtime 1.0.1
wasm 1.rs 8.6ms 1.2ms 18.4MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs 83ms 0.6ms 43.2MB 98ms 2ms node 16.17.0
hacklang 1.hack 792ms 4.1ms 175.1MB 718ms 44ms hhvm 4.169.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 121ms 1.0ms 6.1MB 110ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 138ms 0.7ms 18.7MB 123ms 0ms wasmedgec 0.11.0
wasm 1.rs 148ms 0.8ms 11.1MB 140ms 0ms wasmtime 1.0.1
wasm 1.rs 227ms 2.8ms 44.5MB 237ms 10ms node 16.17.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 356ms 2.8ms 6.0MB 343ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 395ms 1.9ms 18.5MB 380ms 0ms wasmedgec 0.11.0
wasm 1.rs 429ms 5.6ms 11.1MB 417ms 0ms wasmtime 1.0.1
wasm 1.rs 489ms 0.9ms 44.8MB 493ms 17ms node 16.17.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 60ms 0.6ms 4.8MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 71ms 0.6ms 18.2MB 60ms 0ms wasmedgec 0.11.0
wasm 1.rs 74ms 0.9ms 9.4MB 67ms 0ms wasmtime 1.0.1
wasm 1.rs 155ms 1.9ms 44.8MB 167ms 10ms node 16.17.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 1022ms 5.0ms 47.5MB 1030ms 10ms node 16.17.0
wasm 8.rs 1070ms 11ms 21.9MB 1040ms 7ms wasmedgec 0.11.0
wasm 8.rs 1182ms 4.7ms 9.1MB 1163ms 0ms wasmer/llvm 2.3.0
wasm 8.rs 1371ms 19ms 13.9MB 1360ms 0ms wasmtime 1.0.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 54ms 1.0ms 6.0MB 40ms 0ms wasmer/llvm 2.3.0
wasm 8.rs 55ms 0.2ms 18.8MB 47ms 0ms wasmedgec 0.11.0
wasm 8.rs 65ms 1.3ms 11.0MB 50ms 0ms wasmtime 1.0.1
wasm 8.rs 129ms 3.0ms 44.2MB 137ms 13ms node 16.17.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1090ms 0.8ms 29.9MB 1057ms 20ms wasmer/llvm 2.3.0
wasm 1.rs 1161ms 6.0ms 42.5MB 1133ms 13ms wasmedgec 0.11.0
wasm 1.rs 1379ms 16ms 67.6MB 1383ms 13ms node 16.17.0
wasm 1.rs 1415ms 3.4ms 34.7MB 1390ms 7ms wasmtime 1.0.1
hacklang 1.hack timeout 0.0ms 0.0MB 0ms 0ms hhvm 4.169.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 233ms 0.5ms 11.7MB 217ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 253ms 2.1ms 25.0MB 240ms 0ms wasmedgec 0.11.0
wasm 1.rs 305ms 0.4ms 16.9MB 290ms 3ms wasmtime 1.0.1
wasm 1.rs 361ms 6.6ms 49.6MB 370ms 0ms node 16.17.0
hacklang 1.hack 1914ms 15ms 200.9MB 1830ms 53ms hhvm 4.169.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 524ms 0.2ms 4.7MB 510ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 569ms 0.5ms 11.4MB 557ms 0ms wasmtime 1.0.1
wasm 1.rs 603ms 1.4ms 18.5MB 587ms 0ms wasmedgec 0.11.0
wasm 1.rs 660ms 2.0ms 48.5MB 680ms 10ms node 16.17.0
wasm 2.rs 802ms 0.2ms 18.7MB 783ms 0ms wasmedgec 0.11.0
wasm 2.rs 825ms 0.7ms 4.8MB 813ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 831ms 5.3ms 9.4MB 820ms 0ms wasmtime 1.0.1
wasm 2.rs 897ms 2.2ms 48.3MB 913ms 10ms node 16.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 58ms 0.3ms 4.9MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 65ms 0.5ms 11.4MB 53ms 0ms wasmtime 1.0.1
wasm 1.rs 69ms 1.5ms 18.6MB 57ms 0ms wasmedgec 0.11.0
wasm 2.rs 85ms 1.6ms 4.9MB 73ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 89ms 1.7ms 18.5MB 77ms 0ms wasmedgec 0.11.0
wasm 2.rs 91ms 1.5ms 9.4MB 77ms 0ms wasmtime 1.0.1
wasm 1.rs 159ms 1.9ms 48.3MB 183ms 7ms node 16.17.0
wasm 2.rs 184ms 6.9ms 48.5MB 203ms 7ms node 16.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 507ms 0.4ms 10.6MB 490ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 611ms 3.6ms 23.6MB 593ms 3ms wasmedgec 0.11.0
wasm 2.rs 784ms 2.3ms 48.6MB 790ms 13ms node 16.17.0
wasm 2.rs 828ms 3.4ms 15.6MB 807ms 3ms wasmtime 1.0.1
wasm 1.rs 1228ms 39ms 45.3MB 1193ms 17ms wasmer/llvm 2.3.0
wasm 1.rs 1293ms 29ms 57.6MB 1263ms 10ms wasmedgec 0.11.0
wasm 1.rs 1505ms 39ms 82.9MB 1510ms 17ms node 16.17.0
wasm 1.rs 1515ms 61ms 49.8MB 1493ms 7ms wasmtime 1.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 115ms 0.6ms 7.2MB 100ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 141ms 3.7ms 15.6MB 120ms 10ms wasmer/llvm 2.3.0
wasm 2.rs 147ms 0.8ms 21.0MB 133ms 3ms wasmedgec 0.11.0
wasm 1.rs 152ms 0.1ms 28.2MB 133ms 3ms wasmedgec 0.11.0
wasm 2.rs 199ms 0.3ms 12.0MB 190ms 0ms wasmtime 1.0.1
wasm 1.rs 214ms 0.3ms 20.7MB 203ms 0ms wasmtime 1.0.1
wasm 1.rs 249ms 0.8ms 53.9MB 247ms 13ms node 16.17.0
wasm 2.rs 250ms 6.6ms 45.3MB 250ms 10ms node 16.17.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2632ms 0.5ms 6.7MB 2623ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 2839ms 7.1ms 19.9MB 2827ms 3ms wasmedgec 0.11.0
wasm 2.rs 3093ms 4.6ms 11.4MB 3080ms 0ms wasmtime 1.0.1
wasm 2.rs 3345ms 2.3ms 49.3MB 3390ms 7ms node 16.17.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 624ms 1.2ms 6.3MB 610ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 678ms 1.8ms 19.3MB 660ms 3ms wasmedgec 0.11.0
wasm 2.rs 737ms 0.8ms 11.7MB 717ms 3ms wasmtime 1.0.1
wasm 2.rs 889ms 0.7ms 48.8MB 930ms 3ms node 16.17.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 357ms 0.8ms 18.6MB 347ms 0ms wasmedgec 0.11.0
wasm 0.rs 379ms 0.4ms 4.8MB 370ms 0ms wasmer/llvm 2.3.0
wasm 0.rs 423ms 0.3ms 11.1MB 410ms 0ms wasmtime 1.0.1
wasm 0.rs 457ms 1.3ms 46.1MB 487ms 3ms node 16.17.0
wasm 1.rs 4054ms 18ms 4.8MB 4040ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 4252ms 33ms 18.8MB 4237ms 0ms wasmedgec 0.11.0
wasm 1.rs 4605ms 30ms 51.9MB 4653ms 10ms node 16.17.0
wasm 1.rs 4807ms 2.1ms 10.4MB 4797ms 0ms wasmtime 1.0.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 98ms 0.5ms 20.1MB 80ms 0ms wasmedgec 0.11.0
wasm 0.rs 98ms 0.3ms 4.8MB 90ms 0ms wasmer/llvm 2.3.0
wasm 0.rs 113ms 0.6ms 10.7MB 103ms 0ms wasmtime 1.0.1
wasm 0.rs 193ms 1.3ms 46.9MB 217ms 10ms node 16.17.0
wasm 1.rs 1015ms 0.7ms 4.8MB 1000ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 1068ms 0.5ms 19.4MB 1053ms 0ms wasmedgec 0.11.0
wasm 1.rs 1211ms 1.9ms 10.3MB 1197ms 0ms wasmtime 1.0.1
wasm 1.rs 1257ms 6.1ms 52.1MB 1307ms 10ms node 16.17.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3442ms 0.9ms 21.2MB 3423ms 0ms wasmedgec 0.11.0
wasm 7.rs 3625ms 20ms 5.9MB 3603ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 3701ms 0.4ms 19.3MB 3687ms 0ms wasmedgec 0.11.0
wasm 2.rs 3725ms 1.1ms 6.0MB 3717ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 3908ms 16ms 11.1MB 3887ms 3ms wasmtime 1.0.1
wasm 7.rs 4028ms 1.5ms 11.1MB 4013ms 0ms wasmtime 1.0.1
wasm 7.rs 4158ms 8.1ms 48.3MB 4180ms 7ms node 16.17.0
wasm 2.rs 4439ms 3.1ms 48.3MB 4463ms 7ms node 16.17.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 869ms 1.0ms 19.2MB 853ms 0ms wasmedgec 0.11.0
wasm 7.rs 914ms 0.8ms 5.9MB 900ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 936ms 0.4ms 5.9MB 923ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 936ms 4.0ms 19.3MB 923ms 0ms wasmedgec 0.11.0
wasm 2.rs 1004ms 0.7ms 11.1MB 993ms 0ms wasmtime 1.0.1
wasm 7.rs 1013ms 1.1ms 11.1MB 1000ms 0ms wasmtime 1.0.1
wasm 7.rs 1122ms 3.7ms 48.3MB 1143ms 7ms node 16.17.0
wasm 2.rs 1192ms 4.1ms 48.3MB 1207ms 13ms node 16.17.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 226ms 0.1ms 18.5MB 210ms 0ms wasmedgec 0.11.0
wasm 7.rs 233ms 1.1ms 4.7MB 220ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 238ms 0.9ms 4.9MB 230ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 245ms 2.9ms 18.8MB 227ms 0ms wasmedgec 0.11.0
wasm 2.rs 258ms 1.4ms 9.4MB 247ms 0ms wasmtime 1.0.1
wasm 7.rs 261ms 0.3ms 11.4MB 243ms 0ms wasmtime 1.0.1
wasm 7.rs 360ms 0.9ms 48.8MB 373ms 13ms node 16.17.0
wasm 2.rs 377ms 4.6ms 48.8MB 400ms 7ms node 16.17.0