Haxe VS Wasm benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1986ms 38ms 146.0MB 2520ms 67ms haxe/cpp 4.2.5
wasm 3.rs 2145ms 13ms 37.8MB 2103ms 23ms wasmer/llvm 2.3.0
wasm 5.rs 2189ms 15ms 21.8MB 2157ms 13ms wasmer/llvm 2.3.0
wasm 4.rs 2200ms 0.5ms 21.8MB 2173ms 7ms wasmer/llvm 2.3.0
wasm 5.rs 2220ms 5.4ms 34.7MB 2200ms 0ms wasmedgec 0.11.0
wasm 3.rs 2260ms 12ms 50.8MB 2233ms 7ms wasmedgec 0.11.0
wasm 4.rs 2377ms 24ms 35.0MB 2353ms 10ms wasmedgec 0.11.0
wasm 5.rs 2737ms 25ms 59.4MB 2733ms 20ms node 16.17.0
wasm 3.rs 2803ms 16ms 75.3MB 2783ms 20ms node 16.17.0
wasm 4.rs 2835ms 15ms 59.4MB 2840ms 10ms node 16.17.0
wasm 5.rs 2879ms 21ms 26.8MB 2857ms 7ms wasmtime 1.0.1
wasm 3.rs 2932ms 12ms 42.7MB 2897ms 10ms wasmtime 1.0.1
wasm 4.rs 2950ms 24ms 26.8MB 2930ms 7ms wasmtime 1.0.1
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 120ms 2.8ms 27.5MB 123ms 7ms haxe/cpp 4.2.5
wasm 3.rs 198ms 0.7ms 9.8MB 183ms 3ms wasmer/llvm 2.3.0
wasm 5.rs 204ms 0.8ms 7.9MB 193ms 0ms wasmer/llvm 2.3.0
wasm 4.rs 206ms 1.3ms 7.9MB 190ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 210ms 0.3ms 22.7MB 190ms 0ms wasmedgec 0.11.0
wasm 5.rs 215ms 6.4ms 20.9MB 200ms 0ms wasmedgec 0.11.0
wasm 4.rs 226ms 1.3ms 22.1MB 210ms 0ms wasmedgec 0.11.0
wasm 5.rs 271ms 1.9ms 12.9MB 260ms 0ms wasmtime 1.0.1
wasm 3.rs 275ms 2.3ms 14.7MB 263ms 0ms wasmtime 1.0.1
wasm 4.rs 279ms 3.2ms 12.8MB 267ms 0ms wasmtime 1.0.1
wasm 5.rs 326ms 3.4ms 45.1MB 333ms 7ms node 16.17.0
wasm 3.rs 327ms 2.9ms 46.3MB 330ms 10ms node 16.17.0
wasm 4.rs 341ms 5.0ms 44.8MB 347ms 7ms node 16.17.0
haxe 2.hx 533ms 4.3ms 60.2MB 650ms 27ms haxe/cpp 4.2.5
haxe 1.hx 868ms 1.6ms 7.8MB 833ms 17ms haxe/hl/c 4.2.5
haxe 1.hx 1025ms 4.8ms 11.3MB 977ms 33ms haxe/hl/jit 1.12.0
haxe 2.hx 1372ms 9.2ms 13.4MB 1260ms 97ms haxe/hl/c 4.2.5
haxe 2.hx 1694ms 20ms 24.6MB 1530ms 143ms haxe/hl/jit 1.12.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 296ms 1.0ms 6.0MB 280ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 304ms 0.4ms 18.6MB 290ms 0ms wasmedgec 0.11.0
wasm 1.rs 317ms 0.2ms 9.4MB 300ms 0ms wasmtime 1.0.1
wasm 1.rs 415ms 2.8ms 43.8MB 423ms 7ms node 16.17.0
haxe 1.hx 3164ms 18ms 27.5MB 3210ms 243ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 33ms 0.9ms 6.1MB 23ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 39ms 0.9ms 11.5MB 30ms 0ms wasmtime 1.0.1
wasm 1.rs 41ms 0.3ms 18.9MB 23ms 3ms wasmedgec 0.11.0
wasm 1.rs 123ms 0.8ms 43.3MB 137ms 7ms node 16.17.0
haxe 1.hx 336ms 2.9ms 27.5MB 320ms 23ms haxe/cpp 4.2.5
haxe 1.hx 836ms 21ms 3.3MB 757ms 63ms haxe/hl/c 4.2.5
haxe 1.hx 859ms 3.8ms 3.8MB 803ms 37ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 2.5ms 0.2ms 4.9MB 0ms 0ms wasmer/llvm 2.3.0
haxe 1.hx 3.2ms 0.8ms 3.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 3.9ms 0.2ms 3.3MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 4.1ms 2.2ms 2.6MB 0ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 6.6ms 1.7ms 9.2MB 0ms 0ms wasmtime 1.0.1
wasm 1.rs 8.6ms 1.2ms 18.4MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs 83ms 0.6ms 43.2MB 98ms 2ms node 16.17.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 121ms 1.0ms 6.1MB 110ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 138ms 0.7ms 18.7MB 123ms 0ms wasmedgec 0.11.0
wasm 1.rs 148ms 0.8ms 11.1MB 140ms 0ms wasmtime 1.0.1
haxe 1.hx 189ms 1.4ms 22.2MB 177ms 0ms haxe/cpp 4.2.5
haxe 1.hx 211ms 1.2ms 2.9MB 200ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 227ms 2.8ms 44.5MB 237ms 10ms node 16.17.0
haxe 1.hx 241ms 0.4ms 3.8MB 223ms 0ms haxe/hl/jit 1.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 356ms 2.8ms 6.0MB 343ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 395ms 1.9ms 18.5MB 380ms 0ms wasmedgec 0.11.0
wasm 1.rs 429ms 5.6ms 11.1MB 417ms 0ms wasmtime 1.0.1
wasm 1.rs 489ms 0.9ms 44.8MB 493ms 17ms node 16.17.0
haxe 1.hx 542ms 12ms 27.4MB 533ms 7ms haxe/cpp 4.2.5
haxe 1.hx 626ms 1.6ms 3.0MB 613ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 719ms 9.8ms 3.7MB 707ms 0ms haxe/hl/jit 1.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 60ms 0.6ms 4.8MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 71ms 0.6ms 18.2MB 60ms 0ms wasmedgec 0.11.0
wasm 1.rs 74ms 0.9ms 9.4MB 67ms 0ms wasmtime 1.0.1
haxe 1.hx 87ms 1.8ms 14.2MB 67ms 7ms haxe/cpp 4.2.5
haxe 1.hx 105ms 2.4ms 2.9MB 93ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 119ms 0.9ms 3.8MB 110ms 0ms haxe/hl/jit 1.12.0
wasm 1.rs 155ms 1.9ms 44.8MB 167ms 10ms node 16.17.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1090ms 0.8ms 29.9MB 1057ms 20ms wasmer/llvm 2.3.0
wasm 1.rs 1161ms 6.0ms 42.5MB 1133ms 13ms wasmedgec 0.11.0
wasm 1.rs 1379ms 16ms 67.6MB 1383ms 13ms node 16.17.0
haxe 1.hx 1381ms 4.3ms 97.0MB 1660ms 47ms haxe/cpp 4.2.5
wasm 1.rs 1415ms 3.4ms 34.7MB 1390ms 7ms wasmtime 1.0.1
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 233ms 0.5ms 11.7MB 217ms 0ms wasmer/llvm 2.3.0
haxe 1.hx 248ms 4.7ms 28.6MB 253ms 10ms haxe/cpp 4.2.5
wasm 1.rs 253ms 2.1ms 25.0MB 240ms 0ms wasmedgec 0.11.0
wasm 1.rs 305ms 0.4ms 16.9MB 290ms 3ms wasmtime 1.0.1
wasm 1.rs 361ms 6.6ms 49.6MB 370ms 0ms node 16.17.0
haxe 1.hx 1742ms 6.1ms 15.5MB 1663ms 60ms haxe/hl/c 4.2.5
haxe 1.hx 2026ms 52ms 20.4MB 1913ms 97ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 524ms 0.2ms 4.7MB 510ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 569ms 0.5ms 11.4MB 557ms 0ms wasmtime 1.0.1
wasm 1.rs 603ms 1.4ms 18.5MB 587ms 0ms wasmedgec 0.11.0
wasm 1.rs 660ms 2.0ms 48.5MB 680ms 10ms node 16.17.0
wasm 2.rs 802ms 0.2ms 18.7MB 783ms 0ms wasmedgec 0.11.0
wasm 2.rs 825ms 0.7ms 4.8MB 813ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 831ms 5.3ms 9.4MB 820ms 0ms wasmtime 1.0.1
wasm 2.rs 897ms 2.2ms 48.3MB 913ms 10ms node 16.17.0
haxe 2.hx 1083ms 6.6ms 2.6MB 1070ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 1505ms 76ms 2.6MB 1493ms 0ms haxe/hl/c 4.2.5
haxe 3.hx 2176ms 1.2ms 25.6MB 2470ms 43ms haxe/cpp 4.2.5
haxe 2.hx 2441ms 1.5ms 3.4MB 2427ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2598ms 0.0ms 3.3MB 2587ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 58ms 0.3ms 4.9MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 65ms 0.5ms 11.4MB 53ms 0ms wasmtime 1.0.1
wasm 1.rs 69ms 1.5ms 18.6MB 57ms 0ms wasmedgec 0.11.0
wasm 2.rs 85ms 1.6ms 4.9MB 73ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 89ms 1.7ms 18.5MB 77ms 0ms wasmedgec 0.11.0
wasm 2.rs 91ms 1.5ms 9.4MB 77ms 0ms wasmtime 1.0.1
haxe 2.hx 113ms 3.3ms 2.6MB 100ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 149ms 1.1ms 2.6MB 140ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 159ms 1.9ms 48.3MB 183ms 7ms node 16.17.0
wasm 2.rs 184ms 6.9ms 48.5MB 203ms 7ms node 16.17.0
haxe 3.hx 237ms 2.0ms 27.6MB 250ms 7ms haxe/cpp 4.2.5
haxe 2.hx 255ms 8.1ms 3.4MB 243ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 268ms 6.6ms 3.3MB 253ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 762ms 4.4ms 3.2MB 683ms 60ms haxe/hl/c 4.2.5
haxe 2.hx 833ms 0.9ms 4.4MB 820ms 0ms haxe/cpp 4.2.5
haxe 3.hx 903ms 6.5ms 3.7MB 830ms 60ms haxe/hl/jit 1.12.0
haxe 1.hx 1072ms 1.7ms 3.1MB 1060ms 0ms haxe/cpp 4.2.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3442ms 0.9ms 21.2MB 3423ms 0ms wasmedgec 0.11.0
wasm 7.rs 3625ms 20ms 5.9MB 3603ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 3701ms 0.4ms 19.3MB 3687ms 0ms wasmedgec 0.11.0
wasm 2.rs 3725ms 1.1ms 6.0MB 3717ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 3908ms 16ms 11.1MB 3887ms 3ms wasmtime 1.0.1
wasm 7.rs 4028ms 1.5ms 11.1MB 4013ms 0ms wasmtime 1.0.1
wasm 7.rs 4158ms 8.1ms 48.3MB 4180ms 7ms node 16.17.0
wasm 2.rs 4439ms 3.1ms 48.3MB 4463ms 7ms node 16.17.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 869ms 1.0ms 19.2MB 853ms 0ms wasmedgec 0.11.0
wasm 7.rs 914ms 0.8ms 5.9MB 900ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 936ms 0.4ms 5.9MB 923ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 936ms 4.0ms 19.3MB 923ms 0ms wasmedgec 0.11.0
wasm 2.rs 1004ms 0.7ms 11.1MB 993ms 0ms wasmtime 1.0.1
wasm 7.rs 1013ms 1.1ms 11.1MB 1000ms 0ms wasmtime 1.0.1
wasm 7.rs 1122ms 3.7ms 48.3MB 1143ms 7ms node 16.17.0
wasm 2.rs 1192ms 4.1ms 48.3MB 1207ms 13ms node 16.17.0
haxe 1.hx 1946ms 1.0ms 3.2MB 1930ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 1956ms 3.8ms 6.5MB 1943ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 226ms 0.1ms 18.5MB 210ms 0ms wasmedgec 0.11.0
wasm 7.rs 233ms 1.1ms 4.7MB 220ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 238ms 0.9ms 4.9MB 230ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 245ms 2.9ms 18.8MB 227ms 0ms wasmedgec 0.11.0
wasm 2.rs 258ms 1.4ms 9.4MB 247ms 0ms wasmtime 1.0.1
wasm 7.rs 261ms 0.3ms 11.4MB 243ms 0ms wasmtime 1.0.1
wasm 7.rs 360ms 0.9ms 48.8MB 373ms 13ms node 16.17.0
wasm 2.rs 377ms 4.6ms 48.8MB 400ms 7ms node 16.17.0
haxe 1.hx 491ms 0.8ms 3.0MB 477ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 493ms 1.5ms 5.2MB 480ms 0ms haxe/cpp 4.2.5
haxe 1.hx 2846ms 0.1ms 3.8MB 2840ms 0ms haxe/hl/jit 1.12.0