Haxe VS Wasm benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1721ms 7.7ms 146.1MB 1883ms 80ms haxe/cpp 4.2.5
wasm 3.rs 2048ms 5.9ms 60.1MB 2017ms 10ms wasmedgec 0.13.1
wasm 5.rs 2074ms 21ms 44.2MB 2047ms 10ms wasmedgec 0.13.1
wasm 4.rs 2202ms 1.4ms 44.9MB 2170ms 13ms wasmedgec 0.13.1
wasm 3.rs 2272ms 23ms 48.1MB 2243ms 3ms wasmtime 10.0.1
wasm 3.rs 2717ms 81ms 80.1MB 2687ms 27ms node 18.16.1
wasm 4.rs 2770ms 28ms 65.4MB 2747ms 20ms node 18.16.1
wasm 5.rs 2774ms 20ms 65.1MB 2763ms 7ms node 18.16.1
wasm 5.rs 2817ms 17ms 32.3MB 2800ms 7ms wasmtime 10.0.1
wasm 4.rs 2933ms 20ms 32.2MB 2910ms 7ms wasmtime 10.0.1
haxe 2.hx timeout 0.0ms 480.9MB 5583ms 243ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 48.6MB 4733ms 243ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 83.0MB 4383ms 600ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 49.0MB 4723ms 257ms haxe/hl/jit 1.13.0
haxe 2.hx timeout 0.0ms 130.2MB 4403ms 573ms haxe/hl/jit 1.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 107ms 2.3ms 27.7MB 103ms 0ms haxe/cpp 4.2.5
wasm 3.rs 203ms 4.3ms 32.0MB 180ms 0ms wasmedgec 0.13.1
wasm 5.rs 204ms 1.9ms 30.1MB 187ms 0ms wasmedgec 0.13.1
wasm 3.rs 215ms 5.6ms 20.0MB 200ms 0ms wasmtime 10.0.1
wasm 4.rs 219ms 2.6ms 30.1MB 197ms 3ms wasmedgec 0.13.1
wasm 5.rs 269ms 0.5ms 18.1MB 257ms 0ms wasmtime 10.0.1
wasm 4.rs 284ms 1.1ms 20.0MB 270ms 0ms wasmtime 10.0.1
wasm 3.rs 305ms 8.2ms 52.4MB 290ms 3ms node 18.16.1
wasm 5.rs 308ms 1.0ms 52.2MB 303ms 0ms node 18.16.1
wasm 4.rs 308ms 8.2ms 53.1MB 300ms 7ms node 18.16.1
haxe 2.hx 439ms 8.3ms 58.4MB 457ms 27ms haxe/cpp 4.2.5
haxe 1.hx 789ms 3.5ms 8.6MB 763ms 13ms haxe/hl/c 4.2.5
haxe 1.hx 942ms 3.8ms 11.1MB 887ms 40ms haxe/hl/jit 1.13.0
haxe 2.hx 1177ms 9.7ms 13.4MB 1037ms 123ms haxe/hl/c 4.2.5
haxe 2.hx 1307ms 7.5ms 25.0MB 1120ms 167ms haxe/hl/jit 1.13.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 367ms 0.9ms 27.1MB 347ms 3ms wasmedgec 0.13.1
wasm 1.rs 427ms 1.5ms 16.1MB 413ms 0ms wasmtime 10.0.1
wasm 1.rs 470ms 0.8ms 49.4MB 453ms 7ms node 18.16.1
haxe 1.hx 3439ms 2.9ms 27.5MB 3323ms 243ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 3.4MB 4630ms 350ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 3.8MB 4740ms 243ms haxe/hl/jit 1.13.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 46ms 0.6ms 28.0MB 30ms 0ms wasmedgec 0.13.1
wasm 1.rs 51ms 1.4ms 16.1MB 37ms 0ms wasmtime 10.0.1
wasm 1.rs 92ms 2.7ms 49.5MB 77ms 7ms node 18.16.1
haxe 1.hx 361ms 1.6ms 27.6MB 337ms 20ms haxe/cpp 4.2.5
haxe 1.hx 802ms 2.2ms 3.3MB 750ms 33ms haxe/hl/c 4.2.5
haxe 1.hx 870ms 1.6ms 3.7MB 813ms 37ms haxe/hl/jit 1.13.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1.9ms 0.3ms 3.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 2.9ms 0.9ms 3.2MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 4.3ms 0.7ms 3.2MB 0ms 0ms haxe/hl/jit 1.13.0
wasm 1.rs 7.0ms 1.0ms 16.1MB 0ms 0ms wasmtime 10.0.1
wasm 1.rs 9.9ms 0.9ms 28.8MB 0ms 0ms wasmedgec 0.13.1
wasm 1.rs 47ms 2.4ms 47.3MB 32ms 2ms node 18.16.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 163ms 1.5ms 28.2MB 147ms 3ms wasmedgec 0.13.1
haxe 1.hx 182ms 1.3ms 20.4MB 167ms 3ms haxe/cpp 4.2.5
haxe 1.hx 193ms 1.9ms 2.9MB 180ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 200ms 0.9ms 16.2MB 187ms 0ms wasmtime 10.0.1
haxe 1.hx 235ms 3.2ms 3.6MB 227ms 0ms haxe/hl/jit 1.13.0
wasm 1.rs 283ms 1.5ms 53.4MB 270ms 10ms node 18.16.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 466ms 2.2ms 27.6MB 450ms 0ms wasmedgec 0.13.1
haxe 1.hx 520ms 2.0ms 25.6MB 510ms 7ms haxe/cpp 4.2.5
haxe 1.hx 573ms 3.9ms 2.9MB 560ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 584ms 4.8ms 16.2MB 567ms 0ms wasmtime 10.0.1
haxe 1.hx 696ms 6.8ms 3.7MB 683ms 0ms haxe/hl/jit 1.13.0
wasm 1.rs 722ms 2.0ms 53.1MB 710ms 13ms node 18.16.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 85ms 0.6ms 12.1MB 73ms 0ms haxe/cpp 4.2.5
wasm 1.rs 88ms 1.8ms 28.2MB 70ms 3ms wasmedgec 0.13.1
haxe 1.hx 94ms 0.3ms 2.8MB 87ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 103ms 0.3ms 16.3MB 90ms 0ms wasmtime 10.0.1
haxe 1.hx 117ms 2.5ms 3.6MB 103ms 0ms haxe/hl/jit 1.13.0
wasm 1.rs 159ms 3.7ms 51.3MB 143ms 10ms node 18.16.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1134ms 4.5ms 51.5MB 1103ms 10ms wasmedgec 0.13.1
haxe 1.hx 1142ms 28ms 97.1MB 1237ms 43ms haxe/cpp 4.2.5
wasm 1.rs 1354ms 4.0ms 40.3MB 1327ms 10ms wasmtime 10.0.1
wasm 1.rs 1383ms 21ms 73.3MB 1367ms 13ms node 18.16.1
haxe 1.hx timeout 0.0ms 32.6MB 4523ms 413ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 54.5MB 4623ms 357ms haxe/hl/jit 1.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 196ms 1.0ms 28.7MB 200ms 10ms haxe/cpp 4.2.5
wasm 1.rs 251ms 2.8ms 34.9MB 223ms 10ms wasmedgec 0.13.1
wasm 1.rs 299ms 4.3ms 22.3MB 287ms 0ms wasmtime 10.0.1
wasm 1.rs 340ms 4.2ms 55.4MB 323ms 17ms node 18.16.1
haxe 1.hx 1538ms 6.2ms 11.0MB 1427ms 93ms haxe/hl/c 4.2.5
haxe 1.hx 1707ms 4.6ms 20.2MB 1577ms 110ms haxe/hl/jit 1.13.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 472ms 2.5ms 16.1MB 463ms 0ms wasmtime 10.0.1
wasm 1.rs 492ms 0.4ms 28.6MB 477ms 0ms wasmedgec 0.13.1
wasm 2.rs 655ms 4.7ms 27.8MB 633ms 7ms wasmedgec 0.13.1
wasm 2.rs 657ms 1.4ms 16.3MB 643ms 0ms wasmtime 10.0.1
wasm 1.rs 774ms 77ms 48.6MB 760ms 7ms node 18.16.1
wasm 2.rs 943ms 2.4ms 49.3MB 930ms 7ms node 18.16.1
haxe 2.hx 1011ms 67ms 2.4MB 997ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 1241ms 0.7ms 2.3MB 1227ms 0ms haxe/hl/c 4.2.5
haxe 3.hx 1389ms 23ms 27.6MB 1563ms 23ms haxe/cpp 4.2.5
haxe 2.hx 2328ms 47ms 3.2MB 2317ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx 2627ms 189ms 3.2MB 2613ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx timeout 0.0ms 3.3MB 4983ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 3.2MB 4987ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 3.4MB 4513ms 470ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 3.7MB 4630ms 350ms haxe/hl/jit 1.13.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 55ms 1.7ms 16.1MB 43ms 0ms wasmtime 10.0.1
wasm 1.rs 60ms 2.1ms 27.3MB 50ms 0ms wasmedgec 0.13.1
wasm 2.rs 75ms 1.6ms 16.0MB 63ms 0ms wasmtime 10.0.1
wasm 2.rs 77ms 1.6ms 28.6MB 63ms 3ms wasmedgec 0.13.1
haxe 2.hx 100ms 0.8ms 2.3MB 90ms 0ms haxe/hl/c 4.2.5
wasm 1.rs 119ms 0.8ms 49.5MB 107ms 0ms node 18.16.1
haxe 1.hx 128ms 0.8ms 2.3MB 120ms 0ms haxe/hl/c 4.2.5
wasm 2.rs 142ms 2.9ms 49.9MB 127ms 3ms node 18.16.1
haxe 3.hx 159ms 13ms 25.7MB 153ms 7ms haxe/cpp 4.2.5
haxe 2.hx 236ms 1.9ms 3.3MB 223ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx 258ms 2.9ms 3.3MB 250ms 0ms haxe/hl/jit 1.13.0
haxe 3.hx 653ms 14ms 3.2MB 577ms 60ms haxe/hl/c 4.2.5
haxe 3.hx 772ms 1.3ms 3.7MB 697ms 60ms haxe/hl/jit 1.13.0
haxe 2.hx 803ms 1.5ms 3.2MB 790ms 0ms haxe/cpp 4.2.5
haxe 1.hx 1101ms 0.7ms 3.2MB 1087ms 0ms haxe/cpp 4.2.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 4128ms 1.6ms 32.1MB 4110ms 0ms wasmedgec 0.13.1
wasm 7.rs 4247ms 3.7ms 27.6MB 4233ms 0ms wasmedgec 0.13.1
wasm 2.rs 4317ms 4.1ms 49.0MB 4300ms 0ms node 18.16.1
wasm 2.rs 4425ms 1.5ms 16.3MB 4413ms 0ms wasmtime 10.0.1
wasm 7.rs 4554ms 1.2ms 49.4MB 4540ms 7ms node 18.16.1
haxe 1.hx timeout 0.0ms 6.9MB 4990ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 3.1MB 4983ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 3.7MB 4987ms 0ms haxe/hl/jit 1.13.0
wasm 7.rs timeout 0.0ms 16.0MB 4987ms 0ms wasmtime 10.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 1042ms 2.4ms 28.8MB 1023ms 0ms wasmedgec 0.13.1
wasm 7.rs 1072ms 1.6ms 29.5MB 1060ms 0ms wasmedgec 0.13.1
wasm 2.rs 1116ms 0.6ms 16.1MB 1103ms 0ms wasmtime 10.0.1
wasm 2.rs 1117ms 3.3ms 48.3MB 1097ms 7ms node 18.16.1
wasm 7.rs 1177ms 0.5ms 48.4MB 1160ms 3ms node 18.16.1
haxe 1.hx 1304ms 0.9ms 2.9MB 1290ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 2337ms 0.8ms 6.7MB 2327ms 0ms haxe/cpp 4.2.5
wasm 7.rs 3261ms 2.9ms 16.3MB 3243ms 0ms wasmtime 10.0.1
haxe 1.hx timeout 0.0ms 3.6MB 4983ms 0ms haxe/hl/jit 1.13.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 271ms 0.6ms 28.7MB 250ms 0ms wasmedgec 0.13.1
wasm 7.rs 278ms 0.4ms 27.8MB 260ms 0ms wasmedgec 0.13.1
wasm 2.rs 289ms 5.6ms 16.0MB 270ms 0ms wasmtime 10.0.1
wasm 2.rs 317ms 1.2ms 47.0MB 297ms 10ms node 18.16.1
haxe 1.hx 330ms 0.5ms 2.9MB 320ms 0ms haxe/hl/c 4.2.5
wasm 7.rs 332ms 1.3ms 48.0MB 313ms 7ms node 18.16.1
haxe 1.hx 590ms 0.8ms 5.4MB 577ms 0ms haxe/cpp 4.2.5
wasm 7.rs 822ms 1.0ms 16.1MB 810ms 0ms wasmtime 10.0.1
haxe 1.hx 3423ms 1.0ms 3.6MB 3410ms 0ms haxe/hl/jit 1.13.0