Programming Language and compiler
Benchmarks

OCaml VS Wasm benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 2274ms 4.1ms 30.8MB 2253ms 7ms wasmedgec 0.11.2
wasm 3.rs 2299ms 23ms 47.3MB 2267ms 17ms wasmedgec 0.11.2
wasm 4.rs 2410ms 3.3ms 31.3MB 2390ms 7ms wasmedgec 0.11.2
wasm 5.rs 2774ms 29ms 59.2MB 2767ms 17ms node 16.19.0
wasm 5.rs 2891ms 59ms 26.6MB 2873ms 7ms wasmtime 5.0.0
wasm 4.rs 2914ms 11ms 59.2MB 2917ms 7ms node 16.19.0
wasm 3.rs 2930ms 48ms 74.3MB 2913ms 20ms node 16.19.0
wasm 4.rs 2960ms 14ms 26.5MB 2943ms 3ms wasmtime 5.0.0
wasm 3.rs 3131ms 15ms 42.6MB 3103ms 13ms wasmtime 5.0.0
ocaml 1.ml timeout 0.0ms 153.6MB 4920ms 60ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 211ms 2.5ms 19.6MB 190ms 0ms wasmedgec 0.11.2
wasm 5.rs 215ms 2.0ms 17.9MB 200ms 0ms wasmedgec 0.11.2
wasm 4.rs 229ms 0.4ms 17.2MB 213ms 0ms wasmedgec 0.11.2
wasm 5.rs 265ms 0.7ms 12.7MB 250ms 0ms wasmtime 5.0.0
wasm 4.rs 273ms 0.2ms 12.7MB 260ms 0ms wasmtime 5.0.0
wasm 3.rs 284ms 3.3ms 14.8MB 270ms 0ms wasmtime 5.0.0
wasm 5.rs 327ms 2.8ms 44.8MB 323ms 7ms node 16.19.0
wasm 3.rs 329ms 7.8ms 46.1MB 323ms 13ms node 16.19.0
wasm 4.rs 346ms 4.9ms 45.1MB 347ms 3ms node 16.19.0
ocaml 1.ml 350ms 6.3ms 22.9MB 330ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3637ms 1.5ms 2.8MB 3623ms 0ms ocaml 5.0.0
wasm 1.rs timeout 0.0ms 44.2MB 5007ms 3ms node 16.19.0
wasm 1.rs timeout 0.0ms 16.1MB 4983ms 0ms wasmedgec 0.11.2
wasm 1.rs timeout 0.0ms 9.2MB 4987ms 0ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 303ms 0.6ms 2.8MB 290ms 0ms ocaml 5.0.0
wasm 1.rs 445ms 4.9ms 9.1MB 430ms 0ms wasmtime 5.0.0
wasm 1.rs 451ms 0.2ms 15.2MB 437ms 3ms wasmedgec 0.11.2
wasm 1.rs 499ms 1.2ms 43.8MB 490ms 20ms node 16.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 309ms 1.6ms 17.4MB 293ms 0ms wasmedgec 0.11.2
wasm 1.rs 349ms 1.3ms 9.3MB 340ms 0ms wasmtime 5.0.0
ocaml 6.ml 378ms 0.3ms 22.6MB 360ms 10ms ocaml 5.0.0
wasm 1.rs 386ms 5.1ms 43.8MB 393ms 13ms node 16.19.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 40ms 4.6ms 14.4MB 30ms 0ms wasmedgec 0.11.2
wasm 1.rs 42ms 1.0ms 9.3MB 27ms 0ms wasmtime 5.0.0
ocaml 6.ml 42ms 1.1ms 5.0MB 30ms 0ms ocaml 5.0.0
wasm 1.rs 119ms 1.5ms 43.8MB 123ms 13ms node 16.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.3ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
wasm 1.rs 5.9ms 0.8ms 11.2MB 0ms 0ms wasmtime 5.0.0
wasm 1.rs 6.8ms 0.7ms 15.9MB 0ms 0ms wasmedgec 0.11.2
wasm 1.rs 84ms 1.8ms 43.4MB 96ms 4ms node 16.19.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 156ms 0.5ms 15.7MB 147ms 0ms wasmedgec 0.11.2
wasm 1.rs 190ms 0.8ms 11.2MB 177ms 0ms wasmtime 5.0.0
ocaml 1.ml 245ms 1.5ms 6.8MB 233ms 0ms ocaml 5.0.0
wasm 1.rs 267ms 2.8ms 46.5MB 277ms 3ms node 16.19.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 450ms 0.5ms 15.7MB 437ms 0ms wasmedgec 0.11.2
wasm 1.rs 554ms 1.0ms 11.2MB 540ms 0ms wasmtime 5.0.0
wasm 1.rs 624ms 3.6ms 44.5MB 630ms 3ms node 16.19.0
ocaml 1.ml 724ms 1.7ms 6.8MB 710ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 81ms 0.3ms 14.8MB 70ms 0ms wasmedgec 0.11.2
wasm 1.rs 97ms 0.2ms 11.2MB 90ms 0ms wasmtime 5.0.0
ocaml 1.ml 109ms 0.3ms 6.0MB 97ms 0ms ocaml 5.0.0
wasm 1.rs 179ms 3.1ms 44.3MB 173ms 17ms node 16.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1256ms 2.7ms 38.6MB 1230ms 10ms wasmedgec 0.11.2
wasm 1.rs 1440ms 29ms 34.9MB 1413ms 10ms wasmtime 5.0.0
wasm 1.rs 1447ms 17ms 66.9MB 1437ms 17ms node 16.19.0
ocaml 1.ml 1777ms 7.9ms 69.3MB 1723ms 40ms ocaml 5.0.0
ocaml 2.ml 3374ms 15ms 74.1MB 3323ms 33ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 265ms 3.9ms 25.8MB 240ms 10ms ocaml 5.0.0
wasm 1.rs 267ms 1.2ms 21.9MB 250ms 0ms wasmedgec 0.11.2
wasm 1.rs 301ms 1.9ms 17.0MB 287ms 0ms wasmtime 5.0.0
wasm 1.rs 368ms 1.8ms 49.4MB 363ms 10ms node 16.19.0
ocaml 2.ml 589ms 2.0ms 30.3MB 567ms 7ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 538ms 4.0ms 3.0MB 520ms 0ms ocaml 5.0.0
wasm 1.rs 569ms 1.1ms 9.4MB 553ms 0ms wasmtime 5.0.0
wasm 1.rs 606ms 0.3ms 15.8MB 590ms 0ms wasmedgec 0.11.2
wasm 1.rs 660ms 3.1ms 48.1MB 677ms 7ms node 16.19.0
wasm 2.rs 802ms 3.5ms 11.2MB 787ms 0ms wasmtime 5.0.0
wasm 2.rs 836ms 4.9ms 15.4MB 820ms 0ms wasmedgec 0.11.2
wasm 2.rs 892ms 2.1ms 48.8MB 907ms 13ms node 16.19.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 58ms 0.3ms 2.9MB 50ms 0ms ocaml 5.0.0
wasm 1.rs 66ms 1.8ms 11.3MB 50ms 0ms wasmtime 5.0.0
wasm 1.rs 69ms 0.9ms 15.8MB 57ms 0ms wasmedgec 0.11.2
wasm 2.rs 90ms 1.2ms 11.3MB 77ms 0ms wasmtime 5.0.0
wasm 2.rs 91ms 0.3ms 15.5MB 80ms 0ms wasmedgec 0.11.2
wasm 1.rs 157ms 2.7ms 48.1MB 177ms 3ms node 16.19.0
wasm 2.rs 183ms 1.1ms 48.6MB 200ms 7ms node 16.19.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 663ms 1.7ms 20.1MB 643ms 0ms wasmedgec 0.11.2
wasm 2.rs 810ms 6.7ms 55.1MB 810ms 10ms node 16.19.0
wasm 2.rs 866ms 3.2ms 16.0MB 850ms 0ms wasmtime 5.0.0
wasm 1.rs 1128ms 125ms 54.9MB 1103ms 10ms wasmedgec 0.11.2
wasm 1.rs 1408ms 30ms 83.0MB 1403ms 20ms node 16.19.0
wasm 1.rs 2525ms 64ms 49.9MB 2503ms 7ms wasmtime 5.0.0
ocaml 1.ml 2639ms 6.0ms 550.4MB 2483ms 137ms ocaml 5.0.0
ocaml 2.ml 2827ms 181ms 19.0MB 2810ms 3ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 156ms 2.3ms 25.7MB 143ms 3ms wasmedgec 0.11.2
wasm 2.rs 158ms 3.4ms 16.5MB 140ms 0ms wasmedgec 0.11.2
wasm 2.rs 204ms 0.5ms 12.2MB 187ms 0ms wasmtime 5.0.0
wasm 1.rs 236ms 2.9ms 20.6MB 223ms 0ms wasmtime 5.0.0
wasm 2.rs 250ms 3.7ms 51.0MB 247ms 13ms node 16.19.0
wasm 1.rs 266ms 7.7ms 53.6MB 270ms 3ms node 16.19.0
ocaml 1.ml 576ms 3.3ms 140.3MB 530ms 27ms ocaml 5.0.0
ocaml 2.ml 640ms 3.5ms 9.1MB 627ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 194.3MB 4887ms 90ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 709ms 2.1ms 52.5MB 667ms 23ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3638ms 1.8ms 15.6MB 3623ms 0ms wasmedgec 0.11.2
wasm 7.rs 3675ms 0.2ms 16.7MB 3660ms 0ms wasmedgec 0.11.2
wasm 2.rs 4011ms 8.8ms 11.2MB 3997ms 0ms wasmtime 5.0.0
wasm 7.rs 4036ms 4.9ms 11.3MB 4023ms 0ms wasmtime 5.0.0
wasm 7.rs 4129ms 1.5ms 48.7MB 4140ms 10ms node 16.19.0
wasm 2.rs 4441ms 10ms 48.7MB 4450ms 17ms node 16.19.0
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 920ms 1.0ms 15.3MB 907ms 0ms wasmedgec 0.11.2
wasm 7.rs 927ms 0.9ms 16.4MB 910ms 0ms wasmedgec 0.11.2
wasm 2.rs 1015ms 3.7ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1015ms 1.0ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1117ms 2.5ms 48.7MB 1133ms 10ms node 16.19.0
wasm 2.rs 1190ms 5.4ms 52.2MB 1193ms 17ms node 16.19.0
ocaml 2.ml 1550ms 13ms 3.6MB 1537ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 238ms 1.7ms 15.8MB 230ms 0ms wasmedgec 0.11.2
wasm 7.rs 239ms 1.9ms 15.2MB 223ms 0ms wasmedgec 0.11.2
wasm 2.rs 260ms 0.8ms 11.2MB 243ms 3ms wasmtime 5.0.0
wasm 7.rs 261ms 0.7ms 9.4MB 247ms 0ms wasmtime 5.0.0
wasm 7.rs 358ms 3.4ms 48.6MB 370ms 13ms node 16.19.0
wasm 2.rs 375ms 4.5ms 48.4MB 390ms 10ms node 16.19.0
ocaml 2.ml 390ms 0.4ms 3.4MB 380ms 0ms ocaml 5.0.0