Wasm VS OCaml benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 2180ms 20ms 31.1MB 2160ms 3ms wasmedgec 0.11.2
wasm 3.rs 2185ms 45ms 47.8MB 2160ms 10ms wasmedgec 0.11.2
wasm 4.rs 2373ms 18ms 30.8MB 2353ms 7ms wasmedgec 0.11.2
wasm 3.rs 2613ms 35ms 42.6MB 2580ms 17ms wasmtime 5.0.0
wasm 5.rs 2867ms 15ms 26.8MB 2853ms 0ms wasmtime 5.0.0
wasm 5.rs 2870ms 20ms 58.4MB 2873ms 10ms node 16.19.0
wasm 3.rs 2889ms 47ms 74.7MB 2880ms 20ms node 16.19.0
wasm 4.rs 2899ms 48ms 58.5MB 2900ms 10ms node 16.19.0
wasm 4.rs 3187ms 20ms 26.8MB 3170ms 3ms wasmtime 5.0.0
ocaml 1.ml 4918ms 27ms 153.4MB 4853ms 47ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 202ms 9.8ms 19.8MB 187ms 0ms wasmedgec 0.11.2
wasm 5.rs 204ms 4.2ms 17.8MB 190ms 0ms wasmedgec 0.11.2
wasm 4.rs 221ms 0.7ms 17.7MB 207ms 0ms wasmedgec 0.11.2
wasm 3.rs 238ms 3.7ms 14.7MB 220ms 0ms wasmtime 5.0.0
wasm 5.rs 267ms 1.0ms 12.8MB 253ms 0ms wasmtime 5.0.0
wasm 4.rs 303ms 11ms 12.8MB 287ms 0ms wasmtime 5.0.0
wasm 4.rs 337ms 6.3ms 44.6MB 343ms 0ms node 16.19.0
wasm 5.rs 337ms 3.3ms 44.1MB 340ms 13ms node 16.19.0
wasm 3.rs 340ms 9.8ms 46.0MB 343ms 3ms node 16.19.0
ocaml 1.ml 343ms 1.5ms 22.9MB 327ms 3ms ocaml 5.0.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1556ms 47ms 49.7MB 1553ms 10ms node 16.19.0
wasm 3.rs 1578ms 9.3ms 12.9MB 1560ms 0ms wasmtime 5.0.0
wasm 3.rs 1982ms 35ms 17.8MB 1970ms 0ms wasmedgec 0.11.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 109ms 1.2ms 11.5MB 93ms 0ms wasmtime 5.0.0
wasm 3.rs 134ms 0.8ms 16.1MB 117ms 0ms wasmedgec 0.11.2
wasm 3.rs 211ms 2.9ms 47.5MB 250ms 10ms node 16.19.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 467ms 1.7ms 17.3MB 450ms 3ms wasmedgec 0.11.2
wasm 1.rs 616ms 13ms 12.3MB 600ms 0ms wasmtime 5.0.0
wasm 1.rs 691ms 4.3ms 49.8MB 730ms 10ms node 16.19.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 128ms 0.4ms 15.9MB 117ms 0ms wasmedgec 0.11.2
wasm 1.rs 165ms 6.7ms 11.5MB 150ms 0ms wasmtime 5.0.0
wasm 1.rs 273ms 3.1ms 49.6MB 313ms 13ms node 16.19.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3975ms 4.3ms 2.8MB 3963ms 0ms ocaml 5.0.0
wasm 1.rs 4719ms 21ms 44.2MB 4730ms 10ms node 16.19.0
wasm 1.rs timeout 0.0ms 15.7MB 4987ms 0ms wasmedgec 0.11.2
wasm 1.rs timeout 0.0ms 9.1MB 4990ms 0ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 330ms 1.2ms 2.9MB 320ms 0ms ocaml 5.0.0
wasm 1.rs 431ms 1.7ms 9.2MB 413ms 0ms wasmtime 5.0.0
wasm 1.rs 448ms 0.5ms 14.3MB 437ms 0ms wasmedgec 0.11.2
wasm 1.rs 470ms 13ms 44.3MB 480ms 3ms node 16.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 357ms 0.7ms 15.7MB 340ms 0ms wasmedgec 0.11.2
wasm 1.rs 412ms 1.4ms 9.2MB 400ms 0ms wasmtime 5.0.0
ocaml 6.ml 421ms 0.7ms 22.7MB 403ms 0ms ocaml 5.0.0
wasm 1.rs 448ms 3.2ms 43.7MB 457ms 10ms node 16.19.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 43ms 0.9ms 15.7MB 33ms 0ms wasmedgec 0.11.2
ocaml 6.ml 46ms 0.5ms 4.9MB 33ms 0ms ocaml 5.0.0
wasm 1.rs 49ms 0.3ms 11.0MB 37ms 0ms wasmtime 5.0.0
wasm 1.rs 126ms 0.8ms 44.0MB 147ms 3ms node 16.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.5ms 0.7ms 2.9MB 0ms 0ms ocaml 5.0.0
wasm 1.rs 6.0ms 0.3ms 10.8MB 0ms 0ms wasmtime 5.0.0
wasm 1.rs 6.3ms 0.3ms 15.9MB 0ms 0ms wasmedgec 0.11.2
wasm 1.rs 81ms 1.5ms 43.3MB 96ms 4ms node 16.19.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 162ms 3.5ms 15.8MB 150ms 0ms wasmedgec 0.11.2
wasm 1.rs 206ms 1.2ms 11.1MB 193ms 0ms wasmtime 5.0.0
ocaml 1.ml 259ms 0.2ms 6.8MB 250ms 0ms ocaml 5.0.0
wasm 1.rs 279ms 8.7ms 44.5MB 283ms 10ms node 16.19.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 461ms 0.7ms 15.6MB 450ms 0ms wasmedgec 0.11.2
wasm 1.rs 601ms 1.2ms 11.1MB 585ms 0ms wasmtime 5.0.0
wasm 1.rs 649ms 8.1ms 44.5MB 657ms 3ms node 16.19.0
ocaml 1.ml 769ms 4.3ms 6.8MB 757ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 82ms 1.2ms 14.7MB 70ms 0ms wasmedgec 0.11.2
wasm 1.rs 105ms 0.5ms 9.2MB 90ms 0ms wasmtime 5.0.0
ocaml 1.ml 115ms 0.5ms 5.9MB 107ms 0ms ocaml 5.0.0
wasm 1.rs 180ms 3.4ms 44.6MB 190ms 3ms node 16.19.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 1074ms 4.0ms 47.4MB 1073ms 17ms node 16.19.0
wasm 8.rs 1100ms 4.8ms 18.6MB 1087ms 0ms wasmedgec 0.11.2
wasm 8.rs 1323ms 17ms 14.1MB 1300ms 0ms wasmtime 5.0.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 54ms 1.3ms 16.2MB 43ms 0ms wasmedgec 0.11.2
wasm 8.rs 63ms 0.7ms 11.3MB 53ms 0ms wasmtime 5.0.0
wasm 8.rs 137ms 3.2ms 44.8MB 150ms 3ms node 16.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1239ms 32ms 39.7MB 1210ms 17ms wasmedgec 0.11.2
wasm 1.rs 1455ms 25ms 34.9MB 1430ms 7ms wasmtime 5.0.0
wasm 1.rs 1475ms 1.2ms 66.9MB 1473ms 13ms node 16.19.0
ocaml 1.ml 1528ms 14ms 69.1MB 1497ms 13ms ocaml 5.0.0
ocaml 2.ml 3201ms 10ms 74.3MB 3160ms 27ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 223ms 0.9ms 25.6MB 207ms 3ms ocaml 5.0.0
wasm 1.rs 261ms 1.5ms 20.4MB 247ms 0ms wasmedgec 0.11.2
wasm 1.rs 306ms 2.3ms 17.1MB 290ms 0ms wasmtime 5.0.0
wasm 1.rs 373ms 8.1ms 49.6MB 377ms 7ms node 16.19.0
ocaml 2.ml 572ms 3.4ms 30.1MB 550ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 468ms 0.1ms 3.0MB 460ms 0ms ocaml 5.0.0
wasm 1.rs 497ms 15ms 9.3MB 483ms 0ms wasmtime 5.0.0
wasm 1.rs 502ms 2.4ms 15.3MB 487ms 0ms wasmedgec 0.11.2
wasm 1.rs 576ms 5.1ms 48.0MB 593ms 7ms node 16.19.0
wasm 2.rs 673ms 5.3ms 9.4MB 657ms 0ms wasmtime 5.0.0
wasm 2.rs 694ms 1.0ms 15.8MB 680ms 0ms wasmedgec 0.11.2
wasm 2.rs 751ms 0.9ms 50.7MB 763ms 13ms node 16.19.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 1.2ms 2.9MB 40ms 0ms ocaml 5.0.0
wasm 1.rs 56ms 0.4ms 10.8MB 43ms 0ms wasmtime 5.0.0
wasm 1.rs 58ms 0.6ms 15.8MB 47ms 0ms wasmedgec 0.11.2
wasm 2.rs 75ms 1.4ms 9.4MB 60ms 0ms wasmtime 5.0.0
wasm 2.rs 77ms 1.0ms 15.4MB 63ms 0ms wasmedgec 0.11.2
wasm 1.rs 147ms 5.0ms 48.1MB 163ms 7ms node 16.19.0
wasm 2.rs 171ms 1.8ms 48.8MB 187ms 10ms node 16.19.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 565ms 5.4ms 20.6MB 547ms 0ms wasmedgec 0.11.2
wasm 2.rs 741ms 3.2ms 15.9MB 727ms 0ms wasmtime 5.0.0
wasm 2.rs 743ms 13ms 48.5MB 747ms 10ms node 16.19.0
wasm 1.rs 1448ms 159ms 54.0MB 1423ms 10ms wasmedgec 0.11.2
wasm 1.rs 1486ms 103ms 82.8MB 1483ms 20ms node 16.19.0
ocaml 1.ml 1942ms 9.7ms 550.6MB 1843ms 83ms ocaml 5.0.0
wasm 1.rs 2121ms 90ms 50.1MB 2100ms 3ms wasmtime 5.0.0
ocaml 2.ml 2416ms 46ms 19.0MB 2403ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 137ms 2.3ms 16.9MB 120ms 0ms wasmedgec 0.11.2
wasm 2.rs 176ms 0.6ms 12.1MB 163ms 0ms wasmtime 5.0.0
wasm 1.rs 182ms 9.1ms 25.3MB 167ms 0ms wasmedgec 0.11.2
wasm 1.rs 234ms 4.1ms 20.7MB 210ms 3ms wasmtime 5.0.0
wasm 2.rs 238ms 3.0ms 44.7MB 243ms 7ms node 16.19.0
wasm 1.rs 244ms 12ms 53.3MB 243ms 13ms node 16.19.0
ocaml 1.ml 354ms 17ms 140.4MB 323ms 13ms ocaml 5.0.0
ocaml 2.ml 602ms 21ms 9.1MB 583ms 0ms ocaml 5.0.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2770ms 3.3ms 16.8MB 2753ms 0ms wasmedgec 0.11.2
wasm 2.rs 3089ms 1.7ms 11.8MB 3080ms 0ms wasmtime 5.0.0
wasm 2.rs 3451ms 41ms 48.7MB 3487ms 13ms node 16.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 651ms 2.3ms 15.3MB 640ms 0ms wasmedgec 0.11.2
wasm 2.rs 727ms 1.0ms 11.3MB 710ms 0ms wasmtime 5.0.0
wasm 2.rs 895ms 12ms 48.1MB 933ms 13ms node 16.19.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 447ms 0.4ms 17.3MB 433ms 0ms wasmedgec 0.11.2
wasm 0.rs 478ms 0.8ms 9.5MB 467ms 0ms wasmtime 5.0.0
wasm 0.rs 500ms 3.3ms 47.0MB 517ms 10ms node 16.19.0
wasm 1.rs 4688ms 3.1ms 16.1MB 4670ms 0ms wasmedgec 0.11.2
wasm 1.rs 4898ms 56ms 58.5MB 4943ms 17ms node 16.19.0
wasm 1.rs timeout 0.0ms 11.7MB 4983ms 0ms wasmtime 5.0.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 123ms 4.2ms 16.2MB 107ms 0ms wasmedgec 0.11.2
wasm 0.rs 130ms 4.5ms 11.3MB 120ms 0ms wasmtime 5.0.0
wasm 0.rs 207ms 0.3ms 46.7MB 230ms 7ms node 16.19.0
wasm 1.rs 1186ms 11ms 16.2MB 1163ms 0ms wasmedgec 0.11.2
wasm 1.rs 1319ms 3.2ms 11.6MB 1307ms 0ms wasmtime 5.0.0
wasm 1.rs 1360ms 18ms 56.1MB 1393ms 37ms node 16.19.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 4128ms 2.4ms 15.4MB 4110ms 3ms wasmedgec 0.11.2
wasm 7.rs 4266ms 34ms 16.0MB 4250ms 0ms wasmedgec 0.11.2
wasm 2.rs 4306ms 3.2ms 48.5MB 4323ms 10ms node 16.19.0
wasm 2.rs 4413ms 29ms 11.3MB 4400ms 0ms wasmtime 5.0.0
wasm 7.rs 4514ms 17ms 48.9MB 4530ms 10ms node 16.19.0
wasm 7.rs 4629ms 19ms 11.3MB 4617ms 0ms wasmtime 5.0.0
ocaml 2.ml timeout 0.0ms 4.2MB 4990ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 1044ms 6.9ms 16.2MB 1030ms 0ms wasmedgec 0.11.2
wasm 7.rs 1068ms 1.1ms 15.7MB 1057ms 0ms wasmedgec 0.11.2
wasm 2.rs 1113ms 0.1ms 11.3MB 1100ms 0ms wasmtime 5.0.0
wasm 2.rs 1157ms 5.8ms 48.5MB 1167ms 17ms node 16.19.0
wasm 7.rs 1162ms 0.5ms 11.3MB 1150ms 0ms wasmtime 5.0.0
wasm 7.rs 1206ms 3.5ms 48.8MB 1217ms 17ms node 16.19.0
ocaml 2.ml 1634ms 0.6ms 3.7MB 1620ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 268ms 0.8ms 14.9MB 257ms 0ms wasmedgec 0.11.2
wasm 7.rs 279ms 6.0ms 16.1MB 257ms 0ms wasmedgec 0.11.2
wasm 2.rs 288ms 6.1ms 9.4MB 277ms 0ms wasmtime 5.0.0
wasm 7.rs 299ms 2.6ms 9.5MB 290ms 0ms wasmtime 5.0.0
wasm 2.rs 375ms 13ms 48.5MB 387ms 17ms node 16.19.0
wasm 7.rs 384ms 2.8ms 48.9MB 410ms 7ms node 16.19.0
ocaml 2.ml 412ms 0.8ms 3.4MB 400ms 0ms ocaml 5.0.0