Programming Language and compiler
Benchmarks

OCaml VS Wasm benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 2145ms 13ms 37.8MB 2103ms 23ms wasmer/llvm 2.3.0
wasm 5.rs 2189ms 15ms 21.8MB 2157ms 13ms wasmer/llvm 2.3.0
wasm 4.rs 2200ms 0.5ms 21.8MB 2173ms 7ms wasmer/llvm 2.3.0
wasm 5.rs 2220ms 5.4ms 34.7MB 2200ms 0ms wasmedgec 0.11.0
wasm 3.rs 2260ms 12ms 50.8MB 2233ms 7ms wasmedgec 0.11.0
wasm 4.rs 2377ms 24ms 35.0MB 2353ms 10ms wasmedgec 0.11.0
wasm 5.rs 2737ms 25ms 59.4MB 2733ms 20ms node 16.17.0
wasm 3.rs 2803ms 16ms 75.3MB 2783ms 20ms node 16.17.0
wasm 4.rs 2835ms 15ms 59.4MB 2840ms 10ms node 16.17.0
wasm 5.rs 2879ms 21ms 26.8MB 2857ms 7ms wasmtime 1.0.1
wasm 3.rs 2932ms 12ms 42.7MB 2897ms 10ms wasmtime 1.0.1
wasm 4.rs 2950ms 24ms 26.8MB 2930ms 7ms wasmtime 1.0.1
ocaml 1.ml 4394ms 23ms 120.7MB 4350ms 23ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 198ms 0.7ms 9.8MB 183ms 3ms wasmer/llvm 2.3.0
wasm 5.rs 204ms 0.8ms 7.9MB 193ms 0ms wasmer/llvm 2.3.0
wasm 4.rs 206ms 1.3ms 7.9MB 190ms 0ms wasmer/llvm 2.3.0
wasm 3.rs 210ms 0.3ms 22.7MB 190ms 0ms wasmedgec 0.11.0
wasm 5.rs 215ms 6.4ms 20.9MB 200ms 0ms wasmedgec 0.11.0
wasm 4.rs 226ms 1.3ms 22.1MB 210ms 0ms wasmedgec 0.11.0
wasm 5.rs 271ms 1.9ms 12.9MB 260ms 0ms wasmtime 1.0.1
wasm 3.rs 275ms 2.3ms 14.7MB 263ms 0ms wasmtime 1.0.1
wasm 4.rs 279ms 3.2ms 12.8MB 267ms 0ms wasmtime 1.0.1
ocaml 1.ml 284ms 2.7ms 17.4MB 263ms 3ms ocaml 4.14.0
wasm 5.rs 326ms 3.4ms 45.1MB 333ms 7ms node 16.17.0
wasm 3.rs 327ms 2.9ms 46.3MB 330ms 10ms node 16.17.0
wasm 4.rs 341ms 5.0ms 44.8MB 347ms 7ms node 16.17.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3576ms 2.8ms 2.6MB 3560ms 0ms ocaml 4.14.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms node 16.17.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs timeout 0.0ms 0.0MB 0ms 0ms wasmtime 1.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 299ms 0.6ms 2.5MB 290ms 0ms ocaml 4.14.0
wasm 1.rs 426ms 0.4ms 4.7MB 413ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 436ms 3.4ms 9.2MB 423ms 0ms wasmtime 1.0.1
wasm 1.rs 455ms 1.0ms 18.5MB 440ms 0ms wasmedgec 0.11.0
wasm 1.rs 499ms 6.0ms 44.2MB 503ms 7ms node 16.17.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 296ms 1.0ms 6.0MB 280ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 304ms 0.4ms 18.6MB 290ms 0ms wasmedgec 0.11.0
wasm 1.rs 317ms 0.2ms 9.4MB 300ms 0ms wasmtime 1.0.1
ocaml 6.ml 387ms 0.8ms 24.5MB 370ms 0ms ocaml 4.14.0
wasm 1.rs 415ms 2.8ms 43.8MB 423ms 7ms node 16.17.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 33ms 0.9ms 6.1MB 23ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 39ms 0.9ms 11.5MB 30ms 0ms wasmtime 1.0.1
wasm 1.rs 41ms 0.3ms 18.9MB 23ms 3ms wasmedgec 0.11.0
ocaml 6.ml 47ms 3.7ms 5.7MB 33ms 0ms ocaml 4.14.0
wasm 1.rs 123ms 0.8ms 43.3MB 137ms 7ms node 16.17.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.2ms 0.7ms 2.9MB 0ms 0ms ocaml 4.14.0
wasm 1.rs 2.5ms 0.2ms 4.9MB 0ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 6.6ms 1.7ms 9.2MB 0ms 0ms wasmtime 1.0.1
wasm 1.rs 8.6ms 1.2ms 18.4MB 0ms 0ms wasmedgec 0.11.0
wasm 1.rs 83ms 0.6ms 43.2MB 98ms 2ms node 16.17.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 121ms 1.0ms 6.1MB 110ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 138ms 0.7ms 18.7MB 123ms 0ms wasmedgec 0.11.0
wasm 1.rs 148ms 0.8ms 11.1MB 140ms 0ms wasmtime 1.0.1
wasm 1.rs 227ms 2.8ms 44.5MB 237ms 10ms node 16.17.0
ocaml 1.ml 231ms 0.7ms 5.9MB 213ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 356ms 2.8ms 6.0MB 343ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 395ms 1.9ms 18.5MB 380ms 0ms wasmedgec 0.11.0
wasm 1.rs 429ms 5.6ms 11.1MB 417ms 0ms wasmtime 1.0.1
wasm 1.rs 489ms 0.9ms 44.8MB 493ms 17ms node 16.17.0
ocaml 1.ml 679ms 0.5ms 5.8MB 667ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 60ms 0.6ms 4.8MB 50ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 71ms 0.6ms 18.2MB 60ms 0ms wasmedgec 0.11.0
wasm 1.rs 74ms 0.9ms 9.4MB 67ms 0ms wasmtime 1.0.1
ocaml 1.ml 102ms 0.9ms 5.2MB 90ms 0ms ocaml 4.14.0
wasm 1.rs 155ms 1.9ms 44.8MB 167ms 10ms node 16.17.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1090ms 0.8ms 29.9MB 1057ms 20ms wasmer/llvm 2.3.0
wasm 1.rs 1161ms 6.0ms 42.5MB 1133ms 13ms wasmedgec 0.11.0
wasm 1.rs 1379ms 16ms 67.6MB 1383ms 13ms node 16.17.0
wasm 1.rs 1415ms 3.4ms 34.7MB 1390ms 7ms wasmtime 1.0.1
ocaml 1.ml 1706ms 12ms 62.7MB 1653ms 33ms ocaml 4.14.0
ocaml 2.ml 2834ms 23ms 70.4MB 2790ms 27ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 204ms 2.4ms 18.7MB 180ms 3ms ocaml 4.14.0
wasm 1.rs 233ms 0.5ms 11.7MB 217ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 253ms 2.1ms 25.0MB 240ms 0ms wasmedgec 0.11.0
wasm 1.rs 305ms 0.4ms 16.9MB 290ms 3ms wasmtime 1.0.1
wasm 1.rs 361ms 6.6ms 49.6MB 370ms 0ms node 16.17.0
ocaml 2.ml 458ms 4.5ms 23.6MB 437ms 7ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 524ms 0.2ms 4.7MB 510ms 0ms wasmer/llvm 2.3.0
ocaml 1.ml 549ms 0.6ms 2.4MB 540ms 0ms ocaml 4.14.0
wasm 1.rs 569ms 0.5ms 11.4MB 557ms 0ms wasmtime 1.0.1
wasm 1.rs 603ms 1.4ms 18.5MB 587ms 0ms wasmedgec 0.11.0
wasm 1.rs 660ms 2.0ms 48.5MB 680ms 10ms node 16.17.0
wasm 2.rs 802ms 0.2ms 18.7MB 783ms 0ms wasmedgec 0.11.0
wasm 2.rs 825ms 0.7ms 4.8MB 813ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 831ms 5.3ms 9.4MB 820ms 0ms wasmtime 1.0.1
wasm 2.rs 897ms 2.2ms 48.3MB 913ms 10ms node 16.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 58ms 0.3ms 4.9MB 50ms 0ms wasmer/llvm 2.3.0
ocaml 1.ml 59ms 0.7ms 2.6MB 50ms 0ms ocaml 4.14.0
wasm 1.rs 65ms 0.5ms 11.4MB 53ms 0ms wasmtime 1.0.1
wasm 1.rs 69ms 1.5ms 18.6MB 57ms 0ms wasmedgec 0.11.0
wasm 2.rs 85ms 1.6ms 4.9MB 73ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 89ms 1.7ms 18.5MB 77ms 0ms wasmedgec 0.11.0
wasm 2.rs 91ms 1.5ms 9.4MB 77ms 0ms wasmtime 1.0.1
wasm 1.rs 159ms 1.9ms 48.3MB 183ms 7ms node 16.17.0
wasm 2.rs 184ms 6.9ms 48.5MB 203ms 7ms node 16.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 507ms 0.4ms 10.6MB 490ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 611ms 3.6ms 23.6MB 593ms 3ms wasmedgec 0.11.0
wasm 2.rs 784ms 2.3ms 48.6MB 790ms 13ms node 16.17.0
wasm 2.rs 828ms 3.4ms 15.6MB 807ms 3ms wasmtime 1.0.1
wasm 1.rs 1228ms 39ms 45.3MB 1193ms 17ms wasmer/llvm 2.3.0
wasm 1.rs 1293ms 29ms 57.6MB 1263ms 10ms wasmedgec 0.11.0
wasm 1.rs 1505ms 39ms 82.9MB 1510ms 17ms node 16.17.0
wasm 1.rs 1515ms 61ms 49.8MB 1493ms 7ms wasmtime 1.0.1
ocaml 2.ml 2573ms 9.8ms 21.6MB 2553ms 3ms ocaml 4.14.0
ocaml 1.ml 3310ms 2.4ms 555.8MB 3143ms 147ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 115ms 0.6ms 7.2MB 100ms 0ms wasmer/llvm 2.3.0
wasm 1.rs 141ms 3.7ms 15.6MB 120ms 10ms wasmer/llvm 2.3.0
wasm 2.rs 147ms 0.8ms 21.0MB 133ms 3ms wasmedgec 0.11.0
wasm 1.rs 152ms 0.1ms 28.2MB 133ms 3ms wasmedgec 0.11.0
wasm 2.rs 199ms 0.3ms 12.0MB 190ms 0ms wasmtime 1.0.1
wasm 1.rs 214ms 0.3ms 20.7MB 203ms 0ms wasmtime 1.0.1
wasm 1.rs 249ms 0.8ms 53.9MB 247ms 13ms node 16.17.0
wasm 2.rs 250ms 6.6ms 45.3MB 250ms 10ms node 16.17.0
ocaml 2.ml 608ms 1.5ms 9.0MB 593ms 0ms ocaml 4.14.0
ocaml 1.ml 671ms 10ms 142.5MB 617ms 37ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 666ms 3.8ms 50.7MB 637ms 17ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3442ms 0.9ms 21.2MB 3423ms 0ms wasmedgec 0.11.0
wasm 7.rs 3625ms 20ms 5.9MB 3603ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 3701ms 0.4ms 19.3MB 3687ms 0ms wasmedgec 0.11.0
wasm 2.rs 3725ms 1.1ms 6.0MB 3717ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 3908ms 16ms 11.1MB 3887ms 3ms wasmtime 1.0.1
wasm 7.rs 4028ms 1.5ms 11.1MB 4013ms 0ms wasmtime 1.0.1
wasm 7.rs 4158ms 8.1ms 48.3MB 4180ms 7ms node 16.17.0
wasm 2.rs 4439ms 3.1ms 48.3MB 4463ms 7ms node 16.17.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 869ms 1.0ms 19.2MB 853ms 0ms wasmedgec 0.11.0
wasm 7.rs 914ms 0.8ms 5.9MB 900ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 936ms 0.4ms 5.9MB 923ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 936ms 4.0ms 19.3MB 923ms 0ms wasmedgec 0.11.0
wasm 2.rs 1004ms 0.7ms 11.1MB 993ms 0ms wasmtime 1.0.1
wasm 7.rs 1013ms 1.1ms 11.1MB 1000ms 0ms wasmtime 1.0.1
wasm 7.rs 1122ms 3.7ms 48.3MB 1143ms 7ms node 16.17.0
wasm 2.rs 1192ms 4.1ms 48.3MB 1207ms 13ms node 16.17.0
ocaml 2.ml 1522ms 0.9ms 3.4MB 1510ms 0ms ocaml 4.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 226ms 0.1ms 18.5MB 210ms 0ms wasmedgec 0.11.0
wasm 7.rs 233ms 1.1ms 4.7MB 220ms 0ms wasmer/llvm 2.3.0
wasm 2.rs 238ms 0.9ms 4.9MB 230ms 0ms wasmer/llvm 2.3.0
wasm 7.rs 245ms 2.9ms 18.8MB 227ms 0ms wasmedgec 0.11.0
wasm 2.rs 258ms 1.4ms 9.4MB 247ms 0ms wasmtime 1.0.1
wasm 7.rs 261ms 0.3ms 11.4MB 243ms 0ms wasmtime 1.0.1
wasm 7.rs 360ms 0.9ms 48.8MB 373ms 13ms node 16.17.0
wasm 2.rs 377ms 4.6ms 48.8MB 400ms 7ms node 16.17.0
ocaml 2.ml 386ms 3.1ms 3.0MB 370ms 0ms ocaml 4.14.0