Wasm VS Kotlin benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 469ms 5.8ms 575.8MB 550ms 80ms kotlin/jvm 21
wasm 3.rs 1832ms 18ms 82.0MB 1817ms 23ms node 18.19.0
wasm 5.rs 1873ms 10ms 65.7MB 1860ms 20ms node 18.19.0
wasm 4.rs 1910ms 6.6ms 34.9MB 1893ms 3ms wasmtime 17.0.0
wasm 3.rs 1959ms 30ms 50.9MB 1923ms 20ms wasmtime 17.0.0
wasm 5.rs 2022ms 10ms 34.9MB 1997ms 3ms wasmtime 17.0.0
wasm 4.rs 2156ms 42ms 66.8MB 2137ms 20ms node 18.19.0
kotlin 1-m.kt 3056ms 54ms 248.5MB 5070ms 700ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 99ms 0.6ms 158.3MB 107ms 30ms kotlin/jvm 21
wasm 4.rs 184ms 4.7ms 20.9MB 167ms 0ms wasmtime 17.0.0
wasm 3.rs 186ms 4.3ms 22.9MB 167ms 0ms wasmtime 17.0.0
wasm 5.rs 194ms 1.5ms 20.9MB 180ms 0ms wasmtime 17.0.0
wasm 3.rs 208ms 1.9ms 53.2MB 190ms 23ms node 18.19.0
wasm 5.rs 215ms 1.7ms 53.0MB 210ms 7ms node 18.19.0
wasm 4.rs 252ms 15ms 53.0MB 240ms 13ms node 18.19.0
kotlin 1-m.kt 270ms 4.6ms 28.5MB 430ms 60ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1207ms 4.1ms 55.8MB 1250ms 20ms node 18.19.0
wasm 3.rs 1234ms 9.3ms 21.1MB 1217ms 3ms wasmtime 17.0.0
kotlin 2-m.kt 1773ms 358ms 242.2MB 6577ms 93ms kotlin/jvm 21
kotlin 1.kt 2141ms 6.2ms 220.2MB 3003ms 67ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 14.8MB 6140ms 457ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 72.9MB 19063ms 127ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 89ms 3.1ms 19.7MB 77ms 0ms wasmtime 17.0.0
wasm 3.rs 129ms 0.6ms 57.2MB 157ms 23ms node 18.19.0
kotlin 2-m.kt 404ms 0.7ms 32.8MB 1477ms 27ms kotlin/native 1.8.21
kotlin 1-m.kt 465ms 18ms 74.9MB 1057ms 50ms kotlin/jvm 21
kotlin 1.kt 683ms 4.2ms 10.8MB 820ms 57ms kotlin/native 1.8.21
kotlin 2-m.kt 912ms 14ms 99.8MB 3203ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 469ms 42ms 20.3MB 453ms 0ms wasmtime 17.0.0
wasm 1.rs 481ms 2.2ms 58.4MB 543ms 17ms node 18.19.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 120ms 0.3ms 19.6MB 103ms 0ms wasmtime 17.0.0
wasm 1.rs 176ms 0.9ms 58.2MB 223ms 23ms node 18.19.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 4176ms 317ms 18.5MB 4160ms 0ms wasmtime 17.0.0
wasm 1.rs timeout 0.0ms 50.5MB 4983ms 7ms node 18.19.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 341ms 5.0ms 18.5MB 330ms 0ms wasmtime 17.0.0
wasm 1.rs 654ms 3.7ms 50.4MB 640ms 10ms node 18.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 295ms 2.8ms 18.8MB 280ms 0ms wasmtime 17.0.0
wasm 1.rs 317ms 2.4ms 50.0MB 310ms 7ms node 18.19.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 38ms 0.5ms 18.9MB 23ms 0ms wasmtime 17.0.0
wasm 1.rs 67ms 0.8ms 50.5MB 63ms 7ms node 18.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.3ms 0.1ms 4.7MB 0ms 0ms kotlin/native 1.8.21
wasm 1.rs 6.8ms 0.2ms 19.0MB 0ms 0ms wasmtime 17.0.0
wasm 1.rs 37ms 0.7ms 48.6MB 24ms 4ms node 18.19.0
kotlin 1.kt 58ms 4.5ms 47.3MB 58ms 14ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 118ms 1.0ms 19.0MB 107ms 0ms wasmtime 17.0.0
kotlin 1-m.kt 179ms 1.1ms 94.8MB 310ms 17ms kotlin/jvm 21
kotlin 2-m.kt 199ms 5.9ms 100.7MB 413ms 33ms kotlin/jvm 21
wasm 1.rs 205ms 1.5ms 53.4MB 207ms 10ms node 18.19.0
kotlin 2.kt 303ms 2.6ms 7.8MB 433ms 10ms kotlin/native 1.8.21
kotlin 1.kt 507ms 10ms 7.8MB 607ms 3ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 302ms 3.3ms 212.9MB 523ms 57ms kotlin/jvm 21
kotlin 1.kt 326ms 4.4ms 204.4MB 440ms 33ms kotlin/jvm 21
wasm 1.rs 340ms 7.6ms 19.0MB 327ms 0ms wasmtime 17.0.0
wasm 1.rs 534ms 4.6ms 53.3MB 530ms 17ms node 18.19.0
kotlin 2.kt 911ms 18ms 7.8MB 1313ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1534ms 5.9ms 7.8MB 1860ms 30ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 62ms 0.6ms 18.8MB 50ms 0ms wasmtime 17.0.0
wasm 1.rs 120ms 1.4ms 52.2MB 110ms 17ms node 18.19.0
kotlin 2.kt 141ms 2.9ms 5.8MB 193ms 3ms kotlin/native 1.8.21
kotlin 1-m.kt 143ms 4.2ms 90.6MB 260ms 37ms kotlin/jvm 21
kotlin 2-m.kt 158ms 11ms 95.6MB 307ms 40ms kotlin/jvm 21
kotlin 1.kt 180ms 1.3ms 5.8MB 237ms 0ms kotlin/native 1.8.21

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 864ms 2.7ms 21.8MB 850ms 0ms wasmtime 17.0.0
wasm 8.rs 1081ms 21ms 54.1MB 1067ms 13ms node 18.19.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 44ms 0.3ms 18.9MB 37ms 3ms wasmtime 17.0.0
wasm 8.rs 85ms 3.1ms 51.0MB 80ms 3ms node 18.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 352ms 3.1ms 677.8MB 383ms 80ms kotlin/jvm 21
wasm 1.rs 994ms 15ms 42.9MB 967ms 13ms wasmtime 17.0.0
wasm 1.rs 1049ms 26ms 74.0MB 1027ms 20ms node 18.19.0
kotlin 1-m.kt 1499ms 16ms 136.6MB 2307ms 317ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 129ms 0.4ms 206.5MB 147ms 47ms kotlin/jvm 21
wasm 1.rs 222ms 0.8ms 24.9MB 210ms 0ms wasmtime 17.0.0
wasm 1.rs 258ms 2.2ms 55.9MB 243ms 17ms node 18.19.0
kotlin 1-m.kt 323ms 19ms 40.4MB 467ms 77ms kotlin/native 1.8.21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 406ms 3.4ms 4.6MB 393ms 0ms kotlin/native 1.8.21
kotlin 1.kt 442ms 1.8ms 49.2MB 497ms 7ms kotlin/jvm 21
wasm 1.rs 448ms 1.3ms 18.8MB 430ms 0ms wasmtime 17.0.0
wasm 2.rs 569ms 0.7ms 18.8MB 557ms 0ms wasmtime 17.0.0
wasm 1.rs 787ms 145ms 50.0MB 773ms 7ms node 18.19.0
wasm 2.rs 871ms 3.1ms 51.1MB 860ms 7ms node 18.19.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 44ms 0.9ms 4.6MB 33ms 0ms kotlin/native 1.8.21
wasm 1.rs 54ms 1.0ms 18.8MB 40ms 3ms wasmtime 17.0.0
wasm 2.rs 66ms 0.7ms 18.8MB 53ms 0ms wasmtime 17.0.0
wasm 1.rs 104ms 2.6ms 50.1MB 93ms 10ms node 18.19.0
kotlin 1-m.kt 120ms 0.3ms 49.4MB 167ms 17ms kotlin/jvm 21
wasm 2.rs 122ms 0.7ms 50.8MB 110ms 7ms node 18.19.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 346ms 3.4ms 23.8MB 337ms 0ms wasmtime 17.0.0
wasm 1.rs 515ms 31ms 57.9MB 500ms 3ms wasmtime 17.0.0
wasm 2.rs 589ms 5.8ms 54.8MB 580ms 3ms node 18.19.0
wasm 1.rs 812ms 6.1ms 89.4MB 797ms 17ms node 18.19.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 90ms 1.5ms 20.0MB 70ms 0ms wasmtime 17.0.0
wasm 1.rs 107ms 11ms 28.7MB 90ms 3ms wasmtime 17.0.0
wasm 2.rs 173ms 1.8ms 51.1MB 167ms 0ms node 18.19.0
wasm 1.rs 184ms 0.9ms 59.9MB 160ms 17ms node 18.19.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2223ms 3.0ms 19.8MB 2210ms 0ms wasmtime 17.0.0
wasm 2.rs 2256ms 1.9ms 56.4MB 2277ms 30ms node 18.19.0
kotlin 1.kt 3719ms 43ms 355.7MB 4563ms 90ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.5MB 6490ms 283ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 4980ms 173ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 526ms 0.4ms 18.9MB 507ms 0ms wasmtime 17.0.0
wasm 2.rs 567ms 0.1ms 56.3MB 590ms 23ms node 18.19.0
kotlin 1-m.kt 976ms 35ms 353.3MB 1717ms 97ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6410ms 283ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 5020ms 130ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 3058ms 41ms 233.9MB 3943ms 80ms kotlin/jvm 21
wasm 1.rs 3531ms 59ms 58.4MB 3590ms 20ms node 18.19.0
wasm 1.rs 3639ms 5.5ms 18.5MB 3623ms 0ms wasmtime 17.0.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 923ms 5.6ms 19.0MB 907ms 0ms wasmtime 17.0.0
wasm 1.rs 927ms 13ms 58.4MB 977ms 30ms node 18.19.0
kotlin 1-m.kt 975ms 45ms 233.6MB 1800ms 47ms kotlin/jvm 21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 7.rs 3705ms 9.4ms 49.9MB 3690ms 7ms node 18.19.0
wasm 2.rs 3742ms 13ms 18.3MB 3727ms 0ms wasmtime 17.0.0
wasm 2.rs 3746ms 4.9ms 49.7MB 3730ms 7ms node 18.19.0
wasm 7.rs 4973ms 5.7ms 18.3MB 4957ms 3ms wasmtime 17.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 942ms 1.0ms 18.3MB 930ms 0ms wasmtime 17.0.0
wasm 7.rs 954ms 2.8ms 49.9MB 937ms 10ms node 18.19.0
wasm 2.rs 963ms 1.3ms 49.4MB 953ms 3ms node 18.19.0
wasm 7.rs 1251ms 3.1ms 18.2MB 1237ms 0ms wasmtime 17.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 245ms 0.7ms 18.7MB 230ms 0ms wasmtime 17.0.0
wasm 7.rs 268ms 1.8ms 49.7MB 253ms 10ms node 18.19.0
wasm 2.rs 271ms 2.4ms 49.3MB 263ms 3ms node 18.19.0
wasm 7.rs 320ms 1.0ms 18.2MB 303ms 0ms wasmtime 17.0.0