Programming Language and compiler
Benchmarks

Wasm VS Crystal benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 2274ms 4.1ms 30.8MB 2253ms 7ms wasmedgec 0.11.2
crystal 1.cr 2277ms 6.4ms 64.1MB 2247ms 20ms crystal 1.7.2
wasm 3.rs 2299ms 23ms 47.3MB 2267ms 17ms wasmedgec 0.11.2
wasm 4.rs 2410ms 3.3ms 31.3MB 2390ms 7ms wasmedgec 0.11.2
wasm 5.rs 2774ms 29ms 59.2MB 2767ms 17ms node 16.19.0
wasm 5.rs 2891ms 59ms 26.6MB 2873ms 7ms wasmtime 5.0.0
wasm 4.rs 2914ms 11ms 59.2MB 2917ms 7ms node 16.19.0
wasm 3.rs 2930ms 48ms 74.3MB 2913ms 20ms node 16.19.0
wasm 4.rs 2960ms 14ms 26.5MB 2943ms 3ms wasmtime 5.0.0
wasm 3.rs 3131ms 15ms 42.6MB 3103ms 13ms wasmtime 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 166ms 2.6ms 10.9MB 153ms 0ms crystal 1.7.2
wasm 3.rs 211ms 2.5ms 19.6MB 190ms 0ms wasmedgec 0.11.2
wasm 5.rs 215ms 2.0ms 17.9MB 200ms 0ms wasmedgec 0.11.2
wasm 4.rs 229ms 0.4ms 17.2MB 213ms 0ms wasmedgec 0.11.2
wasm 5.rs 265ms 0.7ms 12.7MB 250ms 0ms wasmtime 5.0.0
wasm 4.rs 273ms 0.2ms 12.7MB 260ms 0ms wasmtime 5.0.0
wasm 3.rs 284ms 3.3ms 14.8MB 270ms 0ms wasmtime 5.0.0
wasm 5.rs 327ms 2.8ms 44.8MB 323ms 7ms node 16.19.0
wasm 3.rs 329ms 7.8ms 46.1MB 323ms 13ms node 16.19.0
wasm 4.rs 346ms 4.9ms 45.1MB 347ms 3ms node 16.19.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1543ms 32ms 50.6MB 1583ms 10ms node 16.19.0
wasm 3.rs 1657ms 2.8ms 12.6MB 1647ms 0ms wasmtime 5.0.0
wasm 3.rs 2076ms 4.9ms 17.2MB 2057ms 0ms wasmedgec 0.11.2
crystal 1.cr 2381ms 14ms 20.3MB 2337ms 30ms crystal 1.7.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 110ms 1.7ms 11.2MB 100ms 0ms wasmtime 5.0.0
crystal 1.cr 125ms 1.4ms 7.5MB 107ms 3ms crystal 1.7.2
wasm 3.rs 146ms 13ms 17.0MB 127ms 0ms wasmedgec 0.11.2
wasm 3.rs 214ms 4.5ms 48.8MB 250ms 10ms node 16.19.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 77ms 0.3ms 6.5MB 57ms 7ms crystal 1.7.2
wasm 1.rs 473ms 3.1ms 16.8MB 460ms 0ms wasmedgec 0.11.2
wasm 1.rs 589ms 0.8ms 12.0MB 577ms 0ms wasmtime 5.0.0
wasm 1.rs 654ms 4.4ms 49.7MB 687ms 17ms node 16.19.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 30ms 0.2ms 5.2MB 13ms 0ms crystal 1.7.2
wasm 1.rs 127ms 0.9ms 16.1MB 113ms 0ms wasmedgec 0.11.2
wasm 1.rs 156ms 0.5ms 11.3MB 143ms 0ms wasmtime 5.0.0
wasm 1.rs 264ms 1.6ms 49.6MB 307ms 3ms node 16.19.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3751ms 1.7ms 3.0MB 3737ms 0ms crystal 1.7.2
wasm 1.rs timeout 0.0ms 44.2MB 5007ms 3ms node 16.19.0
wasm 1.rs timeout 0.0ms 16.1MB 4983ms 0ms wasmedgec 0.11.2
wasm 1.rs timeout 0.0ms 9.2MB 4987ms 0ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 304ms 0.8ms 2.9MB 290ms 0ms crystal 1.7.2
wasm 1.rs 445ms 4.9ms 9.1MB 430ms 0ms wasmtime 5.0.0
wasm 1.rs 451ms 0.2ms 15.2MB 437ms 3ms wasmedgec 0.11.2
wasm 1.rs 499ms 1.2ms 43.8MB 490ms 20ms node 16.19.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 309ms 1.6ms 17.4MB 293ms 0ms wasmedgec 0.11.2
wasm 1.rs 349ms 1.3ms 9.3MB 340ms 0ms wasmtime 5.0.0
wasm 1.rs 386ms 5.1ms 43.8MB 393ms 13ms node 16.19.0
crystal 2.cr 725ms 2.3ms 3.2MB 637ms 73ms crystal 1.7.2
crystal 1.cr 963ms 1.4ms 14.6MB 850ms 100ms crystal 1.7.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 40ms 4.6ms 14.4MB 30ms 0ms wasmedgec 0.11.2
wasm 1.rs 42ms 1.0ms 9.3MB 27ms 0ms wasmtime 5.0.0
crystal 2.cr 76ms 0.3ms 3.3MB 60ms 0ms crystal 1.7.2
crystal 1.cr 101ms 0.7ms 4.6MB 77ms 10ms crystal 1.7.2
wasm 1.rs 119ms 1.5ms 43.8MB 123ms 13ms node 16.19.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.9ms 0.7ms 2.9MB 0ms 0ms crystal 1.7.2
wasm 1.rs 5.9ms 0.8ms 11.2MB 0ms 0ms wasmtime 5.0.0
wasm 1.rs 6.8ms 0.7ms 15.9MB 0ms 0ms wasmedgec 0.11.2
wasm 1.rs 84ms 1.8ms 43.4MB 96ms 4ms node 16.19.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 56ms 0.2ms 2.9MB 47ms 0ms crystal 1.7.2
crystal 1.cr 93ms 0.4ms 3.0MB 80ms 0ms crystal 1.7.2
wasm 1.rs 156ms 0.5ms 15.7MB 147ms 0ms wasmedgec 0.11.2
wasm 1.rs 190ms 0.8ms 11.2MB 177ms 0ms wasmtime 5.0.0
wasm 1.rs 267ms 2.8ms 46.5MB 277ms 3ms node 16.19.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 161ms 0.9ms 3.0MB 150ms 0ms crystal 1.7.2
crystal 1.cr 270ms 0.9ms 3.0MB 260ms 0ms crystal 1.7.2
wasm 1.rs 450ms 0.5ms 15.7MB 437ms 0ms wasmedgec 0.11.2
wasm 1.rs 554ms 1.0ms 11.2MB 540ms 0ms wasmtime 5.0.0
wasm 1.rs 624ms 3.6ms 44.5MB 630ms 3ms node 16.19.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 29ms 0.4ms 3.0MB 20ms 0ms crystal 1.7.2
crystal 1.cr 47ms 0.6ms 2.9MB 40ms 0ms crystal 1.7.2
wasm 1.rs 81ms 0.3ms 14.8MB 70ms 0ms wasmedgec 0.11.2
wasm 1.rs 97ms 0.2ms 11.2MB 90ms 0ms wasmtime 5.0.0
wasm 1.rs 179ms 3.1ms 44.3MB 173ms 17ms node 16.19.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 413ms 0.6ms 9.6MB 400ms 0ms crystal 1.7.2
wasm 8.rs 1033ms 2.7ms 47.8MB 1037ms 10ms node 16.19.0
wasm 8.rs 1045ms 0.1ms 18.8MB 1033ms 0ms wasmedgec 0.11.2
wasm 8.rs 1420ms 2.2ms 14.1MB 1403ms 0ms wasmtime 5.0.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 0.3ms 6.9MB 10ms 0ms crystal 1.7.2
wasm 8.rs 53ms 1.9ms 15.3MB 40ms 0ms wasmedgec 0.11.2
wasm 8.rs 66ms 1.1ms 11.3MB 57ms 0ms wasmtime 5.0.0
wasm 8.rs 130ms 1.3ms 44.8MB 143ms 7ms node 16.19.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 1256ms 2.7ms 38.6MB 1230ms 10ms wasmedgec 0.11.2
wasm 1.rs 1440ms 29ms 34.9MB 1413ms 10ms wasmtime 5.0.0
wasm 1.rs 1447ms 17ms 66.9MB 1437ms 17ms node 16.19.0
crystal 1.cr 1618ms 9.5ms 64.2MB 1590ms 13ms crystal 1.7.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 267ms 1.2ms 21.9MB 250ms 0ms wasmedgec 0.11.2
crystal 1.cr 288ms 7.9ms 22.2MB 267ms 10ms crystal 1.7.2
wasm 1.rs 301ms 1.9ms 17.0MB 287ms 0ms wasmtime 5.0.0
wasm 1.rs 368ms 1.8ms 49.4MB 363ms 10ms node 16.19.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 547ms 0.9ms 3.0MB 537ms 0ms crystal 1.7.2
wasm 1.rs 569ms 1.1ms 9.4MB 553ms 0ms wasmtime 5.0.0
crystal 2.cr 575ms 6.4ms 2.9MB 563ms 0ms crystal 1.7.2
wasm 1.rs 606ms 0.3ms 15.8MB 590ms 0ms wasmedgec 0.11.2
wasm 1.rs 660ms 3.1ms 48.1MB 677ms 7ms node 16.19.0
wasm 2.rs 802ms 3.5ms 11.2MB 787ms 0ms wasmtime 5.0.0
wasm 2.rs 836ms 4.9ms 15.4MB 820ms 0ms wasmedgec 0.11.2
wasm 2.rs 892ms 2.1ms 48.8MB 907ms 13ms node 16.19.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 60ms 0.5ms 2.9MB 50ms 0ms crystal 1.7.2
crystal 1.cr 60ms 1.8ms 2.9MB 50ms 0ms crystal 1.7.2
wasm 1.rs 66ms 1.8ms 11.3MB 50ms 0ms wasmtime 5.0.0
wasm 1.rs 69ms 0.9ms 15.8MB 57ms 0ms wasmedgec 0.11.2
wasm 2.rs 90ms 1.2ms 11.3MB 77ms 0ms wasmtime 5.0.0
wasm 2.rs 91ms 0.3ms 15.5MB 80ms 0ms wasmedgec 0.11.2
wasm 1.rs 157ms 2.7ms 48.1MB 177ms 3ms node 16.19.0
wasm 2.rs 183ms 1.1ms 48.6MB 200ms 7ms node 16.19.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 441ms 2.4ms 7.8MB 423ms 0ms crystal 1.7.2
wasm 2.rs 663ms 1.7ms 20.1MB 643ms 0ms wasmedgec 0.11.2
wasm 2.rs 810ms 6.7ms 55.1MB 810ms 10ms node 16.19.0
wasm 2.rs 866ms 3.2ms 16.0MB 850ms 0ms wasmtime 5.0.0
wasm 1.rs 1128ms 125ms 54.9MB 1103ms 10ms wasmedgec 0.11.2
crystal 1.cr 1153ms 37ms 42.3MB 1130ms 10ms crystal 1.7.2
wasm 1.rs 1408ms 30ms 83.0MB 1403ms 20ms node 16.19.0
wasm 1.rs 2525ms 64ms 49.9MB 2503ms 7ms wasmtime 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 97ms 0.5ms 4.1MB 90ms 0ms crystal 1.7.2
crystal 1.cr 149ms 0.7ms 12.8MB 140ms 0ms crystal 1.7.2
wasm 1.rs 156ms 2.3ms 25.7MB 143ms 3ms wasmedgec 0.11.2
wasm 2.rs 158ms 3.4ms 16.5MB 140ms 0ms wasmedgec 0.11.2
wasm 2.rs 204ms 0.5ms 12.2MB 187ms 0ms wasmtime 5.0.0
wasm 1.rs 236ms 2.9ms 20.6MB 223ms 0ms wasmtime 5.0.0
wasm 2.rs 250ms 3.7ms 51.0MB 247ms 13ms node 16.19.0
wasm 1.rs 266ms 7.7ms 53.6MB 270ms 3ms node 16.19.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2443ms 5.8ms 16.3MB 2430ms 0ms wasmedgec 0.11.2
wasm 2.rs 2805ms 1.3ms 11.7MB 2790ms 0ms wasmtime 5.0.0
crystal 1.cr 2850ms 21ms 7.5MB 2820ms 17ms crystal 1.7.2
wasm 2.rs 3077ms 4.9ms 48.2MB 3110ms 10ms node 16.19.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 580ms 1.2ms 16.8MB 567ms 3ms wasmedgec 0.11.2
crystal 1.cr 614ms 9.2ms 5.3MB 587ms 10ms crystal 1.7.2
wasm 2.rs 667ms 1.9ms 11.2MB 650ms 0ms wasmtime 5.0.0
wasm 2.rs 818ms 4.1ms 48.6MB 857ms 7ms node 16.19.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 377ms 0.5ms 16.4MB 360ms 0ms wasmedgec 0.11.2
wasm 0.rs 430ms 3.0ms 11.3MB 423ms 0ms wasmtime 5.0.0
wasm 0.rs 454ms 1.8ms 46.8MB 487ms 0ms node 16.19.0
wasm 1.rs 4260ms 7.7ms 16.5MB 4243ms 0ms wasmedgec 0.11.2
wasm 1.rs 4637ms 19ms 59.2MB 4680ms 10ms node 16.19.0
wasm 1.rs 4959ms 9.1ms 11.0MB 4947ms 0ms wasmtime 5.0.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 0.rs 102ms 3.1ms 15.9MB 87ms 0ms wasmedgec 0.11.2
wasm 0.rs 116ms 2.7ms 11.4MB 103ms 0ms wasmtime 5.0.0
wasm 0.rs 191ms 2.8ms 47.0MB 207ms 10ms node 16.19.0
wasm 1.rs 1072ms 1.9ms 15.4MB 1050ms 0ms wasmedgec 0.11.2
wasm 1.rs 1250ms 3.2ms 11.5MB 1237ms 0ms wasmtime 5.0.0
wasm 1.rs 1275ms 3.6ms 58.6MB 1320ms 13ms node 16.19.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3638ms 1.8ms 15.6MB 3623ms 0ms wasmedgec 0.11.2
wasm 7.rs 3675ms 0.2ms 16.7MB 3660ms 0ms wasmedgec 0.11.2
wasm 2.rs 4011ms 8.8ms 11.2MB 3997ms 0ms wasmtime 5.0.0
wasm 7.rs 4036ms 4.9ms 11.3MB 4023ms 0ms wasmtime 5.0.0
wasm 7.rs 4129ms 1.5ms 48.7MB 4140ms 10ms node 16.19.0
wasm 2.rs 4441ms 10ms 48.7MB 4450ms 17ms node 16.19.0
crystal 1.cr timeout 0.0ms 4.0MB 4983ms 0ms crystal 1.7.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 920ms 1.0ms 15.3MB 907ms 0ms wasmedgec 0.11.2
wasm 7.rs 927ms 0.9ms 16.4MB 910ms 0ms wasmedgec 0.11.2
wasm 2.rs 1015ms 3.7ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1015ms 1.0ms 11.3MB 1003ms 0ms wasmtime 5.0.0
wasm 7.rs 1117ms 2.5ms 48.7MB 1133ms 10ms node 16.19.0
wasm 2.rs 1190ms 5.4ms 52.2MB 1193ms 17ms node 16.19.0
crystal 1.cr 1524ms 1.0ms 3.8MB 1507ms 0ms crystal 1.7.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 238ms 1.7ms 15.8MB 230ms 0ms wasmedgec 0.11.2
wasm 7.rs 239ms 1.9ms 15.2MB 223ms 0ms wasmedgec 0.11.2
wasm 2.rs 260ms 0.8ms 11.2MB 243ms 3ms wasmtime 5.0.0
wasm 7.rs 261ms 0.7ms 9.4MB 247ms 0ms wasmtime 5.0.0
wasm 7.rs 358ms 3.4ms 48.6MB 370ms 13ms node 16.19.0
wasm 2.rs 375ms 4.5ms 48.4MB 390ms 10ms node 16.19.0
crystal 1.cr 385ms 0.4ms 3.8MB 373ms 0ms crystal 1.7.2