Programming Language and compiler
Benchmarks

Chapel VS Wasm benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 2048ms 5.9ms 60.1MB 2017ms 10ms wasmedgec 0.13.1
wasm 5.rs 2074ms 21ms 44.2MB 2047ms 10ms wasmedgec 0.13.1
wasm 4.rs 2202ms 1.4ms 44.9MB 2170ms 13ms wasmedgec 0.13.1
wasm 3.rs 2272ms 23ms 48.1MB 2243ms 3ms wasmtime 10.0.1
chapel 4.chpl 2278ms 2.2ms 64.2MB 2247ms 20ms chpl 1.31.0
chapel 3.chpl 2393ms 13ms 50.2MB 2373ms 10ms chpl 1.31.0
wasm 3.rs 2717ms 81ms 80.1MB 2687ms 27ms node 18.16.1
wasm 4.rs 2770ms 28ms 65.4MB 2747ms 20ms node 18.16.1
wasm 5.rs 2774ms 20ms 65.1MB 2763ms 7ms node 18.16.1
wasm 5.rs 2817ms 17ms 32.3MB 2800ms 7ms wasmtime 10.0.1
wasm 4.rs 2933ms 20ms 32.2MB 2910ms 7ms wasmtime 10.0.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 203ms 4.3ms 32.0MB 180ms 0ms wasmedgec 0.13.1
wasm 5.rs 204ms 1.9ms 30.1MB 187ms 0ms wasmedgec 0.13.1
wasm 3.rs 215ms 5.6ms 20.0MB 200ms 0ms wasmtime 10.0.1
wasm 4.rs 219ms 2.6ms 30.1MB 197ms 3ms wasmedgec 0.13.1
chapel 4.chpl 220ms 1.8ms 28.0MB 203ms 7ms chpl 1.31.0
chapel 3.chpl 225ms 0.7ms 24.1MB 207ms 7ms chpl 1.31.0
wasm 5.rs 269ms 0.5ms 18.1MB 257ms 0ms wasmtime 10.0.1
wasm 4.rs 284ms 1.1ms 20.0MB 270ms 0ms wasmtime 10.0.1
wasm 3.rs 305ms 8.2ms 52.4MB 290ms 3ms node 18.16.1
wasm 5.rs 308ms 1.0ms 52.2MB 303ms 0ms node 18.16.1
wasm 4.rs 308ms 8.2ms 53.1MB 300ms 7ms node 18.16.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1425ms 14ms 56.6MB 1440ms 10ms node 18.16.1
wasm 3.rs 1520ms 4.5ms 18.5MB 1503ms 3ms wasmtime 10.0.1
wasm 3.rs 2028ms 2.8ms 28.4MB 2010ms 0ms wasmedgec 0.13.1
chapel 1-m.chpl 4044ms 31ms 83.4MB 7847ms 37ms chpl 1.31.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 105ms 0.2ms 16.9MB 90ms 0ms wasmtime 10.0.1
wasm 3.rs 143ms 1.5ms 29.9MB 130ms 0ms wasmedgec 0.13.1
wasm 3.rs 165ms 4.4ms 58.6MB 173ms 10ms node 18.16.1
chapel 1-m.chpl 286ms 15ms 54.0MB 510ms 7ms chpl 1.31.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.0ms 36.0MB 93ms 0ms chpl 1.31.0
wasm 1.rs 484ms 1.6ms 28.9MB 463ms 0ms wasmedgec 0.13.1
wasm 1.rs 589ms 0.5ms 17.5MB 570ms 0ms wasmtime 10.0.1
wasm 1.rs 659ms 0.8ms 58.1MB 690ms 7ms node 18.16.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.4ms 34.0MB 30ms 7ms chpl 1.31.0
wasm 1.rs 132ms 0.7ms 29.7MB 120ms 0ms wasmedgec 0.13.1
wasm 1.rs 157ms 0.3ms 16.7MB 147ms 0ms wasmtime 10.0.1
wasm 1.rs 233ms 3.6ms 57.6MB 260ms 13ms node 18.16.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 148ms 2.2ms 32.0MB 253ms 0ms chpl 1.31.0
wasm 1.rs 367ms 0.9ms 27.1MB 347ms 3ms wasmedgec 0.13.1
wasm 1.rs 427ms 1.5ms 16.1MB 413ms 0ms wasmtime 10.0.1
wasm 1.rs 470ms 0.8ms 49.4MB 453ms 7ms node 18.16.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 32ms 1.1ms 32.0MB 30ms 0ms chpl 1.31.0
wasm 1.rs 46ms 0.6ms 28.0MB 30ms 0ms wasmedgec 0.13.1
wasm 1.rs 51ms 1.4ms 16.1MB 37ms 0ms wasmtime 10.0.1
wasm 1.rs 92ms 2.7ms 49.5MB 77ms 7ms node 18.16.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 7.0ms 1.0ms 16.1MB 0ms 0ms wasmtime 10.0.1
wasm 1.rs 9.9ms 0.9ms 28.8MB 0ms 0ms wasmedgec 0.13.1
chapel 1.chpl 17ms 0.6ms 32.3MB 10ms 0ms chpl 1.31.0
wasm 1.rs 47ms 2.4ms 47.3MB 32ms 2ms node 18.16.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 933ms 1.9ms 85.0MB 1723ms 13ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 163ms 3.3ms 76.4MB 270ms 10ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 363ms 1.0ms 32.3MB 353ms 3ms chpl 1.31.0
wasm 1.rs 472ms 2.5ms 16.1MB 463ms 0ms wasmtime 10.0.1
wasm 1.rs 492ms 0.4ms 28.6MB 477ms 0ms wasmedgec 0.13.1
wasm 2.rs 655ms 4.7ms 27.8MB 633ms 7ms wasmedgec 0.13.1
wasm 2.rs 657ms 1.4ms 16.3MB 643ms 0ms wasmtime 10.0.1
wasm 1.rs 774ms 77ms 48.6MB 760ms 7ms node 18.16.1
wasm 2.rs 943ms 2.4ms 49.3MB 930ms 7ms node 18.16.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 55ms 1.7ms 16.1MB 43ms 0ms wasmtime 10.0.1
chapel 2.chpl 55ms 1.2ms 32.3MB 47ms 3ms chpl 1.31.0
wasm 1.rs 60ms 2.1ms 27.3MB 50ms 0ms wasmedgec 0.13.1
wasm 2.rs 75ms 1.6ms 16.0MB 63ms 0ms wasmtime 10.0.1
wasm 2.rs 77ms 1.6ms 28.6MB 63ms 3ms wasmedgec 0.13.1
wasm 1.rs 119ms 0.8ms 49.5MB 107ms 0ms node 18.16.1
wasm 2.rs 142ms 2.9ms 49.9MB 127ms 3ms node 18.16.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 596ms 3.6ms 34.1MB 577ms 3ms chpl 1.31.0
wasm 2.rs 2761ms 9.1ms 28.6MB 2740ms 3ms wasmedgec 0.13.1
wasm 2.rs 3088ms 0.8ms 17.2MB 3077ms 0ms wasmtime 10.0.1
wasm 2.rs 3251ms 2.8ms 53.8MB 3257ms 10ms node 18.16.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 156ms 3.1ms 34.1MB 147ms 0ms chpl 1.31.0
wasm 2.rs 652ms 3.8ms 28.8MB 637ms 0ms wasmedgec 0.13.1
wasm 2.rs 727ms 1.0ms 16.9MB 710ms 0ms wasmtime 10.0.1
wasm 2.rs 815ms 2.2ms 54.6MB 827ms 13ms node 18.16.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1933ms 23ms 221.8MB 1793ms 130ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 216ms 2.4ms 52.8MB 183ms 23ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1543ms 3.8ms 32.4MB 1533ms 0ms chpl 1.31.0
wasm 1.rs 4503ms 3.2ms 27.3MB 4487ms 0ms wasmedgec 0.13.1
wasm 1.rs 4739ms 11ms 66.6MB 4793ms 13ms node 18.16.1
wasm 1.rs timeout 0.0ms 16.1MB 4983ms 0ms wasmtime 10.0.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 404ms 1.8ms 32.4MB 383ms 7ms chpl 1.31.0
wasm 1.rs 1138ms 2.2ms 26.6MB 1120ms 0ms wasmedgec 0.13.1
wasm 1.rs 1262ms 8.5ms 66.9MB 1300ms 23ms node 18.16.1
wasm 1.rs 1316ms 16ms 16.3MB 1300ms 0ms wasmtime 10.0.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2241ms 4.7ms 32.2MB 4403ms 3ms chpl 1.31.0
wasm 2.rs 4128ms 1.6ms 32.1MB 4110ms 0ms wasmedgec 0.13.1
wasm 7.rs 4247ms 3.7ms 27.6MB 4233ms 0ms wasmedgec 0.13.1
wasm 2.rs 4317ms 4.1ms 49.0MB 4300ms 0ms node 18.16.1
chapel 1.chpl 4378ms 1.3ms 32.3MB 4367ms 3ms chpl 1.31.0
wasm 2.rs 4425ms 1.5ms 16.3MB 4413ms 0ms wasmtime 10.0.1
wasm 7.rs 4554ms 1.2ms 49.4MB 4540ms 7ms node 18.16.1
wasm 7.rs timeout 0.0ms 16.0MB 4987ms 0ms wasmtime 10.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 592ms 12ms 32.2MB 1117ms 0ms chpl 1.31.0
wasm 2.rs 1042ms 2.4ms 28.8MB 1023ms 0ms wasmedgec 0.13.1
wasm 7.rs 1072ms 1.6ms 29.5MB 1060ms 0ms wasmedgec 0.13.1
chapel 1.chpl 1114ms 1.0ms 32.3MB 1100ms 0ms chpl 1.31.0
wasm 2.rs 1116ms 0.6ms 16.1MB 1103ms 0ms wasmtime 10.0.1
wasm 2.rs 1117ms 3.3ms 48.3MB 1097ms 7ms node 18.16.1
wasm 7.rs 1177ms 0.5ms 48.4MB 1160ms 3ms node 18.16.1
wasm 7.rs 3261ms 2.9ms 16.3MB 3243ms 0ms wasmtime 10.0.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 165ms 1.0ms 32.2MB 287ms 3ms chpl 1.31.0
wasm 2.rs 271ms 0.6ms 28.7MB 250ms 0ms wasmedgec 0.13.1
wasm 7.rs 278ms 0.4ms 27.8MB 260ms 0ms wasmedgec 0.13.1
wasm 2.rs 289ms 5.6ms 16.0MB 270ms 0ms wasmtime 10.0.1
chapel 1.chpl 298ms 4.4ms 32.3MB 290ms 0ms chpl 1.31.0
wasm 2.rs 317ms 1.2ms 47.0MB 297ms 10ms node 18.16.1
wasm 7.rs 332ms 1.3ms 48.0MB 313ms 7ms node 18.16.1
wasm 7.rs 822ms 1.0ms 16.1MB 810ms 0ms wasmtime 10.0.1