Wasm VS Codon benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1735ms 38ms 51.3MB 1700ms 17ms wasmtime 29.0.1
wasm 4.rs 1755ms 3.5ms 35.3MB 1730ms 13ms wasmtime 29.0.1
wasm 5.rs 1769ms 18ms 37.2MB 1753ms 3ms wasmtime 29.0.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 5.rs 170ms 0.9ms 21.3MB 160ms 0ms wasmtime 29.0.1
wasm 4.rs 171ms 2.2ms 23.3MB 160ms 0ms wasmtime 29.0.1
wasm 3.rs 172ms 6.1ms 23.3MB 160ms 3ms wasmtime 29.0.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 1128ms 15ms 21.5MB 1110ms 0ms wasmtime 29.0.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 3.rs 83ms 2.3ms 20.0MB 70ms 0ms wasmtime 29.0.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 416ms 1.5ms 20.8MB 403ms 3ms wasmtime 29.0.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 113ms 1.5ms 20.1MB 100ms 0ms wasmtime 29.0.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 4263ms 18ms 20.8MB 4253ms 0ms wasmtime 29.0.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 357ms 5.3ms 19.4MB 347ms 0ms wasmtime 29.0.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 233ms 1.1ms 19.7MB 220ms 0ms wasmtime 29.0.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 31ms 1.1ms 19.5MB 17ms 3ms wasmtime 29.0.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.1ms 0.5ms 5.5MB 0ms 0ms codon 0.17.0
wasm 1.rs 7.3ms 0.2ms 20.6MB 0ms 0ms wasmtime 29.0.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 84ms 1.3ms 19.7MB 70ms 0ms wasmtime 29.0.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 233ms 2.5ms 19.6MB 223ms 0ms wasmtime 29.0.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 45ms 1.3ms 20.9MB 33ms 0ms wasmtime 29.0.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 816ms 2.6ms 22.5MB 800ms 0ms wasmtime 29.0.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 8.rs 42ms 0.3ms 19.5MB 30ms 0ms wasmtime 29.0.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 886ms 9.9ms 45.3MB 853ms 17ms wasmtime 29.0.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 192ms 0.4ms 25.3MB 177ms 3ms wasmtime 29.0.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 407ms 1.8ms 19.2MB 390ms 0ms wasmtime 29.0.1
wasm 2.rs 579ms 1.4ms 19.2MB 563ms 0ms wasmtime 29.0.1
codon 1.py 1371ms 99ms 7.9MB 1357ms 0ms codon 0.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 49ms 0.4ms 21.2MB 37ms 0ms wasmtime 29.0.1
wasm 2.rs 66ms 1.1ms 19.2MB 57ms 0ms wasmtime 29.0.1
codon 1.py 135ms 1.9ms 7.9MB 123ms 0ms codon 0.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 368ms 5.0ms 46.5MB 357ms 0ms codon 0.17.0
wasm 2.rs 370ms 9.0ms 24.2MB 357ms 0ms wasmtime 29.0.1
wasm 1.rs 471ms 3.2ms 58.5MB 453ms 3ms wasmtime 29.0.1
codon 2.py 848ms 3.7ms 100.0MB 830ms 13ms codon 0.17.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 71ms 1.3ms 15.3MB 60ms 0ms codon 0.17.0
wasm 2.rs 93ms 1.0ms 22.5MB 80ms 3ms wasmtime 29.0.1
wasm 1.rs 97ms 3.2ms 29.2MB 87ms 0ms wasmtime 29.0.1
codon 2.py 198ms 1.5ms 25.9MB 187ms 3ms codon 0.17.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 2195ms 7.4ms 20.2MB 2177ms 7ms wasmtime 29.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 520ms 2.1ms 21.4MB 503ms 0ms wasmtime 29.0.1

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 3552ms 38ms 18.9MB 3533ms 3ms wasmtime 29.0.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 892ms 4.5ms 19.6MB 873ms 3ms wasmtime 29.0.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 3585ms 7.0ms 19.0MB 3567ms 0ms wasmtime 29.0.1
wasm 7.rs 4890ms 13ms 21.0MB 4873ms 0ms wasmtime 29.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 905ms 2.5ms 20.9MB 890ms 3ms wasmtime 29.0.1
wasm 7.rs 1227ms 3.4ms 20.7MB 1210ms 0ms wasmtime 29.0.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 243ms 13ms 18.8MB 230ms 0ms wasmtime 29.0.1
wasm 7.rs 315ms 2.2ms 20.7MB 300ms 0ms wasmtime 29.0.1