Codon VS Wasm benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 4.5ms 0.8ms 7.2MB 0ms 0ms codon 0.16.3
wasm 1.rs 6.8ms 0.2ms 19.0MB 0ms 0ms wasmtime 17.0.0
wasm 1.rs 37ms 0.7ms 48.6MB 24ms 4ms node 18.19.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 448ms 1.3ms 18.8MB 430ms 0ms wasmtime 17.0.0
wasm 2.rs 569ms 0.7ms 18.8MB 557ms 0ms wasmtime 17.0.0
wasm 1.rs 787ms 145ms 50.0MB 773ms 7ms node 18.19.0
wasm 2.rs 871ms 3.1ms 51.1MB 860ms 7ms node 18.19.0
codon 1.py 1295ms 1.9ms 7.7MB 1287ms 0ms codon 0.16.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 1.rs 54ms 1.0ms 18.8MB 40ms 3ms wasmtime 17.0.0
wasm 2.rs 66ms 0.7ms 18.8MB 53ms 0ms wasmtime 17.0.0
wasm 1.rs 104ms 2.6ms 50.1MB 93ms 10ms node 18.19.0
wasm 2.rs 122ms 0.7ms 50.8MB 110ms 7ms node 18.19.0
codon 1.py 140ms 2.4ms 5.8MB 127ms 0ms codon 0.16.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
wasm 2.rs 346ms 3.4ms 23.8MB 337ms 0ms wasmtime 17.0.0
codon 1.py 406ms 0.9ms 46.5MB 390ms 0ms codon 0.16.3
codon 2.py 482ms 8.3ms 107.0MB 463ms 13ms codon 0.16.3
wasm 1.rs 515ms 31ms 57.9MB 500ms 3ms wasmtime 17.0.0
wasm 2.rs 589ms 5.8ms 54.8MB 580ms 3ms node 18.19.0
wasm 1.rs 812ms 6.1ms 89.4MB 797ms 17ms node 18.19.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 81ms 2.0ms 17.2MB 70ms 0ms codon 0.16.3
wasm 2.rs 90ms 1.5ms 20.0MB 70ms 0ms wasmtime 17.0.0
wasm 1.rs 107ms 11ms 28.7MB 90ms 3ms wasmtime 17.0.0
codon 2.py 110ms 3.4ms 26.0MB 97ms 3ms codon 0.16.3
wasm 2.rs 173ms 1.8ms 51.1MB 167ms 0ms node 18.19.0
wasm 1.rs 184ms 0.9ms 59.9MB 160ms 17ms node 18.19.0