Codon VS Rust benchmarks

Current benchmark data was generated on Sun Jan 29 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.2ms 0.1ms 1.1MB 0ms 0ms rustc 1.69.0-nightly
rust 1.rs 1.5ms 0.4ms 1.9MB 0ms 0ms rustc 1.67.0
codon 1.py 4.1ms 0.8ms 5.3MB 0ms 0ms codon 0.15.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 260ms 6.4ms 1.1MB 253ms 0ms rustc 1.67.0
rust 7-i.rs 321ms 0.6ms 1.0MB 310ms 0ms rustc 1.67.0
rust 3.rs 338ms 0.4ms 1.0MB 330ms 0ms rustc 1.69.0-nightly
rust 2.rs 346ms 4.5ms 1.0MB 337ms 0ms rustc 1.67.0
rust 1.rs 390ms 6.7ms 1.1MB 380ms 0ms rustc 1.67.0
codon 1.py 1947ms 23ms 5.3MB 1933ms 0ms codon 0.15.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 28ms 0.7ms 1.9MB 20ms 0ms rustc 1.67.0
rust 7-i.rs 34ms 0.1ms 1.0MB 23ms 0ms rustc 1.67.0
rust 2.rs 37ms 0.4ms 1.0MB 27ms 0ms rustc 1.67.0
rust 3.rs 37ms 0.6ms 1.1MB 23ms 0ms rustc 1.69.0-nightly
rust 1.rs 41ms 0.0ms 1.0MB 30ms 0ms rustc 1.67.0
codon 1.py 197ms 0.8ms 5.3MB 187ms 0ms codon 0.15.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 472ms 0.3ms 6.6MB 457ms 0ms rustc 1.67.0
codon 1.py 873ms 79ms 48.3MB 850ms 3ms codon 0.15.4
codon 2.py 1003ms 24ms 106.7MB 977ms 13ms codon 0.15.4
rust 1.rs 1083ms 41ms 40.8MB 1057ms 10ms rustc 1.67.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 109ms 0.7ms 3.1MB 100ms 0ms rustc 1.67.0
rust 1.rs 129ms 1.1ms 11.6MB 120ms 0ms rustc 1.67.0
codon 1.py 150ms 0.2ms 15.1MB 133ms 3ms codon 0.15.4
codon 2.py 185ms 3.8ms 23.9MB 173ms 3ms codon 0.15.4