Rust VS Codon benchmarks

Current benchmark data was generated on Sun Jan 29 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 183ms 2.8ms 1.7MB 327ms 0ms rustc 1.69.0-nightly
rust 5-m.rs 195ms 1.0ms 1.7MB 350ms 0ms rustc 1.67.0
rust 1c.rs 230ms 0.3ms 1.1MB 217ms 0ms rustc 1.69.0-nightly
rust 1.rs 314ms 0.7ms 1.1MB 300ms 0ms rustc 1.67.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 25ms 1.1ms 1.7MB 30ms 0ms rustc 1.69.0-nightly
rust 1c.rs 26ms 0.6ms 1.1MB 13ms 0ms rustc 1.69.0-nightly
rust 5-m.rs 29ms 1.4ms 1.6MB 30ms 3ms rustc 1.67.0
rust 1.rs 34ms 0.8ms 1.0MB 20ms 0ms rustc 1.67.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.2ms 0.1ms 1.1MB 0ms 0ms rustc 1.69.0-nightly
rust 1.rs 1.5ms 0.4ms 1.9MB 0ms 0ms rustc 1.67.0
codon 1.py 4.1ms 0.8ms 5.3MB 0ms 0ms codon 0.15.4

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 414ms 0.7ms 4.6MB 400ms 0ms rustc 1.69.0-nightly
rust 8.rs 493ms 0.3ms 5.0MB 480ms 0ms rustc 1.67.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 20ms 1.1ms 1.0MB 10ms 0ms rustc 1.69.0-nightly
rust 8.rs 23ms 0.1ms 1.1MB 17ms 0ms rustc 1.67.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 260ms 6.4ms 1.1MB 253ms 0ms rustc 1.67.0
rust 7-i.rs 321ms 0.6ms 1.0MB 310ms 0ms rustc 1.67.0
rust 3.rs 338ms 0.4ms 1.0MB 330ms 0ms rustc 1.69.0-nightly
rust 2.rs 346ms 4.5ms 1.0MB 337ms 0ms rustc 1.67.0
rust 1.rs 390ms 6.7ms 1.1MB 380ms 0ms rustc 1.67.0
codon 1.py 1947ms 23ms 5.3MB 1933ms 0ms codon 0.15.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 28ms 0.7ms 1.9MB 20ms 0ms rustc 1.67.0
rust 7-i.rs 34ms 0.1ms 1.0MB 23ms 0ms rustc 1.67.0
rust 2.rs 37ms 0.4ms 1.0MB 27ms 0ms rustc 1.67.0
rust 3.rs 37ms 0.6ms 1.1MB 23ms 0ms rustc 1.69.0-nightly
rust 1.rs 41ms 0.0ms 1.0MB 30ms 0ms rustc 1.67.0
codon 1.py 197ms 0.8ms 5.3MB 187ms 0ms codon 0.15.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 1062ms 9.9ms 2.6MB 2050ms 0ms rustc 1.69.0-nightly
rust 7-m.rs 1066ms 14ms 2.3MB 2050ms 0ms rustc 1.67.0
rust 8.rs 2060ms 0.7ms 2.3MB 2050ms 0ms rustc 1.69.0-nightly
rust 7.rs 2061ms 0.6ms 2.2MB 2050ms 0ms rustc 1.67.0
rust 2-m.rs 2154ms 3.3ms 2.3MB 4197ms 0ms rustc 1.67.0
rust 2.rs timeout 0.0ms 2.2MB 4990ms 0ms rustc 1.67.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 274ms 1.6ms 2.2MB 507ms 0ms rustc 1.69.0-nightly
rust 7-m.rs 274ms 1.2ms 1.1MB 510ms 0ms rustc 1.67.0
rust 8.rs 517ms 0.3ms 2.1MB 510ms 0ms rustc 1.69.0-nightly
rust 7.rs 517ms 0.5ms 1.0MB 510ms 0ms rustc 1.67.0
rust 2-m.rs 555ms 0.7ms 2.2MB 1053ms 3ms rustc 1.67.0
rust 2.rs 1729ms 1.3ms 1.0MB 1720ms 0ms rustc 1.67.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 74ms 0.9ms 1.0MB 127ms 0ms rustc 1.69.0-nightly
rust 7-m.rs 74ms 1.0ms 1.0MB 120ms 0ms rustc 1.67.0
rust 7.rs 131ms 0.7ms 1.0MB 120ms 0ms rustc 1.67.0
rust 8.rs 132ms 0.6ms 1.1MB 120ms 0ms rustc 1.69.0-nightly
rust 2-m.rs 144ms 1.3ms 1.0MB 257ms 0ms rustc 1.67.0
rust 2.rs 435ms 0.7ms 1.0MB 423ms 0ms rustc 1.67.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1635ms 10ms 33.8MB 1610ms 10ms rustc 1.67.0
rust 5.rs 1718ms 6.1ms 33.8MB 1703ms 3ms rustc 1.67.0
rust 3.rs 1920ms 24ms 49.8MB 1890ms 10ms rustc 1.67.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 150ms 1.2ms 5.9MB 140ms 0ms rustc 1.67.0
rust 5.rs 155ms 1.0ms 5.7MB 143ms 0ms rustc 1.67.0
rust 3.rs 174ms 2.4ms 7.8MB 160ms 0ms rustc 1.67.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-m.rs 861ms 84ms 4.9MB 1647ms 23ms rustc 1.67.0
rust 3-m.rs 941ms 43ms 6.2MB 1803ms 27ms rustc 1.67.0
rust 3.rs 1837ms 9.0ms 6.2MB 1787ms 37ms rustc 1.67.0
rust 1-m.rs 2866ms 68ms 4.9MB 5527ms 110ms rustc 1.67.0
rust 4.rs 3200ms 7.8ms 4.3MB 3183ms 0ms rustc 1.67.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 73ms 2.7ms 2.8MB 120ms 3ms rustc 1.67.0
rust 5-m.rs 106ms 4.2ms 2.7MB 183ms 0ms rustc 1.67.0
rust 3.rs 119ms 0.8ms 3.1MB 110ms 0ms rustc 1.67.0
rust 1-m.rs 201ms 4.7ms 2.9MB 357ms 13ms rustc 1.67.0
rust 4.rs 209ms 0.5ms 2.4MB 197ms 0ms rustc 1.67.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 145ms 0.3ms 3.6MB 137ms 0ms rustc 1.67.0
rust 2.rs 601ms 3.4ms 3.8MB 590ms 0ms rustc 1.67.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 42ms 2.6ms 2.8MB 30ms 0ms rustc 1.67.0
rust 2.rs 112ms 0.2ms 3.2MB 97ms 0ms rustc 1.67.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 711ms 12ms 2.0MB 1380ms 0ms rustc 1.67.0
rust 2-im.rs 1052ms 9.6ms 1.0MB 2023ms 0ms rustc 1.67.0
rust 3-i.rs 1427ms 5.3ms 1.1MB 1413ms 0ms rustc 1.67.0
rust 5-m.rs 1519ms 321ms 1.0MB 2770ms 0ms rustc 1.67.0
rust 1-m.rs 1985ms 22ms 1.0MB 3853ms 0ms rustc 1.67.0
rust 2-i.rs 2046ms 0.5ms 1.0MB 2037ms 0ms rustc 1.67.0
rust 1.rs 3700ms 6.2ms 1.1MB 3687ms 0ms rustc 1.67.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 64ms 0.1ms 1.0MB 110ms 0ms rustc 1.67.0
rust 2-im.rs 94ms 2.6ms 1.0MB 160ms 0ms rustc 1.67.0
rust 3-i.rs 118ms 0.1ms 1.0MB 110ms 0ms rustc 1.67.0
rust 5-m.rs 150ms 10.0ms 1.0MB 267ms 0ms rustc 1.67.0
rust 2-i.rs 171ms 0.4ms 1.0MB 160ms 0ms rustc 1.67.0
rust 1-m.rs 179ms 8.7ms 1.1MB 327ms 0ms rustc 1.67.0
rust 1.rs 312ms 4.8ms 1.1MB 303ms 0ms rustc 1.67.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 127ms 30ms 23.5MB 67ms 73ms rustc 1.67.0
rust 2-http2.rs 325ms 78ms 37.6MB 437ms 113ms rustc 1.67.0
rust 2.rs 485ms 8.3ms 103.8MB 247ms 470ms rustc 1.67.0
rust 1-http2.rs 776ms 67ms 70.4MB 923ms 380ms rustc 1.67.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 62ms 14ms 13.0MB 17ms 13ms rustc 1.67.0
rust 2.rs 132ms 6.6ms 24.7MB 37ms 80ms rustc 1.67.0
rust 2-http2.rs 311ms 49ms 25.0MB 450ms 83ms rustc 1.67.0
rust 1-http2.rs 411ms 7.0ms 26.7MB 640ms 100ms rustc 1.67.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 75ms 0.2ms 38.1MB 53ms 7ms rustc 1.67.0
rust 3.rs 76ms 2.1ms 36.3MB 57ms 3ms rustc 1.67.0
rust 1.rs 120ms 0.3ms 75.4MB 73ms 30ms rustc 1.67.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 499ms 1.2ms 257.2MB 403ms 83ms rustc 1.67.0
rust 3.rs 505ms 3.3ms 258.2MB 390ms 100ms rustc 1.67.0
rust 1.rs 861ms 1.4ms 605.2MB 600ms 243ms rustc 1.67.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 320ms 3.2ms 29.2MB 560ms 3ms rustc 1.67.0
rust 8.rs 595ms 3.2ms 24.0MB 577ms 0ms rustc 1.67.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 47ms 3.1ms 16.4MB 57ms 3ms rustc 1.67.0
rust 8.rs 76ms 3.3ms 11.5MB 60ms 3ms rustc 1.67.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 63ms 4.6ms 2.1MB 53ms 0ms rustc 1.67.0
rust 1.rs 71ms 0.5ms 1.0MB 60ms 0ms rustc 1.67.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 207ms 8.4ms 1.1MB 193ms 0ms rustc 1.67.0
rust 1.rs 297ms 1.9ms 1.1MB 287ms 0ms rustc 1.67.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 37ms 3.5ms 1.0MB 27ms 0ms rustc 1.67.0
rust 1.rs 48ms 0.7ms 1.0MB 40ms 0ms rustc 1.67.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 941ms 3.4ms 33.8MB 923ms 3ms rustc 1.67.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 195ms 1.2ms 9.9MB 183ms 0ms rustc 1.67.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 472ms 0.3ms 6.6MB 457ms 0ms rustc 1.67.0
codon 1.py 873ms 79ms 48.3MB 850ms 3ms codon 0.15.4
codon 2.py 1003ms 24ms 106.7MB 977ms 13ms codon 0.15.4
rust 1.rs 1083ms 41ms 40.8MB 1057ms 10ms rustc 1.67.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 109ms 0.7ms 3.1MB 100ms 0ms rustc 1.67.0
rust 1.rs 129ms 1.1ms 11.6MB 120ms 0ms rustc 1.67.0
codon 1.py 150ms 0.2ms 15.1MB 133ms 3ms codon 0.15.4
codon 2.py 185ms 3.8ms 23.9MB 173ms 3ms codon 0.15.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 1746ms 0.9ms 2.9MB 1683ms 47ms rustc 1.67.0
rust 1.rs 1809ms 1.4ms 2.8MB 1637ms 157ms rustc 1.67.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 382ms 0.1ms 2.5MB 360ms 10ms rustc 1.67.0
rust 2.rs 390ms 0.5ms 2.5MB 377ms 0ms rustc 1.67.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 560ms 10ms 76.9MB 710ms 13ms rustc 1.67.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 64ms 3.0ms 11.8MB 70ms 0ms rustc 1.67.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 149ms 0.5ms 1.0MB 140ms 0ms rustc 1.67.0
rust 1.rs 1866ms 11ms 1.1MB 1853ms 0ms rustc 1.67.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 39ms 0.4ms 1.1MB 30ms 0ms rustc 1.67.0
rust 1.rs 470ms 9.3ms 1.1MB 460ms 0ms rustc 1.67.0