Programming Language and compiler
Benchmarks

Rust VS Codon benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.3ms 0.0ms 1.8MB 0ms 0ms rustc 1.83.0
rust 1.rs 1.3ms 0.0ms 1.8MB 0ms 0ms rustc 1.85.0-nightly
codon 1.py 4.2ms 0.5ms 6.9MB 0ms 0ms codon 0.17.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 253ms 8.3ms 4.8MB 240ms 0ms rustc 1.85.0-nightly
rust 8.rs 308ms 1.6ms 4.9MB 300ms 0ms rustc 1.83.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 13ms 0.2ms 2.0MB 0ms 0ms rustc 1.85.0-nightly
rust 8.rs 15ms 0.2ms 1.9MB 10ms 0ms rustc 1.83.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 165ms 3.7ms 1.9MB 153ms 0ms rustc 1.83.0
rust 7-i.rs 236ms 0.8ms 1.8MB 227ms 0ms rustc 1.83.0
rust 1.rs 238ms 0.5ms 1.8MB 230ms 0ms rustc 1.83.0
rust 2.rs 279ms 0.3ms 1.8MB 267ms 0ms rustc 1.83.0
rust 3.rs 280ms 0.4ms 1.9MB 270ms 0ms rustc 1.85.0-nightly
codon 1.py 1306ms 9.3ms 7.7MB 1293ms 0ms codon 0.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 19ms 0.4ms 1.8MB 10ms 0ms rustc 1.83.0
rust 1.rs 26ms 0.1ms 1.8MB 17ms 0ms rustc 1.83.0
rust 7-i.rs 26ms 0.2ms 1.8MB 13ms 0ms rustc 1.83.0
rust 2.rs 30ms 0.1ms 1.8MB 20ms 0ms rustc 1.83.0
rust 3.rs 30ms 0.2ms 1.9MB 20ms 0ms rustc 1.85.0-nightly
codon 1.py 136ms 1.5ms 7.7MB 120ms 0ms codon 0.17.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 498ms 0.9ms 6.5MB 1900ms 7ms rustc 1.85.0-nightly
rust 7-m.rs 498ms 1.8ms 4.2MB 1907ms 10ms rustc 1.83.0
rust 8.rs 1016ms 12ms 2.5MB 1003ms 0ms rustc 1.85.0-nightly
rust 2-m.rs 1952ms 2.2ms 6.2MB 7643ms 0ms rustc 1.83.0
rust 7.rs 2122ms 22ms 1.9MB 2117ms 0ms rustc 1.83.0
rust 2.rs 4203ms 9.7ms 2.0MB 4193ms 0ms rustc 1.83.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 128ms 0.4ms 6.2MB 470ms 3ms rustc 1.85.0-nightly
rust 7-m.rs 129ms 0.5ms 6.1MB 463ms 7ms rustc 1.83.0
rust 8.rs 255ms 1.5ms 2.3MB 243ms 0ms rustc 1.85.0-nightly
rust 2-m.rs 492ms 0.5ms 4.1MB 1890ms 0ms rustc 1.83.0
rust 7.rs 530ms 4.7ms 1.8MB 523ms 0ms rustc 1.83.0
rust 2.rs 1051ms 1.9ms 1.9MB 1040ms 0ms rustc 1.83.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 36ms 0.2ms 4.1MB 107ms 0ms rustc 1.83.0
rust 8-m.rs 36ms 0.5ms 4.1MB 117ms 0ms rustc 1.85.0-nightly
rust 8.rs 66ms 0.3ms 2.0MB 57ms 0ms rustc 1.85.0-nightly
rust 2-m.rs 127ms 0.6ms 4.1MB 457ms 7ms rustc 1.83.0
rust 7.rs 135ms 2.0ms 1.8MB 127ms 0ms rustc 1.83.0
rust 2.rs 266ms 1.0ms 1.9MB 253ms 0ms rustc 1.83.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1251ms 6.0ms 33.8MB 1233ms 7ms rustc 1.83.0
rust 5.rs 1378ms 31ms 33.8MB 1357ms 10ms rustc 1.83.0
rust 3.rs 1482ms 30ms 49.8MB 1443ms 23ms rustc 1.83.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5.rs 123ms 0.3ms 5.8MB 110ms 0ms rustc 1.83.0
rust 4.rs 129ms 19ms 5.8MB 120ms 0ms rustc 1.83.0
rust 3.rs 142ms 4.7ms 7.8MB 130ms 0ms rustc 1.83.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 551ms 82ms 11.1MB 2080ms 57ms rustc 1.83.0
rust 5-m.rs 656ms 59ms 7.5MB 2470ms 83ms rustc 1.83.0
rust 1-m.rs 1003ms 5.2ms 10.4MB 3537ms 357ms rustc 1.83.0
rust 3.rs 1139ms 24ms 9.3MB 1087ms 37ms rustc 1.83.0
rust 4.rs 1910ms 26ms 7.5MB 1897ms 0ms rustc 1.83.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 55ms 3.7ms 6.2MB 163ms 13ms rustc 1.83.0
rust 5-m.rs 57ms 9.9ms 7.2MB 147ms 17ms rustc 1.83.0
rust 3.rs 72ms 3.4ms 4.0MB 57ms 0ms rustc 1.83.0
rust 1-m.rs 84ms 2.4ms 5.8MB 257ms 40ms rustc 1.83.0
rust 4.rs 114ms 0.3ms 3.4MB 103ms 0ms rustc 1.83.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 115ms 0.3ms 3.6MB 100ms 0ms rustc 1.83.0
rust 2.rs 414ms 5.1ms 3.5MB 400ms 0ms rustc 1.83.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 33ms 0.7ms 2.9MB 20ms 0ms rustc 1.83.0
rust 2.rs 76ms 1.6ms 3.0MB 67ms 0ms rustc 1.83.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 413ms 6.2ms 4.0MB 1573ms 0ms rustc 1.83.0
rust 5-m.rs 567ms 6.5ms 4.0MB 2143ms 3ms rustc 1.83.0
rust 2-im.rs 629ms 1.2ms 6.0MB 2387ms 0ms rustc 1.83.0
rust 1-m.rs 997ms 11ms 6.0MB 3850ms 0ms rustc 1.83.0
rust 3-i.rs 1489ms 1.2ms 1.9MB 1480ms 0ms rustc 1.83.0
rust 2-i.rs 1754ms 1.4ms 1.8MB 1740ms 0ms rustc 1.83.0
rust 1.rs 2669ms 15ms 1.8MB 2657ms 0ms rustc 1.83.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 38ms 0.3ms 4.0MB 117ms 3ms rustc 1.83.0
rust 5-m.rs 56ms 0.8ms 6.0MB 170ms 0ms rustc 1.83.0
rust 2-im.rs 62ms 1.1ms 6.0MB 200ms 0ms rustc 1.83.0
rust 1-m.rs 88ms 1.9ms 6.0MB 307ms 0ms rustc 1.83.0
rust 3-i.rs 124ms 0.4ms 1.9MB 117ms 0ms rustc 1.83.0
rust 2-i.rs 149ms 0.8ms 1.8MB 140ms 0ms rustc 1.83.0
rust 1.rs 223ms 0.6ms 1.8MB 210ms 0ms rustc 1.83.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 91ms 2.5ms 4.8MB 240ms 7ms rustc 1.83.0
rust 5-m.rs 98ms 0.2ms 6.5MB 320ms 0ms rustc 1.83.0
rust 1c.rs 162ms 0.1ms 1.9MB 150ms 0ms rustc 1.83.0
rust 1.rs 193ms 1.6ms 1.9MB 180ms 0ms rustc 1.83.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 16ms 0.2ms 4.8MB 20ms 3ms rustc 1.83.0
rust 5-m.rs 17ms 0.2ms 4.8MB 30ms 0ms rustc 1.83.0
rust 1c.rs 19ms 0.2ms 1.9MB 10ms 0ms rustc 1.83.0
rust 1.rs 22ms 0.3ms 1.9MB 10ms 0ms rustc 1.83.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1-m.rs 289ms 71ms 44.1MB 103ms 333ms rustc 1.83.0
rust 2-http2.rs 382ms 68ms 77.9MB 630ms 457ms rustc 1.83.0
rust 1-http2.rs 461ms 79ms 78.1MB 593ms 710ms rustc 1.83.0
rust 2-m.rs 461ms 71ms 86.0MB 200ms 843ms rustc 1.83.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 83ms 4.0ms 17.5MB 30ms 67ms rustc 1.83.0
rust 2-m.rs 123ms 6.6ms 32.0MB 43ms 167ms rustc 1.83.0
rust 1-http2.rs 191ms 24ms 28.3MB 353ms 157ms rustc 1.83.0
rust 2-http2.rs 194ms 25ms 33.2MB 373ms 157ms rustc 1.83.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-i.rs 28ms 1.0ms 9.8MB 17ms 0ms rustc 1.83.0
rust 4-i.rs 31ms 0.8ms 7.9MB 13ms 3ms rustc 1.83.0
rust 3.rs 61ms 0.9ms 33.8MB 37ms 7ms rustc 1.83.0
rust 2.rs 63ms 1.2ms 35.5MB 40ms 7ms rustc 1.83.0
rust 1.rs 101ms 2.1ms 69.3MB 63ms 23ms rustc 1.83.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-i.rs 207ms 0.4ms 52.8MB 180ms 10ms rustc 1.83.0
rust 4-i.rs 265ms 7.0ms 54.4MB 203ms 47ms rustc 1.83.0
rust 3.rs 403ms 2.5ms 238.3MB 303ms 87ms rustc 1.83.0
rust 2.rs 412ms 4.8ms 237.8MB 310ms 83ms rustc 1.83.0
rust 1.rs 692ms 5.4ms 551.6MB 440ms 237ms rustc 1.83.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 226ms 10ms 30.0MB 647ms 17ms rustc 1.83.0
rust 8.rs 503ms 36ms 23.9MB 480ms 7ms rustc 1.83.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 34ms 1.4ms 15.7MB 63ms 3ms rustc 1.83.0
rust 8.rs 60ms 0.3ms 11.5MB 47ms 3ms rustc 1.83.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 42ms 1.1ms 1.9MB 30ms 0ms rustc 1.83.0
rust 1.rs 51ms 4.9ms 2.0MB 43ms 0ms rustc 1.83.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 156ms 1.9ms 1.9MB 150ms 0ms rustc 1.83.0
rust 1.rs 197ms 16ms 2.0MB 187ms 0ms rustc 1.83.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 26ms 0.5ms 1.9MB 20ms 0ms rustc 1.83.0
rust 1.rs 29ms 0.7ms 1.9MB 20ms 0ms rustc 1.83.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 697ms 5.9ms 33.8MB 670ms 13ms rustc 1.83.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 150ms 2.8ms 9.8MB 137ms 0ms rustc 1.83.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 308ms 10.0ms 40.9MB 293ms 0ms rustc 1.83.0
rust 2.rs 317ms 3.1ms 6.6MB 303ms 0ms rustc 1.83.0
codon 1.py 388ms 15ms 46.5MB 370ms 3ms codon 0.17.0
codon 2.py 904ms 9.6ms 99.9MB 880ms 20ms codon 0.17.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 63ms 4.7ms 11.6MB 50ms 0ms rustc 1.83.0
codon 1.py 74ms 3.4ms 17.3MB 63ms 0ms codon 0.17.0
rust 2.rs 82ms 0.9ms 2.9MB 70ms 0ms rustc 1.83.0
codon 2.py 199ms 0.4ms 25.7MB 190ms 0ms codon 0.17.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1519ms 2.0ms 2.8MB 1257ms 243ms rustc 1.83.0
rust 2.rs 1706ms 6.4ms 2.8MB 1613ms 73ms rustc 1.83.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 320ms 1.6ms 2.4MB 290ms 17ms rustc 1.83.0
rust 2.rs 379ms 3.1ms 2.5MB 360ms 3ms rustc 1.83.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 433ms 4.1ms 80.3MB 443ms 10ms rustc 1.83.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 51ms 1.4ms 13.3MB 40ms 3ms rustc 1.83.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 118ms 1.7ms 1.8MB 107ms 0ms rustc 1.83.0
rust 1.rs 1413ms 13ms 2.0MB 1397ms 0ms rustc 1.83.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 32ms 1.6ms 1.9MB 23ms 0ms rustc 1.83.0
rust 1.rs 355ms 3.7ms 1.9MB 343ms 0ms rustc 1.83.0