Programming Language and compiler
Benchmarks

Chapel VS Rust benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1792ms 160ms 33.7MB 1770ms 7ms rustc 1.61.0
rust 3.rs 1864ms 18ms 49.8MB 1833ms 17ms rustc 1.61.0
rust 5.rs 2061ms 144ms 33.9MB 2040ms 3ms rustc 1.61.0
chapel 4.chpl 2346ms 6.5ms 64.0MB 2320ms 17ms chpl 1.26.0
chapel 3.chpl 2513ms 24ms 64.0MB 2487ms 17ms chpl 1.26.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 155ms 13ms 5.8MB 140ms 0ms rustc 1.61.0
rust 5.rs 171ms 15ms 5.9MB 157ms 0ms rustc 1.61.0
rust 3.rs 182ms 1.8ms 7.8MB 170ms 0ms rustc 1.61.0
chapel 4.chpl 226ms 2.7ms 34.1MB 207ms 3ms chpl 1.26.0
chapel 3.chpl 228ms 2.1ms 34.3MB 213ms 3ms chpl 1.26.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 926ms 44ms 6.2MB 1777ms 27ms rustc 1.61.0
rust 5-m.rs 1068ms 96ms 5.5MB 2043ms 30ms rustc 1.61.0
rust 3.rs 1836ms 5.8ms 6.5MB 1803ms 13ms rustc 1.61.0
rust 1-m.rs 2854ms 48ms 5.6MB 5457ms 143ms rustc 1.61.0
rust 4.rs 3338ms 1.9ms 4.7MB 3330ms 0ms rustc 1.61.0
chapel 1-m.chpl 4114ms 58ms 71.5MB 8013ms 37ms chpl 1.26.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 74ms 1.5ms 3.0MB 120ms 0ms rustc 1.61.0
rust 5-m.rs 94ms 26ms 3.2MB 153ms 3ms rustc 1.61.0
rust 3.rs 128ms 12ms 3.1MB 110ms 3ms rustc 1.61.0
rust 1-m.rs 203ms 7.2ms 2.8MB 353ms 20ms rustc 1.61.0
rust 4.rs 221ms 0.3ms 2.7MB 207ms 0ms rustc 1.61.0
chapel 1-m.chpl 281ms 1.3ms 44.2MB 503ms 10ms chpl 1.26.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.3ms 36.1MB 83ms 7ms chpl 1.26.0
rust 1.rs 147ms 0.3ms 3.7MB 140ms 0ms rustc 1.61.0
rust 2.rs 585ms 1.3ms 3.8MB 570ms 0ms rustc 1.61.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 41ms 0.9ms 3.0MB 30ms 0ms rustc 1.61.0
chapel 1.chpl 47ms 1.5ms 34.1MB 40ms 0ms chpl 1.26.0
rust 2.rs 110ms 1.6ms 3.3MB 100ms 0ms rustc 1.61.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 150ms 1.4ms 32.0MB 253ms 7ms chpl 1.26.0
rust 5c-m.rs 180ms 3.2ms 1.3MB 313ms 3ms rustc 1.63.0
rust 5-m.rs 206ms 1.1ms 1.3MB 370ms 0ms rustc 1.61.0
rust 1c.rs 234ms 0.2ms 0.7MB 227ms 0ms rustc 1.63.0
rust 1.rs 315ms 0.7ms 0.6MB 307ms 0ms rustc 1.61.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 28ms 2.3ms 0.7MB 20ms 0ms rustc 1.63.0
rust 5c-m.rs 29ms 2.8ms 1.3MB 33ms 0ms rustc 1.63.0
rust 5-m.rs 29ms 1.4ms 1.3MB 33ms 0ms rustc 1.61.0
chapel 5.chpl 33ms 0.6ms 32.0MB 30ms 3ms chpl 1.26.0
rust 1.rs 35ms 1.1ms 2.1MB 23ms 0ms rustc 1.61.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 2.1ms 1.0ms 0.6MB 0ms 0ms rustc 1.63.0
rust 1.rs 6.1ms 9.2ms 0.6MB 0ms 0ms rustc 1.61.0
chapel 1.chpl 18ms 0.9ms 32.4MB 8ms 3ms chpl 1.26.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 350ms 7.7ms 29.1MB 603ms 17ms rustc 1.61.0
rust 8.rs 615ms 8.3ms 23.2MB 593ms 10ms rustc 1.61.0
chapel 3-m.chpl 954ms 13ms 98.6MB 1727ms 27ms chpl 1.26.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 50ms 2.3ms 16.0MB 70ms 3ms rustc 1.61.0
rust 8.rs 76ms 0.9ms 11.6MB 57ms 3ms rustc 1.61.0
chapel 3-m.chpl 168ms 8.5ms 77.1MB 263ms 20ms chpl 1.26.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 253ms 0.8ms 0.6MB 240ms 0ms rustc 1.61.0
rust 7-i.rs 305ms 0.2ms 0.6MB 290ms 0ms rustc 1.61.0
rust 3.rs 319ms 0.2ms 0.6MB 310ms 0ms rustc 1.63.0
rust 2.rs 347ms 9.0ms 0.6MB 337ms 0ms rustc 1.61.0
chapel 2.chpl 363ms 1.3ms 32.4MB 350ms 0ms chpl 1.26.0
rust 1.rs 390ms 11ms 0.6MB 377ms 0ms rustc 1.61.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 29ms 1.4ms 0.6MB 20ms 0ms rustc 1.61.0
rust 7-i.rs 33ms 1.1ms 0.6MB 23ms 0ms rustc 1.61.0
rust 3.rs 35ms 1.8ms 0.6MB 30ms 0ms rustc 1.63.0
rust 1.rs 42ms 1.4ms 0.6MB 30ms 0ms rustc 1.61.0
rust 2.rs 50ms 12ms 0.6MB 40ms 0ms rustc 1.61.0
chapel 2.chpl 56ms 0.5ms 32.4MB 50ms 0ms chpl 1.26.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 598ms 3.9ms 34.1MB 580ms 7ms chpl 1.26.0
rust 2.rs 1829ms 0.8ms 2.8MB 1750ms 67ms rustc 1.61.0
rust 1.rs 1829ms 0.7ms 2.9MB 1670ms 143ms rustc 1.61.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 152ms 0.7ms 34.1MB 143ms 0ms chpl 1.26.0
rust 1.rs 390ms 0.6ms 2.6MB 373ms 0ms rustc 1.61.0
rust 2.rs 409ms 0.9ms 2.6MB 397ms 0ms rustc 1.61.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 564ms 4.9ms 77.1MB 713ms 20ms rustc 1.61.0
chapel 3.chpl 1944ms 8.6ms 251.1MB 1770ms 160ms chpl 1.26.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 66ms 3.2ms 11.9MB 73ms 0ms rustc 1.61.0
chapel 3.chpl 214ms 1.0ms 56.8MB 193ms 10ms chpl 1.26.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 146ms 0.7ms 0.6MB 140ms 0ms rustc 1.61.0
chapel 1.chpl 1551ms 1.4ms 32.3MB 1540ms 7ms chpl 1.26.0
rust 1.rs 1857ms 16ms 0.7MB 1843ms 0ms rustc 1.61.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 39ms 0.9ms 0.7MB 30ms 0ms rustc 1.61.0
chapel 1.chpl 404ms 1.2ms 32.3MB 393ms 7ms chpl 1.26.0
rust 1.rs 467ms 1.7ms 0.7MB 457ms 0ms rustc 1.61.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 1065ms 1.3ms 2.2MB 2063ms 0ms rustc 1.61.0
rust 8-m.rs 1067ms 3.9ms 2.3MB 2060ms 3ms rustc 1.63.0
rust 8.rs 2062ms 1.0ms 2.5MB 2050ms 0ms rustc 1.63.0
rust 7.rs 2063ms 0.4ms 2.1MB 2050ms 0ms rustc 1.61.0
rust 2-m.rs 2152ms 7.6ms 2.2MB 4170ms 3ms rustc 1.61.0
chapel 1-m.chpl 2311ms 70ms 32.5MB 4457ms 10ms chpl 1.26.0
chapel 1.chpl 4377ms 1.0ms 32.4MB 4360ms 7ms chpl 1.26.0
rust 2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.61.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7-m.rs 275ms 1.2ms 0.7MB 510ms 0ms rustc 1.61.0
rust 8-m.rs 275ms 1.1ms 2.2MB 507ms 0ms rustc 1.63.0
rust 8.rs 518ms 0.3ms 2.2MB 510ms 0ms rustc 1.63.0
rust 7.rs 518ms 0.9ms 0.6MB 510ms 0ms rustc 1.61.0
rust 2-m.rs 543ms 1.0ms 2.1MB 1033ms 0ms rustc 1.61.0
chapel 1-m.chpl 582ms 1.7ms 32.4MB 1110ms 3ms chpl 1.26.0
chapel 1.chpl 1110ms 0.6ms 32.4MB 1097ms 3ms chpl 1.26.0
rust 2.rs 1704ms 0.1ms 0.6MB 1690ms 0ms rustc 1.61.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 76ms 0.9ms 2.2MB 127ms 0ms rustc 1.63.0
rust 7-m.rs 76ms 1.2ms 0.7MB 127ms 0ms rustc 1.61.0
rust 8.rs 132ms 1.4ms 2.1MB 120ms 0ms rustc 1.63.0
rust 7.rs 133ms 1.1ms 0.6MB 120ms 0ms rustc 1.61.0
rust 2-m.rs 144ms 0.6ms 0.7MB 257ms 0ms rustc 1.61.0
chapel 1-m.chpl 165ms 0.5ms 32.4MB 283ms 3ms chpl 1.26.0
chapel 1.chpl 295ms 1.0ms 32.4MB 283ms 3ms chpl 1.26.0
rust 2.rs 429ms 1.3ms 0.6MB 417ms 0ms rustc 1.61.0