Chapel VS Rust benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1350ms 24ms 33.8MB 1323ms 13ms rustc 1.75.0
rust 5.rs 1432ms 16ms 33.8MB 1407ms 7ms rustc 1.75.0
rust 3.rs 1491ms 51ms 49.9MB 1463ms 13ms rustc 1.75.0
chapel 4.chpl 1944ms 12ms 66.2MB 1933ms 7ms chpl 1.31.0
chapel 3.chpl 2115ms 17ms 66.3MB 2100ms 0ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5.rs 126ms 1.5ms 5.8MB 117ms 0ms rustc 1.75.0
rust 4.rs 129ms 0.4ms 5.8MB 117ms 0ms rustc 1.75.0
rust 3.rs 134ms 3.3ms 7.8MB 123ms 0ms rustc 1.75.0
chapel 4.chpl 191ms 2.3ms 36.3MB 180ms 7ms chpl 1.31.0
chapel 3.chpl 198ms 1.7ms 34.3MB 183ms 7ms chpl 1.31.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 535ms 34ms 11.1MB 1983ms 70ms rustc 1.75.0
rust 5-m.rs 590ms 45ms 7.9MB 2197ms 70ms rustc 1.75.0
rust 1-m.rs 1011ms 8.9ms 12.4MB 3597ms 360ms rustc 1.75.0
rust 3.rs 1111ms 11ms 9.3MB 1060ms 33ms rustc 1.75.0
rust 4.rs 1363ms 6.2ms 7.6MB 1343ms 3ms rustc 1.75.0
chapel 1-m.chpl 2296ms 27ms 506.1MB 4477ms 70ms chpl 1.31.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 48ms 3.9ms 8.1MB 147ms 7ms rustc 1.75.0
rust 5-m.rs 51ms 0.9ms 5.4MB 137ms 23ms rustc 1.75.0
rust 3.rs 70ms 3.0ms 4.1MB 60ms 3ms rustc 1.75.0
rust 1-m.rs 82ms 7.0ms 7.7MB 237ms 40ms rustc 1.75.0
rust 4.rs 82ms 1.0ms 3.3MB 70ms 0ms rustc 1.75.0
chapel 1-m.chpl 203ms 23ms 450.8MB 333ms 33ms chpl 1.31.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 79ms 0.6ms 36.5MB 70ms 0ms chpl 1.31.0
rust 1.rs 123ms 2.1ms 3.6MB 113ms 0ms rustc 1.75.0
rust 2.rs 438ms 3.0ms 3.6MB 427ms 0ms rustc 1.75.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 33ms 0.2ms 2.9MB 23ms 0ms rustc 1.75.0
chapel 1.chpl 40ms 0.2ms 34.5MB 30ms 0ms chpl 1.31.0
rust 2.rs 82ms 1.0ms 3.1MB 70ms 0ms rustc 1.75.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 90ms 0.4ms 4.8MB 237ms 0ms rustc 1.77.0-nightly
rust 5-m.rs 99ms 1.2ms 6.5MB 323ms 3ms rustc 1.75.0
chapel 5-m.chpl 111ms 1.0ms 32.4MB 193ms 0ms chpl 1.31.0
rust 1c.rs 164ms 0.5ms 1.9MB 150ms 0ms rustc 1.77.0-nightly
rust 1.rs 223ms 0.3ms 1.9MB 210ms 0ms rustc 1.75.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5c-m.rs 16ms 0.3ms 6.5MB 20ms 0ms rustc 1.77.0-nightly
rust 5-m.rs 17ms 0.2ms 6.4MB 30ms 0ms rustc 1.75.0
rust 1c.rs 19ms 0.5ms 1.9MB 10ms 0ms rustc 1.77.0-nightly
rust 1.rs 25ms 0.7ms 1.9MB 17ms 0ms rustc 1.75.0
chapel 5.chpl 29ms 0.6ms 32.4MB 23ms 3ms chpl 1.31.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.2ms 0.1ms 1.9MB 0ms 0ms rustc 1.75.0
rust 1.rs 1.3ms 0.1ms 1.9MB 0ms 0ms rustc 1.77.0-nightly
chapel 1.chpl 16ms 0.2ms 32.8MB 10ms 0ms chpl 1.31.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 275ms 21ms 30.3MB 817ms 7ms rustc 1.75.0
rust 8.rs 508ms 3.8ms 23.8MB 483ms 10ms rustc 1.75.0
chapel 3-m.chpl 766ms 18ms 101.0MB 1443ms 7ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 36ms 1.1ms 17.8MB 73ms 7ms rustc 1.75.0
rust 8.rs 66ms 2.6ms 11.4MB 50ms 0ms rustc 1.75.0
chapel 3-m.chpl 120ms 0.8ms 90.9MB 207ms 3ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 168ms 9.4ms 1.9MB 157ms 0ms rustc 1.75.0
rust 7-i.rs 222ms 0.8ms 1.9MB 210ms 0ms rustc 1.75.0
rust 3.rs 285ms 0.7ms 1.9MB 277ms 0ms rustc 1.77.0-nightly
rust 2.rs 288ms 0.4ms 1.8MB 273ms 0ms rustc 1.75.0
chapel 2.chpl 329ms 2.0ms 32.8MB 313ms 7ms chpl 1.31.0
rust 1.rs 338ms 1.1ms 1.9MB 330ms 0ms rustc 1.75.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 19ms 1.1ms 1.9MB 10ms 0ms rustc 1.75.0
rust 7-i.rs 25ms 0.5ms 1.9MB 13ms 0ms rustc 1.75.0
rust 3.rs 31ms 0.2ms 1.8MB 20ms 0ms rustc 1.77.0-nightly
rust 2.rs 31ms 0.1ms 1.8MB 20ms 0ms rustc 1.75.0
rust 1.rs 37ms 1.1ms 1.8MB 30ms 0ms rustc 1.75.0
chapel 2.chpl 51ms 1.6ms 32.9MB 47ms 0ms chpl 1.31.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.3ms 34.4MB 443ms 0ms chpl 1.31.0
rust 1.rs 1528ms 4.6ms 2.8MB 1280ms 230ms rustc 1.75.0
rust 2.rs 1712ms 3.5ms 2.7MB 1630ms 63ms rustc 1.75.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 122ms 1.3ms 34.2MB 113ms 0ms chpl 1.31.0
rust 1.rs 319ms 1.2ms 2.4MB 300ms 7ms rustc 1.75.0
rust 2.rs 380ms 3.1ms 2.4MB 367ms 0ms rustc 1.75.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 437ms 7.7ms 78.6MB 453ms 17ms rustc 1.75.0
chapel 3.chpl 1388ms 3.3ms 224.1MB 1340ms 40ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 51ms 1.6ms 11.6MB 43ms 7ms rustc 1.75.0
chapel 3.chpl 169ms 0.9ms 52.9MB 150ms 10ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 120ms 1.3ms 1.9MB 110ms 0ms rustc 1.75.0
chapel 1.chpl 1183ms 3.7ms 33.0MB 1170ms 3ms chpl 1.31.0
rust 1.rs 1422ms 3.5ms 1.9MB 1410ms 0ms rustc 1.75.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 32ms 0.4ms 1.8MB 20ms 0ms rustc 1.75.0
chapel 1.chpl 311ms 1.6ms 33.1MB 307ms 0ms chpl 1.31.0
rust 1.rs 376ms 25ms 1.8MB 360ms 0ms rustc 1.75.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 525ms 0.4ms 6.3MB 2023ms 3ms rustc 1.77.0-nightly
rust 7-m.rs 997ms 0.9ms 6.2MB 3887ms 3ms rustc 1.75.0
rust 8.rs 1075ms 1.1ms 2.3MB 1063ms 0ms rustc 1.77.0-nightly
chapel 1-m.chpl 1911ms 0.6ms 32.9MB 3783ms 0ms chpl 1.31.0
rust 2-m.rs 1935ms 1.0ms 6.2MB 7583ms 13ms rustc 1.75.0
rust 7.rs 2068ms 5.9ms 2.0MB 2063ms 0ms rustc 1.75.0
chapel 1.chpl 3712ms 4.9ms 32.8MB 3703ms 0ms chpl 1.31.0
rust 2.rs 4161ms 0.9ms 2.0MB 4150ms 0ms rustc 1.75.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 135ms 0.6ms 6.2MB 497ms 0ms rustc 1.77.0-nightly
rust 7-m.rs 255ms 0.2ms 6.1MB 947ms 7ms rustc 1.75.0
rust 8.rs 272ms 1.1ms 2.0MB 260ms 0ms rustc 1.77.0-nightly
rust 2-m.rs 488ms 0.9ms 8.1MB 1880ms 3ms rustc 1.75.0
chapel 1-m.chpl 496ms 1.2ms 32.9MB 953ms 0ms chpl 1.31.0
rust 7.rs 517ms 1.8ms 1.9MB 507ms 0ms rustc 1.75.0
chapel 1.chpl 944ms 2.4ms 32.8MB 933ms 0ms chpl 1.31.0
rust 2.rs 1043ms 0.9ms 2.0MB 1030ms 0ms rustc 1.75.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 38ms 0.4ms 6.1MB 113ms 0ms rustc 1.77.0-nightly
rust 7-m.rs 69ms 0.5ms 6.1MB 227ms 10ms rustc 1.75.0
rust 8.rs 71ms 0.4ms 1.9MB 60ms 0ms rustc 1.77.0-nightly
rust 2-m.rs 127ms 1.1ms 6.1MB 457ms 3ms rustc 1.75.0
rust 7.rs 131ms 0.2ms 1.9MB 120ms 0ms rustc 1.75.0
chapel 1-m.chpl 140ms 0.8ms 33.0MB 240ms 7ms chpl 1.31.0
chapel 1.chpl 252ms 1.7ms 32.8MB 247ms 0ms chpl 1.31.0
rust 2.rs 262ms 0.2ms 2.0MB 250ms 0ms rustc 1.75.0