Programming Language and compiler
Benchmarks

Rust VS Chapel benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 145ms 1.2ms 9.5MB 250ms 3ms chpl 1.29.0
rust 5c-m.rs 186ms 2.9ms 1.7MB 330ms 0ms rustc 1.69.0-nightly
rust 5-m.rs 198ms 1.5ms 1.7MB 350ms 0ms rustc 1.67.0
rust 1c.rs 232ms 2.5ms 1.7MB 217ms 0ms rustc 1.69.0-nightly
rust 1.rs 314ms 0.5ms 1.0MB 300ms 0ms rustc 1.67.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 26ms 0.4ms 1.0MB 17ms 0ms rustc 1.69.0-nightly
rust 5c-m.rs 27ms 0.9ms 1.7MB 30ms 0ms rustc 1.69.0-nightly
chapel 5.chpl 28ms 0.9ms 10.6MB 23ms 0ms chpl 1.29.0
rust 5-m.rs 31ms 1.5ms 1.7MB 40ms 0ms rustc 1.67.0
rust 1.rs 35ms 0.4ms 1.1MB 27ms 0ms rustc 1.67.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 2.3ms 0.7ms 1.1MB 0ms 0ms rustc 1.69.0-nightly
rust 1.rs 2.3ms 0.7ms 1.0MB 0ms 0ms rustc 1.67.0
chapel 1.chpl 15ms 2.8ms 10.2MB 13ms 0ms chpl 1.29.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 415ms 0.7ms 4.9MB 407ms 0ms rustc 1.69.0-nightly
rust 8.rs 493ms 0.4ms 4.7MB 477ms 0ms rustc 1.67.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 21ms 0.5ms 1.0MB 10ms 0ms rustc 1.69.0-nightly
rust 8.rs 23ms 0.1ms 1.0MB 13ms 0ms rustc 1.67.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 257ms 0.3ms 1.1MB 240ms 0ms rustc 1.67.0
rust 7-i.rs 332ms 1.5ms 1.0MB 320ms 0ms rustc 1.67.0
rust 3.rs 340ms 1.3ms 1.1MB 327ms 0ms rustc 1.69.0-nightly
rust 2.rs 340ms 2.9ms 1.0MB 327ms 0ms rustc 1.67.0
chapel 2.chpl 374ms 1.0ms 2.6MB 363ms 0ms chpl 1.29.0
rust 1.rs 393ms 3.7ms 1.1MB 383ms 0ms rustc 1.67.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 32ms 6.3ms 1.0MB 23ms 0ms rustc 1.67.0
rust 7-i.rs 35ms 0.6ms 1.0MB 23ms 0ms rustc 1.67.0
rust 3.rs 37ms 0.1ms 1.0MB 30ms 0ms rustc 1.69.0-nightly
rust 2.rs 37ms 0.3ms 1.0MB 27ms 0ms rustc 1.67.0
rust 1.rs 41ms 0.8ms 1.1MB 30ms 0ms rustc 1.67.0
chapel 2.chpl 52ms 1.1ms 20.2MB 47ms 0ms chpl 1.29.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 1080ms 12ms 2.5MB 2083ms 0ms rustc 1.69.0-nightly
rust 7-m.rs 1084ms 10ms 2.0MB 2087ms 0ms rustc 1.67.0
rust 7.rs 2063ms 0.4ms 2.2MB 2053ms 0ms rustc 1.67.0
rust 8.rs 2066ms 6.4ms 2.3MB 2053ms 0ms rustc 1.69.0-nightly
rust 2-m.rs 2185ms 13ms 2.2MB 4257ms 0ms rustc 1.67.0
chapel 1-m.chpl 2300ms 88ms 32.3MB 4430ms 7ms chpl 1.29.0
chapel 1.chpl 4374ms 2.3ms 32.4MB 4363ms 3ms chpl 1.29.0
rust 2.rs timeout 0.0ms 2.2MB 4983ms 0ms rustc 1.67.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 277ms 3.3ms 2.2MB 507ms 3ms rustc 1.69.0-nightly
rust 7-m.rs 278ms 5.2ms 1.0MB 513ms 0ms rustc 1.67.0
rust 7.rs 518ms 0.6ms 1.0MB 510ms 0ms rustc 1.67.0
rust 8.rs 519ms 0.9ms 2.1MB 510ms 0ms rustc 1.69.0-nightly
chapel 1-m.chpl 581ms 0.8ms 32.3MB 1110ms 0ms chpl 1.29.0
rust 2-m.rs 620ms 108ms 4.0MB 1170ms 0ms rustc 1.67.0
chapel 1.chpl 1111ms 1.9ms 32.3MB 1100ms 0ms chpl 1.29.0
rust 2.rs 1729ms 0.4ms 1.0MB 1720ms 0ms rustc 1.67.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 75ms 0.6ms 1.0MB 123ms 0ms rustc 1.69.0-nightly
rust 7-m.rs 75ms 0.4ms 1.0MB 127ms 0ms rustc 1.67.0
rust 8.rs 131ms 0.3ms 1.1MB 120ms 0ms rustc 1.69.0-nightly
rust 7.rs 132ms 0.4ms 1.0MB 120ms 0ms rustc 1.67.0
chapel 1-m.chpl 164ms 3.6ms 32.3MB 287ms 3ms chpl 1.29.0
rust 2-m.rs 227ms 5.6ms 1.0MB 400ms 7ms rustc 1.67.0
chapel 1.chpl 297ms 1.7ms 32.3MB 287ms 0ms chpl 1.29.0
rust 2.rs 436ms 0.8ms 1.0MB 427ms 0ms rustc 1.67.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1788ms 3.0ms 33.6MB 1763ms 13ms rustc 1.67.0
rust 5.rs 1951ms 33ms 33.8MB 1927ms 7ms rustc 1.67.0
rust 3.rs 2134ms 59ms 49.7MB 2097ms 17ms rustc 1.67.0
chapel 4.chpl 2288ms 12ms 46.2MB 2260ms 7ms chpl 1.29.0
chapel 3.chpl 2449ms 12ms 46.2MB 2427ms 13ms chpl 1.29.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 152ms 0.3ms 5.7MB 137ms 0ms rustc 1.67.0
rust 5.rs 160ms 1.1ms 5.7MB 147ms 0ms rustc 1.67.0
rust 3.rs 177ms 2.9ms 7.8MB 163ms 0ms rustc 1.67.0
chapel 4.chpl 219ms 3.7ms 14.0MB 207ms 0ms chpl 1.29.0
chapel 3.chpl 226ms 0.3ms 14.0MB 220ms 0ms chpl 1.29.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-m.rs 900ms 109ms 4.6MB 1720ms 40ms rustc 1.67.0
rust 3-m.rs 1004ms 32ms 6.2MB 1893ms 27ms rustc 1.67.0
rust 3.rs 1949ms 13ms 6.2MB 1900ms 30ms rustc 1.67.0
rust 1-m.rs 3130ms 25ms 4.9MB 6013ms 97ms rustc 1.67.0
rust 4.rs 3240ms 18ms 4.3MB 3227ms 0ms rustc 1.67.0
chapel 1-m.chpl 3927ms 97ms 59.5MB 7640ms 30ms chpl 1.29.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 77ms 4.7ms 3.0MB 123ms 3ms rustc 1.67.0
rust 5-m.rs 105ms 2.6ms 2.7MB 177ms 3ms rustc 1.67.0
rust 3.rs 122ms 5.0ms 3.1MB 110ms 0ms rustc 1.67.0
rust 4.rs 210ms 0.9ms 2.4MB 200ms 0ms rustc 1.67.0
rust 1-m.rs 214ms 9.6ms 2.9MB 377ms 13ms rustc 1.67.0
chapel 1-m.chpl 270ms 6.8ms 20.4MB 480ms 7ms chpl 1.29.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 0.6ms 11.7MB 90ms 0ms chpl 1.29.0
rust 1.rs 149ms 5.0ms 3.6MB 137ms 0ms rustc 1.67.0
rust 2.rs 602ms 3.3ms 3.8MB 590ms 0ms rustc 1.67.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 40ms 0.7ms 2.8MB 30ms 0ms rustc 1.67.0
chapel 1.chpl 43ms 1.8ms 20.9MB 37ms 0ms chpl 1.29.0
rust 2.rs 113ms 0.2ms 3.1MB 103ms 0ms rustc 1.67.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 716ms 10ms 1.1MB 1390ms 0ms rustc 1.67.0
rust 2-im.rs 1057ms 12ms 1.1MB 2030ms 0ms rustc 1.67.0
rust 5-m.rs 1255ms 5.8ms 1.0MB 2403ms 0ms rustc 1.67.0
rust 3-i.rs 1394ms 13ms 1.1MB 1383ms 0ms rustc 1.67.0
rust 2-i.rs 1880ms 0.9ms 1.0MB 1870ms 0ms rustc 1.67.0
rust 1-m.rs 2006ms 7.1ms 1.0MB 3880ms 0ms rustc 1.67.0
rust 1.rs 3693ms 14ms 1.0MB 3677ms 0ms rustc 1.67.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 68ms 3.4ms 1.0MB 110ms 0ms rustc 1.67.0
rust 2-im.rs 98ms 2.1ms 1.0MB 160ms 0ms rustc 1.67.0
rust 5-m.rs 116ms 0.9ms 1.0MB 193ms 0ms rustc 1.67.0
rust 3-i.rs 120ms 1.4ms 1.0MB 107ms 0ms rustc 1.67.0
rust 2-i.rs 157ms 0.2ms 1.8MB 147ms 0ms rustc 1.67.0
rust 1-m.rs 176ms 3.7ms 1.1MB 320ms 0ms rustc 1.67.0
rust 1.rs 317ms 3.7ms 1.1MB 307ms 0ms rustc 1.67.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 169ms 57ms 41.8MB 97ms 97ms rustc 1.67.0
rust 2-http2.rs 370ms 71ms 40.3MB 457ms 133ms rustc 1.67.0
rust 2-m.rs 575ms 15ms 102.4MB 297ms 567ms rustc 1.67.0
rust 1-http2.rs 790ms 152ms 72.3MB 827ms 483ms rustc 1.67.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 76ms 10ms 12.2MB 20ms 27ms rustc 1.67.0
rust 2.rs 140ms 11ms 25.0MB 53ms 83ms rustc 1.67.0
rust 2-http2.rs 364ms 79ms 25.2MB 503ms 127ms rustc 1.67.0
rust 1-http2.rs 465ms 13ms 25.8MB 693ms 113ms rustc 1.67.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 82ms 1.2ms 38.0MB 53ms 17ms rustc 1.67.0
rust 3.rs 84ms 0.5ms 36.3MB 60ms 7ms rustc 1.67.0
rust 1.rs 131ms 3.2ms 75.4MB 80ms 37ms rustc 1.67.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 516ms 2.1ms 258.5MB 390ms 107ms rustc 1.67.0
rust 3.rs 526ms 4.2ms 258.5MB 393ms 113ms rustc 1.67.0
rust 1.rs 909ms 22ms 605.5MB 647ms 247ms rustc 1.67.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 354ms 9.2ms 29.0MB 620ms 7ms rustc 1.67.0
rust 8.rs 599ms 6.8ms 23.7MB 570ms 10ms rustc 1.67.0
chapel 3-m.chpl 1012ms 59ms 88.2MB 1780ms 33ms chpl 1.29.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 45ms 2.6ms 16.2MB 57ms 0ms rustc 1.67.0
rust 8.rs 78ms 1.0ms 11.6MB 70ms 0ms rustc 1.67.0
chapel 3-m.chpl 165ms 1.3ms 63.5MB 267ms 13ms chpl 1.29.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 62ms 3.5ms 1.0MB 50ms 0ms rustc 1.67.0
rust 1.rs 70ms 0.1ms 1.0MB 60ms 0ms rustc 1.67.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 223ms 4.9ms 1.1MB 210ms 0ms rustc 1.67.0
rust 1.rs 292ms 0.1ms 1.1MB 280ms 0ms rustc 1.67.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 35ms 1.7ms 1.0MB 30ms 0ms rustc 1.67.0
rust 1.rs 47ms 0.2ms 1.0MB 40ms 0ms rustc 1.67.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 972ms 14ms 33.7MB 947ms 7ms rustc 1.67.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 197ms 3.3ms 9.9MB 180ms 0ms rustc 1.67.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 472ms 0.6ms 6.5MB 460ms 0ms rustc 1.67.0
rust 1.rs 1268ms 103ms 40.9MB 1240ms 13ms rustc 1.67.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 107ms 1.7ms 3.1MB 97ms 0ms rustc 1.67.0
rust 1.rs 143ms 12ms 11.6MB 133ms 0ms rustc 1.67.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 593ms 3.5ms 4.1MB 577ms 3ms chpl 1.29.0
rust 2.rs 1751ms 1.0ms 2.8MB 1673ms 63ms rustc 1.67.0
rust 1.rs 1842ms 44ms 2.8MB 1687ms 133ms rustc 1.67.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 147ms 0.9ms 3.8MB 140ms 0ms chpl 1.29.0
rust 2.rs 391ms 0.8ms 2.5MB 380ms 0ms rustc 1.67.0
rust 1.rs 395ms 7.0ms 2.4MB 363ms 13ms rustc 1.67.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 566ms 9.1ms 77.6MB 713ms 20ms rustc 1.67.0
chapel 3.chpl 1995ms 11ms 221.6MB 1847ms 137ms chpl 1.29.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 64ms 0.7ms 11.1MB 73ms 0ms rustc 1.67.0
chapel 3.chpl 218ms 3.7ms 35.6MB 187ms 17ms chpl 1.29.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 150ms 1.9ms 1.0MB 140ms 0ms rustc 1.67.0
chapel 1.chpl 1539ms 19ms 32.3MB 1507ms 13ms chpl 1.29.0
rust 1.rs 1857ms 9.0ms 1.0MB 1843ms 0ms rustc 1.67.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 41ms 0.3ms 1.0MB 30ms 0ms rustc 1.67.0
chapel 1.chpl 398ms 0.6ms 32.3MB 387ms 0ms chpl 1.29.0
rust 1.rs 467ms 0.8ms 1.0MB 460ms 0ms rustc 1.67.0