Programming Language and compiler
Benchmarks

Rust VS Chapel benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 133ms 2.6ms 16.1MB 220ms 0ms chpl 1.28.0
rust 5-m.rs 183ms 3.3ms 1.2MB 327ms 0ms rustc 1.64.0
rust 5c-m.rs 183ms 2.1ms 1.2MB 317ms 0ms rustc 1.66.0-nightly
rust 1c.rs 220ms 0.2ms 0.7MB 210ms 0ms rustc 1.66.0-nightly
rust 1.rs 262ms 1.2ms 0.6MB 250ms 0ms rustc 1.64.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 25ms 1.9ms 0.6MB 17ms 0ms rustc 1.66.0-nightly
chapel 5.chpl 26ms 1.0ms 16.1MB 23ms 0ms chpl 1.28.0
rust 5c-m.rs 27ms 3.2ms 1.3MB 33ms 0ms rustc 1.66.0-nightly
rust 5-m.rs 29ms 1.9ms 1.3MB 33ms 0ms rustc 1.64.0
rust 1.rs 30ms 1.8ms 0.6MB 20ms 0ms rustc 1.64.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 1.8ms 0.4ms 0.6MB 0ms 0ms rustc 1.66.0-nightly
rust 1.rs 2.0ms 0.8ms 0.6MB 0ms 0ms rustc 1.64.0
chapel 1.chpl 15ms 2.3ms 16.4MB 0ms 10ms chpl 1.28.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 360ms 1.1ms 4.9MB 350ms 0ms rustc 1.66.0-nightly
rust 8.rs 501ms 0.8ms 4.9MB 490ms 0ms rustc 1.64.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 18ms 0.6ms 0.6MB 10ms 0ms rustc 1.66.0-nightly
rust 8.rs 24ms 0.3ms 0.6MB 10ms 0ms rustc 1.64.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 207ms 1.2ms 0.6MB 197ms 0ms rustc 1.64.0
rust 7-i.rs 287ms 0.9ms 0.6MB 277ms 0ms rustc 1.64.0
rust 3.rs 342ms 0.5ms 0.7MB 330ms 0ms rustc 1.66.0-nightly
rust 2.rs 359ms 3.4ms 0.6MB 347ms 0ms rustc 1.64.0
chapel 2.chpl 401ms 1.1ms 16.4MB 390ms 0ms chpl 1.28.0
rust 1.rs 415ms 5.8ms 0.6MB 407ms 0ms rustc 1.64.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 24ms 1.2ms 0.6MB 13ms 0ms rustc 1.64.0
rust 7-i.rs 31ms 0.3ms 0.6MB 20ms 0ms rustc 1.64.0
rust 3.rs 37ms 0.5ms 0.7MB 30ms 0ms rustc 1.66.0-nightly
rust 2.rs 38ms 0.1ms 0.6MB 30ms 0ms rustc 1.64.0
rust 1.rs 45ms 0.9ms 0.6MB 33ms 0ms rustc 1.64.0
chapel 2.chpl 56ms 1.4ms 16.4MB 43ms 3ms chpl 1.28.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 889ms 1.1ms 2.6MB 1713ms 0ms rustc 1.66.0-nightly
rust 7-m.rs 892ms 0.5ms 2.2MB 1720ms 0ms rustc 1.64.0
rust 8.rs 1718ms 0.1ms 2.5MB 1703ms 0ms rustc 1.66.0-nightly
rust 7.rs 1719ms 0.9ms 2.2MB 1707ms 0ms rustc 1.64.0
rust 2-m.rs 1831ms 13ms 4.0MB 3530ms 3ms rustc 1.64.0
chapel 1-m.chpl 1941ms 3.7ms 32.3MB 3797ms 3ms chpl 1.28.0
chapel 1.chpl 3776ms 0.5ms 32.3MB 3760ms 0ms chpl 1.28.0
rust 2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 233ms 1.4ms 2.3MB 427ms 0ms rustc 1.66.0-nightly
rust 7-m.rs 233ms 0.5ms 0.7MB 427ms 0ms rustc 1.64.0
rust 8.rs 432ms 0.3ms 2.2MB 420ms 0ms rustc 1.66.0-nightly
rust 7.rs 435ms 1.6ms 0.6MB 423ms 0ms rustc 1.64.0
rust 2-m.rs 465ms 0.7ms 2.3MB 877ms 0ms rustc 1.64.0
chapel 1-m.chpl 507ms 1.4ms 32.3MB 953ms 7ms chpl 1.28.0
chapel 1.chpl 963ms 0.7ms 32.3MB 947ms 7ms chpl 1.28.0
rust 2.rs 1551ms 0.4ms 0.6MB 1540ms 0ms rustc 1.64.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 64ms 0.7ms 2.2MB 107ms 0ms rustc 1.66.0-nightly
rust 7-m.rs 66ms 2.4ms 0.7MB 110ms 0ms rustc 1.64.0
rust 8.rs 111ms 0.9ms 2.2MB 100ms 0ms rustc 1.66.0-nightly
rust 7.rs 111ms 1.0ms 0.6MB 100ms 0ms rustc 1.64.0
rust 2-m.rs 125ms 1.5ms 0.7MB 217ms 0ms rustc 1.64.0
chapel 1-m.chpl 147ms 2.6ms 32.3MB 253ms 0ms chpl 1.28.0
chapel 1.chpl 256ms 0.7ms 32.3MB 243ms 7ms chpl 1.28.0
rust 2.rs 391ms 1.3ms 0.6MB 380ms 0ms rustc 1.64.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1768ms 38ms 33.7MB 1743ms 10ms rustc 1.64.0
rust 5.rs 1899ms 6.4ms 33.8MB 1880ms 3ms rustc 1.64.0
rust 3.rs 2017ms 65ms 49.9MB 1977ms 20ms rustc 1.64.0
chapel 4.chpl 2546ms 7.4ms 50.3MB 2507ms 20ms chpl 1.28.0
chapel 3.chpl 2663ms 18ms 41.5MB 2623ms 13ms chpl 1.28.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 157ms 0.7ms 5.6MB 143ms 0ms rustc 1.64.0
rust 3.rs 167ms 4.4ms 7.8MB 153ms 0ms rustc 1.64.0
rust 5.rs 168ms 0.6ms 6.0MB 157ms 0ms rustc 1.64.0
chapel 3.chpl 235ms 1.7ms 11.3MB 223ms 0ms chpl 1.28.0
chapel 4.chpl 237ms 1.6ms 13.1MB 230ms 0ms chpl 1.28.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 937ms 22ms 6.0MB 1790ms 30ms rustc 1.64.0
rust 5-m.rs 1022ms 195ms 5.4MB 1947ms 27ms rustc 1.64.0
rust 3.rs 1817ms 12ms 6.5MB 1773ms 27ms rustc 1.64.0
rust 4.rs 3031ms 1.3ms 4.5MB 3020ms 0ms rustc 1.64.0
rust 1-m.rs 3311ms 68ms 5.3MB 6430ms 60ms rustc 1.64.0
chapel 1-m.chpl 3955ms 51ms 55.6MB 7720ms 33ms chpl 1.28.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 76ms 2.3ms 3.0MB 117ms 10ms rustc 1.64.0
rust 5-m.rs 94ms 9.1ms 2.8MB 160ms 0ms rustc 1.64.0
rust 3.rs 112ms 0.5ms 3.1MB 97ms 0ms rustc 1.64.0
rust 4.rs 200ms 1.7ms 2.6MB 183ms 0ms rustc 1.64.0
rust 1-m.rs 222ms 3.7ms 2.9MB 400ms 10ms rustc 1.64.0
chapel 1-m.chpl 277ms 4.4ms 26.2MB 500ms 10ms chpl 1.28.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 90ms 0.6ms 18.4MB 73ms 7ms chpl 1.28.0
rust 1.rs 140ms 0.9ms 3.7MB 130ms 0ms rustc 1.64.0
rust 2.rs 575ms 1.8ms 3.7MB 560ms 0ms rustc 1.64.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 39ms 0.5ms 3.0MB 30ms 0ms rustc 1.64.0
chapel 1.chpl 40ms 0.6ms 16.9MB 27ms 3ms chpl 1.28.0
rust 2.rs 112ms 0.5ms 3.1MB 100ms 0ms rustc 1.64.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 649ms 0.6ms 0.7MB 1253ms 0ms rustc 1.64.0
rust 2-im.rs 987ms 13ms 0.7MB 1893ms 0ms rustc 1.64.0
rust 3-i.rs 1213ms 9.5ms 0.6MB 1203ms 0ms rustc 1.64.0
rust 5-m.rs 1217ms 22ms 0.7MB 2327ms 0ms rustc 1.64.0
rust 2-i.rs 1797ms 0.7ms 0.6MB 1787ms 0ms rustc 1.64.0
rust 1-m.rs 2029ms 11ms 0.7MB 3927ms 0ms rustc 1.64.0
rust 1.rs 3997ms 10ms 0.6MB 3983ms 0ms rustc 1.64.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 62ms 0.9ms 0.7MB 97ms 0ms rustc 1.64.0
rust 2-im.rs 90ms 2.2ms 0.7MB 150ms 0ms rustc 1.64.0
rust 3-i.rs 103ms 0.5ms 0.6MB 90ms 0ms rustc 1.64.0
rust 5-m.rs 112ms 0.5ms 0.7MB 190ms 0ms rustc 1.64.0
rust 2-i.rs 153ms 0.6ms 0.6MB 140ms 0ms rustc 1.64.0
rust 1-m.rs 182ms 1.3ms 0.7MB 320ms 0ms rustc 1.64.0
rust 1.rs 337ms 1.1ms 0.6MB 327ms 0ms rustc 1.64.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2-http2.rs 363ms 82ms 50.3MB 463ms 123ms rustc 1.64.0
rust 2-m.rs 556ms 4.6ms 112.8MB 313ms 553ms rustc 1.64.0
rust 1-http2.rs 1074ms 262ms 88.0MB 1423ms 480ms rustc 1.64.0
rust 1.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 79ms 20ms 16.7MB 27ms 27ms rustc 1.64.0
rust 2.rs 138ms 6.4ms 30.6MB 43ms 97ms rustc 1.64.0
rust 1-http2.rs 358ms 54ms 28.3MB 500ms 103ms rustc 1.64.0
rust 2-http2.rs timeout 0.0ms 0.0MB 0ms 0ms rustc 1.64.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3.rs 84ms 1.6ms 36.4MB 57ms 13ms rustc 1.64.0
rust 2.rs 85ms 0.4ms 38.1MB 57ms 10ms rustc 1.64.0
rust 1.rs 147ms 0.9ms 75.5MB 103ms 27ms rustc 1.64.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3.rs 518ms 0.9ms 258.6MB 397ms 107ms rustc 1.64.0
rust 2.rs 533ms 0.2ms 258.5MB 403ms 113ms rustc 1.64.0
rust 1.rs 954ms 2.4ms 605.5MB 663ms 273ms rustc 1.64.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 353ms 13ms 28.7MB 630ms 13ms rustc 1.64.0
rust 8.rs 636ms 5.3ms 24.0MB 610ms 10ms rustc 1.64.0
chapel 3-m.chpl 976ms 4.2ms 72.3MB 1780ms 40ms chpl 1.28.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 52ms 4.6ms 16.1MB 63ms 10ms rustc 1.64.0
rust 8.rs 81ms 2.7ms 11.5MB 67ms 0ms rustc 1.64.0
chapel 3-m.chpl 176ms 6.7ms 59.6MB 260ms 27ms chpl 1.28.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 53ms 0.9ms 0.6MB 50ms 0ms rustc 1.64.0
rust 1.rs 83ms 5.1ms 2.2MB 73ms 0ms rustc 1.64.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 208ms 10ms 0.6MB 197ms 0ms rustc 1.64.0
rust 1.rs 300ms 24ms 2.1MB 287ms 0ms rustc 1.64.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 32ms 0.8ms 0.6MB 20ms 0ms rustc 1.64.0
rust 1.rs 45ms 0.5ms 0.6MB 37ms 0ms rustc 1.64.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 894ms 6.7ms 33.8MB 863ms 13ms rustc 1.64.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 186ms 1.2ms 9.8MB 170ms 0ms rustc 1.64.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 461ms 0.5ms 6.7MB 447ms 0ms rustc 1.64.0
rust 1.rs 1352ms 162ms 40.9MB 1327ms 7ms rustc 1.64.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 105ms 0.7ms 3.1MB 90ms 0ms rustc 1.64.0
rust 1.rs 123ms 2.3ms 11.6MB 107ms 0ms rustc 1.64.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 482ms 1.9ms 19.6MB 470ms 0ms chpl 1.28.0
rust 1.rs 1738ms 3.3ms 2.8MB 1573ms 150ms rustc 1.64.0
rust 2.rs 1805ms 1.0ms 2.7MB 1737ms 43ms rustc 1.64.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 126ms 4.1ms 16.9MB 110ms 3ms chpl 1.28.0
rust 1.rs 374ms 0.9ms 2.4MB 357ms 3ms rustc 1.64.0
rust 2.rs 409ms 0.3ms 2.6MB 397ms 0ms rustc 1.64.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 566ms 0.2ms 77.9MB 743ms 20ms rustc 1.64.0
chapel 3.chpl 1911ms 10ms 221.6MB 1720ms 177ms chpl 1.28.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 63ms 0.6ms 11.2MB 70ms 0ms rustc 1.64.0
chapel 3.chpl 201ms 0.8ms 33.7MB 157ms 30ms chpl 1.28.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 135ms 0.4ms 0.6MB 130ms 0ms rustc 1.64.0
chapel 1.chpl 1479ms 2.5ms 32.3MB 1457ms 7ms chpl 1.28.0
rust 1.rs 1855ms 6.0ms 0.6MB 1843ms 0ms rustc 1.64.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 36ms 0.5ms 0.6MB 27ms 0ms rustc 1.64.0
chapel 1.chpl 386ms 1.2ms 32.3MB 367ms 3ms chpl 1.28.0
rust 1.rs 466ms 0.4ms 0.7MB 453ms 0ms rustc 1.64.0