Programming Language and compiler
Benchmarks

Rust VS Chapel benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 148ms 2.2ms 32.0MB 253ms 0ms chpl 1.31.0
rust 5c-m.rs 185ms 2.2ms 1.7MB 327ms 0ms rustc 1.73.0-nightly
rust 5-m.rs 204ms 3.5ms 1.8MB 367ms 0ms rustc 1.70.0
rust 1c.rs 228ms 1.2ms 1.1MB 220ms 0ms rustc 1.73.0-nightly
rust 1.rs 316ms 1.6ms 1.0MB 297ms 3ms rustc 1.70.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1c.rs 26ms 1.1ms 1.1MB 20ms 0ms rustc 1.73.0-nightly
rust 5c-m.rs 26ms 0.8ms 1.7MB 30ms 0ms rustc 1.73.0-nightly
rust 5-m.rs 29ms 2.2ms 1.7MB 33ms 0ms rustc 1.70.0
chapel 5.chpl 32ms 1.1ms 32.0MB 30ms 0ms chpl 1.31.0
rust 1.rs 33ms 0.2ms 1.0MB 27ms 0ms rustc 1.70.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 2.1ms 0.4ms 1.9MB 0ms 0ms rustc 1.73.0-nightly
rust 1.rs 2.1ms 0.4ms 2.0MB 0ms 0ms rustc 1.70.0
chapel 1.chpl 17ms 0.6ms 32.3MB 10ms 0ms chpl 1.31.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 412ms 1.0ms 4.9MB 400ms 0ms rustc 1.73.0-nightly
rust 8.rs 490ms 1.3ms 4.9MB 477ms 0ms rustc 1.70.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 9.rs 19ms 0.1ms 1.1MB 10ms 0ms rustc 1.73.0-nightly
rust 8.rs 23ms 0.5ms 1.0MB 10ms 0ms rustc 1.70.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 255ms 0.2ms 1.0MB 247ms 0ms rustc 1.70.0
rust 3.rs 321ms 0.4ms 1.0MB 310ms 0ms rustc 1.73.0-nightly
rust 7-i.rs 322ms 0.4ms 1.1MB 310ms 0ms rustc 1.70.0
rust 2.rs 332ms 2.6ms 1.0MB 323ms 0ms rustc 1.70.0
chapel 2.chpl 363ms 1.0ms 32.3MB 353ms 3ms chpl 1.31.0
rust 1.rs 390ms 4.6ms 1.1MB 377ms 0ms rustc 1.70.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4-i.rs 28ms 0.2ms 1.1MB 20ms 0ms rustc 1.70.0
rust 7-i.rs 34ms 0.2ms 1.1MB 27ms 0ms rustc 1.70.0
rust 3.rs 35ms 1.1ms 1.0MB 23ms 0ms rustc 1.73.0-nightly
rust 2.rs 35ms 0.3ms 1.0MB 30ms 0ms rustc 1.70.0
rust 1.rs 41ms 0.6ms 1.1MB 30ms 0ms rustc 1.70.0
chapel 2.chpl 55ms 1.2ms 32.3MB 47ms 3ms chpl 1.31.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 1057ms 1.6ms 2.5MB 2053ms 0ms rustc 1.73.0-nightly
rust 7-m.rs 1469ms 5.7ms 2.2MB 2853ms 0ms rustc 1.70.0
rust 8.rs 2060ms 0.8ms 2.4MB 2047ms 0ms rustc 1.73.0-nightly
chapel 1-m.chpl 2241ms 4.7ms 32.2MB 4403ms 3ms chpl 1.31.0
rust 2-m.rs 2810ms 17ms 2.3MB 5467ms 10ms rustc 1.70.0
rust 7.rs 2956ms 3.2ms 1.0MB 2947ms 0ms rustc 1.70.0
chapel 1.chpl 4378ms 1.3ms 32.3MB 4367ms 3ms chpl 1.31.0
rust 2.rs timeout 0.0ms 2.2MB 4990ms 0ms rustc 1.70.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 276ms 3.1ms 2.1MB 503ms 3ms rustc 1.73.0-nightly
rust 7-m.rs 376ms 1.4ms 1.0MB 710ms 0ms rustc 1.70.0
rust 8.rs 518ms 0.5ms 2.2MB 507ms 0ms rustc 1.73.0-nightly
chapel 1-m.chpl 592ms 12ms 32.2MB 1117ms 0ms chpl 1.31.0
rust 2-m.rs 717ms 3.1ms 2.1MB 1367ms 3ms rustc 1.70.0
rust 7.rs 742ms 1.2ms 1.0MB 730ms 0ms rustc 1.70.0
chapel 1.chpl 1114ms 1.0ms 32.3MB 1100ms 0ms chpl 1.31.0
rust 2.rs 1423ms 0.6ms 1.1MB 1410ms 0ms rustc 1.70.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 74ms 1.1ms 1.0MB 127ms 0ms rustc 1.73.0-nightly
rust 7-m.rs 102ms 1.8ms 1.0MB 170ms 0ms rustc 1.70.0
rust 8.rs 131ms 0.1ms 1.1MB 120ms 0ms rustc 1.73.0-nightly
chapel 1-m.chpl 165ms 1.0ms 32.2MB 287ms 3ms chpl 1.31.0
rust 2-m.rs 184ms 0.6ms 1.1MB 333ms 0ms rustc 1.70.0
rust 7.rs 188ms 1.0ms 1.1MB 177ms 0ms rustc 1.70.0
chapel 1.chpl 298ms 4.4ms 32.3MB 290ms 0ms chpl 1.31.0
rust 2.rs 358ms 0.8ms 1.1MB 350ms 0ms rustc 1.70.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 1642ms 2.2ms 33.8MB 1623ms 3ms rustc 1.70.0
rust 5.rs 1724ms 5.8ms 33.9MB 1697ms 10ms rustc 1.70.0
rust 3.rs 1918ms 21ms 49.9MB 1893ms 7ms rustc 1.70.0
chapel 4.chpl 2278ms 2.2ms 64.2MB 2247ms 20ms chpl 1.31.0
chapel 3.chpl 2393ms 13ms 50.2MB 2373ms 10ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 4.rs 148ms 0.5ms 5.6MB 140ms 0ms rustc 1.70.0
rust 5.rs 156ms 0.5ms 5.7MB 143ms 0ms rustc 1.70.0
rust 3.rs 174ms 0.5ms 7.9MB 160ms 0ms rustc 1.70.0
chapel 4.chpl 220ms 1.8ms 28.0MB 203ms 7ms chpl 1.31.0
chapel 3.chpl 225ms 0.7ms 24.1MB 207ms 7ms chpl 1.31.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 5-m.rs 1526ms 487ms 5.5MB 2950ms 47ms rustc 1.70.0
rust 3.rs 1892ms 8.6ms 7.4MB 1837ms 37ms rustc 1.70.0
rust 3-m.rs 2420ms 212ms 7.2MB 4707ms 53ms rustc 1.70.0
rust 1-m.rs 2933ms 25ms 4.6MB 5687ms 90ms rustc 1.70.0
rust 4.rs 3210ms 10ms 4.3MB 3197ms 0ms rustc 1.70.0
chapel 1-m.chpl 4044ms 31ms 83.4MB 7847ms 37ms chpl 1.31.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-m.rs 80ms 7.5ms 3.5MB 137ms 3ms rustc 1.70.0
rust 5-m.rs 101ms 25ms 3.5MB 163ms 7ms rustc 1.70.0
rust 3.rs 121ms 1.0ms 3.9MB 110ms 0ms rustc 1.70.0
rust 4.rs 212ms 1.4ms 2.2MB 200ms 0ms rustc 1.70.0
rust 1-m.rs 214ms 2.2ms 2.8MB 380ms 17ms rustc 1.70.0
chapel 1-m.chpl 286ms 15ms 54.0MB 510ms 7ms chpl 1.31.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 2.0ms 36.0MB 93ms 0ms chpl 1.31.0
rust 1.rs 148ms 0.6ms 3.5MB 140ms 0ms rustc 1.70.0
rust 2.rs 597ms 0.6ms 3.8MB 580ms 3ms rustc 1.70.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 40ms 0.4ms 2.8MB 30ms 0ms rustc 1.70.0
chapel 1.chpl 47ms 1.4ms 34.0MB 30ms 7ms chpl 1.31.0
rust 2.rs 112ms 0.2ms 3.1MB 100ms 0ms rustc 1.70.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 805ms 10ms 1.1MB 1557ms 0ms rustc 1.70.0
rust 2-im.rs 1055ms 3.5ms 1.0MB 2027ms 0ms rustc 1.70.0
rust 5-m.rs 1197ms 13ms 1.1MB 2310ms 0ms rustc 1.70.0
rust 3-i.rs 1678ms 2.7ms 1.0MB 1667ms 0ms rustc 1.70.0
rust 1-m.rs 1980ms 32ms 1.1MB 3797ms 0ms rustc 1.70.0
rust 2-i.rs 2298ms 0.8ms 1.0MB 2290ms 0ms rustc 1.70.0
rust 1.rs 3718ms 31ms 1.0MB 3707ms 0ms rustc 1.70.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 3-im.rs 72ms 1.1ms 1.0MB 120ms 0ms rustc 1.70.0
rust 2-im.rs 95ms 0.5ms 1.0MB 160ms 0ms rustc 1.70.0
rust 5-m.rs 112ms 1.6ms 1.0MB 183ms 0ms rustc 1.70.0
rust 3-i.rs 140ms 0.4ms 1.0MB 130ms 0ms rustc 1.70.0
rust 1-m.rs 172ms 4.7ms 1.1MB 310ms 0ms rustc 1.70.0
rust 2-i.rs 195ms 0.7ms 1.0MB 183ms 0ms rustc 1.70.0
rust 1.rs 314ms 4.7ms 1.0MB 300ms 0ms rustc 1.70.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 222ms 15ms 48.5MB 100ms 140ms rustc 1.70.0
rust 2.rs 382ms 18ms 55.1MB 200ms 353ms rustc 1.70.0
rust 2-http2.rs 413ms 89ms 54.3MB 497ms 170ms rustc 1.70.0
rust 1-http2.rs 853ms 170ms 76.0MB 1097ms 400ms rustc 1.70.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 81ms 3.1ms 16.4MB 13ms 40ms rustc 1.70.0
rust 2.rs 125ms 9.5ms 25.9MB 37ms 73ms rustc 1.70.0
rust 2-http2.rs 275ms 67ms 31.4MB 347ms 80ms rustc 1.70.0
rust 1-http2.rs 339ms 80ms 27.2MB 447ms 80ms rustc 1.70.0

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 72ms 1.3ms 38.1MB 50ms 10ms rustc 1.70.0
rust 3.rs 75ms 1.6ms 36.1MB 50ms 13ms rustc 1.70.0
rust 1.rs 120ms 3.5ms 75.3MB 90ms 13ms rustc 1.70.0

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 495ms 0.8ms 258.3MB 393ms 80ms rustc 1.70.0
rust 3.rs 509ms 0.8ms 257.4MB 403ms 90ms rustc 1.70.0
rust 1.rs 872ms 0.3ms 606.1MB 627ms 230ms rustc 1.70.0

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 318ms 4.0ms 27.9MB 563ms 10ms rustc 1.70.0
rust 8.rs 548ms 0.9ms 23.7MB 530ms 7ms rustc 1.70.0
chapel 3-m.chpl 933ms 1.9ms 85.0MB 1723ms 13ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 8-m.rs 44ms 1.8ms 16.0MB 57ms 3ms rustc 1.70.0
rust 8.rs 71ms 1.1ms 11.4MB 57ms 0ms rustc 1.70.0
chapel 3-m.chpl 163ms 3.3ms 76.4MB 270ms 10ms chpl 1.31.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 49ms 0.4ms 1.0MB 40ms 0ms rustc 1.70.0
rust 1.rs 69ms 0.8ms 1.0MB 57ms 0ms rustc 1.70.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 206ms 0.8ms 1.0MB 200ms 0ms rustc 1.70.0
rust 1.rs 290ms 0.2ms 1.0MB 280ms 0ms rustc 1.70.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0-unsafe.rs 37ms 2.5ms 1.0MB 23ms 0ms rustc 1.70.0
rust 1.rs 46ms 0.4ms 1.0MB 40ms 0ms rustc 1.70.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 930ms 5.0ms 33.9MB 907ms 7ms rustc 1.70.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 1.rs 195ms 2.3ms 9.9MB 183ms 0ms rustc 1.70.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 459ms 1.6ms 6.6MB 443ms 0ms rustc 1.70.0
rust 1.rs 519ms 15ms 40.9MB 497ms 7ms rustc 1.70.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 2.rs 102ms 1.2ms 3.1MB 90ms 0ms rustc 1.70.0
rust 1.rs 124ms 4.5ms 11.6MB 110ms 0ms rustc 1.70.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 596ms 3.6ms 34.1MB 577ms 3ms chpl 1.31.0
rust 2.rs 1748ms 0.4ms 2.8MB 1683ms 47ms rustc 1.70.0
rust 1.rs 1879ms 1.5ms 2.8MB 1703ms 163ms rustc 1.70.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 156ms 3.1ms 34.1MB 147ms 0ms chpl 1.31.0
rust 2.rs 389ms 0.2ms 2.4MB 377ms 0ms rustc 1.70.0
rust 1.rs 399ms 0.5ms 2.5MB 380ms 3ms rustc 1.70.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 571ms 3.3ms 78.6MB 607ms 10ms rustc 1.70.0
chapel 3.chpl 1933ms 23ms 221.8MB 1793ms 130ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 64ms 2.1ms 12.5MB 60ms 0ms rustc 1.70.0
chapel 3.chpl 216ms 2.4ms 52.8MB 183ms 23ms chpl 1.31.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 155ms 12ms 1.0MB 147ms 0ms rustc 1.70.0
chapel 1.chpl 1543ms 3.8ms 32.4MB 1533ms 0ms chpl 1.31.0
rust 1.rs 1892ms 9.3ms 1.1MB 1877ms 0ms rustc 1.70.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 0.rs 40ms 0.7ms 1.1MB 30ms 0ms rustc 1.70.0
chapel 1.chpl 404ms 1.8ms 32.4MB 383ms 7ms chpl 1.31.0
rust 1.rs 475ms 0.7ms 1.0MB 463ms 0ms rustc 1.70.0