Programming Language and compiler
Benchmarks

Chapel VS Python benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1197ms 3.3ms 96.2MB 1130ms 53ms pypy 3.10.16
chapel 3.chpl 2069ms 6.5ms 60.3MB 2057ms 0ms chpl 1.31.0
chapel 4.chpl 2076ms 200ms 62.2MB 2063ms 3ms chpl 1.31.0
python 1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.2
python 1.py timeout 0.0ms 40.5MB 4740ms 250ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 97ms 2.2ms 68.7MB 67ms 17ms pypy 3.10.16
chapel 3.chpl 188ms 1.6ms 32.2MB 180ms 0ms chpl 1.31.0
chapel 4.chpl 196ms 21ms 32.3MB 190ms 0ms chpl 1.31.0
python 1.py 487ms 1.2ms 11.9MB 460ms 13ms pyston 3.8.12
python 1.py 726ms 15ms 12.6MB 713ms 0ms cpython 3.13.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1280ms 15ms 107.2MB 1230ms 37ms pypy 3.10.16
chapel 1-m.chpl 2266ms 93ms 525.8MB 4393ms 80ms chpl 1.31.0
python 1.py 2668ms 8.1ms 25.1MB 2643ms 10ms cpython 3.13.2
python 1.py timeout 0.0ms 17.4MB 4980ms 10ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 198ms 4.8ms 494.6MB 317ms 50ms chpl 1.31.0
python 1.py 221ms 0.4ms 86.7MB 183ms 23ms pypy 3.10.16
python 1.py 239ms 1.7ms 20.3MB 220ms 10ms cpython 3.13.2
python 1.py 663ms 2.7ms 16.8MB 637ms 10ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 73ms 2.7ms 32.5MB 70ms 0ms chpl 1.31.0
python 1.py 252ms 2.8ms 83.3MB 213ms 27ms pypy 3.10.16
python 1.py 360ms 4.5ms 12.5MB 343ms 0ms cpython 3.13.2
python 1.py 2006ms 3.3ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 1.3ms 30.5MB 30ms 0ms chpl 1.31.0
python 1.py 105ms 0.1ms 63.3MB 73ms 17ms pypy 3.10.16
python 1.py 125ms 28ms 12.3MB 100ms 0ms cpython 3.13.2
python 1.py 349ms 1.6ms 8.8MB 337ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 106ms 1.8ms 28.3MB 190ms 0ms chpl 1.31.0
python 1.py 1866ms 18ms 88.8MB 1820ms 33ms pypy 3.10.16
python 5-m.py 2278ms 15ms 65.4MB 3513ms 857ms pypy 3.10.16
python 5-m.py 2482ms 19ms 12.5MB 3550ms 1030ms pyston 3.8.12
python 1.py 3030ms 3.8ms 8.1MB 3020ms 0ms pyston 3.8.12
python 5-m.py 3399ms 44ms 13.5MB 4503ms 963ms cpython 3.13.2
python 1.py 4712ms 79ms 8.8MB 4703ms 0ms cpython 3.13.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.3ms 28.4MB 20ms 0ms chpl 1.31.0
python 1.py 249ms 2.9ms 63.3MB 220ms 13ms pypy 3.10.16
python 1.py 317ms 7.5ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 321ms 4.6ms 12.5MB 420ms 147ms pyston 3.8.12
python 5-m.py 405ms 4.6ms 13.5MB 490ms 133ms cpython 3.13.2
python 5-m.py 450ms 2.3ms 65.4MB 730ms 327ms pypy 3.10.16
python 1.py 484ms 3.0ms 8.8MB 473ms 0ms cpython 3.13.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
python 1.py 12ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.2ms 8.6MB 10ms 0ms cpython 3.13.2
python 1.py 30ms 1.2ms 51.4MB 10ms 10ms pypy 3.10.16

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 747ms 1.1ms 87.0MB 1410ms 10ms chpl 1.31.0
python 3-m.py 2464ms 33ms 136.4MB 8333ms 327ms pypy 3.10.16
python 3-m.py 3223ms 25ms 34.3MB 12263ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.6MB 87ms 23ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 116ms 0.5ms 87.0MB 200ms 3ms chpl 1.31.0
python 3-m.py 392ms 2.5ms 76.3MB 1003ms 160ms pypy 3.10.16
python 3-m.py 406ms 1.5ms 14.3MB 1347ms 70ms pyston 3.8.12
python 3-m.py 659ms 5.8ms 15.1MB 2317ms 63ms cpython 3.13.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 326ms 5.3ms 28.9MB 317ms 0ms chpl 1.31.0
python 2.py 1357ms 7.5ms 57.9MB 1330ms 10ms pypy 3.10.16
python 1.py 2662ms 11ms 57.2MB 2640ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 2.3ms 28.8MB 40ms 0ms chpl 1.31.0
python 2.py 179ms 2.5ms 57.9MB 157ms 10ms pypy 3.10.16
python 1.py 310ms 12ms 57.0MB 287ms 10ms pypy 3.10.16
python 1.py 934ms 14ms 8.3MB 920ms 0ms pyston 3.8.12
python 2.py 1326ms 45ms 8.1MB 1313ms 0ms pyston 3.8.12
python 1.py 3035ms 123ms 8.6MB 3020ms 0ms cpython 3.13.2
python 2.py 3207ms 87ms 8.8MB 3197ms 0ms cpython 3.13.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 446ms 2.3ms 28.4MB 440ms 0ms chpl 1.31.0
python 4.py 1912ms 9.2ms 8.9MB 1870ms 27ms pyston 3.8.12
python 4.py 1956ms 14ms 9.3MB 1890ms 47ms cpython 3.13.2
python 4.py 2197ms 12ms 89.4MB 2153ms 30ms pypy 3.10.16

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 116ms 1.2ms 30.3MB 110ms 0ms chpl 1.31.0
python 4.py 453ms 3.4ms 8.6MB 443ms 0ms pyston 3.8.12
python 4.py 463ms 0.7ms 9.1MB 450ms 0ms cpython 3.13.2
python 4.py 551ms 4.4ms 83.8MB 517ms 20ms pypy 3.10.16

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1399ms 7.7ms 222.1MB 1347ms 43ms chpl 1.31.0
python 1.py 2254ms 9.7ms 243.7MB 2197ms 43ms pypy 3.10.16
python 1.py 4766ms 18ms 268.3MB 4583ms 167ms pyston 3.8.12
python 1.py timeout 0.0ms 144.0MB 4937ms 47ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 164ms 2.9ms 49.0MB 150ms 10ms chpl 1.31.0
python 1.py 331ms 4.0ms 85.9MB 290ms 27ms pypy 3.10.16
python 1.py 498ms 3.7ms 36.1MB 467ms 20ms pyston 3.8.12
python 1.py 611ms 4.7ms 31.0MB 580ms 13ms cpython 3.13.2

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1181ms 3.6ms 29.2MB 1177ms 0ms chpl 1.31.0
python 1.py 3166ms 15ms 8.3MB 3153ms 0ms pyston 3.8.12
python 1.py 3558ms 6.3ms 74.3MB 3520ms 20ms pypy 3.10.16
python 1.py 3834ms 38ms 8.6MB 3823ms 0ms cpython 3.13.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 308ms 2.9ms 29.0MB 303ms 0ms chpl 1.31.0
python 1.py 806ms 3.4ms 8.3MB 793ms 0ms pyston 3.8.12
python 1.py 971ms 7.2ms 8.6MB 960ms 0ms cpython 3.13.2
python 1.py 996ms 9.3ms 67.4MB 967ms 13ms pypy 3.10.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1928ms 19ms 28.8MB 3830ms 0ms chpl 1.31.0
chapel 1.chpl 3725ms 17ms 28.8MB 3720ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.8MB 30ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 95.8MB 803ms 87ms pypy 3.10.16
python 8.py timeout 0.0ms 14.2MB 40ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 0.6ms 28.5MB 957ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 1.1ms 28.8MB 933ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.3MB 47ms 13ms cpython 3.13.2
python 8.py timeout 0.0ms 96.3MB 1323ms 190ms pypy 3.10.16
python 8.py timeout 0.0ms 13.6MB 63ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 135ms 1.0ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 2.4ms 28.8MB 240ms 0ms chpl 1.31.0
python 8-m.py 1978ms 5.9ms 93.1MB 6363ms 257ms pypy 3.10.16
python 8.py timeout 0.0ms 14.0MB 90ms 17ms cpython 3.13.2
python 8.py timeout 0.0ms 13.2MB 130ms 40ms pyston 3.8.12