Programming Language and compiler
Benchmarks

Chapel VS Python benchmarks

Current benchmark data was generated on Fri Aug 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1165ms 6.5ms 96.8MB 1107ms 47ms pypy 3.11.13
chapel 4.chpl 1943ms 3.5ms 62.3MB 1937ms 0ms chpl 1.31.0
chapel 3.chpl 2057ms 34ms 62.4MB 2050ms 0ms chpl 1.31.0
python 1.py timeout 0.0ms 41.0MB 4967ms 23ms cpython 3.13.5
python 1.py timeout 0.0ms 40.5MB 4733ms 253ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 95ms 3.5ms 68.3MB 63ms 17ms pypy 3.11.13
chapel 4.chpl 185ms 1.5ms 32.4MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 188ms 2.4ms 32.3MB 187ms 0ms chpl 1.31.0
python 1.py 492ms 6.9ms 11.9MB 470ms 10ms pyston 3.8.12
python 1.py 734ms 16ms 12.9MB 723ms 0ms cpython 3.13.5

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1207ms 3.1ms 105.2MB 1160ms 37ms pypy 3.11.13
chapel 1-m.chpl 2227ms 82ms 611.9MB 4340ms 77ms chpl 1.31.0
python 1.py 2664ms 14ms 25.4MB 2643ms 10ms cpython 3.13.5
python 1.py timeout 0.0ms 17.3MB 4980ms 3ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 195ms 2.0ms 578.1MB 313ms 50ms chpl 1.31.0
python 1.py 223ms 2.8ms 85.4MB 183ms 23ms pypy 3.11.13
python 1.py 230ms 0.7ms 20.6MB 210ms 3ms cpython 3.13.5
python 1.py 692ms 7.5ms 16.8MB 673ms 3ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 69ms 0.2ms 32.5MB 70ms 0ms chpl 1.31.0
python 1.py 264ms 5.4ms 84.7MB 227ms 23ms pypy 3.11.13
python 1.py 363ms 1.6ms 12.6MB 347ms 3ms cpython 3.13.5
python 1.py 2009ms 3.5ms 9.6MB 1997ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 33ms 0.3ms 30.5MB 30ms 0ms chpl 1.31.0
python 1.py 106ms 0.4ms 65.4MB 80ms 10ms pypy 3.11.13
python 1.py 107ms 1.1ms 11.8MB 93ms 0ms cpython 3.13.5
python 1.py 348ms 1.8ms 8.8MB 333ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 106ms 1.0ms 28.4MB 190ms 0ms chpl 1.31.0
python 1.py 2215ms 30ms 89.2MB 2163ms 33ms pypy 3.11.13
python 5-m.py 2319ms 16ms 66.2MB 3547ms 837ms pypy 3.11.13
python 5-m.py 2445ms 19ms 12.5MB 3547ms 983ms pyston 3.8.12
python 1.py 3020ms 14ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3347ms 16ms 13.8MB 4410ms 927ms cpython 3.13.5
python 1.py 4661ms 7.5ms 9.0MB 4647ms 0ms cpython 3.13.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 20ms 1.0ms 28.4MB 20ms 0ms chpl 1.31.0
python 1.py 279ms 1.4ms 63.5MB 250ms 10ms pypy 3.11.13
python 5-m.py 310ms 1.1ms 12.5MB 393ms 143ms pyston 3.8.12
python 1.py 313ms 2.4ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 394ms 3.6ms 13.8MB 473ms 127ms cpython 3.13.5
python 5-m.py 448ms 1.8ms 66.2MB 763ms 273ms pypy 3.11.13
python 1.py 491ms 9.3ms 8.9MB 480ms 0ms cpython 3.13.5

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 10ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
python 1.py 11ms 0.9ms 7.8MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 0.8ms 8.8MB 0ms 0ms cpython 3.13.5
python 1.py 29ms 0.8ms 52.2MB 10ms 10ms pypy 3.11.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 746ms 4.8ms 99.0MB 1410ms 7ms chpl 1.31.0
python 3-m.py 2327ms 11ms 142.4MB 7870ms 307ms pypy 3.11.13
python 3-m.py 3105ms 7.2ms 34.0MB 11830ms 113ms pyston 3.8.12
python 3.py timeout 0.0ms 35.8MB 90ms 13ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 114ms 2.1ms 87.0MB 200ms 3ms chpl 1.31.0
python 3-m.py 380ms 3.0ms 77.0MB 967ms 143ms pypy 3.11.13
python 3-m.py 398ms 5.7ms 14.2MB 1317ms 70ms pyston 3.8.12
python 3-m.py 657ms 3.2ms 15.3MB 2323ms 67ms cpython 3.13.5

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 324ms 1.7ms 28.8MB 320ms 0ms chpl 1.31.0
python 2.py 1342ms 2.7ms 60.5MB 1317ms 13ms pypy 3.11.13
python 1.py 2650ms 17ms 57.8MB 2627ms 10ms pypy 3.11.13
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.5
python 2.py timeout 0.0ms 9.0MB 4990ms 0ms cpython 3.13.5
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 43ms 1.3ms 28.8MB 40ms 0ms chpl 1.31.0
python 2.py 176ms 4.7ms 58.5MB 153ms 10ms pypy 3.11.13
python 1.py 305ms 1.6ms 57.8MB 283ms 7ms pypy 3.11.13
python 1.py 940ms 29ms 8.3MB 927ms 0ms pyston 3.8.12
python 2.py 1345ms 52ms 8.1MB 1330ms 0ms pyston 3.8.12
python 1.py 2971ms 99ms 8.9MB 2960ms 0ms cpython 3.13.5
python 2.py 2989ms 51ms 9.0MB 2977ms 0ms cpython 3.13.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 444ms 0.8ms 28.3MB 440ms 0ms chpl 1.31.0
python 4.py 1924ms 4.4ms 8.9MB 1873ms 37ms pyston 3.8.12
python 4.py 1956ms 1.7ms 9.5MB 1913ms 33ms cpython 3.13.5
python 4.py 2159ms 6.6ms 89.6MB 2120ms 30ms pypy 3.11.13

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 114ms 0.4ms 30.4MB 110ms 0ms chpl 1.31.0
python 4.py 453ms 2.0ms 8.6MB 440ms 0ms pyston 3.8.12
python 4.py 468ms 3.7ms 9.4MB 457ms 0ms cpython 3.13.5
python 4.py 549ms 3.2ms 83.6MB 510ms 27ms pypy 3.11.13

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1388ms 7.1ms 246.1MB 1340ms 43ms chpl 1.31.0
python 1.py 2244ms 7.2ms 245.8MB 2183ms 43ms pypy 3.11.13
python 1.py 4754ms 9.8ms 226.2MB 4570ms 170ms pyston 3.8.12
python 1.py timeout 0.0ms 137.9MB 4930ms 53ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 159ms 2.9ms 48.9MB 140ms 10ms chpl 1.31.0
python 1.py 333ms 7.5ms 87.3MB 290ms 30ms pypy 3.11.13
python 1.py 497ms 1.8ms 30.3MB 463ms 20ms pyston 3.8.12
python 1.py 617ms 0.3ms 30.0MB 587ms 17ms cpython 3.13.5

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1203ms 44ms 29.1MB 1197ms 0ms chpl 1.31.0
python 1.py 3157ms 7.5ms 8.4MB 3143ms 0ms pyston 3.8.12
python 1.py 3590ms 17ms 75.7MB 3557ms 23ms pypy 3.11.13
python 1.py 3831ms 12ms 8.9MB 3817ms 0ms cpython 3.13.5

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 308ms 3.0ms 29.1MB 303ms 0ms chpl 1.31.0
python 1.py 800ms 1.0ms 8.3MB 790ms 0ms pyston 3.8.12
python 1.py 955ms 9.6ms 8.9MB 943ms 0ms cpython 3.13.5
python 1.py 1001ms 6.1ms 68.6MB 973ms 13ms pypy 3.11.13

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1914ms 2.2ms 29.0MB 3800ms 0ms chpl 1.31.0
chapel 1.chpl 3718ms 16ms 28.8MB 3713ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.8MB 40ms 10ms cpython 3.13.5
python 8.py timeout 0.0ms 94.2MB 653ms 73ms pypy 3.11.13
python 8.py timeout 0.0ms 14.3MB 40ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 491ms 2.1ms 29.0MB 953ms 0ms chpl 1.31.0
chapel 1.chpl 945ms 5.5ms 28.6MB 940ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.4MB 50ms 7ms cpython 3.13.5
python 8.py timeout 0.0ms 96.2MB 1180ms 140ms pypy 3.11.13
python 8.py timeout 0.0ms 13.6MB 63ms 13ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 132ms 0.5ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 246ms 3.8ms 28.8MB 243ms 0ms chpl 1.31.0
python 8-m.py 2147ms 28ms 94.2MB 7087ms 240ms pypy 3.11.13
python 8.py timeout 0.0ms 14.3MB 90ms 13ms cpython 3.13.5
python 8.py timeout 0.0ms 13.1MB 133ms 37ms pyston 3.8.12