Programming Language and compiler
Benchmarks

Chapel VS Python benchmarks

Current benchmark data was generated on Tue Jul 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1158ms 1.0ms 96.1MB 1093ms 53ms pypy 3.10.16
chapel 4.chpl 1970ms 8.4ms 62.3MB 1960ms 3ms chpl 1.31.0
chapel 3.chpl 2062ms 35ms 62.3MB 2057ms 0ms chpl 1.31.0
python 1.py timeout 0.0ms 41.0MB 4963ms 17ms cpython 3.13.5
python 1.py timeout 0.0ms 40.5MB 4753ms 233ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 93ms 0.2ms 68.8MB 67ms 17ms pypy 3.10.16
chapel 3.chpl 188ms 2.0ms 32.3MB 180ms 0ms chpl 1.31.0
chapel 4.chpl 196ms 20ms 32.3MB 190ms 0ms chpl 1.31.0
python 1.py 477ms 1.2ms 11.9MB 453ms 13ms pyston 3.8.12
python 1.py 718ms 3.5ms 13.0MB 707ms 0ms cpython 3.13.5

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1210ms 16ms 106.4MB 1167ms 30ms pypy 3.10.16
chapel 1-m.chpl 2288ms 97ms 769.4MB 4450ms 97ms chpl 1.31.0
python 1.py 2689ms 24ms 25.4MB 2667ms 10ms cpython 3.13.5
python 1.py timeout 0.0ms 17.4MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 211ms 14ms 725.6MB 333ms 60ms chpl 1.31.0
python 1.py 220ms 5.3ms 84.7MB 183ms 27ms pypy 3.10.16
python 1.py 237ms 8.3ms 20.6MB 217ms 3ms cpython 3.13.5
python 1.py 648ms 13ms 16.8MB 633ms 0ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 72ms 0.4ms 32.5MB 70ms 0ms chpl 1.31.0
python 1.py 252ms 1.9ms 83.5MB 217ms 20ms pypy 3.10.16
python 1.py 363ms 0.9ms 12.6MB 347ms 0ms cpython 3.13.5
python 1.py 2004ms 1.1ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 0.6ms 30.5MB 30ms 0ms chpl 1.31.0
python 1.py 102ms 2.6ms 63.7MB 77ms 13ms pypy 3.10.16
python 1.py 110ms 2.3ms 11.6MB 97ms 0ms cpython 3.13.5
python 1.py 352ms 0.5ms 8.8MB 340ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 108ms 3.0ms 28.4MB 193ms 0ms chpl 1.31.0
python 1.py 1857ms 11ms 88.9MB 1810ms 30ms pypy 3.10.16
python 5-m.py 2292ms 35ms 65.6MB 3537ms 850ms pypy 3.10.16
python 5-m.py 2462ms 20ms 12.5MB 3543ms 983ms pyston 3.8.12
python 1.py 3024ms 23ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3410ms 32ms 13.8MB 4480ms 947ms cpython 3.13.5
python 1.py 4667ms 43ms 9.0MB 4653ms 0ms cpython 3.13.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.4ms 28.4MB 20ms 0ms chpl 1.31.0
python 1.py 250ms 0.9ms 63.4MB 220ms 10ms pypy 3.10.16
python 5-m.py 315ms 11ms 12.5MB 390ms 157ms pyston 3.8.12
python 1.py 315ms 4.7ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 407ms 7.3ms 13.8MB 483ms 143ms cpython 3.13.5
python 5-m.py 446ms 3.8ms 65.6MB 753ms 297ms pypy 3.10.16
python 1.py 484ms 2.4ms 9.0MB 470ms 0ms cpython 3.13.5

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.4ms 28.8MB 0ms 0ms chpl 1.31.0
python 1.py 12ms 0.7ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 1.2ms 8.8MB 10ms 0ms cpython 3.13.5
python 1.py 30ms 0.9ms 51.7MB 6ms 12ms pypy 3.10.16

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 789ms 57ms 87.0MB 1463ms 7ms chpl 1.31.0
python 3-m.py 2412ms 51ms 136.6MB 8240ms 337ms pypy 3.10.16
python 3-m.py 3142ms 31ms 34.2MB 11930ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.8MB 93ms 20ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 114ms 0.4ms 76.9MB 200ms 3ms chpl 1.31.0
python 3-m.py 385ms 6.3ms 75.8MB 977ms 150ms pypy 3.10.16
python 3-m.py 401ms 5.6ms 14.3MB 1327ms 67ms pyston 3.8.12
python 3-m.py 687ms 8.0ms 15.2MB 2437ms 67ms cpython 3.13.5

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 320ms 1.9ms 28.8MB 317ms 0ms chpl 1.31.0
python 2.py 1358ms 8.1ms 58.1MB 1333ms 10ms pypy 3.10.16
python 1.py 2644ms 7.4ms 57.0MB 2620ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.5
python 2.py timeout 0.0ms 9.0MB 4990ms 0ms cpython 3.13.5
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 48ms 4.7ms 28.8MB 43ms 0ms chpl 1.31.0
python 2.py 182ms 1.2ms 57.9MB 160ms 10ms pypy 3.10.16
python 1.py 304ms 1.2ms 57.1MB 280ms 10ms pypy 3.10.16
python 1.py 921ms 6.9ms 8.4MB 910ms 0ms pyston 3.8.12
python 2.py 1314ms 5.3ms 8.3MB 1300ms 0ms pyston 3.8.12
python 2.py 2943ms 21ms 9.0MB 2930ms 0ms cpython 3.13.5
python 1.py 3003ms 91ms 9.0MB 2990ms 0ms cpython 3.13.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 448ms 1.5ms 30.3MB 443ms 0ms chpl 1.31.0
python 4.py 1929ms 6.9ms 8.9MB 1887ms 30ms pyston 3.8.12
python 4.py 1980ms 20ms 9.5MB 1927ms 43ms cpython 3.13.5
python 4.py 2185ms 3.8ms 89.6MB 2150ms 20ms pypy 3.10.16

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 113ms 1.0ms 30.4MB 110ms 0ms chpl 1.31.0
python 4.py 462ms 1.2ms 8.6MB 450ms 0ms pyston 3.8.12
python 4.py 480ms 6.7ms 9.4MB 470ms 0ms cpython 3.13.5
python 4.py 553ms 3.7ms 83.9MB 513ms 23ms pypy 3.10.16

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1397ms 5.8ms 246.1MB 1347ms 40ms chpl 1.31.0
python 1.py 2263ms 15ms 243.6MB 2203ms 47ms pypy 3.10.16
python 1.py 4758ms 1.8ms 252.5MB 4570ms 170ms pyston 3.8.12
python 1.py timeout 0.0ms 130.2MB 4930ms 60ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 160ms 1.0ms 48.9MB 147ms 10ms chpl 1.31.0
python 1.py 331ms 3.3ms 85.1MB 290ms 30ms pypy 3.10.16
python 1.py 510ms 17ms 30.3MB 477ms 20ms pyston 3.8.12
python 1.py 622ms 9.0ms 30.0MB 590ms 17ms cpython 3.13.5

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1189ms 8.0ms 29.1MB 1180ms 0ms chpl 1.31.0
python 1.py 3168ms 17ms 8.4MB 3157ms 0ms pyston 3.8.12
python 1.py 3522ms 17ms 74.4MB 3483ms 23ms pypy 3.10.16
python 1.py 3760ms 8.9ms 8.9MB 3753ms 0ms cpython 3.13.5

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 310ms 1.9ms 29.2MB 303ms 0ms chpl 1.31.0
python 1.py 800ms 1.8ms 8.4MB 790ms 0ms pyston 3.8.12
python 1.py 949ms 2.1ms 8.9MB 937ms 0ms cpython 3.13.5
python 1.py 990ms 5.3ms 67.4MB 963ms 13ms pypy 3.10.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1930ms 12ms 28.9MB 3833ms 0ms chpl 1.31.0
chapel 1.chpl 3728ms 14ms 28.8MB 3723ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.8MB 33ms 10ms cpython 3.13.5
python 8.py timeout 0.0ms 95.9MB 787ms 80ms pypy 3.10.16
python 8.py timeout 0.0ms 14.4MB 33ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 495ms 2.2ms 28.9MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 941ms 4.2ms 28.8MB 937ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.5MB 47ms 13ms cpython 3.13.5
python 8.py timeout 0.0ms 95.6MB 1280ms 180ms pypy 3.10.16
python 8.py timeout 0.0ms 13.6MB 60ms 13ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 0.7ms 29.0MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 0.8ms 28.8MB 240ms 0ms chpl 1.31.0
python 8-m.py 1948ms 18ms 92.9MB 6303ms 253ms pypy 3.10.16
python 8.py timeout 0.0ms 14.3MB 80ms 20ms cpython 3.13.5
python 8.py timeout 0.0ms 13.1MB 150ms 30ms pyston 3.8.12