Programming Language and compiler
Benchmarks

Chapel VS Python benchmarks

Current benchmark data was generated on Mon May 19 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1208ms 7.9ms 96.1MB 1143ms 53ms pypy 3.10.16
chapel 4.chpl 1952ms 9.9ms 62.3MB 1943ms 3ms chpl 1.31.0
chapel 3.chpl 2127ms 36ms 62.3MB 2120ms 0ms chpl 1.31.0
python 1.py timeout 0.0ms 40.9MB 4963ms 20ms cpython 3.13.3
python 1.py timeout 0.0ms 40.5MB 4757ms 230ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 97ms 2.2ms 68.8MB 70ms 13ms pypy 3.10.16
chapel 4.chpl 184ms 1.8ms 30.3MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 186ms 1.6ms 32.3MB 183ms 0ms chpl 1.31.0
python 1.py 476ms 3.5ms 11.9MB 453ms 10ms pyston 3.8.12
python 1.py 736ms 14ms 12.8MB 723ms 0ms cpython 3.13.3

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1227ms 12ms 104.8MB 1183ms 33ms pypy 3.10.16
chapel 1-m.chpl 2280ms 43ms 659.8MB 4437ms 87ms chpl 1.31.0
python 1.py 2739ms 28ms 25.2MB 2720ms 7ms cpython 3.13.3
python 1.py timeout 0.0ms 17.4MB 4987ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 206ms 4.4ms 630.1MB 320ms 60ms chpl 1.31.0
python 1.py 230ms 1.7ms 84.9MB 190ms 27ms pypy 3.10.16
python 1.py 234ms 2.7ms 20.5MB 213ms 10ms cpython 3.13.3
python 1.py 662ms 11ms 16.8MB 647ms 0ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 71ms 1.6ms 32.5MB 70ms 0ms chpl 1.31.0
python 1.py 252ms 4.6ms 83.0MB 217ms 20ms pypy 3.10.16
python 1.py 361ms 2.9ms 12.7MB 347ms 0ms cpython 3.13.3
python 1.py 2016ms 25ms 9.6MB 2003ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 33ms 3.0ms 30.5MB 30ms 0ms chpl 1.31.0
python 1.py 101ms 1.7ms 63.6MB 73ms 13ms pypy 3.10.16
python 1.py 108ms 1.3ms 11.5MB 97ms 0ms cpython 3.13.3
python 1.py 348ms 1.4ms 8.8MB 340ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 105ms 0.9ms 28.4MB 190ms 0ms chpl 1.31.0
python 1.py 1852ms 2.6ms 88.9MB 1803ms 30ms pypy 3.10.16
python 5-m.py 2288ms 4.5ms 65.6MB 3530ms 820ms pypy 3.10.16
python 5-m.py 2438ms 9.1ms 12.5MB 3527ms 990ms pyston 3.8.12
python 1.py 3053ms 14ms 8.1MB 3040ms 0ms pyston 3.8.12
python 5-m.py 3439ms 104ms 13.9MB 4590ms 917ms cpython 3.13.3
python 1.py 4786ms 32ms 8.8MB 4770ms 0ms cpython 3.13.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 22ms 2.1ms 28.4MB 20ms 0ms chpl 1.31.0
python 1.py 249ms 3.9ms 63.3MB 223ms 13ms pypy 3.10.16
python 5-m.py 311ms 2.2ms 12.5MB 393ms 150ms pyston 3.8.12
python 1.py 314ms 3.8ms 8.1MB 300ms 0ms pyston 3.8.12
python 5-m.py 405ms 4.1ms 13.9MB 497ms 133ms cpython 3.13.3
python 5-m.py 442ms 3.9ms 65.6MB 733ms 303ms pypy 3.10.16
python 1.py 495ms 2.8ms 8.9MB 483ms 0ms cpython 3.13.3

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.3ms 28.8MB 0ms 0ms chpl 1.31.0
python 1.py 11ms 0.3ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 0.5ms 8.8MB 10ms 0ms cpython 3.13.3
python 1.py 29ms 1.2ms 51.7MB 10ms 10ms pypy 3.10.16

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 749ms 3.1ms 86.9MB 1420ms 7ms chpl 1.31.0
python 3-m.py 2430ms 39ms 136.4MB 8180ms 343ms pypy 3.10.16
python 3-m.py 3153ms 25ms 34.1MB 11980ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.4MB 97ms 20ms cpython 3.13.3

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 115ms 1.4ms 77.0MB 200ms 0ms chpl 1.31.0
python 3-m.py 387ms 3.7ms 76.5MB 987ms 163ms pypy 3.10.16
python 3-m.py 399ms 2.7ms 14.4MB 1320ms 70ms pyston 3.8.12
python 3-m.py 693ms 7.5ms 15.1MB 2423ms 70ms cpython 3.13.3

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 322ms 4.1ms 28.9MB 317ms 0ms chpl 1.31.0
python 2.py 1353ms 3.9ms 58.1MB 1330ms 10ms pypy 3.10.16
python 1.py 2669ms 18ms 57.1MB 2643ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.3
python 2.py timeout 0.0ms 8.9MB 4987ms 0ms cpython 3.13.3
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 45ms 0.3ms 28.9MB 40ms 0ms chpl 1.31.0
python 2.py 177ms 1.3ms 58.1MB 157ms 10ms pypy 3.10.16
python 1.py 305ms 3.3ms 57.0MB 280ms 10ms pypy 3.10.16
python 1.py 928ms 11ms 8.3MB 917ms 0ms pyston 3.8.12
python 2.py 1294ms 2.1ms 8.1MB 1280ms 0ms pyston 3.8.12
python 1.py 2942ms 8.2ms 8.8MB 2930ms 0ms cpython 3.13.3
python 2.py 3274ms 97ms 8.9MB 3263ms 0ms cpython 3.13.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 445ms 2.1ms 30.4MB 440ms 0ms chpl 1.31.0
python 4.py 1916ms 21ms 8.9MB 1867ms 33ms pyston 3.8.12
python 4.py 1987ms 11ms 9.4MB 1930ms 43ms cpython 3.13.3
python 4.py 2204ms 6.9ms 89.5MB 2160ms 30ms pypy 3.10.16

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 115ms 0.6ms 30.4MB 110ms 0ms chpl 1.31.0
python 4.py 454ms 4.5ms 8.6MB 443ms 0ms pyston 3.8.12
python 4.py 480ms 17ms 9.3MB 470ms 0ms cpython 3.13.3
python 4.py 559ms 7.0ms 83.9MB 527ms 20ms pypy 3.10.16

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1396ms 9.0ms 220.1MB 1353ms 37ms chpl 1.31.0
python 1.py 2256ms 13ms 242.7MB 2197ms 47ms pypy 3.10.16
python 1.py 4793ms 54ms 226.2MB 4607ms 173ms pyston 3.8.12
python 1.py timeout 0.0ms 149.2MB 4940ms 50ms cpython 3.13.3

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 163ms 2.2ms 48.9MB 140ms 13ms chpl 1.31.0
python 1.py 339ms 2.5ms 86.1MB 300ms 30ms pypy 3.10.16
python 1.py 497ms 0.1ms 30.5MB 460ms 20ms pyston 3.8.12
python 1.py 610ms 7.4ms 29.9MB 583ms 13ms cpython 3.13.3

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1184ms 16ms 29.1MB 1177ms 0ms chpl 1.31.0
python 1.py 3236ms 88ms 8.4MB 3220ms 0ms pyston 3.8.12
python 1.py 3528ms 9.8ms 74.5MB 3493ms 20ms pypy 3.10.16
python 1.py 3806ms 7.0ms 8.8MB 3793ms 0ms cpython 3.13.3

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 315ms 8.4ms 29.1MB 310ms 0ms chpl 1.31.0
python 1.py 800ms 6.2ms 8.3MB 790ms 0ms pyston 3.8.12
python 1.py 958ms 3.5ms 8.9MB 947ms 0ms cpython 3.13.3
python 1.py 986ms 1.3ms 67.4MB 957ms 20ms pypy 3.10.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1912ms 1.5ms 28.9MB 3800ms 0ms chpl 1.31.0
chapel 1.chpl 3730ms 9.2ms 28.8MB 3720ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.9MB 37ms 10ms cpython 3.13.3
python 8.py timeout 0.0ms 95.9MB 810ms 90ms pypy 3.10.16
python 8.py timeout 0.0ms 14.1MB 30ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 1.7ms 28.8MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 3.7ms 28.8MB 933ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.6MB 47ms 10ms cpython 3.13.3
python 8.py timeout 0.0ms 96.4MB 1343ms 187ms pypy 3.10.16
python 8.py timeout 0.0ms 13.6MB 57ms 10ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 0.9ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 249ms 2.0ms 28.8MB 243ms 0ms chpl 1.31.0
python 8-m.py 1983ms 24ms 93.1MB 6417ms 257ms pypy 3.10.16
python 8.py timeout 0.0ms 14.3MB 87ms 23ms cpython 3.13.3
python 8.py timeout 0.0ms 13.4MB 140ms 33ms pyston 3.8.12