Programming Language and compiler
Benchmarks

Python VS Chapel benchmarks

Current benchmark data was generated on Tue Jul 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1158ms 1.0ms 96.1MB 1093ms 53ms pypy 3.10.16
chapel 4.chpl 1970ms 8.4ms 62.3MB 1960ms 3ms chpl 1.31.0
chapel 3.chpl 2062ms 35ms 62.3MB 2057ms 0ms chpl 1.31.0
python 1.py timeout 0.0ms 41.0MB 4963ms 17ms cpython 3.13.5
python 1.py timeout 0.0ms 40.5MB 4753ms 233ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 93ms 0.2ms 68.8MB 67ms 17ms pypy 3.10.16
chapel 3.chpl 188ms 2.0ms 32.3MB 180ms 0ms chpl 1.31.0
chapel 4.chpl 196ms 20ms 32.3MB 190ms 0ms chpl 1.31.0
python 1.py 477ms 1.2ms 11.9MB 453ms 13ms pyston 3.8.12
python 1.py 718ms 3.5ms 13.0MB 707ms 0ms cpython 3.13.5

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1210ms 16ms 106.4MB 1167ms 30ms pypy 3.10.16
chapel 1-m.chpl 2288ms 97ms 769.4MB 4450ms 97ms chpl 1.31.0
python 1.py 2689ms 24ms 25.4MB 2667ms 10ms cpython 3.13.5
python 1.py timeout 0.0ms 17.4MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 211ms 14ms 725.6MB 333ms 60ms chpl 1.31.0
python 1.py 220ms 5.3ms 84.7MB 183ms 27ms pypy 3.10.16
python 1.py 237ms 8.3ms 20.6MB 217ms 3ms cpython 3.13.5
python 1.py 648ms 13ms 16.8MB 633ms 0ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 72ms 0.4ms 32.5MB 70ms 0ms chpl 1.31.0
python 1.py 252ms 1.9ms 83.5MB 217ms 20ms pypy 3.10.16
python 1.py 363ms 0.9ms 12.6MB 347ms 0ms cpython 3.13.5
python 1.py 2004ms 1.1ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 0.6ms 30.5MB 30ms 0ms chpl 1.31.0
python 1.py 102ms 2.6ms 63.7MB 77ms 13ms pypy 3.10.16
python 1.py 110ms 2.3ms 11.6MB 97ms 0ms cpython 3.13.5
python 1.py 352ms 0.5ms 8.8MB 340ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 108ms 3.0ms 28.4MB 193ms 0ms chpl 1.31.0
python 1.py 1857ms 11ms 88.9MB 1810ms 30ms pypy 3.10.16
python 5-m.py 2292ms 35ms 65.6MB 3537ms 850ms pypy 3.10.16
python 5-m.py 2462ms 20ms 12.5MB 3543ms 983ms pyston 3.8.12
python 1.py 3024ms 23ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3410ms 32ms 13.8MB 4480ms 947ms cpython 3.13.5
python 1.py 4667ms 43ms 9.0MB 4653ms 0ms cpython 3.13.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.4ms 28.4MB 20ms 0ms chpl 1.31.0
python 1.py 250ms 0.9ms 63.4MB 220ms 10ms pypy 3.10.16
python 5-m.py 315ms 11ms 12.5MB 390ms 157ms pyston 3.8.12
python 1.py 315ms 4.7ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 407ms 7.3ms 13.8MB 483ms 143ms cpython 3.13.5
python 5-m.py 446ms 3.8ms 65.6MB 753ms 297ms pypy 3.10.16
python 1.py 484ms 2.4ms 9.0MB 470ms 0ms cpython 3.13.5

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 11ms 0.4ms 28.8MB 0ms 0ms chpl 1.31.0
python 1.py 12ms 0.7ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 1.2ms 8.8MB 10ms 0ms cpython 3.13.5
python 1.py 30ms 0.9ms 51.7MB 6ms 12ms pypy 3.10.16

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2218ms 72ms 26.8MB 1067ms 1437ms pyston 3.8.12
python 1.py 2622ms 127ms 27.8MB 1607ms 1473ms cpython 3.13.5
python 1.py 4714ms 36ms 102.6MB 2843ms 1093ms pypy 3.10.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1123ms 32ms 21.1MB 223ms 260ms pyston 3.8.12
python 1.py 1195ms 33ms 22.9MB 317ms 260ms cpython 3.13.5
python 1.py 1607ms 143ms 85.9MB 690ms 207ms pypy 3.10.16

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 200ms 1.3ms 38.1MB 163ms 23ms pyston 3.8.12
python 1.py 222ms 2.1ms 38.6MB 193ms 17ms cpython 3.13.5
python 1.py 302ms 3.5ms 88.8MB 263ms 27ms pypy 3.10.16

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1850ms 9.9ms 220.5MB 1673ms 163ms pyston 3.8.12
python 1.py 1927ms 3.4ms 222.0MB 1820ms 93ms cpython 3.13.5
python 1.py 1928ms 14ms 222.7MB 1847ms 67ms pypy 3.10.16

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 789ms 57ms 87.0MB 1463ms 7ms chpl 1.31.0
python 3-m.py 2412ms 51ms 136.6MB 8240ms 337ms pypy 3.10.16
python 3-m.py 3142ms 31ms 34.2MB 11930ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.8MB 93ms 20ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 114ms 0.4ms 76.9MB 200ms 3ms chpl 1.31.0
python 3-m.py 385ms 6.3ms 75.8MB 977ms 150ms pypy 3.10.16
python 3-m.py 401ms 5.6ms 14.3MB 1327ms 67ms pyston 3.8.12
python 3-m.py 687ms 8.0ms 15.2MB 2437ms 67ms cpython 3.13.5

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 147ms 1.1ms 58.3MB 120ms 10ms pypy 3.10.16
python 1.py 178ms 1.7ms 59.4MB 153ms 10ms pypy 3.10.16
python 1.py 730ms 8.0ms 8.9MB 720ms 0ms pyston 3.8.12
python 2.py 850ms 11ms 8.5MB 840ms 0ms pyston 3.8.12
python 1.py 1141ms 7.1ms 9.5MB 1133ms 0ms cpython 3.13.5
python 2.py 1304ms 8.0ms 9.3MB 1290ms 0ms cpython 3.13.5

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 339ms 1.2ms 60.5MB 317ms 10ms pypy 3.10.16
python 1.py 380ms 4.2ms 60.3MB 357ms 10ms pypy 3.10.16
python 1.py 2148ms 10ms 8.9MB 2137ms 0ms pyston 3.8.12
python 2.py 2496ms 44ms 8.5MB 2483ms 0ms pyston 3.8.12
python 1.py 3362ms 46ms 9.5MB 3350ms 0ms cpython 3.13.5
python 2.py 3908ms 18ms 9.3MB 3897ms 0ms cpython 3.13.5

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 107ms 3.6ms 58.2MB 80ms 10ms pypy 3.10.16
python 1.py 122ms 3.9ms 58.8MB 97ms 10ms pypy 3.10.16
python 1.py 355ms 5.9ms 8.5MB 343ms 0ms pyston 3.8.12
python 2.py 385ms 2.9ms 8.1MB 373ms 0ms pyston 3.8.12
python 1.py 537ms 11ms 9.3MB 527ms 0ms cpython 3.13.5
python 2.py 628ms 9.6ms 8.9MB 617ms 0ms cpython 3.13.5

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2196ms 9.7ms 202.5MB 2077ms 100ms pypy 3.10.16
python 1.py timeout 0.0ms 94.1MB 4960ms 27ms cpython 3.13.5
python 1.py timeout 0.0ms 130.3MB 4930ms 57ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 385ms 4.5ms 104.7MB 323ms 50ms pypy 3.10.16
python 1.py 3347ms 32ms 37.4MB 3317ms 13ms cpython 3.13.5
python 1.py timeout 0.0ms 48.9MB 4953ms 37ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 320ms 1.9ms 28.8MB 317ms 0ms chpl 1.31.0
python 2.py 1358ms 8.1ms 58.1MB 1333ms 10ms pypy 3.10.16
python 1.py 2644ms 7.4ms 57.0MB 2620ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.5
python 2.py timeout 0.0ms 9.0MB 4990ms 0ms cpython 3.13.5
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 48ms 4.7ms 28.8MB 43ms 0ms chpl 1.31.0
python 2.py 182ms 1.2ms 57.9MB 160ms 10ms pypy 3.10.16
python 1.py 304ms 1.2ms 57.1MB 280ms 10ms pypy 3.10.16
python 1.py 921ms 6.9ms 8.4MB 910ms 0ms pyston 3.8.12
python 2.py 1314ms 5.3ms 8.3MB 1300ms 0ms pyston 3.8.12
python 2.py 2943ms 21ms 9.0MB 2930ms 0ms cpython 3.13.5
python 1.py 3003ms 91ms 9.0MB 2990ms 0ms cpython 3.13.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2563ms 130ms 369.7MB 2490ms 57ms pypy 3.10.16
python 2.py 2996ms 31ms 632.9MB 2817ms 167ms pyston 3.8.12
python 1.py 4717ms 60ms 320.4MB 4660ms 40ms pyston 3.8.12
python 1.py timeout 0.0ms 321.4MB 4967ms 23ms cpython 3.13.5
python 2.py timeout 0.0ms 633.8MB 4823ms 157ms cpython 3.13.5
python 2.py timeout 0.0ms 959.9MB 4717ms 263ms pypy 3.10.16

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 547ms 6.2ms 135.3MB 507ms 23ms pypy 3.10.16
python 2.py 723ms 2.9ms 164.2MB 683ms 27ms pyston 3.8.12
python 1.py 1065ms 10ms 86.0MB 1040ms 10ms pyston 3.8.12
python 2.py 1383ms 0.6ms 165.1MB 1343ms 27ms cpython 3.13.5
python 2.py 1508ms 4.4ms 290.3MB 1420ms 73ms pypy 3.10.16
python 1.py 2870ms 13ms 87.0MB 2847ms 10ms cpython 3.13.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 448ms 1.5ms 30.3MB 443ms 0ms chpl 1.31.0
python 4.py 1929ms 6.9ms 8.9MB 1887ms 30ms pyston 3.8.12
python 4.py 1980ms 20ms 9.5MB 1927ms 43ms cpython 3.13.5
python 4.py 2185ms 3.8ms 89.6MB 2150ms 20ms pypy 3.10.16

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 113ms 1.0ms 30.4MB 110ms 0ms chpl 1.31.0
python 4.py 462ms 1.2ms 8.6MB 450ms 0ms pyston 3.8.12
python 4.py 480ms 6.7ms 9.4MB 470ms 0ms cpython 3.13.5
python 4.py 553ms 3.7ms 83.9MB 513ms 23ms pypy 3.10.16

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1397ms 5.8ms 246.1MB 1347ms 40ms chpl 1.31.0
python 1.py 2263ms 15ms 243.6MB 2203ms 47ms pypy 3.10.16
python 1.py 4758ms 1.8ms 252.5MB 4570ms 170ms pyston 3.8.12
python 1.py timeout 0.0ms 130.2MB 4930ms 60ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 160ms 1.0ms 48.9MB 147ms 10ms chpl 1.31.0
python 1.py 331ms 3.3ms 85.1MB 290ms 30ms pypy 3.10.16
python 1.py 510ms 17ms 30.3MB 477ms 20ms pyston 3.8.12
python 1.py 622ms 9.0ms 30.0MB 590ms 17ms cpython 3.13.5

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1189ms 8.0ms 29.1MB 1180ms 0ms chpl 1.31.0
python 1.py 3168ms 17ms 8.4MB 3157ms 0ms pyston 3.8.12
python 1.py 3522ms 17ms 74.4MB 3483ms 23ms pypy 3.10.16
python 1.py 3760ms 8.9ms 8.9MB 3753ms 0ms cpython 3.13.5

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 310ms 1.9ms 29.2MB 303ms 0ms chpl 1.31.0
python 1.py 800ms 1.8ms 8.4MB 790ms 0ms pyston 3.8.12
python 1.py 949ms 2.1ms 8.9MB 937ms 0ms cpython 3.13.5
python 1.py 990ms 5.3ms 67.4MB 963ms 13ms pypy 3.10.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1930ms 12ms 28.9MB 3833ms 0ms chpl 1.31.0
chapel 1.chpl 3728ms 14ms 28.8MB 3723ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.8MB 33ms 10ms cpython 3.13.5
python 8.py timeout 0.0ms 95.9MB 787ms 80ms pypy 3.10.16
python 8.py timeout 0.0ms 14.4MB 33ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 495ms 2.2ms 28.9MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 941ms 4.2ms 28.8MB 937ms 0ms chpl 1.31.0
python 8.py timeout 0.0ms 14.5MB 47ms 13ms cpython 3.13.5
python 8.py timeout 0.0ms 95.6MB 1280ms 180ms pypy 3.10.16
python 8.py timeout 0.0ms 13.6MB 60ms 13ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 0.7ms 29.0MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 0.8ms 28.8MB 240ms 0ms chpl 1.31.0
python 8-m.py 1948ms 18ms 92.9MB 6303ms 253ms pypy 3.10.16
python 8.py timeout 0.0ms 14.3MB 80ms 20ms cpython 3.13.5
python 8.py timeout 0.0ms 13.1MB 150ms 30ms pyston 3.8.12