Programming Language and compiler
Benchmarks

All Python benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 1197ms 3.3ms 96.2MB 1130ms 53ms pypy 3.10.16
1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.2
1.py timeout 0.0ms 40.5MB 4740ms 250ms pyston 3.8.12

Input: 15

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 97ms 2.2ms 68.7MB 67ms 17ms pypy 3.10.16
1.py 487ms 1.2ms 11.9MB 460ms 13ms pyston 3.8.12
1.py 726ms 15ms 12.6MB 713ms 0ms cpython 3.13.2

coro-prime-sieve

Input: 4000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 1280ms 15ms 107.2MB 1230ms 37ms pypy 3.10.16
1.py 2668ms 8.1ms 25.1MB 2643ms 10ms cpython 3.13.2
1.py timeout 0.0ms 17.4MB 4980ms 10ms pyston 3.8.12

Input: 1000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 221ms 0.4ms 86.7MB 183ms 23ms pypy 3.10.16
1.py 239ms 1.7ms 20.3MB 220ms 10ms cpython 3.13.2
1.py 663ms 2.7ms 16.8MB 637ms 10ms pyston 3.8.12

edigits

Input: 250001

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 252ms 2.8ms 83.3MB 213ms 27ms pypy 3.10.16
1.py 360ms 4.5ms 12.5MB 343ms 0ms cpython 3.13.2
1.py 2006ms 3.3ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 105ms 0.1ms 63.3MB 73ms 17ms pypy 3.10.16
1.py 125ms 28ms 12.3MB 100ms 0ms cpython 3.13.2
1.py 349ms 1.6ms 8.8MB 337ms 0ms pyston 3.8.12

fasta

Input: 2500000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 1866ms 18ms 88.8MB 1820ms 33ms pypy 3.10.16
5-m.py 2278ms 15ms 65.4MB 3513ms 857ms pypy 3.10.16
5-m.py 2482ms 19ms 12.5MB 3550ms 1030ms pyston 3.8.12
1.py 3030ms 3.8ms 8.1MB 3020ms 0ms pyston 3.8.12
5-m.py 3399ms 44ms 13.5MB 4503ms 963ms cpython 3.13.2
1.py 4712ms 79ms 8.8MB 4703ms 0ms cpython 3.13.2

Input: 250000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 249ms 2.9ms 63.3MB 220ms 13ms pypy 3.10.16
1.py 317ms 7.5ms 8.1MB 303ms 0ms pyston 3.8.12
5-m.py 321ms 4.6ms 12.5MB 420ms 147ms pyston 3.8.12
5-m.py 405ms 4.6ms 13.5MB 490ms 133ms cpython 3.13.2
5-m.py 450ms 2.3ms 65.4MB 730ms 327ms pypy 3.10.16
1.py 484ms 3.0ms 8.8MB 473ms 0ms cpython 3.13.2

helloworld

Input: QwQ

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 12ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
1.py 14ms 1.2ms 8.6MB 10ms 0ms cpython 3.13.2
1.py 30ms 1.2ms 51.4MB 10ms 10ms pypy 3.10.16

http-server

Input: 3000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 2282ms 194ms 26.9MB 1117ms 1593ms pyston 3.8.12
1.py 2580ms 481ms 27.6MB 1630ms 1610ms cpython 3.13.2
1.py 4863ms 221ms 103.4MB 2960ms 1227ms pypy 3.10.16

Input: 500

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 1083ms 4.6ms 21.3MB 230ms 290ms pyston 3.8.12
1.py 1174ms 104ms 22.5MB 320ms 273ms cpython 3.13.2
1.py 1547ms 248ms 85.3MB 713ms 237ms pypy 3.10.16

json-serde

Input: sample 5000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 202ms 1.8ms 38.2MB 167ms 23ms pyston 3.8.12
1.py 219ms 2.8ms 38.6MB 193ms 13ms cpython 3.13.2
1.py 302ms 5.9ms 89.6MB 263ms 27ms pypy 3.10.16

Input: canada 15

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 1859ms 6.2ms 220.5MB 1687ms 153ms pyston 3.8.12
1.py 1921ms 20ms 222.2MB 1843ms 63ms pypy 3.10.16
1.py 1947ms 15ms 221.4MB 1850ms 83ms cpython 3.13.2

knucleotide

Input: 2500000_in

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
3-m.py 2464ms 33ms 136.4MB 8333ms 327ms pypy 3.10.16
3-m.py 3223ms 25ms 34.3MB 12263ms 117ms pyston 3.8.12
3.py timeout 0.0ms 35.6MB 87ms 23ms cpython 3.13.2

Input: 250000_in

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
3-m.py 392ms 2.5ms 76.3MB 1003ms 160ms pypy 3.10.16
3-m.py 406ms 1.5ms 14.3MB 1347ms 70ms pyston 3.8.12
3-m.py 659ms 5.8ms 15.1MB 2317ms 63ms cpython 3.13.2

lru

Input: 1000 1000000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
2.py 147ms 1.7ms 58.3MB 127ms 10ms pypy 3.10.16
1.py 184ms 4.8ms 59.3MB 160ms 10ms pypy 3.10.16
1.py 721ms 2.1ms 8.9MB 707ms 0ms pyston 3.8.12
2.py 846ms 12ms 8.5MB 837ms 0ms pyston 3.8.12
1.py 1125ms 14ms 9.3MB 1113ms 0ms cpython 3.13.2
2.py 1331ms 3.3ms 9.0MB 1320ms 0ms cpython 3.13.2

Input: 1000 3000000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
2.py 345ms 4.6ms 59.2MB 320ms 10ms pypy 3.10.16
1.py 383ms 1.7ms 60.3MB 360ms 10ms pypy 3.10.16
1.py 2123ms 11ms 8.9MB 2107ms 0ms pyston 3.8.12
2.py 2478ms 14ms 8.5MB 2463ms 0ms pyston 3.8.12
1.py 3384ms 51ms 9.3MB 3370ms 0ms cpython 3.13.2
2.py 4191ms 262ms 9.0MB 4180ms 0ms cpython 3.13.2

Input: 100 500000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
2.py 108ms 2.1ms 57.9MB 83ms 10ms pypy 3.10.16
1.py 124ms 2.8ms 58.7MB 97ms 13ms pypy 3.10.16
1.py 350ms 0.8ms 8.5MB 337ms 0ms pyston 3.8.12
2.py 388ms 2.7ms 8.1MB 380ms 0ms pyston 3.8.12
1.py 535ms 0.5ms 9.0MB 520ms 0ms cpython 3.13.2
2.py 638ms 8.7ms 8.6MB 623ms 0ms cpython 3.13.2

merkletrees

Input: 17

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 2242ms 13ms 202.7MB 2123ms 100ms pypy 3.10.16
1.py timeout 0.0ms 93.6MB 4953ms 30ms cpython 3.13.2
1.py timeout 0.0ms 130.4MB 4930ms 53ms pyston 3.8.12

Input: 15

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 384ms 3.7ms 105.2MB 320ms 47ms pypy 3.10.16
1.py 3229ms 20ms 37.2MB 3203ms 13ms cpython 3.13.2
1.py timeout 0.0ms 48.4MB 4963ms 23ms pyston 3.8.12

nbody

Input: 5000000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
2.py 1357ms 7.5ms 57.9MB 1330ms 10ms pypy 3.10.16
1.py 2662ms 11ms 57.2MB 2640ms 10ms pypy 3.10.16
1.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
2.py 179ms 2.5ms 57.9MB 157ms 10ms pypy 3.10.16
1.py 310ms 12ms 57.0MB 287ms 10ms pypy 3.10.16
1.py 934ms 14ms 8.3MB 920ms 0ms pyston 3.8.12
2.py 1326ms 45ms 8.1MB 1313ms 0ms pyston 3.8.12
1.py 3035ms 123ms 8.6MB 3020ms 0ms cpython 3.13.2
2.py 3207ms 87ms 8.8MB 3197ms 0ms cpython 3.13.2

nsieve

Input: 12

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 2644ms 5.0ms 369.5MB 2577ms 57ms pypy 3.10.16
2.py 3165ms 30ms 633.0MB 2990ms 157ms pyston 3.8.12
1.py timeout 0.0ms 321.1MB 4960ms 30ms cpython 3.13.2
2.py timeout 0.0ms 633.6MB 4830ms 153ms cpython 3.13.2
2.py timeout 0.0ms 959.7MB 4717ms 270ms pypy 3.10.16
1.py timeout 0.0ms 320.4MB 4933ms 50ms pyston 3.8.12

Input: 10

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 554ms 4.7ms 135.2MB 517ms 23ms pypy 3.10.16
2.py 754ms 4.9ms 164.2MB 710ms 27ms pyston 3.8.12
1.py 1144ms 17ms 86.0MB 1117ms 10ms pyston 3.8.12
2.py 1460ms 5.5ms 164.8MB 1417ms 30ms cpython 3.13.2
2.py 1589ms 53ms 290.2MB 1500ms 77ms pypy 3.10.16
1.py 2736ms 37ms 86.8MB 2710ms 10ms cpython 3.13.2

pidigits

Input: 8000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
4.py 1912ms 9.2ms 8.9MB 1870ms 27ms pyston 3.8.12
4.py 1956ms 14ms 9.3MB 1890ms 47ms cpython 3.13.2
4.py 2197ms 12ms 89.4MB 2153ms 30ms pypy 3.10.16

Input: 4000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
4.py 453ms 3.4ms 8.6MB 443ms 0ms pyston 3.8.12
4.py 463ms 0.7ms 9.1MB 450ms 0ms cpython 3.13.2
4.py 551ms 4.4ms 83.8MB 517ms 20ms pypy 3.10.16

regex-redux

Input: 2500000_in

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 2254ms 9.7ms 243.7MB 2197ms 43ms pypy 3.10.16
1.py 4766ms 18ms 268.3MB 4583ms 167ms pyston 3.8.12
1.py timeout 0.0ms 144.0MB 4937ms 47ms cpython 3.13.2

Input: 250000_in

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 331ms 4.0ms 85.9MB 290ms 27ms pypy 3.10.16
1.py 498ms 3.7ms 36.1MB 467ms 20ms pyston 3.8.12
1.py 611ms 4.7ms 31.0MB 580ms 13ms cpython 3.13.2

secp256k1

Input: 2000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 3166ms 15ms 8.3MB 3153ms 0ms pyston 3.8.12
1.py 3558ms 6.3ms 74.3MB 3520ms 20ms pypy 3.10.16
1.py 3834ms 38ms 8.6MB 3823ms 0ms cpython 3.13.2

Input: 500

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
1.py 806ms 3.4ms 8.3MB 793ms 0ms pyston 3.8.12
1.py 971ms 7.2ms 8.6MB 960ms 0ms cpython 3.13.2
1.py 996ms 9.3ms 67.4MB 967ms 13ms pypy 3.10.16

spectral-norm

Input: 8000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
8.py timeout 0.0ms 14.8MB 30ms 10ms cpython 3.13.2
8.py timeout 0.0ms 95.8MB 803ms 87ms pypy 3.10.16
8.py timeout 0.0ms 14.2MB 40ms 10ms pyston 3.8.12

Input: 4000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
8.py timeout 0.0ms 14.3MB 47ms 13ms cpython 3.13.2
8.py timeout 0.0ms 96.3MB 1323ms 190ms pypy 3.10.16
8.py timeout 0.0ms 13.6MB 63ms 20ms pyston 3.8.12

Input: 2000

code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
8-m.py 1978ms 5.9ms 93.1MB 6363ms 257ms pypy 3.10.16
8.py timeout 0.0ms 14.0MB 90ms 17ms cpython 3.13.2
8.py timeout 0.0ms 13.2MB 130ms 40ms pyston 3.8.12