Programming Language and compiler
Benchmarks

Python VS Crystal benchmarks

Current benchmark data was generated on Fri Aug 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1165ms 6.5ms 96.8MB 1107ms 47ms pypy 3.11.13
crystal 1.cr 1231ms 8.3ms 64.2MB 1203ms 10ms crystal 1.17.0
python 1.py timeout 0.0ms 41.0MB 4967ms 23ms cpython 3.13.5
python 1.py timeout 0.0ms 40.5MB 4733ms 253ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 95ms 3.5ms 68.3MB 63ms 17ms pypy 3.11.13
crystal 1.cr 104ms 1.6ms 11.0MB 90ms 0ms crystal 1.17.0
python 1.py 492ms 6.9ms 11.9MB 470ms 10ms pyston 3.8.12
python 1.py 734ms 16ms 12.9MB 723ms 0ms cpython 3.13.5

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1207ms 3.1ms 105.2MB 1160ms 37ms pypy 3.11.13
crystal 1.cr 1489ms 15ms 19.9MB 1420ms 57ms crystal 1.17.0
python 1.py 2664ms 14ms 25.4MB 2643ms 10ms cpython 3.13.5
python 1.py timeout 0.0ms 17.3MB 4980ms 3ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 82ms 4.6ms 7.1MB 57ms 10ms crystal 1.17.0
python 1.py 223ms 2.8ms 85.4MB 183ms 23ms pypy 3.11.13
python 1.py 230ms 0.7ms 20.6MB 210ms 3ms cpython 3.13.5
python 1.py 692ms 7.5ms 16.8MB 673ms 3ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 57ms 1.8ms 6.5MB 40ms 3ms crystal 1.17.0
python 1.py 264ms 5.4ms 84.7MB 227ms 23ms pypy 3.11.13
python 1.py 363ms 1.6ms 12.6MB 347ms 3ms cpython 3.13.5
python 1.py 2009ms 3.5ms 9.6MB 1997ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 22ms 1.7ms 5.3MB 10ms 0ms crystal 1.17.0
python 1.py 106ms 0.4ms 65.4MB 80ms 10ms pypy 3.11.13
python 1.py 107ms 1.1ms 11.8MB 93ms 0ms cpython 3.13.5
python 1.py 348ms 1.8ms 8.8MB 333ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 540ms 2.0ms 3.6MB 450ms 77ms crystal 1.17.0
crystal 1.cr 681ms 2.0ms 14.6MB 570ms 97ms crystal 1.17.0
python 1.py 2215ms 30ms 89.2MB 2163ms 33ms pypy 3.11.13
python 5-m.py 2319ms 16ms 66.2MB 3547ms 837ms pypy 3.11.13
python 5-m.py 2445ms 19ms 12.5MB 3547ms 983ms pyston 3.8.12
python 1.py 3020ms 14ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3347ms 16ms 13.8MB 4410ms 927ms cpython 3.13.5
python 1.py 4661ms 7.5ms 9.0MB 4647ms 0ms cpython 3.13.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 57ms 0.8ms 3.6MB 40ms 0ms crystal 1.17.0
crystal 1.cr 72ms 0.8ms 4.4MB 53ms 7ms crystal 1.17.0
python 1.py 279ms 1.4ms 63.5MB 250ms 10ms pypy 3.11.13
python 5-m.py 310ms 1.1ms 12.5MB 393ms 143ms pyston 3.8.12
python 1.py 313ms 2.4ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 394ms 3.6ms 13.8MB 473ms 127ms cpython 3.13.5
python 5-m.py 448ms 1.8ms 66.2MB 763ms 273ms pypy 3.11.13
python 1.py 491ms 9.3ms 8.9MB 480ms 0ms cpython 3.13.5

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.1ms 2.9MB 0ms 0ms crystal 1.17.0
python 1.py 11ms 0.9ms 7.8MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 0.8ms 8.8MB 0ms 0ms cpython 3.13.5
python 1.py 29ms 0.8ms 52.2MB 10ms 10ms pypy 3.11.13

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1962ms 442ms 300.0MB 300ms 437ms crystal 1.17.0
python 1.py 2261ms 207ms 26.4MB 1067ms 1463ms pyston 3.8.12
python 1.py 2324ms 148ms 27.6MB 1560ms 1477ms cpython 3.13.5
python 1.py 4664ms 163ms 103.1MB 3057ms 1103ms pypy 3.11.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1128ms 37ms 21.4MB 243ms 243ms pyston 3.8.12
python 1.py 1182ms 83ms 22.8MB 307ms 267ms cpython 3.13.5
crystal 1.cr 1239ms 102ms 53.0MB 27ms 77ms crystal 1.17.0
python 1.py 1817ms 105ms 87.1MB 737ms 220ms pypy 3.11.13

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 203ms 4.0ms 38.1MB 163ms 27ms pyston 3.8.12
python 1.py 217ms 2.8ms 38.5MB 190ms 13ms cpython 3.13.5
python 1.py 452ms 7.1ms 109.3MB 397ms 43ms pypy 3.11.13

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1851ms 3.5ms 220.5MB 1680ms 157ms pyston 3.8.12
python 1.py 1926ms 13ms 222.0MB 1827ms 90ms cpython 3.13.5
python 1.py 3254ms 25ms 365.0MB 3087ms 150ms pypy 3.11.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 2327ms 11ms 142.4MB 7870ms 307ms pypy 3.11.13
python 3-m.py 3105ms 7.2ms 34.0MB 11830ms 113ms pyston 3.8.12
python 3.py timeout 0.0ms 35.8MB 90ms 13ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 380ms 3.0ms 77.0MB 967ms 143ms pypy 3.11.13
python 3-m.py 398ms 5.7ms 14.2MB 1317ms 70ms pyston 3.8.12
python 3-m.py 657ms 3.2ms 15.3MB 2323ms 67ms cpython 3.13.5

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 0.9ms 3.0MB 30ms 0ms crystal 1.17.0
crystal 1.cr 70ms 1.9ms 3.0MB 60ms 0ms crystal 1.17.0
python 2.py 148ms 2.3ms 58.9MB 123ms 7ms pypy 3.11.13
python 1.py 187ms 5.0ms 59.8MB 163ms 10ms pypy 3.11.13
python 1.py 734ms 3.0ms 8.9MB 717ms 0ms pyston 3.8.12
python 2.py 857ms 2.7ms 8.5MB 847ms 0ms pyston 3.8.12
python 1.py 1149ms 2.1ms 9.5MB 1140ms 0ms cpython 3.13.5
python 2.py 1312ms 22ms 9.3MB 1300ms 0ms cpython 3.13.5

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 105ms 1.9ms 3.0MB 97ms 0ms crystal 1.17.0
crystal 1.cr 201ms 2.2ms 3.0MB 190ms 0ms crystal 1.17.0
python 2.py 349ms 5.1ms 59.7MB 320ms 13ms pypy 3.11.13
python 1.py 399ms 2.9ms 60.7MB 373ms 10ms pypy 3.11.13
python 1.py 2181ms 1.1ms 8.9MB 2170ms 0ms pyston 3.8.12
python 2.py 2527ms 6.0ms 8.5MB 2513ms 0ms pyston 3.8.12
python 1.py 3381ms 12ms 9.5MB 3373ms 0ms cpython 3.13.5
python 2.py 3934ms 57ms 9.3MB 3923ms 0ms cpython 3.13.5

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 19ms 1.2ms 3.0MB 10ms 0ms crystal 1.17.0
crystal 1.cr 33ms 1.2ms 3.0MB 20ms 0ms crystal 1.17.0
python 2.py 106ms 3.8ms 58.1MB 83ms 10ms pypy 3.11.13
python 1.py 122ms 3.9ms 59.3MB 103ms 10ms pypy 3.11.13
python 1.py 357ms 3.8ms 8.5MB 347ms 0ms pyston 3.8.12
python 2.py 391ms 3.4ms 8.1MB 383ms 0ms pyston 3.8.12
python 1.py 540ms 3.8ms 9.3MB 527ms 0ms cpython 3.13.5
python 2.py 631ms 12ms 8.9MB 620ms 0ms cpython 3.13.5

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 838ms 12ms 64.2MB 820ms 7ms crystal 1.17.0
python 1.py 2182ms 14ms 204.7MB 2060ms 107ms pypy 3.11.13
python 1.py timeout 0.0ms 94.1MB 4957ms 33ms cpython 3.13.5
python 1.py timeout 0.0ms 130.4MB 4937ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 177ms 4.2ms 22.3MB 160ms 0ms crystal 1.17.0
python 1.py 375ms 1.4ms 105.3MB 317ms 43ms pypy 3.11.13
python 1.py 3001ms 36ms 37.4MB 2973ms 13ms cpython 3.13.5
python 1.py timeout 0.0ms 48.9MB 4940ms 47ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 345ms 2.9ms 3.4MB 337ms 0ms crystal 1.17.0
crystal 1.cr 346ms 3.1ms 3.4MB 337ms 0ms crystal 1.17.0
python 2.py 1342ms 2.7ms 60.5MB 1317ms 13ms pypy 3.11.13
python 1.py 2650ms 17ms 57.8MB 2627ms 10ms pypy 3.11.13
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.5
python 2.py timeout 0.0ms 9.0MB 4990ms 0ms cpython 3.13.5
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.5ms 3.4MB 30ms 0ms crystal 1.17.0
crystal 1.cr 39ms 0.1ms 3.4MB 30ms 0ms crystal 1.17.0
python 2.py 176ms 4.7ms 58.5MB 153ms 10ms pypy 3.11.13
python 1.py 305ms 1.6ms 57.8MB 283ms 7ms pypy 3.11.13
python 1.py 940ms 29ms 8.3MB 927ms 0ms pyston 3.8.12
python 2.py 1345ms 52ms 8.1MB 1330ms 0ms pyston 3.8.12
python 1.py 2971ms 99ms 8.9MB 2960ms 0ms cpython 3.13.5
python 2.py 2989ms 51ms 9.0MB 2977ms 0ms cpython 3.13.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 301ms 3.1ms 8.3MB 290ms 0ms crystal 1.17.0
crystal 1.cr 420ms 4.6ms 43.0MB 403ms 0ms crystal 1.17.0
python 1.py 2403ms 56ms 369.9MB 2330ms 57ms pypy 3.11.13
python 2.py 2979ms 17ms 633.0MB 2793ms 170ms pyston 3.8.12
python 1.py 4806ms 156ms 320.4MB 4743ms 47ms pyston 3.8.12
python 1.py timeout 0.0ms 321.4MB 4960ms 20ms cpython 3.13.5
python 2.py timeout 0.0ms 633.8MB 4827ms 160ms cpython 3.13.5
python 2.py timeout 0.0ms 1017.7MB 4707ms 280ms pypy 3.11.13

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 74ms 0.2ms 4.5MB 70ms 0ms crystal 1.17.0
crystal 1.cr 89ms 0.6ms 13.2MB 80ms 0ms crystal 1.17.0
python 1.py 503ms 12ms 135.7MB 463ms 23ms pypy 3.11.13
python 2.py 726ms 6.1ms 164.2MB 683ms 30ms pyston 3.8.12
python 1.py 1068ms 11ms 86.0MB 1040ms 10ms pyston 3.8.12
python 2.py 1370ms 7.2ms 165.1MB 1327ms 30ms cpython 3.13.5
python 2.py 1392ms 15ms 290.8MB 1303ms 73ms pypy 3.11.13
python 1.py 2819ms 6.7ms 87.0MB 2793ms 10ms cpython 3.13.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1924ms 4.4ms 8.9MB 1873ms 37ms pyston 3.8.12
python 4.py 1956ms 1.7ms 9.5MB 1913ms 33ms cpython 3.13.5
crystal 1.cr 1960ms 30ms 6.3MB 1927ms 17ms crystal 1.17.0
python 4.py 2159ms 6.6ms 89.6MB 2120ms 30ms pypy 3.11.13

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 438ms 11ms 5.0MB 430ms 0ms crystal 1.17.0
python 4.py 453ms 2.0ms 8.6MB 440ms 0ms pyston 3.8.12
python 4.py 468ms 3.7ms 9.4MB 457ms 0ms cpython 3.13.5
python 4.py 549ms 3.2ms 83.6MB 510ms 27ms pypy 3.11.13

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2244ms 7.2ms 245.8MB 2183ms 43ms pypy 3.11.13
python 1.py 4754ms 9.8ms 226.2MB 4570ms 170ms pyston 3.8.12
python 1.py timeout 0.0ms 137.9MB 4930ms 53ms cpython 3.13.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 333ms 7.5ms 87.3MB 290ms 30ms pypy 3.11.13
python 1.py 497ms 1.8ms 30.3MB 463ms 20ms pyston 3.8.12
python 1.py 617ms 0.3ms 30.0MB 587ms 17ms cpython 3.13.5

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3157ms 7.5ms 8.4MB 3143ms 0ms pyston 3.8.12
python 1.py 3590ms 17ms 75.7MB 3557ms 23ms pypy 3.11.13
python 1.py 3831ms 12ms 8.9MB 3817ms 0ms cpython 3.13.5

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 800ms 1.0ms 8.3MB 790ms 0ms pyston 3.8.12
python 1.py 955ms 9.6ms 8.9MB 943ms 0ms cpython 3.13.5
python 1.py 1001ms 6.1ms 68.6MB 973ms 13ms pypy 3.11.13

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3758ms 11ms 4.5MB 3750ms 0ms crystal 1.17.0
python 8.py timeout 0.0ms 14.8MB 40ms 10ms cpython 3.13.5
python 8.py timeout 0.0ms 94.2MB 653ms 73ms pypy 3.11.13
python 8.py timeout 0.0ms 14.3MB 40ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 941ms 1.2ms 4.5MB 930ms 0ms crystal 1.17.0
python 8.py timeout 0.0ms 14.4MB 50ms 7ms cpython 3.13.5
python 8.py timeout 0.0ms 96.2MB 1180ms 140ms pypy 3.11.13
python 8.py timeout 0.0ms 13.6MB 63ms 13ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 242ms 3.7ms 3.9MB 233ms 0ms crystal 1.17.0
python 8-m.py 2147ms 28ms 94.2MB 7087ms 240ms pypy 3.11.13
python 8.py timeout 0.0ms 14.3MB 90ms 13ms cpython 3.13.5
python 8.py timeout 0.0ms 13.1MB 133ms 37ms pyston 3.8.12