Programming Language and compiler
Benchmarks

Python VS Nim benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 741ms 8.3ms 34.9MB 727ms 0ms nim 2.2.0
nim 2.nim 919ms 4.1ms 34.7MB 900ms 7ms nim/clang 2.2.0
python 1.py 1086ms 7.1ms 95.8MB 1023ms 47ms pypy 3.10.14
python 1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.1
python 1.py timeout 0.0ms 40.5MB 4750ms 237ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 67ms 0.5ms 5.5MB 57ms 0ms nim 2.2.0
nim 2.nim 85ms 2.2ms 5.8MB 77ms 0ms nim/clang 2.2.0
python 1.py 93ms 4.4ms 68.1MB 57ms 20ms pypy 3.10.14
python 1.py 448ms 2.5ms 11.9MB 423ms 7ms pyston 3.8.12
python 1.py 675ms 16ms 12.6MB 660ms 0ms cpython 3.13.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1119ms 8.2ms 102.5MB 1053ms 50ms pypy 3.10.14
nim 1.nim timeout 0.0ms 561.4MB 2450ms 2080ms nim 2.2.0
nim 1.nim timeout 0.0ms 570.6MB 2543ms 1987ms nim/clang 2.2.0
python 1.py timeout 0.0ms 21.3MB 4980ms 3ms cpython 3.13.1
python 1.py timeout 0.0ms 17.4MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 203ms 0.3ms 84.2MB 163ms 27ms pypy 3.10.14
python 1.py 554ms 29ms 20.5MB 530ms 3ms cpython 3.13.1
python 1.py 598ms 6.9ms 16.8MB 577ms 10ms pyston 3.8.12
nim 1.nim 4127ms 12ms 519.8MB 2037ms 1663ms nim/clang 2.2.0
nim 1.nim 4262ms 22ms 519.3MB 2010ms 1827ms nim 2.2.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 236ms 4.6ms 82.9MB 197ms 27ms pypy 3.10.14
python 1.py 341ms 2.5ms 12.7MB 330ms 0ms cpython 3.13.1
python 1.py 1892ms 11ms 9.6MB 1877ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 97ms 4.0ms 62.8MB 70ms 10ms pypy 3.10.14
python 1.py 107ms 1.8ms 12.1MB 90ms 3ms cpython 3.13.1
python 1.py 334ms 3.4ms 8.8MB 317ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 174ms 1.9ms 1.5MB 160ms 0ms nim 2.2.0
nim 2.nim 226ms 6.1ms 1.8MB 213ms 0ms nim/clang 2.2.0
nim 1.nim 542ms 6.4ms 1.8MB 420ms 110ms nim/clang 2.2.0
nim 1.nim 569ms 4.4ms 1.5MB 470ms 87ms nim 2.2.0
python 1.py 1807ms 11ms 88.3MB 1767ms 30ms pypy 3.10.14
python 5-m.py 2335ms 46ms 12.5MB 3357ms 953ms pyston 3.8.12
python 5-m.py 2672ms 21ms 64.9MB 3783ms 763ms pypy 3.10.14
python 1.py 2864ms 24ms 8.1MB 2850ms 3ms pyston 3.8.12
python 5-m.py 3195ms 8.8ms 13.8MB 4240ms 883ms cpython 3.13.1
python 1.py 4308ms 7.9ms 8.8MB 4297ms 0ms cpython 3.13.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 20ms 0.4ms 1.5MB 10ms 0ms nim 2.2.0
nim 2.nim 25ms 1.4ms 1.8MB 17ms 0ms nim/clang 2.2.0
nim 1.nim 58ms 0.7ms 1.8MB 30ms 17ms nim/clang 2.2.0
nim 1.nim 60ms 2.1ms 1.5MB 37ms 10ms nim 2.2.0
python 1.py 238ms 5.8ms 63.6MB 210ms 13ms pypy 3.10.14
python 5-m.py 295ms 6.0ms 12.5MB 383ms 127ms pyston 3.8.12
python 1.py 299ms 3.5ms 8.1MB 287ms 0ms pyston 3.8.12
python 5-m.py 377ms 1.5ms 13.8MB 457ms 123ms cpython 3.13.1
python 1.py 451ms 3.5ms 8.8MB 440ms 3ms cpython 3.13.1
python 5-m.py 510ms 5.7ms 64.9MB 750ms 283ms pypy 3.10.14

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.0ms 0.0ms 1.6MB 0ms 0ms nim 2.2.0
nim 1.nim 1.1ms 0.1ms 1.8MB 0ms 0ms nim/clang 2.2.0
python 1.py 11ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 1.3ms 8.5MB 10ms 0ms cpython 3.13.1
python 1.py 26ms 0.9ms 51.0MB 8ms 8ms pypy 3.10.14

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 930ms 5.9ms 99.3MB 260ms 647ms nim 2.2.0
nim 1.nim 934ms 16ms 99.4MB 237ms 673ms nim/clang 2.2.0
python 1.py 2185ms 130ms 36.3MB 963ms 1550ms pyston 3.8.12
python 1.py 2293ms 260ms 33.2MB 1447ms 1537ms cpython 3.13.1
python 1.py 4404ms 18ms 106.6MB 2683ms 1083ms pypy 3.10.14

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 152ms 5.5ms 18.1MB 30ms 107ms nim/clang 2.2.0
nim 1.nim 155ms 3.4ms 18.2MB 37ms 100ms nim 2.2.0
python 1.py 1091ms 7.1ms 30.8MB 230ms 243ms pyston 3.8.12
python 1.py 1188ms 161ms 28.8MB 293ms 250ms cpython 3.13.1
python 1.py 1741ms 161ms 88.8MB 650ms 203ms pypy 3.10.14

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 182ms 0.5ms 38.4MB 143ms 20ms pyston 3.8.12
python 1.py 202ms 5.2ms 38.5MB 170ms 13ms cpython 3.13.1
python 1.py 281ms 7.9ms 87.3MB 240ms 23ms pypy 3.10.14

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1728ms 15ms 220.5MB 1570ms 140ms pyston 3.8.12
python 1.py 1788ms 9.0ms 221.8MB 1693ms 80ms pypy 3.10.14
python 1.py 1796ms 4.2ms 221.7MB 1690ms 87ms cpython 3.13.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 2164ms 33ms 137.9MB 7297ms 307ms pypy 3.10.14
python 3-m.py 2926ms 28ms 34.0MB 11103ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.7MB 93ms 7ms cpython 3.13.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 356ms 2.8ms 75.7MB 893ms 163ms pypy 3.10.14
python 3-m.py 377ms 10ms 15.6MB 1223ms 73ms pyston 3.8.12
python 3-m.py 607ms 6.1ms 17.1MB 2127ms 67ms cpython 3.13.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 105ms 4.1ms 1.6MB 97ms 0ms nim/clang 2.2.0
nim 2.nim 108ms 2.2ms 1.8MB 100ms 0ms nim 2.2.0
python 2.py 143ms 0.8ms 57.9MB 117ms 13ms pypy 3.10.14
python 1.py 172ms 3.1ms 59.5MB 147ms 10ms pypy 3.10.14
python 1.py 694ms 2.8ms 8.9MB 687ms 0ms pyston 3.8.12
python 2.py 790ms 4.9ms 8.5MB 773ms 0ms pyston 3.8.12
python 1.py 1060ms 5.7ms 9.3MB 1043ms 0ms cpython 3.13.1
python 2.py 1262ms 16ms 9.0MB 1247ms 0ms cpython 3.13.1
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 307ms 6.6ms 1.6MB 297ms 0ms nim/clang 2.2.0
nim 2.nim 319ms 3.0ms 1.4MB 310ms 0ms nim 2.2.0
python 2.py 321ms 7.8ms 58.9MB 293ms 10ms pypy 3.10.14
python 1.py 360ms 5.5ms 60.4MB 337ms 10ms pypy 3.10.14
python 1.py 2016ms 25ms 8.9MB 2000ms 0ms pyston 3.8.12
python 2.py 2346ms 34ms 8.5MB 2333ms 0ms pyston 3.8.12
python 1.py 3111ms 15ms 9.3MB 3093ms 3ms cpython 3.13.1
python 2.py 3679ms 12ms 9.0MB 3667ms 0ms cpython 3.13.1
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 46ms 1.6ms 1.8MB 40ms 0ms nim/clang 2.2.0
nim 2.nim 49ms 1.9ms 1.5MB 40ms 0ms nim 2.2.0
python 2.py 101ms 2.0ms 57.8MB 77ms 10ms pypy 3.10.14
python 1.py 115ms 1.3ms 58.5MB 90ms 10ms pypy 3.10.14
python 1.py 328ms 7.8ms 8.5MB 313ms 0ms pyston 3.8.12
python 2.py 366ms 15ms 8.1MB 350ms 0ms pyston 3.8.12
nim 1.nim 463ms 5.7ms 1.5MB 450ms 0ms nim/clang 2.2.0
nim 1.nim 467ms 5.4ms 1.3MB 453ms 0ms nim 2.2.0
python 1.py 503ms 5.9ms 9.1MB 483ms 0ms cpython 3.13.1
python 2.py 613ms 10ms 8.8MB 600ms 0ms cpython 3.13.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 520ms 10ms 34.9MB 497ms 7ms nim 2.2.0
nim 1.nim 578ms 6.2ms 34.7MB 553ms 10ms nim/clang 2.2.0
python 1.py 2111ms 2.8ms 210.1MB 2007ms 83ms pypy 3.10.14
python 1.py timeout 0.0ms 93.9MB 4963ms 23ms cpython 3.13.1
python 1.py timeout 0.0ms 130.4MB 4933ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 112ms 2.9ms 9.6MB 100ms 0ms nim 2.2.0
nim 1.nim 124ms 3.0ms 9.9MB 110ms 0ms nim/clang 2.2.0
python 1.py 360ms 5.1ms 103.6MB 297ms 50ms pypy 3.10.14
python 1.py 2752ms 61ms 37.2MB 2727ms 7ms cpython 3.13.1
python 1.py 4838ms 94ms 48.9MB 4770ms 50ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 302ms 2.8ms 1.8MB 290ms 0ms nim 2.2.0
nim 2.nim 330ms 8.5ms 2.0MB 320ms 0ms nim/clang 2.2.0
python 2.py 1278ms 0.7ms 59.8MB 1253ms 10ms pypy 3.10.14
python 1.py 2492ms 13ms 56.6MB 2467ms 10ms pypy 3.10.14
python 1.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.13.1
python 2.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.1
python 1.py timeout 0.0ms 8.3MB 4987ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 32ms 0.5ms 1.8MB 20ms 0ms nim 2.2.0
nim 2.nim 35ms 0.9ms 2.0MB 23ms 0ms nim/clang 2.2.0
python 2.py 165ms 1.2ms 57.8MB 143ms 10ms pypy 3.10.14
python 1.py 284ms 2.2ms 56.6MB 267ms 3ms pypy 3.10.14
python 1.py 892ms 9.1ms 8.3MB 883ms 0ms pyston 3.8.12
python 2.py 1234ms 13ms 8.3MB 1220ms 0ms pyston 3.8.12
python 1.py 2829ms 9.3ms 8.8MB 2813ms 0ms cpython 3.13.1
python 2.py 3043ms 23ms 8.8MB 3030ms 0ms cpython 3.13.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 252ms 0.5ms 41.5MB 240ms 0ms nim 2.2.0
nim 1.nim 293ms 2.6ms 41.8MB 280ms 0ms nim/clang 2.2.0
python 1.py 2328ms 43ms 369.1MB 2263ms 47ms pypy 3.10.14
python 2.py 2768ms 15ms 632.9MB 2590ms 163ms pyston 3.8.12
python 1.py 4623ms 31ms 320.4MB 4567ms 40ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4953ms 27ms cpython 3.13.1
python 2.py timeout 0.0ms 633.5MB 4813ms 170ms cpython 3.13.1
python 2.py timeout 0.0ms 959.3MB 4743ms 243ms pypy 3.10.14

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 53ms 2.2ms 11.5MB 40ms 0ms nim 2.2.0
nim 1.nim 60ms 3.6ms 11.8MB 50ms 0ms nim/clang 2.2.0
python 1.py 497ms 14ms 134.7MB 467ms 17ms pypy 3.10.14
python 2.py 679ms 22ms 164.2MB 630ms 30ms pyston 3.8.12
python 1.py 1022ms 10ms 86.0MB 1000ms 3ms pyston 3.8.12
python 2.py 1327ms 14ms 164.8MB 1283ms 27ms cpython 3.13.1
python 2.py 1463ms 8.1ms 289.7MB 1363ms 80ms pypy 3.10.14
python 1.py 2501ms 11ms 86.9MB 2473ms 10ms cpython 3.13.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1803ms 1.7ms 8.9MB 1750ms 37ms pyston 3.8.12
python 4.py 1882ms 15ms 9.4MB 1823ms 40ms cpython 3.13.1
python 4.py 2018ms 13ms 89.1MB 1983ms 20ms pypy 3.10.14

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 427ms 4.9ms 8.8MB 413ms 0ms pyston 3.8.12
python 4.py 450ms 5.6ms 9.1MB 437ms 0ms cpython 3.13.1
python 4.py 515ms 2.6ms 83.8MB 480ms 17ms pypy 3.10.14

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1541ms 6.9ms 152.3MB 1513ms 13ms nim/clang 2.2.0
nim 1.nim 1567ms 8.6ms 151.5MB 1530ms 23ms nim 2.2.0
python 1.py 2122ms 9.7ms 243.2MB 2060ms 43ms pypy 3.10.14
python 1.py 4481ms 9.0ms 226.3MB 4283ms 180ms pyston 3.8.12
python 1.py timeout 0.0ms 165.8MB 4940ms 40ms cpython 3.13.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 162ms 0.2ms 17.6MB 143ms 3ms nim/clang 2.2.0
nim 1.nim 163ms 1.8ms 17.4MB 153ms 0ms nim 2.2.0
python 1.py 310ms 4.2ms 85.0MB 273ms 20ms pypy 3.10.14
python 1.py 468ms 2.3ms 30.5MB 440ms 13ms pyston 3.8.12
python 1.py 594ms 8.6ms 31.0MB 557ms 23ms cpython 3.13.1

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3007ms 4.8ms 8.3MB 2997ms 0ms pyston 3.8.12
python 1.py 3542ms 41ms 74.6MB 3513ms 13ms pypy 3.10.14
python 1.py 3659ms 51ms 8.8MB 3650ms 0ms cpython 3.13.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 765ms 9.3ms 8.3MB 750ms 0ms pyston 3.8.12
python 1.py 922ms 10.0ms 8.8MB 913ms 0ms cpython 3.13.1
python 1.py 973ms 12ms 67.5MB 947ms 10ms pypy 3.10.14

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3383ms 20ms 1.6MB 3370ms 0ms nim/clang 2.2.0
nim 1.nim 3439ms 35ms 1.4MB 3430ms 0ms nim 2.2.0
python 8.py timeout 0.0ms 16.7MB 43ms 13ms cpython 3.13.1
python 8.py timeout 0.0ms 99.4MB 790ms 163ms pypy 3.10.14
python 8.py timeout 0.0ms 16.5MB 67ms 20ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 848ms 4.3ms 1.5MB 837ms 0ms nim/clang 2.2.0
nim 1.nim 860ms 8.6ms 1.3MB 853ms 0ms nim 2.2.0
python 8.py timeout 0.0ms 16.5MB 87ms 20ms cpython 3.13.1
python 8.py timeout 0.0ms 100.4MB 1460ms 480ms pypy 3.10.14
python 8.py timeout 0.0ms 15.6MB 147ms 37ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 214ms 1.3ms 1.3MB 203ms 0ms nim 2.2.0
nim 1.nim 217ms 5.1ms 1.5MB 207ms 0ms nim/clang 2.2.0
python 8-m.py 1880ms 5.8ms 95.0MB 6000ms 323ms pypy 3.10.14
python 8.py timeout 0.0ms 16.2MB 233ms 33ms cpython 3.13.1
python 8.py timeout 0.0ms 17.2MB 440ms 127ms pyston 3.8.12