Programming Language and compiler
Benchmarks

Nim VS Python benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 793ms 24ms 34.9MB 777ms 3ms nim 2.2.0
nim 2.nim 986ms 7.4ms 34.2MB 967ms 7ms nim/clang 2.2.0
python 1.py 1149ms 16ms 95.7MB 1087ms 47ms pypy 3.10.14
python 1.py timeout 0.0ms 40.8MB 4970ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 40.6MB 4743ms 240ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 72ms 1.1ms 5.5MB 60ms 0ms nim 2.2.0
nim 2.nim 94ms 2.8ms 5.8MB 80ms 0ms nim/clang 2.2.0
python 1.py 94ms 1.9ms 68.0MB 63ms 20ms pypy 3.10.14
python 1.py 491ms 25ms 11.9MB 463ms 7ms pyston 3.8.12
python 1.py 710ms 4.2ms 12.8MB 697ms 0ms cpython 3.13.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1178ms 15ms 102.5MB 1133ms 30ms pypy 3.10.14
nim 1.nim timeout 0.0ms 545.3MB 2497ms 2050ms nim 2.2.0
nim 1.nim timeout 0.0ms 552.6MB 2520ms 2020ms nim/clang 2.2.0
python 1.py timeout 0.0ms 21.1MB 4977ms 7ms cpython 3.13.0
python 1.py timeout 0.0ms 17.1MB 4977ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 219ms 6.3ms 84.3MB 183ms 20ms pypy 3.10.14
python 1.py 572ms 3.4ms 20.4MB 543ms 10ms cpython 3.13.0
python 1.py 685ms 13ms 16.8MB 663ms 7ms pyston 3.8.12
nim 1.nim 4405ms 8.9ms 519.8MB 2203ms 1773ms nim/clang 2.2.0
nim 1.nim 4519ms 16ms 519.3MB 2230ms 1857ms nim 2.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 188ms 0.7ms 1.5MB 177ms 0ms nim 2.2.0
nim 2.nim 239ms 2.9ms 1.8MB 227ms 0ms nim/clang 2.2.0
nim 1.nim 569ms 1.0ms 1.8MB 433ms 123ms nim/clang 2.2.0
nim 1.nim 596ms 1.0ms 1.5MB 467ms 113ms nim 2.2.0
python 1.py 1909ms 10.0ms 88.3MB 1867ms 23ms pypy 3.10.14
python 5-m.py 2472ms 27ms 12.5MB 3610ms 997ms pyston 3.8.12
python 5-m.py 2826ms 10ms 64.9MB 4047ms 780ms pypy 3.10.14
python 1.py 3033ms 47ms 8.1MB 3017ms 0ms pyston 3.8.12
python 5-m.py 3411ms 65ms 13.9MB 4617ms 930ms cpython 3.13.0
python 1.py 4670ms 96ms 8.8MB 4650ms 3ms cpython 3.13.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 21ms 0.6ms 1.5MB 10ms 0ms nim 2.2.0
nim 2.nim 26ms 0.4ms 1.6MB 17ms 0ms nim/clang 2.2.0
nim 1.nim 60ms 1.1ms 1.8MB 40ms 7ms nim/clang 2.2.0
nim 1.nim 63ms 1.0ms 1.5MB 43ms 7ms nim 2.2.0
python 1.py 250ms 0.3ms 63.8MB 223ms 10ms pypy 3.10.14
python 5-m.py 312ms 1.4ms 12.5MB 420ms 123ms pyston 3.8.12
python 1.py 312ms 2.4ms 8.1MB 297ms 0ms pyston 3.8.12
python 5-m.py 408ms 10ms 13.9MB 520ms 120ms cpython 3.13.0
python 1.py 478ms 11ms 8.8MB 463ms 0ms cpython 3.13.0
python 5-m.py 555ms 5.0ms 65.0MB 817ms 313ms pypy 3.10.14

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.2ms 0.0ms 1.8MB 0ms 0ms nim/clang 2.2.0
nim 1.nim 1.2ms 0.2ms 1.6MB 0ms 0ms nim 2.2.0
python 1.py 12ms 1.2ms 7.6MB 5ms 5ms pyston 3.8.12
python 1.py 15ms 0.3ms 8.5MB 10ms 0ms cpython 3.13.0
python 1.py 29ms 1.5ms 51.0MB 4ms 12ms pypy 3.10.14

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 996ms 14ms 99.4MB 277ms 693ms nim/clang 2.2.0
nim 1.nim 1015ms 23ms 99.2MB 290ms 693ms nim 2.2.0
python 1.py 2123ms 18ms 36.4MB 1133ms 1507ms pyston 3.8.12
python 1.py 2379ms 301ms 33.3MB 1593ms 1627ms cpython 3.13.0
python 1.py 4814ms 17ms 107.0MB 2870ms 1220ms pypy 3.10.14

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 159ms 2.7ms 17.8MB 37ms 103ms nim 2.2.0
nim 1.nim 166ms 6.9ms 18.1MB 37ms 113ms nim/clang 2.2.0
python 1.py 1101ms 27ms 28.8MB 217ms 287ms pyston 3.8.12
python 1.py 1170ms 92ms 28.7MB 317ms 273ms cpython 3.13.0
python 1.py 1611ms 66ms 89.5MB 723ms 200ms pypy 3.10.14

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 110ms 2.7ms 1.6MB 100ms 0ms nim/clang 2.2.0
nim 2.nim 116ms 2.9ms 1.3MB 107ms 0ms nim 2.2.0
python 2.py 146ms 5.0ms 57.9MB 120ms 7ms pypy 3.10.14
python 1.py 176ms 0.5ms 59.5MB 150ms 10ms pypy 3.10.14
python 1.py 713ms 3.1ms 8.9MB 703ms 0ms pyston 3.8.12
python 2.py 841ms 12ms 8.5MB 830ms 0ms pyston 3.8.12
python 1.py 1118ms 25ms 9.4MB 1110ms 0ms cpython 3.13.0
python 2.py 1290ms 15ms 9.1MB 1273ms 0ms cpython 3.13.0
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 322ms 3.0ms 1.9MB 313ms 0ms nim/clang 2.2.0
nim 2.nim 335ms 1.0ms 1.3MB 323ms 0ms nim 2.2.0
python 2.py 339ms 1.0ms 58.9MB 313ms 13ms pypy 3.10.14
python 1.py 372ms 2.9ms 60.4MB 347ms 10ms pypy 3.10.14
python 1.py 2130ms 31ms 8.9MB 2117ms 3ms pyston 3.8.12
python 2.py 2504ms 61ms 8.5MB 2490ms 0ms pyston 3.8.12
python 1.py 3298ms 41ms 9.4MB 3283ms 0ms cpython 3.13.0
python 2.py 3869ms 4.9ms 9.1MB 3853ms 0ms cpython 3.13.0
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 49ms 1.7ms 1.5MB 40ms 0ms nim/clang 2.2.0
nim 2.nim 51ms 0.5ms 1.3MB 40ms 0ms nim 2.2.0
python 2.py 103ms 0.8ms 57.8MB 77ms 13ms pypy 3.10.14
python 1.py 120ms 2.9ms 58.5MB 97ms 7ms pypy 3.10.14
python 1.py 349ms 5.9ms 8.5MB 333ms 0ms pyston 3.8.12
python 2.py 384ms 5.3ms 8.1MB 367ms 3ms pyston 3.8.12
nim 1.nim 489ms 3.0ms 1.5MB 480ms 0ms nim/clang 2.2.0
nim 1.nim 490ms 1.1ms 1.3MB 480ms 0ms nim 2.2.0
python 1.py 536ms 14ms 9.3MB 520ms 0ms cpython 3.13.0
python 2.py 617ms 1.4ms 8.8MB 607ms 0ms cpython 3.13.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 386ms 2.1ms 4.8MB 373ms 0ms nim/clang 2.2.0
nim 1.nim 573ms 1.8ms 4.5MB 563ms 0ms nim 2.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 19ms 0.2ms 1.9MB 10ms 0ms nim/clang 2.2.0
nim 1.nim 27ms 0.7ms 1.6MB 20ms 0ms nim 2.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 556ms 11ms 34.4MB 540ms 0ms nim 2.2.0
nim 1.nim 619ms 4.0ms 35.2MB 600ms 7ms nim/clang 2.2.0
python 1.py 2247ms 43ms 210.1MB 2133ms 97ms pypy 3.10.14
python 1.py timeout 0.0ms 93.9MB 4953ms 30ms cpython 3.13.0
python 1.py timeout 0.0ms 130.3MB 4930ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 122ms 2.0ms 9.6MB 107ms 0ms nim 2.2.0
nim 1.nim 131ms 4.4ms 9.9MB 120ms 0ms nim/clang 2.2.0
python 1.py 378ms 2.6ms 103.6MB 327ms 33ms pypy 3.10.14
python 1.py 3059ms 119ms 37.1MB 3030ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 48.9MB 4953ms 33ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 319ms 1.8ms 1.8MB 310ms 0ms nim 2.2.0
nim 2.nim 339ms 0.8ms 2.0MB 330ms 0ms nim/clang 2.2.0
python 2.py 1352ms 14ms 59.8MB 1320ms 17ms pypy 3.10.14
python 1.py 2641ms 30ms 56.6MB 2610ms 13ms pypy 3.10.14
python 1.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.0
python 2.py timeout 0.0ms 8.8MB 4983ms 0ms cpython 3.13.0
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 34ms 0.6ms 1.8MB 23ms 0ms nim 2.2.0
nim 2.nim 36ms 0.2ms 2.0MB 27ms 0ms nim/clang 2.2.0
python 2.py 180ms 2.7ms 57.6MB 153ms 10ms pypy 3.10.14
python 1.py 304ms 5.3ms 56.8MB 277ms 10ms pypy 3.10.14
python 1.py 1078ms 255ms 8.3MB 1063ms 0ms pyston 3.8.12
python 2.py 1319ms 15ms 8.1MB 1303ms 0ms pyston 3.8.12
python 1.py 2912ms 17ms 8.8MB 2900ms 0ms cpython 3.13.0
python 2.py 3132ms 41ms 8.8MB 3123ms 0ms cpython 3.13.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 291ms 18ms 41.5MB 273ms 0ms nim 2.2.0
nim 1.nim 317ms 14ms 41.8MB 307ms 0ms nim/clang 2.2.0
python 1.py 2489ms 28ms 369.0MB 2417ms 57ms pypy 3.10.14
python 2.py 2905ms 8.7ms 632.9MB 2723ms 167ms pyston 3.8.12
python 1.py 4843ms 56ms 320.4MB 4783ms 43ms pyston 3.8.12
python 1.py timeout 0.0ms 321.2MB 4963ms 23ms cpython 3.13.0
python 2.py timeout 0.0ms 633.6MB 4813ms 170ms cpython 3.13.0
python 2.py timeout 0.0ms 959.3MB 4733ms 250ms pypy 3.10.14

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 53ms 2.9ms 11.5MB 43ms 0ms nim 2.2.0
nim 1.nim 64ms 4.0ms 11.8MB 57ms 0ms nim/clang 2.2.0
python 1.py 540ms 2.4ms 134.6MB 500ms 27ms pypy 3.10.14
python 2.py 709ms 4.9ms 164.2MB 657ms 33ms pyston 3.8.12
python 1.py 1118ms 29ms 86.0MB 1090ms 10ms pyston 3.8.12
python 2.py 1383ms 21ms 164.9MB 1333ms 30ms cpython 3.13.0
python 2.py 1531ms 11ms 289.6MB 1443ms 73ms pypy 3.10.14
python 1.py 2652ms 13ms 86.9MB 2623ms 10ms cpython 3.13.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1629ms 16ms 152.2MB 1600ms 17ms nim/clang 2.2.0
nim 1.nim 1651ms 7.0ms 152.1MB 1620ms 17ms nim 2.2.0
python 1.py 2217ms 5.8ms 243.1MB 2157ms 43ms pypy 3.10.14
python 1.py 4742ms 15ms 226.2MB 4557ms 170ms pyston 3.8.12
python 1.py timeout 0.0ms 179.6MB 4903ms 77ms cpython 3.13.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 173ms 3.9ms 17.6MB 153ms 7ms nim/clang 2.2.0
nim 1.nim 175ms 2.2ms 16.5MB 163ms 0ms nim 2.2.0
python 1.py 330ms 5.3ms 85.5MB 283ms 30ms pypy 3.10.14
python 1.py 493ms 3.6ms 30.3MB 450ms 27ms pyston 3.8.12
python 1.py 587ms 4.1ms 29.9MB 547ms 23ms cpython 3.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3574ms 1.3ms 1.6MB 3563ms 0ms nim/clang 2.2.0
nim 1.nim 3593ms 7.6ms 1.4MB 3583ms 0ms nim 2.2.0
python 8.py timeout 0.0ms 16.7MB 53ms 10ms cpython 3.13.0
python 8.py timeout 0.0ms 100.0MB 833ms 137ms pypy 3.10.14
python 8.py timeout 0.0ms 18.2MB 70ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 896ms 0.8ms 1.5MB 887ms 0ms nim/clang 2.2.0
nim 1.nim 904ms 3.3ms 1.3MB 893ms 0ms nim 2.2.0
python 8.py timeout 0.0ms 16.4MB 93ms 30ms cpython 3.13.0
python 8.py timeout 0.0ms 99.8MB 1533ms 517ms pypy 3.10.14
python 8.py timeout 0.0ms 17.5MB 140ms 33ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 226ms 0.6ms 1.5MB 213ms 0ms nim/clang 2.2.0
nim 1.nim 228ms 1.3ms 1.3MB 220ms 0ms nim 2.2.0
python 8-m.py 1973ms 18ms 95.1MB 6307ms 370ms pypy 3.10.14
python 8.py timeout 0.0ms 16.1MB 277ms 40ms cpython 3.13.0
python 8.py timeout 0.0ms 17.3MB 397ms 113ms pyston 3.8.12