Programming Language and compiler
Benchmarks

Nim VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 835ms 5.3ms 34.4MB 813ms 7ms nim 2.0.2
nim 2.nim 1170ms 1.0ms 34.7MB 1150ms 7ms nim/clang 2.0.2
python 1.py 1568ms 90ms 79.1MB 1510ms 40ms pypy 3.10.13
python 1.py timeout 0.0ms 41.3MB 4977ms 10ms cpython 3.12.1
python 1.py timeout 0.0ms 40.5MB 4763ms 223ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 80ms 2.9ms 5.5MB 70ms 0ms nim 2.0.2
nim 2.nim 113ms 2.9ms 5.8MB 100ms 0ms nim/clang 2.0.2
python 1.py 116ms 0.7ms 62.6MB 80ms 20ms pypy 3.10.13
python 1.py 478ms 4.3ms 11.9MB 450ms 13ms pyston 3.8.12
python 1.py 732ms 6.5ms 13.1MB 713ms 0ms cpython 3.12.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 301ms 0.9ms 20.4MB 277ms 7ms cpython 3.12.1
python 1.py 3056ms 23ms 116.4MB 2993ms 47ms pypy 3.10.13
nim 1.nim timeout 0.0ms 549.4MB 2490ms 2053ms nim 2.0.2
nim 1.nim timeout 0.0ms 558.6MB 2537ms 1997ms nim/clang 2.0.2
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 292ms 2.9ms 82.9MB 243ms 30ms pypy 3.10.13
python 1.py 303ms 0.9ms 20.4MB 280ms 7ms cpython 3.12.1
python 1.py 653ms 8.2ms 16.8MB 637ms 0ms pyston 3.8.12
nim 1.nim 4326ms 9.0ms 519.8MB 2247ms 1653ms nim/clang 2.0.2
nim 1.nim 4400ms 29ms 519.4MB 2180ms 1793ms nim 2.0.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 188ms 3.5ms 1.5MB 177ms 0ms nim 2.0.2
nim 2.nim 239ms 3.2ms 1.8MB 227ms 0ms nim/clang 2.0.2
nim 1.nim 549ms 1.1ms 1.8MB 447ms 87ms nim/clang 2.0.2
nim 1.nim 573ms 0.7ms 1.5MB 463ms 90ms nim 2.0.2
python 1.py 1945ms 8.0ms 62.7MB 1917ms 10ms pypy 3.10.13
python 5-m.py 2465ms 14ms 12.4MB 3553ms 1027ms pyston 3.8.12
python 5-m.py 2926ms 14ms 63.1MB 4217ms 773ms pypy 3.10.13
python 1.py 3002ms 24ms 8.1MB 2987ms 0ms pyston 3.8.12
python 5-m.py 3316ms 15ms 14.3MB 4393ms 993ms cpython 3.12.1
python 1.py 4481ms 71ms 9.3MB 4473ms 0ms cpython 3.12.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 20ms 0.4ms 1.5MB 10ms 0ms nim 2.0.2
nim 2.nim 26ms 0.6ms 1.6MB 20ms 0ms nim/clang 2.0.2
nim 1.nim 58ms 0.6ms 1.8MB 43ms 0ms nim/clang 2.0.2
nim 1.nim 61ms 1.0ms 1.5MB 43ms 7ms nim 2.0.2
python 1.py 267ms 4.6ms 61.3MB 240ms 7ms pypy 3.10.13
python 5-m.py 314ms 12ms 12.5MB 407ms 147ms pyston 3.8.12
python 1.py 316ms 1.5ms 8.1MB 303ms 3ms pyston 3.8.12
python 5-m.py 401ms 1.6ms 14.3MB 463ms 167ms cpython 3.12.1
python 1.py 469ms 14ms 9.3MB 457ms 0ms cpython 3.12.1
python 5-m.py 657ms 11ms 63.1MB 880ms 367ms pypy 3.10.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.0ms 0.1ms 1.6MB 0ms 0ms nim 2.0.2
nim 1.nim 1.2ms 0.1ms 1.9MB 0ms 0ms nim/clang 2.0.2
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 895ms 13ms 97.3MB 283ms 583ms nim 2.0.2
nim 1.nim 909ms 5.9ms 98.3MB 293ms 583ms nim/clang 2.0.2
python 1.py 2025ms 149ms 36.9MB 1037ms 1437ms pyston 3.8.12
python 1.py 2549ms 259ms 33.6MB 1583ms 1460ms cpython 3.12.1
python 1.py 4777ms 225ms 98.0MB 3277ms 1110ms pypy 3.10.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 147ms 2.3ms 18.0MB 27ms 100ms nim 2.0.2
nim 1.nim 149ms 1.0ms 18.1MB 43ms 90ms nim/clang 2.0.2
python 1.py 1113ms 9.9ms 28.9MB 323ms 247ms cpython 3.12.1
python 1.py 1119ms 55ms 30.6MB 210ms 260ms pyston 3.8.12
python 1.py 1605ms 357ms 88.8MB 810ms 207ms pypy 3.10.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 108ms 1.5ms 1.6MB 100ms 0ms nim/clang 2.0.2
nim 2.nim 109ms 2.7ms 1.4MB 97ms 0ms nim 2.0.2
python 2.py 154ms 4.7ms 56.8MB 123ms 17ms pypy 3.10.13
python 1.py 189ms 6.3ms 59.5MB 160ms 13ms pypy 3.10.13
python 1.py 729ms 10ms 8.9MB 713ms 0ms pyston 3.8.12
python 2.py 851ms 3.5ms 8.5MB 840ms 0ms pyston 3.8.12
python 1.py 1105ms 12ms 9.9MB 1093ms 0ms cpython 3.12.1
python 2.py 1288ms 22ms 9.5MB 1277ms 0ms cpython 3.12.1
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.0.2
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.0.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 316ms 0.4ms 1.9MB 307ms 0ms nim/clang 2.0.2
nim 2.nim 323ms 4.4ms 1.4MB 313ms 0ms nim 2.0.2
python 2.py 349ms 3.5ms 59.9MB 327ms 10ms pypy 3.10.13
python 1.py 395ms 5.9ms 60.9MB 367ms 17ms pypy 3.10.13
python 1.py 2192ms 83ms 8.9MB 2180ms 0ms pyston 3.8.12
python 2.py 2556ms 13ms 8.5MB 2547ms 0ms pyston 3.8.12
python 1.py 3250ms 26ms 9.9MB 3233ms 0ms cpython 3.12.1
python 2.py 3744ms 9.6ms 9.5MB 3733ms 0ms cpython 3.12.1
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.0.2
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.0.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 48ms 0.6ms 1.5MB 40ms 0ms nim/clang 2.0.2
nim 2.nim 49ms 0.7ms 1.3MB 40ms 0ms nim 2.0.2
python 2.py 113ms 4.7ms 56.5MB 87ms 10ms pypy 3.10.13
python 1.py 122ms 0.4ms 57.5MB 93ms 10ms pypy 3.10.13
python 1.py 349ms 6.2ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 391ms 3.9ms 8.1MB 380ms 0ms pyston 3.8.12
python 1.py 528ms 10ms 9.5MB 517ms 0ms cpython 3.12.1
nim 1.nim 536ms 10ms 1.5MB 523ms 0ms nim/clang 2.0.2
nim 1.nim 536ms 8.6ms 1.3MB 523ms 0ms nim 2.0.2
python 2.py 616ms 7.8ms 9.3MB 603ms 0ms cpython 3.12.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 389ms 2.4ms 4.8MB 377ms 0ms nim/clang 2.0.2
nim 1.nim 577ms 3.8ms 4.5MB 563ms 0ms nim 2.0.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 19ms 0.8ms 1.9MB 10ms 0ms nim/clang 2.0.2
nim 1.nim 28ms 0.5ms 1.6MB 20ms 0ms nim 2.0.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 553ms 0.7ms 34.4MB 533ms 3ms nim 2.0.2
nim 1.nim 653ms 8.9ms 36.5MB 633ms 3ms nim/clang 2.0.2
python 1.py 2604ms 19ms 201.5MB 2490ms 97ms pypy 3.10.13
python 1.py timeout 0.0ms 81.6MB 4970ms 20ms cpython 3.12.1
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 122ms 0.7ms 9.8MB 110ms 0ms nim 2.0.2
nim 1.nim 143ms 2.1ms 10.0MB 130ms 0ms nim/clang 2.0.2
python 1.py 487ms 3.0ms 94.2MB 440ms 30ms pypy 3.10.13
python 1.py timeout 0.0ms 34.1MB 4977ms 7ms cpython 3.12.1
python 1.py timeout 0.0ms 41.4MB 4970ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 318ms 1.0ms 1.8MB 310ms 0ms nim 2.0.2
nim 2.nim 343ms 3.5ms 2.0MB 333ms 0ms nim/clang 2.0.2
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 34ms 0.5ms 1.8MB 23ms 0ms nim 2.0.2
nim 2.nim 36ms 0.1ms 2.0MB 30ms 0ms nim/clang 2.0.2
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 282ms 2.6ms 41.5MB 270ms 0ms nim 2.0.2
nim 1.nim 351ms 9.9ms 41.8MB 337ms 0ms nim/clang 2.0.2
python 2.py 3061ms 79ms 632.9MB 2887ms 157ms pyston 3.8.12
python 1.py 3479ms 37ms 366.2MB 3410ms 50ms pypy 3.10.13
python 1.py 4862ms 92ms 320.5MB 4807ms 47ms pyston 3.8.12
python 2.py 4871ms 47ms 634.1MB 4697ms 160ms cpython 3.12.1
python 1.py timeout 0.0ms 321.7MB 4963ms 23ms cpython 3.12.1
python 2.py timeout 0.0ms 956.8MB 4737ms 247ms pypy 3.10.13

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 56ms 1.3ms 11.5MB 47ms 0ms nim 2.0.2
nim 1.nim 65ms 1.0ms 11.8MB 53ms 0ms nim/clang 2.0.2
python 1.py 698ms 9.1ms 131.7MB 667ms 17ms pypy 3.10.13
python 2.py 735ms 2.3ms 164.3MB 690ms 23ms pyston 3.8.12
python 1.py 1113ms 6.9ms 86.0MB 1087ms 7ms pyston 3.8.12
python 2.py 1213ms 1.8ms 165.4MB 1170ms 30ms cpython 3.12.1
python 1.py 2241ms 84ms 87.3MB 2217ms 10ms cpython 3.12.1
python 2.py 2612ms 31ms 283.0MB 2523ms 77ms pypy 3.10.13

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1623ms 6.2ms 152.4MB 1583ms 23ms nim/clang 2.0.2
nim 1.nim 1647ms 11ms 151.5MB 1617ms 13ms nim 2.0.2
python 1.py 2250ms 4.5ms 233.5MB 2197ms 33ms pypy 3.10.13
python 1.py 4736ms 9.4ms 226.2MB 4533ms 187ms pyston 3.8.12
python 1.py timeout 0.0ms 129.4MB 4950ms 37ms cpython 3.12.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 172ms 1.3ms 16.4MB 153ms 7ms nim 2.0.2
nim 1.nim 173ms 1.6ms 16.7MB 160ms 0ms nim/clang 2.0.2
python 1.py 342ms 4.3ms 75.2MB 303ms 23ms pypy 3.10.13
python 1.py 493ms 1.8ms 30.5MB 463ms 17ms pyston 3.8.12
python 1.py 616ms 5.5ms 29.9MB 577ms 20ms cpython 3.12.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3574ms 1.9ms 1.6MB 3567ms 0ms nim/clang 2.0.2
nim 1.nim 3591ms 12ms 1.4MB 3580ms 0ms nim 2.0.2
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 895ms 0.8ms 1.5MB 887ms 0ms nim/clang 2.0.2
nim 1.nim 899ms 2.9ms 1.8MB 890ms 0ms nim 2.0.2
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 226ms 0.0ms 1.5MB 217ms 0ms nim/clang 2.0.2
nim 1.nim 227ms 1.0ms 1.8MB 220ms 0ms nim 2.0.2
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12