Programming Language and compiler
Benchmarks

Nim VS Python benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1472ms 22ms 274.2MB 1347ms 113ms pypy 3.8.13
nim 2.nim 3377ms 55ms 34.4MB 3353ms 7ms nim/clang 1.6.8
nim 2.nim 3539ms 69ms 35.1MB 3510ms 13ms nim 1.6.8
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 126ms 20ms 83.2MB 90ms 13ms pypy 3.8.13
nim 2.nim 319ms 3.0ms 5.7MB 307ms 0ms nim/clang 1.6.8
nim 2.nim 330ms 0.7ms 5.4MB 317ms 0ms nim 1.6.8
python 1.py 607ms 2.1ms 11.9MB 577ms 7ms pyston 3.8.12
python 1.py 1507ms 5.3ms 11.9MB 1493ms 0ms cpython 3.10.7

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1089ms 26ms 197.1MB 1007ms 63ms pypy 3.8.13
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 276ms 9.7ms 95.5MB 233ms 20ms pypy 3.8.13
python 1.py 936ms 4.7ms 16.9MB 913ms 3ms pyston 3.8.12
python 1.py 989ms 23ms 17.1MB 967ms 0ms cpython 3.10.7
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 825ms 3.2ms 88.0MB 797ms 10ms pypy 3.8.13
python 1.py 1668ms 0.6ms 9.3MB 1650ms 3ms cpython 3.10.7
python 1.py 2780ms 0.6ms 9.6MB 2763ms 0ms pyston 3.8.12
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 212ms 0.7ms 81.9MB 187ms 10ms pypy 3.8.13
python 1.py 307ms 0.8ms 8.5MB 293ms 0ms cpython 3.10.7
python 1.py 479ms 0.5ms 8.9MB 463ms 0ms pyston 3.8.12
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 257ms 0.4ms 0.7MB 250ms 0ms nim 1.6.8
nim 2.nim 339ms 2.7ms 1.0MB 327ms 0ms nim/clang 1.6.8
nim 1.nim 786ms 1.8ms 0.6MB 683ms 80ms nim 1.6.8
nim 1.nim 809ms 2.8ms 1.0MB 720ms 70ms nim/clang 1.6.8
python 1.py 2517ms 15ms 91.2MB 2477ms 23ms pypy 3.8.13
python 5-m.py 3868ms 429ms 12.7MB 5843ms 990ms pyston 3.8.12
python 5-m.py 3977ms 29ms 85.3MB 5397ms 1067ms pypy 3.8.13
python 1.py 4077ms 6.7ms 7.9MB 4053ms 7ms pyston 3.8.12
python 5-m.py 4457ms 38ms 12.1MB 6397ms 1020ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 29ms 0.4ms 0.7MB 20ms 0ms nim 1.6.8
nim 2.nim 37ms 0.6ms 0.9MB 30ms 0ms nim/clang 1.6.8
nim 1.nim 83ms 0.4ms 1.0MB 67ms 3ms nim/clang 1.6.8
nim 1.nim 84ms 4.0ms 0.7MB 67ms 3ms nim 1.6.8
python 1.py 332ms 0.7ms 81.8MB 303ms 13ms pypy 3.8.13
python 1.py 425ms 3.2ms 7.9MB 410ms 0ms pyston 3.8.12
python 5-m.py 425ms 34ms 12.6MB 587ms 123ms pyston 3.8.12
python 5-m.py 535ms 34ms 12.0MB 680ms 137ms cpython 3.10.7
python 1.py 708ms 1.9ms 7.7MB 693ms 0ms cpython 3.10.7
python 5-m.py 815ms 3.9ms 85.3MB 753ms 367ms pypy 3.8.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.6ms 0.4ms 0.7MB 0ms 0ms nim 1.6.8
nim 1.nim 1.9ms 0.7ms 1.0MB 0ms 0ms nim/clang 1.6.8
python 1.py 14ms 0.8ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 0.6ms 7.6MB 10ms 0ms cpython 3.10.7
python 1.py 32ms 0.6ms 54.9MB 16ms 2ms pypy 3.8.13

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 731ms 2.3ms 94.2MB 330ms 367ms nim 1.6.8
nim 1.nim 735ms 1.5ms 94.3MB 297ms 407ms nim/clang 1.6.8
python 1.py 1542ms 2.9ms 29.3MB 1303ms 873ms pyston 3.8.12
python 1.py 2184ms 12ms 27.3MB 1953ms 963ms cpython 3.10.7
python 1.py 4220ms 24ms 132.1MB 3360ms 767ms pypy 3.8.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 123ms 0.9ms 18.3MB 53ms 57ms nim 1.6.8
nim 1.nim 125ms 0.9ms 18.7MB 40ms 67ms nim/clang 1.6.8
python 1.py 355ms 1.7ms 23.9MB 267ms 177ms pyston 3.8.12
python 1.py 439ms 7.6ms 21.8MB 373ms 170ms cpython 3.10.7
python 1.py 1070ms 30ms 106.7MB 870ms 163ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 147ms 0.8ms 1.0MB 140ms 0ms nim/clang 1.6.8
nim 2.nim 158ms 1.3ms 0.7MB 150ms 0ms nim 1.6.8
python 2.py 206ms 8.8ms 80.0MB 177ms 13ms pypy 3.8.13
python 1.py 239ms 0.8ms 81.1MB 213ms 13ms pypy 3.8.13
python 1.py 980ms 3.6ms 9.0MB 963ms 0ms pyston 3.8.12
python 2.py 1155ms 3.7ms 8.7MB 1140ms 0ms pyston 3.8.12
python 1.py 1854ms 29ms 8.4MB 1843ms 0ms cpython 3.10.7
python 2.py 2594ms 29ms 8.3MB 2583ms 0ms cpython 3.10.7
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 434ms 0.5ms 0.9MB 420ms 0ms nim/clang 1.6.8
nim 2.nim 466ms 0.8ms 0.7MB 457ms 0ms nim 1.6.8
python 2.py 469ms 1.8ms 80.3MB 437ms 13ms pypy 3.8.13
python 1.py 509ms 5.6ms 81.5MB 490ms 7ms pypy 3.8.13
python 1.py 2897ms 7.1ms 9.0MB 2880ms 0ms pyston 3.8.12
python 2.py 3450ms 16ms 8.7MB 3437ms 0ms pyston 3.8.12
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 65ms 0.6ms 1.0MB 53ms 0ms nim/clang 1.6.8
nim 2.nim 68ms 0.9ms 0.6MB 60ms 0ms nim 1.6.8
python 2.py 147ms 2.5ms 80.0MB 120ms 10ms pypy 3.8.13
python 1.py 162ms 1.0ms 81.0MB 130ms 20ms pypy 3.8.13
nim 1.nim 419ms 6.5ms 1.0MB 407ms 0ms nim/clang 1.6.8
nim 1.nim 448ms 0.6ms 0.7MB 440ms 0ms nim 1.6.8
python 1.py 477ms 4.2ms 8.7MB 457ms 0ms pyston 3.8.12
python 2.py 540ms 4.5ms 8.2MB 527ms 0ms pyston 3.8.12
python 1.py 869ms 9.9ms 7.9MB 857ms 0ms cpython 3.10.7
python 2.py 1253ms 11ms 7.3MB 1237ms 0ms cpython 3.10.7

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 575ms 0.8ms 4.9MB 563ms 0ms nim/clang 1.6.8
nim 1.nim 996ms 0.9ms 4.5MB 983ms 0ms nim 1.6.8

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 27ms 0.3ms 2.0MB 20ms 0ms nim/clang 1.6.8
nim 1.nim 44ms 0.9ms 0.7MB 33ms 0ms nim 1.6.8

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1605ms 45ms 34.8MB 1583ms 3ms nim/clang 1.6.8
nim 1.nim 1659ms 3.2ms 35.1MB 1637ms 3ms nim 1.6.8
python 1.py 2242ms 17ms 293.8MB 2047ms 177ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 333ms 6.8ms 145.2MB 270ms 43ms pypy 3.8.13
nim 1.nim 340ms 1.1ms 9.9MB 327ms 0ms nim/clang 1.6.8
nim 1.nim 359ms 2.9ms 9.3MB 343ms 0ms nim 1.6.8
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 405ms 1.0ms 1.0MB 393ms 0ms nim/clang 1.6.8
nim 2.nim 428ms 0.3ms 1.0MB 413ms 0ms nim 1.6.8
python 2.py 1898ms 18ms 79.9MB 1873ms 10ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 46ms 0.7ms 1.0MB 37ms 0ms nim 1.6.8
nim 2.nim 47ms 4.8ms 1.0MB 33ms 0ms nim/clang 1.6.8
python 2.py 249ms 3.9ms 79.8MB 220ms 10ms pypy 3.8.13
python 1.py 560ms 16ms 79.4MB 523ms 13ms pypy 3.8.13
python 1.py 1195ms 5.3ms 8.3MB 1180ms 0ms pyston 3.8.12
python 2.py 1583ms 1.2ms 8.2MB 1570ms 0ms pyston 3.8.12
python 1.py 4606ms 4.4ms 7.2MB 4597ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 588ms 1.8ms 6.4MB 577ms 0ms nim/clang 1.6.8
nim 2.nim 642ms 0.9ms 6.0MB 630ms 0ms nim 1.6.8
nim 1.nim 665ms 15ms 41.1MB 643ms 0ms nim 1.6.8
nim 1.nim 734ms 6.6ms 40.6MB 713ms 3ms nim/clang 1.6.8
python 1.py 3979ms 12ms 391.6MB 3850ms 110ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 122ms 0.5ms 11.1MB 110ms 0ms nim 1.6.8
nim 1.nim 128ms 0.3ms 11.4MB 117ms 0ms nim/clang 1.6.8
nim 2.nim 140ms 0.6ms 3.2MB 130ms 0ms nim/clang 1.6.8
nim 2.nim 153ms 1.0ms 2.9MB 140ms 0ms nim 1.6.8
python 1.py 985ms 51ms 215.7MB 930ms 37ms pypy 3.8.13
python 1.py 1795ms 29ms 86.0MB 1750ms 27ms pyston 3.8.12
python 1.py 4178ms 13ms 85.9MB 4140ms 23ms cpython 3.10.7

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2593ms 5.4ms 119.3MB 2537ms 43ms pypy 3.8.13
python 4.py 2770ms 1.9ms 8.6MB 2733ms 20ms cpython 3.10.7
python 4.py 2779ms 1.2ms 9.0MB 2740ms 20ms pyston 3.8.12
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 652ms 5.0ms 84.5MB 630ms 10ms pypy 3.8.13
python 4.py 657ms 1.0ms 8.6MB 640ms 0ms pyston 3.8.12
python 4.py 661ms 1.8ms 8.3MB 650ms 0ms cpython 3.10.7
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2569ms 0.7ms 167.2MB 2520ms 30ms nim/clang 1.6.8
nim 1.nim 2574ms 3.7ms 167.2MB 2527ms 33ms nim 1.6.8
python 1.py 3319ms 6.1ms 264.1MB 3210ms 90ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 265ms 1.4ms 17.0MB 250ms 3ms nim/clang 1.6.8
nim 1.nim 266ms 2.0ms 16.7MB 250ms 3ms nim 1.6.8
python 1.py 462ms 1.0ms 102.6MB 423ms 27ms pypy 3.8.13
python 1.py 696ms 3.9ms 30.3MB 670ms 10ms pyston 3.8.12
python 1.py 848ms 1.7ms 30.6MB 813ms 17ms cpython 3.10.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4121ms 3.1ms 1.9MB 4107ms 0ms nim 1.6.8
nim 1.nim 4122ms 2.2ms 1.8MB 4107ms 0ms nim/clang 1.6.8
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1032ms 0.1ms 1.0MB 1020ms 0ms nim/clang 1.6.8
nim 1.nim 1032ms 0.5ms 0.9MB 1020ms 0ms nim 1.6.8
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.9ms 1.0MB 250ms 0ms nim 1.6.8
nim 1.nim 261ms 1.0ms 1.0MB 250ms 0ms nim/clang 1.6.8
python 8-m.py 3224ms 95ms 109.9MB 5487ms 373ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12