Programming Language and compiler
Benchmarks

Go VS Python benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1423ms 18ms 273.9MB 1297ms 103ms pypy 3.8.13
go 1.go 2897ms 7.4ms 44.7MB 4130ms 57ms go 1.19.1
go 1.go 3962ms 29ms 39.1MB 3947ms 0ms tinygo 0.25.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 114ms 2.9ms 83.3MB 83ms 13ms pypy 3.8.13
go 1.go 257ms 2.9ms 8.2MB 333ms 3ms go 1.19.1
go 1.go 303ms 0.3ms 6.0MB 290ms 0ms tinygo 0.25.0
python 1.py 604ms 2.9ms 11.9MB 583ms 3ms pyston 3.8.12
python 1.py 1521ms 20ms 11.9MB 1507ms 3ms cpython 3.10.7

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 741ms 41ms 13.6MB 1443ms 0ms go 1.19.1
python 1.py 1008ms 16ms 196.8MB 940ms 57ms pypy 3.8.13
go 1.go 1717ms 3.5ms 253.7MB 1650ms 50ms tinygo 0.25.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 56ms 5.7ms 5.4MB 93ms 0ms go 1.19.1
python 1.py 260ms 0.8ms 95.4MB 223ms 20ms pypy 3.8.13
go 1.go 270ms 0.7ms 66.7MB 243ms 7ms tinygo 0.25.0
python 1.py 930ms 3.1ms 17.0MB 917ms 0ms pyston 3.8.12
python 1.py 977ms 2.6ms 17.0MB 963ms 0ms cpython 3.10.7

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 169ms 2.8ms 8.5MB 153ms 3ms go 1.19.1
python 1.py 810ms 2.1ms 88.0MB 777ms 17ms pypy 3.8.13
python 1.py 1669ms 0.8ms 9.3MB 1657ms 0ms cpython 3.10.7
python 1.py 2779ms 0.9ms 9.6MB 2760ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 2.5ms 8.2MB 40ms 0ms go 1.19.1
python 1.py 206ms 0.7ms 81.8MB 177ms 13ms pypy 3.8.13
python 1.py 308ms 0.6ms 8.5MB 293ms 0ms cpython 3.10.7
python 1.py 479ms 1.0ms 8.9MB 467ms 0ms pyston 3.8.12

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1448ms 9.9ms 3.0MB 2803ms 0ms go 1.19.1
go 3.go 2930ms 1.7ms 49.1MB 2910ms 10ms tinygo 0.25.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 144ms 1.8ms 5.0MB 223ms 0ms go 1.19.1
go 3.go 309ms 0.7ms 50.1MB 297ms 0ms tinygo 0.25.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 238ms 0.4ms 2.9MB 440ms 0ms go 1.19.1
python 1.py 2430ms 2.9ms 91.0MB 2397ms 17ms pypy 3.8.13
python 5-m.py 3362ms 35ms 12.7MB 4993ms 967ms pyston 3.8.12
python 5-m.py 3866ms 39ms 85.1MB 5200ms 1070ms pypy 3.8.13
python 1.py 4087ms 9.2ms 7.9MB 4070ms 3ms pyston 3.8.12
python 5-m.py 4441ms 70ms 12.0MB 6400ms 987ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 30ms 0.2ms 2.9MB 40ms 0ms go 1.19.1
python 1.py 326ms 3.7ms 81.6MB 290ms 17ms pypy 3.8.13
python 1.py 423ms 0.9ms 7.9MB 413ms 0ms pyston 3.8.12
python 5-m.py 481ms 4.4ms 12.6MB 707ms 110ms pyston 3.8.12
python 5-m.py 508ms 1.0ms 12.1MB 660ms 140ms cpython 3.10.7
python 1.py 708ms 2.1ms 7.8MB 697ms 0ms cpython 3.10.7
python 5-m.py 793ms 2.8ms 85.2MB 893ms 423ms pypy 3.8.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.8ms 0.7ms 2.0MB 0ms 0ms tinygo 0.25.0
go 1.go 2.7ms 0.4ms 2.9MB 0ms 0ms go 1.19.1
python 1.py 14ms 1.1ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 1.1ms 7.4MB 10ms 0ms cpython 3.10.7
python 1.py 34ms 2.3ms 54.9MB 12ms 8ms pypy 3.8.13

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 162ms 5.8ms 58.4MB 243ms 37ms go 1.19.1
go 1-m.go 567ms 30ms 179.2MB 543ms 323ms go 1.19.1
go 2-m.go 585ms 63ms 176.1MB 580ms 343ms go 1.19.1
python 1.py 1540ms 5.2ms 29.2MB 1313ms 873ms pyston 3.8.12
python 1.py 2194ms 16ms 31.2MB 1910ms 1010ms cpython 3.10.7
python 1.py 4259ms 35ms 130.2MB 3287ms 887ms pypy 3.8.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 40ms 3.1ms 22.7MB 40ms 10ms go 1.19.1
go 2.go 113ms 1.2ms 39.1MB 80ms 43ms go 1.19.1
go 1.go 119ms 8.4ms 38.0MB 77ms 50ms go 1.19.1
python 1.py 349ms 2.0ms 23.3MB 277ms 167ms pyston 3.8.12
python 1.py 436ms 1.4ms 23.8MB 363ms 187ms cpython 3.10.7
python 1.py 1073ms 11ms 105.9MB 880ms 163ms pypy 3.8.13

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 71ms 0.4ms 39.5MB 53ms 13ms go 1.19.1
go 1.go 171ms 2.1ms 20.2MB 157ms 7ms go 1.19.1
python 1.py 246ms 1.7ms 38.2MB 220ms 10ms pyston 3.8.12
python 1.py 263ms 3.1ms 38.7MB 237ms 10ms cpython 3.10.7
python 1.py 423ms 1.8ms 109.1MB 387ms 20ms pypy 3.8.13

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 396ms 8.4ms 187.8MB 373ms 90ms go 1.19.1
go 1.go 1039ms 5.9ms 106.0MB 1003ms 63ms go 1.19.1
python 1.py 2313ms 2.4ms 220.6MB 2177ms 123ms pyston 3.8.12
python 1.py 2326ms 1.8ms 219.6MB 2197ms 113ms cpython 3.10.7
python 1.py 2580ms 12ms 248.8MB 2497ms 67ms pypy 3.8.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1510ms 5.2ms 41.1MB 2797ms 37ms go 1.19.1
python 3-m.py 3411ms 2.7ms 203.0MB 5960ms 320ms pypy 3.8.13
python 3-m.py 4696ms 72ms 34.2MB 8987ms 57ms pyston 3.8.12
python 3.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 226ms 3.0ms 22.4MB 360ms 13ms go 1.19.1
python 3-m.py 516ms 7.9ms 97.3MB 743ms 110ms pypy 3.8.13
python 3-m.py 550ms 5.5ms 15.7MB 953ms 47ms pyston 3.8.12
python 3-m.py 832ms 4.8ms 13.6MB 1517ms 13ms cpython 3.10.7

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 166ms 0.4ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 173ms 1.4ms 2.8MB 160ms 0ms go 1.19.1
python 2.py 196ms 0.7ms 79.9MB 170ms 10ms pypy 3.8.13
python 1.py 237ms 1.7ms 81.0MB 210ms 13ms pypy 3.8.13
python 1.py 985ms 4.4ms 9.0MB 963ms 3ms pyston 3.8.12
python 2.py 1156ms 8.0ms 8.7MB 1147ms 0ms pyston 3.8.12
python 1.py 1833ms 6.7ms 8.4MB 1823ms 0ms cpython 3.10.7
python 2.py 2618ms 42ms 8.3MB 2603ms 0ms cpython 3.10.7

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 461ms 1.8ms 80.0MB 433ms 13ms pypy 3.8.13
go 3.go 491ms 0.3ms 0.3MB 480ms 0ms tinygo 0.25.0
python 1.py 503ms 2.3ms 81.3MB 467ms 20ms pypy 3.8.13
go 3.go 514ms 3.1ms 3.4MB 500ms 0ms go 1.19.1
python 1.py 2936ms 17ms 8.9MB 2927ms 0ms pyston 3.8.12
python 2.py 3435ms 11ms 8.7MB 3420ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 81ms 0.5ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 93ms 2.3ms 5.6MB 83ms 0ms go 1.19.1
python 2.py 142ms 1.4ms 79.8MB 117ms 13ms pypy 3.8.13
python 1.py 160ms 3.5ms 81.1MB 137ms 13ms pypy 3.8.13
python 1.py 475ms 1.5ms 8.7MB 463ms 0ms pyston 3.8.12
python 2.py 539ms 2.5ms 8.2MB 523ms 0ms pyston 3.8.12
python 1.py 870ms 12ms 7.9MB 853ms 0ms cpython 3.10.7
python 2.py 1251ms 9.8ms 7.3MB 1237ms 0ms cpython 3.10.7

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4110ms 15ms 6.9MB 4093ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 171ms 0.3ms 2.8MB 160ms 0ms go 1.19.1
go 1.go 245ms 0.3ms 0.0MB 233ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1891ms 8.9ms 38.2MB 2680ms 17ms go 1.19.1
python 1.py 2222ms 2.5ms 293.8MB 2007ms 193ms pypy 3.8.13
go 2.go 2233ms 22ms 52.9MB 3143ms 57ms go 1.19.1
go 1.go 3053ms 3.0ms 159.8MB 3003ms 37ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 323ms 3.3ms 144.9MB 263ms 47ms pypy 3.8.13
go 1.go 409ms 5.1ms 12.5MB 563ms 10ms go 1.19.1
go 2.go 477ms 1.5ms 14.3MB 647ms 20ms go 1.19.1
go 1.go 800ms 6.4ms 39.1MB 783ms 3ms tinygo 0.25.0
go 2.go 1329ms 3.7ms 52.1MB 1313ms 0ms tinygo 0.25.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 454ms 2.2ms 2.9MB 440ms 0ms go 1.19.1
go 1.go 842ms 0.7ms 0.0MB 830ms 0ms tinygo 0.25.0
python 2.py 1903ms 43ms 80.2MB 1873ms 10ms pypy 3.8.13
python 1.py 4875ms 37ms 79.5MB 4843ms 13ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 1.8ms 2.9MB 37ms 0ms go 1.19.1
go 1.go 86ms 0.5ms 0.0MB 80ms 0ms tinygo 0.25.0
python 2.py 250ms 4.9ms 79.9MB 217ms 17ms pypy 3.8.13
python 1.py 534ms 3.2ms 79.3MB 510ms 13ms pypy 3.8.13
python 1.py 1197ms 9.9ms 8.3MB 1183ms 0ms pyston 3.8.12
python 2.py 1623ms 53ms 8.2MB 1610ms 0ms pyston 3.8.12
python 1.py 4672ms 67ms 7.4MB 4657ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 574ms 29ms 75.2MB 540ms 13ms go 1.19.1
go 2.go 632ms 2.0ms 17.4MB 613ms 0ms tinygo 0.25.0
go 1.go 749ms 39ms 43.8MB 727ms 7ms tinygo 0.25.0
go 2.go 915ms 14ms 20.0MB 897ms 10ms go 1.19.1
python 1.py 3909ms 23ms 391.6MB 3780ms 113ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 133ms 1.5ms 13.9MB 120ms 0ms tinygo 0.25.0
go 1.go 134ms 8.0ms 21.9MB 120ms 0ms go 1.19.1
go 2.go 146ms 0.6ms 5.4MB 133ms 0ms tinygo 0.25.0
go 2.go 218ms 2.3ms 8.1MB 200ms 3ms go 1.19.1
python 1.py 859ms 7.3ms 215.9MB 807ms 40ms pypy 3.8.13
python 1.py 1794ms 18ms 86.0MB 1753ms 27ms pyston 3.8.12
python 1.py 3919ms 114ms 85.9MB 3883ms 17ms cpython 3.10.7

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1425ms 2.8ms 8.4MB 1393ms 10ms go 1.19.1
python 4.py 2546ms 5.2ms 120.0MB 2507ms 23ms pypy 3.8.13
python 4.py 2766ms 0.4ms 8.6MB 2740ms 7ms cpython 3.10.7
python 4.py 2779ms 0.7ms 9.0MB 2750ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 338ms 1.2ms 8.4MB 323ms 0ms go 1.19.1
python 4.py 649ms 6.3ms 84.4MB 620ms 10ms pypy 3.8.13
python 4.py 657ms 0.1ms 8.7MB 647ms 0ms pyston 3.8.12
python 4.py 662ms 0.7ms 8.3MB 650ms 0ms cpython 3.10.7

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3306ms 4.7ms 263.8MB 3217ms 73ms pypy 3.8.13
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 456ms 1.9ms 104.3MB 413ms 23ms pypy 3.8.13
python 1.py 693ms 1.3ms 29.8MB 660ms 13ms pyston 3.8.12
python 1.py 842ms 2.3ms 30.9MB 810ms 17ms cpython 3.10.7
go 3.go 2475ms 29ms 18.2MB 2460ms 20ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 170ms 1.5ms 8.1MB 160ms 3ms go 1.19.1
python 1.py 4446ms 13ms 8.4MB 4433ms 0ms pyston 3.8.12
python 1.py 4743ms 5.5ms 87.4MB 4710ms 17ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 54ms 0.8ms 9.5MB 47ms 0ms go 1.19.1
python 1.py 1131ms 8.0ms 8.4MB 1113ms 0ms pyston 3.8.12
python 1.py 1329ms 0.9ms 84.4MB 1293ms 20ms pypy 3.8.13
python 1.py 1478ms 2.4ms 7.3MB 1470ms 0ms cpython 3.10.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2499ms 19ms 5.5MB 4830ms 0ms go 1.19.1
go 1.go 4890ms 3.2ms 5.5MB 4880ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 627ms 1.2ms 2.9MB 1193ms 0ms go 1.19.1
go 1.go 1227ms 6.7ms 2.9MB 1213ms 0ms go 1.19.1
go 1.go 2576ms 1.3ms 0.0MB 2563ms 0ms tinygo 0.25.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 165ms 0.6ms 2.9MB 297ms 0ms go 1.19.1
go 1.go 310ms 1.4ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 646ms 0.6ms 2.0MB 640ms 0ms tinygo 0.25.0
python 8-m.py 3207ms 84ms 110.9MB 5483ms 330ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12