Programming Language and compiler
Benchmarks

Python VS Go benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1667ms 61ms 273.7MB 1530ms 110ms pypy 3.8.13
go 1.go 3208ms 18ms 45.7MB 4603ms 63ms go 1.18.2
go 1.go 4543ms 15ms 39.4MB 4520ms 7ms tinygo 0.23.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 128ms 2.2ms 82.9MB 83ms 20ms pypy 3.8.13
go 1.go 282ms 9.2ms 8.2MB 330ms 0ms go 1.18.2
go 1.go 360ms 1.9ms 6.3MB 350ms 0ms tinygo 0.23.0
python 1.py 641ms 4.3ms 12.3MB 610ms 13ms pyston 3.8.12
python 1.py 1532ms 2.7ms 11.8MB 1517ms 0ms cpython 3.10.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 838ms 145ms 13.6MB 1630ms 0ms go 1.18.2
python 1.py 1216ms 5.5ms 196.8MB 1140ms 60ms pypy 3.8.13
go 1.go 1779ms 20ms 257.5MB 1707ms 57ms tinygo 0.23.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 62ms 0.8ms 5.4MB 97ms 0ms go 1.18.2
go 1.go 275ms 1.2ms 66.3MB 257ms 3ms tinygo 0.23.0
python 1.py 293ms 12ms 95.1MB 257ms 17ms pypy 3.8.13
python 1.py 965ms 4.9ms 17.2MB 947ms 3ms pyston 3.8.12
python 1.py 1003ms 35ms 17.1MB 967ms 0ms cpython 3.10.4

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 170ms 2.3ms 8.4MB 160ms 0ms go 1.18.2
python 1.py 833ms 2.0ms 87.8MB 790ms 30ms pypy 3.8.13
python 1.py 2857ms 0.4ms 10.0MB 2843ms 0ms pyston 3.8.12
python 1.py 2859ms 0.7ms 9.3MB 2843ms 0ms cpython 3.10.4

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 53ms 0.8ms 7.2MB 40ms 0ms go 1.18.2
python 1.py 218ms 1.9ms 81.6MB 183ms 20ms pypy 3.8.13
python 1.py 495ms 1.8ms 9.2MB 480ms 0ms pyston 3.8.12
python 1.py 504ms 1.7ms 8.5MB 490ms 0ms cpython 3.10.4

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 250ms 1.9ms 2.9MB 453ms 3ms go 1.18.2
python 1.py 2691ms 81ms 90.8MB 2643ms 30ms pypy 3.8.13
python 5-m.py 3357ms 14ms 12.9MB 4937ms 1013ms pyston 3.8.12
python 5-m.py 3998ms 20ms 85.2MB 4463ms 930ms pypy 3.8.13
python 1.py 4467ms 32ms 8.2MB 4447ms 3ms pyston 3.8.12
python 5-m.py 4473ms 26ms 12.1MB 6287ms 1063ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 32ms 0.5ms 2.9MB 37ms 0ms go 1.18.2
python 1.py 347ms 5.0ms 81.5MB 320ms 13ms pypy 3.8.13
python 5-m.py 408ms 6.5ms 12.9MB 537ms 130ms pyston 3.8.12
python 1.py 460ms 2.0ms 8.2MB 447ms 0ms pyston 3.8.12
python 5-m.py 522ms 3.8ms 12.0MB 670ms 147ms cpython 3.10.4
python 1.py 732ms 8.2ms 7.8MB 717ms 0ms cpython 3.10.4
python 5-m.py 813ms 7.3ms 85.3MB 900ms 443ms pypy 3.8.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.7ms 0.1ms 0.0MB 0ms 0ms tinygo 0.23.0
go 1.go 2.9ms 0.3ms 2.8MB 0ms 0ms go 1.18.2
python 1.py 14ms 1.1ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.6ms 7.5MB 10ms 0ms cpython 3.10.4
python 1.py 34ms 1.1ms 53.6MB 10ms 10ms pypy 3.8.13

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 207ms 52ms 54.5MB 287ms 33ms go 1.18.2
go 2-m.go 548ms 19ms 165.5MB 467ms 393ms go 1.18.2
go 1-m.go 624ms 90ms 186.4MB 577ms 403ms go 1.18.2
python 1.py 1591ms 2.0ms 29.9MB 1273ms 967ms pyston 3.8.12
python 1.py 2223ms 6.7ms 27.3MB 1947ms 1003ms cpython 3.10.4
python 1.py 4366ms 54ms 129.3MB 3380ms 903ms pypy 3.8.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 30ms 19ms 20.5MB 35ms 15ms go 1.18.2
go 2.go 124ms 16ms 39.2MB 77ms 53ms go 1.18.2
go 1.go 137ms 2.7ms 38.9MB 93ms 50ms go 1.18.2
python 1.py 360ms 1.0ms 24.0MB 300ms 157ms pyston 3.8.12
python 1.py 449ms 12ms 21.9MB 373ms 180ms cpython 3.10.4
python 1.py 1101ms 12ms 104.5MB 907ms 163ms pypy 3.8.13

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 81ms 2.9ms 45.2MB 67ms 7ms go 1.18.2
go 1.go 171ms 3.0ms 20.4MB 163ms 3ms go 1.18.2
python 1.py 263ms 2.8ms 38.6MB 240ms 7ms pyston 3.8.12
python 1.py 266ms 1.5ms 39.5MB 240ms 10ms cpython 3.10.4
python 1.py 431ms 0.6ms 109.0MB 380ms 30ms pypy 3.8.13

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 385ms 6.8ms 211.3MB 387ms 40ms go 1.18.2
go 1.go 1052ms 3.0ms 110.5MB 1023ms 40ms go 1.18.2
python 1.py 2403ms 5.3ms 219.7MB 2277ms 110ms cpython 3.10.4
python 1.py 2446ms 4.3ms 221.0MB 2263ms 167ms pyston 3.8.12
python 1.py 2600ms 2.7ms 249.5MB 2507ms 80ms pypy 3.8.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1495ms 29ms 39.7MB 2737ms 40ms go 1.18.2
python 3-m.py 3674ms 52ms 204.5MB 6457ms 323ms pypy 3.8.13
python 3.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 3.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 229ms 1.6ms 21.5MB 353ms 20ms go 1.18.2
python 3-m.py 539ms 4.5ms 97.1MB 800ms 100ms pypy 3.8.13
python 3-m.py 656ms 4.0ms 16.3MB 1163ms 30ms pyston 3.8.12
python 3-m.py 932ms 8.3ms 15.3MB 1690ms 33ms cpython 3.10.4

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 165ms 0.4ms 2.0MB 153ms 0ms tinygo 0.23.0
go 3.go 173ms 2.5ms 2.9MB 160ms 0ms go 1.18.2
python 2.py 204ms 2.0ms 79.9MB 160ms 23ms pypy 3.8.13
python 1.py 244ms 0.9ms 81.2MB 217ms 10ms pypy 3.8.13
python 1.py 1052ms 3.9ms 9.3MB 1040ms 0ms pyston 3.8.12
python 2.py 1290ms 15ms 9.0MB 1277ms 0ms pyston 3.8.12
python 1.py 1848ms 8.2ms 8.3MB 1830ms 0ms cpython 3.10.4
python 2.py 2609ms 24ms 8.3MB 2597ms 0ms cpython 3.10.4

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 470ms 1.2ms 80.1MB 443ms 10ms pypy 3.8.13
go 3.go 490ms 0.9ms 2.0MB 480ms 0ms tinygo 0.23.0
go 3.go 506ms 3.4ms 2.9MB 490ms 0ms go 1.18.2
python 1.py 513ms 2.9ms 81.2MB 490ms 10ms pypy 3.8.13
python 1.py 3126ms 28ms 9.3MB 3117ms 0ms pyston 3.8.12
python 2.py 3831ms 16ms 9.1MB 3817ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 80ms 0.2ms 0.0MB 70ms 0ms tinygo 0.23.0
go 3.go 90ms 0.8ms 3.8MB 80ms 0ms go 1.18.2
python 2.py 147ms 0.7ms 80.0MB 117ms 13ms pypy 3.8.13
python 1.py 164ms 1.1ms 80.8MB 137ms 13ms pypy 3.8.13
python 1.py 519ms 1.1ms 9.0MB 503ms 0ms pyston 3.8.12
python 2.py 597ms 5.7ms 8.5MB 583ms 0ms pyston 3.8.12
python 1.py 868ms 2.3ms 7.8MB 857ms 0ms cpython 3.10.4
python 2.py 1256ms 4.4ms 7.4MB 1240ms 0ms cpython 3.10.4

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2093ms 7.9ms 40.0MB 2973ms 50ms go 1.18.2
go 2.go 2355ms 17ms 49.2MB 3370ms 53ms go 1.18.2
python 1.py 2718ms 66ms 293.9MB 2520ms 183ms pypy 3.8.13
go 1.go 4907ms 0.8ms 160.4MB 4863ms 27ms tinygo 0.23.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 387ms 1.3ms 144.6MB 327ms 43ms pypy 3.8.13
go 1.go 433ms 9.3ms 12.2MB 590ms 10ms go 1.18.2
go 2.go 497ms 3.8ms 12.9MB 697ms 7ms go 1.18.2
go 1.go 861ms 4.0ms 38.3MB 843ms 0ms tinygo 0.23.0
go 2.go 1481ms 5.6ms 38.6MB 1467ms 0ms tinygo 0.23.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 456ms 2.9ms 2.8MB 447ms 0ms go 1.18.2
go 1.go 844ms 2.5ms 2.0MB 830ms 0ms tinygo 0.23.0
python 2.py 2186ms 36ms 79.8MB 2157ms 13ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 52ms 0.6ms 2.8MB 37ms 0ms go 1.18.2
go 1.go 87ms 1.1ms 2.0MB 80ms 0ms tinygo 0.23.0
python 2.py 282ms 2.1ms 79.5MB 257ms 10ms pypy 3.8.13
python 1.py 590ms 2.3ms 79.7MB 563ms 10ms pypy 3.8.13
python 1.py 1463ms 3.4ms 8.6MB 1450ms 0ms pyston 3.8.12
python 2.py 2152ms 28ms 8.5MB 2140ms 0ms pyston 3.8.12
python 1.py 4709ms 32ms 7.3MB 4693ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2.go 646ms 5.3ms 17.4MB 637ms 0ms tinygo 0.23.0
go 1.go 821ms 37ms 73.6MB 800ms 3ms go 1.18.2
go 1.go 864ms 3.5ms 42.3MB 847ms 3ms tinygo 0.23.0
go 2.go 929ms 3.5ms 20.1MB 923ms 0ms go 1.18.2
python 1.py 4135ms 8.4ms 391.3MB 4000ms 113ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 120ms 1.0ms 21.9MB 103ms 3ms go 1.18.2
go 1.go 133ms 1.9ms 13.3MB 117ms 0ms tinygo 0.23.0
go 2.go 154ms 2.0ms 5.6MB 140ms 0ms tinygo 0.23.0
go 2.go 221ms 2.3ms 9.5MB 210ms 0ms go 1.18.2
python 1.py 1053ms 100ms 215.9MB 993ms 40ms pypy 3.8.13
python 1.py 2722ms 31ms 86.4MB 2687ms 17ms pyston 3.8.12
python 1.py 4283ms 21ms 85.9MB 4240ms 27ms cpython 3.10.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1377ms 4.0ms 8.6MB 1357ms 3ms go 1.18.2
python 4.py 2762ms 3.2ms 9.4MB 2727ms 17ms pyston 3.8.12
python 4.py 2782ms 2.3ms 8.5MB 2740ms 23ms cpython 3.10.4
python 4.py 2800ms 13ms 119.5MB 2757ms 27ms pypy 3.8.13

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 329ms 1.8ms 8.5MB 310ms 0ms go 1.18.2
python 4.py 655ms 0.7ms 9.1MB 643ms 0ms pyston 3.8.12
python 4.py 666ms 2.4ms 8.3MB 650ms 0ms cpython 3.10.4
python 4.py 694ms 12ms 84.5MB 663ms 13ms pypy 3.8.13

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3343ms 4.3ms 264.1MB 3253ms 80ms pypy 3.8.13
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 469ms 1.3ms 103.4MB 423ms 30ms pypy 3.8.13
python 1.py 745ms 2.2ms 30.4MB 707ms 17ms pyston 3.8.12
python 1.py 871ms 1.3ms 31.0MB 840ms 20ms cpython 3.10.4
go 3.go 2553ms 26ms 18.0MB 2543ms 17ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 172ms 1.0ms 9.7MB 157ms 7ms go 1.18.2
python 1.py 4525ms 6.4ms 8.7MB 4513ms 0ms pyston 3.8.12
python 1.py 4943ms 15ms 87.2MB 4900ms 23ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.5ms 9.5MB 43ms 0ms go 1.18.2
python 1.py 1147ms 4.0ms 8.6MB 1133ms 0ms pyston 3.8.12
python 1.py 1399ms 2.2ms 84.2MB 1367ms 17ms pypy 3.8.13
python 1.py 1490ms 3.6ms 7.7MB 1473ms 0ms cpython 3.10.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2513ms 5.8ms 5.3MB 4870ms 7ms go 1.18.2
go 1.go 4978ms 9.8ms 5.4MB 4963ms 0ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 636ms 1.3ms 3.3MB 1207ms 0ms go 1.18.2
go 1.go 1246ms 1.8ms 3.3MB 1230ms 3ms go 1.18.2
go 1.go 2576ms 0.3ms 0.0MB 2567ms 0ms tinygo 0.23.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 168ms 1.2ms 2.8MB 300ms 0ms go 1.18.2
go 1.go 317ms 2.2ms 2.8MB 303ms 0ms go 1.18.2
go 1.go 647ms 0.4ms 2.0MB 640ms 0ms tinygo 0.23.0
python 8-m.py 3295ms 48ms 110.4MB 5600ms 377ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12