Programming Language and compiler
Benchmarks

V VS Python benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1118ms 8.9ms 37.2MB 1100ms 0ms v/clang+gc 0.2.4
python 1.py 1667ms 61ms 273.7MB 1530ms 110ms pypy 3.8.13
v 1.v 2375ms 3.1ms 2086.3MB 1607ms 750ms v/clang 0.2.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 116ms 1.6ms 5.6MB 107ms 0ms v/clang+gc 0.2.4
python 1.py 128ms 2.2ms 82.9MB 83ms 20ms pypy 3.8.13
v 1.v 220ms 0.6ms 197.8MB 133ms 73ms v/clang 0.2.4
python 1.py 641ms 4.3ms 12.3MB 610ms 13ms pyston 3.8.12
python 1.py 1532ms 2.7ms 11.8MB 1517ms 0ms cpython 3.10.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1216ms 5.5ms 196.8MB 1140ms 60ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang 0.2.4
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.2.4

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 293ms 12ms 95.1MB 257ms 17ms pypy 3.8.13
python 1.py 965ms 4.9ms 17.2MB 947ms 3ms pyston 3.8.12
python 1.py 1003ms 35ms 17.1MB 967ms 0ms cpython 3.10.4
v 1-m.v 2078ms 196ms 18.2MB 1930ms 1983ms v/clang 0.2.4
v 1-m.v 2154ms 386ms 18.8MB 2113ms 1923ms v/clang+gc 0.2.4

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 833ms 2.0ms 87.8MB 790ms 30ms pypy 3.8.13
python 1.py 2857ms 0.4ms 10.0MB 2843ms 0ms pyston 3.8.12
python 1.py 2859ms 0.7ms 9.3MB 2843ms 0ms cpython 3.10.4
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.2.4

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 218ms 1.9ms 81.6MB 183ms 20ms pypy 3.8.13
python 1.py 495ms 1.8ms 9.2MB 480ms 0ms pyston 3.8.12
python 1.py 504ms 1.7ms 8.5MB 490ms 0ms cpython 3.10.4
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.2.4

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3311ms 2.6ms 1.9MB 3300ms 0ms v/clang+gc 0.2.4
v 1.v 3417ms 147ms 0.6MB 3407ms 0ms v/clang 0.2.4

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 277ms 1.0ms 2.1MB 263ms 0ms v/clang+gc 0.2.4
v 1.v 281ms 1.5ms 0.6MB 267ms 0ms v/clang 0.2.4

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 769ms 0.5ms 2.2MB 630ms 123ms v/clang+gc 0.2.4
v 1.v 837ms 2.2ms 0.6MB 720ms 100ms v/clang 0.2.4
python 1.py 2691ms 81ms 90.8MB 2643ms 30ms pypy 3.8.13
python 5-m.py 3357ms 14ms 12.9MB 4937ms 1013ms pyston 3.8.12
python 5-m.py 3998ms 20ms 85.2MB 4463ms 930ms pypy 3.8.13
python 1.py 4467ms 32ms 8.2MB 4447ms 3ms pyston 3.8.12
python 5-m.py 4473ms 26ms 12.1MB 6287ms 1063ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 81ms 1.1ms 2.3MB 63ms 3ms v/clang+gc 0.2.4
v 1.v 86ms 1.0ms 0.6MB 63ms 10ms v/clang 0.2.4
python 1.py 347ms 5.0ms 81.5MB 320ms 13ms pypy 3.8.13
python 5-m.py 408ms 6.5ms 12.9MB 537ms 130ms pyston 3.8.12
python 1.py 460ms 2.0ms 8.2MB 447ms 0ms pyston 3.8.12
python 5-m.py 522ms 3.8ms 12.0MB 670ms 147ms cpython 3.10.4
python 1.py 732ms 8.2ms 7.8MB 717ms 0ms cpython 3.10.4
python 5-m.py 813ms 7.3ms 85.3MB 900ms 443ms pypy 3.8.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1.5ms 0.7ms 0.6MB 0ms 0ms v/clang 0.2.4
v 1.v 2.5ms 0.9ms 1.9MB 0ms 0ms v/clang+gc 0.2.4
python 1.py 14ms 1.1ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.6ms 7.5MB 10ms 0ms cpython 3.10.4
python 1.py 34ms 1.1ms 53.6MB 10ms 10ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 204ms 2.0ms 79.9MB 160ms 23ms pypy 3.8.13
python 1.py 244ms 0.9ms 81.2MB 217ms 10ms pypy 3.8.13
v 1.v 399ms 1.3ms 0.6MB 390ms 0ms v/clang 0.2.4
v 1.v 416ms 0.8ms 2.3MB 400ms 0ms v/clang+gc 0.2.4
python 1.py 1052ms 3.9ms 9.3MB 1040ms 0ms pyston 3.8.12
python 2.py 1290ms 15ms 9.0MB 1277ms 0ms pyston 3.8.12
python 1.py 1848ms 8.2ms 8.3MB 1830ms 0ms cpython 3.10.4
python 2.py 2609ms 24ms 8.3MB 2597ms 0ms cpython 3.10.4

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 470ms 1.2ms 80.1MB 443ms 10ms pypy 3.8.13
python 1.py 513ms 2.9ms 81.2MB 490ms 10ms pypy 3.8.13
v 1.v 1186ms 1.6ms 0.6MB 1177ms 0ms v/clang 0.2.4
v 1.v 1244ms 1.7ms 2.3MB 1230ms 0ms v/clang+gc 0.2.4
python 1.py 3126ms 28ms 9.3MB 3117ms 0ms pyston 3.8.12
python 2.py 3831ms 16ms 9.1MB 3817ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 127ms 0.4ms 0.6MB 120ms 0ms v/clang 0.2.4
v 1.v 135ms 1.2ms 2.3MB 120ms 0ms v/clang+gc 0.2.4
python 2.py 147ms 0.7ms 80.0MB 117ms 13ms pypy 3.8.13
python 1.py 164ms 1.1ms 80.8MB 137ms 13ms pypy 3.8.13
python 1.py 519ms 1.1ms 9.0MB 503ms 0ms pyston 3.8.12
python 2.py 597ms 5.7ms 8.5MB 583ms 0ms pyston 3.8.12
python 1.py 868ms 2.3ms 7.8MB 857ms 0ms cpython 3.10.4
python 2.py 1256ms 4.4ms 7.4MB 1240ms 0ms cpython 3.10.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 988ms 1.1ms 0.8MB 980ms 0ms v/clang 0.2.4
v 1.v 1015ms 4.4ms 2.4MB 1003ms 0ms v/clang+gc 0.2.4
python 2.py 2186ms 36ms 79.8MB 2157ms 13ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 104ms 5.6ms 0.9MB 93ms 0ms v/clang 0.2.4
v 1.v 104ms 0.2ms 2.3MB 90ms 0ms v/clang+gc 0.2.4
python 2.py 282ms 2.1ms 79.5MB 257ms 10ms pypy 3.8.13
python 1.py 590ms 2.3ms 79.7MB 563ms 10ms pypy 3.8.13
python 1.py 1463ms 3.4ms 8.6MB 1450ms 0ms pyston 3.8.12
python 2.py 2152ms 28ms 8.5MB 2140ms 0ms pyston 3.8.12
python 1.py 4709ms 32ms 7.3MB 4693ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 509ms 13ms 6.8MB 490ms 0ms v/clang+gc 0.2.4
v 1.v 533ms 20ms 40.2MB 517ms 3ms v/clang 0.2.4
v 1.v 539ms 16ms 41.2MB 527ms 0ms v/clang+gc 0.2.4
python 1.py 4135ms 8.4ms 391.3MB 4000ms 113ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 117ms 1.0ms 3.2MB 103ms 0ms v/clang+gc 0.2.4
v 1.v 118ms 0.6ms 11.0MB 110ms 0ms v/clang 0.2.4
v 1.v 118ms 2.9ms 19.1MB 100ms 0ms v/clang+gc 0.2.4
python 1.py 1053ms 100ms 215.9MB 993ms 40ms pypy 3.8.13
python 1.py 2722ms 31ms 86.4MB 2687ms 17ms pyston 3.8.12
python 1.py 4283ms 21ms 85.9MB 4240ms 27ms cpython 3.10.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2762ms 3.2ms 9.4MB 2727ms 17ms pyston 3.8.12
python 4.py 2782ms 2.3ms 8.5MB 2740ms 23ms cpython 3.10.4
python 4.py 2800ms 13ms 119.5MB 2757ms 27ms pypy 3.8.13
v 1.v 4672ms 119ms 3.2MB 4640ms 10ms v/clang+gc 0.2.4
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang 0.2.4
v 2.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.2.4

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 655ms 0.7ms 9.1MB 643ms 0ms pyston 3.8.12
python 4.py 666ms 2.4ms 8.3MB 650ms 0ms cpython 3.10.4
python 4.py 694ms 12ms 84.5MB 663ms 13ms pypy 3.8.13
v 1.v 1163ms 20ms 2.7MB 1147ms 0ms v/clang+gc 0.2.4
v 2.v 1568ms 4.5ms 3.2MB 1550ms 3ms v/clang+gc 0.2.4
v 1.v 2202ms 1.6ms 2459.0MB 1173ms 1017ms v/clang 0.2.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 4117ms 0.3ms 1.8MB 4110ms 0ms v/clang 0.2.4
v 1.v 4119ms 2.0ms 3.0MB 4103ms 0ms v/clang+gc 0.2.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1032ms 0.5ms 2.5MB 1020ms 0ms v/clang+gc 0.2.4
v 1.v 1043ms 2.3ms 0.8MB 1017ms 0ms v/clang 0.2.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 261ms 0.6ms 2.6MB 250ms 0ms v/clang+gc 0.2.4
v 1.v 269ms 2.7ms 0.8MB 247ms 0ms v/clang 0.2.4
python 8-m.py 3295ms 48ms 110.4MB 5600ms 377ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12