Programming Language and compiler
Benchmarks

V VS Python benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1261ms 2.9ms 37.0MB 1230ms 13ms v/clang 0.3.1
v 1.v 1269ms 15ms 37.2MB 1243ms 13ms v/clang+gc 0.3.1
python 1.py 1760ms 27ms 220.4MB 1617ms 123ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 119ms 0.8ms 5.6MB 110ms 0ms v/clang+gc 0.3.1
v 1.v 121ms 4.5ms 5.6MB 107ms 0ms v/clang 0.3.1
python 1.py 143ms 21ms 78.6MB 97ms 23ms pypy 3.8.13
python 1.py 672ms 1.8ms 12.0MB 647ms 10ms pyston 3.8.12
python 1.py 1631ms 5.5ms 11.8MB 1610ms 3ms cpython 3.10.7

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1507ms 105ms 221.2MB 1387ms 107ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang 0.3.1
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 311ms 11ms 90.3MB 267ms 23ms pypy 3.8.13
python 1.py 867ms 4.7ms 16.9MB 837ms 7ms pyston 3.8.12
python 1.py 932ms 46ms 16.9MB 883ms 7ms cpython 3.10.7
v 1-m.v 2037ms 35ms 24.4MB 1980ms 1840ms v/clang+gc 0.3.1
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang 0.3.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 754ms 3.2ms 83.2MB 710ms 27ms pypy 3.8.13
python 1.py 1409ms 0.8ms 9.3MB 1397ms 0ms cpython 3.10.7
python 1.py 2303ms 5.0ms 9.7MB 2283ms 0ms pyston 3.8.12
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.3.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 214ms 1.1ms 75.9MB 173ms 23ms pypy 3.8.13
python 1.py 267ms 1.1ms 8.5MB 250ms 0ms cpython 3.10.7
python 1.py 405ms 0.6ms 8.9MB 390ms 0ms pyston 3.8.12
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.3.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3035ms 6.2ms 2.0MB 3023ms 0ms v/clang 0.3.1
v 1.v 3110ms 179ms 2.0MB 3093ms 0ms v/clang+gc 0.3.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 250ms 1.0ms 1.9MB 240ms 0ms v/clang+gc 0.3.1
v 1.v 251ms 1.1ms 2.0MB 237ms 0ms v/clang 0.3.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 485ms 0.7ms 2.2MB 470ms 0ms v/clang 0.3.1
v 1.v 488ms 2.3ms 2.2MB 473ms 0ms v/clang+gc 0.3.1
python 1.py 3029ms 165ms 89.2MB 2983ms 27ms pypy 3.8.13
python 5-m.py 3558ms 20ms 12.6MB 5183ms 1190ms pyston 3.8.12
python 1.py 3999ms 58ms 7.9MB 3983ms 0ms pyston 3.8.12
python 5-m.py 4619ms 10ms 12.1MB 6683ms 1273ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 5-m.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 52ms 0.2ms 2.3MB 40ms 0ms v/clang+gc 0.3.1
v 1.v 53ms 1.1ms 2.2MB 40ms 0ms v/clang 0.3.1
python 1.py 387ms 10.0ms 75.2MB 357ms 17ms pypy 3.8.13
python 1.py 410ms 0.9ms 7.9MB 397ms 0ms pyston 3.8.12
python 5-m.py 438ms 9.0ms 12.7MB 557ms 160ms pyston 3.8.12
python 5-m.py 575ms 55ms 12.1MB 727ms 160ms cpython 3.10.7
python 1.py 714ms 3.9ms 7.8MB 700ms 0ms cpython 3.10.7
python 5-m.py 916ms 11ms 78.8MB 1077ms 460ms pypy 3.8.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 2.2ms 0.7ms 2.0MB 0ms 0ms v/clang+gc 0.3.1
v 1.v 2.4ms 0.5ms 2.1MB 0ms 0ms v/clang 0.3.1
python 1.py 14ms 0.9ms 7.4MB 10ms 0ms cpython 3.10.7
python 1.py 15ms 2.2ms 7.2MB 10ms 0ms pyston 3.8.12
python 1.py 38ms 0.5ms 55.0MB 12ms 12ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 238ms 4.4ms 73.9MB 200ms 20ms pypy 3.8.13
python 1.py 278ms 1.8ms 75.5MB 240ms 20ms pypy 3.8.13
v 1.v 359ms 0.6ms 2.2MB 350ms 0ms v/clang+gc 0.3.1
v 1.v 373ms 0.5ms 2.2MB 360ms 0ms v/clang 0.3.1
python 1.py 937ms 1.0ms 8.9MB 920ms 0ms pyston 3.8.12
python 2.py 1082ms 6.0ms 8.7MB 1070ms 0ms pyston 3.8.12
python 1.py 1759ms 7.5ms 8.4MB 1743ms 3ms cpython 3.10.7
python 2.py 2552ms 33ms 8.3MB 2537ms 0ms cpython 3.10.7

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 561ms 2.2ms 74.9MB 533ms 13ms pypy 3.8.13
python 1.py 613ms 0.9ms 76.0MB 577ms 23ms pypy 3.8.13
v 1.v 1074ms 2.0ms 2.3MB 1060ms 0ms v/clang+gc 0.3.1
v 1.v 1111ms 1.1ms 2.3MB 1097ms 0ms v/clang 0.3.1
python 1.py 2803ms 51ms 8.9MB 2783ms 0ms pyston 3.8.12
python 2.py 3188ms 7.1ms 8.6MB 3177ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 127ms 0.5ms 2.3MB 120ms 0ms v/clang+gc 0.3.1
v 1.v 134ms 0.7ms 2.5MB 127ms 0ms v/clang 0.3.1
python 2.py 166ms 0.5ms 74.4MB 137ms 13ms pypy 3.8.13
python 1.py 184ms 1.9ms 74.5MB 153ms 10ms pypy 3.8.13
python 1.py 455ms 3.9ms 8.7MB 440ms 0ms pyston 3.8.12
python 2.py 503ms 2.3ms 8.2MB 487ms 0ms pyston 3.8.12
python 1.py 836ms 3.1ms 7.9MB 807ms 3ms cpython 3.10.7
python 2.py 1255ms 20ms 7.3MB 1243ms 0ms cpython 3.10.7

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 370ms 0.2ms 5.1MB 353ms 0ms v/clang+gc 0.3.1
v 1.v 381ms 1.8ms 8.9MB 370ms 0ms v/clang 0.3.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 19ms 0.2ms 2.3MB 10ms 0ms v/clang 0.3.1
v 1.v 19ms 0.7ms 2.3MB 10ms 0ms v/clang+gc 0.3.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 993ms 14ms 2.3MB 977ms 0ms v/clang 0.3.1
v 1.v 1002ms 0.6ms 2.4MB 990ms 0ms v/clang+gc 0.3.1
python 2.py 2105ms 22ms 74.5MB 2077ms 10ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 106ms 4.0ms 2.4MB 93ms 0ms v/clang 0.3.1
v 1.v 106ms 3.7ms 2.3MB 97ms 0ms v/clang+gc 0.3.1
python 2.py 278ms 3.4ms 74.0MB 247ms 13ms pypy 3.8.13
python 1.py 577ms 5.3ms 73.4MB 550ms 13ms pypy 3.8.13
python 1.py 1154ms 8.4ms 8.3MB 1140ms 0ms pyston 3.8.12
python 2.py 1573ms 0.7ms 8.2MB 1560ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 536ms 0.5ms 10.5MB 523ms 0ms v/clang+gc 0.3.1
v 2.v 547ms 0.4ms 6.8MB 530ms 0ms v/clang 0.3.1
v 1.v 1234ms 37ms 41.3MB 1210ms 7ms v/clang 0.3.1
v 1.v 1269ms 33ms 41.2MB 1250ms 7ms v/clang+gc 0.3.1
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 117ms 1.3ms 19.0MB 100ms 0ms v/clang+gc 0.3.1
v 1.v 118ms 0.6ms 19.8MB 103ms 0ms v/clang 0.3.1
v 2.v 125ms 1.0ms 3.3MB 110ms 0ms v/clang+gc 0.3.1
v 2.v 125ms 0.2ms 3.3MB 117ms 0ms v/clang 0.3.1
python 1.py 1332ms 9.4ms 209.6MB 1267ms 47ms pypy 3.8.13
python 1.py 2644ms 32ms 86.0MB 2583ms 40ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2341ms 0.9ms 8.6MB 2297ms 27ms cpython 3.10.7
python 4.py 2416ms 1.3ms 9.0MB 2387ms 13ms pyston 3.8.12
python 4.py 2613ms 14ms 127.7MB 2547ms 50ms pypy 3.8.13
v 1.v 4221ms 166ms 3.3MB 4197ms 7ms v/clang+gc 0.3.1
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang 0.3.1
v 2.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.3.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 565ms 1.7ms 8.3MB 550ms 0ms cpython 3.10.7
python 4.py 578ms 0.4ms 8.8MB 560ms 0ms pyston 3.8.12
python 4.py 689ms 24ms 80.0MB 653ms 17ms pypy 3.8.13
v 1.v 1063ms 5.5ms 2.7MB 1047ms 0ms v/clang+gc 0.3.1
v 2.v 1510ms 18ms 2.8MB 1497ms 0ms v/clang+gc 0.3.1
v 1.v 1631ms 30ms 3.1MB 1617ms 0ms v/clang 0.3.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3358ms 13ms 275.2MB 3233ms 107ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
v 1.v timeout 0.0ms 0.0MB 0ms 0ms v/clang+gc 0.3.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 472ms 1.0ms 98.2MB 423ms 37ms pypy 3.8.13
python 1.py 773ms 0.9ms 30.2MB 740ms 20ms pyston 3.8.12
python 1.py 827ms 3.5ms 31.1MB 777ms 33ms cpython 3.10.7
v 1.v 4372ms 2.0ms 26.0MB 4347ms 10ms v/clang+gc 0.3.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3432ms 0.2ms 2.9MB 3420ms 0ms v/clang+gc 0.3.1
v 1.v 3435ms 2.2ms 2.8MB 3420ms 0ms v/clang 0.3.1
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 861ms 0.2ms 2.5MB 850ms 0ms v/clang 0.3.1
v 1.v 863ms 0.6ms 2.6MB 847ms 0ms v/clang+gc 0.3.1
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 218ms 0.3ms 2.6MB 207ms 0ms v/clang 0.3.1
v 1.v 219ms 0.8ms 2.6MB 203ms 0ms v/clang+gc 0.3.1
python 8-m.py 4187ms 29ms 110.1MB 7277ms 400ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12