Current benchmark data was generated on Wed May 25 2022, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1538ms | 8.5ms | 221.3MB | 1423ms | 100ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang 0.2.4 |
v | 1.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang+gc 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 312ms | 8.1ms | 90.4MB | 270ms | 23ms | pypy 3.8.13 |
python | 1.py | 864ms | 4.1ms | 17.2MB | 843ms | 0ms | pyston 3.8.12 |
python | 1.py | 910ms | 2.7ms | 17.0MB | 887ms | 7ms | cpython 3.10.4 |
v | 1-m.v | 1889ms | 85ms | 17.8MB | 1903ms | 1643ms | v/clang 0.2.4 |
v | 1-m.v | 2361ms | 540ms | 20.5MB | 2327ms | 2083ms | v/clang+gc 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 753ms | 3.4ms | 82.9MB | 707ms | 27ms | pypy 3.8.13 |
python | 1.py | 2245ms | 159ms | 9.3MB | 2230ms | 0ms | cpython 3.10.4 |
python | 1.py | 2294ms | 0.4ms | 10.0MB | 2283ms | 0ms | pyston 3.8.12 |
v | 1.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang+gc 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 199ms | 12ms | 76.2MB | 163ms | 17ms | pypy 3.8.13 |
python | 1.py | 404ms | 0.7ms | 9.1MB | 390ms | 0ms | pyston 3.8.12 |
python | 1.py | 419ms | 0.5ms | 8.5MB | 407ms | 0ms | cpython 3.10.4 |
v | 1.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang+gc 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 698ms | 2.2ms | 2.2MB | 603ms | 77ms | v/clang+gc 0.2.4 |
v | 1.v | 816ms | 5.9ms | 0.6MB | 720ms | 77ms | v/clang 0.2.4 |
python | 1.py | 2907ms | 44ms | 89.2MB | 2870ms | 23ms | pypy 3.8.13 |
python | 5-m.py | 3562ms | 19ms | 12.9MB | 5000ms | 1320ms | pyston 3.8.12 |
python | 1.py | 4022ms | 316ms | 8.2MB | 4003ms | 3ms | pyston 3.8.12 |
python | 5-m.py | 4407ms | 159ms | 12.1MB | 6360ms | 1213ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 5-m.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 75ms | 1.2ms | 2.2MB | 57ms | 3ms | v/clang+gc 0.2.4 |
v | 1.v | 84ms | 0.9ms | 0.6MB | 63ms | 3ms | v/clang 0.2.4 |
python | 1.py | 368ms | 2.0ms | 75.5MB | 337ms | 17ms | pypy 3.8.13 |
python | 5-m.py | 432ms | 6.5ms | 12.9MB | 537ms | 173ms | pyston 3.8.12 |
python | 1.py | 434ms | 31ms | 8.2MB | 420ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 545ms | 3.4ms | 12.1MB | 683ms | 197ms | cpython 3.10.4 |
python | 1.py | 678ms | 48ms | 7.7MB | 663ms | 0ms | cpython 3.10.4 |
python | 5-m.py | 910ms | 3.9ms | 78.8MB | 1063ms | 467ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 2.1ms | 0.4ms | 2.0MB | 0ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 2.5ms | 2.4ms | 0.6MB | 0ms | 0ms | v/clang 0.2.4 |
python | 1.py | 14ms | 1.8ms | 7.6MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 16ms | 2.8ms | 7.3MB | 10ms | 0ms | cpython 3.10.4 |
python | 1.py | 37ms | 1.1ms | 54.6MB | 12ms | 10ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 235ms | 0.8ms | 74.1MB | 203ms | 13ms | pypy 3.8.13 |
python | 1.py | 280ms | 0.3ms | 75.4MB | 250ms | 17ms | pypy 3.8.13 |
v | 1.v | 339ms | 0.2ms | 0.6MB | 330ms | 0ms | v/clang 0.2.4 |
v | 1.v | 362ms | 2.8ms | 2.3MB | 350ms | 0ms | v/clang+gc 0.2.4 |
python | 1.py | 878ms | 5.1ms | 9.3MB | 867ms | 0ms | pyston 3.8.12 |
python | 2.py | 1055ms | 2.7ms | 9.1MB | 1040ms | 0ms | pyston 3.8.12 |
python | 1.py | 1743ms | 15ms | 8.4MB | 1730ms | 0ms | cpython 3.10.4 |
python | 2.py | 2570ms | 50ms | 8.3MB | 2557ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 562ms | 4.3ms | 74.6MB | 523ms | 17ms | pypy 3.8.13 |
python | 1.py | 614ms | 2.1ms | 76.1MB | 583ms | 17ms | pypy 3.8.13 |
v | 1.v | 1013ms | 1.0ms | 0.6MB | 1000ms | 0ms | v/clang 0.2.4 |
v | 1.v | 1076ms | 4.4ms | 2.2MB | 1067ms | 0ms | v/clang+gc 0.2.4 |
python | 1.py | 2586ms | 14ms | 9.3MB | 2570ms | 0ms | pyston 3.8.12 |
python | 2.py | 3121ms | 7.9ms | 9.0MB | 3107ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 120ms | 0.6ms | 0.6MB | 110ms | 0ms | v/clang 0.2.4 |
v | 1.v | 127ms | 1.0ms | 2.3MB | 120ms | 0ms | v/clang+gc 0.2.4 |
python | 2.py | 167ms | 1.7ms | 74.0MB | 133ms | 17ms | pypy 3.8.13 |
python | 1.py | 184ms | 0.5ms | 74.3MB | 143ms | 17ms | pypy 3.8.13 |
python | 1.py | 431ms | 5.2ms | 8.9MB | 413ms | 0ms | pyston 3.8.12 |
python | 2.py | 487ms | 2.4ms | 8.5MB | 477ms | 0ms | pyston 3.8.12 |
python | 1.py | 811ms | 4.9ms | 7.8MB | 793ms | 3ms | cpython 3.10.4 |
python | 2.py | 1234ms | 16ms | 7.3MB | 1217ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 988ms | 1.3ms | 0.8MB | 980ms | 0ms | v/clang 0.2.4 |
v | 1.v | 1002ms | 0.0ms | 2.3MB | 990ms | 0ms | v/clang+gc 0.2.4 |
python | 2.py | 2271ms | 62ms | 74.5MB | 2243ms | 13ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 98ms | 7.3ms | 0.8MB | 87ms | 0ms | v/clang 0.2.4 |
v | 1.v | 105ms | 0.8ms | 2.4MB | 90ms | 0ms | v/clang+gc 0.2.4 |
python | 2.py | 294ms | 5.0ms | 74.1MB | 253ms | 27ms | pypy 3.8.13 |
python | 1.py | 583ms | 1.7ms | 73.4MB | 557ms | 13ms | pypy 3.8.13 |
python | 1.py | 1420ms | 106ms | 8.7MB | 1407ms | 0ms | pyston 3.8.12 |
python | 2.py | 2057ms | 12ms | 8.5MB | 2043ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 2.v | 499ms | 6.1ms | 10.4MB | 480ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 1054ms | 16ms | 41.3MB | 1033ms | 10ms | v/clang+gc 0.2.4 |
v | 1.v | 1142ms | 36ms | 40.1MB | 1113ms | 13ms | v/clang 0.2.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 2.v | 113ms | 0.8ms | 3.3MB | 103ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 118ms | 1.0ms | 10.9MB | 107ms | 0ms | v/clang 0.2.4 |
v | 1.v | 125ms | 1.0ms | 19.8MB | 103ms | 3ms | v/clang+gc 0.2.4 |
python | 1.py | 1357ms | 20ms | 209.6MB | 1277ms | 70ms | pypy 3.8.13 |
python | 1.py | 2822ms | 61ms | 86.4MB | 2770ms | 37ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 2069ms | 2.9ms | 8.6MB | 2037ms | 20ms | cpython 3.10.4 |
python | 4.py | 2237ms | 2.1ms | 9.4MB | 2207ms | 10ms | pyston 3.8.12 |
python | 4.py | 2733ms | 28ms | 127.6MB | 2640ms | 73ms | pypy 3.8.13 |
v | 1.v | 4270ms | 76ms | 3.2MB | 4247ms | 3ms | v/clang+gc 0.2.4 |
v | 1.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang 0.2.4 |
v | 2.v | timeout | 0.0ms | 0.0MB | 0ms | 0ms | v/clang+gc 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 502ms | 4.7ms | 8.4MB | 480ms | 0ms | cpython 3.10.4 |
python | 4.py | 535ms | 1.2ms | 9.1MB | 520ms | 0ms | pyston 3.8.12 |
python | 4.py | 702ms | 4.2ms | 79.7MB | 670ms | 20ms | pypy 3.8.13 |
v | 1.v | 1076ms | 1.6ms | 2.5MB | 1060ms | 0ms | v/clang+gc 0.2.4 |
v | 2.v | 1546ms | 13ms | 3.1MB | 1530ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 2390ms | 6.9ms | 2460.0MB | 1277ms | 1093ms | v/clang 0.2.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 3033ms | 0.4ms | 2.9MB | 3020ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 3165ms | 232ms | 1.7MB | 3153ms | 0ms | v/clang 0.2.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 762ms | 0.3ms | 2.6MB | 750ms | 0ms | v/clang+gc 0.2.4 |
v | 1.v | 794ms | 58ms | 0.9MB | 783ms | 0ms | v/clang 0.2.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
v | 1.v | 207ms | 9.0ms | 0.9MB | 190ms | 0ms | v/clang 0.2.4 |
v | 1.v | 219ms | 2.0ms | 2.6MB | 210ms | 0ms | v/clang+gc 0.2.4 |
python | 8-m.py | 4206ms | 35ms | 105.3MB | 7317ms | 397ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |