Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
5-m.py | 3319ms | 2874ms | 76.1MB | 6847ms | 1390ms | pypy 3.9.16 |
1.py | 3477ms | 32ms | 84.7MB | 3433ms | 23ms | pypy 3.9.16 |
5-m.py | 3960ms | 31ms | 12.5MB | 5733ms | 1390ms | pyston 3.8.12 |
1.py | 4684ms | 24ms | 7.9MB | 4667ms | 0ms | pyston 3.8.12 |
5-m.py | 4713ms | 13ms | 13.6MB | 6807ms | 1347ms | cpython 3.11.2 |
1.py | timeout | 0.0ms | 8.6MB | 4977ms | 3ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 425ms | 2.0ms | 73.7MB | 383ms | 23ms | pypy 3.9.16 |
5-m.py | 479ms | 2.6ms | 12.6MB | 630ms | 173ms | pyston 3.8.12 |
1.py | 495ms | 15ms | 7.9MB | 480ms | 0ms | pyston 3.8.12 |
5-m.py | 559ms | 1.6ms | 13.5MB | 737ms | 167ms | cpython 3.11.2 |
1.py | 715ms | 1.6ms | 8.7MB | 700ms | 0ms | cpython 3.11.2 |
5-m.py | 932ms | 8.4ms | 76.0MB | 1000ms | 530ms | pypy 3.9.16 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 284ms | 4.9ms | 70.9MB | 253ms | 13ms | pypy 3.9.16 |
1.py | 313ms | 4.7ms | 72.0MB | 270ms | 27ms | pypy 3.9.16 |
1.py | 1120ms | 2.0ms | 9.0MB | 1107ms | 0ms | pyston 3.8.12 |
2.py | 1293ms | 9.6ms | 8.7MB | 1273ms | 3ms | pyston 3.8.12 |
1.py | 1484ms | 19ms | 9.4MB | 1467ms | 0ms | cpython 3.11.2 |
2.py | 1699ms | 14ms | 9.1MB | 1687ms | 0ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 667ms | 16ms | 71.1MB | 630ms | 23ms | pypy 3.9.16 |
1.py | 711ms | 2.5ms | 72.3MB | 680ms | 13ms | pypy 3.9.16 |
2-m.py | 3295ms | 2854ms | 9.2MB | 4943ms | 0ms | cpython 3.11.2 |
1.py | 3305ms | 23ms | 9.0MB | 3287ms | 0ms | pyston 3.8.12 |
2.py | 3823ms | 41ms | 8.6MB | 3810ms | 0ms | pyston 3.8.12 |
1.py | 4427ms | 18ms | 9.3MB | 4410ms | 0ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 188ms | 6.7ms | 71.4MB | 157ms | 20ms | pypy 3.9.16 |
1.py | 206ms | 1.7ms | 72.5MB | 170ms | 20ms | pypy 3.9.16 |
1.py | 540ms | 9.0ms | 8.7MB | 527ms | 0ms | pyston 3.8.12 |
2.py | 602ms | 4.0ms | 8.2MB | 583ms | 0ms | pyston 3.8.12 |
1.py | 707ms | 4.4ms | 8.7MB | 693ms | 0ms | cpython 3.11.2 |
2.py | 854ms | 5.2ms | 8.4MB | 837ms | 0ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 2414ms | 33ms | 71.4MB | 2383ms | 17ms | pypy 3.9.16 |
1.py | 4354ms | 39ms | 70.3MB | 4317ms | 17ms | pypy 3.9.16 |
1.py | timeout | 0.0ms | 8.4MB | 4983ms | 0ms | cpython 3.11.2 |
2.py | timeout | 0.0ms | 8.6MB | 4987ms | 0ms | cpython 3.11.2 |
1.py | timeout | 0.0ms | 8.4MB | 4983ms | 3ms | pyston 3.8.12 |
2.py | timeout | 0.0ms | 7.9MB | 4973ms | 7ms | pyston 3.8.12 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 309ms | 3.3ms | 71.0MB | 277ms | 17ms | pypy 3.9.16 |
1.py | 499ms | 4.8ms | 70.3MB | 460ms | 20ms | pypy 3.9.16 |
1.py | 1397ms | 19ms | 8.3MB | 1380ms | 0ms | pyston 3.8.12 |
2.py | 1891ms | 7.9ms | 7.9MB | 1873ms | 3ms | pyston 3.8.12 |
1.py | 3917ms | 146ms | 8.4MB | 3903ms | 0ms | cpython 3.11.2 |
2.py | 4128ms | 39ms | 8.6MB | 4107ms | 0ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | timeout | 0.0ms | 321.1MB | 4883ms | 97ms | cpython 3.11.2 |
2.py | timeout | 0.0ms | 633.7MB | 4543ms | 437ms | cpython 3.11.2 |
1.py | timeout | 0.0ms | 382.8MB | 4817ms | 160ms | pypy 3.9.16 |
2.py | timeout | 0.0ms | 984.6MB | 4567ms | 407ms | pypy 3.9.16 |
1.py | timeout | 0.0ms | 320.4MB | 4907ms | 73ms | pyston 3.8.12 |
2.py | timeout | 0.0ms | 633.0MB | 4470ms | 513ms | pyston 3.8.12 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 1274ms | 13ms | 207.0MB | 1197ms | 60ms | pypy 3.9.16 |
2.py | 1351ms | 12ms | 164.3MB | 1267ms | 73ms | pyston 3.8.12 |
2.py | 2045ms | 5.7ms | 164.8MB | 1947ms | 80ms | cpython 3.11.2 |
2.py | 2170ms | 38ms | 210.3MB | 2020ms | 130ms | pypy 3.9.16 |
1.py | 2641ms | 32ms | 86.0MB | 2583ms | 40ms | pyston 3.8.12 |
1.py | 4357ms | 11ms | 86.7MB | 4297ms | 40ms | cpython 3.11.2 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
8.py | timeout | 0.0ms | 16.5MB | 60ms | 17ms | cpython 3.11.2 |
8.py | timeout | 0.0ms | 98.9MB | 643ms | 93ms | pypy 3.9.16 |
8.py | timeout | 0.0ms | 17.5MB | 57ms | 20ms | pyston 3.8.12 |