Current benchmark data was generated on Mon May 19 2025, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 1852ms | 2.6ms | 88.9MB | 1803ms | 30ms | pypy 3.10.16 |
5-m.py | 2288ms | 4.5ms | 65.6MB | 3530ms | 820ms | pypy 3.10.16 |
5-m.py | 2438ms | 9.1ms | 12.5MB | 3527ms | 990ms | pyston 3.8.12 |
1.py | 3053ms | 14ms | 8.1MB | 3040ms | 0ms | pyston 3.8.12 |
5-m.py | 3439ms | 104ms | 13.9MB | 4590ms | 917ms | cpython 3.13.3 |
1.py | 4786ms | 32ms | 8.8MB | 4770ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 249ms | 3.9ms | 63.3MB | 223ms | 13ms | pypy 3.10.16 |
5-m.py | 311ms | 2.2ms | 12.5MB | 393ms | 150ms | pyston 3.8.12 |
1.py | 314ms | 3.8ms | 8.1MB | 300ms | 0ms | pyston 3.8.12 |
5-m.py | 405ms | 4.1ms | 13.9MB | 497ms | 133ms | cpython 3.13.3 |
5-m.py | 442ms | 3.9ms | 65.6MB | 733ms | 303ms | pypy 3.10.16 |
1.py | 495ms | 2.8ms | 8.9MB | 483ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 147ms | 4.7ms | 58.4MB | 123ms | 10ms | pypy 3.10.16 |
1.py | 178ms | 0.9ms | 59.5MB | 153ms | 10ms | pypy 3.10.16 |
1.py | 729ms | 8.4ms | 8.9MB | 720ms | 0ms | pyston 3.8.12 |
2.py | 843ms | 5.9ms | 8.5MB | 833ms | 0ms | pyston 3.8.12 |
1.py | 1162ms | 0.5ms | 9.5MB | 1150ms | 0ms | cpython 3.13.3 |
2.py | 1336ms | 11ms | 9.1MB | 1327ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 340ms | 1.6ms | 59.2MB | 317ms | 10ms | pypy 3.10.16 |
1.py | 379ms | 2.4ms | 60.4MB | 353ms | 13ms | pypy 3.10.16 |
1.py | 2141ms | 9.4ms | 8.9MB | 2127ms | 0ms | pyston 3.8.12 |
2.py | 2517ms | 56ms | 8.5MB | 2507ms | 0ms | pyston 3.8.12 |
1.py | 3461ms | 59ms | 9.5MB | 3450ms | 0ms | cpython 3.13.3 |
2.py | 3968ms | 103ms | 9.1MB | 3957ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 105ms | 0.4ms | 58.2MB | 80ms | 10ms | pypy 3.10.16 |
1.py | 122ms | 3.4ms | 58.8MB | 100ms | 10ms | pypy 3.10.16 |
1.py | 349ms | 0.5ms | 8.5MB | 340ms | 0ms | pyston 3.8.12 |
2.py | 388ms | 5.3ms | 8.1MB | 373ms | 0ms | pyston 3.8.12 |
1.py | 561ms | 4.3ms | 9.3MB | 547ms | 0ms | cpython 3.13.3 |
2.py | 636ms | 2.8ms | 8.8MB | 627ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 1353ms | 3.9ms | 58.1MB | 1330ms | 10ms | pypy 3.10.16 |
1.py | 2669ms | 18ms | 57.1MB | 2643ms | 10ms | pypy 3.10.16 |
1.py | timeout | 0.0ms | 8.9MB | 4990ms | 0ms | cpython 3.13.3 |
2.py | timeout | 0.0ms | 8.9MB | 4987ms | 0ms | cpython 3.13.3 |
1.py | timeout | 0.0ms | 8.3MB | 4990ms | 0ms | pyston 3.8.12 |
2.py | timeout | 0.0ms | 8.1MB | 4983ms | 0ms | pyston 3.8.12 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
2.py | 177ms | 1.3ms | 58.1MB | 157ms | 10ms | pypy 3.10.16 |
1.py | 305ms | 3.3ms | 57.0MB | 280ms | 10ms | pypy 3.10.16 |
1.py | 928ms | 11ms | 8.3MB | 917ms | 0ms | pyston 3.8.12 |
2.py | 1294ms | 2.1ms | 8.1MB | 1280ms | 0ms | pyston 3.8.12 |
1.py | 2942ms | 8.2ms | 8.8MB | 2930ms | 0ms | cpython 3.13.3 |
2.py | 3274ms | 97ms | 8.9MB | 3263ms | 0ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 2512ms | 35ms | 369.6MB | 2440ms | 57ms | pypy 3.10.16 |
2.py | 2965ms | 38ms | 632.9MB | 2797ms | 153ms | pyston 3.8.12 |
1.py | 4719ms | 55ms | 320.4MB | 4660ms | 47ms | pyston 3.8.12 |
1.py | timeout | 0.0ms | 321.4MB | 4957ms | 30ms | cpython 3.13.3 |
2.py | timeout | 0.0ms | 633.8MB | 4843ms | 143ms | cpython 3.13.3 |
2.py | timeout | 0.0ms | 959.9MB | 4710ms | 280ms | pypy 3.10.16 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
1.py | 526ms | 2.9ms | 135.2MB | 490ms | 23ms | pypy 3.10.16 |
2.py | 713ms | 3.4ms | 164.2MB | 670ms | 30ms | pyston 3.8.12 |
1.py | 1069ms | 35ms | 86.0MB | 1047ms | 10ms | pyston 3.8.12 |
2.py | 1424ms | 21ms | 165.0MB | 1380ms | 30ms | cpython 3.13.3 |
2.py | 1518ms | 19ms | 290.3MB | 1427ms | 77ms | pypy 3.10.16 |
1.py | 2702ms | 14ms | 86.9MB | 2680ms | 10ms | cpython 3.13.3 |
code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|
8.py | timeout | 0.0ms | 14.9MB | 37ms | 10ms | cpython 3.13.3 |
8.py | timeout | 0.0ms | 95.9MB | 810ms | 90ms | pypy 3.10.16 |
8.py | timeout | 0.0ms | 14.1MB | 30ms | 13ms | pyston 3.8.12 |