Current benchmark data was generated on Thu May 01 2025, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1163ms | 3.7ms | 96.4MB | 1093ms | 57ms | pypy 3.10.16 |
acton | 1.act | timeout | 0.0ms | 66.9MB | 5943ms | 87ms | actonc 0.25.0 |
python | 1.py | timeout | 0.0ms | 41.0MB | 4967ms | 20ms | cpython 3.13.3 |
python | 1.py | timeout | 0.0ms | 40.6MB | 4747ms | 240ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 94ms | 1.4ms | 68.9MB | 67ms | 20ms | pypy 3.10.16 |
python | 1.py | 477ms | 5.2ms | 11.9MB | 453ms | 10ms | pyston 3.8.12 |
python | 1.py | 735ms | 1.9ms | 12.9MB | 720ms | 0ms | cpython 3.13.3 |
acton | 1.act | 824ms | 27ms | 12.0MB | 960ms | 70ms | actonc 0.25.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
acton | 1.act | 231ms | 12ms | 8.1MB | 207ms | 40ms | actonc 0.25.0 |
python | 1.py | 254ms | 1.8ms | 83.3MB | 213ms | 27ms | pypy 3.10.16 |
python | 1.py | 358ms | 0.5ms | 12.7MB | 343ms | 0ms | cpython 3.13.3 |
python | 1.py | 2007ms | 3.8ms | 9.6MB | 1993ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
acton | 1.act | 90ms | 15ms | 6.0MB | 73ms | 13ms | actonc 0.25.0 |
python | 1.py | 101ms | 2.1ms | 63.4MB | 77ms | 13ms | pypy 3.10.16 |
python | 1.py | 110ms | 2.3ms | 11.6MB | 97ms | 0ms | cpython 3.13.3 |
python | 1.py | 347ms | 0.6ms | 8.8MB | 340ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1844ms | 2.1ms | 88.9MB | 1803ms | 27ms | pypy 3.10.16 |
python | 5-m.py | 2282ms | 26ms | 65.6MB | 3447ms | 880ms | pypy 3.10.16 |
python | 5-m.py | 2440ms | 42ms | 12.5MB | 3553ms | 983ms | pyston 3.8.12 |
python | 1.py | 3029ms | 17ms | 8.1MB | 3013ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 3360ms | 25ms | 13.8MB | 4480ms | 893ms | cpython 3.13.3 |
python | 1.py | 4658ms | 29ms | 8.9MB | 4647ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 248ms | 3.6ms | 63.3MB | 217ms | 13ms | pypy 3.10.16 |
python | 5-m.py | 310ms | 2.9ms | 12.5MB | 413ms | 133ms | pyston 3.8.12 |
python | 1.py | 316ms | 5.2ms | 8.1MB | 303ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 405ms | 7.8ms | 13.9MB | 507ms | 127ms | cpython 3.13.3 |
python | 5-m.py | 437ms | 3.3ms | 65.4MB | 743ms | 283ms | pypy 3.10.16 |
python | 1.py | 475ms | 3.8ms | 8.8MB | 463ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
acton | 1.act | 3.8ms | 0.3ms | 3.9MB | 0ms | 0ms | actonc 0.25.0 |
python | 1.py | 12ms | 0.6ms | 7.6MB | 0ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.0ms | 8.6MB | 10ms | 0ms | cpython 3.13.3 |
python | 1.py | 29ms | 1.3ms | 51.6MB | 10ms | 10ms | pypy 3.10.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 146ms | 2.0ms | 58.3MB | 120ms | 10ms | pypy 3.10.16 |
python | 1.py | 182ms | 1.5ms | 59.4MB | 157ms | 13ms | pypy 3.10.16 |
python | 1.py | 719ms | 4.1ms | 8.9MB | 707ms | 0ms | pyston 3.8.12 |
python | 2.py | 846ms | 13ms | 8.5MB | 833ms | 0ms | pyston 3.8.12 |
python | 1.py | 1151ms | 14ms | 9.5MB | 1137ms | 0ms | cpython 3.13.3 |
python | 2.py | 1319ms | 13ms | 9.1MB | 1307ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 338ms | 2.2ms | 59.3MB | 313ms | 10ms | pypy 3.10.16 |
python | 1.py | 385ms | 11ms | 60.3MB | 360ms | 13ms | pypy 3.10.16 |
python | 1.py | 2132ms | 15ms | 8.9MB | 2120ms | 0ms | pyston 3.8.12 |
python | 2.py | 2534ms | 37ms | 8.5MB | 2523ms | 0ms | pyston 3.8.12 |
python | 1.py | 3411ms | 66ms | 9.5MB | 3397ms | 0ms | cpython 3.13.3 |
python | 2.py | 3945ms | 23ms | 9.1MB | 3933ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 105ms | 0.6ms | 58.1MB | 80ms | 10ms | pypy 3.10.16 |
python | 1.py | 121ms | 3.1ms | 58.8MB | 97ms | 10ms | pypy 3.10.16 |
python | 1.py | 345ms | 3.5ms | 8.5MB | 330ms | 0ms | pyston 3.8.12 |
python | 2.py | 387ms | 4.3ms | 8.1MB | 373ms | 0ms | pyston 3.8.12 |
python | 1.py | 543ms | 3.8ms | 9.3MB | 533ms | 0ms | cpython 3.13.3 |
python | 2.py | 634ms | 7.0ms | 8.8MB | 620ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 2205ms | 15ms | 202.6MB | 2087ms | 107ms | pypy 3.10.16 |
acton | 1.act | 3256ms | 12ms | 84.6MB | 3660ms | 60ms | actonc 0.25.0 |
python | 1.py | timeout | 0.0ms | 93.9MB | 4953ms | 37ms | cpython 3.13.3 |
python | 1.py | timeout | 0.0ms | 130.3MB | 4937ms | 50ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 374ms | 1.8ms | 105.3MB | 317ms | 40ms | pypy 3.10.16 |
acton | 1.act | 693ms | 11ms | 24.0MB | 760ms | 33ms | actonc 0.25.0 |
python | 1.py | 2897ms | 36ms | 37.3MB | 2873ms | 10ms | cpython 3.13.3 |
python | 1.py | timeout | 0.0ms | 48.9MB | 4940ms | 50ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 1359ms | 3.9ms | 58.1MB | 1333ms | 10ms | pypy 3.10.16 |
python | 1.py | 2652ms | 15ms | 57.1MB | 2627ms | 13ms | pypy 3.10.16 |
python | 1.py | timeout | 0.0ms | 8.8MB | 4990ms | 0ms | cpython 3.13.3 |
python | 2.py | timeout | 0.0ms | 8.9MB | 4990ms | 0ms | cpython 3.13.3 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4990ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4990ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 180ms | 3.6ms | 57.9MB | 153ms | 10ms | pypy 3.10.16 |
python | 1.py | 303ms | 3.1ms | 57.2MB | 280ms | 10ms | pypy 3.10.16 |
python | 1.py | 926ms | 7.5ms | 8.3MB | 910ms | 0ms | pyston 3.8.12 |
python | 2.py | 1300ms | 5.2ms | 8.3MB | 1293ms | 0ms | pyston 3.8.12 |
python | 1.py | 2952ms | 2.0ms | 8.9MB | 2940ms | 0ms | cpython 3.13.3 |
python | 2.py | 3262ms | 188ms | 8.9MB | 3250ms | 0ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 2568ms | 13ms | 369.6MB | 2497ms | 60ms | pypy 3.10.16 |
python | 2.py | 3071ms | 131ms | 633.0MB | 2887ms | 167ms | pyston 3.8.12 |
python | 1.py | 4763ms | 47ms | 320.4MB | 4703ms | 50ms | pyston 3.8.12 |
acton | 1.act | timeout | 0.0ms | 561.0MB | 6610ms | 93ms | actonc 0.25.0 |
python | 1.py | timeout | 0.0ms | 321.3MB | 4960ms | 20ms | cpython 3.13.3 |
python | 2.py | timeout | 0.0ms | 633.7MB | 4823ms | 163ms | cpython 3.13.3 |
python | 2.py | timeout | 0.0ms | 959.9MB | 4720ms | 267ms | pypy 3.10.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 533ms | 4.7ms | 135.3MB | 493ms | 23ms | pypy 3.10.16 |
python | 2.py | 719ms | 1.6ms | 164.2MB | 673ms | 30ms | pyston 3.8.12 |
python | 1.py | 1046ms | 3.4ms | 86.1MB | 1020ms | 10ms | pyston 3.8.12 |
python | 2.py | 1404ms | 6.2ms | 165.0MB | 1367ms | 27ms | cpython 3.13.3 |
python | 2.py | 1537ms | 17ms | 290.2MB | 1447ms | 77ms | pypy 3.10.16 |
acton | 1.act | 2441ms | 6.0ms | 192.4MB | 2940ms | 60ms | actonc 0.25.0 |
python | 1.py | 2673ms | 5.0ms | 86.9MB | 2650ms | 10ms | cpython 3.13.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 1915ms | 12ms | 8.9MB | 1873ms | 27ms | pyston 3.8.12 |
python | 4.py | 1986ms | 7.7ms | 9.4MB | 1933ms | 40ms | cpython 3.13.3 |
python | 4.py | 2182ms | 4.7ms | 89.6MB | 2143ms | 27ms | pypy 3.10.16 |
acton | 1-m.act | 3448ms | 37ms | 6.8MB | 3523ms | 2430ms | actonc 0.25.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 451ms | 2.1ms | 8.6MB | 440ms | 0ms | pyston 3.8.12 |
python | 4.py | 470ms | 1.0ms | 9.1MB | 460ms | 0ms | cpython 3.13.3 |
python | 4.py | 550ms | 2.6ms | 83.9MB | 520ms | 20ms | pypy 3.10.16 |
acton | 1-m.act | 960ms | 34ms | 6.1MB | 940ms | 687ms | actonc 0.25.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 8.py | timeout | 0.0ms | 14.9MB | 40ms | 7ms | cpython 3.13.3 |
python | 8.py | timeout | 0.0ms | 95.8MB | 763ms | 77ms | pypy 3.10.16 |
python | 8.py | timeout | 0.0ms | 14.1MB | 30ms | 10ms | pyston 3.8.12 |