Current benchmark data was generated on Thu May 04 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 5-m.py | 3471ms | 17ms | 12.7MB | 4990ms | 1227ms | pyston 3.8.12 |
python | 1.py | 3566ms | 105ms | 85.0MB | 3510ms | 37ms | pypy 3.9.16 |
python | 1.py | 3928ms | 17ms | 8.0MB | 3910ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 4067ms | 23ms | 13.6MB | 5703ms | 1260ms | cpython 3.11.3 |
python | 5-m.py | 4917ms | 70ms | 76.1MB | 5657ms | 1113ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 3ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 409ms | 0.7ms | 7.9MB | 393ms | 3ms | pyston 3.8.12 |
python | 1.py | 427ms | 11ms | 73.7MB | 390ms | 20ms | pypy 3.9.16 |
python | 5-m.py | 428ms | 8.5ms | 12.6MB | 557ms | 143ms | pyston 3.8.12 |
python | 5-m.py | 505ms | 14ms | 13.6MB | 593ms | 207ms | cpython 3.11.3 |
python | 1.py | 604ms | 1.0ms | 8.6MB | 587ms | 0ms | cpython 3.11.3 |
python | 5-m.py | 874ms | 16ms | 76.3MB | 983ms | 463ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 1.7ms | 0.7ms | 1.3MB | 0ms | 0ms | gcc 13.1.0 |
c | 1.c | 1.8ms | 0.5ms | 1.4MB | 0ms | 0ms | clang 14.0.0 |
c | 1.c | 2.2ms | 0.4ms | 1.0MB | 0ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
python | 1.py | 13ms | 0.4ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 15ms | 0.9ms | 8.4MB | 7ms | 3ms | cpython 3.11.3 |
python | 1.py | 40ms | 2.2ms | 52.0MB | 14ms | 10ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1-m.c | 238ms | 1.6ms | 23.5MB | 390ms | 10ms | gcc 13.1.0 |
c | 1-m.c | 495ms | 13ms | 20.6MB | 840ms | 20ms | clang 14.0.0 |
python | 3-m.py | 4677ms | 58ms | 209.3MB | 8310ms | 410ms | pypy 3.9.16 |
python | 3.py | timeout | 0.0ms | 35.2MB | 97ms | 13ms | cpython 3.11.3 |
python | 3.py | timeout | 0.0ms | 34.2MB | 73ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 34ms | 0.7ms | 12.8MB | 43ms | 0ms | gcc 13.1.0 |
c | 1-m.c | 59ms | 1.9ms | 9.7MB | 90ms | 0ms | clang 14.0.0 |
python | 3-m.py | 635ms | 0.8ms | 86.0MB | 947ms | 127ms | pypy 3.9.16 |
python | 3-m.py | 676ms | 6.7ms | 17.7MB | 1183ms | 33ms | pyston 3.8.12 |
python | 3-m.py | 943ms | 4.1ms | 16.7MB | 1683ms | 53ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 232ms | 1.0ms | 71.0MB | 203ms | 17ms | pypy 3.9.16 |
python | 1.py | 278ms | 6.3ms | 71.9MB | 247ms | 13ms | pypy 3.9.16 |
python | 1.py | 925ms | 7.8ms | 9.0MB | 907ms | 0ms | pyston 3.8.12 |
python | 2.py | 1073ms | 2.7ms | 8.8MB | 1057ms | 0ms | pyston 3.8.12 |
python | 1.py | 1276ms | 27ms | 9.3MB | 1257ms | 0ms | cpython 3.11.3 |
python | 2.py | 1421ms | 16ms | 9.1MB | 1407ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 557ms | 2.9ms | 71.5MB | 527ms | 20ms | pypy 3.9.16 |
python | 1.py | 608ms | 1.1ms | 72.4MB | 587ms | 7ms | pypy 3.9.16 |
python | 1.py | 2726ms | 8.2ms | 9.0MB | 2710ms | 0ms | pyston 3.8.12 |
python | 2.py | 3173ms | 4.4ms | 8.7MB | 3160ms | 0ms | pyston 3.8.12 |
python | 1.py | 3748ms | 29ms | 9.2MB | 3733ms | 0ms | cpython 3.11.3 |
python | 2.py | 4262ms | 61ms | 9.1MB | 4247ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 162ms | 0.5ms | 71.2MB | 130ms | 13ms | pypy 3.9.16 |
python | 1.py | 181ms | 1.1ms | 72.4MB | 140ms | 23ms | pypy 3.9.16 |
python | 1.py | 444ms | 1.3ms | 8.8MB | 430ms | 0ms | pyston 3.8.12 |
python | 2.py | 506ms | 6.4ms | 8.3MB | 490ms | 0ms | pyston 3.8.12 |
python | 1.py | 598ms | 1.3ms | 8.7MB | 583ms | 0ms | cpython 3.11.3 |
python | 2.py | 712ms | 6.9ms | 8.4MB | 697ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 295ms | 0.8ms | 1.3MB | 287ms | 0ms | gcc 13.1.0 |
c | 8-i.c | 308ms | 0.9ms | 1.0MB | 300ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 5.c | 323ms | 1.2ms | 1.0MB | 313ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 2.c | 329ms | 1.6ms | 1.3MB | 317ms | 0ms | gcc 13.1.0 |
c | 5.c | 334ms | 0.5ms | 1.2MB | 323ms | 0ms | gcc 13.1.0 |
c | 2.c | 344ms | 0.4ms | 1.0MB | 333ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 5.c | 355ms | 0.8ms | 1.4MB | 340ms | 0ms | clang 14.0.0 |
c | 8-i.c | 369ms | 17ms | 1.4MB | 360ms | 0ms | clang 14.0.0 |
c | 2.c | 387ms | 0.3ms | 1.4MB | 380ms | 0ms | clang 14.0.0 |
python | 2.py | 2132ms | 23ms | 71.3MB | 2103ms | 10ms | pypy 3.9.16 |
python | 1.py | 3664ms | 19ms | 70.4MB | 3623ms | 23ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4987ms | 0ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4983ms | 0ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4987ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 7.9MB | 4980ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 32ms | 0.5ms | 1.3MB | 20ms | 0ms | gcc 13.1.0 |
c | 5.c | 35ms | 0.9ms | 0.9MB | 27ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 8-i.c | 35ms | 3.5ms | 1.0MB | 27ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 5.c | 36ms | 0.3ms | 1.3MB | 27ms | 0ms | gcc 13.1.0 |
c | 2.c | 36ms | 0.2ms | 0.9MB | 30ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 2.c | 37ms | 3.1ms | 1.3MB | 30ms | 0ms | gcc 13.1.0 |
c | 5.c | 38ms | 0.6ms | 1.4MB | 30ms | 0ms | clang 14.0.0 |
c | 8-i.c | 40ms | 2.8ms | 1.4MB | 30ms | 0ms | clang 14.0.0 |
c | 2.c | 42ms | 1.2ms | 1.4MB | 30ms | 0ms | clang 14.0.0 |
python | 2.py | 279ms | 3.4ms | 71.2MB | 253ms | 10ms | pypy 3.9.16 |
python | 1.py | 425ms | 14ms | 70.4MB | 390ms | 17ms | pypy 3.9.16 |
python | 1.py | 1156ms | 2.0ms | 8.4MB | 1137ms | 3ms | pyston 3.8.12 |
python | 2.py | 1597ms | 31ms | 7.9MB | 1577ms | 3ms | pyston 3.8.12 |
python | 1.py | 3179ms | 60ms | 8.4MB | 3167ms | 3ms | cpython 3.11.3 |
python | 2.py | 3574ms | 7.6ms | 8.6MB | 3557ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 1049ms | 42ms | 40.9MB | 1013ms | 13ms | gcc 13.1.0 |
c | 1.c | 1063ms | 25ms | 40.1MB | 1030ms | 13ms | zigcc 0.11.0-dev.2969+855493bb8 |
c | 1.c | 1105ms | 55ms | 40.9MB | 1070ms | 13ms | clang 14.0.0 |
python | 1.py | timeout | 0.0ms | 321.0MB | 4897ms | 80ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 633.5MB | 4677ms | 307ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 382.8MB | 4850ms | 133ms | pypy 3.9.16 |
python | 2.py | timeout | 0.0ms | 991.9MB | 4623ms | 360ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.4MB | 4903ms | 80ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.3MB | 4557ms | 423ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 119ms | 6.2ms | 11.7MB | 103ms | 0ms | gcc 13.1.0 |
c | 1.c | 121ms | 4.5ms | 11.6MB | 107ms | 0ms | clang 14.0.0 |
c | 1.c | 123ms | 1.3ms | 11.1MB | 110ms | 0ms | zigcc 0.11.0-dev.2969+855493bb8 |
python | 1.py | 1331ms | 14ms | 207.2MB | 1257ms | 60ms | pypy 3.9.16 |
python | 2.py | 1563ms | 21ms | 164.4MB | 1463ms | 83ms | pyston 3.8.12 |
python | 2.py | 2088ms | 6.3ms | 164.9MB | 1990ms | 83ms | cpython 3.11.3 |
python | 2.py | 2161ms | 4.7ms | 210.5MB | 2013ms | 133ms | pypy 3.9.16 |
python | 1.py | 3370ms | 74ms | 86.0MB | 3313ms | 37ms | pyston 3.8.12 |
python | 1.py | 4719ms | 66ms | 86.6MB | 4660ms | 40ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 1285ms | 17ms | 1.3MB | 2483ms | 0ms | gcc 13.1.0 |
c | 5-im.c | 1596ms | 1.4ms | 1.3MB | 3123ms | 0ms | gcc 13.1.0 |
c | 4-m.c | 1635ms | 2.9ms | 3.2MB | 3207ms | 0ms | clang 14.0.0 |
c | 6-im.c | 1637ms | 1.7ms | 1.3MB | 3187ms | 0ms | gcc 13.1.0 |
c | 6-im.c | 1653ms | 12ms | 3.2MB | 3227ms | 0ms | clang 14.0.0 |
c | 3-m.c | 1870ms | 3.4ms | 1.3MB | 3667ms | 0ms | gcc 13.1.0 |
c | 3-m.c | 1874ms | 16ms | 3.3MB | 3673ms | 0ms | clang 14.0.0 |
c | 5-im.c | 2035ms | 24ms | 5.2MB | 3980ms | 0ms | clang 14.0.0 |
python | 8.py | timeout | 0.0ms | 16.3MB | 50ms | 10ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 99.0MB | 657ms | 100ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 16.3MB | 70ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 336ms | 4.1ms | 3.2MB | 630ms | 0ms | gcc 13.1.0 |
c | 5-im.c | 411ms | 1.0ms | 1.3MB | 780ms | 0ms | gcc 13.1.0 |
c | 4-m.c | 421ms | 2.7ms | 3.1MB | 800ms | 0ms | clang 14.0.0 |
c | 6-im.c | 424ms | 2.3ms | 3.2MB | 803ms | 3ms | clang 14.0.0 |
c | 6-im.c | 424ms | 3.5ms | 1.3MB | 807ms | 0ms | gcc 13.1.0 |
c | 3-m.c | 473ms | 0.8ms | 3.2MB | 910ms | 0ms | clang 14.0.0 |
c | 3-m.c | 477ms | 1.1ms | 1.3MB | 910ms | 0ms | gcc 13.1.0 |
c | 5-im.c | 514ms | 1.2ms | 3.2MB | 990ms | 0ms | clang 14.0.0 |
python | 8.py | timeout | 0.0ms | 16.2MB | 97ms | 17ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 102.4MB | 1130ms | 193ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.6MB | 167ms | 27ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 95ms | 6.1ms | 1.3MB | 160ms | 0ms | gcc 13.1.0 |
c | 5-im.c | 112ms | 1.0ms | 1.3MB | 200ms | 0ms | gcc 13.1.0 |
c | 6-im.c | 113ms | 0.4ms | 3.2MB | 200ms | 0ms | clang 14.0.0 |
c | 6-im.c | 114ms | 1.0ms | 1.3MB | 200ms | 0ms | gcc 13.1.0 |
c | 4-m.c | 116ms | 4.5ms | 3.6MB | 200ms | 0ms | clang 14.0.0 |
c | 3-m.c | 129ms | 0.9ms | 1.3MB | 230ms | 0ms | gcc 13.1.0 |
c | 3-m.c | 140ms | 16ms | 3.1MB | 240ms | 0ms | clang 14.0.0 |
c | 5-im.c | 140ms | 2.7ms | 3.2MB | 247ms | 0ms | clang 14.0.0 |
python | 8-m.py | 4105ms | 62ms | 103.1MB | 7120ms | 430ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 15.9MB | 230ms | 23ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 16.7MB | 310ms | 70ms | pyston 3.8.12 |