Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 3.swift | 405ms | 28ms | 22.7MB | 537ms | 10ms | swift 5.7.3 |
python | 5-m.py | 3396ms | 47ms | 12.7MB | 4827ms | 1273ms | pyston 3.8.12 |
python | 1.py | 3472ms | 22ms | 85.0MB | 3427ms | 23ms | pypy 3.9.16 |
python | 1.py | 3936ms | 36ms | 7.9MB | 3923ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 4001ms | 4.4ms | 13.6MB | 5693ms | 1197ms | cpython 3.11.1 |
python | 5-m.py | 4662ms | 42ms | 76.1MB | 6713ms | 1320ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 3.swift | 65ms | 1.8ms | 14.7MB | 40ms | 7ms | swift 5.7.3 |
python | 1.py | 407ms | 1.7ms | 8.0MB | 390ms | 3ms | pyston 3.8.12 |
python | 1.py | 433ms | 0.6ms | 73.8MB | 407ms | 13ms | pypy 3.9.16 |
python | 5-m.py | 436ms | 14ms | 12.6MB | 557ms | 160ms | pyston 3.8.12 |
python | 5-m.py | 485ms | 5.8ms | 13.6MB | 587ms | 193ms | cpython 3.11.1 |
python | 1.py | 594ms | 1.0ms | 8.6MB | 580ms | 0ms | cpython 3.11.1 |
python | 5-m.py | 845ms | 3.6ms | 76.2MB | 923ms | 457ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 1.swift | 3.4ms | 0.1ms | 0.0MB | 0ms | 0ms | swift 5.7.3 |
python | 1.py | 14ms | 0.9ms | 8.4MB | 10ms | 0ms | cpython 3.11.1 |
python | 1.py | 14ms | 0.7ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 37ms | 0.6ms | 51.6MB | 8ms | 14ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 2-m.swift | 2227ms | 12ms | 42.1MB | 4180ms | 30ms | swift 5.7.3 |
python | 3.py | timeout | 0.0ms | 35.3MB | 93ms | 20ms | cpython 3.11.1 |
python | 3.py | timeout | 0.0ms | 207.6MB | 297ms | 87ms | pypy 3.9.16 |
python | 3.py | timeout | 0.0ms | 34.1MB | 77ms | 23ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 2-m.swift | 393ms | 32ms | 33.6MB | 630ms | 17ms | swift 5.7.3 |
python | 3-m.py | 670ms | 8.9ms | 86.2MB | 1007ms | 117ms | pypy 3.9.16 |
python | 3-m.py | 718ms | 12ms | 15.9MB | 1250ms | 47ms | pyston 3.8.12 |
python | 3-m.py | 942ms | 1.3ms | 17.0MB | 1707ms | 30ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 232ms | 1.2ms | 70.9MB | 200ms | 10ms | pypy 3.9.16 |
python | 1.py | 284ms | 6.6ms | 71.9MB | 240ms | 23ms | pypy 3.9.16 |
python | 1.py | 934ms | 3.2ms | 9.1MB | 923ms | 0ms | pyston 3.8.12 |
python | 2.py | 1077ms | 7.0ms | 8.7MB | 1063ms | 0ms | pyston 3.8.12 |
python | 1.py | 1255ms | 16ms | 9.3MB | 1243ms | 0ms | cpython 3.11.1 |
python | 2.py | 1427ms | 8.5ms | 9.1MB | 1410ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 557ms | 5.6ms | 71.3MB | 520ms | 23ms | pypy 3.9.16 |
python | 1.py | 616ms | 1.8ms | 72.5MB | 580ms | 20ms | pypy 3.9.16 |
python | 1.py | 2744ms | 8.5ms | 9.1MB | 2723ms | 0ms | pyston 3.8.12 |
python | 2.py | 3201ms | 18ms | 8.7MB | 3183ms | 3ms | pyston 3.8.12 |
python | 1.py | 3733ms | 77ms | 9.3MB | 3717ms | 0ms | cpython 3.11.1 |
python | 2.py | 4232ms | 26ms | 9.1MB | 4217ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 161ms | 0.9ms | 71.3MB | 130ms | 10ms | pypy 3.9.16 |
python | 1.py | 187ms | 2.1ms | 72.3MB | 157ms | 17ms | pypy 3.9.16 |
python | 1.py | 454ms | 2.7ms | 8.8MB | 440ms | 0ms | pyston 3.8.12 |
python | 2.py | 501ms | 1.5ms | 8.2MB | 487ms | 0ms | pyston 3.8.12 |
python | 1.py | 597ms | 4.0ms | 8.7MB | 577ms | 3ms | cpython 3.11.1 |
python | 2.py | 709ms | 5.6ms | 8.4MB | 693ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 7.swift | 453ms | 6.5ms | 5.2MB | 443ms | 0ms | swift 5.7.3 |
python | 2.py | 2170ms | 15ms | 71.1MB | 2137ms | 17ms | pypy 3.9.16 |
python | 1.py | 3646ms | 10ms | 70.2MB | 3617ms | 7ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.5MB | 4987ms | 0ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4980ms | 3ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 8.5MB | 4990ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.0MB | 4983ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
swift | 7.swift | 49ms | 2.8ms | 5.2MB | 40ms | 0ms | swift 5.7.3 |
python | 2.py | 267ms | 1.3ms | 70.9MB | 233ms | 17ms | pypy 3.9.16 |
python | 1.py | 416ms | 2.4ms | 70.4MB | 380ms | 17ms | pypy 3.9.16 |
python | 1.py | 1163ms | 10ms | 8.4MB | 1150ms | 0ms | pyston 3.8.12 |
python | 2.py | 1601ms | 24ms | 7.9MB | 1587ms | 0ms | pyston 3.8.12 |
python | 1.py | 3147ms | 98ms | 8.5MB | 3133ms | 0ms | cpython 3.11.1 |
python | 2.py | 3709ms | 215ms | 8.6MB | 3697ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 4962ms | 19ms | 382.8MB | 4797ms | 147ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 321.1MB | 4897ms | 87ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4557ms | 427ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 1000.1MB | 4617ms | 363ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.5MB | 4903ms | 80ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.0MB | 4553ms | 427ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1141ms | 2.1ms | 207.1MB | 1077ms | 50ms | pypy 3.9.16 |
python | 2.py | 1452ms | 29ms | 164.4MB | 1347ms | 90ms | pyston 3.8.12 |
python | 2.py | 1926ms | 10ms | 210.5MB | 1793ms | 117ms | pypy 3.9.16 |
python | 2.py | 2006ms | 13ms | 164.8MB | 1907ms | 80ms | cpython 3.11.1 |
python | 1.py | 3114ms | 48ms | 86.1MB | 3063ms | 33ms | pyston 3.8.12 |
python | 1.py | 4358ms | 46ms | 86.8MB | 4307ms | 33ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 2411ms | 0.4ms | 9.1MB | 2377ms | 20ms | pyston 3.8.12 |
python | 4.py | 2413ms | 1.4ms | 9.4MB | 2383ms | 17ms | cpython 3.11.1 |
python | 4.py | 2667ms | 37ms | 125.2MB | 2610ms | 40ms | pypy 3.9.16 |
swift | 1.swift | timeout | 0.0ms | 6.7MB | 4970ms | 10ms | swift 5.7.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 578ms | 2.1ms | 8.8MB | 560ms | 0ms | pyston 3.8.12 |
python | 4.py | 581ms | 0.7ms | 9.2MB | 563ms | 0ms | cpython 3.11.1 |
python | 4.py | 682ms | 5.4ms | 76.9MB | 653ms | 13ms | pypy 3.9.16 |
swift | 1.swift | 2616ms | 0.1ms | 6.3MB | 2600ms | 3ms | swift 5.7.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 8.py | timeout | 0.0ms | 16.5MB | 53ms | 13ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 100.3MB | 660ms | 83ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.8MB | 77ms | 13ms | pyston 3.8.12 |