Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 3281ms | 110ms | 88.1MB | 3240ms | 23ms | pypy 3.9.16 |
python | 5-m.py | 4072ms | 15ms | 13.5MB | 5707ms | 977ms | cpython 3.11.1 |
python | 1.py | 4085ms | 11ms | 8.0MB | 4063ms | 7ms | pyston 3.8.12 |
python | 5-m.py | 4087ms | 56ms | 12.5MB | 6220ms | 1000ms | pyston 3.8.12 |
python | 5-m.py | 4461ms | 125ms | 82.8MB | 5007ms | 1030ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.5MB | 4990ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 430ms | 8.6ms | 7.9MB | 413ms | 0ms | pyston 3.8.12 |
python | 1.py | 444ms | 84ms | 79.3MB | 410ms | 20ms | pypy 3.9.16 |
python | 5-m.py | 468ms | 23ms | 12.7MB | 667ms | 150ms | pyston 3.8.12 |
python | 5-m.py | 472ms | 3.0ms | 13.5MB | 617ms | 113ms | cpython 3.11.1 |
python | 1.py | 603ms | 4.7ms | 8.6MB | 590ms | 0ms | cpython 3.11.1 |
python | 5-m.py | 838ms | 30ms | 82.5MB | 903ms | 487ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 1.7ms | 0.3ms | 1.4MB | 0ms | 0ms | clang 14.0.0 |
c | 1.c | 1.8ms | 0.5ms | 1.3MB | 0ms | 0ms | gcc 12.2.0 |
c | 1.c | 3.4ms | 0.1ms | 0.0MB | 0ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
python | 1.py | 13ms | 0.4ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.4ms | 8.4MB | 10ms | 0ms | cpython 3.11.1 |
python | 1.py | 38ms | 3.1ms | 51.6MB | 14ms | 10ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1-m.c | 251ms | 4.3ms | 23.5MB | 417ms | 7ms | gcc 12.2.0 |
c | 1-m.c | 476ms | 1.3ms | 20.4MB | 850ms | 7ms | clang 14.0.0 |
python | 3-m.py | 4291ms | 242ms | 202.2MB | 7437ms | 357ms | pypy 3.9.16 |
python | 3.py | timeout | 0.0ms | 35.0MB | 87ms | 17ms | cpython 3.11.1 |
python | 3.py | timeout | 0.0ms | 34.3MB | 73ms | 17ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 33ms | 2.2ms | 12.8MB | 43ms | 3ms | gcc 12.2.0 |
c | 1-m.c | 59ms | 0.9ms | 9.7MB | 93ms | 0ms | clang 14.0.0 |
python | 3-m.py | 618ms | 72ms | 94.3MB | 927ms | 110ms | pypy 3.9.16 |
python | 3-m.py | 737ms | 14ms | 17.6MB | 1307ms | 20ms | pyston 3.8.12 |
python | 3-m.py | 843ms | 37ms | 16.9MB | 1520ms | 27ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 212ms | 19ms | 77.3MB | 177ms | 13ms | pypy 3.9.16 |
python | 1.py | 248ms | 4.0ms | 78.2MB | 207ms | 23ms | pypy 3.9.16 |
python | 1.py | 976ms | 2.0ms | 9.0MB | 960ms | 0ms | pyston 3.8.12 |
python | 2.py | 1156ms | 1.7ms | 8.7MB | 1140ms | 0ms | pyston 3.8.12 |
python | 1.py | 1300ms | 7.9ms | 9.3MB | 1287ms | 0ms | cpython 3.11.1 |
python | 2.py | 1494ms | 5.2ms | 9.1MB | 1477ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 475ms | 2.8ms | 77.2MB | 443ms | 10ms | pypy 3.9.16 |
python | 1.py | 512ms | 11ms | 78.8MB | 480ms | 17ms | pypy 3.9.16 |
python | 1.py | 2900ms | 12ms | 9.0MB | 2880ms | 3ms | pyston 3.8.12 |
python | 2.py | 3456ms | 28ms | 8.8MB | 3440ms | 0ms | pyston 3.8.12 |
python | 1.py | 3892ms | 45ms | 9.5MB | 3877ms | 0ms | cpython 3.11.1 |
python | 2.py | 4470ms | 72ms | 9.1MB | 4453ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 141ms | 3.5ms | 77.2MB | 110ms | 17ms | pypy 3.9.16 |
python | 1.py | 171ms | 15ms | 78.2MB | 140ms | 13ms | pypy 3.9.16 |
python | 1.py | 476ms | 3.0ms | 8.7MB | 460ms | 0ms | pyston 3.8.12 |
python | 2.py | 539ms | 3.6ms | 8.2MB | 523ms | 0ms | pyston 3.8.12 |
python | 1.py | 619ms | 4.0ms | 8.9MB | 607ms | 0ms | cpython 3.11.1 |
python | 2.py | 745ms | 5.0ms | 8.4MB | 733ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 315ms | 3.9ms | 1.3MB | 297ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 5.c | 320ms | 0.3ms | 1.3MB | 310ms | 0ms | gcc 12.2.0 |
c | 5.c | 329ms | 1.2ms | 1.0MB | 317ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 5.c | 331ms | 0.2ms | 1.4MB | 320ms | 0ms | clang 14.0.0 |
c | 2.c | 340ms | 2.0ms | 1.2MB | 327ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 2.c | 341ms | 0.6ms | 1.4MB | 330ms | 0ms | clang 14.0.0 |
c | 8-i.c | 365ms | 0.8ms | 1.3MB | 350ms | 0ms | gcc 12.2.0 |
c | 8-i.c | 373ms | 2.0ms | 1.4MB | 360ms | 0ms | clang 14.0.0 |
c | 2.c | 624ms | 0.7ms | 1.3MB | 610ms | 0ms | gcc 12.2.0 |
python | 2.py | 2692ms | 149ms | 77.4MB | 2660ms | 13ms | pypy 3.9.16 |
python | 1.py | 3533ms | 41ms | 76.5MB | 3500ms | 17ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4983ms | 0ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4990ms | 0ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4977ms | 3ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.0MB | 4990ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 33ms | 0.2ms | 1.3MB | 20ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 5.c | 34ms | 0.3ms | 1.3MB | 23ms | 0ms | gcc 12.2.0 |
c | 5.c | 35ms | 0.2ms | 1.4MB | 27ms | 0ms | clang 14.0.0 |
c | 5.c | 36ms | 0.6ms | 1.0MB | 27ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 2.c | 37ms | 1.2ms | 1.4MB | 30ms | 0ms | clang 14.0.0 |
c | 2.c | 37ms | 1.0ms | 2.0MB | 27ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 8-i.c | 38ms | 0.2ms | 1.3MB | 30ms | 0ms | gcc 12.2.0 |
c | 8-i.c | 40ms | 0.9ms | 1.4MB | 30ms | 0ms | clang 14.0.0 |
c | 2.c | 65ms | 0.4ms | 1.3MB | 53ms | 0ms | gcc 12.2.0 |
python | 2.py | 305ms | 26ms | 77.0MB | 277ms | 10ms | pypy 3.9.16 |
python | 1.py | 400ms | 3.4ms | 76.4MB | 373ms | 10ms | pypy 3.9.16 |
python | 1.py | 1193ms | 1.0ms | 8.3MB | 1180ms | 0ms | pyston 3.8.12 |
python | 2.py | 1636ms | 28ms | 7.9MB | 1623ms | 0ms | pyston 3.8.12 |
python | 2.py | 3404ms | 24ms | 8.6MB | 3393ms | 0ms | cpython 3.11.1 |
python | 1.py | 3437ms | 149ms | 8.4MB | 3423ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 578ms | 9.5ms | 40.8MB | 553ms | 7ms | clang 14.0.0 |
c | 1.c | 593ms | 23ms | 40.2MB | 570ms | 7ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 1.c | 632ms | 33ms | 41.1MB | 600ms | 13ms | gcc 12.2.0 |
python | 1.py | 4480ms | 211ms | 389.1MB | 4330ms | 133ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 321.1MB | 4937ms | 50ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4690ms | 293ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 1013.7MB | 4620ms | 360ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.5MB | 4897ms | 87ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.2MB | 4577ms | 403ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 115ms | 1.2ms | 11.4MB | 103ms | 0ms | clang 14.0.0 |
c | 1.c | 119ms | 3.0ms | 11.1MB | 110ms | 0ms | zigcc 0.11.0-dev.1479+97b1a9bb6 |
c | 1.c | 120ms | 2.3ms | 11.8MB | 110ms | 0ms | gcc 12.2.0 |
python | 1.py | 1085ms | 58ms | 213.2MB | 1033ms | 37ms | pypy 3.9.16 |
python | 2.py | 1345ms | 7.3ms | 164.4MB | 1253ms | 70ms | pyston 3.8.12 |
python | 2.py | 1668ms | 7.8ms | 164.8MB | 1593ms | 60ms | cpython 3.11.1 |
python | 1.py | 1746ms | 35ms | 86.1MB | 1713ms | 20ms | pyston 3.8.12 |
python | 2.py | 1769ms | 128ms | 266.8MB | 1623ms | 123ms | pypy 3.9.16 |
python | 1.py | 2971ms | 17ms | 86.7MB | 2933ms | 20ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 1389ms | 1.4ms | 1.3MB | 2723ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 1613ms | 2.8ms | 1.3MB | 3163ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 1684ms | 16ms | 3.3MB | 3300ms | 0ms | clang 14.0.0 |
c | 4-m.c | 1698ms | 5.3ms | 3.1MB | 3337ms | 0ms | clang 14.0.0 |
c | 5-im.c | 1848ms | 11ms | 1.3MB | 3630ms | 0ms | gcc 12.2.0 |
c | 5-im.c | 2152ms | 3.8ms | 3.2MB | 4233ms | 0ms | clang 14.0.0 |
c | 3-m.c | 2200ms | 14ms | 1.3MB | 4330ms | 0ms | gcc 12.2.0 |
c | 3-m.c | 2210ms | 8.6ms | 3.2MB | 4337ms | 3ms | clang 14.0.0 |
python | 8.py | timeout | 0.0ms | 16.5MB | 57ms | 7ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 105.2MB | 717ms | 120ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.7MB | 57ms | 23ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 357ms | 1.3ms | 1.3MB | 687ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 416ms | 4.5ms | 1.3MB | 793ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 431ms | 2.2ms | 3.1MB | 820ms | 0ms | clang 14.0.0 |
c | 4-m.c | 436ms | 2.6ms | 3.1MB | 837ms | 0ms | clang 14.0.0 |
c | 5-im.c | 472ms | 2.2ms | 1.3MB | 907ms | 0ms | gcc 12.2.0 |
c | 3-m.c | 560ms | 4.0ms | 1.3MB | 1080ms | 0ms | gcc 12.2.0 |
c | 3-m.c | 564ms | 4.7ms | 3.2MB | 1090ms | 0ms | clang 14.0.0 |
c | 5-im.c | 590ms | 76ms | 3.3MB | 1093ms | 0ms | clang 14.0.0 |
python | 8.py | timeout | 0.0ms | 18.2MB | 113ms | 10ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 107.0MB | 1267ms | 210ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.2MB | 160ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 102ms | 3.6ms | 1.3MB | 177ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 112ms | 2.5ms | 1.3MB | 200ms | 0ms | gcc 12.2.0 |
c | 6-im.c | 115ms | 0.2ms | 3.2MB | 203ms | 0ms | clang 14.0.0 |
c | 4-m.c | 119ms | 2.3ms | 3.5MB | 210ms | 0ms | clang 14.0.0 |
c | 5-im.c | 127ms | 0.5ms | 1.3MB | 230ms | 0ms | gcc 12.2.0 |
c | 5-im.c | 147ms | 2.5ms | 3.2MB | 263ms | 3ms | clang 14.0.0 |
c | 3-m.c | 149ms | 1.3ms | 3.3MB | 273ms | 0ms | gcc 12.2.0 |
c | 3-m.c | 150ms | 1.7ms | 3.2MB | 273ms | 0ms | clang 14.0.0 |
python | 8-m.py | 3558ms | 133ms | 107.0MB | 6063ms | 373ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 15.9MB | 243ms | 30ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 17.1MB | 357ms | 73ms | pyston 3.8.12 |