Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 1.1ms | 0.1ms | 1.4MB | 0ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 1.c | 1.3ms | 0.1ms | 2.1MB | 0ms | 0ms | gcc 13.2.0 |
c | 1.c | 1.5ms | 0.3ms | 2.1MB | 0ms | 0ms | clang 14.0.0-1ubuntu1.1 |
python | 1.py | 12ms | 0.9ms | 7.6MB | 0ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.3ms | 9.0MB | 0ms | 0ms | cpython 3.12.1 |
python | 1.py | 30ms | 1.2ms | 48.6MB | 8ms | 8ms | pypy 3.10.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1-m.c | 174ms | 4.0ms | 25.5MB | 410ms | 7ms | gcc 13.2.0 |
c | 1-m.c | 306ms | 28ms | 29.7MB | 1020ms | 30ms | clang 14.0.0-1ubuntu1.1 |
python | 3-m.py | 2331ms | 35ms | 135.9MB | 7750ms | 343ms | pypy 3.10.13 |
python | 3-m.py | 3289ms | 49ms | 34.2MB | 12493ms | 123ms | pyston 3.8.12 |
python | 3.py | timeout | 0.0ms | 35.9MB | 87ms | 27ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1-m.c | 28ms | 1.9ms | 13.4MB | 63ms | 0ms | gcc 13.2.0 |
c | 1-m.c | 41ms | 4.7ms | 16.8MB | 107ms | 7ms | clang 14.0.0-1ubuntu1.1 |
python | 3-m.py | 404ms | 0.9ms | 17.7MB | 1333ms | 70ms | pyston 3.8.12 |
python | 3-m.py | 409ms | 2.6ms | 71.4MB | 1023ms | 163ms | pypy 3.10.13 |
python | 3-m.py | 694ms | 3.6ms | 17.5MB | 2423ms | 80ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 245ms | 0.5ms | 1.5MB | 233ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 8-i.c | 255ms | 1.1ms | 2.3MB | 243ms | 0ms | gcc 13.2.0 |
c | 5.c | 297ms | 0.4ms | 1.5MB | 287ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 8-i.c | 301ms | 1.9ms | 2.1MB | 290ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 2.c | 309ms | 0.5ms | 2.3MB | 300ms | 0ms | gcc 13.2.0 |
c | 2.c | 311ms | 1.1ms | 1.5MB | 300ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 5.c | 311ms | 1.0ms | 2.3MB | 300ms | 0ms | gcc 13.2.0 |
c | 5.c | 314ms | 1.5ms | 2.1MB | 303ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 2.c | 318ms | 3.6ms | 2.1MB | 303ms | 0ms | clang 14.0.0-1ubuntu1.1 |
python | 2.py | 1386ms | 17ms | 60.4MB | 1357ms | 17ms | pypy 3.10.13 |
python | 1.py | 2647ms | 17ms | 54.1MB | 2617ms | 10ms | pypy 3.10.13 |
python | 1.py | timeout | 0.0ms | 9.1MB | 4987ms | 0ms | cpython 3.12.1 |
python | 2.py | timeout | 0.0ms | 9.3MB | 4990ms | 0ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4980ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4983ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 8-i.c | 27ms | 0.1ms | 1.5MB | 20ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 8-i.c | 28ms | 0.5ms | 2.3MB | 20ms | 0ms | gcc 13.2.0 |
c | 5.c | 32ms | 0.4ms | 1.5MB | 20ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 2.c | 33ms | 0.3ms | 2.3MB | 23ms | 0ms | gcc 13.2.0 |
c | 8-i.c | 33ms | 1.6ms | 2.1MB | 27ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 5.c | 33ms | 0.5ms | 2.3MB | 27ms | 0ms | gcc 13.2.0 |
c | 2.c | 34ms | 0.8ms | 1.5MB | 27ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
c | 2.c | 34ms | 0.9ms | 2.1MB | 27ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 5.c | 34ms | 1.1ms | 2.1MB | 27ms | 0ms | clang 14.0.0-1ubuntu1.1 |
python | 2.py | 179ms | 0.4ms | 55.8MB | 153ms | 10ms | pypy 3.10.13 |
python | 1.py | 305ms | 5.4ms | 54.0MB | 283ms | 10ms | pypy 3.10.13 |
python | 1.py | 942ms | 43ms | 8.3MB | 930ms | 0ms | pyston 3.8.12 |
python | 2.py | 1314ms | 31ms | 8.1MB | 1300ms | 0ms | pyston 3.8.12 |
python | 1.py | 2986ms | 131ms | 9.1MB | 2973ms | 0ms | cpython 3.12.1 |
python | 2.py | 3077ms | 2.2ms | 9.1MB | 3063ms | 0ms | cpython 3.12.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 283ms | 1.3ms | 41.1MB | 267ms | 0ms | gcc 13.2.0 |
c | 1.c | 287ms | 7.5ms | 40.8MB | 273ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 1.c | 295ms | 2.4ms | 40.3MB | 273ms | 3ms | zigcc 0.12.0-dev.2341+92211135f |
python | 2.py | 3061ms | 79ms | 632.9MB | 2887ms | 157ms | pyston 3.8.12 |
python | 1.py | 3479ms | 37ms | 366.2MB | 3410ms | 50ms | pypy 3.10.13 |
python | 1.py | 4862ms | 92ms | 320.5MB | 4807ms | 47ms | pyston 3.8.12 |
python | 2.py | 4871ms | 47ms | 634.1MB | 4697ms | 160ms | cpython 3.12.1 |
python | 1.py | timeout | 0.0ms | 321.7MB | 4963ms | 23ms | cpython 3.12.1 |
python | 2.py | timeout | 0.0ms | 956.8MB | 4737ms | 247ms | pypy 3.10.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 1.c | 54ms | 0.5ms | 11.8MB | 40ms | 0ms | gcc 13.2.0 |
c | 1.c | 58ms | 1.7ms | 11.5MB | 47ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 1.c | 59ms | 1.3ms | 11.0MB | 47ms | 0ms | zigcc 0.12.0-dev.2341+92211135f |
python | 1.py | 698ms | 9.1ms | 131.7MB | 667ms | 17ms | pypy 3.10.13 |
python | 2.py | 735ms | 2.3ms | 164.3MB | 690ms | 23ms | pyston 3.8.12 |
python | 1.py | 1113ms | 6.9ms | 86.0MB | 1087ms | 7ms | pyston 3.8.12 |
python | 2.py | 1213ms | 1.8ms | 165.4MB | 1170ms | 30ms | cpython 3.12.1 |
python | 1.py | 2241ms | 84ms | 87.3MB | 2217ms | 10ms | cpython 3.12.1 |
python | 2.py | 2612ms | 31ms | 283.0MB | 2523ms | 77ms | pypy 3.10.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 947ms | 11ms | 4.1MB | 3703ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 981ms | 47ms | 4.1MB | 3790ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 1003ms | 11ms | 9.1MB | 3920ms | 3ms | clang 14.0.0-1ubuntu1.1 |
c | 4-m.c | 1117ms | 3.7ms | 5.1MB | 4367ms | 10ms | clang 14.0.0-1ubuntu1.1 |
c | 5-im.c | 1145ms | 6.7ms | 4.1MB | 4493ms | 0ms | gcc 13.2.0 |
c | 5-im.c | 1335ms | 18ms | 5.3MB | 5220ms | 13ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 1825ms | 3.8ms | 7.3MB | 7183ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 1933ms | 0.6ms | 4.1MB | 7637ms | 3ms | gcc 13.2.0 |
python | 8.py | timeout | 0.0ms | 17.2MB | 57ms | 13ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 76.8MB | 967ms | 133ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 18.1MB | 63ms | 10ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 246ms | 0.5ms | 4.1MB | 937ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 252ms | 6.4ms | 4.0MB | 957ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 258ms | 0.1ms | 9.2MB | 973ms | 3ms | clang 14.0.0-1ubuntu1.1 |
c | 4-m.c | 288ms | 1.9ms | 7.0MB | 1090ms | 3ms | clang 14.0.0-1ubuntu1.1 |
c | 5-im.c | 297ms | 1.3ms | 4.0MB | 1130ms | 0ms | gcc 13.2.0 |
c | 5-im.c | 340ms | 0.0ms | 7.3MB | 1300ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 462ms | 0.4ms | 5.3MB | 1787ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 487ms | 1.0ms | 4.0MB | 1893ms | 0ms | gcc 13.2.0 |
python | 8.py | timeout | 0.0ms | 16.8MB | 100ms | 13ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 75.9MB | 1767ms | 440ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 17.8MB | 150ms | 30ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
c | 4-m.c | 69ms | 0.7ms | 4.1MB | 243ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 70ms | 0.0ms | 4.0MB | 247ms | 0ms | gcc 13.2.0 |
c | 6-im.c | 72ms | 1.1ms | 7.1MB | 247ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 4-m.c | 80ms | 0.5ms | 5.1MB | 280ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 5-im.c | 83ms | 0.5ms | 4.0MB | 300ms | 0ms | gcc 13.2.0 |
c | 5-im.c | 109ms | 28ms | 5.2MB | 363ms | 3ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 124ms | 0.7ms | 7.0MB | 447ms | 0ms | clang 14.0.0-1ubuntu1.1 |
c | 3-m.c | 129ms | 1.4ms | 4.0MB | 480ms | 0ms | gcc 13.2.0 |
python | 8-m.py | 2161ms | 17ms | 76.3MB | 6830ms | 320ms | pypy 3.10.13 |
python | 8.py | timeout | 0.0ms | 14.6MB | 293ms | 40ms | cpython 3.12.1 |
python | 8.py | timeout | 0.0ms | 17.2MB | 430ms | 120ms | pyston 3.8.12 |