Current benchmark data was generated on Wed May 25 2022, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1831ms | 34ms | 220.3MB | 1667ms | 147ms | pypy 3.8.13 |
ocaml | 1.ml | 4123ms | 259ms | 120.7MB | 4060ms | 43ms | ocaml 4.14.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 140ms | 3.4ms | 78.6MB | 107ms | 20ms | pypy 3.8.13 |
ocaml | 1.ml | 285ms | 2.1ms | 17.4MB | 267ms | 3ms | ocaml 4.14.0 |
python | 1.py | 682ms | 3.3ms | 12.4MB | 657ms | 7ms | pyston 3.8.12 |
python | 1.py | 1619ms | 7.5ms | 11.8MB | 1603ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 6.ml | 357ms | 26ms | 25.6MB | 340ms | 3ms | ocaml 4.14.0 |
python | 1.py | 2907ms | 44ms | 89.2MB | 2870ms | 23ms | pypy 3.8.13 |
python | 5-m.py | 3562ms | 19ms | 12.9MB | 5000ms | 1320ms | pyston 3.8.12 |
python | 1.py | 4022ms | 316ms | 8.2MB | 4003ms | 3ms | pyston 3.8.12 |
python | 5-m.py | 4407ms | 159ms | 12.1MB | 6360ms | 1213ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 5-m.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 6.ml | 43ms | 0.5ms | 4.9MB | 30ms | 0ms | ocaml 4.14.0 |
python | 1.py | 368ms | 2.0ms | 75.5MB | 337ms | 17ms | pypy 3.8.13 |
python | 5-m.py | 432ms | 6.5ms | 12.9MB | 537ms | 173ms | pyston 3.8.12 |
python | 1.py | 434ms | 31ms | 8.2MB | 420ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 545ms | 3.4ms | 12.1MB | 683ms | 197ms | cpython 3.10.4 |
python | 1.py | 678ms | 48ms | 7.7MB | 663ms | 0ms | cpython 3.10.4 |
python | 5-m.py | 910ms | 3.9ms | 78.8MB | 1063ms | 467ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 203ms | 0.4ms | 5.8MB | 190ms | 0ms | ocaml 4.14.0 |
python | 2.py | 235ms | 0.8ms | 74.1MB | 203ms | 13ms | pypy 3.8.13 |
python | 1.py | 280ms | 0.3ms | 75.4MB | 250ms | 17ms | pypy 3.8.13 |
python | 1.py | 878ms | 5.1ms | 9.3MB | 867ms | 0ms | pyston 3.8.12 |
python | 2.py | 1055ms | 2.7ms | 9.1MB | 1040ms | 0ms | pyston 3.8.12 |
python | 1.py | 1743ms | 15ms | 8.4MB | 1730ms | 0ms | cpython 3.10.4 |
python | 2.py | 2570ms | 50ms | 8.3MB | 2557ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 562ms | 4.3ms | 74.6MB | 523ms | 17ms | pypy 3.8.13 |
python | 1.py | 614ms | 2.1ms | 76.1MB | 583ms | 17ms | pypy 3.8.13 |
ocaml | 1.ml | 627ms | 47ms | 5.9MB | 610ms | 0ms | ocaml 4.14.0 |
python | 1.py | 2586ms | 14ms | 9.3MB | 2570ms | 0ms | pyston 3.8.12 |
python | 2.py | 3121ms | 7.9ms | 9.0MB | 3107ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 91ms | 0.4ms | 5.1MB | 80ms | 0ms | ocaml 4.14.0 |
python | 2.py | 167ms | 1.7ms | 74.0MB | 133ms | 17ms | pypy 3.8.13 |
python | 1.py | 184ms | 0.5ms | 74.3MB | 143ms | 17ms | pypy 3.8.13 |
python | 1.py | 431ms | 5.2ms | 8.9MB | 413ms | 0ms | pyston 3.8.12 |
python | 2.py | 487ms | 2.4ms | 8.5MB | 477ms | 0ms | pyston 3.8.12 |
python | 1.py | 811ms | 4.9ms | 7.8MB | 793ms | 3ms | cpython 3.10.4 |
python | 2.py | 1234ms | 16ms | 7.3MB | 1217ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 1709ms | 12ms | 62.6MB | 1673ms | 17ms | ocaml 4.14.0 |
ocaml | 2.ml | 2842ms | 3.0ms | 71.2MB | 2803ms | 20ms | ocaml 4.14.0 |
python | 1.py | 2988ms | 32ms | 233.4MB | 2767ms | 203ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 205ms | 0.5ms | 18.6MB | 180ms | 10ms | ocaml 4.14.0 |
python | 1.py | 443ms | 13ms | 151.0MB | 363ms | 60ms | pypy 3.8.13 |
ocaml | 2.ml | 460ms | 5.6ms | 25.2MB | 440ms | 3ms | ocaml 4.14.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 526ms | 39ms | 2.4MB | 513ms | 0ms | ocaml 4.14.0 |
python | 2.py | 2271ms | 62ms | 74.5MB | 2243ms | 13ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 1.ml | 59ms | 0.6ms | 2.6MB | 50ms | 0ms | ocaml 4.14.0 |
python | 2.py | 294ms | 5.0ms | 74.1MB | 253ms | 27ms | pypy 3.8.13 |
python | 1.py | 583ms | 1.7ms | 73.4MB | 557ms | 13ms | pypy 3.8.13 |
python | 1.py | 1420ms | 106ms | 8.7MB | 1407ms | 0ms | pyston 3.8.12 |
python | 2.py | 2057ms | 12ms | 8.5MB | 2043ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 2.ml | 2591ms | 2.3ms | 19.8MB | 2577ms | 3ms | ocaml 4.14.0 |
ocaml | 1.ml | 3328ms | 22ms | 555.2MB | 3160ms | 150ms | ocaml 4.14.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 2.ml | 612ms | 2.4ms | 8.9MB | 593ms | 0ms | ocaml 4.14.0 |
ocaml | 1.ml | 678ms | 11ms | 142.5MB | 630ms | 30ms | ocaml 4.14.0 |
python | 1.py | 1357ms | 20ms | 209.6MB | 1277ms | 70ms | pypy 3.8.13 |
python | 1.py | 2822ms | 61ms | 86.4MB | 2770ms | 37ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 3387ms | 11ms | 274.3MB | 3267ms | 103ms | pypy 3.8.13 |
ocaml | 2.ml | timeout | 0.0ms | 0.0MB | 0ms | 0ms | ocaml 4.14.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 478ms | 2.4ms | 98.3MB | 430ms | 27ms | pypy 3.8.13 |
ocaml | 2.ml | 667ms | 1.2ms | 50.3MB | 630ms | 20ms | ocaml 4.14.0 |
python | 1.py | 745ms | 2.1ms | 30.7MB | 697ms | 30ms | pyston 3.8.12 |
python | 1.py | 757ms | 1.3ms | 30.7MB | 723ms | 20ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 2.ml | timeout | 0.0ms | 0.0MB | 0ms | 0ms | ocaml 4.14.0 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 2.ml | 1344ms | 0.8ms | 3.4MB | 1330ms | 0ms | ocaml 4.14.0 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
ocaml | 2.ml | 385ms | 0.1ms | 3.1MB | 373ms | 0ms | ocaml 4.14.0 |
python | 8-m.py | 4206ms | 35ms | 105.3MB | 7317ms | 397ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |