Current benchmark data was generated on Thu May 04 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1790ms | 46ms | 217.6MB | 1663ms | 110ms | pypy 3.9.16 |
haxe | 1.hx | 2096ms | 20ms | 146.2MB | 2420ms | 73ms | haxe/cpp 4.2.5 |
haxe | 2.hx | timeout | 0.0ms | 398.3MB | 5893ms | 190ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 48.7MB | 4733ms | 247ms | haxe/hl/c 4.2.5 |
haxe | 2.hx | timeout | 0.0ms | 83.0MB | 4490ms | 493ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 49.0MB | 4743ms | 237ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | timeout | 0.0ms | 130.2MB | 4500ms | 483ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 40.9MB | 4960ms | 17ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 40.3MB | 4917ms | 63ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 128ms | 7.4ms | 25.8MB | 120ms | 10ms | haxe/cpp 4.2.5 |
python | 1.py | 160ms | 14ms | 74.6MB | 110ms | 23ms | pypy 3.9.16 |
haxe | 2.hx | 597ms | 8.3ms | 58.4MB | 653ms | 40ms | haxe/cpp 4.2.5 |
python | 1.py | 671ms | 2.6ms | 12.0MB | 633ms | 17ms | pyston 3.8.12 |
haxe | 1.hx | 844ms | 3.6ms | 8.6MB | 797ms | 33ms | haxe/hl/c 4.2.5 |
python | 1.py | 966ms | 14ms | 12.5MB | 947ms | 3ms | cpython 3.11.3 |
haxe | 1.hx | 1008ms | 5.7ms | 11.1MB | 950ms | 40ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | 1339ms | 21ms | 13.5MB | 1210ms | 113ms | haxe/hl/c 4.2.5 |
haxe | 2.hx | 1818ms | 21ms | 25.0MB | 1650ms | 150ms | haxe/hl/jit 1.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 3154ms | 17ms | 27.6MB | 3213ms | 220ms | haxe/cpp 4.2.5 |
python | 5-m.py | 3471ms | 17ms | 12.7MB | 4990ms | 1227ms | pyston 3.8.12 |
python | 1.py | 3566ms | 105ms | 85.0MB | 3510ms | 37ms | pypy 3.9.16 |
python | 1.py | 3928ms | 17ms | 8.0MB | 3910ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 4067ms | 23ms | 13.6MB | 5703ms | 1260ms | cpython 3.11.3 |
python | 5-m.py | 4917ms | 70ms | 76.1MB | 5657ms | 1113ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 3.3MB | 4647ms | 333ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.7MB | 4743ms | 237ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 3ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 332ms | 2.6ms | 27.7MB | 317ms | 23ms | haxe/cpp 4.2.5 |
python | 1.py | 409ms | 0.7ms | 7.9MB | 393ms | 3ms | pyston 3.8.12 |
python | 1.py | 427ms | 11ms | 73.7MB | 390ms | 20ms | pypy 3.9.16 |
python | 5-m.py | 428ms | 8.5ms | 12.6MB | 557ms | 143ms | pyston 3.8.12 |
python | 5-m.py | 505ms | 14ms | 13.6MB | 593ms | 207ms | cpython 3.11.3 |
python | 1.py | 604ms | 1.0ms | 8.6MB | 587ms | 0ms | cpython 3.11.3 |
haxe | 1.hx | 779ms | 2.0ms | 3.3MB | 723ms | 40ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 837ms | 0.9ms | 3.7MB | 787ms | 37ms | haxe/hl/jit 1.13.0 |
python | 5-m.py | 874ms | 16ms | 76.3MB | 983ms | 463ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 2.6ms | 0.5ms | 3.2MB | 0ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 3.3ms | 0.7ms | 2.9MB | 0ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 4.5ms | 1.1ms | 2.8MB | 0ms | 0ms | haxe/hl/jit 1.13.0 |
python | 1.py | 13ms | 0.4ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 15ms | 0.9ms | 8.4MB | 7ms | 3ms | cpython 3.11.3 |
python | 1.py | 40ms | 2.2ms | 52.0MB | 14ms | 10ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 200ms | 9.2ms | 20.4MB | 180ms | 7ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 209ms | 2.4ms | 2.9MB | 197ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 230ms | 8.2ms | 3.6MB | 217ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 232ms | 1.0ms | 71.0MB | 203ms | 17ms | pypy 3.9.16 |
python | 1.py | 278ms | 6.3ms | 71.9MB | 247ms | 13ms | pypy 3.9.16 |
python | 1.py | 925ms | 7.8ms | 9.0MB | 907ms | 0ms | pyston 3.8.12 |
python | 2.py | 1073ms | 2.7ms | 8.8MB | 1057ms | 0ms | pyston 3.8.12 |
python | 1.py | 1276ms | 27ms | 9.3MB | 1257ms | 0ms | cpython 3.11.3 |
python | 2.py | 1421ms | 16ms | 9.1MB | 1407ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 549ms | 11ms | 25.6MB | 537ms | 7ms | haxe/cpp 4.2.5 |
python | 2.py | 557ms | 2.9ms | 71.5MB | 527ms | 20ms | pypy 3.9.16 |
python | 1.py | 608ms | 1.1ms | 72.4MB | 587ms | 7ms | pypy 3.9.16 |
haxe | 1.hx | 615ms | 3.9ms | 2.9MB | 600ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 669ms | 6.6ms | 3.7MB | 653ms | 3ms | haxe/hl/jit 1.13.0 |
python | 1.py | 2726ms | 8.2ms | 9.0MB | 2710ms | 0ms | pyston 3.8.12 |
python | 2.py | 3173ms | 4.4ms | 8.7MB | 3160ms | 0ms | pyston 3.8.12 |
python | 1.py | 3748ms | 29ms | 9.2MB | 3733ms | 0ms | cpython 3.11.3 |
python | 2.py | 4262ms | 61ms | 9.1MB | 4247ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 88ms | 1.1ms | 12.2MB | 73ms | 3ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 103ms | 0.5ms | 2.8MB | 93ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 113ms | 0.5ms | 3.6MB | 103ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 162ms | 0.5ms | 71.2MB | 130ms | 13ms | pypy 3.9.16 |
python | 1.py | 181ms | 1.1ms | 72.4MB | 140ms | 23ms | pypy 3.9.16 |
python | 1.py | 444ms | 1.3ms | 8.8MB | 430ms | 0ms | pyston 3.8.12 |
python | 2.py | 506ms | 6.4ms | 8.3MB | 490ms | 0ms | pyston 3.8.12 |
python | 1.py | 598ms | 1.3ms | 8.7MB | 583ms | 0ms | cpython 3.11.3 |
python | 2.py | 712ms | 6.9ms | 8.4MB | 697ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1500ms | 28ms | 95.2MB | 1657ms | 53ms | haxe/cpp 4.2.5 |
python | 1.py | 2892ms | 160ms | 230.4MB | 2713ms | 160ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 31.9MB | 4647ms | 333ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 54.0MB | 4657ms | 327ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 92.9MB | 4940ms | 40ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 130.3MB | 4920ms | 53ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 260ms | 8.6ms | 26.7MB | 263ms | 13ms | haxe/cpp 4.2.5 |
python | 1.py | 423ms | 11ms | 149.9MB | 360ms | 47ms | pypy 3.9.16 |
haxe | 1.hx | 1701ms | 17ms | 10.9MB | 1557ms | 123ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 2040ms | 23ms | 20.3MB | 1910ms | 110ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 37.1MB | 4977ms | 7ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 41.4MB | 4960ms | 17ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 1084ms | 2.5ms | 2.4MB | 1070ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 1446ms | 1.1ms | 2.3MB | 1430ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | 1504ms | 9.5ms | 27.7MB | 1800ms | 57ms | haxe/cpp 4.2.5 |
python | 2.py | 2132ms | 23ms | 71.3MB | 2103ms | 10ms | pypy 3.9.16 |
haxe | 2.hx | 2451ms | 1.1ms | 3.2MB | 2440ms | 0ms | haxe/hl/jit 1.13.0 |
haxe | 1.hx | 2611ms | 7.8ms | 3.2MB | 2593ms | 0ms | haxe/hl/jit 1.13.0 |
python | 1.py | 3664ms | 19ms | 70.4MB | 3623ms | 23ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 3.2MB | 4987ms | 0ms | haxe/cpp 4.2.5 |
haxe | 2.hx | timeout | 0.0ms | 3.2MB | 4983ms | 0ms | haxe/cpp 4.2.5 |
haxe | 3.hx | timeout | 0.0ms | 3.3MB | 4527ms | 460ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | timeout | 0.0ms | 3.6MB | 4680ms | 307ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 8.4MB | 4987ms | 0ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4983ms | 0ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4987ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 7.9MB | 4980ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 115ms | 3.2ms | 2.3MB | 103ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 147ms | 0.3ms | 2.3MB | 140ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | 171ms | 4.5ms | 27.7MB | 183ms | 13ms | haxe/cpp 4.2.5 |
haxe | 2.hx | 257ms | 4.8ms | 3.3MB | 240ms | 0ms | haxe/hl/jit 1.13.0 |
haxe | 1.hx | 274ms | 13ms | 3.3MB | 260ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 279ms | 3.4ms | 71.2MB | 253ms | 10ms | pypy 3.9.16 |
python | 1.py | 425ms | 14ms | 70.4MB | 390ms | 17ms | pypy 3.9.16 |
haxe | 3.hx | 693ms | 2.4ms | 3.2MB | 620ms | 57ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | 822ms | 1.3ms | 3.6MB | 763ms | 47ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | 864ms | 26ms | 3.2MB | 850ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 1125ms | 3.7ms | 3.2MB | 1110ms | 0ms | haxe/cpp 4.2.5 |
python | 1.py | 1156ms | 2.0ms | 8.4MB | 1137ms | 3ms | pyston 3.8.12 |
python | 2.py | 1597ms | 31ms | 7.9MB | 1577ms | 3ms | pyston 3.8.12 |
python | 1.py | 3179ms | 60ms | 8.4MB | 3167ms | 3ms | cpython 3.11.3 |
python | 2.py | 3574ms | 7.6ms | 8.6MB | 3557ms | 0ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | timeout | 0.0ms | 321.0MB | 4897ms | 80ms | cpython 3.11.3 |
python | 2.py | timeout | 0.0ms | 633.5MB | 4677ms | 307ms | cpython 3.11.3 |
python | 1.py | timeout | 0.0ms | 382.8MB | 4850ms | 133ms | pypy 3.9.16 |
python | 2.py | timeout | 0.0ms | 991.9MB | 4623ms | 360ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.4MB | 4903ms | 80ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.3MB | 4557ms | 423ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1331ms | 14ms | 207.2MB | 1257ms | 60ms | pypy 3.9.16 |
python | 2.py | 1563ms | 21ms | 164.4MB | 1463ms | 83ms | pyston 3.8.12 |
python | 2.py | 2088ms | 6.3ms | 164.9MB | 1990ms | 83ms | cpython 3.11.3 |
python | 2.py | 2161ms | 4.7ms | 210.5MB | 2013ms | 133ms | pypy 3.9.16 |
python | 1.py | 3370ms | 74ms | 86.0MB | 3313ms | 37ms | pyston 3.8.12 |
python | 1.py | 4719ms | 66ms | 86.6MB | 4660ms | 40ms | cpython 3.11.3 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | timeout | 0.0ms | 7.2MB | 4987ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.1MB | 4980ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.8MB | 4987ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8.py | timeout | 0.0ms | 16.3MB | 50ms | 10ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 99.0MB | 657ms | 100ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 16.3MB | 70ms | 20ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1361ms | 10ms | 2.9MB | 1347ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 2168ms | 1.1ms | 6.6MB | 2153ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.6MB | 4987ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8.py | timeout | 0.0ms | 16.2MB | 97ms | 17ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 102.4MB | 1130ms | 193ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.6MB | 167ms | 27ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 342ms | 0.3ms | 2.9MB | 330ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 548ms | 0.2ms | 5.4MB | 533ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 2851ms | 2.8ms | 3.7MB | 2840ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8-m.py | 4105ms | 62ms | 103.1MB | 7120ms | 430ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 15.9MB | 230ms | 23ms | cpython 3.11.3 |
python | 8.py | timeout | 0.0ms | 16.7MB | 310ms | 70ms | pyston 3.8.12 |