Current benchmark data was generated on Fri May 20 2022, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1667ms | 61ms | 273.7MB | 1530ms | 110ms | pypy 3.8.13 |
haxe | 1.hx | 1746ms | 39ms | 146.0MB | 2053ms | 50ms | haxe/cpp 4.2.4 |
haxe | 2.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 2.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
haxe | 2.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 112ms | 1.7ms | 27.4MB | 113ms | 7ms | haxe/cpp 4.2.4 |
python | 1.py | 128ms | 2.2ms | 82.9MB | 83ms | 20ms | pypy 3.8.13 |
haxe | 2.hx | 471ms | 7.8ms | 60.2MB | 547ms | 27ms | haxe/cpp 4.2.4 |
python | 1.py | 641ms | 4.3ms | 12.3MB | 610ms | 13ms | pyston 3.8.12 |
haxe | 1.hx | 799ms | 17ms | 7.8MB | 757ms | 23ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 1052ms | 5.0ms | 11.1MB | 1000ms | 37ms | haxe/hl/jit 1.12.0 |
haxe | 2.hx | 1257ms | 16ms | 13.5MB | 1083ms | 160ms | haxe/hl/c 4.2.4 |
python | 1.py | 1532ms | 2.7ms | 11.8MB | 1517ms | 0ms | cpython 3.10.4 |
haxe | 2.hx | 1595ms | 8.6ms | 24.5MB | 1413ms | 167ms | haxe/hl/jit 1.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 2691ms | 81ms | 90.8MB | 2643ms | 30ms | pypy 3.8.13 |
haxe | 1.hx | 3288ms | 4.4ms | 27.4MB | 3187ms | 280ms | haxe/cpp 4.2.4 |
python | 5-m.py | 3357ms | 14ms | 12.9MB | 4937ms | 1013ms | pyston 3.8.12 |
python | 5-m.py | 3998ms | 20ms | 85.2MB | 4463ms | 930ms | pypy 3.8.13 |
python | 1.py | 4467ms | 32ms | 8.2MB | 4447ms | 3ms | pyston 3.8.12 |
python | 5-m.py | 4473ms | 26ms | 12.1MB | 6287ms | 1063ms | cpython 3.10.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 347ms | 5.0ms | 81.5MB | 320ms | 13ms | pypy 3.8.13 |
haxe | 1.hx | 348ms | 3.6ms | 27.4MB | 310ms | 40ms | haxe/cpp 4.2.4 |
python | 5-m.py | 408ms | 6.5ms | 12.9MB | 537ms | 130ms | pyston 3.8.12 |
python | 1.py | 460ms | 2.0ms | 8.2MB | 447ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 522ms | 3.8ms | 12.0MB | 670ms | 147ms | cpython 3.10.4 |
python | 1.py | 732ms | 8.2ms | 7.8MB | 717ms | 0ms | cpython 3.10.4 |
python | 5-m.py | 813ms | 7.3ms | 85.3MB | 900ms | 443ms | pypy 3.8.13 |
haxe | 1.hx | 823ms | 1.1ms | 3.5MB | 717ms | 87ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 854ms | 0.5ms | 3.8MB | 800ms | 37ms | haxe/hl/jit 1.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 2.2ms | 0.7ms | 2.6MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 2.7ms | 0.4ms | 3.2MB | 0ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 4.0ms | 0.7ms | 3.3MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | 14ms | 1.1ms | 7.6MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 15ms | 0.6ms | 7.5MB | 10ms | 0ms | cpython 3.10.4 |
python | 1.py | 34ms | 1.1ms | 53.6MB | 10ms | 10ms | pypy 3.8.13 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 180ms | 0.8ms | 2.8MB | 170ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 182ms | 1.5ms | 20.3MB | 167ms | 0ms | haxe/cpp 4.2.4 |
python | 2.py | 204ms | 2.0ms | 79.9MB | 160ms | 23ms | pypy 3.8.13 |
python | 1.py | 244ms | 0.9ms | 81.2MB | 217ms | 10ms | pypy 3.8.13 |
haxe | 1.hx | 249ms | 4.9ms | 3.8MB | 233ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | 1052ms | 3.9ms | 9.3MB | 1040ms | 0ms | pyston 3.8.12 |
python | 2.py | 1290ms | 15ms | 9.0MB | 1277ms | 0ms | pyston 3.8.12 |
python | 1.py | 1848ms | 8.2ms | 8.3MB | 1830ms | 0ms | cpython 3.10.4 |
python | 2.py | 2609ms | 24ms | 8.3MB | 2597ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 470ms | 1.2ms | 80.1MB | 443ms | 10ms | pypy 3.8.13 |
python | 1.py | 513ms | 2.9ms | 81.2MB | 490ms | 10ms | pypy 3.8.13 |
haxe | 1.hx | 518ms | 0.7ms | 27.5MB | 510ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 535ms | 3.8ms | 3.0MB | 523ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 720ms | 11ms | 3.7MB | 707ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | 3126ms | 28ms | 9.3MB | 3117ms | 0ms | pyston 3.8.12 |
python | 2.py | 3831ms | 16ms | 9.1MB | 3817ms | 0ms | pyston 3.8.12 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 86ms | 1.4ms | 14.1MB | 73ms | 3ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 89ms | 1.0ms | 2.9MB | 77ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 120ms | 1.3ms | 3.6MB | 110ms | 0ms | haxe/hl/jit 1.12.0 |
python | 2.py | 147ms | 0.7ms | 80.0MB | 117ms | 13ms | pypy 3.8.13 |
python | 1.py | 164ms | 1.1ms | 80.8MB | 137ms | 13ms | pypy 3.8.13 |
python | 1.py | 519ms | 1.1ms | 9.0MB | 503ms | 0ms | pyston 3.8.12 |
python | 2.py | 597ms | 5.7ms | 8.5MB | 583ms | 0ms | pyston 3.8.12 |
python | 1.py | 868ms | 2.3ms | 7.8MB | 857ms | 0ms | cpython 3.10.4 |
python | 2.py | 1256ms | 4.4ms | 7.4MB | 1240ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1165ms | 17ms | 97.0MB | 1357ms | 37ms | haxe/cpp 4.2.4 |
python | 1.py | 2718ms | 66ms | 293.9MB | 2520ms | 183ms | pypy 3.8.13 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 222ms | 3.5ms | 28.6MB | 230ms | 10ms | haxe/cpp 4.2.4 |
python | 1.py | 387ms | 1.3ms | 144.6MB | 327ms | 43ms | pypy 3.8.13 |
haxe | 1.hx | 1591ms | 10ms | 15.3MB | 1497ms | 77ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 1950ms | 6.7ms | 20.4MB | 1800ms | 133ms | haxe/hl/jit 1.12.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 978ms | 29ms | 2.6MB | 967ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 1318ms | 51ms | 2.6MB | 1307ms | 0ms | haxe/hl/c 4.2.4 |
python | 2.py | 2186ms | 36ms | 79.8MB | 2157ms | 13ms | pypy 3.8.13 |
haxe | 3.hx | 2348ms | 2.5ms | 27.6MB | 2647ms | 47ms | haxe/cpp 4.2.4 |
haxe | 2.hx | 2467ms | 70ms | 3.4MB | 2457ms | 0ms | haxe/hl/jit 1.12.0 |
haxe | 1.hx | 2528ms | 21ms | 3.3MB | 2517ms | 0ms | haxe/hl/jit 1.12.0 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/cpp 4.2.4 |
haxe | 2.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/cpp 4.2.4 |
haxe | 3.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 3.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 1.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 99ms | 2.0ms | 2.6MB | 87ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | 130ms | 1.0ms | 2.6MB | 117ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 2.hx | 246ms | 2.4ms | 3.4MB | 233ms | 0ms | haxe/hl/jit 1.12.0 |
haxe | 3.hx | 250ms | 1.0ms | 27.6MB | 263ms | 7ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 259ms | 2.3ms | 3.3MB | 250ms | 0ms | haxe/hl/jit 1.12.0 |
python | 2.py | 282ms | 2.1ms | 79.5MB | 257ms | 10ms | pypy 3.8.13 |
python | 1.py | 590ms | 2.3ms | 79.7MB | 563ms | 10ms | pypy 3.8.13 |
haxe | 3.hx | 697ms | 12ms | 3.3MB | 623ms | 57ms | haxe/hl/c 4.2.4 |
haxe | 2.hx | 841ms | 3.8ms | 4.4MB | 827ms | 0ms | haxe/cpp 4.2.4 |
haxe | 3.hx | 849ms | 3.5ms | 3.7MB | 777ms | 53ms | haxe/hl/jit 1.12.0 |
haxe | 1.hx | 1135ms | 2.7ms | 3.1MB | 1123ms | 0ms | haxe/cpp 4.2.4 |
python | 1.py | 1463ms | 3.4ms | 8.6MB | 1450ms | 0ms | pyston 3.8.12 |
python | 2.py | 2152ms | 28ms | 8.5MB | 2140ms | 0ms | pyston 3.8.12 |
python | 1.py | 4709ms | 32ms | 7.3MB | 4693ms | 0ms | cpython 3.10.4 |
python | 2.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 2333ms | 0.6ms | 6.6MB | 2320ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 2339ms | 1.2ms | 3.2MB | 2327ms | 0ms | haxe/hl/c 4.2.4 |
haxe | 1.hx | timeout | 0.0ms | 0.0MB | 0ms | 0ms | haxe/hl/jit 1.12.0 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pypy 3.8.13 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 586ms | 0.6ms | 5.3MB | 573ms | 0ms | haxe/cpp 4.2.4 |
haxe | 1.hx | 588ms | 0.8ms | 3.0MB | 580ms | 0ms | haxe/hl/c 4.2.4 |
python | 8-m.py | 3295ms | 48ms | 110.4MB | 5600ms | 377ms | pypy 3.8.13 |
haxe | 1.hx | 3428ms | 1.3ms | 3.7MB | 3420ms | 0ms | haxe/hl/jit 1.12.0 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | cpython 3.10.4 |
python | 8.py | timeout | 0.0ms | 0.0MB | 0ms | 0ms | pyston 3.8.12 |