Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1880ms | 26ms | 146.2MB | 2330ms | 70ms | haxe/cpp 4.2.5 |
python | 1.py | 2447ms | 34ms | 217.6MB | 2300ms | 130ms | pypy 3.9.16 |
haxe | 2.hx | timeout | 0.0ms | 480.8MB | 6600ms | 247ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 48.6MB | 4707ms | 277ms | haxe/hl/c 4.2.5 |
haxe | 2.hx | timeout | 0.0ms | 83.0MB | 4503ms | 480ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 49.0MB | 4733ms | 250ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | timeout | 0.0ms | 130.2MB | 4497ms | 480ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 40.8MB | 4957ms | 23ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 40.4MB | 4933ms | 47ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 126ms | 3.3ms | 27.7MB | 117ms | 3ms | haxe/cpp 4.2.5 |
python | 1.py | 162ms | 21ms | 74.4MB | 110ms | 23ms | pypy 3.9.16 |
haxe | 2.hx | 510ms | 9.4ms | 60.3MB | 587ms | 30ms | haxe/cpp 4.2.5 |
python | 1.py | 674ms | 6.1ms | 12.0MB | 653ms | 7ms | pyston 3.8.12 |
haxe | 1.hx | 909ms | 9.0ms | 8.6MB | 860ms | 33ms | haxe/hl/c 4.2.5 |
python | 1.py | 989ms | 5.6ms | 12.5MB | 970ms | 7ms | cpython 3.11.1 |
haxe | 1.hx | 1133ms | 11ms | 11.1MB | 1077ms | 37ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | 1314ms | 27ms | 13.4MB | 1213ms | 83ms | haxe/hl/c 4.2.5 |
haxe | 2.hx | 1509ms | 8.7ms | 25.0MB | 1383ms | 110ms | haxe/hl/jit 1.13.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 3083ms | 3.1ms | 27.5MB | 3050ms | 247ms | haxe/cpp 4.2.5 |
python | 5-m.py | 3396ms | 47ms | 12.7MB | 4827ms | 1273ms | pyston 3.8.12 |
python | 1.py | 3472ms | 22ms | 85.0MB | 3427ms | 23ms | pypy 3.9.16 |
python | 1.py | 3936ms | 36ms | 7.9MB | 3923ms | 0ms | pyston 3.8.12 |
python | 5-m.py | 4001ms | 4.4ms | 13.6MB | 5693ms | 1197ms | cpython 3.11.1 |
python | 5-m.py | 4662ms | 42ms | 76.1MB | 6713ms | 1320ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 3.4MB | 4683ms | 300ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.8MB | 4750ms | 233ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4980ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 328ms | 3.5ms | 27.5MB | 300ms | 33ms | haxe/cpp 4.2.5 |
python | 1.py | 407ms | 1.7ms | 8.0MB | 390ms | 3ms | pyston 3.8.12 |
python | 1.py | 433ms | 0.6ms | 73.8MB | 407ms | 13ms | pypy 3.9.16 |
python | 5-m.py | 436ms | 14ms | 12.6MB | 557ms | 160ms | pyston 3.8.12 |
python | 5-m.py | 485ms | 5.8ms | 13.6MB | 587ms | 193ms | cpython 3.11.1 |
python | 1.py | 594ms | 1.0ms | 8.6MB | 580ms | 0ms | cpython 3.11.1 |
haxe | 1.hx | 769ms | 1.0ms | 3.3MB | 710ms | 43ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 834ms | 0.2ms | 3.6MB | 770ms | 50ms | haxe/hl/jit 1.13.0 |
python | 5-m.py | 845ms | 3.6ms | 76.2MB | 923ms | 457ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 2.7ms | 0.7ms | 2.4MB | 0ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 4.0ms | 0.7ms | 3.0MB | 0ms | 0ms | haxe/hl/jit 1.13.0 |
haxe | 1.hx | 4.3ms | 1.7ms | 3.2MB | 0ms | 0ms | haxe/cpp 4.2.5 |
python | 1.py | 14ms | 0.9ms | 8.4MB | 10ms | 0ms | cpython 3.11.1 |
python | 1.py | 14ms | 0.7ms | 7.3MB | 10ms | 0ms | pyston 3.8.12 |
python | 1.py | 37ms | 0.6ms | 51.6MB | 8ms | 14ms | pypy 3.9.16 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 189ms | 2.3ms | 22.3MB | 177ms | 3ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 209ms | 5.8ms | 2.8MB | 197ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 229ms | 3.3ms | 3.6MB | 217ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 232ms | 1.2ms | 70.9MB | 200ms | 10ms | pypy 3.9.16 |
python | 1.py | 284ms | 6.6ms | 71.9MB | 240ms | 23ms | pypy 3.9.16 |
python | 1.py | 934ms | 3.2ms | 9.1MB | 923ms | 0ms | pyston 3.8.12 |
python | 2.py | 1077ms | 7.0ms | 8.7MB | 1063ms | 0ms | pyston 3.8.12 |
python | 1.py | 1255ms | 16ms | 9.3MB | 1243ms | 0ms | cpython 3.11.1 |
python | 2.py | 1427ms | 8.5ms | 9.1MB | 1410ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 538ms | 8.2ms | 27.5MB | 523ms | 7ms | haxe/cpp 4.2.5 |
python | 2.py | 557ms | 5.6ms | 71.3MB | 520ms | 23ms | pypy 3.9.16 |
haxe | 1.hx | 610ms | 3.4ms | 2.8MB | 593ms | 3ms | haxe/hl/c 4.2.5 |
python | 1.py | 616ms | 1.8ms | 72.5MB | 580ms | 20ms | pypy 3.9.16 |
haxe | 1.hx | 674ms | 13ms | 3.7MB | 660ms | 0ms | haxe/hl/jit 1.13.0 |
python | 1.py | 2744ms | 8.5ms | 9.1MB | 2723ms | 0ms | pyston 3.8.12 |
python | 2.py | 3201ms | 18ms | 8.7MB | 3183ms | 3ms | pyston 3.8.12 |
python | 1.py | 3733ms | 77ms | 9.3MB | 3717ms | 0ms | cpython 3.11.1 |
python | 2.py | 4232ms | 26ms | 9.1MB | 4217ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 86ms | 0.6ms | 14.1MB | 73ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 102ms | 1.2ms | 2.9MB | 90ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 113ms | 0.6ms | 3.6MB | 100ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 161ms | 0.9ms | 71.3MB | 130ms | 10ms | pypy 3.9.16 |
python | 1.py | 187ms | 2.1ms | 72.3MB | 157ms | 17ms | pypy 3.9.16 |
python | 1.py | 454ms | 2.7ms | 8.8MB | 440ms | 0ms | pyston 3.8.12 |
python | 2.py | 501ms | 1.5ms | 8.2MB | 487ms | 0ms | pyston 3.8.12 |
python | 1.py | 597ms | 4.0ms | 8.7MB | 577ms | 3ms | cpython 3.11.1 |
python | 2.py | 709ms | 5.6ms | 8.4MB | 693ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1315ms | 13ms | 97.2MB | 1570ms | 50ms | haxe/cpp 4.2.5 |
python | 1.py | 2938ms | 261ms | 230.3MB | 2777ms | 143ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 32.7MB | 4650ms | 333ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 54.0MB | 4590ms | 393ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 92.9MB | 4947ms | 33ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 130.2MB | 4930ms | 50ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 253ms | 10ms | 28.5MB | 243ms | 23ms | haxe/cpp 4.2.5 |
python | 1.py | 482ms | 20ms | 149.6MB | 410ms | 53ms | pypy 3.9.16 |
haxe | 1.hx | 1659ms | 4.1ms | 10.9MB | 1533ms | 110ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 1917ms | 76ms | 20.2MB | 1800ms | 103ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 36.9MB | 4967ms | 13ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 41.5MB | 4963ms | 17ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 1107ms | 28ms | 2.3MB | 1097ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 1439ms | 3.4ms | 2.4MB | 1427ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 3-m.hx | 1482ms | 19ms | 27.6MB | 2480ms | 23ms | haxe/cpp 4.2.5 |
python | 2.py | 2170ms | 15ms | 71.1MB | 2137ms | 17ms | pypy 3.9.16 |
haxe | 2.hx | 2488ms | 69ms | 3.3MB | 2477ms | 0ms | haxe/hl/jit 1.13.0 |
haxe | 1.hx | 2618ms | 43ms | 3.2MB | 2600ms | 0ms | haxe/hl/jit 1.13.0 |
python | 1.py | 3646ms | 10ms | 70.2MB | 3617ms | 7ms | pypy 3.9.16 |
haxe | 1.hx | timeout | 0.0ms | 3.2MB | 4990ms | 0ms | haxe/cpp 4.2.5 |
haxe | 2.hx | timeout | 0.0ms | 3.3MB | 4983ms | 0ms | haxe/cpp 4.2.5 |
haxe | 3.hx | timeout | 0.0ms | 3.3MB | 4537ms | 443ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | timeout | 0.0ms | 3.8MB | 4630ms | 350ms | haxe/hl/jit 1.13.0 |
python | 1.py | timeout | 0.0ms | 8.5MB | 4987ms | 0ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 8.6MB | 4980ms | 3ms | cpython 3.11.1 |
python | 1.py | timeout | 0.0ms | 8.5MB | 4990ms | 0ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.0MB | 4983ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 2.hx | 112ms | 1.0ms | 2.4MB | 100ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 147ms | 1.1ms | 2.4MB | 140ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 3-m.hx | 166ms | 0.9ms | 27.7MB | 243ms | 10ms | haxe/cpp 4.2.5 |
haxe | 2.hx | 251ms | 0.5ms | 3.3MB | 237ms | 0ms | haxe/hl/jit 1.13.0 |
python | 2.py | 267ms | 1.3ms | 70.9MB | 233ms | 17ms | pypy 3.9.16 |
haxe | 1.hx | 268ms | 6.1ms | 3.3MB | 253ms | 0ms | haxe/hl/jit 1.13.0 |
python | 1.py | 416ms | 2.4ms | 70.4MB | 380ms | 17ms | pypy 3.9.16 |
haxe | 3.hx | 686ms | 2.3ms | 3.2MB | 623ms | 47ms | haxe/hl/c 4.2.5 |
haxe | 3.hx | 824ms | 11ms | 3.7MB | 763ms | 43ms | haxe/hl/jit 1.13.0 |
haxe | 2.hx | 865ms | 7.0ms | 3.2MB | 853ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 1043ms | 1.1ms | 3.2MB | 1030ms | 0ms | haxe/cpp 4.2.5 |
python | 1.py | 1163ms | 10ms | 8.4MB | 1150ms | 0ms | pyston 3.8.12 |
python | 2.py | 1601ms | 24ms | 7.9MB | 1587ms | 0ms | pyston 3.8.12 |
python | 1.py | 3147ms | 98ms | 8.5MB | 3133ms | 0ms | cpython 3.11.1 |
python | 2.py | 3709ms | 215ms | 8.6MB | 3697ms | 0ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 4962ms | 19ms | 382.8MB | 4797ms | 147ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 321.1MB | 4897ms | 87ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 633.6MB | 4557ms | 427ms | cpython 3.11.1 |
python | 2.py | timeout | 0.0ms | 1000.1MB | 4617ms | 363ms | pypy 3.9.16 |
python | 1.py | timeout | 0.0ms | 320.5MB | 4903ms | 80ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 633.0MB | 4553ms | 427ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1141ms | 2.1ms | 207.1MB | 1077ms | 50ms | pypy 3.9.16 |
python | 2.py | 1452ms | 29ms | 164.4MB | 1347ms | 90ms | pyston 3.8.12 |
python | 2.py | 1926ms | 10ms | 210.5MB | 1793ms | 117ms | pypy 3.9.16 |
python | 2.py | 2006ms | 13ms | 164.8MB | 1907ms | 80ms | cpython 3.11.1 |
python | 1.py | 3114ms | 48ms | 86.1MB | 3063ms | 33ms | pyston 3.8.12 |
python | 1.py | 4358ms | 46ms | 86.8MB | 4307ms | 33ms | cpython 3.11.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | timeout | 0.0ms | 7.2MB | 4987ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.0MB | 4990ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.7MB | 4987ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8.py | timeout | 0.0ms | 16.5MB | 53ms | 13ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 100.3MB | 660ms | 83ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.8MB | 77ms | 13ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 1352ms | 0.8ms | 3.0MB | 1340ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 2172ms | 0.6ms | 6.6MB | 2157ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | timeout | 0.0ms | 3.6MB | 4983ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8.py | timeout | 0.0ms | 16.3MB | 100ms | 17ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 111.3MB | 1097ms | 220ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 17.2MB | 160ms | 30ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
haxe | 1.hx | 342ms | 1.0ms | 2.9MB | 330ms | 0ms | haxe/hl/c 4.2.5 |
haxe | 1.hx | 548ms | 1.0ms | 5.4MB | 533ms | 0ms | haxe/cpp 4.2.5 |
haxe | 1.hx | 2851ms | 1.2ms | 3.6MB | 2840ms | 0ms | haxe/hl/jit 1.13.0 |
python | 8-m.py | 3809ms | 23ms | 104.7MB | 6577ms | 407ms | pypy 3.9.16 |
python | 8.py | timeout | 0.0ms | 15.8MB | 277ms | 47ms | cpython 3.11.1 |
python | 8.py | timeout | 0.0ms | 16.8MB | 297ms | 63ms | pyston 3.8.12 |