Programming Language and compiler
Benchmarks

Haxe VS Python benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1667ms 61ms 273.7MB 1530ms 110ms pypy 3.8.13
haxe 1.hx 1746ms 39ms 146.0MB 2053ms 50ms haxe/cpp 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 112ms 1.7ms 27.4MB 113ms 7ms haxe/cpp 4.2.4
python 1.py 128ms 2.2ms 82.9MB 83ms 20ms pypy 3.8.13
haxe 2.hx 471ms 7.8ms 60.2MB 547ms 27ms haxe/cpp 4.2.4
python 1.py 641ms 4.3ms 12.3MB 610ms 13ms pyston 3.8.12
haxe 1.hx 799ms 17ms 7.8MB 757ms 23ms haxe/hl/c 4.2.4
haxe 1.hx 1052ms 5.0ms 11.1MB 1000ms 37ms haxe/hl/jit 1.12.0
haxe 2.hx 1257ms 16ms 13.5MB 1083ms 160ms haxe/hl/c 4.2.4
python 1.py 1532ms 2.7ms 11.8MB 1517ms 0ms cpython 3.10.4
haxe 2.hx 1595ms 8.6ms 24.5MB 1413ms 167ms haxe/hl/jit 1.12.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2691ms 81ms 90.8MB 2643ms 30ms pypy 3.8.13
haxe 1.hx 3288ms 4.4ms 27.4MB 3187ms 280ms haxe/cpp 4.2.4
python 5-m.py 3357ms 14ms 12.9MB 4937ms 1013ms pyston 3.8.12
python 5-m.py 3998ms 20ms 85.2MB 4463ms 930ms pypy 3.8.13
python 1.py 4467ms 32ms 8.2MB 4447ms 3ms pyston 3.8.12
python 5-m.py 4473ms 26ms 12.1MB 6287ms 1063ms cpython 3.10.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 347ms 5.0ms 81.5MB 320ms 13ms pypy 3.8.13
haxe 1.hx 348ms 3.6ms 27.4MB 310ms 40ms haxe/cpp 4.2.4
python 5-m.py 408ms 6.5ms 12.9MB 537ms 130ms pyston 3.8.12
python 1.py 460ms 2.0ms 8.2MB 447ms 0ms pyston 3.8.12
python 5-m.py 522ms 3.8ms 12.0MB 670ms 147ms cpython 3.10.4
python 1.py 732ms 8.2ms 7.8MB 717ms 0ms cpython 3.10.4
python 5-m.py 813ms 7.3ms 85.3MB 900ms 443ms pypy 3.8.13
haxe 1.hx 823ms 1.1ms 3.5MB 717ms 87ms haxe/hl/c 4.2.4
haxe 1.hx 854ms 0.5ms 3.8MB 800ms 37ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.7ms 2.6MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 2.7ms 0.4ms 3.2MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx 4.0ms 0.7ms 3.3MB 0ms 0ms haxe/hl/jit 1.12.0
python 1.py 14ms 1.1ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.6ms 7.5MB 10ms 0ms cpython 3.10.4
python 1.py 34ms 1.1ms 53.6MB 10ms 10ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 180ms 0.8ms 2.8MB 170ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 182ms 1.5ms 20.3MB 167ms 0ms haxe/cpp 4.2.4
python 2.py 204ms 2.0ms 79.9MB 160ms 23ms pypy 3.8.13
python 1.py 244ms 0.9ms 81.2MB 217ms 10ms pypy 3.8.13
haxe 1.hx 249ms 4.9ms 3.8MB 233ms 0ms haxe/hl/jit 1.12.0
python 1.py 1052ms 3.9ms 9.3MB 1040ms 0ms pyston 3.8.12
python 2.py 1290ms 15ms 9.0MB 1277ms 0ms pyston 3.8.12
python 1.py 1848ms 8.2ms 8.3MB 1830ms 0ms cpython 3.10.4
python 2.py 2609ms 24ms 8.3MB 2597ms 0ms cpython 3.10.4

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 470ms 1.2ms 80.1MB 443ms 10ms pypy 3.8.13
python 1.py 513ms 2.9ms 81.2MB 490ms 10ms pypy 3.8.13
haxe 1.hx 518ms 0.7ms 27.5MB 510ms 0ms haxe/cpp 4.2.4
haxe 1.hx 535ms 3.8ms 3.0MB 523ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 720ms 11ms 3.7MB 707ms 0ms haxe/hl/jit 1.12.0
python 1.py 3126ms 28ms 9.3MB 3117ms 0ms pyston 3.8.12
python 2.py 3831ms 16ms 9.1MB 3817ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 86ms 1.4ms 14.1MB 73ms 3ms haxe/cpp 4.2.4
haxe 1.hx 89ms 1.0ms 2.9MB 77ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 120ms 1.3ms 3.6MB 110ms 0ms haxe/hl/jit 1.12.0
python 2.py 147ms 0.7ms 80.0MB 117ms 13ms pypy 3.8.13
python 1.py 164ms 1.1ms 80.8MB 137ms 13ms pypy 3.8.13
python 1.py 519ms 1.1ms 9.0MB 503ms 0ms pyston 3.8.12
python 2.py 597ms 5.7ms 8.5MB 583ms 0ms pyston 3.8.12
python 1.py 868ms 2.3ms 7.8MB 857ms 0ms cpython 3.10.4
python 2.py 1256ms 4.4ms 7.4MB 1240ms 0ms cpython 3.10.4

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1165ms 17ms 97.0MB 1357ms 37ms haxe/cpp 4.2.4
python 1.py 2718ms 66ms 293.9MB 2520ms 183ms pypy 3.8.13
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 222ms 3.5ms 28.6MB 230ms 10ms haxe/cpp 4.2.4
python 1.py 387ms 1.3ms 144.6MB 327ms 43ms pypy 3.8.13
haxe 1.hx 1591ms 10ms 15.3MB 1497ms 77ms haxe/hl/c 4.2.4
haxe 1.hx 1950ms 6.7ms 20.4MB 1800ms 133ms haxe/hl/jit 1.12.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 978ms 29ms 2.6MB 967ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 1318ms 51ms 2.6MB 1307ms 0ms haxe/hl/c 4.2.4
python 2.py 2186ms 36ms 79.8MB 2157ms 13ms pypy 3.8.13
haxe 3.hx 2348ms 2.5ms 27.6MB 2647ms 47ms haxe/cpp 4.2.4
haxe 2.hx 2467ms 70ms 3.4MB 2457ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2528ms 21ms 3.3MB 2517ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 99ms 2.0ms 2.6MB 87ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 130ms 1.0ms 2.6MB 117ms 0ms haxe/hl/c 4.2.4
haxe 2.hx 246ms 2.4ms 3.4MB 233ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 250ms 1.0ms 27.6MB 263ms 7ms haxe/cpp 4.2.4
haxe 1.hx 259ms 2.3ms 3.3MB 250ms 0ms haxe/hl/jit 1.12.0
python 2.py 282ms 2.1ms 79.5MB 257ms 10ms pypy 3.8.13
python 1.py 590ms 2.3ms 79.7MB 563ms 10ms pypy 3.8.13
haxe 3.hx 697ms 12ms 3.3MB 623ms 57ms haxe/hl/c 4.2.4
haxe 2.hx 841ms 3.8ms 4.4MB 827ms 0ms haxe/cpp 4.2.4
haxe 3.hx 849ms 3.5ms 3.7MB 777ms 53ms haxe/hl/jit 1.12.0
haxe 1.hx 1135ms 2.7ms 3.1MB 1123ms 0ms haxe/cpp 4.2.4
python 1.py 1463ms 3.4ms 8.6MB 1450ms 0ms pyston 3.8.12
python 2.py 2152ms 28ms 8.5MB 2140ms 0ms pyston 3.8.12
python 1.py 4709ms 32ms 7.3MB 4693ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2333ms 0.6ms 6.6MB 2320ms 0ms haxe/cpp 4.2.4
haxe 1.hx 2339ms 1.2ms 3.2MB 2327ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 586ms 0.6ms 5.3MB 573ms 0ms haxe/cpp 4.2.4
haxe 1.hx 588ms 0.8ms 3.0MB 580ms 0ms haxe/hl/c 4.2.4
python 8-m.py 3295ms 48ms 110.4MB 5600ms 377ms pypy 3.8.13
haxe 1.hx 3428ms 1.3ms 3.7MB 3420ms 0ms haxe/hl/jit 1.12.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12