Programming Language and compiler
Benchmarks

Haxe VS Python benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1086ms 7.1ms 95.8MB 1023ms 47ms pypy 3.10.14
haxe 1.hx 1232ms 27ms 144.0MB 1417ms 63ms haxe/cpp 4.3.6
haxe 2.hx 4213ms 67ms 497.0MB 4850ms 217ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 50.6MB 5367ms 437ms haxe/hl/c 4.3.6
haxe 2.hx timeout 0.0ms 85.0MB 4880ms 743ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 52.9MB 7470ms 420ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 132.9MB 7320ms 807ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.1
python 1.py timeout 0.0ms 40.5MB 4750ms 237ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 82ms 3.2ms 25.6MB 73ms 3ms haxe/cpp 4.3.6
python 1.py 93ms 4.4ms 68.1MB 57ms 20ms pypy 3.10.14
haxe 2.hx 354ms 9.3ms 60.1MB 370ms 23ms haxe/cpp 4.3.6
python 1.py 448ms 2.5ms 11.9MB 423ms 7ms pyston 3.8.12
haxe 1.hx 599ms 7.0ms 10.7MB 567ms 47ms haxe/hl/c 4.3.6
haxe 1.hx 636ms 20ms 13.2MB 693ms 50ms haxe/hl/jit 1.14.0
python 1.py 675ms 16ms 12.6MB 660ms 0ms cpython 3.13.1
haxe 2.hx 874ms 18ms 15.7MB 780ms 130ms haxe/hl/c 4.3.6
haxe 2.hx 891ms 21ms 27.0MB 830ms 180ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1807ms 11ms 88.3MB 1767ms 30ms pypy 3.10.14
haxe 1.hx 2331ms 12ms 25.6MB 2153ms 247ms haxe/cpp 4.3.6
python 5-m.py 2335ms 46ms 12.5MB 3357ms 953ms pyston 3.8.12
python 5-m.py 2672ms 21ms 64.9MB 3783ms 763ms pypy 3.10.14
python 1.py 2864ms 24ms 8.1MB 2850ms 3ms pyston 3.8.12
python 5-m.py 3195ms 8.8ms 13.8MB 4240ms 883ms cpython 3.13.1
python 1.py 4308ms 7.9ms 8.8MB 4297ms 0ms cpython 3.13.1
haxe 1.hx timeout 0.0ms 5.2MB 4270ms 933ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 5.7MB 4277ms 947ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 238ms 5.8ms 63.6MB 210ms 13ms pypy 3.10.14
haxe 1.hx 246ms 5.3ms 27.5MB 200ms 40ms haxe/cpp 4.3.6
python 5-m.py 295ms 6.0ms 12.5MB 383ms 127ms pyston 3.8.12
python 1.py 299ms 3.5ms 8.1MB 287ms 0ms pyston 3.8.12
python 5-m.py 377ms 1.5ms 13.8MB 457ms 123ms cpython 3.13.1
python 1.py 451ms 3.5ms 8.8MB 440ms 3ms cpython 3.13.1
python 5-m.py 510ms 5.7ms 64.9MB 750ms 283ms pypy 3.10.14
haxe 1.hx 622ms 7.2ms 5.3MB 507ms 127ms haxe/hl/c 4.3.6
haxe 1.hx 650ms 2.7ms 5.8MB 553ms 113ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.1ms 0.1ms 4.8MB 0ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2.4ms 0.2ms 4.3MB 0ms 0ms haxe/cpp 4.3.6
haxe 1.hx 3.5ms 0.5ms 4.8MB 0ms 0ms haxe/hl/jit 1.14.0
python 1.py 11ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 1.3ms 8.5MB 10ms 0ms cpython 3.13.1
python 1.py 26ms 0.9ms 51.0MB 8ms 8ms pypy 3.10.14

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 127ms 0.8ms 5.0MB 120ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 128ms 3.0ms 20.4MB 113ms 3ms haxe/cpp 4.3.6
python 2.py 143ms 0.8ms 57.9MB 117ms 13ms pypy 3.10.14
haxe 1.hx 153ms 5.1ms 5.7MB 143ms 0ms haxe/hl/jit 1.14.0
python 1.py 172ms 3.1ms 59.5MB 147ms 10ms pypy 3.10.14
python 1.py 694ms 2.8ms 8.9MB 687ms 0ms pyston 3.8.12
python 2.py 790ms 4.9ms 8.5MB 773ms 0ms pyston 3.8.12
python 1.py 1060ms 5.7ms 9.3MB 1043ms 0ms cpython 3.13.1
python 2.py 1262ms 16ms 9.0MB 1247ms 0ms cpython 3.13.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 321ms 7.8ms 58.9MB 293ms 10ms pypy 3.10.14
python 1.py 360ms 5.5ms 60.4MB 337ms 10ms pypy 3.10.14
haxe 1.hx 361ms 10ms 25.6MB 347ms 3ms haxe/cpp 4.3.6
haxe 1.hx 370ms 1.8ms 5.0MB 353ms 3ms haxe/hl/c 4.3.6
haxe 1.hx 436ms 4.8ms 5.7MB 420ms 3ms haxe/hl/jit 1.14.0
python 1.py 2016ms 25ms 8.9MB 2000ms 0ms pyston 3.8.12
python 2.py 2346ms 34ms 8.5MB 2333ms 0ms pyston 3.8.12
python 1.py 3111ms 15ms 9.3MB 3093ms 3ms cpython 3.13.1
python 2.py 3679ms 12ms 9.0MB 3667ms 0ms cpython 3.13.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 61ms 0.9ms 12.4MB 47ms 0ms haxe/cpp 4.3.6
haxe 1.hx 65ms 2.0ms 5.0MB 57ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 77ms 1.0ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0
python 2.py 101ms 2.0ms 57.8MB 77ms 10ms pypy 3.10.14
python 1.py 115ms 1.3ms 58.5MB 90ms 10ms pypy 3.10.14
python 1.py 328ms 7.8ms 8.5MB 313ms 0ms pyston 3.8.12
python 2.py 366ms 15ms 8.1MB 350ms 0ms pyston 3.8.12
python 1.py 503ms 5.9ms 9.1MB 483ms 0ms cpython 3.13.1
python 2.py 613ms 10ms 8.8MB 600ms 0ms cpython 3.13.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 860ms 12ms 97.0MB 943ms 40ms haxe/cpp 4.3.6
python 1.py 2111ms 2.8ms 210.1MB 2007ms 83ms pypy 3.10.14
haxe 1.hx timeout 0.0ms 34.6MB 4787ms 557ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 59.8MB 5720ms 480ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 93.9MB 4963ms 23ms cpython 3.13.1
python 1.py timeout 0.0ms 130.4MB 4933ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 158ms 1.7ms 28.6MB 157ms 7ms haxe/cpp 4.3.6
python 1.py 360ms 5.1ms 103.6MB 297ms 50ms pypy 3.10.14
haxe 1.hx 1221ms 17ms 12.8MB 1160ms 127ms haxe/hl/c 4.3.6
haxe 1.hx 1244ms 17ms 22.3MB 1260ms 123ms haxe/hl/jit 1.14.0
python 1.py 2752ms 61ms 37.2MB 2727ms 7ms cpython 3.13.1
python 1.py 4838ms 94ms 48.9MB 4770ms 50ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 808ms 2.6ms 5.0MB 800ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 1008ms 28ms 5.0MB 997ms 0ms haxe/hl/c 4.3.6
python 2.py 1278ms 0.7ms 59.8MB 1253ms 10ms pypy 3.10.14
haxe 3.hx 1319ms 19ms 25.6MB 1433ms 43ms haxe/cpp 4.3.6
haxe 2.hx 2282ms 22ms 5.7MB 2270ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2328ms 4.3ms 5.7MB 2317ms 0ms haxe/hl/jit 1.14.0
python 1.py 2492ms 13ms 56.6MB 2467ms 10ms pypy 3.10.14
haxe 1.hx timeout 0.0ms 4.4MB 4987ms 0ms haxe/cpp 4.3.6
haxe 2.hx timeout 0.0ms 4.4MB 4987ms 0ms haxe/cpp 4.3.6
haxe 3.hx timeout 0.0ms 5.2MB 3857ms 1647ms haxe/hl/c 4.3.6
haxe 3.hx timeout 0.0ms 5.9MB 4097ms 1367ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.13.1
python 2.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.1
python 1.py timeout 0.0ms 8.3MB 4987ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 85ms 2.3ms 5.0MB 77ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 103ms 1.4ms 5.0MB 93ms 0ms haxe/hl/c 4.3.6
haxe 3.hx 147ms 2.7ms 27.6MB 143ms 10ms haxe/cpp 4.3.6
python 2.py 165ms 1.2ms 57.8MB 143ms 10ms pypy 3.10.14
haxe 2.hx 232ms 2.0ms 5.7MB 220ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 240ms 7.9ms 5.7MB 230ms 0ms haxe/hl/jit 1.14.0
python 1.py 284ms 2.2ms 56.6MB 267ms 3ms pypy 3.10.14
haxe 3.hx 628ms 2.6ms 5.2MB 487ms 190ms haxe/hl/c 4.3.6
haxe 2.hx 633ms 1.3ms 4.4MB 620ms 0ms haxe/cpp 4.3.6
haxe 3.hx 732ms 7.5ms 5.8MB 587ms 197ms haxe/hl/jit 1.14.0
haxe 1.hx 761ms 7.6ms 4.4MB 753ms 0ms haxe/cpp 4.3.6
python 1.py 892ms 9.1ms 8.3MB 883ms 0ms pyston 3.8.12
python 2.py 1234ms 13ms 8.3MB 1220ms 0ms pyston 3.8.12
python 1.py 2829ms 9.3ms 8.8MB 2813ms 0ms cpython 3.13.1
python 2.py 3043ms 23ms 8.8MB 3030ms 0ms cpython 3.13.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3731ms 16ms 5.2MB 3720ms 0ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 6.9MB 4987ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4987ms 3ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.7MB 43ms 13ms cpython 3.13.1
python 8.py timeout 0.0ms 99.4MB 790ms 163ms pypy 3.10.14
python 8.py timeout 0.0ms 16.5MB 67ms 20ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 936ms 9.4ms 5.2MB 923ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2279ms 6.3ms 6.6MB 2267ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4987ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.5MB 87ms 20ms cpython 3.13.1
python 8.py timeout 0.0ms 100.4MB 1460ms 480ms pypy 3.10.14
python 8.py timeout 0.0ms 15.6MB 147ms 37ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 242ms 7.7ms 5.1MB 227ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 568ms 1.8ms 5.4MB 557ms 0ms haxe/cpp 4.3.6
python 8-m.py 1880ms 5.8ms 95.0MB 6000ms 323ms pypy 3.10.14
haxe 1.hx 2209ms 6.9ms 5.8MB 2200ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.2MB 233ms 33ms cpython 3.13.1
python 8.py timeout 0.0ms 17.2MB 440ms 127ms pyston 3.8.12