Programming Language and compiler
Benchmarks

Haxe VS Python benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1149ms 16ms 95.7MB 1087ms 47ms pypy 3.10.14
haxe 1.hx 1329ms 25ms 145.7MB 1547ms 63ms haxe/cpp 4.3.6
haxe 2.hx 4475ms 79ms 497.1MB 5153ms 213ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 50.6MB 5560ms 417ms haxe/hl/c 4.3.6
haxe 2.hx timeout 0.0ms 85.0MB 5067ms 693ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 52.4MB 7860ms 440ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 132.9MB 7410ms 773ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 40.8MB 4970ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 40.6MB 4743ms 240ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 93ms 1.2ms 27.6MB 90ms 7ms haxe/cpp 4.3.6
python 1.py 94ms 1.9ms 68.0MB 63ms 20ms pypy 3.10.14
haxe 2.hx 405ms 19ms 60.3MB 440ms 27ms haxe/cpp 4.3.6
python 1.py 491ms 25ms 11.9MB 463ms 7ms pyston 3.8.12
haxe 1.hx 637ms 9.9ms 10.7MB 600ms 57ms haxe/hl/c 4.3.6
haxe 1.hx 673ms 7.3ms 13.4MB 730ms 57ms haxe/hl/jit 1.14.0
python 1.py 710ms 4.2ms 12.8MB 697ms 0ms cpython 3.13.0
haxe 2.hx 925ms 7.0ms 15.5MB 787ms 183ms haxe/hl/c 4.3.6
haxe 2.hx 1253ms 56ms 27.2MB 1317ms 183ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1909ms 10.0ms 88.3MB 1867ms 23ms pypy 3.10.14
haxe 1.hx 2465ms 27ms 27.4MB 2353ms 250ms haxe/cpp 4.3.6
python 5-m.py 2472ms 27ms 12.5MB 3610ms 997ms pyston 3.8.12
python 5-m.py 2826ms 10ms 64.9MB 4047ms 780ms pypy 3.10.14
python 1.py 3033ms 47ms 8.1MB 3017ms 0ms pyston 3.8.12
python 5-m.py 3411ms 65ms 13.9MB 4617ms 930ms cpython 3.13.0
python 1.py 4670ms 96ms 8.8MB 4650ms 3ms cpython 3.13.0
haxe 1.hx timeout 0.0ms 5.4MB 4233ms 970ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 5.7MB 4290ms 933ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 250ms 0.3ms 63.8MB 223ms 10ms pypy 3.10.14
haxe 1.hx 261ms 3.2ms 27.6MB 223ms 37ms haxe/cpp 4.3.6
python 5-m.py 312ms 1.4ms 12.5MB 420ms 123ms pyston 3.8.12
python 1.py 312ms 2.4ms 8.1MB 297ms 0ms pyston 3.8.12
python 5-m.py 408ms 10ms 13.9MB 520ms 120ms cpython 3.13.0
python 1.py 478ms 11ms 8.8MB 463ms 0ms cpython 3.13.0
python 5-m.py 555ms 5.0ms 65.0MB 817ms 313ms pypy 3.10.14
haxe 1.hx 652ms 1.7ms 5.4MB 547ms 120ms haxe/hl/c 4.3.6
haxe 1.hx 693ms 3.7ms 5.7MB 593ms 120ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.3ms 4.7MB 0ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2.3ms 0.2ms 4.4MB 0ms 0ms haxe/cpp 4.3.6
haxe 1.hx 4.1ms 0.3ms 4.7MB 0ms 0ms haxe/hl/jit 1.14.0
python 1.py 12ms 1.2ms 7.6MB 5ms 5ms pyston 3.8.12
python 1.py 15ms 0.3ms 8.5MB 10ms 0ms cpython 3.13.0
python 1.py 29ms 1.5ms 51.0MB 4ms 12ms pypy 3.10.14

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 135ms 3.7ms 20.4MB 123ms 3ms haxe/cpp 4.3.6
haxe 1.hx 136ms 1.5ms 5.0MB 130ms 0ms haxe/hl/c 4.3.6
python 2.py 146ms 5.0ms 57.9MB 120ms 7ms pypy 3.10.14
haxe 1.hx 159ms 3.9ms 5.8MB 143ms 3ms haxe/hl/jit 1.14.0
python 1.py 176ms 0.5ms 59.5MB 150ms 10ms pypy 3.10.14
python 1.py 713ms 3.1ms 8.9MB 703ms 0ms pyston 3.8.12
python 2.py 841ms 12ms 8.5MB 830ms 0ms pyston 3.8.12
python 1.py 1118ms 25ms 9.4MB 1110ms 0ms cpython 3.13.0
python 2.py 1290ms 15ms 9.1MB 1273ms 0ms cpython 3.13.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 339ms 1.0ms 58.9MB 313ms 13ms pypy 3.10.14
python 1.py 372ms 2.9ms 60.4MB 347ms 10ms pypy 3.10.14
haxe 1.hx 378ms 2.7ms 25.5MB 360ms 7ms haxe/cpp 4.3.6
haxe 1.hx 396ms 2.4ms 5.1MB 383ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 458ms 2.3ms 5.8MB 447ms 3ms haxe/hl/jit 1.14.0
python 1.py 2130ms 31ms 8.9MB 2117ms 3ms pyston 3.8.12
python 2.py 2504ms 61ms 8.5MB 2490ms 0ms pyston 3.8.12
python 1.py 3298ms 41ms 9.4MB 3283ms 0ms cpython 3.13.0
python 2.py 3869ms 4.9ms 9.1MB 3853ms 0ms cpython 3.13.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 62ms 0.1ms 12.4MB 50ms 0ms haxe/cpp 4.3.6
haxe 1.hx 67ms 0.4ms 5.0MB 60ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 79ms 0.1ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0
python 2.py 103ms 0.8ms 57.8MB 77ms 13ms pypy 3.10.14
python 1.py 120ms 2.9ms 58.5MB 97ms 7ms pypy 3.10.14
python 1.py 349ms 5.9ms 8.5MB 333ms 0ms pyston 3.8.12
python 2.py 384ms 5.3ms 8.1MB 367ms 3ms pyston 3.8.12
python 1.py 536ms 14ms 9.3MB 520ms 0ms cpython 3.13.0
python 2.py 617ms 1.4ms 8.8MB 607ms 0ms cpython 3.13.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 926ms 34ms 96.9MB 1033ms 43ms haxe/cpp 4.3.6
python 1.py 2247ms 43ms 210.1MB 2133ms 97ms pypy 3.10.14
haxe 1.hx timeout 0.0ms 34.5MB 4910ms 500ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 57.0MB 5923ms 507ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 93.9MB 4953ms 30ms cpython 3.13.0
python 1.py timeout 0.0ms 130.3MB 4930ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 173ms 2.0ms 28.6MB 173ms 7ms haxe/cpp 4.3.6
python 1.py 378ms 2.6ms 103.6MB 327ms 33ms pypy 3.10.14
haxe 1.hx 1302ms 9.8ms 12.7MB 1247ms 133ms haxe/hl/c 4.3.6
haxe 1.hx 1487ms 13ms 22.3MB 1537ms 123ms haxe/hl/jit 1.14.0
python 1.py 3059ms 119ms 37.1MB 3030ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 48.9MB 4953ms 33ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 867ms 20ms 5.1MB 860ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 1053ms 7.5ms 5.0MB 1040ms 0ms haxe/hl/c 4.3.6
python 2.py 1352ms 14ms 59.8MB 1320ms 17ms pypy 3.10.14
haxe 3.hx 1390ms 21ms 25.6MB 1597ms 40ms haxe/cpp 4.3.6
haxe 2.hx 2402ms 3.1ms 5.7MB 2387ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2451ms 7.8ms 5.7MB 2433ms 0ms haxe/hl/jit 1.14.0
python 1.py 2641ms 30ms 56.6MB 2610ms 13ms pypy 3.10.14
haxe 1.hx timeout 0.0ms 4.4MB 4990ms 0ms haxe/cpp 4.3.6
haxe 2.hx timeout 0.0ms 4.4MB 4990ms 0ms haxe/cpp 4.3.6
haxe 3.hx timeout 0.0ms 5.2MB 3863ms 1640ms haxe/hl/c 4.3.6
haxe 3.hx timeout 0.0ms 5.9MB 4157ms 1303ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.0
python 2.py timeout 0.0ms 8.8MB 4983ms 0ms cpython 3.13.0
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 89ms 2.0ms 5.0MB 80ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 110ms 3.1ms 5.0MB 100ms 0ms haxe/hl/c 4.3.6
haxe 3.hx 158ms 1.7ms 25.6MB 163ms 7ms haxe/cpp 4.3.6
python 2.py 180ms 2.7ms 57.6MB 153ms 10ms pypy 3.10.14
haxe 2.hx 250ms 2.1ms 5.7MB 240ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 250ms 1.7ms 5.7MB 237ms 0ms haxe/hl/jit 1.14.0
python 1.py 304ms 5.3ms 56.8MB 277ms 10ms pypy 3.10.14
haxe 3.hx 665ms 0.8ms 5.1MB 527ms 193ms haxe/hl/c 4.3.6
haxe 2.hx 671ms 3.3ms 4.4MB 657ms 0ms haxe/cpp 4.3.6
haxe 3.hx 773ms 2.5ms 5.8MB 633ms 197ms haxe/hl/jit 1.14.0
haxe 1.hx 807ms 5.6ms 4.4MB 797ms 0ms haxe/cpp 4.3.6
python 1.py 1078ms 255ms 8.3MB 1063ms 0ms pyston 3.8.12
python 2.py 1319ms 15ms 8.1MB 1303ms 0ms pyston 3.8.12
python 1.py 2912ms 17ms 8.8MB 2900ms 0ms cpython 3.13.0
python 2.py 3132ms 41ms 8.8MB 3123ms 0ms cpython 3.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3912ms 9.7ms 5.2MB 3900ms 0ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 6.9MB 4980ms 3ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4983ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.7MB 53ms 10ms cpython 3.13.0
python 8.py timeout 0.0ms 100.0MB 833ms 137ms pypy 3.10.14
python 8.py timeout 0.0ms 18.2MB 70ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 986ms 2.8ms 5.1MB 973ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2391ms 1.0ms 6.6MB 2377ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4980ms 7ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.4MB 93ms 30ms cpython 3.13.0
python 8.py timeout 0.0ms 99.8MB 1533ms 517ms pypy 3.10.14
python 8.py timeout 0.0ms 17.5MB 140ms 33ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 251ms 2.6ms 5.0MB 243ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 600ms 0.8ms 5.4MB 583ms 0ms haxe/cpp 4.3.6
python 8-m.py 1973ms 18ms 95.1MB 6307ms 370ms pypy 3.10.14
haxe 1.hx 2304ms 7.8ms 5.7MB 2287ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.1MB 277ms 40ms cpython 3.13.0
python 8.py timeout 0.0ms 17.3MB 397ms 113ms pyston 3.8.12