Programming Language and compiler
Benchmarks

Haxe VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1346ms 37ms 146.5MB 1547ms 73ms haxe/cpp 4.3.3
python 1.py 1568ms 90ms 79.1MB 1510ms 40ms pypy 3.10.13
haxe 2.hx 4434ms 13ms 497.6MB 5017ms 237ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 50.6MB 5550ms 417ms haxe/hl/c 4.3.3
haxe 2.hx timeout 0.0ms 85.0MB 4997ms 693ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 52.5MB 7810ms 447ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 133.0MB 7413ms 843ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 41.3MB 4977ms 10ms cpython 3.12.1
python 1.py timeout 0.0ms 40.5MB 4763ms 223ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 92ms 3.5ms 28.1MB 87ms 10ms haxe/cpp 4.3.3
python 1.py 116ms 0.7ms 62.6MB 80ms 20ms pypy 3.10.13
haxe 2.hx 396ms 10.0ms 60.8MB 427ms 17ms haxe/cpp 4.3.3
python 1.py 478ms 4.3ms 11.9MB 450ms 13ms pyston 3.8.12
haxe 1.hx 640ms 0.3ms 10.9MB 600ms 53ms haxe/hl/c 4.3.3
haxe 1.hx 669ms 7.5ms 13.2MB 710ms 63ms haxe/hl/jit 1.14.0
python 1.py 732ms 6.5ms 13.1MB 713ms 0ms cpython 3.12.1
haxe 2.hx 930ms 4.0ms 15.6MB 810ms 160ms haxe/hl/c 4.3.3
haxe 2.hx 1114ms 23ms 27.0MB 1120ms 183ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1945ms 8.0ms 62.7MB 1917ms 10ms pypy 3.10.13
haxe 1.hx 2368ms 2.5ms 28.3MB 2300ms 187ms haxe/cpp 4.3.3
python 5-m.py 2465ms 14ms 12.4MB 3553ms 1027ms pyston 3.8.12
python 5-m.py 2926ms 14ms 63.1MB 4217ms 773ms pypy 3.10.13
python 1.py 3002ms 24ms 8.1MB 2987ms 0ms pyston 3.8.12
python 5-m.py 3316ms 15ms 14.3MB 4393ms 993ms cpython 3.12.1
python 1.py 4481ms 71ms 9.3MB 4473ms 0ms cpython 3.12.1
haxe 1.hx timeout 0.0ms 5.2MB 4343ms 843ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 5.7MB 4357ms 867ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 254ms 1.8ms 28.0MB 230ms 23ms haxe/cpp 4.3.3
python 1.py 267ms 4.6ms 61.3MB 240ms 7ms pypy 3.10.13
python 5-m.py 314ms 12ms 12.5MB 407ms 147ms pyston 3.8.12
python 1.py 316ms 1.5ms 8.1MB 303ms 3ms pyston 3.8.12
python 5-m.py 401ms 1.6ms 14.3MB 463ms 167ms cpython 3.12.1
python 1.py 469ms 14ms 9.3MB 457ms 0ms cpython 3.12.1
haxe 1.hx 653ms 1.5ms 5.4MB 547ms 117ms haxe/hl/c 4.3.3
python 5-m.py 657ms 11ms 63.1MB 880ms 367ms pypy 3.10.13
haxe 1.hx 673ms 1.7ms 5.8MB 577ms 113ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.2ms 5.0MB 0ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 2.5ms 0.2ms 5.1MB 0ms 0ms haxe/cpp 4.3.3
haxe 1.hx 3.9ms 0.3ms 5.0MB 0ms 0ms haxe/hl/jit 1.14.0
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 135ms 2.2ms 21.0MB 120ms 0ms haxe/cpp 4.3.3
haxe 1.hx 136ms 1.7ms 5.0MB 127ms 0ms haxe/hl/c 4.3.3
python 2.py 154ms 4.7ms 56.8MB 123ms 17ms pypy 3.10.13
haxe 1.hx 155ms 1.2ms 5.7MB 147ms 0ms haxe/hl/jit 1.14.0
python 1.py 189ms 6.3ms 59.5MB 160ms 13ms pypy 3.10.13
python 1.py 729ms 10ms 8.9MB 713ms 0ms pyston 3.8.12
python 2.py 851ms 3.5ms 8.5MB 840ms 0ms pyston 3.8.12
python 1.py 1105ms 12ms 9.9MB 1093ms 0ms cpython 3.12.1
python 2.py 1288ms 22ms 9.5MB 1277ms 0ms cpython 3.12.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 349ms 3.5ms 59.9MB 327ms 10ms pypy 3.10.13
haxe 1.hx 382ms 4.8ms 26.0MB 363ms 10ms haxe/cpp 4.3.3
python 1.py 395ms 5.9ms 60.9MB 367ms 17ms pypy 3.10.13
haxe 1.hx 399ms 5.7ms 5.2MB 387ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 454ms 3.0ms 5.8MB 437ms 3ms haxe/hl/jit 1.14.0
python 1.py 2192ms 83ms 8.9MB 2180ms 0ms pyston 3.8.12
python 2.py 2556ms 13ms 8.5MB 2547ms 0ms pyston 3.8.12
python 1.py 3250ms 26ms 9.9MB 3233ms 0ms cpython 3.12.1
python 2.py 3744ms 9.6ms 9.5MB 3733ms 0ms cpython 3.12.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 64ms 1.6ms 12.9MB 50ms 0ms haxe/cpp 4.3.3
haxe 1.hx 67ms 0.2ms 5.0MB 60ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 78ms 1.9ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0
python 2.py 113ms 4.7ms 56.5MB 87ms 10ms pypy 3.10.13
python 1.py 122ms 0.4ms 57.5MB 93ms 10ms pypy 3.10.13
python 1.py 349ms 6.2ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 391ms 3.9ms 8.1MB 380ms 0ms pyston 3.8.12
python 1.py 528ms 10ms 9.5MB 517ms 0ms cpython 3.12.1
python 2.py 616ms 7.8ms 9.3MB 603ms 0ms cpython 3.12.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 906ms 10ms 97.5MB 993ms 50ms haxe/cpp 4.3.3
python 1.py 2604ms 19ms 201.5MB 2490ms 97ms pypy 3.10.13
haxe 1.hx timeout 0.0ms 34.6MB 4937ms 463ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 59.1MB 6103ms 520ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 81.6MB 4970ms 20ms cpython 3.12.1
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 168ms 2.3ms 29.1MB 167ms 10ms haxe/cpp 4.3.3
python 1.py 487ms 3.0ms 94.2MB 440ms 30ms pypy 3.10.13
haxe 1.hx 1252ms 8.3ms 12.7MB 1177ms 143ms haxe/hl/c 4.3.3
haxe 1.hx 1372ms 13ms 22.4MB 1393ms 117ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 34.1MB 4977ms 7ms cpython 3.12.1
python 1.py timeout 0.0ms 41.4MB 4970ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 850ms 3.3ms 5.0MB 837ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 1043ms 7.8ms 5.0MB 1030ms 0ms haxe/hl/c 4.3.3
haxe 3.hx 1381ms 4.5ms 28.1MB 1537ms 33ms haxe/cpp 4.3.3
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
haxe 2.hx 2397ms 5.9ms 5.7MB 2383ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2470ms 4.7ms 5.7MB 2457ms 0ms haxe/hl/jit 1.14.0
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
haxe 1.hx timeout 0.0ms 4.9MB 4990ms 0ms haxe/cpp 4.3.3
haxe 2.hx timeout 0.0ms 4.9MB 4987ms 0ms haxe/cpp 4.3.3
haxe 3.hx timeout 0.0ms 5.4MB 3853ms 1630ms haxe/hl/c 4.3.3
haxe 3.hx timeout 0.0ms 6.0MB 4117ms 1320ms haxe/hl/jit 1.14.0
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 90ms 1.5ms 5.0MB 80ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 108ms 1.2ms 5.0MB 100ms 0ms haxe/hl/c 4.3.3
haxe 3.hx 153ms 1.5ms 28.3MB 147ms 10ms haxe/cpp 4.3.3
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
haxe 2.hx 247ms 5.2ms 5.7MB 237ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 252ms 1.0ms 5.7MB 240ms 0ms haxe/hl/jit 1.14.0
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
haxe 3.hx 677ms 19ms 5.2MB 523ms 200ms haxe/hl/c 4.3.3
haxe 2.hx 688ms 25ms 5.0MB 680ms 0ms haxe/cpp 4.3.3
haxe 3.hx 774ms 2.3ms 5.8MB 640ms 187ms haxe/hl/jit 1.14.0
haxe 1.hx 807ms 2.8ms 5.0MB 797ms 0ms haxe/cpp 4.3.3
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3903ms 4.9ms 5.3MB 3890ms 0ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 7.4MB 4987ms 0ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 5.8MB 4990ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 988ms 15ms 5.1MB 973ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 2387ms 2.0ms 7.0MB 2377ms 0ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 5.8MB 4980ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 259ms 10ms 5.2MB 247ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 601ms 1.4ms 5.9MB 590ms 0ms haxe/cpp 4.3.3
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
haxe 1.hx 2301ms 9.1ms 5.8MB 2287ms 0ms haxe/hl/jit 1.14.0
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12