Haxe VS Odin benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1706ms 26ms 146.0MB 1993ms 73ms haxe/cpp 4.2.5
haxe 2.hx 4974ms 30ms 497.0MB 6187ms 247ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 113ms 2.7ms 27.5MB 110ms 3ms haxe/cpp 4.2.5
haxe 2.hx 456ms 3.4ms 60.2MB 540ms 17ms haxe/cpp 4.2.5
haxe 1.hx 784ms 1.8ms 8.0MB 753ms 13ms haxe/hl/c 4.2.5
haxe 1.hx 970ms 7.8ms 11.2MB 910ms 43ms haxe/hl/jit 1.12.0
haxe 2.hx 1217ms 7.1ms 13.4MB 1097ms 103ms haxe/hl/c 4.2.5
haxe 2.hx 1535ms 2.8ms 24.6MB 1350ms 167ms haxe/hl/jit 1.12.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3345ms 47ms 27.4MB 3283ms 240ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 350ms 1.7ms 27.4MB 320ms 30ms haxe/cpp 4.2.5
haxe 1.hx 820ms 1.1ms 3.3MB 730ms 73ms haxe/hl/c 4.2.5
haxe 1.hx 847ms 1.0ms 3.8MB 797ms 33ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1.7ms 0.5ms 0.9MB 0ms 0ms odin 2022
haxe 1.hx 2.2ms 0.3ms 2.6MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 2.8ms 0.6ms 3.2MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 4.3ms 0.8ms 3.4MB 0ms 0ms haxe/hl/jit 1.12.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 182ms 0.8ms 1.9MB 170ms 0ms odin 2022
haxe 1.hx 183ms 1.4ms 2.9MB 170ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 186ms 7.2ms 22.1MB 167ms 3ms haxe/cpp 4.2.5
haxe 1.hx 242ms 3.5ms 3.8MB 233ms 0ms haxe/hl/jit 1.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 516ms 3.1ms 27.5MB 507ms 3ms haxe/cpp 4.2.5
haxe 1.hx 541ms 7.1ms 3.0MB 530ms 0ms haxe/hl/c 4.2.5
odin 1.odin 545ms 3.0ms 1.9MB 530ms 0ms odin 2022
haxe 1.hx 700ms 2.8ms 3.8MB 687ms 0ms haxe/hl/jit 1.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 85ms 2.6ms 0.9MB 73ms 0ms odin 2022
haxe 1.hx 87ms 0.5ms 14.3MB 77ms 3ms haxe/cpp 4.2.5
haxe 1.hx 92ms 2.9ms 3.0MB 83ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 116ms 0.6ms 3.7MB 110ms 0ms haxe/hl/jit 1.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1157ms 10ms 97.0MB 1343ms 40ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 214ms 7.7ms 28.6MB 217ms 13ms haxe/cpp 4.2.5
haxe 1.hx 1572ms 12ms 15.4MB 1473ms 83ms haxe/hl/c 4.2.5
haxe 1.hx 1825ms 9.2ms 20.4MB 1703ms 103ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 966ms 35ms 2.6MB 950ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 1258ms 5.7ms 2.6MB 1247ms 0ms haxe/hl/c 4.2.5
haxe 3.hx 2338ms 5.6ms 27.5MB 2607ms 37ms haxe/cpp 4.2.5
haxe 2.hx 2382ms 77ms 3.4MB 2373ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2478ms 37ms 3.3MB 2467ms 0ms haxe/hl/jit 1.12.0
odin 1.odin 2502ms 1.7ms 0.9MB 2490ms 0ms odin 2022
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 98ms 1.4ms 2.6MB 90ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 133ms 3.3ms 2.6MB 123ms 0ms haxe/hl/c 4.2.5
haxe 2.hx 244ms 11ms 3.3MB 233ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 250ms 0.3ms 27.5MB 253ms 17ms haxe/cpp 4.2.5
odin 1.odin 253ms 0.8ms 0.9MB 240ms 0ms odin 2022
haxe 1.hx 253ms 2.9ms 3.2MB 240ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 701ms 9.4ms 3.3MB 613ms 70ms haxe/hl/c 4.2.5
haxe 2.hx 837ms 0.5ms 4.4MB 830ms 0ms haxe/cpp 4.2.5
haxe 3.hx 869ms 11ms 3.8MB 793ms 57ms haxe/hl/jit 1.12.0
haxe 1.hx 1133ms 2.7ms 4.4MB 1117ms 0ms haxe/cpp 4.2.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 4618ms 1.5ms 2.9MB 4607ms 0ms odin 2022
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1158ms 0.3ms 2.3MB 1147ms 0ms odin 2022
haxe 1.hx 2333ms 1.3ms 6.6MB 2320ms 0ms haxe/cpp 4.2.5
haxe 1.hx 2338ms 1.6ms 3.2MB 2330ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 294ms 3.8ms 1.9MB 280ms 0ms odin 2022
haxe 1.hx 586ms 0.1ms 5.3MB 577ms 0ms haxe/cpp 4.2.5
haxe 1.hx 588ms 1.3ms 3.0MB 580ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 3428ms 2.0ms 3.8MB 3413ms 0ms haxe/hl/jit 1.12.0