Lua VS Haxe benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2201ms 42ms 146.2MB 2680ms 83ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 400.3MB 6437ms 250ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 48.6MB 4717ms 263ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 83.0MB 4470ms 507ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 49.0MB 4710ms 267ms haxe/hl/jit 1.13.0
haxe 2.hx timeout 0.0ms 130.2MB 4537ms 447ms haxe/hl/jit 1.13.0
lua 1.lua timeout 0.0ms 119.5MB 4903ms 70ms lua 5.4.4
lua 1.lua timeout 0.0ms 174.6MB 4897ms 83ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 153ms 9.8ms 27.6MB 140ms 17ms haxe/cpp 4.2.5
lua 1.lua 584ms 53ms 24.6MB 553ms 10ms luajit 2.1.0-beta3
haxe 2.hx 587ms 11ms 60.3MB 693ms 37ms haxe/cpp 4.2.5
haxe 1.hx 1017ms 21ms 8.6MB 963ms 33ms haxe/hl/c 4.2.5
haxe 1.hx 1220ms 18ms 11.1MB 1147ms 53ms haxe/hl/jit 1.13.0
lua 1.lua 1408ms 8.5ms 17.4MB 1387ms 3ms lua 5.4.4
haxe 2.hx 1565ms 20ms 13.4MB 1423ms 123ms haxe/hl/c 4.2.5
haxe 2.hx 1987ms 8.3ms 25.0MB 1800ms 173ms haxe/hl/jit 1.13.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
lua 1.lua 2.4ms 0.8ms 2.2MB 0ms 0ms luajit 2.1.0-beta3
lua 1.lua 2.4ms 1.0ms 1.4MB 0ms 0ms lua 5.4.4
haxe 1.hx 3.7ms 0.5ms 2.3MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 4.3ms 1.1ms 3.2MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 5.0ms 0.5ms 3.2MB 0ms 0ms haxe/hl/jit 1.13.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1517ms 33ms 97.1MB 1783ms 63ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 32.7MB 4657ms 327ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 53.7MB 4637ms 347ms haxe/hl/jit 1.13.0
lua 1.lua timeout 0.0ms 159.1MB 4913ms 67ms lua 5.4.4
lua 1.lua timeout 0.0ms 180.9MB 4870ms 107ms luajit 2.1.0-beta3

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 303ms 9.8ms 28.7MB 303ms 13ms haxe/cpp 4.2.5
haxe 1.hx 1964ms 16ms 10.9MB 1850ms 93ms haxe/hl/c 4.2.5
lua 1.lua 2162ms 57ms 38.5MB 2130ms 13ms luajit 2.1.0-beta3
haxe 1.hx 2306ms 12ms 20.2MB 2133ms 157ms haxe/hl/jit 1.13.0
lua 1.lua 3623ms 55ms 41.6MB 3593ms 13ms lua 5.4.4

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 1304ms 23ms 2.3MB 1293ms 0ms haxe/hl/c 4.2.5
lua 4.lua 1337ms 28ms 1.5MB 1320ms 0ms luajit 2.1.0-beta3
haxe 1.hx 1709ms 6.3ms 2.3MB 1697ms 0ms haxe/hl/c 4.2.5
haxe 3-m.hx 1780ms 28ms 27.6MB 2797ms 30ms haxe/cpp 4.2.5
haxe 2.hx 2981ms 49ms 3.3MB 2967ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx 3144ms 83ms 3.2MB 3127ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx timeout 0.0ms 3.3MB 4980ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 3.2MB 4983ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 3.3MB 4530ms 453ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 3.7MB 4647ms 330ms haxe/hl/jit 1.13.0
lua 4.lua timeout 0.0ms 1.5MB 4990ms 0ms lua 5.4.4

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 2.hx 135ms 3.5ms 2.3MB 130ms 0ms haxe/hl/c 4.2.5
lua 4.lua 138ms 1.4ms 1.5MB 123ms 0ms luajit 2.1.0-beta3
haxe 1.hx 180ms 8.2ms 2.3MB 170ms 0ms haxe/hl/c 4.2.5
haxe 3.hx 201ms 1.9ms 27.6MB 263ms 7ms haxe/cpp 4.2.5
haxe 2.hx 299ms 0.9ms 3.3MB 287ms 0ms haxe/hl/jit 1.13.0
haxe 1.hx 322ms 8.0ms 3.2MB 310ms 0ms haxe/hl/jit 1.13.0
haxe 3.hx 827ms 3.3ms 3.1MB 743ms 70ms haxe/hl/c 4.2.5
haxe 3.hx 976ms 3.7ms 3.6MB 893ms 63ms haxe/hl/jit 1.13.0
haxe 2.hx 1025ms 6.6ms 3.2MB 1013ms 0ms haxe/cpp 4.2.5
haxe 1.hx 1242ms 3.3ms 3.2MB 1227ms 0ms haxe/cpp 4.2.5
lua 4.lua 1886ms 102ms 1.4MB 1873ms 0ms lua 5.4.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx timeout 0.0ms 6.7MB 4983ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 3.0MB 4987ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 3.7MB 4987ms 0ms haxe/hl/jit 1.13.0
lua 1.lua timeout 0.0ms 2.2MB 4977ms 3ms lua 5.4.4
lua 1.lua timeout 0.0ms 2.5MB 4987ms 0ms luajit 2.1.0-beta3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1619ms 13ms 2.8MB 1603ms 0ms haxe/hl/c 4.2.5
lua 1.lua 1702ms 29ms 2.5MB 1687ms 0ms luajit 2.1.0-beta3
haxe 1.hx 2585ms 6.5ms 6.6MB 2573ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 3.7MB 4983ms 0ms haxe/hl/jit 1.13.0
lua 1.lua timeout 0.0ms 2.3MB 4987ms 0ms lua 5.4.4

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 409ms 4.8ms 2.9MB 390ms 0ms haxe/hl/c 4.2.5
lua 1.lua 434ms 2.7ms 1.5MB 423ms 0ms luajit 2.1.0-beta3
haxe 1.hx 651ms 3.4ms 5.3MB 643ms 0ms haxe/cpp 4.2.5
haxe 1.hx 3415ms 5.7ms 3.6MB 3400ms 0ms haxe/hl/jit 1.13.0
lua 1.lua timeout 0.0ms 1.5MB 4990ms 0ms lua 5.4.4