Programming Language and compiler
Benchmarks

Haxe VS Kotlin benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 455ms 16ms 575.5MB 540ms 63ms kotlin/jvm 21
haxe 1.hx 1232ms 27ms 144.0MB 1417ms 63ms haxe/cpp 4.3.6
kotlin 1-m.kt 2928ms 6.8ms 248.5MB 4967ms 627ms kotlin/native 1.8.21
haxe 2.hx 4213ms 67ms 497.0MB 4850ms 217ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 50.6MB 5367ms 437ms haxe/hl/c 4.3.6
haxe 2.hx timeout 0.0ms 85.0MB 4880ms 743ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 52.9MB 7470ms 420ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 132.9MB 7320ms 807ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 82ms 3.2ms 25.6MB 73ms 3ms haxe/cpp 4.3.6
kotlin 1.kt 95ms 2.4ms 158.2MB 103ms 23ms kotlin/jvm 21
kotlin 1-m.kt 257ms 6.2ms 32.6MB 400ms 63ms kotlin/native 1.8.21
haxe 2.hx 354ms 9.3ms 60.1MB 370ms 23ms haxe/cpp 4.3.6
haxe 1.hx 599ms 7.0ms 10.7MB 567ms 47ms haxe/hl/c 4.3.6
haxe 1.hx 636ms 20ms 13.2MB 693ms 50ms haxe/hl/jit 1.14.0
haxe 2.hx 874ms 18ms 15.7MB 780ms 130ms haxe/hl/c 4.3.6
haxe 2.hx 891ms 21ms 27.0MB 830ms 180ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2331ms 12ms 25.6MB 2153ms 247ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.2MB 4270ms 933ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 5.7MB 4277ms 947ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 246ms 5.3ms 27.5MB 200ms 40ms haxe/cpp 4.3.6
haxe 1.hx 622ms 7.2ms 5.3MB 507ms 127ms haxe/hl/c 4.3.6
haxe 1.hx 650ms 2.7ms 5.8MB 553ms 113ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.1ms 0.1ms 4.8MB 0ms 0ms haxe/hl/c 4.3.6
kotlin 1.kt 2.3ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
haxe 1.hx 2.4ms 0.2ms 4.3MB 0ms 0ms haxe/cpp 4.3.6
haxe 1.hx 3.5ms 0.5ms 4.8MB 0ms 0ms haxe/hl/jit 1.14.0
kotlin 1.kt 55ms 4.2ms 47.4MB 46ms 14ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 127ms 0.8ms 5.0MB 120ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 128ms 3.0ms 20.4MB 113ms 3ms haxe/cpp 4.3.6
haxe 1.hx 153ms 5.1ms 5.7MB 143ms 0ms haxe/hl/jit 1.14.0
kotlin 1-m.kt 172ms 3.8ms 94.9MB 283ms 30ms kotlin/jvm 21
kotlin 2-m.kt 188ms 5.4ms 102.2MB 397ms 30ms kotlin/jvm 21
kotlin 2.kt 285ms 1.3ms 7.8MB 413ms 3ms kotlin/native 1.8.21
kotlin 1.kt 501ms 15ms 7.8MB 600ms 7ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 298ms 25ms 214.4MB 503ms 57ms kotlin/jvm 21
kotlin 1.kt 308ms 0.6ms 204.7MB 413ms 40ms kotlin/jvm 21
haxe 1.hx 361ms 10ms 25.6MB 347ms 3ms haxe/cpp 4.3.6
haxe 1.hx 370ms 1.8ms 5.0MB 353ms 3ms haxe/hl/c 4.3.6
haxe 1.hx 436ms 4.8ms 5.7MB 420ms 3ms haxe/hl/jit 1.14.0
kotlin 2.kt 863ms 8.2ms 7.6MB 1240ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1456ms 8.2ms 7.9MB 1763ms 17ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 61ms 0.9ms 12.4MB 47ms 0ms haxe/cpp 4.3.6
haxe 1.hx 65ms 2.0ms 5.0MB 57ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 77ms 1.0ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0
kotlin 1-m.kt 132ms 1.5ms 92.4MB 250ms 20ms kotlin/jvm 21
kotlin 2.kt 134ms 3.9ms 5.7MB 190ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 159ms 9.9ms 90.8MB 307ms 27ms kotlin/jvm 21
kotlin 1.kt 162ms 4.0ms 5.8MB 207ms 0ms kotlin/native 1.8.21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 329ms 3.6ms 677.6MB 360ms 70ms kotlin/jvm 21
haxe 1.hx 860ms 12ms 97.0MB 943ms 40ms haxe/cpp 4.3.6
kotlin 1-m.kt 1426ms 20ms 136.5MB 2193ms 330ms kotlin/native 1.8.21
haxe 1.hx timeout 0.0ms 34.6MB 4787ms 557ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 59.8MB 5720ms 480ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 122ms 2.0ms 206.5MB 157ms 23ms kotlin/jvm 21
haxe 1.hx 158ms 1.7ms 28.6MB 157ms 7ms haxe/cpp 4.3.6
kotlin 1-m.kt 283ms 1.7ms 40.4MB 410ms 57ms kotlin/native 1.8.21
haxe 1.hx 1221ms 17ms 12.8MB 1160ms 127ms haxe/hl/c 4.3.6
haxe 1.hx 1244ms 17ms 22.3MB 1260ms 123ms haxe/hl/jit 1.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 386ms 8.6ms 4.7MB 373ms 0ms kotlin/native 1.8.21
kotlin 1.kt 422ms 3.5ms 49.7MB 463ms 13ms kotlin/jvm 21
haxe 2.hx 808ms 2.6ms 5.0MB 800ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 1008ms 28ms 5.0MB 997ms 0ms haxe/hl/c 4.3.6
haxe 3.hx 1319ms 19ms 25.6MB 1433ms 43ms haxe/cpp 4.3.6
haxe 2.hx 2282ms 22ms 5.7MB 2270ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2328ms 4.3ms 5.7MB 2317ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx timeout 0.0ms 4.4MB 4987ms 0ms haxe/cpp 4.3.6
haxe 2.hx timeout 0.0ms 4.4MB 4987ms 0ms haxe/cpp 4.3.6
haxe 3.hx timeout 0.0ms 5.2MB 3857ms 1647ms haxe/hl/c 4.3.6
haxe 3.hx timeout 0.0ms 5.9MB 4097ms 1367ms haxe/hl/jit 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 43ms 0.8ms 4.6MB 30ms 0ms kotlin/native 1.8.21
haxe 2.hx 85ms 2.3ms 5.0MB 77ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 103ms 1.4ms 5.0MB 93ms 0ms haxe/hl/c 4.3.6
kotlin 1.kt 112ms 0.7ms 49.4MB 150ms 17ms kotlin/jvm 21
haxe 3.hx 147ms 2.7ms 27.6MB 143ms 10ms haxe/cpp 4.3.6
haxe 2.hx 232ms 2.0ms 5.7MB 220ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 240ms 7.9ms 5.7MB 230ms 0ms haxe/hl/jit 1.14.0
haxe 3.hx 628ms 2.6ms 5.2MB 487ms 190ms haxe/hl/c 4.3.6
haxe 2.hx 633ms 1.3ms 4.4MB 620ms 0ms haxe/cpp 4.3.6
haxe 3.hx 732ms 7.5ms 5.8MB 587ms 197ms haxe/hl/jit 1.14.0
haxe 1.hx 761ms 7.6ms 4.4MB 753ms 0ms haxe/cpp 4.3.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3731ms 16ms 5.2MB 3720ms 0ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 6.9MB 4987ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4987ms 3ms haxe/hl/jit 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 936ms 9.4ms 5.2MB 923ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2279ms 6.3ms 6.6MB 2267ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4987ms 0ms haxe/hl/jit 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 242ms 7.7ms 5.1MB 227ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 568ms 1.8ms 5.4MB 557ms 0ms haxe/cpp 4.3.6
haxe 1.hx 2209ms 6.9ms 5.8MB 2200ms 0ms haxe/hl/jit 1.14.0