Haxe VS Crystal benchmarks

Current benchmark data was generated on Mon Dec 30 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 1335ms 42ms 145.9MB 1523ms 70ms haxe/cpp 4.3.6
crystal 1.cr 1344ms 19ms 64.2MB 1317ms 10ms crystal 1.14.0
haxe 2.hx 4428ms 63ms 497.1MB 5017ms 250ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 50.6MB 5383ms 433ms haxe/hl/c 4.3.6
haxe 2.hx timeout 0.0ms 85.0MB 4953ms 717ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 53.1MB 7477ms 390ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 132.9MB 7453ms 820ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 86ms 1.8ms 27.6MB 70ms 10ms haxe/cpp 4.3.6
crystal 1.cr 105ms 3.9ms 11.1MB 93ms 0ms crystal 1.14.0
haxe 2.hx 388ms 6.7ms 58.3MB 420ms 23ms haxe/cpp 4.3.6
haxe 1.hx 628ms 2.2ms 10.9MB 583ms 60ms haxe/hl/c 4.3.6
haxe 1.hx 666ms 4.0ms 13.2MB 727ms 43ms haxe/hl/jit 1.14.0
haxe 2.hx 915ms 13ms 15.5MB 837ms 127ms haxe/hl/c 4.3.6
haxe 2.hx 953ms 19ms 27.2MB 893ms 183ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 543ms 3.5ms 3.4MB 413ms 110ms crystal 1.14.0
crystal 1.cr 731ms 4.9ms 14.7MB 607ms 107ms crystal 1.14.0
haxe 1.hx 2430ms 12ms 27.6MB 2263ms 247ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.2MB 4253ms 950ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 5.7MB 4350ms 877ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 58ms 1.3ms 3.4MB 33ms 13ms crystal 1.14.0
crystal 1.cr 77ms 0.9ms 4.5MB 50ms 13ms crystal 1.14.0
haxe 1.hx 258ms 1.6ms 25.5MB 223ms 30ms haxe/cpp 4.3.6
haxe 1.hx 651ms 2.0ms 5.4MB 543ms 123ms haxe/hl/c 4.3.6
haxe 1.hx 690ms 5.2ms 5.7MB 577ms 127ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.0ms 0.2ms 3.0MB 0ms 0ms crystal 1.14.0
haxe 1.hx 2.2ms 0.2ms 4.9MB 0ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2.3ms 0.2ms 4.4MB 0ms 0ms haxe/cpp 4.3.6
haxe 1.hx 3.8ms 0.4ms 5.3MB 0ms 0ms haxe/hl/jit 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 1.6ms 3.1MB 27ms 0ms crystal 1.14.0
crystal 1.cr 65ms 2.3ms 3.1MB 53ms 0ms crystal 1.14.0
haxe 1.hx 132ms 0.1ms 20.5MB 117ms 3ms haxe/cpp 4.3.6
haxe 1.hx 135ms 2.0ms 5.2MB 123ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 157ms 2.0ms 5.8MB 147ms 0ms haxe/hl/jit 1.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 99ms 1.9ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 190ms 11ms 3.1MB 180ms 0ms crystal 1.14.0
haxe 1.hx 374ms 2.7ms 25.5MB 363ms 0ms haxe/cpp 4.3.6
haxe 1.hx 394ms 2.7ms 5.0MB 377ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 455ms 3.5ms 5.8MB 440ms 3ms haxe/hl/jit 1.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 1.3ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 1.6ms 3.0MB 20ms 0ms crystal 1.14.0
haxe 1.hx 63ms 1.4ms 12.4MB 53ms 0ms haxe/cpp 4.3.6
haxe 1.hx 68ms 1.0ms 5.1MB 60ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 79ms 1.9ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 794ms 8.6ms 81.7MB 767ms 13ms crystal 1.14.0
haxe 1.hx 881ms 7.2ms 96.9MB 980ms 40ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 34.6MB 4763ms 560ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 59.7MB 6013ms 470ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 162ms 1.4ms 26.6MB 163ms 3ms haxe/cpp 4.3.6
crystal 1.cr 164ms 7.9ms 22.3MB 150ms 0ms crystal 1.14.0
haxe 1.hx 1282ms 5.4ms 12.7MB 1217ms 137ms haxe/hl/c 4.3.6
haxe 1.hx 1301ms 8.1ms 22.3MB 1310ms 130ms haxe/hl/jit 1.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 341ms 1.2ms 3.4MB 330ms 0ms crystal 1.14.0
crystal 1.cr 343ms 3.1ms 3.4MB 333ms 0ms crystal 1.14.0
haxe 2.hx 853ms 4.3ms 5.0MB 843ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 1056ms 20ms 5.0MB 1047ms 0ms haxe/hl/c 4.3.6
haxe 3.hx 1383ms 5.0ms 27.5MB 1513ms 37ms haxe/cpp 4.3.6
haxe 2.hx 2402ms 1.6ms 5.8MB 2390ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2449ms 4.0ms 5.8MB 2437ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx timeout 0.0ms 4.4MB 4990ms 0ms haxe/cpp 4.3.6
haxe 2.hx timeout 0.0ms 4.4MB 4990ms 0ms haxe/cpp 4.3.6
haxe 3.hx timeout 0.0ms 5.3MB 3917ms 1587ms haxe/hl/c 4.3.6
haxe 3.hx timeout 0.0ms 6.0MB 4130ms 1333ms haxe/hl/jit 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.3ms 3.4MB 30ms 0ms crystal 1.14.0
crystal 1.cr 37ms 0.7ms 3.4MB 30ms 0ms crystal 1.14.0
haxe 2.hx 89ms 1.1ms 5.0MB 80ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 109ms 1.4ms 5.0MB 100ms 0ms haxe/hl/c 4.3.6
haxe 3.hx 153ms 1.0ms 25.6MB 147ms 13ms haxe/cpp 4.3.6
haxe 2.hx 244ms 0.6ms 5.8MB 230ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 251ms 2.9ms 5.7MB 240ms 0ms haxe/hl/jit 1.14.0
haxe 3.hx 662ms 6.0ms 5.3MB 483ms 237ms haxe/hl/c 4.3.6
haxe 2.hx 675ms 7.4ms 4.4MB 663ms 0ms haxe/cpp 4.3.6
haxe 3.hx 772ms 2.9ms 5.8MB 617ms 210ms haxe/hl/jit 1.14.0
haxe 1.hx 805ms 6.0ms 4.4MB 793ms 0ms haxe/cpp 4.3.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3905ms 37ms 4.6MB 3897ms 0ms crystal 1.14.0
haxe 1.hx 3909ms 15ms 5.3MB 3897ms 0ms haxe/hl/c 4.3.6
haxe 1.hx timeout 0.0ms 6.9MB 4990ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.8MB 4990ms 0ms haxe/hl/jit 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 981ms 4.6ms 4.5MB 967ms 0ms crystal 1.14.0
haxe 1.hx 985ms 4.9ms 5.1MB 970ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 2388ms 1.9ms 6.5MB 2380ms 0ms haxe/cpp 4.3.6
haxe 1.hx timeout 0.0ms 5.7MB 4990ms 0ms haxe/hl/jit 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 247ms 2.1ms 4.0MB 233ms 0ms crystal 1.14.0
haxe 1.hx 251ms 2.3ms 5.0MB 240ms 0ms haxe/hl/c 4.3.6
haxe 1.hx 602ms 1.2ms 5.3MB 590ms 0ms haxe/cpp 4.3.6
haxe 1.hx 2298ms 16ms 5.8MB 2287ms 0ms haxe/hl/jit 1.14.0