Programming Language and compiler
Benchmarks

Haxe VS C# benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1400ms 22ms 390.6MB 1260ms 180ms dotnet 6.0.300
haxe 1.hx 1746ms 39ms 146.0MB 2053ms 50ms haxe/cpp 4.2.4
csharp 1.cs 2295ms 25ms 103.2MB 2610ms 193ms mono 6.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 112ms 1.7ms 27.4MB 113ms 7ms haxe/cpp 4.2.4
csharp 1.cs 160ms 4.1ms 44.7MB 143ms 3ms mono 6.12.0
csharp 1.cs 194ms 16ms 93.0MB 140ms 20ms dotnet 6.0.300
haxe 2.hx 471ms 7.8ms 60.2MB 547ms 27ms haxe/cpp 4.2.4
haxe 1.hx 799ms 17ms 7.8MB 757ms 23ms haxe/hl/c 4.2.4
haxe 1.hx 1052ms 5.0ms 11.1MB 1000ms 37ms haxe/hl/jit 1.12.0
haxe 2.hx 1257ms 16ms 13.5MB 1083ms 160ms haxe/hl/c 4.2.4
haxe 2.hx 1595ms 8.6ms 24.5MB 1413ms 167ms haxe/hl/jit 1.12.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 386ms 15ms 89.8MB 553ms 117ms dotnet 6.0.300
csharp 5-m.cs 493ms 9.8ms 59.0MB 813ms 110ms mono 6.12.0
haxe 1.hx 3288ms 4.4ms 27.4MB 3187ms 280ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 90ms 15ms 36.1MB 100ms 33ms mono 6.12.0
csharp 5.cs 99ms 9.1ms 45.3MB 90ms 23ms dotnet 6.0.300
haxe 1.hx 348ms 3.6ms 27.4MB 310ms 40ms haxe/cpp 4.2.4
haxe 1.hx 823ms 1.1ms 3.5MB 717ms 87ms haxe/hl/c 4.2.4
haxe 1.hx 854ms 0.5ms 3.8MB 800ms 37ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.7ms 2.6MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 2.7ms 0.4ms 3.2MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx 4.0ms 0.7ms 3.3MB 0ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 19ms 0.4ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 50ms 4.7ms 32.9MB 24ms 2ms dotnet 6.0.300

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 180ms 0.8ms 2.8MB 170ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 182ms 1.5ms 20.3MB 167ms 0ms haxe/cpp 4.2.4
csharp 2.cs 187ms 1.3ms 25.5MB 170ms 0ms mono 6.12.0
csharp 2.cs 208ms 4.7ms 28.0MB 170ms 0ms dotnet 6.0.300
haxe 1.hx 249ms 4.9ms 3.8MB 233ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 1670ms 5.3ms 91.7MB 1620ms 37ms dotnet 6.0.300
csharp 1.cs 3070ms 3.0ms 49.8MB 3023ms 37ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 457ms 3.5ms 28.1MB 427ms 3ms dotnet 6.0.300
csharp 2.cs 511ms 13ms 24.4MB 497ms 0ms mono 6.12.0
haxe 1.hx 518ms 0.7ms 27.5MB 510ms 0ms haxe/cpp 4.2.4
haxe 1.hx 535ms 3.8ms 3.0MB 523ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 720ms 11ms 3.7MB 707ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 4722ms 92ms 92.7MB 4683ms 27ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 86ms 1.4ms 14.1MB 73ms 3ms haxe/cpp 4.2.4
haxe 1.hx 89ms 1.0ms 2.9MB 77ms 0ms haxe/hl/c 4.2.4
csharp 2.cs 107ms 1.5ms 27.3MB 93ms 0ms mono 6.12.0
haxe 1.hx 120ms 1.3ms 3.6MB 110ms 0ms haxe/hl/jit 1.12.0
csharp 2.cs 130ms 4.5ms 27.7MB 103ms 0ms dotnet 6.0.300
csharp 1.cs 3190ms 8.7ms 33.8MB 3163ms 3ms mono 6.12.0
csharp 1.cs 3201ms 7.3ms 73.2MB 3160ms 20ms dotnet 6.0.300

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 908ms 3.1ms 378.4MB 773ms 167ms dotnet 6.0.300
csharp 1.cs 922ms 7.6ms 395.6MB 780ms 173ms dotnet 6.0.300
haxe 1.hx 1165ms 17ms 97.0MB 1357ms 37ms haxe/cpp 4.2.4
csharp 1.cs 1729ms 34ms 153.0MB 2073ms 143ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 222ms 3.5ms 28.6MB 230ms 10ms haxe/cpp 4.2.4
csharp 2.cs 253ms 3.7ms 94.1MB 203ms 30ms dotnet 6.0.300
csharp 1.cs 284ms 3.0ms 183.8MB 197ms 67ms dotnet 6.0.300
csharp 1.cs 315ms 3.6ms 74.8MB 283ms 40ms mono 6.12.0
haxe 1.hx 1591ms 10ms 15.3MB 1497ms 77ms haxe/hl/c 4.2.4
haxe 1.hx 1950ms 6.7ms 20.4MB 1800ms 133ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 438ms 9.0ms 29.3MB 410ms 0ms dotnet 6.0.300
csharp 8.cs 537ms 3.7ms 29.1MB 503ms 3ms dotnet 6.0.300
haxe 2.hx 978ms 29ms 2.6MB 967ms 0ms haxe/hl/c 4.2.4
csharp 8.cs 1110ms 1.7ms 27.0MB 1097ms 0ms mono 6.12.0
haxe 1.hx 1318ms 51ms 2.6MB 1307ms 0ms haxe/hl/c 4.2.4
haxe 3.hx 2348ms 2.5ms 27.6MB 2647ms 47ms haxe/cpp 4.2.4
haxe 2.hx 2467ms 70ms 3.4MB 2457ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2528ms 21ms 3.3MB 2517ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 95ms 4.6ms 29.2MB 67ms 0ms dotnet 6.0.300
haxe 2.hx 99ms 2.0ms 2.6MB 87ms 0ms haxe/hl/c 4.2.4
csharp 8.cs 101ms 4.9ms 31.2MB 77ms 0ms dotnet 6.0.300
haxe 1.hx 130ms 1.0ms 2.6MB 117ms 0ms haxe/hl/c 4.2.4
csharp 8.cs 135ms 4.1ms 27.0MB 123ms 0ms mono 6.12.0
haxe 2.hx 246ms 2.4ms 3.4MB 233ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 250ms 1.0ms 27.6MB 263ms 7ms haxe/cpp 4.2.4
haxe 1.hx 259ms 2.3ms 3.3MB 250ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 697ms 12ms 3.3MB 623ms 57ms haxe/hl/c 4.2.4
haxe 2.hx 841ms 3.8ms 4.4MB 827ms 0ms haxe/cpp 4.2.4
haxe 3.hx 849ms 3.5ms 3.7MB 777ms 53ms haxe/hl/jit 1.12.0
haxe 1.hx 1135ms 2.7ms 3.1MB 1123ms 0ms haxe/cpp 4.2.4

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2999ms 510ms 30.9MB 5187ms 20ms dotnet 6.0.300
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 719ms 3.7ms 29.5MB 1297ms 13ms dotnet 6.0.300
haxe 1.hx 2333ms 0.6ms 6.6MB 2320ms 0ms haxe/cpp 4.2.4
haxe 1.hx 2339ms 1.2ms 3.2MB 2327ms 0ms haxe/hl/c 4.2.4
csharp 3-m.cs 3181ms 129ms 29.4MB 6040ms 10ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 235ms 3.5ms 30.1MB 360ms 3ms dotnet 6.0.300
haxe 1.hx 586ms 0.6ms 5.3MB 573ms 0ms haxe/cpp 4.2.4
haxe 1.hx 588ms 0.8ms 3.0MB 580ms 0ms haxe/hl/c 4.2.4
csharp 3-m.cs 805ms 2.5ms 30.0MB 1530ms 3ms mono 6.12.0
haxe 1.hx 3428ms 1.3ms 3.7MB 3420ms 0ms haxe/hl/jit 1.12.0