Programming Language and compiler
Benchmarks

Haxe VS C# benchmarks

Current benchmark data was generated on Fri Sep 30 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1701ms 79ms 337.4MB 1520ms 203ms dotnet 6.0.401
haxe 1.hx 1986ms 38ms 146.0MB 2520ms 67ms haxe/cpp 4.2.5
csharp 1.cs 2453ms 32ms 106.2MB 2917ms 240ms mono 6.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 120ms 2.8ms 27.5MB 123ms 7ms haxe/cpp 4.2.5
csharp 1.cs 162ms 2.3ms 42.8MB 130ms 20ms mono 6.12.0
csharp 1.cs 200ms 7.6ms 75.7MB 150ms 27ms dotnet 6.0.401
haxe 2.hx 533ms 4.3ms 60.2MB 650ms 27ms haxe/cpp 4.2.5
haxe 1.hx 868ms 1.6ms 7.8MB 833ms 17ms haxe/hl/c 4.2.5
haxe 1.hx 1025ms 4.8ms 11.3MB 977ms 33ms haxe/hl/jit 1.12.0
haxe 2.hx 1372ms 9.2ms 13.4MB 1260ms 97ms haxe/hl/c 4.2.5
haxe 2.hx 1694ms 20ms 24.6MB 1530ms 143ms haxe/hl/jit 1.12.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 472ms 1.0ms 67.2MB 537ms 77ms dotnet 6.0.401
csharp 5-m.cs 535ms 32ms 47.1MB 870ms 137ms mono 6.12.0
haxe 1.hx 3164ms 18ms 27.5MB 3210ms 243ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 92ms 1.0ms 36.9MB 113ms 17ms mono 6.12.0
csharp 5.cs 139ms 14ms 41.5MB 90ms 13ms dotnet 6.0.401
haxe 1.hx 336ms 2.9ms 27.5MB 320ms 23ms haxe/cpp 4.2.5
haxe 1.hx 836ms 21ms 3.3MB 757ms 63ms haxe/hl/c 4.2.5
haxe 1.hx 859ms 3.8ms 3.8MB 803ms 37ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 3.2ms 0.8ms 3.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 3.9ms 0.2ms 3.3MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 4.1ms 2.2ms 2.6MB 0ms 0ms haxe/hl/c 4.2.5
csharp 1.cs 22ms 1.6ms 25.8MB 10ms 0ms mono 6.12.0
csharp 1.cs 65ms 17ms 29.1MB 22ms 6ms dotnet 6.0.401

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 189ms 1.4ms 22.2MB 177ms 0ms haxe/cpp 4.2.5
csharp 2.cs 195ms 1.2ms 24.9MB 183ms 0ms mono 6.12.0
csharp 2.cs 201ms 9.0ms 27.8MB 173ms 0ms dotnet 6.0.401
haxe 1.hx 211ms 1.2ms 2.9MB 200ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 241ms 0.4ms 3.8MB 223ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 1784ms 6.0ms 74.9MB 1737ms 33ms dotnet 6.0.401
csharp 1.cs 3355ms 4.4ms 47.9MB 3307ms 37ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 468ms 7.6ms 28.2MB 440ms 3ms dotnet 6.0.401
csharp 2.cs 526ms 2.3ms 25.5MB 510ms 0ms mono 6.12.0
haxe 1.hx 542ms 12ms 27.4MB 533ms 7ms haxe/cpp 4.2.5
haxe 1.hx 626ms 1.6ms 3.0MB 613ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 719ms 9.8ms 3.7MB 707ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 87ms 1.8ms 14.2MB 67ms 7ms haxe/cpp 4.2.5
haxe 1.hx 105ms 2.4ms 2.9MB 93ms 0ms haxe/hl/c 4.2.5
csharp 2.cs 110ms 0.5ms 23.5MB 90ms 3ms mono 6.12.0
haxe 1.hx 119ms 0.9ms 3.8MB 110ms 0ms haxe/hl/jit 1.12.0
csharp 2.cs 132ms 5.4ms 27.9MB 97ms 7ms dotnet 6.0.401
csharp 1.cs 4479ms 24ms 70.6MB 4427ms 23ms dotnet 6.0.401
csharp 1.cs 4608ms 12ms 30.1MB 4587ms 0ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1094ms 7.3ms 304.4MB 937ms 183ms dotnet 6.0.401
csharp 2.cs 1102ms 13ms 385.1MB 963ms 187ms dotnet 6.0.401
haxe 1.hx 1381ms 4.3ms 97.0MB 1660ms 47ms haxe/cpp 4.2.5
csharp 1.cs 1903ms 28ms 152.3MB 2487ms 133ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 248ms 4.7ms 28.6MB 253ms 10ms haxe/cpp 4.2.5
csharp 2.cs 299ms 3.5ms 132.9MB 217ms 63ms dotnet 6.0.401
csharp 1.cs 318ms 2.0ms 167.0MB 233ms 60ms dotnet 6.0.401
csharp 1.cs 343ms 1.8ms 72.7MB 317ms 43ms mono 6.12.0
haxe 1.hx 1742ms 6.1ms 15.5MB 1663ms 60ms haxe/hl/c 4.2.5
haxe 1.hx 2026ms 52ms 20.4MB 1913ms 97ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 414ms 4.9ms 27.4MB 387ms 3ms dotnet 6.0.401
csharp 8.cs 616ms 2.0ms 29.4MB 583ms 7ms dotnet 6.0.401
haxe 2.hx 1083ms 6.6ms 2.6MB 1070ms 0ms haxe/hl/c 4.2.5
csharp 8.cs 1281ms 1.2ms 25.2MB 1263ms 0ms mono 6.12.0
haxe 1.hx 1505ms 76ms 2.6MB 1493ms 0ms haxe/hl/c 4.2.5
haxe 3.hx 2176ms 1.2ms 25.6MB 2470ms 43ms haxe/cpp 4.2.5
haxe 2.hx 2441ms 1.5ms 3.4MB 2427ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2598ms 0.0ms 3.3MB 2587ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 91ms 4.1ms 27.4MB 50ms 10ms dotnet 6.0.401
haxe 2.hx 113ms 3.3ms 2.6MB 100ms 0ms haxe/hl/c 4.2.5
csharp 8.cs 115ms 5.4ms 29.3MB 80ms 3ms dotnet 6.0.401
haxe 1.hx 149ms 1.1ms 2.6MB 140ms 0ms haxe/hl/c 4.2.5
csharp 8.cs 151ms 0.5ms 25.5MB 133ms 0ms mono 6.12.0
haxe 3.hx 237ms 2.0ms 27.6MB 250ms 7ms haxe/cpp 4.2.5
haxe 2.hx 255ms 8.1ms 3.4MB 243ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 268ms 6.6ms 3.3MB 253ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 762ms 4.4ms 3.2MB 683ms 60ms haxe/hl/c 4.2.5
haxe 2.hx 833ms 0.9ms 4.4MB 820ms 0ms haxe/cpp 4.2.5
haxe 3.hx 903ms 6.5ms 3.7MB 830ms 60ms haxe/hl/jit 1.12.0
haxe 1.hx 1072ms 1.7ms 3.1MB 1060ms 0ms haxe/cpp 4.2.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2823ms 595ms 32.5MB 4717ms 13ms dotnet 6.0.401
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 672ms 2.3ms 30.3MB 1210ms 17ms dotnet 6.0.401
haxe 1.hx 1946ms 1.0ms 3.2MB 1930ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 1956ms 3.8ms 6.5MB 1943ms 0ms haxe/cpp 4.2.5
csharp 3-m.cs 2668ms 125ms 29.8MB 5033ms 10ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 223ms 0.9ms 30.3MB 330ms 10ms dotnet 6.0.401
haxe 1.hx 491ms 0.8ms 3.0MB 477ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 493ms 1.5ms 5.2MB 480ms 0ms haxe/cpp 4.2.5
csharp 3-m.cs 677ms 0.7ms 29.7MB 1273ms 7ms mono 6.12.0
haxe 1.hx 2846ms 0.1ms 3.8MB 2840ms 0ms haxe/hl/jit 1.12.0