Programming Language and compiler
Benchmarks

Haxe VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1213ms 21ms 132.8MB 1443ms 180ms dotnet/aot 8.0.101
haxe 1.hx 1346ms 37ms 146.5MB 1547ms 73ms haxe/cpp 4.3.3
csharp 1.cs 1714ms 70ms 109.8MB 1903ms 220ms mono 6.12.0
csharp 1.cs 1868ms 70ms 2126.1MB 710ms 1117ms dotnet 8.0.101
haxe 2.hx 4434ms 13ms 497.6MB 5017ms 237ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 50.6MB 5550ms 417ms haxe/hl/c 4.3.3
haxe 2.hx timeout 0.0ms 85.0MB 4997ms 693ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 52.5MB 7810ms 447ms haxe/hl/jit 1.14.0
haxe 2.hx timeout 0.0ms 133.0MB 7413ms 843ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 92ms 3.5ms 28.1MB 87ms 10ms haxe/cpp 4.3.3
csharp 1.cs 92ms 2.7ms 29.1MB 93ms 13ms dotnet/aot 8.0.101
csharp 1.cs 142ms 1.4ms 44.9MB 117ms 13ms mono 6.12.0
csharp 1.cs 283ms 5.7ms 229.7MB 130ms 113ms dotnet 8.0.101
haxe 2.hx 396ms 10.0ms 60.8MB 427ms 17ms haxe/cpp 4.3.3
haxe 1.hx 640ms 0.3ms 10.9MB 600ms 53ms haxe/hl/c 4.3.3
haxe 1.hx 669ms 7.5ms 13.2MB 710ms 63ms haxe/hl/jit 1.14.0
haxe 2.hx 930ms 4.0ms 15.6MB 810ms 160ms haxe/hl/c 4.3.3
haxe 2.hx 1114ms 23ms 27.0MB 1120ms 183ms haxe/hl/jit 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 133ms 7.9ms 36.2MB 380ms 83ms dotnet/aot 8.0.101
csharp 5-m.cs 205ms 9.6ms 45.3MB 477ms 117ms dotnet 8.0.101
csharp 5-m.cs 262ms 5.6ms 47.9MB 683ms 147ms mono 6.12.0
haxe 1.hx 2368ms 2.5ms 28.3MB 2300ms 187ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 5.2MB 4343ms 843ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 5.7MB 4357ms 867ms haxe/hl/jit 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 34ms 1.8ms 27.0MB 50ms 27ms dotnet/aot 8.0.101
csharp 5-m.cs 85ms 10ms 42.7MB 110ms 30ms mono 6.12.0
csharp 5.cs 86ms 6.4ms 42.0MB 83ms 20ms dotnet 8.0.101
haxe 1.hx 254ms 1.8ms 28.0MB 230ms 23ms haxe/cpp 4.3.3
haxe 1.hx 653ms 1.5ms 5.4MB 547ms 117ms haxe/hl/c 4.3.3
haxe 1.hx 673ms 1.7ms 5.8MB 577ms 113ms haxe/hl/jit 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.2ms 5.0MB 0ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 2.5ms 0.2ms 5.1MB 0ms 0ms haxe/cpp 4.3.3
haxe 1.hx 3.9ms 0.3ms 5.0MB 0ms 0ms haxe/hl/jit 1.14.0
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 106ms 1.6ms 14.1MB 100ms 0ms dotnet/aot 8.0.101
haxe 1.hx 135ms 2.2ms 21.0MB 120ms 0ms haxe/cpp 4.3.3
haxe 1.hx 136ms 1.7ms 5.0MB 127ms 0ms haxe/hl/c 4.3.3
csharp 2.cs 148ms 4.4ms 23.7MB 133ms 0ms mono 6.12.0
haxe 1.hx 155ms 1.2ms 5.7MB 147ms 0ms haxe/hl/jit 1.14.0
csharp 2.cs 275ms 12ms 32.4MB 233ms 10ms dotnet 8.0.101
csharp 1.cs 1019ms 3.2ms 17.3MB 1010ms 10ms dotnet/aot 8.0.101
csharp 1.cs 1444ms 29ms 163.2MB 1333ms 93ms dotnet 8.0.101
csharp 1.cs 3317ms 12ms 48.3MB 3263ms 47ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 293ms 5.4ms 12.1MB 287ms 0ms dotnet/aot 8.0.101
csharp 2.cs 358ms 4.8ms 27.1MB 347ms 0ms mono 6.12.0
haxe 1.hx 382ms 4.8ms 26.0MB 363ms 10ms haxe/cpp 4.3.3
haxe 1.hx 399ms 5.7ms 5.2MB 387ms 0ms haxe/hl/c 4.3.3
csharp 2.cs 421ms 6.2ms 34.8MB 383ms 10ms dotnet 8.0.101
haxe 1.hx 454ms 3.0ms 5.8MB 437ms 3ms haxe/hl/jit 1.14.0
csharp 1.cs 3057ms 18ms 17.1MB 3037ms 17ms dotnet/aot 8.0.101
csharp 1.cs 3997ms 26ms 422.9MB 3770ms 203ms dotnet 8.0.101
csharp 1.cs timeout 0.0ms 46.4MB 4930ms 60ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 59ms 0.4ms 16.1MB 55ms 5ms dotnet/aot 8.0.101
haxe 1.hx 64ms 1.6ms 12.9MB 50ms 0ms haxe/cpp 4.3.3
haxe 1.hx 67ms 0.2ms 5.0MB 60ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 78ms 1.9ms 5.7MB 67ms 0ms haxe/hl/jit 1.14.0
csharp 2.cs 96ms 0.3ms 25.4MB 83ms 3ms mono 6.12.0
csharp 2.cs 195ms 1.6ms 32.5MB 147ms 13ms dotnet 8.0.101
csharp 1.cs 1709ms 2.4ms 16.9MB 1707ms 0ms dotnet/aot 8.0.101
csharp 1.cs 1719ms 9.1ms 86.6MB 1663ms 33ms dotnet 8.0.101
csharp 1.cs 1812ms 7.4ms 29.2MB 1793ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 520ms 2.4ms 155.2MB 587ms 87ms dotnet/aot 8.0.101
csharp 1.cs 601ms 10ms 107.3MB 693ms 97ms dotnet/aot 8.0.101
haxe 1.hx 906ms 10ms 97.5MB 993ms 50ms haxe/cpp 4.3.3
csharp 2.cs 1201ms 5.0ms 1295.1MB 493ms 673ms dotnet 8.0.101
csharp 1.cs 1308ms 29ms 144.8MB 1517ms 157ms mono 6.12.0
csharp 1.cs 1565ms 4.3ms 1869.6MB 580ms 943ms dotnet 8.0.101
haxe 1.hx timeout 0.0ms 34.6MB 4937ms 463ms haxe/hl/c 4.3.3
haxe 1.hx timeout 0.0ms 59.1MB 6103ms 520ms haxe/hl/jit 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 110ms 2.0ms 38.0MB 113ms 17ms dotnet/aot 8.0.101
csharp 1.cs 123ms 1.1ms 48.4MB 130ms 23ms dotnet/aot 8.0.101
haxe 1.hx 168ms 2.3ms 29.1MB 167ms 10ms haxe/cpp 4.3.3
csharp 1.cs 262ms 7.9ms 73.9MB 237ms 33ms mono 6.12.0
csharp 2.cs 371ms 4.9ms 305.1MB 183ms 157ms dotnet 8.0.101
csharp 1.cs 441ms 8.6ms 428.5MB 170ms 237ms dotnet 8.0.101
haxe 1.hx 1252ms 8.3ms 12.7MB 1177ms 143ms haxe/hl/c 4.3.3
haxe 1.hx 1372ms 13ms 22.4MB 1393ms 117ms haxe/hl/jit 1.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
haxe 2.hx 850ms 3.3ms 5.0MB 837ms 0ms haxe/hl/c 4.3.3
haxe 1.hx 1043ms 7.8ms 5.0MB 1030ms 0ms haxe/hl/c 4.3.3
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0
haxe 3.hx 1381ms 4.5ms 28.1MB 1537ms 33ms haxe/cpp 4.3.3
haxe 2.hx 2397ms 5.9ms 5.7MB 2383ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 2470ms 4.7ms 5.7MB 2457ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx timeout 0.0ms 4.9MB 4990ms 0ms haxe/cpp 4.3.3
haxe 2.hx timeout 0.0ms 4.9MB 4987ms 0ms haxe/cpp 4.3.3
haxe 3.hx timeout 0.0ms 5.4MB 3853ms 1630ms haxe/hl/c 4.3.3
haxe 3.hx timeout 0.0ms 6.0MB 4117ms 1320ms haxe/hl/jit 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
haxe 2.hx 90ms 1.5ms 5.0MB 80ms 0ms haxe/hl/c 4.3.3
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
haxe 1.hx 108ms 1.2ms 5.0MB 100ms 0ms haxe/hl/c 4.3.3
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
haxe 3.hx 153ms 1.5ms 28.3MB 147ms 10ms haxe/cpp 4.3.3
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0
haxe 2.hx 247ms 5.2ms 5.7MB 237ms 0ms haxe/hl/jit 1.14.0
haxe 1.hx 252ms 1.0ms 5.7MB 240ms 0ms haxe/hl/jit 1.14.0
haxe 3.hx 677ms 19ms 5.2MB 523ms 200ms haxe/hl/c 4.3.3
haxe 2.hx 688ms 25ms 5.0MB 680ms 0ms haxe/cpp 4.3.3
haxe 3.hx 774ms 2.3ms 5.8MB 640ms 187ms haxe/hl/jit 1.14.0
haxe 1.hx 807ms 2.8ms 5.0MB 797ms 0ms haxe/cpp 4.3.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
haxe 1.hx 3903ms 4.9ms 5.3MB 3890ms 0ms haxe/hl/c 4.3.3
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0
haxe 1.hx timeout 0.0ms 7.4MB 4987ms 0ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 5.8MB 4990ms 0ms haxe/hl/jit 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
haxe 1.hx 988ms 15ms 5.1MB 973ms 0ms haxe/hl/c 4.3.3
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0
haxe 1.hx 2387ms 2.0ms 7.0MB 2377ms 0ms haxe/cpp 4.3.3
haxe 1.hx timeout 0.0ms 5.8MB 4980ms 0ms haxe/hl/jit 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
haxe 1.hx 259ms 10ms 5.2MB 247ms 0ms haxe/hl/c 4.3.3
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0
haxe 1.hx 601ms 1.4ms 5.9MB 590ms 0ms haxe/cpp 4.3.3
haxe 1.hx 2301ms 9.1ms 5.8MB 2287ms 0ms haxe/hl/jit 1.14.0