Programming Language and compiler
Benchmarks

C# VS Haxe benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1595ms 35ms 305.1MB 1500ms 147ms dotnet 6.0.300
haxe 1.hx 2041ms 26ms 145.9MB 2597ms 83ms haxe/cpp 4.2.4
csharp 1.cs 2472ms 34ms 107.8MB 2887ms 257ms mono 6.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 136ms 1.9ms 27.5MB 143ms 13ms haxe/cpp 4.2.4
csharp 1.cs 164ms 1.0ms 44.7MB 137ms 13ms mono 6.12.0
csharp 1.cs 193ms 1.5ms 77.6MB 143ms 23ms dotnet 6.0.300
haxe 2.hx 558ms 7.7ms 60.3MB 723ms 27ms haxe/cpp 4.2.4
haxe 1.hx 882ms 3.1ms 7.8MB 847ms 20ms haxe/hl/c 4.2.4
haxe 1.hx 1145ms 6.0ms 11.1MB 1087ms 43ms haxe/hl/jit 1.12.0
haxe 2.hx 1473ms 23ms 13.5MB 1347ms 110ms haxe/hl/c 4.2.4
haxe 2.hx 1935ms 13ms 24.6MB 1740ms 177ms haxe/hl/jit 1.12.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 4737ms 96ms 89.8MB 8880ms 67ms dotnet 6.0.300

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 429ms 21ms 78.6MB 657ms 47ms dotnet 6.0.300

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 844ms 57ms 47.7MB 803ms 7ms dotnet 6.0.300

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 401ms 20ms 91.1MB 600ms 93ms dotnet 6.0.300
csharp 5-m.cs 528ms 11ms 34.3MB 877ms 113ms mono 6.12.0
haxe 1.hx 3188ms 5.2ms 27.3MB 3350ms 217ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 98ms 9.7ms 34.6MB 113ms 37ms mono 6.12.0
csharp 5.cs 100ms 11ms 40.3MB 77ms 37ms dotnet 6.0.300
haxe 1.hx 342ms 5.8ms 27.4MB 333ms 27ms haxe/cpp 4.2.4
haxe 1.hx 801ms 47ms 3.4MB 730ms 53ms haxe/hl/c 4.2.4
haxe 1.hx 878ms 25ms 3.9MB 827ms 37ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.9ms 1.0ms 2.6MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 3.4ms 0.6ms 3.2MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx 4.9ms 0.5ms 3.3MB 0ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 22ms 0.9ms 25.8MB 10ms 0ms mono 6.12.0
csharp 1.cs 52ms 6.4ms 29.0MB 20ms 4ms dotnet 6.0.300

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 665ms 24ms 113.5MB 733ms 93ms dotnet 6.0.300
csharp 2.cs 904ms 35ms 153.5MB 847ms 430ms dotnet 6.0.300
csharp 1-m.cs 937ms 49ms 171.9MB 943ms 470ms dotnet 6.0.300

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 483ms 5.6ms 80.8MB 397ms 110ms dotnet 6.0.300
csharp 1.cs 503ms 19ms 91.9MB 490ms 127ms dotnet 6.0.300
csharp 2-http2.cs 519ms 15ms 83.2MB 510ms 60ms dotnet 6.0.300

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 337ms 24ms 69.7MB 293ms 27ms dotnet 6.0.300
csharp 1.cs 542ms 2.6ms 147.1MB 487ms 73ms dotnet 6.0.300

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1989ms 91ms 275.2MB 2103ms 107ms dotnet 6.0.300
csharp 1.cs 3179ms 46ms 799.4MB 3127ms 390ms dotnet 6.0.300

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1274ms 7.0ms 77.3MB 1860ms 37ms dotnet 6.0.300
csharp 6-m.cs 1776ms 5.9ms 69.5MB 2940ms 27ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 249ms 7.7ms 62.2MB 280ms 27ms dotnet 6.0.300
csharp 6.cs 270ms 6.3ms 55.6MB 357ms 20ms mono 6.12.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 191ms 0.8ms 22.2MB 173ms 7ms haxe/cpp 4.2.4
csharp 2.cs 197ms 1.2ms 27.4MB 183ms 0ms mono 6.12.0
csharp 2.cs 210ms 0.9ms 27.7MB 173ms 0ms dotnet 6.0.300
haxe 1.hx 212ms 1.2ms 2.9MB 197ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 250ms 5.8ms 3.8MB 237ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 1575ms 7.0ms 75.7MB 1540ms 20ms dotnet 6.0.300
csharp 1.cs 3411ms 3.0ms 47.7MB 3360ms 43ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 464ms 4.2ms 28.0MB 437ms 7ms dotnet 6.0.300
csharp 2.cs 526ms 3.2ms 26.0MB 510ms 0ms mono 6.12.0
haxe 1.hx 538ms 1.5ms 27.4MB 537ms 3ms haxe/cpp 4.2.4
haxe 1.hx 628ms 5.9ms 3.0MB 613ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 735ms 13ms 3.6MB 717ms 3ms haxe/hl/jit 1.12.0
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 88ms 0.9ms 14.3MB 70ms 0ms haxe/cpp 4.2.4
haxe 1.hx 107ms 2.0ms 3.1MB 97ms 0ms haxe/hl/c 4.2.4
csharp 2.cs 112ms 0.8ms 27.2MB 97ms 0ms mono 6.12.0
haxe 1.hx 121ms 0.5ms 3.7MB 107ms 0ms haxe/hl/jit 1.12.0
csharp 2.cs 132ms 3.8ms 25.9MB 97ms 7ms dotnet 6.0.300
csharp 1.cs 4345ms 104ms 62.0MB 4307ms 27ms dotnet 6.0.300
csharp 1.cs 4416ms 309ms 32.3MB 4393ms 10ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 668ms 10ms 81.3MB 617ms 30ms dotnet 6.0.300
csharp 1.cs 3440ms 14ms 36.3MB 3410ms 3ms dotnet 6.0.300
csharp 3.cs 3646ms 4.4ms 38.0MB 3613ms 3ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 92ms 1.5ms 38.9MB 57ms 10ms dotnet 6.0.300
csharp 3.cs 222ms 4.8ms 33.0MB 187ms 10ms dotnet 6.0.300
csharp 1.cs 318ms 2.1ms 33.2MB 290ms 3ms dotnet 6.0.300
csharp 1.cs 740ms 1.1ms 26.5MB 720ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1061ms 2.4ms 388.0MB 937ms 167ms dotnet 6.0.300
csharp 1.cs 1098ms 27ms 305.2MB 957ms 170ms dotnet 6.0.300
haxe 1.hx 1430ms 9.8ms 96.9MB 1727ms 50ms haxe/cpp 4.2.4
csharp 1.cs 1920ms 11ms 147.1MB 2480ms 123ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 278ms 1.5ms 28.6MB 293ms 20ms haxe/cpp 4.2.4
csharp 2.cs 308ms 5.3ms 135.0MB 213ms 70ms dotnet 6.0.300
csharp 1.cs 323ms 1.1ms 164.5MB 227ms 80ms dotnet 6.0.300
csharp 1.cs 346ms 0.7ms 74.4MB 317ms 47ms mono 6.12.0
haxe 1.hx 1810ms 21ms 15.4MB 1697ms 97ms haxe/hl/c 4.2.4
haxe 1.hx 2241ms 26ms 20.3MB 2077ms 147ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 443ms 4.3ms 31.2MB 410ms 3ms dotnet 6.0.300
csharp 8.cs 618ms 8.4ms 27.2MB 583ms 7ms dotnet 6.0.300
haxe 2.hx 1084ms 15ms 2.6MB 1070ms 0ms haxe/hl/c 4.2.4
csharp 8.cs 1298ms 29ms 25.0MB 1280ms 0ms mono 6.12.0
haxe 1.hx 1466ms 63ms 2.6MB 1457ms 0ms haxe/hl/c 4.2.4
haxe 3.hx 2205ms 13ms 27.6MB 2720ms 47ms haxe/cpp 4.2.4
haxe 2.hx 2526ms 63ms 3.3MB 2510ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 2756ms 36ms 3.3MB 2747ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 96ms 3.5ms 27.2MB 60ms 0ms dotnet 6.0.300
csharp 8.cs 112ms 7.1ms 29.1MB 83ms 0ms dotnet 6.0.300
haxe 2.hx 113ms 2.1ms 2.6MB 100ms 0ms haxe/hl/c 4.2.4
csharp 8.cs 147ms 9.2ms 25.0MB 133ms 0ms mono 6.12.0
haxe 1.hx 147ms 0.3ms 2.6MB 140ms 0ms haxe/hl/c 4.2.4
haxe 3.hx 238ms 1.3ms 25.6MB 267ms 10ms haxe/cpp 4.2.4
haxe 2.hx 255ms 0.7ms 3.4MB 243ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx 270ms 2.8ms 3.3MB 260ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 764ms 6.9ms 3.2MB 677ms 73ms haxe/hl/c 4.2.4
haxe 2.hx 832ms 0.4ms 4.4MB 820ms 0ms haxe/cpp 4.2.4
haxe 3.hx 909ms 4.6ms 3.9MB 833ms 53ms haxe/hl/jit 1.12.0
haxe 1.hx 1075ms 3.8ms 3.1MB 1063ms 0ms haxe/cpp 4.2.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1007ms 64ms 42.1MB 973ms 3ms dotnet 6.0.300
csharp 1.cs 1293ms 32ms 96.5MB 1240ms 27ms dotnet 6.0.300
csharp 1.cs 1450ms 53ms 86.6MB 1417ms 20ms mono 6.12.0
csharp 2.cs 2628ms 182ms 32.4MB 2617ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 183ms 2.0ms 48.7MB 143ms 13ms dotnet 6.0.300
csharp 1.cs 199ms 1.6ms 42.6MB 180ms 3ms mono 6.12.0
csharp 2.cs 310ms 2.5ms 31.6MB 270ms 10ms dotnet 6.0.300
csharp 2.cs 612ms 0.3ms 26.1MB 600ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1348ms 3.0ms 79.6MB 1333ms 43ms dotnet 6.0.300

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 2913ms 188ms 589.8MB 2837ms 267ms dotnet 7.0.100
csharp 5p.cs 3745ms 33ms 591.6MB 3603ms 257ms dotnet 7.0.100
csharp 5.cs 3954ms 237ms 522.8MB 3853ms 243ms dotnet 6.0.300

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 455ms 7.3ms 168.0MB 390ms 50ms dotnet 7.0.100
csharp 5p.cs 494ms 19ms 162.0MB 423ms 53ms dotnet 7.0.100
csharp 5.cs 537ms 6.2ms 89.3MB 483ms 43ms dotnet 6.0.300

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4641ms 242ms 79.1MB 4623ms 33ms dotnet 6.0.300

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1157ms 36ms 75.0MB 1140ms 23ms dotnet 6.0.300

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2478ms 3.8ms 29.7MB 4743ms 17ms dotnet 6.0.300
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.4
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 686ms 0.7ms 30.1MB 1230ms 10ms dotnet 6.0.300
haxe 1.hx 1821ms 122ms 6.5MB 1803ms 0ms haxe/cpp 4.2.4
haxe 1.hx 1950ms 1.0ms 3.3MB 1940ms 0ms haxe/hl/c 4.2.4
csharp 3-m.cs 2554ms 15ms 27.7MB 4747ms 3ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 227ms 5.2ms 27.3MB 337ms 7ms dotnet 6.0.300
haxe 1.hx 493ms 2.0ms 2.9MB 480ms 0ms haxe/hl/c 4.2.4
haxe 1.hx 495ms 0.1ms 5.2MB 480ms 0ms haxe/cpp 4.2.4
csharp 3-m.cs 662ms 0.1ms 29.7MB 1207ms 0ms mono 6.12.0
haxe 1.hx 2849ms 0.5ms 3.9MB 2833ms 0ms haxe/hl/jit 1.12.0