Programming Language and compiler
Benchmarks

C# VS Haxe benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1356ms 24ms 392.1MB 1253ms 170ms dotnet 6.0.401
haxe 1.hx 1719ms 32ms 145.9MB 1990ms 63ms haxe/cpp 4.2.5
csharp 1.cs 2170ms 29ms 100.2MB 2493ms 153ms mono 6.12.0
haxe 2.hx 4945ms 27ms 497.1MB 6153ms 260ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 108ms 1.3ms 27.5MB 103ms 10ms haxe/cpp 4.2.5
csharp 1.cs 153ms 1.8ms 44.8MB 127ms 7ms mono 6.12.0
csharp 1.cs 188ms 2.9ms 89.2MB 127ms 33ms dotnet 6.0.401
haxe 2.hx 445ms 2.1ms 58.2MB 503ms 40ms haxe/cpp 4.2.5
haxe 1.hx 788ms 6.4ms 7.9MB 747ms 20ms haxe/hl/c 4.2.5
haxe 1.hx 943ms 5.1ms 11.2MB 900ms 23ms haxe/hl/jit 1.12.0
haxe 2.hx 1211ms 10ms 13.5MB 1060ms 130ms haxe/hl/c 4.2.5
haxe 2.hx 1479ms 10ms 24.6MB 1317ms 143ms haxe/hl/jit 1.12.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 4272ms 154ms 104.3MB 7873ms 80ms dotnet 6.0.401

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 408ms 26ms 82.3MB 623ms 43ms dotnet 6.0.401

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1107ms 3.4ms 47.8MB 1070ms 7ms dotnet 6.0.401

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 404ms 16ms 83.6MB 610ms 107ms dotnet 6.0.401
csharp 5-m.cs 504ms 35ms 85.0MB 833ms 113ms mono 6.12.0
haxe 1.hx 3321ms 25ms 27.4MB 3237ms 240ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 85ms 4.3ms 36.8MB 103ms 20ms mono 6.12.0
csharp 5.cs 97ms 5.2ms 39.7MB 87ms 17ms dotnet 6.0.401
haxe 1.hx 347ms 1.2ms 27.6MB 327ms 23ms haxe/cpp 4.2.5
haxe 1.hx 821ms 1.6ms 3.4MB 733ms 70ms haxe/hl/c 4.2.5
haxe 1.hx 847ms 0.8ms 3.8MB 793ms 33ms haxe/hl/jit 1.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 2.2ms 0.4ms 3.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 4.0ms 2.6ms 3.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx 4.4ms 0.7ms 3.0MB 0ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 19ms 0.8ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 50ms 7.0ms 27.1MB 18ms 6ms dotnet 6.0.401

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 642ms 12ms 122.7MB 720ms 90ms dotnet 6.0.401
csharp 2-http3.cs 787ms 27ms 271.8MB 843ms 243ms dotnet 7.0.100-rc.1.22431.12
csharp 2.cs 825ms 29ms 146.2MB 797ms 373ms dotnet 6.0.401
csharp 1-m.cs 878ms 52ms 165.1MB 893ms 437ms dotnet 6.0.401

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 442ms 10ms 76.9MB 370ms 103ms dotnet 6.0.401
csharp 1.cs 474ms 5.4ms 83.9MB 467ms 100ms dotnet 6.0.401
csharp 2-http3.cs 499ms 7.8ms 188.8MB 413ms 123ms dotnet 7.0.100-rc.1.22431.12
csharp 2-http2.cs 510ms 12ms 78.4MB 520ms 40ms dotnet 6.0.401

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 388ms 18ms 66.2MB 330ms 20ms dotnet 6.0.401
csharp 1.cs 521ms 5.9ms 144.1MB 487ms 60ms dotnet 6.0.401

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 2037ms 11ms 265.9MB 2110ms 100ms dotnet 6.0.401
csharp 1.cs 3342ms 247ms 759.2MB 3303ms 340ms dotnet 6.0.401

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 1144ms 5.2ms 70.7MB 1687ms 30ms dotnet 6.0.401
csharp 6-m.cs 1568ms 60ms 69.8MB 2570ms 17ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 229ms 1.0ms 51.2MB 303ms 13ms mono 6.12.0
csharp 6.cs 229ms 4.3ms 62.1MB 257ms 17ms dotnet 6.0.401

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 180ms 0.8ms 22.3MB 167ms 3ms haxe/cpp 4.2.5
haxe 1.hx 183ms 0.7ms 3.0MB 170ms 0ms haxe/hl/c 4.2.5
csharp 2.cs 186ms 2.6ms 25.5MB 167ms 0ms mono 6.12.0
csharp 2.cs 206ms 5.1ms 28.1MB 170ms 0ms dotnet 6.0.401
haxe 1.hx 238ms 4.1ms 3.8MB 227ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 1695ms 39ms 88.7MB 1610ms 33ms dotnet 6.0.401
csharp 1.cs 3023ms 16ms 49.6MB 2993ms 20ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 462ms 9.8ms 28.4MB 440ms 0ms dotnet 6.0.401
csharp 2.cs 506ms 4.4ms 27.5MB 493ms 0ms mono 6.12.0
haxe 1.hx 515ms 4.3ms 27.3MB 500ms 3ms haxe/cpp 4.2.5
haxe 1.hx 541ms 3.6ms 3.0MB 530ms 0ms haxe/hl/c 4.2.5
haxe 1.hx 710ms 16ms 3.6MB 697ms 0ms haxe/hl/jit 1.12.0
csharp 1.cs 4631ms 6.8ms 91.1MB 4590ms 27ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 86ms 1.6ms 15.8MB 73ms 0ms haxe/cpp 4.2.5
haxe 1.hx 90ms 0.4ms 2.9MB 77ms 0ms haxe/hl/c 4.2.5
csharp 2.cs 106ms 1.7ms 26.0MB 90ms 3ms mono 6.12.0
haxe 1.hx 119ms 3.9ms 3.7MB 103ms 0ms haxe/hl/jit 1.12.0
csharp 2.cs 134ms 1.6ms 30.0MB 97ms 3ms dotnet 6.0.401
csharp 1.cs 3184ms 4.2ms 77.1MB 3137ms 30ms dotnet 6.0.401
csharp 1.cs 3186ms 0.7ms 30.6MB 3167ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 755ms 19ms 94.3MB 680ms 30ms dotnet 6.0.401
csharp 1.cs 3770ms 131ms 34.4MB 3740ms 0ms dotnet 6.0.401
csharp 3.cs 4339ms 9.3ms 36.3MB 4300ms 3ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 108ms 1.1ms 36.8MB 60ms 7ms dotnet 6.0.401
csharp 3.cs 251ms 0.8ms 33.2MB 217ms 3ms dotnet 6.0.401
csharp 1.cs 289ms 8.3ms 33.4MB 267ms 3ms dotnet 6.0.401
csharp 1.cs 832ms 3.6ms 25.0MB 820ms 0ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 914ms 7.1ms 378.8MB 773ms 170ms dotnet 6.0.401
csharp 1.cs 919ms 7.8ms 392.6MB 787ms 170ms dotnet 6.0.401
haxe 1.hx 1119ms 6.4ms 96.9MB 1293ms 47ms haxe/cpp 4.2.5
csharp 1.cs 1663ms 12ms 141.4MB 2043ms 107ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
haxe 1.hx 203ms 3.4ms 28.5MB 210ms 7ms haxe/cpp 4.2.5
csharp 2.cs 259ms 4.0ms 92.3MB 203ms 30ms dotnet 6.0.401
csharp 1.cs 293ms 7.5ms 185.8MB 200ms 70ms dotnet 6.0.401
csharp 1.cs 306ms 3.4ms 72.6MB 290ms 23ms mono 6.12.0
haxe 1.hx 1561ms 3.0ms 15.4MB 1443ms 97ms haxe/hl/c 4.2.5
haxe 1.hx 1788ms 11ms 20.2MB 1660ms 117ms haxe/hl/jit 1.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 403ms 4.5ms 29.4MB 370ms 0ms dotnet 6.0.401
csharp 8.cs 535ms 3.0ms 29.4MB 503ms 0ms dotnet 6.0.401
haxe 2.hx 969ms 26ms 2.5MB 953ms 0ms haxe/hl/c 4.2.5
csharp 8.cs 1111ms 5.5ms 26.4MB 1093ms 0ms mono 6.12.0
haxe 1.hx 1325ms 63ms 2.6MB 1313ms 0ms haxe/hl/c 4.2.5
haxe 2.hx 2317ms 0.0ms 3.3MB 2303ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 2325ms 3.1ms 27.5MB 2567ms 47ms haxe/cpp 4.2.5
haxe 1.hx 2461ms 1.5ms 3.3MB 2450ms 0ms haxe/hl/jit 1.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 2.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 3.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 87ms 3.3ms 27.5MB 60ms 0ms dotnet 6.0.401
haxe 2.hx 98ms 1.0ms 2.6MB 90ms 0ms haxe/hl/c 4.2.5
csharp 8.cs 103ms 6.9ms 29.3MB 73ms 3ms dotnet 6.0.401
csharp 8.cs 132ms 0.5ms 23.0MB 120ms 0ms mono 6.12.0
haxe 1.hx 133ms 5.4ms 2.5MB 120ms 0ms haxe/hl/c 4.2.5
haxe 2.hx 247ms 19ms 3.4MB 237ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 248ms 0.5ms 27.6MB 253ms 10ms haxe/cpp 4.2.5
haxe 1.hx 260ms 0.9ms 3.3MB 240ms 0ms haxe/hl/jit 1.12.0
haxe 3.hx 690ms 3.6ms 3.2MB 627ms 50ms haxe/hl/c 4.2.5
haxe 2.hx 849ms 14ms 4.4MB 840ms 0ms haxe/cpp 4.2.5
haxe 3.hx 867ms 11ms 3.8MB 800ms 53ms haxe/hl/jit 1.12.0
haxe 1.hx 1133ms 4.0ms 3.1MB 1120ms 0ms haxe/cpp 4.2.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 734ms 4.5ms 88.1MB 690ms 17ms dotnet 6.0.401
csharp 1.cs 793ms 34ms 82.8MB 763ms 17ms mono 6.12.0
csharp 2.cs 996ms 4.1ms 36.2MB 957ms 10ms dotnet 6.0.401
csharp 2.cs 2434ms 0.4ms 32.4MB 2417ms 3ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 181ms 1.9ms 46.0MB 147ms 10ms dotnet 6.0.401
csharp 1.cs 185ms 2.0ms 40.6MB 167ms 3ms mono 6.12.0
csharp 2.cs 278ms 1.1ms 29.8MB 250ms 3ms dotnet 6.0.401
csharp 2.cs 604ms 0.6ms 27.7MB 583ms 7ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1271ms 5.4ms 96.5MB 1257ms 37ms dotnet 6.0.401

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3119ms 121ms 618.6MB 2993ms 207ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 4149ms 49ms 527.8MB 4090ms 197ms dotnet 6.0.401

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 456ms 3.6ms 179.6MB 390ms 57ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 542ms 4.3ms 90.5MB 493ms 27ms dotnet 6.0.401

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4397ms 116ms 91.0MB 4377ms 27ms dotnet 6.0.401

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1170ms 9.4ms 90.6MB 1147ms 27ms dotnet 6.0.401

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 3138ms 699ms 32.7MB 5223ms 17ms dotnet 6.0.401
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/cpp 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/c 4.2.5
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 721ms 1.6ms 30.6MB 1313ms 10ms dotnet 6.0.401
haxe 1.hx 2330ms 0.1ms 6.6MB 2317ms 0ms haxe/cpp 4.2.5
haxe 1.hx 2338ms 0.7ms 3.3MB 2327ms 0ms haxe/hl/c 4.2.5
csharp 3-m.cs 3184ms 138ms 29.2MB 6040ms 3ms mono 6.12.0
haxe 1.hx timeout 0.0ms 0.0MB 0ms 0ms haxe/hl/jit 1.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 232ms 2.2ms 30.0MB 357ms 7ms dotnet 6.0.401
haxe 1.hx 586ms 0.3ms 5.3MB 577ms 0ms haxe/cpp 4.2.5
haxe 1.hx 587ms 0.1ms 3.2MB 580ms 0ms haxe/hl/c 4.2.5
csharp 3-m.cs 800ms 2.0ms 27.8MB 1523ms 0ms mono 6.12.0
haxe 1.hx 3430ms 6.1ms 3.8MB 3420ms 0ms haxe/hl/jit 1.12.0