Programming Language and compiler
Benchmarks

OCaml VS C# benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 912ms 14ms 187.1MB 903ms 140ms dotnet/aot 9.0.102
csharp 1.cs 964ms 9.3ms 206.6MB 947ms 153ms dotnet 9.0.102
csharp 1.cs 1752ms 85ms 103.6MB 1933ms 253ms mono 6.12.0
ocaml 1.ml 2977ms 13ms 132.6MB 2900ms 60ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 117ms 2.5ms 41.9MB 80ms 30ms dotnet/aot 9.0.102
csharp 1.cs 151ms 2.8ms 46.3MB 127ms 10ms mono 6.12.0
csharp 1.cs 204ms 17ms 64.6MB 153ms 37ms dotnet 9.0.102
ocaml 1.ml 214ms 3.1ms 19.2MB 197ms 3ms ocaml 5.3.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2911ms 3.1ms 4.9MB 2900ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 4.0ms 4.9MB 233ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 138ms 5.4ms 33.9MB 347ms 123ms dotnet/aot 9.0.102
csharp 5-m.cs 188ms 2.6ms 50.8MB 470ms 113ms dotnet 9.0.102
csharp 5-m.cs 259ms 14ms 58.4MB 653ms 157ms mono 6.12.0
ocaml 6.ml 345ms 2.4ms 24.9MB 333ms 0ms ocaml 5.3.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 26ms 1.6ms 23.7MB 33ms 17ms dotnet/aot 9.0.102
ocaml 6.ml 38ms 0.2ms 7.5MB 23ms 0ms ocaml 5.3.0
csharp 5-m.cs 61ms 1.5ms 47.1MB 83ms 20ms dotnet 9.0.102
csharp 5-m.cs 70ms 1.0ms 39.6MB 103ms 17ms mono 6.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.2ms 5.0MB 0ms 0ms ocaml 5.3.0
csharp 1.cs 18ms 10ms 12.5MB 0ms 0ms dotnet/aot 9.0.102
csharp 1.cs 31ms 0.2ms 23.3MB 22ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.3ms 30.3MB 16ms 4ms dotnet 9.0.102

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 99ms 1.7ms 13.9MB 83ms 0ms dotnet/aot 9.0.102
csharp 2.cs 146ms 1.3ms 22.7MB 133ms 3ms mono 6.12.0
ocaml 1.ml 181ms 7.0ms 6.5MB 167ms 0ms ocaml 5.3.0
csharp 2.cs 257ms 11ms 33.4MB 233ms 13ms dotnet 9.0.102
csharp 1.cs 1004ms 6.7ms 17.2MB 980ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1439ms 251ms 38.9MB 1417ms 13ms dotnet 9.0.102
csharp 1.cs 3311ms 41ms 47.6MB 3270ms 30ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 273ms 2.4ms 13.7MB 257ms 0ms dotnet/aot 9.0.102
csharp 2.cs 402ms 2.3ms 35.6MB 387ms 10ms dotnet 9.0.102
csharp 2.cs 412ms 97ms 24.8MB 397ms 0ms mono 6.12.0
ocaml 1.ml 540ms 16ms 6.6MB 527ms 0ms ocaml 5.3.0
csharp 1.cs 2970ms 21ms 17.1MB 2943ms 13ms dotnet/aot 9.0.102
csharp 1.cs 3581ms 35ms 39.1MB 3560ms 20ms dotnet 9.0.102
csharp 1.cs timeout 0.0ms 47.8MB 4953ms 37ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 52ms 1.8ms 15.9MB 40ms 0ms dotnet/aot 9.0.102
ocaml 1.ml 77ms 0.8ms 6.0MB 63ms 0ms ocaml 5.3.0
csharp 2.cs 94ms 1.2ms 24.5MB 80ms 3ms mono 6.12.0
csharp 2.cs 166ms 1.3ms 35.5MB 147ms 7ms dotnet 9.0.102
csharp 1.cs 1609ms 2.2ms 36.8MB 1597ms 7ms dotnet 9.0.102
csharp 1.cs 1817ms 2.0ms 16.9MB 1793ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1821ms 18ms 30.8MB 1803ms 7ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 540ms 17ms 126.2MB 480ms 90ms dotnet/aot 9.0.102
csharp 1.cs 585ms 1.6ms 153.7MB 523ms 133ms dotnet/aot 9.0.102
csharp 2.cs 687ms 11ms 142.9MB 637ms 97ms dotnet 9.0.102
csharp 1.cs 740ms 30ms 169.4MB 690ms 120ms dotnet 9.0.102
ocaml 1.ml 1060ms 22ms 71.2MB 1023ms 27ms ocaml 5.3.0
csharp 1.cs 1320ms 56ms 146.4MB 1527ms 183ms mono 6.12.0
ocaml 2.ml 2025ms 10ms 91.8MB 1973ms 37ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 135ms 1.9ms 64.0MB 103ms 33ms dotnet/aot 9.0.102
ocaml 1.ml 148ms 2.0ms 21.6MB 133ms 0ms ocaml 5.3.0
csharp 1.cs 153ms 2.5ms 80.5MB 120ms 43ms dotnet/aot 9.0.102
csharp 1.cs 260ms 7.3ms 69.5MB 233ms 33ms mono 6.12.0
csharp 2.cs 263ms 7.3ms 82.8MB 210ms 47ms dotnet 9.0.102
csharp 1.cs 288ms 18ms 99.0MB 240ms 50ms dotnet 9.0.102
ocaml 2.ml 352ms 1.6ms 27.7MB 327ms 7ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 360ms 2.4ms 34.2MB 340ms 10ms dotnet 9.0.102
csharp 8.cs 370ms 0.4ms 15.7MB 357ms 0ms dotnet/aot 9.0.102
ocaml 1.ml 373ms 4.8ms 5.3MB 363ms 0ms ocaml 5.3.0
csharp 8.cs 418ms 0.9ms 33.8MB 393ms 10ms dotnet 9.0.102
csharp 8.cs 1246ms 5.3ms 22.4MB 1230ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 40ms 0.1ms 5.3MB 30ms 0ms ocaml 5.3.0
csharp 8.cs 46ms 1.7ms 16.0MB 30ms 0ms dotnet/aot 9.0.102
csharp 9.cs 92ms 1.1ms 34.0MB 77ms 0ms dotnet 9.0.102
csharp 8.cs 105ms 9.8ms 34.0MB 73ms 10ms dotnet 9.0.102
csharp 8.cs 162ms 2.1ms 26.3MB 147ms 3ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 308ms 4.3ms 54.8MB 287ms 10ms dotnet/aot 9.0.102
csharp 1.cs 349ms 1.7ms 70.4MB 323ms 10ms dotnet 9.0.102
csharp 2.cs 396ms 1.6ms 19.9MB 380ms 3ms dotnet/aot 9.0.102
csharp 2.cs 400ms 11ms 38.9MB 370ms 10ms dotnet 9.0.102
csharp 1.cs 535ms 6.8ms 86.0MB 507ms 10ms mono 6.12.0
ocaml 1.ml 914ms 6.3ms 552.5MB 853ms 43ms ocaml 5.3.0
csharp 2.cs 1874ms 13ms 31.5MB 1860ms 0ms mono 6.12.0
ocaml 2.ml 1875ms 8.7ms 18.6MB 1857ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 65ms 0.2ms 27.5MB 50ms 3ms dotnet/aot 9.0.102
csharp 1.cs 98ms 1.1ms 45.5MB 73ms 10ms dotnet 9.0.102
csharp 2.cs 102ms 0.7ms 17.8MB 87ms 3ms dotnet/aot 9.0.102
csharp 2.cs 130ms 1.9ms 36.2MB 107ms 7ms dotnet 9.0.102
csharp 1.cs 144ms 1.5ms 40.3MB 127ms 7ms mono 6.12.0
ocaml 1.ml 176ms 3.5ms 142.3MB 153ms 7ms ocaml 5.3.0
ocaml 2.ml 466ms 4.9ms 9.1MB 453ms 0ms ocaml 5.3.0
csharp 2.cs 484ms 8.1ms 24.9MB 463ms 3ms mono 6.12.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1747ms 9.0ms 429.4MB 1660ms 133ms dotnet/aot 9.0.102
csharp 5.cs 2081ms 40ms 454.7MB 2120ms 190ms dotnet 9.0.102
csharp 6.cs 2702ms 39ms 451.9MB 2663ms 167ms dotnet 9.0.102
csharp 5.cs 4204ms 37ms 425.2MB 4097ms 153ms dotnet/aot 9.0.102
ocaml 2.ml timeout 0.0ms 484.8MB 4803ms 180ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 191ms 1.2ms 54.4MB 167ms 17ms dotnet/aot 9.0.102
csharp 5.cs 293ms 6.7ms 80.4MB 240ms 43ms dotnet 9.0.102
csharp 6.cs 390ms 2.9ms 78.2MB 350ms 37ms dotnet 9.0.102
csharp 5.cs 429ms 2.0ms 58.0MB 403ms 17ms dotnet/aot 9.0.102
ocaml 2.ml 545ms 6.3ms 57.2MB 507ms 27ms ocaml 5.3.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1873ms 37ms 18.4MB 7180ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 1971ms 75ms 38.1MB 7220ms 13ms dotnet 9.0.102
ocaml 2.ml 4564ms 17ms 6.3MB 4553ms 0ms ocaml 5.3.0
csharp 3-m.cs 4634ms 249ms 30.7MB 17543ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 476ms 1.6ms 18.2MB 1790ms 10ms dotnet/aot 9.0.102
csharp 3-m.cs 542ms 12ms 39.9MB 1870ms 10ms dotnet 9.0.102
ocaml 2.ml 1141ms 5.8ms 6.1MB 1130ms 0ms ocaml 5.3.0
csharp 3-m.cs 1203ms 18ms 31.0MB 4483ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 129ms 1.0ms 18.4MB 440ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 193ms 15ms 36.4MB 497ms 10ms dotnet 9.0.102
ocaml 2.ml 292ms 4.1ms 5.3MB 283ms 0ms ocaml 5.3.0
csharp 3-m.cs 348ms 2.4ms 26.4MB 1160ms 7ms mono 6.12.0