Programming Language and compiler
Benchmarks

OCaml VS C# benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1356ms 24ms 392.1MB 1253ms 170ms dotnet 6.0.401
csharp 1.cs 2170ms 29ms 100.2MB 2493ms 153ms mono 6.12.0
ocaml 1.ml 3996ms 16ms 120.6MB 3963ms 20ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 153ms 1.8ms 44.8MB 127ms 7ms mono 6.12.0
csharp 1.cs 188ms 2.9ms 89.2MB 127ms 33ms dotnet 6.0.401
ocaml 1.ml 268ms 3.9ms 17.4MB 253ms 0ms ocaml 4.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3944ms 24ms 2.4MB 3930ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 326ms 0.9ms 2.5MB 320ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 404ms 16ms 83.6MB 610ms 107ms dotnet 6.0.401
ocaml 6.ml 424ms 0.4ms 25.3MB 403ms 7ms ocaml 4.14.0
csharp 5-m.cs 504ms 35ms 85.0MB 833ms 113ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.5ms 5.9MB 33ms 0ms ocaml 4.14.0
csharp 5.cs 85ms 4.3ms 36.8MB 103ms 20ms mono 6.12.0
csharp 5.cs 97ms 5.2ms 39.7MB 87ms 17ms dotnet 6.0.401

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.3ms 0.7ms 2.5MB 0ms 0ms ocaml 4.14.0
csharp 1.cs 19ms 0.8ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 50ms 7.0ms 27.1MB 18ms 6ms dotnet 6.0.401

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 186ms 2.6ms 25.5MB 167ms 0ms mono 6.12.0
csharp 2.cs 206ms 5.1ms 28.1MB 170ms 0ms dotnet 6.0.401
ocaml 1.ml 238ms 0.1ms 6.0MB 230ms 0ms ocaml 4.14.0
csharp 1.cs 1695ms 39ms 88.7MB 1610ms 33ms dotnet 6.0.401
csharp 1.cs 3023ms 16ms 49.6MB 2993ms 20ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 462ms 9.8ms 28.4MB 440ms 0ms dotnet 6.0.401
csharp 2.cs 506ms 4.4ms 27.5MB 493ms 0ms mono 6.12.0
ocaml 1.ml 706ms 0.9ms 5.9MB 690ms 0ms ocaml 4.14.0
csharp 1.cs 4631ms 6.8ms 91.1MB 4590ms 27ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 105ms 1.1ms 5.2MB 93ms 0ms ocaml 4.14.0
csharp 2.cs 106ms 1.7ms 26.0MB 90ms 3ms mono 6.12.0
csharp 2.cs 134ms 1.6ms 30.0MB 97ms 3ms dotnet 6.0.401
csharp 1.cs 3184ms 4.2ms 77.1MB 3137ms 30ms dotnet 6.0.401
csharp 1.cs 3186ms 0.7ms 30.6MB 3167ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 914ms 7.1ms 378.8MB 773ms 170ms dotnet 6.0.401
csharp 1.cs 919ms 7.8ms 392.6MB 787ms 170ms dotnet 6.0.401
ocaml 1.ml 1492ms 4.5ms 62.8MB 1460ms 13ms ocaml 4.14.0
csharp 1.cs 1663ms 12ms 141.4MB 2043ms 107ms mono 6.12.0
ocaml 2.ml 2545ms 6.5ms 71.3MB 2520ms 10ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 192ms 1.8ms 18.6MB 170ms 3ms ocaml 4.14.0
csharp 2.cs 259ms 4.0ms 92.3MB 203ms 30ms dotnet 6.0.401
csharp 1.cs 293ms 7.5ms 185.8MB 200ms 70ms dotnet 6.0.401
csharp 1.cs 306ms 3.4ms 72.6MB 290ms 23ms mono 6.12.0
ocaml 2.ml 432ms 3.0ms 23.6MB 413ms 0ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 403ms 4.5ms 29.4MB 370ms 0ms dotnet 6.0.401
ocaml 1.ml 470ms 0.5ms 2.5MB 460ms 0ms ocaml 4.14.0
csharp 8.cs 535ms 3.0ms 29.4MB 503ms 0ms dotnet 6.0.401
csharp 8.cs 1111ms 5.5ms 26.4MB 1093ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 51ms 0.8ms 2.4MB 40ms 0ms ocaml 4.14.0
csharp 9.cs 87ms 3.3ms 27.5MB 60ms 0ms dotnet 6.0.401
csharp 8.cs 103ms 6.9ms 29.3MB 73ms 3ms dotnet 6.0.401
csharp 8.cs 132ms 0.5ms 23.0MB 120ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 734ms 4.5ms 88.1MB 690ms 17ms dotnet 6.0.401
csharp 1.cs 793ms 34ms 82.8MB 763ms 17ms mono 6.12.0
csharp 2.cs 996ms 4.1ms 36.2MB 957ms 10ms dotnet 6.0.401
ocaml 1.ml 1988ms 8.5ms 556.0MB 1893ms 77ms ocaml 4.14.0
ocaml 2.ml 2288ms 25ms 20.2MB 2277ms 0ms ocaml 4.14.0
csharp 2.cs 2434ms 0.4ms 32.4MB 2417ms 3ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 181ms 1.9ms 46.0MB 147ms 10ms dotnet 6.0.401
csharp 1.cs 185ms 2.0ms 40.6MB 167ms 3ms mono 6.12.0
csharp 2.cs 278ms 1.1ms 29.8MB 250ms 3ms dotnet 6.0.401
ocaml 1.ml 374ms 18ms 142.4MB 340ms 17ms ocaml 4.14.0
ocaml 2.ml 549ms 1.2ms 9.7MB 540ms 0ms ocaml 4.14.0
csharp 2.cs 604ms 0.6ms 27.7MB 583ms 7ms mono 6.12.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3119ms 121ms 618.6MB 2993ms 207ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 4149ms 49ms 527.8MB 4090ms 197ms dotnet 6.0.401
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 456ms 3.6ms 179.6MB 390ms 57ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 542ms 4.3ms 90.5MB 493ms 27ms dotnet 6.0.401
ocaml 2.ml 683ms 3.0ms 49.9MB 663ms 7ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 3138ms 699ms 32.7MB 5223ms 17ms dotnet 6.0.401
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 721ms 1.6ms 30.6MB 1313ms 10ms dotnet 6.0.401
ocaml 2.ml 1647ms 1.1ms 3.2MB 1640ms 0ms ocaml 4.14.0
csharp 3-m.cs 3184ms 138ms 29.2MB 6040ms 3ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 232ms 2.2ms 30.0MB 357ms 7ms dotnet 6.0.401
ocaml 2.ml 415ms 1.0ms 3.1MB 400ms 0ms ocaml 4.14.0
csharp 3-m.cs 800ms 2.0ms 27.8MB 1523ms 0ms mono 6.12.0