OCaml VS Nim benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 1946ms 26ms 35.1MB 1927ms 3ms nim 1.6.10
nim 2.nim 2142ms 32ms 35.5MB 2120ms 7ms nim/clang 1.6.10
ocaml 1.ml 4918ms 27ms 153.4MB 4853ms 47ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 183ms 0.2ms 5.5MB 170ms 0ms nim 1.6.10
nim 2.nim 195ms 1.2ms 5.7MB 187ms 0ms nim/clang 1.6.10
ocaml 1.ml 343ms 1.5ms 22.9MB 327ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3975ms 4.3ms 2.8MB 3963ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 330ms 1.2ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 268ms 0.2ms 1.0MB 260ms 0ms nim 1.6.10
nim 2.nim 335ms 0.2ms 1.3MB 327ms 0ms nim/clang 1.6.10
ocaml 6.ml 421ms 0.7ms 22.7MB 403ms 0ms ocaml 5.0.0
nim 1.nim 779ms 4.3ms 1.1MB 687ms 73ms nim 1.6.10
nim 1.nim 796ms 1.3ms 1.2MB 687ms 93ms nim/clang 1.6.10

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 32ms 3.0ms 1.1MB 20ms 0ms nim 1.6.10
nim 2.nim 37ms 2.3ms 1.3MB 27ms 0ms nim/clang 1.6.10
ocaml 6.ml 46ms 0.5ms 4.9MB 33ms 0ms ocaml 5.0.0
nim 1.nim 79ms 0.1ms 1.1MB 57ms 7ms nim 1.6.10
nim 1.nim 83ms 1.7ms 1.3MB 67ms 3ms nim/clang 1.6.10

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.5ms 0.8ms 1.3MB 0ms 0ms nim/clang 1.6.10
nim 1.nim 1.7ms 0.7ms 1.0MB 0ms 0ms nim 1.6.10
ocaml 1.ml 2.5ms 0.7ms 2.9MB 0ms 0ms ocaml 5.0.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 147ms 1.5ms 1.2MB 140ms 0ms nim/clang 1.6.10
nim 2.nim 151ms 0.4ms 1.0MB 140ms 0ms nim 1.6.10
ocaml 1.ml 259ms 0.2ms 6.8MB 250ms 0ms ocaml 5.0.0
nim 1.nim timeout 0.0ms 1.0MB 4990ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim/clang 1.6.10

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 430ms 1.7ms 1.2MB 420ms 0ms nim/clang 1.6.10
nim 2.nim 448ms 1.1ms 1.0MB 437ms 0ms nim 1.6.10
ocaml 1.ml 769ms 4.3ms 6.8MB 757ms 0ms ocaml 5.0.0
nim 1.nim timeout 0.0ms 1.0MB 4990ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 1.3MB 4983ms 0ms nim/clang 1.6.10

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 63ms 0.2ms 1.3MB 50ms 0ms nim/clang 1.6.10
nim 2.nim 65ms 0.7ms 1.1MB 57ms 0ms nim 1.6.10
ocaml 1.ml 115ms 0.5ms 5.9MB 107ms 0ms ocaml 5.0.0
nim 1.nim 387ms 3.1ms 1.2MB 373ms 0ms nim/clang 1.6.10
nim 1.nim 465ms 40ms 1.0MB 447ms 0ms nim 1.6.10

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1003ms 8.6ms 34.3MB 983ms 3ms nim 1.6.10
nim 1.nim 1037ms 18ms 35.2MB 1013ms 7ms nim/clang 1.6.10
ocaml 1.ml 1528ms 14ms 69.1MB 1497ms 13ms ocaml 5.0.0
ocaml 2.ml 3201ms 10ms 74.3MB 3160ms 27ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 213ms 1.3ms 9.3MB 197ms 0ms nim 1.6.10
nim 1.nim 222ms 1.4ms 9.5MB 210ms 0ms nim/clang 1.6.10
ocaml 1.ml 223ms 0.9ms 25.6MB 207ms 3ms ocaml 5.0.0
ocaml 2.ml 572ms 3.4ms 30.1MB 550ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 381ms 0.4ms 1.3MB 370ms 0ms nim 1.6.10
nim 2.nim 412ms 3.2ms 1.3MB 403ms 0ms nim/clang 1.6.10
ocaml 1.ml 468ms 0.1ms 3.0MB 460ms 0ms ocaml 5.0.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 40ms 0.0ms 1.4MB 30ms 0ms nim 1.6.10
nim 2.nim 43ms 0.2ms 1.2MB 30ms 0ms nim/clang 1.6.10
ocaml 1.ml 50ms 1.2ms 2.9MB 40ms 0ms ocaml 5.0.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 574ms 11ms 40.6MB 553ms 0ms nim/clang 1.6.10
nim 1.nim 587ms 10ms 40.2MB 570ms 0ms nim 1.6.10
nim 2.nim 587ms 4.0ms 6.4MB 573ms 0ms nim/clang 1.6.10
nim 2.nim 667ms 5.2ms 6.2MB 657ms 0ms nim 1.6.10
ocaml 1.ml 1942ms 9.7ms 550.6MB 1843ms 83ms ocaml 5.0.0
ocaml 2.ml 2416ms 46ms 19.0MB 2403ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 128ms 2.1ms 11.3MB 120ms 0ms nim/clang 1.6.10
nim 1.nim 128ms 0.4ms 11.1MB 120ms 0ms nim 1.6.10
nim 2.nim 138ms 0.3ms 3.2MB 130ms 0ms nim/clang 1.6.10
nim 2.nim 157ms 0.3ms 3.1MB 143ms 0ms nim 1.6.10
ocaml 1.ml 354ms 17ms 140.4MB 323ms 13ms ocaml 5.0.0
ocaml 2.ml 602ms 21ms 9.1MB 583ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2490ms 1.9ms 168.2MB 2440ms 30ms nim/clang 1.6.10
nim 1.nim 2531ms 3.9ms 167.4MB 2480ms 33ms nim 1.6.10
ocaml 2.ml timeout 0.0ms 181.9MB 4913ms 67ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 256ms 2.0ms 17.0MB 233ms 3ms nim/clang 1.6.10
nim 1.nim 260ms 2.1ms 16.8MB 247ms 0ms nim 1.6.10
ocaml 2.ml 715ms 2.1ms 52.5MB 687ms 13ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4118ms 2.6ms 1.3MB 4107ms 0ms nim/clang 1.6.10
nim 1.nim 4118ms 1.5ms 1.3MB 4107ms 0ms nim 1.6.10
ocaml 2.ml timeout 0.0ms 4.2MB 4990ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1031ms 0.1ms 1.2MB 1020ms 0ms nim/clang 1.6.10
nim 1.nim 1033ms 3.1ms 1.3MB 1020ms 0ms nim 1.6.10
ocaml 2.ml 1634ms 0.6ms 3.7MB 1620ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.1ms 1.3MB 250ms 0ms nim 1.6.10
nim 1.nim 261ms 0.1ms 1.3MB 250ms 0ms nim/clang 1.6.10
ocaml 2.ml 412ms 0.8ms 3.4MB 400ms 0ms ocaml 5.0.0