Programming Language and compiler
Benchmarks

Ocaml VS Nim benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 3400ms 65ms 34.4MB 3377ms 7ms nim/clang 1.6.6
nim 2.nim 3513ms 2.5ms 34.5MB 3490ms 7ms nim 1.6.6
ocaml 1.ml 4057ms 12ms 120.4MB 4020ms 17ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 272ms 1.5ms 17.4MB 257ms 3ms ocaml 4.14.0
nim 2.nim 320ms 4.9ms 5.7MB 310ms 0ms nim/clang 1.6.6
nim 2.nim 332ms 2.4ms 5.4MB 320ms 0ms nim 1.6.6

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4187ms 38ms 2.4MB 4173ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 340ms 2.1ms 2.6MB 330ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 261ms 0.9ms 0.7MB 247ms 0ms nim 1.6.6
nim 2.nim 337ms 0.7ms 0.9MB 320ms 0ms nim/clang 1.6.6
ocaml 6.ml 425ms 0.9ms 25.4MB 407ms 0ms ocaml 4.14.0
nim 1.nim 771ms 2.8ms 0.7MB 650ms 103ms nim 1.6.6
nim 1.nim 787ms 2.3ms 0.9MB 657ms 110ms nim/clang 1.6.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 28ms 0.1ms 0.7MB 20ms 0ms nim 1.6.6
nim 2.nim 36ms 0.1ms 1.0MB 30ms 0ms nim/clang 1.6.6
ocaml 6.ml 47ms 1.2ms 4.8MB 40ms 0ms ocaml 4.14.0
nim 1.nim 81ms 0.5ms 0.7MB 57ms 7ms nim 1.6.6
nim 1.nim 82ms 0.9ms 1.0MB 63ms 3ms nim/clang 1.6.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.7ms 0.5ms 0.7MB 0ms 0ms nim 1.6.6
nim 1.nim 1.8ms 0.5ms 1.0MB 0ms 0ms nim/clang 1.6.6
ocaml 1.ml 2.3ms 0.7ms 2.6MB 0ms 0ms ocaml 4.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 147ms 0.8ms 1.0MB 140ms 0ms nim/clang 1.6.6
nim 2.nim 154ms 0.4ms 0.7MB 143ms 0ms nim 1.6.6
ocaml 1.ml 240ms 1.1ms 5.9MB 227ms 0ms ocaml 4.14.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 436ms 4.3ms 1.0MB 427ms 0ms nim/clang 1.6.6
nim 2.nim 458ms 2.1ms 0.7MB 447ms 0ms nim 1.6.6
ocaml 1.ml 708ms 1.7ms 5.8MB 697ms 0ms ocaml 4.14.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 64ms 1.0ms 1.0MB 53ms 0ms nim/clang 1.6.6
nim 2.nim 67ms 0.4ms 0.7MB 60ms 0ms nim 1.6.6
ocaml 1.ml 104ms 0.3ms 5.0MB 97ms 0ms ocaml 4.14.0
nim 1.nim 421ms 0.9ms 1.0MB 410ms 0ms nim/clang 1.6.6
nim 1.nim 466ms 4.2ms 0.7MB 457ms 0ms nim 1.6.6

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1528ms 2.4ms 62.6MB 1497ms 17ms ocaml 4.14.0
nim 1.nim 1581ms 0.4ms 35.1MB 1560ms 10ms nim/clang 1.6.6
nim 1.nim 1664ms 0.7ms 35.1MB 1643ms 7ms nim 1.6.6
ocaml 2.ml 2609ms 9.0ms 71.1MB 2577ms 17ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 195ms 0.7ms 18.7MB 183ms 3ms ocaml 4.14.0
nim 1.nim 340ms 2.8ms 9.9MB 330ms 0ms nim/clang 1.6.6
nim 1.nim 361ms 4.6ms 9.3MB 347ms 0ms nim 1.6.6
ocaml 2.ml 437ms 1.6ms 23.6MB 423ms 0ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 405ms 0.5ms 1.0MB 390ms 0ms nim/clang 1.6.6
nim 2.nim 429ms 1.0ms 1.0MB 420ms 0ms nim 1.6.6
ocaml 1.ml 469ms 0.1ms 2.5MB 460ms 0ms ocaml 4.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 43ms 0.1ms 1.0MB 33ms 0ms nim/clang 1.6.6
nim 2.nim 45ms 0.9ms 1.0MB 40ms 0ms nim 1.6.6
ocaml 1.ml 49ms 0.2ms 2.5MB 40ms 0ms ocaml 4.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 593ms 2.3ms 6.4MB 583ms 0ms nim/clang 1.6.6
nim 2.nim 668ms 3.2ms 6.1MB 650ms 0ms nim 1.6.6
nim 1.nim 828ms 1.4ms 41.1MB 813ms 0ms nim 1.6.6
nim 1.nim 829ms 24ms 40.9MB 813ms 3ms nim/clang 1.6.6
ocaml 1.ml 2063ms 42ms 554.8MB 1947ms 97ms ocaml 4.14.0
ocaml 2.ml 2282ms 3.9ms 19.6MB 2267ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 124ms 0.7ms 11.0MB 110ms 0ms nim 1.6.6
nim 1.nim 129ms 2.5ms 11.3MB 117ms 0ms nim/clang 1.6.6
nim 2.nim 140ms 0.3ms 3.3MB 130ms 0ms nim/clang 1.6.6
nim 2.nim 158ms 0.2ms 3.0MB 150ms 0ms nim 1.6.6
ocaml 1.ml 406ms 11ms 142.8MB 370ms 20ms ocaml 4.14.0
ocaml 2.ml 551ms 1.5ms 9.6MB 540ms 0ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 689ms 1.6ms 50.6MB 657ms 17ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4121ms 0.3ms 1.8MB 4110ms 0ms nim/clang 1.6.6
nim 1.nim 4122ms 1.3ms 1.8MB 4110ms 0ms nim 1.6.6
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1032ms 0.3ms 1.0MB 1020ms 0ms nim 1.6.6
nim 1.nim 1033ms 1.6ms 1.0MB 1020ms 0ms nim/clang 1.6.6
ocaml 2.ml 1650ms 2.9ms 3.4MB 1637ms 0ms ocaml 4.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.3ms 1.0MB 250ms 0ms nim 1.6.6
nim 1.nim 260ms 0.3ms 1.0MB 250ms 0ms nim/clang 1.6.6
ocaml 2.ml 415ms 0.7ms 3.0MB 403ms 0ms ocaml 4.14.0