Programming Language and compiler
Benchmarks

OCaml VS Nim benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 835ms 5.3ms 34.4MB 813ms 7ms nim 2.0.2
nim 2.nim 1170ms 1.0ms 34.7MB 1150ms 7ms nim/clang 2.0.2
ocaml 1.ml 3017ms 20ms 150.6MB 2940ms 63ms ocaml 5.1.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 80ms 2.9ms 5.5MB 70ms 0ms nim 2.0.2
nim 2.nim 113ms 2.9ms 5.8MB 100ms 0ms nim/clang 2.0.2
ocaml 1.ml 222ms 2.9ms 18.8MB 203ms 3ms ocaml 5.1.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2911ms 3.0ms 3.0MB 2897ms 0ms ocaml 5.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 2.5ms 3.0MB 233ms 0ms ocaml 5.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 188ms 3.5ms 1.5MB 177ms 0ms nim 2.0.2
nim 2.nim 239ms 3.2ms 1.8MB 227ms 0ms nim/clang 2.0.2
ocaml 6.ml 345ms 0.3ms 22.7MB 330ms 3ms ocaml 5.1.1
nim 1.nim 549ms 1.1ms 1.8MB 447ms 87ms nim/clang 2.0.2
nim 1.nim 573ms 0.7ms 1.5MB 463ms 90ms nim 2.0.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 20ms 0.4ms 1.5MB 10ms 0ms nim 2.0.2
nim 2.nim 26ms 0.6ms 1.6MB 20ms 0ms nim/clang 2.0.2
ocaml 6.ml 39ms 0.7ms 5.4MB 27ms 0ms ocaml 5.1.1
nim 1.nim 58ms 0.6ms 1.8MB 43ms 0ms nim/clang 2.0.2
nim 1.nim 61ms 1.0ms 1.5MB 43ms 7ms nim 2.0.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.0ms 0.1ms 1.6MB 0ms 0ms nim 2.0.2
nim 1.nim 1.2ms 0.1ms 1.9MB 0ms 0ms nim/clang 2.0.2
ocaml 1.ml 1.7ms 0.1ms 3.0MB 0ms 0ms ocaml 5.1.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 108ms 1.5ms 1.6MB 100ms 0ms nim/clang 2.0.2
nim 2.nim 109ms 2.7ms 1.4MB 97ms 0ms nim 2.0.2
ocaml 1.ml 186ms 5.8ms 6.5MB 177ms 0ms ocaml 5.1.1
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.0.2
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.0.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 316ms 0.4ms 1.9MB 307ms 0ms nim/clang 2.0.2
nim 2.nim 323ms 4.4ms 1.4MB 313ms 0ms nim 2.0.2
ocaml 1.ml 540ms 18ms 6.4MB 527ms 0ms ocaml 5.1.1
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.0.2
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.0.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 48ms 0.6ms 1.5MB 40ms 0ms nim/clang 2.0.2
nim 2.nim 49ms 0.7ms 1.3MB 40ms 0ms nim 2.0.2
ocaml 1.ml 79ms 1.6ms 6.0MB 70ms 0ms ocaml 5.1.1
nim 1.nim 536ms 10ms 1.5MB 523ms 0ms nim/clang 2.0.2
nim 1.nim 536ms 8.6ms 1.3MB 523ms 0ms nim 2.0.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 553ms 0.7ms 34.4MB 533ms 3ms nim 2.0.2
nim 1.nim 653ms 8.9ms 36.5MB 633ms 3ms nim/clang 2.0.2
ocaml 1.ml 1178ms 8.6ms 74.8MB 1140ms 23ms ocaml 5.1.1
ocaml 2.ml 2124ms 11ms 85.5MB 2077ms 27ms ocaml 5.1.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 122ms 0.7ms 9.8MB 110ms 0ms nim 2.0.2
nim 1.nim 143ms 2.1ms 10.0MB 130ms 0ms nim/clang 2.0.2
ocaml 1.ml 153ms 1.9ms 23.1MB 133ms 0ms ocaml 5.1.1
ocaml 2.ml 371ms 4.0ms 24.9MB 347ms 7ms ocaml 5.1.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 318ms 1.0ms 1.8MB 310ms 0ms nim 2.0.2
nim 2.nim 343ms 3.5ms 2.0MB 333ms 0ms nim/clang 2.0.2
ocaml 1.ml 373ms 3.1ms 3.3MB 360ms 0ms ocaml 5.1.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 34ms 0.5ms 1.8MB 23ms 0ms nim 2.0.2
nim 2.nim 36ms 0.1ms 2.0MB 30ms 0ms nim/clang 2.0.2
ocaml 1.ml 40ms 0.9ms 3.3MB 30ms 0ms ocaml 5.1.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 282ms 2.6ms 41.5MB 270ms 0ms nim 2.0.2
nim 1.nim 351ms 9.9ms 41.8MB 337ms 0ms nim/clang 2.0.2
ocaml 1.ml 989ms 6.1ms 550.4MB 923ms 50ms ocaml 5.1.1
ocaml 2.ml 2043ms 6.1ms 18.5MB 2030ms 0ms ocaml 5.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 56ms 1.3ms 11.5MB 47ms 0ms nim 2.0.2
nim 1.nim 65ms 1.0ms 11.8MB 53ms 0ms nim/clang 2.0.2
ocaml 1.ml 212ms 19ms 139.7MB 190ms 7ms ocaml 5.1.1
ocaml 2.ml 502ms 3.3ms 9.0MB 487ms 0ms ocaml 5.1.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1623ms 6.2ms 152.4MB 1583ms 23ms nim/clang 2.0.2
nim 1.nim 1647ms 11ms 151.5MB 1617ms 13ms nim 2.0.2
ocaml 2.ml timeout 0.0ms 466.4MB 4807ms 173ms ocaml 5.1.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 172ms 1.3ms 16.4MB 153ms 7ms nim 2.0.2
nim 1.nim 173ms 1.6ms 16.7MB 160ms 0ms nim/clang 2.0.2
ocaml 2.ml 554ms 9.9ms 57.1MB 520ms 17ms ocaml 5.1.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3574ms 1.9ms 1.6MB 3567ms 0ms nim/clang 2.0.2
nim 1.nim 3591ms 12ms 1.4MB 3580ms 0ms nim 2.0.2
ocaml 2.ml 4552ms 0.3ms 4.4MB 4537ms 0ms ocaml 5.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 895ms 0.8ms 1.5MB 887ms 0ms nim/clang 2.0.2
nim 1.nim 899ms 2.9ms 1.8MB 890ms 0ms nim 2.0.2
ocaml 2.ml 1148ms 4.4ms 4.0MB 1137ms 0ms ocaml 5.1.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 226ms 0.0ms 1.5MB 217ms 0ms nim/clang 2.0.2
nim 1.nim 227ms 1.0ms 1.8MB 220ms 0ms nim 2.0.2
ocaml 2.ml 296ms 9.9ms 3.4MB 287ms 0ms ocaml 5.1.1