OCaml VS V benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1125ms 3.1ms 37.2MB 1100ms 7ms v/clang 0.3.3
v 1.v 1159ms 29ms 37.0MB 1133ms 7ms v/clang+gc 0.3.3
ocaml 1.ml timeout 0.0ms 153.6MB 4920ms 60ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 90ms 0.5ms 5.6MB 73ms 0ms v/clang+gc 0.3.3
v 1.v 91ms 2.6ms 5.6MB 77ms 0ms v/clang 0.3.3
ocaml 1.ml 350ms 6.3ms 22.9MB 330ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 2813ms 16ms 2.0MB 2800ms 0ms v/clang+gc 0.3.3
v 1.v 2820ms 20ms 2.0MB 2803ms 0ms v/clang 0.3.3
ocaml 2.ml 3637ms 1.5ms 2.8MB 3623ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 235ms 0.9ms 2.0MB 220ms 0ms v/clang+gc 0.3.3
v 1.v 236ms 0.4ms 2.1MB 223ms 0ms v/clang 0.3.3
ocaml 2.ml 303ms 0.6ms 2.8MB 290ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 378ms 0.3ms 22.6MB 360ms 10ms ocaml 5.0.0
v 1.v 615ms 0.9ms 2.0MB 603ms 0ms v/clang 0.3.3
v 1.v 616ms 0.7ms 2.0MB 600ms 0ms v/clang+gc 0.3.3

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 42ms 1.1ms 5.0MB 30ms 0ms ocaml 5.0.0
v 1.v 65ms 1.2ms 2.0MB 53ms 0ms v/clang 0.3.3
v 1.v 65ms 0.4ms 2.0MB 57ms 0ms v/clang+gc 0.3.3

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 2.2ms 0.4ms 2.0MB 0ms 0ms v/clang+gc 0.3.3
ocaml 1.ml 2.3ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
v 1.v 2.9ms 0.9ms 2.0MB 0ms 0ms v/clang 0.3.3

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 245ms 1.5ms 6.8MB 233ms 0ms ocaml 5.0.0
v 1.v 350ms 1.5ms 2.2MB 340ms 0ms v/clang+gc 0.3.3
v 1.v 368ms 1.1ms 2.1MB 357ms 0ms v/clang 0.3.3

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 724ms 1.7ms 6.8MB 710ms 0ms ocaml 5.0.0
v 1.v 1043ms 2.5ms 2.1MB 1030ms 0ms v/clang+gc 0.3.3
v 1.v 1095ms 0.2ms 2.3MB 1080ms 0ms v/clang 0.3.3

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 109ms 0.3ms 6.0MB 97ms 0ms ocaml 5.0.0
v 1.v 123ms 0.8ms 2.2MB 110ms 0ms v/clang+gc 0.3.3
v 1.v 131ms 1.5ms 2.3MB 120ms 0ms v/clang 0.3.3

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1777ms 7.9ms 69.3MB 1723ms 40ms ocaml 5.0.0
ocaml 2.ml 3374ms 15ms 74.1MB 3323ms 33ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 265ms 3.9ms 25.8MB 240ms 10ms ocaml 5.0.0
ocaml 2.ml 589ms 2.0ms 30.3MB 567ms 7ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 538ms 4.0ms 3.0MB 520ms 0ms ocaml 5.0.0
v 1.v 884ms 0.4ms 2.4MB 870ms 0ms v/clang+gc 0.3.3
v 1.v 904ms 17ms 2.3MB 885ms 0ms v/clang 0.3.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 58ms 0.3ms 2.9MB 50ms 0ms ocaml 5.0.0
v 1.v 92ms 0.2ms 2.2MB 80ms 0ms v/clang 0.3.3
v 1.v 97ms 6.8ms 2.3MB 87ms 0ms v/clang+gc 0.3.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 545ms 2.6ms 10.5MB 530ms 0ms v/clang 0.3.3
v 2.v 556ms 3.9ms 10.6MB 540ms 0ms v/clang+gc 0.3.3
v 1.v 844ms 6.4ms 41.0MB 823ms 3ms v/clang 0.3.3
v 1.v 1012ms 3.7ms 41.1MB 987ms 10ms v/clang+gc 0.3.3
ocaml 1.ml 2639ms 6.0ms 550.4MB 2483ms 137ms ocaml 5.0.0
ocaml 2.ml 2827ms 181ms 19.0MB 2810ms 3ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 123ms 0.8ms 20.2MB 103ms 3ms v/clang+gc 0.3.3
v 1.v 124ms 2.8ms 20.8MB 107ms 0ms v/clang 0.3.3
v 2.v 125ms 0.5ms 4.1MB 113ms 0ms v/clang 0.3.3
v 2.v 126ms 0.6ms 4.3MB 117ms 0ms v/clang+gc 0.3.3
ocaml 1.ml 576ms 3.3ms 140.3MB 530ms 27ms ocaml 5.0.0
ocaml 2.ml 640ms 3.5ms 9.1MB 627ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 194.3MB 4887ms 90ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 709ms 2.1ms 52.5MB 667ms 23ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0
v 1.v timeout 0.0ms 3.0MB 4990ms 0ms v/clang 0.3.3
v 1.v timeout 0.0ms 3.0MB 4990ms 0ms v/clang+gc 0.3.3

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1550ms 13ms 3.6MB 1537ms 0ms ocaml 5.0.0
v 1.v 1665ms 0.5ms 2.8MB 1657ms 0ms v/clang 0.3.3
v 1.v 1666ms 1.5ms 2.8MB 1660ms 0ms v/clang+gc 0.3.3

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 390ms 0.4ms 3.4MB 380ms 0ms ocaml 5.0.0
v 1.v 420ms 1.3ms 2.6MB 407ms 0ms v/clang+gc 0.3.3
v 1.v 422ms 1.3ms 2.5MB 407ms 0ms v/clang 0.3.3