Ocaml VS Zig benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 4057ms 12ms 120.4MB 4020ms 17ms ocaml 4.14.0
zig 1.zig timeout 0.0ms 0.0MB 0ms 0ms zig 0.10.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 272ms 1.5ms 17.4MB 257ms 3ms ocaml 4.14.0
zig 1.zig 3043ms 18ms 8.0MB 2350ms 657ms zig 0.10.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 1201ms 3.4ms 0.0MB 2350ms 0ms zig 0.10.0
zig 2.zig 2680ms 2.2ms 0.0MB 2670ms 0ms zig 0.10.0
zig 1.zig 3444ms 4.2ms 0.1MB 3430ms 0ms zig 0.10.0
ocaml 2.ml 4187ms 38ms 2.4MB 4173ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 113ms 0.3ms 0.0MB 197ms 0ms zig 0.10.0
zig 2.zig 232ms 1.8ms 0.0MB 220ms 0ms zig 0.10.0
zig 1.zig 290ms 2.1ms 0.1MB 280ms 0ms zig 0.10.0
ocaml 2.ml 340ms 2.1ms 2.6MB 330ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 155ms 0.1ms 0.0MB 150ms 0ms zig 0.10.0
ocaml 6.ml 425ms 0.9ms 25.4MB 407ms 0ms ocaml 4.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 18ms 0.3ms 0.0MB 10ms 0ms zig 0.10.0
ocaml 6.ml 47ms 1.2ms 4.8MB 40ms 0ms ocaml 4.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 2.1ms 1.0ms 0.0MB 0ms 0ms zig 0.10.0
ocaml 1.ml 2.3ms 0.7ms 2.6MB 0ms 0ms ocaml 4.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 47ms 1.7ms 1.6MB 37ms 0ms zig 0.10.0
ocaml 1.ml 240ms 1.1ms 5.9MB 227ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 132ms 0.3ms 1.6MB 120ms 0ms zig 0.10.0
ocaml 1.ml 708ms 1.7ms 5.8MB 697ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 23ms 1.7ms 0.3MB 10ms 0ms zig 0.10.0
ocaml 1.ml 104ms 0.3ms 5.0MB 97ms 0ms ocaml 4.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1528ms 2.4ms 62.6MB 1497ms 17ms ocaml 4.14.0
ocaml 2.ml 2609ms 9.0ms 71.1MB 2577ms 17ms ocaml 4.14.0
zig 1.zig timeout 0.0ms 0.0MB 0ms 0ms zig 0.10.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 195ms 0.7ms 18.7MB 183ms 3ms ocaml 4.14.0
ocaml 2.ml 437ms 1.6ms 23.6MB 423ms 0ms ocaml 4.14.0
zig 1.zig timeout 0.0ms 0.0MB 0ms 0ms zig 0.10.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 303ms 0.6ms 0.0MB 290ms 0ms zig 0.10.0
zig 1.zig 377ms 3.5ms 0.0MB 367ms 0ms zig 0.10.0
ocaml 1.ml 469ms 0.1ms 2.5MB 460ms 0ms ocaml 4.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 33ms 1.6ms 0.0MB 20ms 0ms zig 0.10.0
zig 1.zig 40ms 0.6ms 0.0MB 30ms 0ms zig 0.10.0
ocaml 1.ml 49ms 0.2ms 2.5MB 40ms 0ms ocaml 4.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 423ms 0.2ms 4.9MB 410ms 0ms zig 0.10.0
zig 1.zig 687ms 54ms 39.1MB 657ms 17ms zig 0.10.0
ocaml 1.ml 2063ms 42ms 554.8MB 1947ms 97ms ocaml 4.14.0
ocaml 2.ml 2282ms 3.9ms 19.6MB 2267ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 95ms 1.2ms 1.1MB 87ms 0ms zig 0.10.0
zig 1.zig 118ms 1.4ms 9.6MB 103ms 0ms zig 0.10.0
ocaml 1.ml 406ms 11ms 142.8MB 370ms 20ms ocaml 4.14.0
ocaml 2.ml 551ms 1.5ms 9.6MB 540ms 0ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 689ms 1.6ms 50.6MB 657ms 17ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 1070ms 4.8ms 0.3MB 2047ms 0ms zig 0.10.0
zig 2.zig 2064ms 3.4ms 0.0MB 2050ms 0ms zig 0.10.0
zig 1.zig 4576ms 0.2ms 0.1MB 4560ms 0ms zig 0.10.0
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 278ms 2.3ms 0.2MB 510ms 0ms zig 0.10.0
zig 2.zig 517ms 0.8ms 0.0MB 507ms 0ms zig 0.10.0
zig 1.zig 1146ms 0.6ms 0.1MB 1133ms 0ms zig 0.10.0
ocaml 2.ml 1650ms 2.9ms 3.4MB 1637ms 0ms ocaml 4.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 77ms 1.5ms 0.2MB 123ms 0ms zig 0.10.0
zig 2.zig 131ms 2.0ms 0.0MB 120ms 0ms zig 0.10.0
zig 1.zig 289ms 1.4ms 0.1MB 280ms 0ms zig 0.10.0
ocaml 2.ml 415ms 0.7ms 3.0MB 403ms 0ms ocaml 4.14.0