OCaml VS Odin benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 4093ms 50ms 49.5MB 4060ms 13ms odin 2023
ocaml 1.ml 4948ms 10ms 153.4MB 4887ms 43ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 341ms 3.5ms 22.9MB 323ms 3ms ocaml 5.0.0
odin 1.odin 375ms 6.6ms 7.5MB 363ms 0ms odin 2023

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3984ms 14ms 2.8MB 3973ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 331ms 1.3ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.3ms 22.7MB 407ms 3ms ocaml 5.0.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.4ms 4.9MB 37ms 0ms ocaml 5.0.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 2.0ms 0.7ms 1.2MB 0ms 0ms odin 2023
ocaml 1.ml 2.7ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 264ms 2.8ms 6.7MB 250ms 0ms ocaml 5.0.0
odin 1.odin 297ms 45ms 1.2MB 287ms 0ms odin 2023

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 781ms 8.1ms 6.7MB 767ms 0ms ocaml 5.0.0
odin 1.odin 898ms 139ms 1.3MB 890ms 0ms odin 2023

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 118ms 3.7ms 1.3MB 103ms 0ms odin 2023
ocaml 1.ml 118ms 1.6ms 6.0MB 110ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1524ms 6.3ms 69.4MB 1483ms 23ms ocaml 5.0.0
ocaml 2.ml 3227ms 33ms 74.1MB 3187ms 23ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 229ms 7.2ms 25.6MB 213ms 3ms ocaml 5.0.0
ocaml 2.ml 576ms 3.7ms 30.2MB 557ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 470ms 0.5ms 2.9MB 460ms 0ms ocaml 5.0.0
odin 1-i.odin 508ms 0.6ms 1.3MB 500ms 0ms odin 2023
odin 1.odin 2903ms 22ms 1.2MB 2890ms 0ms odin 2023

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 50ms 0.6ms 2.9MB 40ms 0ms ocaml 5.0.0
odin 1-i.odin 54ms 0.4ms 1.2MB 43ms 0ms odin 2023
odin 1.odin 296ms 10ms 1.2MB 287ms 0ms odin 2023

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 587ms 13ms 40.6MB 570ms 3ms odin 2023
odin 2.odin 1175ms 2.5ms 6.4MB 1167ms 0ms odin 2023
ocaml 1.ml 1999ms 32ms 550.5MB 1893ms 87ms ocaml 5.0.0
ocaml 2.ml 2424ms 16ms 19.0MB 2410ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 122ms 0.7ms 11.3MB 110ms 0ms odin 2023
odin 2.odin 290ms 0.5ms 2.5MB 280ms 0ms odin 2023
ocaml 1.ml 339ms 11ms 140.3MB 307ms 17ms ocaml 5.0.0
ocaml 2.ml 609ms 28ms 9.1MB 590ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 181.9MB 4927ms 47ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 705ms 2.8ms 52.5MB 683ms 10ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 4493ms 2.9ms 2.8MB 4480ms 0ms odin 2023
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1126ms 0.3ms 2.1MB 1110ms 0ms odin 2023
ocaml 2.ml 1639ms 5.6ms 3.7MB 1623ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 284ms 0.1ms 1.9MB 270ms 0ms odin 2023
ocaml 2.ml 412ms 0.4ms 3.3MB 400ms 0ms ocaml 5.0.0