OCaml VS Julia benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1231ms 4.7ms 241.4MB 1120ms 197ms julia 1.8.5
ocaml 1.ml timeout 0.0ms 153.6MB 4920ms 60ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 343ms 1.7ms 219.2MB 270ms 157ms julia 1.8.5
ocaml 1.ml 350ms 6.3ms 22.9MB 330ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1676ms 9.2ms 211.9MB 2847ms 160ms julia 1.8.5
ocaml 2.ml 3637ms 1.5ms 2.8MB 3623ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 303ms 0.6ms 2.8MB 290ms 0ms ocaml 5.0.0
julia 2-m.jl 562ms 2.3ms 209.7MB 690ms 153ms julia 1.8.5

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 378ms 0.3ms 22.6MB 360ms 10ms ocaml 5.0.0
julia 7-m.jl 676ms 2.2ms 302.8MB 877ms 187ms julia 1.8.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 42ms 1.1ms 5.0MB 30ms 0ms ocaml 5.0.0
julia 7.jl 501ms 1.6ms 221.6MB 617ms 130ms julia 1.8.5

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.3ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
julia 1.jl 211ms 11ms 166.7MB 103ms 110ms julia/aot 1.8.5
julia 1.jl 226ms 7.5ms 171.7MB 130ms 104ms julia 1.8.5

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 245ms 1.5ms 6.8MB 233ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 724ms 1.7ms 6.8MB 710ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 109ms 0.3ms 6.0MB 97ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1777ms 7.9ms 69.3MB 1723ms 40ms ocaml 5.0.0
ocaml 2.ml 3374ms 15ms 74.1MB 3323ms 33ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 265ms 3.9ms 25.8MB 240ms 10ms ocaml 5.0.0
ocaml 2.ml 589ms 2.0ms 30.3MB 567ms 7ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 538ms 4.0ms 3.0MB 520ms 0ms ocaml 5.0.0
julia 7.jl 551ms 2.0ms 168.3MB 490ms 147ms julia/aot 1.8.5
julia 7.jl 716ms 7.3ms 223.4MB 647ms 150ms julia 1.8.5

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 58ms 0.3ms 2.9MB 50ms 0ms ocaml 5.0.0
julia 7.jl 271ms 3.4ms 170.4MB 197ms 143ms julia/aot 1.8.5
julia 7.jl 435ms 3.0ms 225.1MB 367ms 150ms julia 1.8.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 439ms 1.7ms 156.1MB 383ms 140ms julia/aot 1.8.5
julia 1.jl 557ms 3.6ms 201.2MB 487ms 153ms julia 1.8.5
ocaml 1.ml 2639ms 6.0ms 550.4MB 2483ms 137ms ocaml 5.0.0
ocaml 2.ml 2827ms 181ms 19.0MB 2810ms 3ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 240ms 0.8ms 150.3MB 173ms 107ms julia/aot 1.8.5
julia 1.jl 361ms 2.5ms 197.4MB 303ms 143ms julia 1.8.5
ocaml 1.ml 576ms 3.3ms 140.3MB 530ms 27ms ocaml 5.0.0
ocaml 2.ml 640ms 3.5ms 9.1MB 627ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 194.3MB 4887ms 90ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 709ms 2.1ms 52.5MB 667ms 23ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1237ms 1.0ms 193.9MB 2083ms 140ms julia 1.8.5
julia 3-m.jl 2142ms 2.6ms 211.2MB 3783ms 160ms julia 1.8.5
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 571ms 2.5ms 192.3MB 777ms 147ms julia 1.8.5
julia 3-m.jl 855ms 17ms 210.0MB 1257ms 160ms julia 1.8.5
ocaml 2.ml 1550ms 13ms 3.6MB 1537ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 390ms 0.4ms 3.4MB 380ms 0ms ocaml 5.0.0
julia 2.jl 408ms 1.0ms 194.4MB 473ms 127ms julia 1.8.5
julia 3.jl 519ms 5.1ms 210.5MB 603ms 167ms julia 1.8.5