Julia VS OCaml benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.6ms 0.9ms 2.9MB 0ms 0ms ocaml 5.0.0
julia 1.jl 236ms 5.1ms 167.8MB 138ms 110ms julia/aot 1.8.5
julia 1.jl 250ms 5.6ms 171.5MB 152ms 114ms julia 1.8.5

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 7.jl 646ms 1.6ms 168.0MB 587ms 163ms julia/aot 1.8.5
ocaml 1.ml 668ms 18ms 2.9MB 653ms 0ms ocaml 5.0.0
julia 7.jl 833ms 13ms 225.8MB 763ms 180ms julia 1.8.5

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 74ms 3.1ms 2.9MB 63ms 0ms ocaml 5.0.0
julia 7.jl 317ms 22ms 167.0MB 240ms 147ms julia/aot 1.8.5
julia 7.jl 526ms 2.9ms 227.5MB 423ms 200ms julia 1.8.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 519ms 11ms 156.1MB 467ms 163ms julia/aot 1.8.5
julia 1.jl 636ms 7.2ms 203.7MB 587ms 150ms julia 1.8.5
ocaml 1.ml 2737ms 6.5ms 550.4MB 2570ms 153ms ocaml 5.0.0
ocaml 2.ml 3263ms 200ms 19.0MB 3240ms 7ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 301ms 26ms 149.8MB 190ms 150ms julia/aot 1.8.5
julia 1.jl 405ms 6.3ms 197.2MB 327ms 180ms julia 1.8.5
ocaml 1.ml 557ms 15ms 140.2MB 507ms 33ms ocaml 5.0.0
ocaml 2.ml 811ms 68ms 9.1MB 797ms 0ms ocaml 5.0.0

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1444ms 14ms 241.6MB 1307ms 233ms julia 1.8.5
ocaml 1.ml timeout 0.0ms 139.4MB 4927ms 50ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 392ms 4.3ms 225.4MB 323ms 170ms julia 1.8.5
ocaml 1.ml 395ms 6.2ms 22.9MB 363ms 13ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1982ms 6.8ms 210.4MB 3410ms 180ms julia 1.8.5
ocaml 2.ml 4303ms 54ms 2.8MB 4290ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 356ms 7.7ms 2.9MB 343ms 0ms ocaml 5.0.0
julia 2-m.jl 674ms 29ms 211.1MB 830ms 190ms julia 1.8.5

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 450ms 2.9ms 22.7MB 433ms 3ms ocaml 5.0.0
julia 7-m.jl 797ms 8.6ms 298.9MB 1077ms 200ms julia 1.8.5

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 50ms 0.4ms 4.9MB 37ms 0ms ocaml 5.0.0
julia 7.jl 570ms 8.1ms 227.5MB 683ms 167ms julia 1.8.5

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 1412ms 8.8ms 274.1MB 1860ms 193ms julia 1.8.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 950ms 17ms 262.9MB 1040ms 200ms julia 1.8.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 856ms 22ms 178.0MB 807ms 157ms julia 1.8.5
julia 1.jl 1650ms 5.6ms 261.1MB 1530ms 227ms julia 1.8.5

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 418ms 15ms 175.4MB 353ms 170ms julia 1.8.5
julia 1.jl 1002ms 43ms 261.2MB 880ms 207ms julia 1.8.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1489ms 28ms 193.8MB 2493ms 173ms julia 1.8.5
julia 3-m.jl 2607ms 78ms 208.5MB 4643ms 157ms julia 1.8.5
ocaml 2.ml timeout 0.0ms 4.0MB 4983ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 682ms 15ms 194.1MB 940ms 170ms julia 1.8.5
julia 3-m.jl 1012ms 20ms 208.1MB 1503ms 173ms julia 1.8.5
ocaml 2.ml 1802ms 7.5ms 3.6MB 1787ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2.jl 473ms 2.6ms 195.0MB 543ms 163ms julia 1.8.5
ocaml 2.ml 475ms 16ms 3.4MB 460ms 0ms ocaml 5.0.0
julia 3.jl 600ms 8.7ms 208.4MB 713ms 183ms julia 1.8.5