Programming Language and compiler
Benchmarks

OCaml VS Codon benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 3017ms 20ms 150.6MB 2940ms 63ms ocaml 5.1.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 222ms 2.9ms 18.8MB 203ms 3ms ocaml 5.1.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2911ms 3.0ms 3.0MB 2897ms 0ms ocaml 5.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 2.5ms 3.0MB 233ms 0ms ocaml 5.1.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 0.3ms 22.7MB 330ms 3ms ocaml 5.1.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.7ms 5.4MB 27ms 0ms ocaml 5.1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.7ms 0.1ms 3.0MB 0ms 0ms ocaml 5.1.1
codon 1.py 4.5ms 0.8ms 7.2MB 0ms 0ms codon 0.16.3

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 186ms 5.8ms 6.5MB 177ms 0ms ocaml 5.1.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 540ms 18ms 6.4MB 527ms 0ms ocaml 5.1.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 79ms 1.6ms 6.0MB 70ms 0ms ocaml 5.1.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1178ms 8.6ms 74.8MB 1140ms 23ms ocaml 5.1.1
ocaml 2.ml 2124ms 11ms 85.5MB 2077ms 27ms ocaml 5.1.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 153ms 1.9ms 23.1MB 133ms 0ms ocaml 5.1.1
ocaml 2.ml 371ms 4.0ms 24.9MB 347ms 7ms ocaml 5.1.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 373ms 3.1ms 3.3MB 360ms 0ms ocaml 5.1.1
codon 1.py 1295ms 1.9ms 7.7MB 1287ms 0ms codon 0.16.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 40ms 0.9ms 3.3MB 30ms 0ms ocaml 5.1.1
codon 1.py 140ms 2.4ms 5.8MB 127ms 0ms codon 0.16.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 406ms 0.9ms 46.5MB 390ms 0ms codon 0.16.3
codon 2.py 482ms 8.3ms 107.0MB 463ms 13ms codon 0.16.3
ocaml 1.ml 989ms 6.1ms 550.4MB 923ms 50ms ocaml 5.1.1
ocaml 2.ml 2043ms 6.1ms 18.5MB 2030ms 0ms ocaml 5.1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 81ms 2.0ms 17.2MB 70ms 0ms codon 0.16.3
codon 2.py 110ms 3.4ms 26.0MB 97ms 3ms codon 0.16.3
ocaml 1.ml 212ms 19ms 139.7MB 190ms 7ms ocaml 5.1.1
ocaml 2.ml 502ms 3.3ms 9.0MB 487ms 0ms ocaml 5.1.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 466.4MB 4807ms 173ms ocaml 5.1.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 554ms 9.9ms 57.1MB 520ms 17ms ocaml 5.1.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4552ms 0.3ms 4.4MB 4537ms 0ms ocaml 5.1.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1148ms 4.4ms 4.0MB 1137ms 0ms ocaml 5.1.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 296ms 9.9ms 3.4MB 287ms 0ms ocaml 5.1.1