Programming Language and compiler
Benchmarks

OCaml VS Codon benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 3047ms 16ms 132.6MB 2977ms 60ms ocaml 5.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 217ms 3.2ms 19.2MB 200ms 0ms ocaml 5.2.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2908ms 3.8ms 4.9MB 2897ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 2.2ms 4.9MB 233ms 0ms ocaml 5.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 347ms 0.9ms 24.9MB 330ms 0ms ocaml 5.2.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.2ms 7.4MB 27ms 0ms ocaml 5.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.8ms 0.2ms 4.9MB 0ms 0ms ocaml 5.2.1
codon 1.py 4.2ms 0.5ms 6.9MB 0ms 0ms codon 0.17.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 183ms 10ms 6.4MB 170ms 0ms ocaml 5.2.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 530ms 20ms 6.6MB 517ms 0ms ocaml 5.2.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 78ms 2.4ms 5.9MB 67ms 0ms ocaml 5.2.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1072ms 10ms 70.2MB 1030ms 27ms ocaml 5.2.1
ocaml 2.ml 2064ms 47ms 91.7MB 2007ms 43ms ocaml 5.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 150ms 2.7ms 21.6MB 127ms 10ms ocaml 5.2.1
ocaml 2.ml 362ms 1.9ms 27.6MB 337ms 7ms ocaml 5.2.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 374ms 0.9ms 5.2MB 363ms 0ms ocaml 5.2.1
codon 1.py 1306ms 9.3ms 7.7MB 1293ms 0ms codon 0.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 42ms 1.3ms 5.2MB 30ms 0ms ocaml 5.2.1
codon 1.py 136ms 1.5ms 7.7MB 120ms 0ms codon 0.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 388ms 15ms 46.5MB 370ms 3ms codon 0.17.0
codon 2.py 904ms 9.6ms 99.9MB 880ms 20ms codon 0.17.0
ocaml 1.ml 945ms 20ms 551.3MB 877ms 50ms ocaml 5.2.1
ocaml 2.ml 1910ms 4.6ms 18.3MB 1897ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
codon 1.py 74ms 3.4ms 17.3MB 63ms 0ms codon 0.17.0
codon 2.py 199ms 0.4ms 25.7MB 190ms 0ms codon 0.17.0
ocaml 1.ml 201ms 5.9ms 142.1MB 173ms 10ms ocaml 5.2.1
ocaml 2.ml 471ms 2.4ms 9.1MB 460ms 0ms ocaml 5.2.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 484.9MB 4780ms 200ms ocaml 5.2.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 533ms 28ms 57.1MB 490ms 27ms ocaml 5.2.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4487ms 17ms 6.6MB 4477ms 0ms ocaml 5.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1126ms 6.0ms 5.9MB 1117ms 0ms ocaml 5.2.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 284ms 2.2ms 5.2MB 270ms 0ms ocaml 5.2.1