Programming Language and compiler
Benchmarks

OCaml VS Acton benchmarks

Current benchmark data was generated on Mon Dec 30 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 3006ms 11ms 132.5MB 2940ms 50ms ocaml 5.2.1
acton 1.act timeout 0.0ms 67.0MB 5963ms 77ms actonc 0.24.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 216ms 1.7ms 19.2MB 200ms 0ms ocaml 5.2.1
acton 1.act 829ms 36ms 12.0MB 960ms 70ms actonc 0.24.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2917ms 7.3ms 4.9MB 2907ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 1.0ms 4.9MB 233ms 0ms ocaml 5.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 346ms 0.8ms 24.8MB 333ms 0ms ocaml 5.2.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.1ms 7.3MB 27ms 0ms ocaml 5.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.8ms 0.2ms 4.9MB 0ms 0ms ocaml 5.2.1
acton 1.act 3.9ms 0.2ms 8.3MB 0ms 0ms actonc 0.24.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 178ms 5.8ms 6.4MB 163ms 0ms ocaml 5.2.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 548ms 4.0ms 6.6MB 537ms 0ms ocaml 5.2.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 78ms 2.9ms 5.9MB 67ms 0ms ocaml 5.2.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1064ms 14ms 70.2MB 1007ms 40ms ocaml 5.2.1
ocaml 2.ml 2031ms 11ms 91.7MB 1983ms 33ms ocaml 5.2.1
acton 1.act 3310ms 185ms 101.9MB 3583ms 63ms actonc 0.24.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 149ms 1.8ms 21.6MB 130ms 3ms ocaml 5.2.1
ocaml 2.ml 363ms 12ms 27.6MB 347ms 3ms ocaml 5.2.1
acton 1.act 699ms 28ms 30.4MB 727ms 37ms actonc 0.24.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 379ms 2.6ms 5.2MB 367ms 0ms ocaml 5.2.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 41ms 1.6ms 5.3MB 30ms 0ms ocaml 5.2.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 937ms 12ms 545.9MB 870ms 47ms ocaml 5.2.1
ocaml 2.ml 1920ms 15ms 17.4MB 1903ms 0ms ocaml 5.2.1
acton 1.act timeout 0.0ms 562.9MB 6753ms 110ms actonc 0.24.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 180ms 2.2ms 142.2MB 163ms 3ms ocaml 5.2.1
ocaml 2.ml 473ms 2.2ms 9.1MB 460ms 0ms ocaml 5.2.1
acton 1.act 2333ms 30ms 192.4MB 2833ms 50ms actonc 0.24.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 484.9MB 4820ms 163ms ocaml 5.2.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 529ms 6.5ms 57.0MB 487ms 23ms ocaml 5.2.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4476ms 16ms 6.4MB 4463ms 0ms ocaml 5.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1128ms 3.0ms 6.1MB 1117ms 0ms ocaml 5.2.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 286ms 4.4ms 5.2MB 273ms 0ms ocaml 5.2.1