C++ VS OCaml benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 383ms 1.6ms 4.7MB 1463ms 0ms g++ 11.4.0
cpp 1-im.cpp 396ms 27ms 8.0MB 1473ms 3ms clang++ 14.0.0-1ubuntu1.1
ocaml 2.ml 2795ms 29ms 4.9MB 2783ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 40ms 0.7ms 7.9MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1-im.cpp 40ms 0.7ms 4.5MB 133ms 0ms g++ 11.4.0
ocaml 2.ml 234ms 2.1ms 4.9MB 223ms 0ms ocaml 5.2.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.0ms 0.1ms 1.4MB 0ms 0ms g++ 11.4.0
ocaml 1.ml 1.7ms 0.2ms 4.9MB 0ms 0ms ocaml 5.2.1
cpp 1.cpp 1.8ms 1.0ms 2.1MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 158ms 1.3ms 1.5MB 150ms 0ms g++ 11.4.0
cpp 0-i.cpp 168ms 2.5ms 2.3MB 160ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 294ms 0.7ms 1.8MB 280ms 0ms g++ 11.4.0
cpp 1.cpp 298ms 3.2ms 2.3MB 287ms 0ms clang++ 14.0.0-1ubuntu1.1
ocaml 1.ml 351ms 2.4ms 5.2MB 340ms 0ms ocaml 5.2.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 17ms 0.2ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 18ms 0.1ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 32ms 0.4ms 1.8MB 20ms 0ms g++ 11.4.0
cpp 1.cpp 33ms 0.7ms 2.3MB 23ms 0ms clang++ 14.0.0-1ubuntu1.1
ocaml 1.ml 40ms 1.6ms 5.2MB 30ms 0ms ocaml 5.2.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 463ms 15ms 7.3MB 447ms 0ms g++ 11.4.0
cpp 1.cpp 499ms 2.6ms 7.7MB 487ms 0ms clang++ 14.0.0-1ubuntu1.1
ocaml 1.ml 887ms 4.5ms 550.8MB 827ms 43ms ocaml 5.2.1
ocaml 2.ml 1822ms 17ms 18.6MB 1810ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 113ms 2.5ms 3.6MB 100ms 0ms g++ 11.4.0
cpp 1.cpp 125ms 0.9ms 4.0MB 113ms 0ms clang++ 14.0.0-1ubuntu1.1
ocaml 1.ml 171ms 3.0ms 142.3MB 147ms 10ms ocaml 5.2.1
ocaml 2.ml 451ms 8.0ms 9.1MB 437ms 0ms ocaml 5.2.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 458ms 3.4ms 4.2MB 1780ms 0ms g++ 11.4.0
cpp 8-m.cpp 459ms 22ms 7.3MB 1757ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 876ms 7.8ms 7.4MB 3420ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 885ms 20ms 4.2MB 3437ms 3ms g++ 11.4.0
ocaml 2.ml 4270ms 34ms 6.3MB 4260ms 0ms ocaml 5.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 118ms 1.8ms 7.4MB 433ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 126ms 5.2ms 4.1MB 463ms 0ms g++ 11.4.0
cpp 6-im.cpp 225ms 2.6ms 7.4MB 847ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 226ms 2.7ms 4.1MB 857ms 0ms g++ 11.4.0
ocaml 2.ml 1068ms 1.5ms 5.9MB 1057ms 0ms ocaml 5.2.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 37ms 0.9ms 4.0MB 117ms 0ms g++ 11.4.0
cpp 8-m.cpp 42ms 11ms 7.4MB 117ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 64ms 1.6ms 7.3MB 210ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 64ms 0.1ms 4.0MB 227ms 0ms g++ 11.4.0
ocaml 2.ml 269ms 1.8ms 5.2MB 257ms 0ms ocaml 5.2.1