OCaml VS Dart benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 1234ms 8.4ms 86.2MB 1207ms 33ms dart/exe 2.19.1
dart 1.dart 1267ms 28ms 88.1MB 1227ms 43ms dart/exe 3.0.0-187.0.dev
ocaml 1.ml timeout 0.0ms 153.6MB 4920ms 60ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 113ms 2.2ms 47.9MB 80ms 23ms dart/exe 2.19.1
dart 1.dart 117ms 2.7ms 47.5MB 93ms 17ms dart/exe 3.0.0-187.0.dev
ocaml 1.ml 350ms 6.3ms 22.9MB 330ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3637ms 1.5ms 2.8MB 3623ms 0ms ocaml 5.0.0
dart 2.dart 4275ms 2.1ms 13.6MB 4263ms 0ms dart/exe 2.19.1
dart 2.dart 4701ms 1.9ms 13.9MB 4683ms 0ms dart/exe 3.0.0-187.0.dev

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 303ms 0.6ms 2.8MB 290ms 0ms ocaml 5.0.0
dart 2.dart 347ms 1.2ms 12.1MB 330ms 0ms dart/exe 2.19.1
dart 2.dart 380ms 1.0ms 12.0MB 363ms 0ms dart/exe 3.0.0-187.0.dev

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 378ms 0.3ms 22.6MB 360ms 10ms ocaml 5.0.0
dart 1.dart 485ms 0.5ms 14.7MB 470ms 0ms dart/exe 3.0.0-187.0.dev
dart 1.dart 524ms 1.4ms 14.1MB 503ms 0ms dart/exe 2.19.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 42ms 1.1ms 5.0MB 30ms 0ms ocaml 5.0.0
dart 1.dart 60ms 0.5ms 14.9MB 47ms 0ms dart/exe 3.0.0-187.0.dev
dart 1.dart 65ms 1.6ms 16.4MB 50ms 0ms dart/exe 2.19.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.3ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0
dart 1.dart 8.0ms 0.2ms 11.4MB 0ms 0ms dart/exe 3.0.0-187.0.dev
dart 1.dart 608ms 548ms 12.1MB 0ms 0ms dart/exe 2.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 236ms 1.7ms 15.3MB 223ms 0ms dart/exe 3.0.0-187.0.dev
dart 2.dart 237ms 1.2ms 17.0MB 213ms 7ms dart/exe 2.19.1
ocaml 1.ml 245ms 1.5ms 6.8MB 233ms 0ms ocaml 5.0.0
dart 1.dart 1064ms 2.3ms 14.7MB 1040ms 10ms dart/exe 2.19.1
dart 1.dart 1077ms 0.2ms 16.5MB 1053ms 7ms dart/exe 3.0.0-187.0.dev

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 2.dart 678ms 1.6ms 16.8MB 657ms 3ms dart/exe 3.0.0-187.0.dev
dart 2.dart 683ms 13ms 14.2MB 663ms 3ms dart/exe 2.19.1
ocaml 1.ml 724ms 1.7ms 6.8MB 710ms 0ms ocaml 5.0.0
dart 1.dart 3168ms 4.6ms 16.4MB 3147ms 7ms dart/exe 2.19.1
dart 1.dart 3209ms 4.6ms 14.7MB 3193ms 7ms dart/exe 3.0.0-187.0.dev

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 109ms 0.3ms 6.0MB 97ms 0ms ocaml 5.0.0
dart 2.dart 111ms 1.9ms 14.8MB 93ms 0ms dart/exe 2.19.1
dart 2.dart 113ms 2.6ms 14.7MB 93ms 7ms dart/exe 3.0.0-187.0.dev
dart 1.dart 183ms 2.2ms 14.9MB 163ms 0ms dart/exe 2.19.1
dart 1.dart 187ms 2.7ms 16.3MB 170ms 3ms dart/exe 3.0.0-187.0.dev

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 533ms 7.8ms 68.6MB 510ms 20ms dart/exe 2.19.1
dart 1.dart 612ms 5.3ms 70.8MB 590ms 27ms dart/exe 3.0.0-187.0.dev
ocaml 1.ml 1777ms 7.9ms 69.3MB 1723ms 40ms ocaml 5.0.0
ocaml 2.ml 3374ms 15ms 74.1MB 3323ms 33ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 134ms 3.3ms 48.7MB 103ms 20ms dart/exe 2.19.1
dart 1.dart 145ms 1.2ms 48.7MB 113ms 20ms dart/exe 3.0.0-187.0.dev
ocaml 1.ml 265ms 3.9ms 25.8MB 240ms 10ms ocaml 5.0.0
ocaml 2.ml 589ms 2.0ms 30.3MB 567ms 7ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 538ms 4.0ms 3.0MB 520ms 0ms ocaml 5.0.0
dart 3.dart 620ms 1.1ms 13.8MB 603ms 0ms dart/exe 3.0.0-187.0.dev
dart 3.dart 621ms 2.4ms 13.6MB 603ms 0ms dart/exe 2.19.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 58ms 0.3ms 2.9MB 50ms 0ms ocaml 5.0.0
dart 3.dart 72ms 1.9ms 12.0MB 60ms 0ms dart/exe 2.19.1
dart 3.dart 75ms 0.9ms 11.6MB 57ms 0ms dart/exe 3.0.0-187.0.dev

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2639ms 6.0ms 550.4MB 2483ms 137ms ocaml 5.0.0
ocaml 2.ml 2827ms 181ms 19.0MB 2810ms 3ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 576ms 3.3ms 140.3MB 530ms 27ms ocaml 5.0.0
ocaml 2.ml 640ms 3.5ms 9.1MB 627ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart timeout 0.0ms 162.2MB 4923ms 57ms dart/exe 2.19.1
dart 1.dart timeout 0.0ms 156.0MB 4923ms 53ms dart/exe 3.0.0-187.0.dev
ocaml 2.ml timeout 0.0ms 194.3MB 4887ms 90ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 702ms 1.5ms 55.9MB 667ms 20ms dart/exe 3.0.0-187.0.dev
dart 1.dart 709ms 1.6ms 53.6MB 677ms 20ms dart/exe 2.19.1
ocaml 2.ml 709ms 2.1ms 52.5MB 667ms 23ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 4806ms 5.2ms 11.6MB 4790ms 0ms dart/exe 3.0.0-187.0.dev
dart 1.dart timeout 0.0ms 11.4MB 4980ms 0ms dart/exe 2.19.1
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 1207ms 2.7ms 13.8MB 1193ms 0ms dart/exe 3.0.0-187.0.dev
dart 1.dart 1407ms 1.5ms 14.2MB 1390ms 0ms dart/exe 2.19.1
ocaml 2.ml 1550ms 13ms 3.6MB 1537ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
dart 1.dart 312ms 2.6ms 14.0MB 297ms 3ms dart/exe 3.0.0-187.0.dev
dart 1.dart 362ms 3.3ms 13.8MB 340ms 0ms dart/exe 2.19.1
ocaml 2.ml 390ms 0.4ms 3.4MB 380ms 0ms ocaml 5.0.0