OCaml VS Crystal benchmarks

Current benchmark data was generated on Sat Mar 29 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1256ms 14ms 64.0MB 1233ms 7ms crystal 1.15.1
ocaml 1.ml 3076ms 70ms 157.2MB 2993ms 73ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 104ms 3.0ms 10.9MB 90ms 0ms crystal 1.15.1
ocaml 1.ml 223ms 5.5ms 19.1MB 203ms 3ms ocaml 5.3.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2498ms 7.0ms 2.8MB 2487ms 0ms crystal 1.15.1
ocaml 2.ml 2920ms 14ms 4.9MB 2910ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 207ms 2.8ms 2.9MB 200ms 0ms crystal 1.15.1
ocaml 2.ml 246ms 2.4ms 4.9MB 237ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 347ms 0.6ms 24.8MB 333ms 0ms ocaml 5.3.0
crystal 2.cr 557ms 5.8ms 3.4MB 460ms 77ms crystal 1.15.1
crystal 1.cr 698ms 1.4ms 14.4MB 580ms 107ms crystal 1.15.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.3ms 7.3MB 30ms 0ms ocaml 5.3.0
crystal 2.cr 59ms 0.6ms 3.5MB 43ms 0ms crystal 1.15.1
crystal 1.cr 75ms 1.4ms 4.8MB 53ms 10ms crystal 1.15.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.1ms 5.0MB 0ms 0ms ocaml 5.3.0
crystal 1.cr 2.0ms 0.2ms 2.9MB 0ms 0ms crystal 1.15.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 0.6ms 2.9MB 30ms 0ms crystal 1.15.1
crystal 1.cr 66ms 1.0ms 2.9MB 60ms 0ms crystal 1.15.1
ocaml 1.ml 185ms 5.6ms 6.4MB 173ms 0ms ocaml 5.3.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 100ms 2.3ms 2.9MB 90ms 0ms crystal 1.15.1
crystal 1.cr 186ms 3.7ms 2.9MB 173ms 0ms crystal 1.15.1
ocaml 1.ml 537ms 16ms 6.6MB 527ms 0ms ocaml 5.3.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 0.8ms 2.9MB 10ms 0ms crystal 1.15.1
crystal 1.cr 32ms 1.0ms 2.9MB 20ms 0ms crystal 1.15.1
ocaml 1.ml 76ms 0.7ms 5.9MB 70ms 0ms ocaml 5.3.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 847ms 17ms 64.0MB 823ms 10ms crystal 1.15.1
ocaml 1.ml 1097ms 8.4ms 70.3MB 1057ms 30ms ocaml 5.3.0
ocaml 2.ml 2087ms 30ms 91.7MB 2037ms 33ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 149ms 1.0ms 21.7MB 133ms 7ms ocaml 5.3.0
crystal 1.cr 156ms 3.3ms 22.2MB 140ms 0ms crystal 1.15.1
ocaml 2.ml 362ms 2.4ms 27.7MB 343ms 3ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 343ms 2.0ms 3.1MB 333ms 0ms crystal 1.15.1
crystal 1.cr 345ms 1.8ms 3.1MB 337ms 0ms crystal 1.15.1
ocaml 1.ml 377ms 1.5ms 5.3MB 367ms 0ms ocaml 5.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 38ms 1.2ms 3.1MB 30ms 0ms crystal 1.15.1
crystal 2.cr 39ms 0.8ms 3.1MB 30ms 0ms crystal 1.15.1
ocaml 1.ml 40ms 1.1ms 5.2MB 30ms 0ms ocaml 5.3.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 300ms 2.7ms 8.1MB 290ms 0ms crystal 1.15.1
crystal 1.cr 424ms 4.1ms 42.3MB 413ms 0ms crystal 1.15.1
ocaml 1.ml 961ms 7.1ms 552.4MB 900ms 47ms ocaml 5.3.0
ocaml 2.ml 1888ms 3.0ms 18.9MB 1877ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 77ms 0.8ms 4.4MB 70ms 0ms crystal 1.15.1
crystal 1.cr 94ms 1.2ms 13.0MB 80ms 0ms crystal 1.15.1
ocaml 1.ml 191ms 10ms 142.3MB 167ms 10ms ocaml 5.3.0
ocaml 2.ml 465ms 0.7ms 9.1MB 457ms 0ms ocaml 5.3.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 474.1MB 4813ms 173ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 550ms 3.3ms 57.1MB 517ms 20ms ocaml 5.3.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3796ms 8.8ms 4.4MB 3783ms 0ms crystal 1.15.1
ocaml 2.ml 4568ms 13ms 6.4MB 4557ms 0ms ocaml 5.3.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 955ms 4.2ms 4.3MB 943ms 0ms crystal 1.15.1
ocaml 2.ml 1153ms 6.9ms 6.1MB 1143ms 0ms ocaml 5.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 243ms 3.1ms 3.8MB 233ms 0ms crystal 1.15.1
ocaml 2.ml 290ms 2.8ms 5.2MB 280ms 0ms ocaml 5.3.0