OCaml VS Crystal benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1235ms 5.9ms 64.2MB 1210ms 10ms crystal 1.16.2
ocaml 1.ml 3316ms 13ms 157.1MB 3237ms 67ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 107ms 1.5ms 11.0MB 93ms 0ms crystal 1.16.2
ocaml 1.ml 247ms 3.4ms 19.1MB 233ms 0ms ocaml 5.3.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2480ms 8.8ms 2.9MB 2470ms 0ms crystal 1.16.2
ocaml 2.ml 2912ms 1.6ms 4.9MB 2900ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 206ms 3.4ms 2.9MB 197ms 0ms crystal 1.16.2
ocaml 2.ml 244ms 1.2ms 4.9MB 237ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 1.2ms 24.8MB 330ms 0ms ocaml 5.3.0
crystal 2.cr 550ms 2.8ms 3.5MB 447ms 90ms crystal 1.16.2
crystal 1.cr 694ms 0.9ms 14.6MB 577ms 103ms crystal 1.16.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.9ms 7.5MB 30ms 0ms ocaml 5.3.0
crystal 2.cr 58ms 0.8ms 3.6MB 40ms 3ms crystal 1.16.2
crystal 1.cr 75ms 0.4ms 4.9MB 50ms 10ms crystal 1.16.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.7ms 0.2ms 5.0MB 0ms 0ms ocaml 5.3.0
crystal 1.cr 1.9ms 0.1ms 2.9MB 0ms 0ms crystal 1.16.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 0.6ms 3.0MB 30ms 0ms crystal 1.16.2
crystal 1.cr 65ms 1.4ms 3.0MB 57ms 0ms crystal 1.16.2
ocaml 1.ml 180ms 3.9ms 6.4MB 167ms 0ms ocaml 5.3.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 99ms 0.9ms 3.0MB 90ms 0ms crystal 1.16.2
crystal 1.cr 187ms 2.0ms 3.0MB 180ms 0ms crystal 1.16.2
ocaml 1.ml 539ms 20ms 6.6MB 530ms 0ms ocaml 5.3.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 17ms 0.3ms 3.0MB 10ms 0ms crystal 1.16.2
crystal 1.cr 30ms 1.3ms 3.0MB 20ms 0ms crystal 1.16.2
ocaml 1.ml 77ms 1.5ms 5.9MB 70ms 0ms ocaml 5.3.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 846ms 6.4ms 64.2MB 823ms 10ms crystal 1.16.2
ocaml 1.ml 1072ms 7.8ms 70.2MB 1030ms 23ms ocaml 5.3.0
ocaml 2.ml 2063ms 33ms 91.7MB 2003ms 47ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 144ms 1.3ms 21.6MB 130ms 3ms ocaml 5.3.0
crystal 1.cr 175ms 0.8ms 22.2MB 160ms 0ms crystal 1.16.2
ocaml 2.ml 352ms 1.6ms 27.7MB 333ms 7ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 343ms 0.7ms 3.3MB 330ms 0ms crystal 1.16.2
crystal 2.cr 344ms 2.9ms 3.3MB 333ms 0ms crystal 1.16.2
ocaml 1.ml 372ms 2.6ms 5.2MB 363ms 0ms ocaml 5.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.5ms 3.3MB 30ms 0ms crystal 1.16.2
crystal 1.cr 38ms 1.1ms 3.3MB 30ms 0ms crystal 1.16.2
ocaml 1.ml 40ms 0.0ms 5.3MB 30ms 0ms ocaml 5.3.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 348ms 4.1ms 8.3MB 340ms 0ms crystal 1.16.2
crystal 1.cr 427ms 4.1ms 43.0MB 413ms 0ms crystal 1.16.2
ocaml 1.ml 955ms 5.3ms 552.0MB 893ms 43ms ocaml 5.3.0
ocaml 2.ml 1880ms 9.6ms 17.1MB 1867ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 88ms 2.4ms 4.5MB 80ms 0ms crystal 1.16.2
crystal 1.cr 89ms 0.3ms 13.2MB 80ms 0ms crystal 1.16.2
ocaml 1.ml 185ms 5.7ms 139.6MB 163ms 10ms ocaml 5.3.0
ocaml 2.ml 469ms 4.3ms 9.1MB 457ms 0ms ocaml 5.3.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 462.8MB 4817ms 170ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 547ms 3.7ms 57.1MB 510ms 23ms ocaml 5.3.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3764ms 9.2ms 4.6MB 3750ms 0ms crystal 1.16.2
ocaml 2.ml 4563ms 8.7ms 6.4MB 4553ms 0ms ocaml 5.3.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 950ms 8.9ms 4.4MB 940ms 0ms crystal 1.16.2
ocaml 2.ml 1146ms 6.2ms 6.1MB 1137ms 0ms ocaml 5.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 241ms 2.8ms 3.9MB 230ms 0ms crystal 1.16.2
ocaml 2.ml 293ms 2.5ms 5.2MB 283ms 0ms ocaml 5.3.0