Programming Language and compiler
Benchmarks

OCaml VS Crystal benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1788ms 5.5ms 64.4MB 1767ms 10ms crystal 1.9.0
ocaml 1.ml 4948ms 10ms 153.4MB 4887ms 43ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 139ms 2.3ms 11.3MB 127ms 0ms crystal 1.9.0
ocaml 1.ml 341ms 3.5ms 22.9MB 323ms 3ms ocaml 5.0.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3629ms 9.7ms 2.9MB 3617ms 0ms crystal 1.9.0
ocaml 2.ml 3984ms 14ms 2.8MB 3973ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 298ms 0.3ms 3.0MB 290ms 0ms crystal 1.9.0
ocaml 2.ml 331ms 1.3ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.3ms 22.7MB 407ms 3ms ocaml 5.0.0
crystal 2.cr 821ms 5.8ms 3.3MB 710ms 93ms crystal 1.9.0
crystal 1.cr 1041ms 2.4ms 14.8MB 917ms 107ms crystal 1.9.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.4ms 4.9MB 37ms 0ms ocaml 5.0.0
crystal 2.cr 85ms 0.7ms 3.4MB 73ms 0ms crystal 1.9.0
crystal 1.cr 108ms 0.1ms 4.7MB 80ms 10ms crystal 1.9.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.3ms 0.5ms 3.0MB 0ms 0ms crystal 1.9.0
ocaml 1.ml 2.7ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 54ms 0.3ms 3.0MB 50ms 0ms crystal 1.9.0
crystal 1.cr 143ms 54ms 3.0MB 130ms 0ms crystal 1.9.0
ocaml 1.ml 264ms 2.8ms 6.7MB 250ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 213ms 80ms 3.0MB 193ms 0ms crystal 1.9.0
crystal 1.cr 273ms 1.2ms 3.0MB 263ms 0ms crystal 1.9.0
ocaml 1.ml 781ms 8.1ms 6.7MB 767ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 29ms 5.2ms 3.0MB 20ms 0ms crystal 1.9.0
crystal 1.cr 49ms 4.2ms 3.1MB 37ms 0ms crystal 1.9.0
ocaml 1.ml 118ms 1.6ms 6.0MB 110ms 0ms ocaml 5.0.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1237ms 24ms 64.4MB 1210ms 13ms crystal 1.9.0
ocaml 1.ml 1524ms 6.3ms 69.4MB 1483ms 23ms ocaml 5.0.0
ocaml 2.ml 3227ms 33ms 74.1MB 3187ms 23ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 226ms 8.6ms 17.5MB 210ms 0ms crystal 1.9.0
ocaml 1.ml 229ms 7.2ms 25.6MB 213ms 3ms ocaml 5.0.0
ocaml 2.ml 576ms 3.7ms 30.2MB 557ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 450ms 0.3ms 2.9MB 437ms 0ms crystal 1.9.0
crystal 1.cr 468ms 29ms 3.0MB 457ms 0ms crystal 1.9.0
ocaml 1.ml 470ms 0.5ms 2.9MB 460ms 0ms ocaml 5.0.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 48ms 0.1ms 2.9MB 40ms 0ms crystal 1.9.0
crystal 1.cr 48ms 0.8ms 3.0MB 40ms 0ms crystal 1.9.0
ocaml 1.ml 50ms 0.6ms 2.9MB 40ms 0ms ocaml 5.0.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 458ms 6.2ms 8.0MB 443ms 0ms crystal 1.9.0
crystal 1.cr 604ms 9.8ms 42.6MB 583ms 0ms crystal 1.9.0
ocaml 1.ml 1999ms 32ms 550.5MB 1893ms 87ms ocaml 5.0.0
ocaml 2.ml 2424ms 16ms 19.0MB 2410ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 103ms 0.3ms 4.1MB 90ms 0ms crystal 1.9.0
crystal 1.cr 140ms 4.1ms 13.0MB 127ms 0ms crystal 1.9.0
ocaml 1.ml 339ms 11ms 140.3MB 307ms 17ms ocaml 5.0.0
ocaml 2.ml 609ms 28ms 9.1MB 590ms 0ms ocaml 5.0.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml timeout 0.0ms 181.9MB 4927ms 47ms ocaml 5.0.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 705ms 2.8ms 52.5MB 683ms 10ms ocaml 5.0.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr timeout 0.0ms 4.4MB 4983ms 0ms crystal 1.9.0
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1433ms 0.2ms 3.9MB 1423ms 0ms crystal 1.9.0
ocaml 2.ml 1639ms 5.6ms 3.7MB 1623ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 364ms 0.3ms 4.0MB 350ms 0ms crystal 1.9.0
ocaml 2.ml 412ms 0.4ms 3.3MB 400ms 0ms ocaml 5.0.0