Programming Language and compiler
Benchmarks

OCaml VS Crystal benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1546ms 11ms 66.3MB 1850ms 13ms crystal 1.5.1
ocaml 1.ml 3974ms 21ms 120.8MB 3930ms 23ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 131ms 2.0ms 13.1MB 133ms 7ms crystal 1.5.1
ocaml 1.ml 268ms 4.6ms 17.4MB 253ms 0ms ocaml 4.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 3925ms 2.1ms 2.6MB 3910ms 0ms ocaml 4.14.0
crystal 1.cr 3970ms 3.9ms 5.0MB 3960ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 322ms 2.7ms 3.0MB 310ms 0ms crystal 1.5.1
ocaml 2.ml 328ms 2.0ms 2.6MB 320ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 423ms 0.6ms 24.5MB 410ms 0ms ocaml 4.14.0
crystal 2.cr 860ms 0.3ms 3.5MB 740ms 107ms crystal 1.5.1
crystal 1.cr 1054ms 0.6ms 14.7MB 907ms 133ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 49ms 2.6ms 6.0MB 33ms 0ms ocaml 4.14.0
crystal 2.cr 91ms 1.0ms 5.2MB 67ms 7ms crystal 1.5.1
crystal 1.cr 111ms 1.8ms 6.5MB 97ms 3ms crystal 1.5.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.2ms 0.6ms 2.6MB 0ms 0ms ocaml 4.14.0
crystal 1.cr 3.5ms 0.7ms 3.2MB 0ms 0ms crystal 1.5.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 62ms 1.9ms 4.9MB 50ms 0ms crystal 1.5.1
crystal 1.cr 107ms 1.7ms 3.1MB 100ms 0ms crystal 1.5.1
ocaml 1.ml 238ms 0.6ms 5.9MB 227ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 174ms 1.4ms 5.1MB 160ms 0ms crystal 1.5.1
crystal 1.cr 314ms 2.6ms 3.1MB 300ms 0ms crystal 1.5.1
ocaml 1.ml 708ms 0.9ms 5.9MB 697ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 31ms 0.6ms 4.9MB 20ms 0ms crystal 1.5.1
crystal 1.cr 53ms 0.6ms 3.1MB 47ms 0ms crystal 1.5.1
ocaml 1.ml 104ms 0.6ms 5.0MB 90ms 0ms ocaml 4.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1021ms 28ms 64.4MB 1143ms 27ms crystal 1.5.1
ocaml 1.ml 1490ms 8.9ms 62.6MB 1450ms 23ms ocaml 4.14.0
ocaml 2.ml 2549ms 8.8ms 71.5MB 2527ms 7ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 188ms 0.6ms 18.6MB 173ms 0ms ocaml 4.14.0
crystal 1.cr 197ms 2.5ms 17.7MB 210ms 3ms crystal 1.5.1
ocaml 2.ml 426ms 1.7ms 23.5MB 407ms 7ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 469ms 0.4ms 2.6MB 457ms 0ms ocaml 4.14.0
crystal 1.cr 509ms 0.5ms 4.9MB 500ms 0ms crystal 1.5.1
crystal 2.cr 540ms 0.8ms 3.0MB 530ms 0ms crystal 1.5.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 51ms 3.2ms 2.4MB 40ms 0ms ocaml 4.14.0
crystal 1.cr 56ms 1.9ms 4.9MB 43ms 0ms crystal 1.5.1
crystal 2.cr 60ms 0.4ms 4.8MB 47ms 0ms crystal 1.5.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 470ms 6.4ms 8.1MB 457ms 0ms crystal 1.5.1
crystal 1.cr 748ms 29ms 42.2MB 727ms 0ms crystal 1.5.1
ocaml 1.ml 2004ms 26ms 555.9MB 1887ms 103ms ocaml 4.14.0
ocaml 2.ml 2262ms 1.0ms 20.1MB 2250ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 111ms 1.8ms 6.3MB 97ms 3ms crystal 1.5.1
crystal 1.cr 155ms 0.2ms 12.9MB 143ms 0ms crystal 1.5.1
ocaml 1.ml 380ms 3.5ms 142.3MB 347ms 13ms ocaml 4.14.0
ocaml 2.ml 548ms 0.4ms 8.4MB 537ms 0ms ocaml 4.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2462ms 7.1ms 194.3MB 2383ms 60ms crystal 1.5.1
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 253ms 0.8ms 22.8MB 233ms 7ms crystal 1.5.1
ocaml 2.ml 682ms 4.2ms 50.9MB 653ms 13ms ocaml 4.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1504ms 0.6ms 4.1MB 1490ms 3ms crystal 1.5.1
ocaml 2.ml 1647ms 1.4ms 3.4MB 1640ms 0ms ocaml 4.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 382ms 2.0ms 5.6MB 370ms 0ms crystal 1.5.1
ocaml 2.ml 415ms 0.4ms 3.5MB 403ms 0ms ocaml 4.14.0