Programming Language and compiler
Benchmarks

Crystal VS OCaml benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1316ms 80ms 64.1MB 1290ms 10ms crystal 1.15.0
ocaml 1.ml 2977ms 13ms 132.6MB 2900ms 60ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 9.3ms 10.9MB 100ms 0ms crystal 1.15.0
ocaml 1.ml 214ms 3.1ms 19.2MB 197ms 3ms ocaml 5.3.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1367ms 11ms 19.8MB 1300ms 50ms crystal 1.15.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 76ms 1.4ms 7.1MB 57ms 7ms crystal 1.15.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 62ms 1.9ms 6.4MB 43ms 3ms crystal 1.15.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.6ms 5.1MB 10ms 0ms crystal 1.15.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2495ms 6.5ms 2.8MB 2483ms 0ms crystal 1.15.0
ocaml 2.ml 2911ms 3.1ms 4.9MB 2900ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 1.5ms 2.8MB 193ms 0ms crystal 1.15.0
ocaml 2.ml 245ms 4.0ms 4.9MB 233ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 2.4ms 24.9MB 333ms 0ms ocaml 5.3.0
crystal 2.cr 573ms 3.5ms 3.5MB 450ms 107ms crystal 1.15.0
crystal 1.cr 720ms 0.6ms 14.6MB 573ms 127ms crystal 1.15.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.2ms 7.5MB 23ms 0ms ocaml 5.3.0
crystal 2.cr 61ms 1.2ms 3.5MB 43ms 7ms crystal 1.15.0
crystal 1.cr 76ms 0.8ms 4.9MB 53ms 7ms crystal 1.15.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.2ms 5.0MB 0ms 0ms ocaml 5.3.0
crystal 1.cr 1.9ms 0.2ms 2.9MB 0ms 0ms crystal 1.15.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2547ms 222ms 197.7MB 403ms 490ms crystal 1.15.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1102ms 0.9ms 36.6MB 47ms 77ms crystal 1.15.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.0ms 2.9MB 23ms 0ms crystal 1.15.0
crystal 1.cr 65ms 1.7ms 3.0MB 57ms 0ms crystal 1.15.0
ocaml 1.ml 181ms 7.0ms 6.5MB 167ms 0ms ocaml 5.3.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 101ms 1.0ms 2.9MB 90ms 0ms crystal 1.15.0
crystal 1.cr 184ms 2.6ms 2.9MB 170ms 0ms crystal 1.15.0
ocaml 1.ml 540ms 16ms 6.6MB 527ms 0ms ocaml 5.3.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 0.6ms 2.9MB 10ms 0ms crystal 1.15.0
crystal 1.cr 30ms 1.5ms 2.9MB 20ms 0ms crystal 1.15.0
ocaml 1.ml 77ms 0.8ms 6.0MB 63ms 0ms ocaml 5.3.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 3.9ms 9.2MB 303ms 0ms crystal 1.15.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 5.8MB 10ms 0ms crystal 1.15.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 860ms 29ms 64.1MB 830ms 10ms crystal 1.15.0
ocaml 1.ml 1060ms 22ms 71.2MB 1023ms 27ms ocaml 5.3.0
ocaml 2.ml 2025ms 10ms 91.8MB 1973ms 37ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 148ms 2.0ms 21.6MB 133ms 0ms ocaml 5.3.0
crystal 1.cr 178ms 4.4ms 22.0MB 160ms 3ms crystal 1.15.0
ocaml 2.ml 352ms 1.6ms 27.7MB 327ms 7ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 2.4ms 3.3MB 330ms 0ms crystal 1.15.0
crystal 2.cr 342ms 1.6ms 3.3MB 330ms 0ms crystal 1.15.0
ocaml 1.ml 373ms 4.8ms 5.3MB 363ms 0ms ocaml 5.3.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.7ms 3.3MB 23ms 0ms crystal 1.15.0
crystal 1.cr 38ms 1.4ms 3.3MB 30ms 0ms crystal 1.15.0
ocaml 1.ml 40ms 0.1ms 5.3MB 30ms 0ms ocaml 5.3.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 299ms 3.7ms 8.2MB 287ms 0ms crystal 1.15.0
crystal 1.cr 419ms 1.3ms 42.8MB 403ms 0ms crystal 1.15.0
ocaml 1.ml 914ms 6.3ms 552.5MB 853ms 43ms ocaml 5.3.0
ocaml 2.ml 1875ms 8.7ms 18.6MB 1857ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 75ms 1.4ms 4.4MB 67ms 0ms crystal 1.15.0
crystal 1.cr 89ms 2.6ms 13.0MB 77ms 0ms crystal 1.15.0
ocaml 1.ml 176ms 3.5ms 142.3MB 153ms 7ms ocaml 5.3.0
ocaml 2.ml 466ms 4.9ms 9.1MB 453ms 0ms ocaml 5.3.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1907ms 10ms 6.2MB 1877ms 13ms crystal 1.15.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 449ms 18ms 5.1MB 430ms 0ms crystal 1.15.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3801ms 27ms 4.4MB 3787ms 0ms crystal 1.15.0
ocaml 2.ml 4564ms 17ms 6.3MB 4553ms 0ms ocaml 5.3.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 955ms 2.5ms 4.3MB 943ms 0ms crystal 1.15.0
ocaml 2.ml 1141ms 5.8ms 6.1MB 1130ms 0ms ocaml 5.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 245ms 2.9ms 3.8MB 237ms 0ms crystal 1.15.0
ocaml 2.ml 292ms 4.1ms 5.3MB 283ms 0ms ocaml 5.3.0