Programming Language and compiler
Benchmarks

Crystal VS OCaml benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1357ms 14ms 64.3MB 1337ms 10ms crystal 1.14.0
ocaml 1.ml 3001ms 12ms 157.2MB 2907ms 80ms ocaml 5.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 3.0ms 11.1MB 93ms 0ms crystal 1.14.0
ocaml 1.ml 214ms 0.7ms 19.2MB 193ms 7ms ocaml 5.2.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1420ms 28ms 20.1MB 1340ms 63ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 78ms 1.8ms 7.5MB 50ms 10ms crystal 1.14.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 59ms 1.0ms 6.6MB 43ms 0ms crystal 1.14.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.5ms 5.4MB 10ms 0ms crystal 1.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2479ms 10ms 3.0MB 2467ms 0ms crystal 1.14.0
ocaml 2.ml 2922ms 17ms 5.0MB 2910ms 0ms ocaml 5.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 206ms 2.2ms 3.0MB 190ms 0ms crystal 1.14.0
ocaml 2.ml 246ms 1.5ms 5.0MB 233ms 0ms ocaml 5.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 346ms 0.5ms 24.9MB 333ms 0ms ocaml 5.2.0
crystal 2.cr 539ms 2.5ms 3.4MB 407ms 113ms crystal 1.14.0
crystal 1.cr 727ms 0.8ms 14.7MB 597ms 120ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.9ms 7.3MB 27ms 0ms ocaml 5.2.0
crystal 2.cr 59ms 1.6ms 3.4MB 40ms 3ms crystal 1.14.0
crystal 1.cr 77ms 1.6ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.8ms 0.1ms 5.0MB 0ms 0ms ocaml 5.2.0
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2213ms 195ms 186.4MB 290ms 500ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1222ms 100ms 53.8MB 27ms 83ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 0.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 65ms 0.9ms 3.1MB 53ms 0ms crystal 1.14.0
ocaml 1.ml 180ms 5.6ms 6.5MB 167ms 0ms ocaml 5.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 100ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 183ms 1.6ms 3.1MB 170ms 0ms crystal 1.14.0
ocaml 1.ml 522ms 18ms 6.6MB 510ms 0ms ocaml 5.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 19ms 1.1ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 1.0ms 3.0MB 20ms 0ms crystal 1.14.0
ocaml 1.ml 75ms 0.7ms 6.0MB 70ms 0ms ocaml 5.2.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 804ms 11ms 81.7MB 773ms 13ms crystal 1.14.0
ocaml 1.ml 1126ms 31ms 71.0MB 1087ms 20ms ocaml 5.2.0
ocaml 2.ml 2098ms 41ms 91.9MB 2040ms 40ms ocaml 5.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 154ms 0.1ms 21.6MB 140ms 0ms ocaml 5.2.0
crystal 1.cr 160ms 0.7ms 22.4MB 140ms 3ms crystal 1.14.0
ocaml 2.ml 368ms 8.4ms 27.6MB 347ms 7ms ocaml 5.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 342ms 2.6ms 3.4MB 327ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.9ms 3.4MB 333ms 0ms crystal 1.14.0
ocaml 1.ml 372ms 3.2ms 5.3MB 363ms 0ms ocaml 5.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 38ms 0.2ms 3.4MB 27ms 0ms crystal 1.14.0
crystal 2.cr 39ms 0.3ms 3.4MB 30ms 0ms crystal 1.14.0
ocaml 1.ml 40ms 0.1ms 5.3MB 30ms 0ms ocaml 5.2.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 351ms 1.7ms 8.4MB 340ms 0ms crystal 1.14.0
crystal 1.cr 373ms 4.3ms 43.0MB 357ms 0ms crystal 1.14.0
ocaml 1.ml 975ms 2.8ms 552.4MB 910ms 50ms ocaml 5.2.0
ocaml 2.ml 1932ms 30ms 17.2MB 1920ms 0ms ocaml 5.2.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 79ms 1.1ms 13.3MB 70ms 0ms crystal 1.14.0
crystal 2.cr 87ms 1.7ms 4.6MB 80ms 0ms crystal 1.14.0
ocaml 1.ml 193ms 2.0ms 142.3MB 170ms 10ms ocaml 5.2.0
ocaml 2.ml 478ms 6.0ms 9.1MB 463ms 0ms ocaml 5.2.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2001ms 13ms 6.4MB 1953ms 30ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 451ms 17ms 5.2MB 433ms 0ms crystal 1.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3898ms 25ms 4.6MB 3887ms 0ms crystal 1.14.0
ocaml 2.ml 4482ms 6.4ms 6.4MB 4473ms 0ms ocaml 5.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 981ms 2.7ms 4.5MB 967ms 0ms crystal 1.14.0
ocaml 2.ml 1129ms 4.1ms 6.1MB 1117ms 0ms ocaml 5.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 251ms 3.2ms 4.0MB 240ms 0ms crystal 1.14.0
ocaml 2.ml 285ms 4.6ms 5.2MB 273ms 0ms ocaml 5.2.0