Programming Language and compiler
Benchmarks

Crystal VS OCaml benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1390ms 8.4ms 64.3MB 1363ms 7ms crystal 1.14.0
ocaml 1.ml 3047ms 16ms 132.6MB 2977ms 60ms ocaml 5.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 108ms 0.6ms 11.1MB 97ms 0ms crystal 1.14.0
ocaml 1.ml 217ms 3.2ms 19.2MB 200ms 0ms ocaml 5.2.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1318ms 45ms 20.1MB 1233ms 67ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 77ms 1.0ms 7.5MB 50ms 13ms crystal 1.14.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 60ms 2.2ms 6.6MB 40ms 10ms crystal 1.14.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.1ms 5.4MB 10ms 0ms crystal 1.14.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2494ms 6.2ms 3.0MB 2483ms 0ms crystal 1.14.0
ocaml 2.ml 2908ms 3.8ms 4.9MB 2897ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 208ms 2.8ms 3.0MB 197ms 0ms crystal 1.14.0
ocaml 2.ml 245ms 2.2ms 4.9MB 233ms 0ms ocaml 5.2.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 347ms 0.9ms 24.9MB 330ms 0ms ocaml 5.2.1
crystal 2.cr 538ms 2.4ms 3.4MB 420ms 100ms crystal 1.14.0
crystal 1.cr 728ms 1.8ms 14.6MB 590ms 120ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.2ms 7.4MB 27ms 0ms ocaml 5.2.1
crystal 2.cr 59ms 0.9ms 3.4MB 40ms 7ms crystal 1.14.0
crystal 1.cr 76ms 0.1ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.8ms 0.2ms 4.9MB 0ms 0ms ocaml 5.2.1
crystal 1.cr 2.1ms 0.2ms 3.0MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1947ms 461ms 187.1MB 310ms 500ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1158ms 90ms 66.3MB 30ms 90ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 1.4ms 3.1MB 20ms 0ms crystal 1.14.0
crystal 1.cr 63ms 1.1ms 3.1MB 50ms 0ms crystal 1.14.0
ocaml 1.ml 183ms 10ms 6.4MB 170ms 0ms ocaml 5.2.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 99ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 187ms 1.0ms 3.3MB 180ms 0ms crystal 1.14.0
ocaml 1.ml 530ms 20ms 6.6MB 517ms 0ms ocaml 5.2.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 19ms 1.0ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 0.7ms 3.0MB 20ms 0ms crystal 1.14.0
ocaml 1.ml 78ms 2.4ms 5.9MB 67ms 0ms ocaml 5.2.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 313ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 17ms 0.2ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 833ms 8.7ms 81.7MB 817ms 3ms crystal 1.14.0
ocaml 1.ml 1072ms 10ms 70.2MB 1030ms 27ms ocaml 5.2.1
ocaml 2.ml 2064ms 47ms 91.7MB 2007ms 43ms ocaml 5.2.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 150ms 2.7ms 21.6MB 127ms 10ms ocaml 5.2.1
crystal 1.cr 162ms 1.4ms 22.3MB 147ms 0ms crystal 1.14.0
ocaml 2.ml 362ms 1.9ms 27.6MB 337ms 7ms ocaml 5.2.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 343ms 1.1ms 3.4MB 330ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.1ms 3.4MB 330ms 0ms crystal 1.14.0
ocaml 1.ml 374ms 0.9ms 5.2MB 363ms 0ms ocaml 5.2.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 38ms 0.8ms 3.4MB 30ms 0ms crystal 1.14.0
crystal 2.cr 38ms 1.0ms 3.4MB 27ms 0ms crystal 1.14.0
ocaml 1.ml 42ms 1.3ms 5.2MB 30ms 0ms ocaml 5.2.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 349ms 3.6ms 8.3MB 340ms 0ms crystal 1.14.0
crystal 1.cr 386ms 1.2ms 43.1MB 373ms 0ms crystal 1.14.0
ocaml 1.ml 945ms 20ms 551.3MB 877ms 50ms ocaml 5.2.1
ocaml 2.ml 1910ms 4.6ms 18.3MB 1897ms 0ms ocaml 5.2.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 82ms 1.2ms 13.3MB 70ms 0ms crystal 1.14.0
crystal 2.cr 91ms 2.2ms 4.6MB 80ms 0ms crystal 1.14.0
ocaml 1.ml 201ms 5.9ms 142.1MB 173ms 10ms ocaml 5.2.1
ocaml 2.ml 471ms 2.4ms 9.1MB 460ms 0ms ocaml 5.2.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2001ms 73ms 6.4MB 1963ms 20ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 454ms 18ms 5.2MB 440ms 0ms crystal 1.14.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3904ms 21ms 4.6MB 3893ms 0ms crystal 1.14.0
ocaml 2.ml 4487ms 17ms 6.6MB 4477ms 0ms ocaml 5.2.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 979ms 2.1ms 4.3MB 967ms 0ms crystal 1.14.0
ocaml 2.ml 1126ms 6.0ms 5.9MB 1117ms 0ms ocaml 5.2.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 249ms 2.4ms 4.0MB 240ms 0ms crystal 1.14.0
ocaml 2.ml 284ms 2.2ms 5.2MB 270ms 0ms ocaml 5.2.1