Programming Language and compiler
Benchmarks

Crystal VS Ocaml benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1614ms 6.4ms 64.4MB 1927ms 20ms crystal 1.4.1
ocaml 1.ml 4057ms 12ms 120.4MB 4020ms 17ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 138ms 0.3ms 11.0MB 143ms 0ms crystal 1.4.1
ocaml 1.ml 272ms 1.5ms 17.4MB 257ms 3ms ocaml 4.14.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1979ms 40ms 20.5MB 1940ms 23ms crystal 1.4.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 111ms 1.9ms 7.6MB 97ms 3ms crystal 1.4.1

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 84ms 3.2ms 9.3MB 67ms 3ms crystal 1.4.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 0.3ms 7.0MB 20ms 0ms crystal 1.4.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3816ms 3.5ms 3.0MB 3800ms 0ms crystal 1.4.1
ocaml 2.ml 4187ms 38ms 2.4MB 4173ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 315ms 1.6ms 3.0MB 303ms 0ms crystal 1.4.1
ocaml 2.ml 340ms 2.1ms 2.6MB 330ms 0ms ocaml 4.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.9ms 25.4MB 407ms 0ms ocaml 4.14.0
crystal 2.cr 842ms 6.9ms 3.6MB 683ms 143ms crystal 1.4.1
crystal 1.cr 1030ms 0.5ms 14.8MB 857ms 160ms crystal 1.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 1.2ms 4.8MB 40ms 0ms ocaml 4.14.0
crystal 2.cr 88ms 0.7ms 3.5MB 70ms 10ms crystal 1.4.1
crystal 1.cr 109ms 2.2ms 4.6MB 83ms 13ms crystal 1.4.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 2.3ms 0.7ms 2.6MB 0ms 0ms ocaml 4.14.0
crystal 1.cr 3.0ms 0.6ms 3.0MB 0ms 0ms crystal 1.4.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2833ms 1054ms 131.4MB 303ms 290ms crystal 1.4.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1242ms 112ms 32.7MB 20ms 63ms crystal 1.4.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 63ms 2.1ms 5.0MB 50ms 0ms crystal 1.4.1
crystal 1.cr 108ms 1.8ms 3.0MB 100ms 0ms crystal 1.4.1
ocaml 1.ml 240ms 1.1ms 5.9MB 227ms 0ms ocaml 4.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 175ms 1.0ms 3.0MB 163ms 0ms crystal 1.4.1
crystal 1.cr 313ms 0.4ms 3.1MB 300ms 0ms crystal 1.4.1
ocaml 1.ml 708ms 1.7ms 5.8MB 697ms 0ms ocaml 4.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 32ms 2.1ms 3.1MB 20ms 0ms crystal 1.4.1
crystal 1.cr 55ms 1.2ms 5.1MB 47ms 0ms crystal 1.4.1
ocaml 1.ml 104ms 0.3ms 5.0MB 97ms 0ms ocaml 4.14.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 996ms 1.0ms 9.6MB 980ms 0ms crystal 1.4.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 46ms 0.6ms 5.0MB 33ms 0ms crystal 1.4.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1119ms 48ms 66.2MB 1287ms 13ms crystal 1.4.1
ocaml 1.ml 1528ms 2.4ms 62.6MB 1497ms 17ms ocaml 4.14.0
ocaml 2.ml 2609ms 9.0ms 71.1MB 2577ms 17ms ocaml 4.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 195ms 0.7ms 18.7MB 183ms 3ms ocaml 4.14.0
crystal 1.cr 226ms 4.8ms 19.4MB 250ms 3ms crystal 1.4.1
ocaml 2.ml 437ms 1.6ms 23.6MB 423ms 0ms ocaml 4.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 469ms 0.1ms 2.5MB 460ms 0ms ocaml 4.14.0
crystal 1.cr 510ms 0.8ms 3.1MB 500ms 0ms crystal 1.4.1
crystal 2.cr 540ms 0.7ms 3.1MB 530ms 0ms crystal 1.4.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 49ms 0.2ms 2.5MB 40ms 0ms ocaml 4.14.0
crystal 1.cr 55ms 1.3ms 3.0MB 43ms 0ms crystal 1.4.1
crystal 2.cr 59ms 2.2ms 5.1MB 47ms 0ms crystal 1.4.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 466ms 1.2ms 10.1MB 450ms 0ms crystal 1.4.1
crystal 1.cr 878ms 62ms 44.5MB 853ms 10ms crystal 1.4.1
ocaml 1.ml 2063ms 42ms 554.8MB 1947ms 97ms ocaml 4.14.0
ocaml 2.ml 2282ms 3.9ms 19.6MB 2267ms 0ms ocaml 4.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 108ms 1.9ms 4.4MB 100ms 0ms crystal 1.4.1
crystal 1.cr 147ms 1.5ms 14.8MB 133ms 0ms crystal 1.4.1
ocaml 1.ml 406ms 11ms 142.8MB 370ms 20ms ocaml 4.14.0
ocaml 2.ml 551ms 1.5ms 9.6MB 540ms 0ms ocaml 4.14.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2771ms 83ms 6.8MB 3037ms 267ms crystal 1.4.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 653ms 3.5ms 5.4MB 680ms 73ms crystal 1.4.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.4.1
ocaml 2.ml timeout 0.0ms 0.0MB 0ms 0ms ocaml 4.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1507ms 2.2ms 5.6MB 1497ms 0ms crystal 1.4.1
ocaml 2.ml 1650ms 2.9ms 3.4MB 1637ms 0ms ocaml 4.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 381ms 1.5ms 3.8MB 367ms 0ms crystal 1.4.1
ocaml 2.ml 415ms 0.7ms 3.0MB 403ms 0ms ocaml 4.14.0