Programming Language and compiler
Benchmarks

Crystal VS OCaml benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1788ms 5.5ms 64.4MB 1767ms 10ms crystal 1.9.0
ocaml 1.ml 4948ms 10ms 153.4MB 4887ms 43ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 139ms 2.3ms 11.3MB 127ms 0ms crystal 1.9.0
ocaml 1.ml 341ms 3.5ms 22.9MB 323ms 3ms ocaml 5.0.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1819ms 61ms 20.4MB 1783ms 17ms crystal 1.9.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 97ms 1.5ms 7.7MB 77ms 10ms crystal 1.9.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 80ms 0.7ms 7.2MB 63ms 7ms crystal 1.9.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 29ms 0.7ms 5.4MB 17ms 3ms crystal 1.9.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3629ms 9.7ms 2.9MB 3617ms 0ms crystal 1.9.0
ocaml 2.ml 3984ms 14ms 2.8MB 3973ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 298ms 0.3ms 3.0MB 290ms 0ms crystal 1.9.0
ocaml 2.ml 331ms 1.3ms 2.9MB 320ms 0ms ocaml 5.0.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 425ms 0.3ms 22.7MB 407ms 3ms ocaml 5.0.0
crystal 2.cr 821ms 5.8ms 3.3MB 710ms 93ms crystal 1.9.0
crystal 1.cr 1041ms 2.4ms 14.8MB 917ms 107ms crystal 1.9.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 47ms 2.4ms 4.9MB 37ms 0ms ocaml 5.0.0
crystal 2.cr 85ms 0.7ms 3.4MB 73ms 0ms crystal 1.9.0
crystal 1.cr 108ms 0.1ms 4.7MB 80ms 10ms crystal 1.9.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.3ms 0.5ms 3.0MB 0ms 0ms crystal 1.9.0
ocaml 1.ml 2.7ms 0.6ms 3.1MB 0ms 0ms ocaml 5.0.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3497ms 61ms 192.3MB 360ms 360ms crystal 1.9.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1284ms 15ms 52.6MB 47ms 50ms crystal 1.9.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 54ms 0.3ms 3.0MB 50ms 0ms crystal 1.9.0
crystal 1.cr 143ms 54ms 3.0MB 130ms 0ms crystal 1.9.0
ocaml 1.ml 264ms 2.8ms 6.7MB 250ms 0ms ocaml 5.0.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 213ms 80ms 3.0MB 193ms 0ms crystal 1.9.0
crystal 1.cr 273ms 1.2ms 3.0MB 263ms 0ms crystal 1.9.0
ocaml 1.ml 781ms 8.1ms 6.7MB 767ms 0ms ocaml 5.0.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 29ms 5.2ms 3.0MB 20ms 0ms crystal 1.9.0
crystal 1.cr 49ms 4.2ms 3.1MB 37ms 0ms crystal 1.9.0
ocaml 1.ml 118ms 1.6ms 6.0MB 110ms 0ms ocaml 5.0.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 585ms 11ms 9.8MB 570ms 0ms crystal 1.9.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 29ms 0.2ms 6.9MB 20ms 0ms crystal 1.9.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1237ms 24ms 64.4MB 1210ms 13ms crystal 1.9.0
ocaml 1.ml 1524ms 6.3ms 69.4MB 1483ms 23ms ocaml 5.0.0
ocaml 2.ml 3227ms 33ms 74.1MB 3187ms 23ms ocaml 5.0.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 226ms 8.6ms 17.5MB 210ms 0ms crystal 1.9.0
ocaml 1.ml 229ms 7.2ms 25.6MB 213ms 3ms ocaml 5.0.0
ocaml 2.ml 576ms 3.7ms 30.2MB 557ms 3ms ocaml 5.0.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 450ms 0.3ms 2.9MB 437ms 0ms crystal 1.9.0
crystal 1.cr 468ms 29ms 3.0MB 457ms 0ms crystal 1.9.0
ocaml 1.ml 470ms 0.5ms 2.9MB 460ms 0ms ocaml 5.0.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 48ms 0.1ms 2.9MB 40ms 0ms crystal 1.9.0
crystal 1.cr 48ms 0.8ms 3.0MB 40ms 0ms crystal 1.9.0
ocaml 1.ml 50ms 0.6ms 2.9MB 40ms 0ms ocaml 5.0.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 458ms 6.2ms 8.0MB 443ms 0ms crystal 1.9.0
crystal 1.cr 604ms 9.8ms 42.6MB 583ms 0ms crystal 1.9.0
ocaml 1.ml 1999ms 32ms 550.5MB 1893ms 87ms ocaml 5.0.0
ocaml 2.ml 2424ms 16ms 19.0MB 2410ms 0ms ocaml 5.0.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 103ms 0.3ms 4.1MB 90ms 0ms crystal 1.9.0
crystal 1.cr 140ms 4.1ms 13.0MB 127ms 0ms crystal 1.9.0
ocaml 1.ml 339ms 11ms 140.3MB 307ms 17ms ocaml 5.0.0
ocaml 2.ml 609ms 28ms 9.1MB 590ms 0ms ocaml 5.0.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2576ms 68ms 6.6MB 2557ms 3ms crystal 1.9.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 583ms 11ms 5.4MB 570ms 0ms crystal 1.9.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr timeout 0.0ms 4.4MB 4983ms 0ms crystal 1.9.0
ocaml 2.ml timeout 0.0ms 4.1MB 4987ms 0ms ocaml 5.0.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1433ms 0.2ms 3.9MB 1423ms 0ms crystal 1.9.0
ocaml 2.ml 1639ms 5.6ms 3.7MB 1623ms 0ms ocaml 5.0.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 364ms 0.3ms 4.0MB 350ms 0ms crystal 1.9.0
ocaml 2.ml 412ms 0.4ms 3.3MB 400ms 0ms ocaml 5.0.0