Programming Language and compiler
Benchmarks

Crystal VS Zig benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1267ms 4.6ms 64.3MB 1247ms 7ms crystal 1.14.0
zig 1.zig 1616ms 20ms 49.1MB 1590ms 10ms zig 0.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 102ms 0.9ms 11.1MB 90ms 0ms crystal 1.14.0
zig 1.zig 142ms 0.5ms 7.1MB 130ms 0ms zig 0.13.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1297ms 25ms 20.1MB 1213ms 63ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 69ms 2.7ms 7.5MB 47ms 10ms crystal 1.14.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 58ms 2.4ms 6.6MB 37ms 7ms crystal 1.14.0
zig 1.zig 2162ms 6.9ms 2.5MB 2130ms 13ms zig 0.13.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 21ms 0.3ms 5.4MB 10ms 0ms crystal 1.14.0
zig 1.zig 368ms 1.2ms 1.9MB 347ms 10ms zig 0.13.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 614ms 3.4ms 3.6MB 2297ms 3ms zig 0.13.0
zig 3-i.zig 1689ms 4.7ms 1.1MB 1680ms 0ms zig 0.13.0
zig 2.zig 2336ms 14ms 1.1MB 2327ms 0ms zig 0.13.0
crystal 1.cr 2357ms 18ms 3.0MB 2343ms 0ms crystal 1.14.0
zig 1.zig 2710ms 6.9ms 1.1MB 2700ms 0ms zig 0.13.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 60ms 2.7ms 3.5MB 183ms 0ms zig 0.13.0
zig 3-i.zig 142ms 1.7ms 1.1MB 130ms 0ms zig 0.13.0
zig 2.zig 190ms 3.5ms 1.1MB 180ms 0ms zig 0.13.0
crystal 1.cr 195ms 0.7ms 3.0MB 190ms 0ms crystal 1.14.0
zig 1.zig 227ms 2.4ms 1.1MB 220ms 0ms zig 0.13.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 81ms 0.5ms 1.1MB 70ms 0ms zig 0.13.0
crystal 2.cr 515ms 7.3ms 3.4MB 413ms 90ms crystal 1.14.0
crystal 1.cr 693ms 6.0ms 14.7MB 553ms 127ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 10ms 0.6ms 1.1MB 0ms 0ms zig 0.13.0
crystal 2.cr 55ms 0.3ms 3.4MB 33ms 10ms crystal 1.14.0
crystal 1.cr 72ms 1.1ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 0.9ms 0.0ms 1.3MB 0ms 0ms zig 0.13.0
crystal 1.cr 2.0ms 0.1ms 3.0MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2050ms 398ms 189.3MB 260ms 487ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1162ms 112ms 53.7MB 40ms 63ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 33ms 1.3ms 2.9MB 23ms 0ms zig 0.13.0
crystal 0-unsafe.cr 35ms 1.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 62ms 2.8ms 3.1MB 50ms 0ms crystal 1.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 90ms 3.0ms 2.9MB 83ms 0ms zig 0.13.0
crystal 0-unsafe.cr 94ms 2.9ms 3.1MB 83ms 0ms crystal 1.14.0
crystal 1.cr 173ms 1.9ms 3.1MB 163ms 0ms crystal 1.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 14ms 0.1ms 1.4MB 10ms 0ms zig 0.13.0
crystal 0-unsafe.cr 17ms 0.4ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 28ms 0.6ms 3.0MB 20ms 0ms crystal 1.14.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 237ms 4.1ms 4.2MB 227ms 0ms zig 0.13.0
crystal 1.cr 300ms 7.0ms 9.2MB 287ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 12ms 0.1ms 1.3MB 0ms 0ms zig 0.13.0
crystal 1.cr 16ms 0.1ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 756ms 9.3ms 81.6MB 727ms 13ms crystal 1.14.0
zig 1.zig 790ms 14ms 41.1MB 763ms 10ms zig 0.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 149ms 3.4ms 22.3MB 133ms 0ms crystal 1.14.0
zig 1.zig 160ms 1.9ms 11.1MB 147ms 0ms zig 0.13.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 258ms 1.8ms 1.1MB 247ms 0ms zig 0.13.0
zig 1.zig 300ms 6.3ms 1.3MB 290ms 0ms zig 0.13.0
crystal 1.cr 327ms 5.3ms 3.4MB 313ms 0ms crystal 1.14.0
crystal 2.cr 327ms 8.1ms 3.4MB 313ms 0ms crystal 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 27ms 0.1ms 1.1MB 20ms 0ms zig 0.13.0
zig 1.zig 33ms 0.3ms 1.3MB 23ms 0ms zig 0.13.0
crystal 2.cr 36ms 0.6ms 3.4MB 23ms 0ms crystal 1.14.0
crystal 1.cr 36ms 0.8ms 3.4MB 30ms 0ms crystal 1.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 240ms 5.5ms 40.3MB 223ms 0ms zig 0.13.0
zig 2.zig 316ms 1.6ms 6.1MB 303ms 0ms zig 0.13.0
crystal 2.cr 327ms 5.2ms 8.4MB 313ms 0ms crystal 1.14.0
crystal 1.cr 348ms 6.2ms 43.1MB 337ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 49ms 1.2ms 11.0MB 33ms 0ms zig 0.13.0
crystal 1.cr 74ms 2.1ms 13.3MB 60ms 0ms crystal 1.14.0
zig 2.zig 78ms 0.3ms 2.4MB 70ms 0ms zig 0.13.0
crystal 2.cr 82ms 1.0ms 4.6MB 70ms 0ms crystal 1.14.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1879ms 34ms 6.5MB 1837ms 23ms crystal 1.14.0
zig 1.zig 2339ms 5.6ms 2.2MB 2307ms 17ms zig 0.13.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 415ms 2.5ms 5.4MB 403ms 0ms crystal 1.14.0
zig 1.zig 536ms 2.8ms 1.8MB 520ms 0ms zig 0.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 450ms 8.0ms 3.8MB 1500ms 7ms zig 0.13.0
zig 2.zig 872ms 1.5ms 1.5MB 860ms 0ms zig 0.13.0
zig 1.zig 3472ms 17ms 1.5MB 3463ms 0ms zig 0.13.0
crystal 1.cr 3700ms 16ms 4.6MB 3683ms 3ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 119ms 0.9ms 3.7MB 250ms 3ms zig 0.13.0
zig 2.zig 218ms 2.6ms 1.4MB 203ms 0ms zig 0.13.0
zig 1.zig 875ms 2.0ms 1.4MB 867ms 0ms zig 0.13.0
crystal 1.cr 933ms 19ms 4.5MB 923ms 0ms crystal 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 37ms 1.7ms 3.7MB 30ms 0ms zig 0.13.0
zig 2.zig 56ms 0.1ms 1.4MB 50ms 0ms zig 0.13.0
zig 1.zig 224ms 2.6ms 1.4MB 213ms 0ms zig 0.13.0
crystal 1.cr 237ms 1.8ms 4.0MB 223ms 0ms crystal 1.14.0