Programming Language and compiler
Benchmarks

Crystal VS Zig benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1357ms 14ms 64.3MB 1337ms 10ms crystal 1.14.0
zig 1.zig 1720ms 11ms 49.1MB 1690ms 13ms zig 0.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 3.0ms 11.1MB 93ms 0ms crystal 1.14.0
zig 1.zig 149ms 4.1ms 7.1MB 137ms 0ms zig 0.13.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1420ms 28ms 20.1MB 1340ms 63ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 78ms 1.8ms 7.5MB 50ms 10ms crystal 1.14.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 59ms 1.0ms 6.6MB 43ms 0ms crystal 1.14.0
zig 1.zig 2266ms 2.1ms 2.5MB 2237ms 10ms zig 0.13.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.5ms 5.4MB 10ms 0ms crystal 1.14.0
zig 1.zig 384ms 0.9ms 1.9MB 367ms 0ms zig 0.13.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 647ms 7.0ms 3.5MB 2430ms 0ms zig 0.13.0
zig 3-i.zig 1788ms 1.5ms 1.1MB 1780ms 0ms zig 0.13.0
zig 2.zig 2455ms 43ms 1.1MB 2440ms 0ms zig 0.13.0
crystal 1.cr 2479ms 10ms 3.0MB 2467ms 0ms crystal 1.14.0
zig 1.zig 2862ms 0.8ms 1.1MB 2850ms 0ms zig 0.13.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 63ms 0.3ms 3.6MB 190ms 0ms zig 0.13.0
zig 3-i.zig 149ms 0.0ms 1.3MB 140ms 0ms zig 0.13.0
zig 2.zig 201ms 5.1ms 1.1MB 193ms 0ms zig 0.13.0
crystal 1.cr 206ms 2.2ms 3.0MB 190ms 0ms crystal 1.14.0
zig 1.zig 241ms 0.5ms 1.1MB 230ms 0ms zig 0.13.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 87ms 0.5ms 1.1MB 80ms 0ms zig 0.13.0
crystal 2.cr 539ms 2.5ms 3.4MB 407ms 113ms crystal 1.14.0
crystal 1.cr 727ms 0.8ms 14.7MB 597ms 120ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 11ms 0.7ms 1.1MB 0ms 0ms zig 0.13.0
crystal 2.cr 59ms 1.6ms 3.4MB 40ms 3ms crystal 1.14.0
crystal 1.cr 77ms 1.6ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 1.0ms 0.0ms 1.3MB 0ms 0ms zig 0.13.0
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2213ms 195ms 186.4MB 290ms 500ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1222ms 100ms 53.8MB 27ms 83ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 34ms 0.7ms 2.9MB 27ms 0ms zig 0.13.0
crystal 0-unsafe.cr 36ms 0.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 65ms 0.9ms 3.1MB 53ms 0ms crystal 1.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 95ms 2.2ms 2.9MB 87ms 0ms zig 0.13.0
crystal 0-unsafe.cr 100ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 183ms 1.6ms 3.1MB 170ms 0ms crystal 1.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 15ms 0.2ms 1.4MB 10ms 0ms zig 0.13.0
crystal 0-unsafe.cr 19ms 1.1ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 1.0ms 3.0MB 20ms 0ms crystal 1.14.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 246ms 0.7ms 4.2MB 240ms 0ms zig 0.13.0
crystal 1.cr 314ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 12ms 0.2ms 1.3MB 0ms 0ms zig 0.13.0
crystal 1.cr 18ms 0.3ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 804ms 11ms 81.7MB 773ms 13ms crystal 1.14.0
zig 1.zig 840ms 21ms 41.1MB 813ms 10ms zig 0.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 160ms 0.7ms 22.4MB 140ms 3ms crystal 1.14.0
zig 1.zig 168ms 1.1ms 11.1MB 157ms 3ms zig 0.13.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 273ms 0.3ms 1.1MB 263ms 0ms zig 0.13.0
zig 1.zig 314ms 0.9ms 1.3MB 300ms 0ms zig 0.13.0
crystal 2.cr 342ms 2.6ms 3.4MB 327ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.9ms 3.4MB 333ms 0ms crystal 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 30ms 1.5ms 1.1MB 20ms 0ms zig 0.13.0
zig 1.zig 34ms 0.6ms 1.3MB 23ms 0ms zig 0.13.0
crystal 1.cr 38ms 0.2ms 3.4MB 27ms 0ms crystal 1.14.0
crystal 2.cr 39ms 0.3ms 3.4MB 30ms 0ms crystal 1.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 256ms 0.6ms 40.3MB 240ms 3ms zig 0.13.0
zig 2.zig 331ms 0.1ms 6.1MB 320ms 0ms zig 0.13.0
crystal 2.cr 351ms 1.7ms 8.4MB 340ms 0ms crystal 1.14.0
crystal 1.cr 373ms 4.3ms 43.0MB 357ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 49ms 1.5ms 11.0MB 40ms 0ms zig 0.13.0
crystal 1.cr 79ms 1.1ms 13.3MB 70ms 0ms crystal 1.14.0
zig 2.zig 81ms 0.6ms 2.4MB 70ms 0ms zig 0.13.0
crystal 2.cr 87ms 1.7ms 4.6MB 80ms 0ms crystal 1.14.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2001ms 13ms 6.4MB 1953ms 30ms crystal 1.14.0
zig 1.zig 2456ms 3.3ms 2.3MB 2427ms 10ms zig 0.13.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 451ms 17ms 5.2MB 433ms 0ms crystal 1.14.0
zig 1.zig 567ms 4.0ms 1.8MB 557ms 0ms zig 0.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 473ms 0.3ms 3.8MB 1590ms 7ms zig 0.13.0
zig 2.zig 918ms 5.7ms 1.5MB 903ms 0ms zig 0.13.0
zig 1.zig 3679ms 26ms 1.5MB 3670ms 0ms zig 0.13.0
crystal 1.cr 3898ms 25ms 4.6MB 3887ms 0ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 126ms 0.9ms 3.7MB 267ms 0ms zig 0.13.0
zig 2.zig 232ms 0.2ms 1.4MB 220ms 0ms zig 0.13.0
zig 1.zig 922ms 1.3ms 1.4MB 910ms 0ms zig 0.13.0
crystal 1.cr 981ms 2.7ms 4.5MB 967ms 0ms crystal 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 38ms 1.0ms 3.7MB 37ms 0ms zig 0.13.0
zig 2.zig 60ms 0.9ms 1.4MB 50ms 0ms zig 0.13.0
zig 1.zig 234ms 2.0ms 1.4MB 223ms 0ms zig 0.13.0
crystal 1.cr 251ms 3.2ms 4.0MB 240ms 0ms crystal 1.14.0