Programming Language and compiler
Benchmarks

Crystal VS Zig benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1390ms 8.4ms 64.3MB 1363ms 7ms crystal 1.14.0
zig 1.zig 1869ms 58ms 49.1MB 1843ms 10ms zig 0.13.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 108ms 0.6ms 11.1MB 97ms 0ms crystal 1.14.0
zig 1.zig 149ms 2.9ms 7.1MB 140ms 0ms zig 0.13.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1318ms 45ms 20.1MB 1233ms 67ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 77ms 1.0ms 7.5MB 50ms 13ms crystal 1.14.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 60ms 2.2ms 6.6MB 40ms 10ms crystal 1.14.0
zig 1.zig 2268ms 2.9ms 2.5MB 2230ms 27ms zig 0.13.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.1ms 5.4MB 10ms 0ms crystal 1.14.0
zig 1.zig 383ms 1.3ms 1.9MB 367ms 3ms zig 0.13.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 645ms 6.6ms 3.5MB 2427ms 0ms zig 0.13.0
zig 3-i.zig 1790ms 1.2ms 1.1MB 1780ms 0ms zig 0.13.0
zig 2.zig 2428ms 24ms 1.1MB 2420ms 0ms zig 0.13.0
crystal 1.cr 2494ms 6.2ms 3.0MB 2483ms 0ms crystal 1.14.0
zig 1.zig 2870ms 11ms 1.1MB 2857ms 0ms zig 0.13.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 60ms 2.3ms 3.5MB 193ms 0ms zig 0.13.0
zig 3-i.zig 149ms 0.1ms 1.1MB 140ms 0ms zig 0.13.0
zig 2.zig 200ms 1.5ms 1.1MB 190ms 0ms zig 0.13.0
crystal 1.cr 208ms 2.8ms 3.0MB 197ms 0ms crystal 1.14.0
zig 1.zig 241ms 1.0ms 1.1MB 230ms 0ms zig 0.13.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 87ms 1.0ms 1.1MB 80ms 0ms zig 0.13.0
crystal 2.cr 538ms 2.4ms 3.4MB 420ms 100ms crystal 1.14.0
crystal 1.cr 728ms 1.8ms 14.6MB 590ms 120ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 10ms 0.1ms 1.1MB 0ms 0ms zig 0.13.0
crystal 2.cr 59ms 0.9ms 3.4MB 40ms 7ms crystal 1.14.0
crystal 1.cr 76ms 0.1ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 1.1ms 0.1ms 1.3MB 0ms 0ms zig 0.13.0
crystal 1.cr 2.1ms 0.2ms 3.0MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1947ms 461ms 187.1MB 310ms 500ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1158ms 90ms 66.3MB 30ms 90ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 35ms 1.7ms 2.9MB 23ms 0ms zig 0.13.0
crystal 0-unsafe.cr 36ms 1.4ms 3.1MB 20ms 0ms crystal 1.14.0
crystal 1.cr 63ms 1.1ms 3.1MB 50ms 0ms crystal 1.14.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 98ms 2.2ms 2.9MB 90ms 0ms zig 0.13.0
crystal 0-unsafe.cr 99ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 187ms 1.0ms 3.3MB 180ms 0ms crystal 1.14.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 16ms 1.3ms 1.4MB 10ms 0ms zig 0.13.0
crystal 0-unsafe.cr 19ms 1.0ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 0.7ms 3.0MB 20ms 0ms crystal 1.14.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 246ms 0.8ms 4.2MB 237ms 0ms zig 0.13.0
crystal 1.cr 313ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 12ms 0.1ms 1.3MB 10ms 0ms zig 0.13.0
crystal 1.cr 17ms 0.2ms 6.3MB 10ms 0ms crystal 1.14.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 829ms 2.4ms 41.1MB 803ms 10ms zig 0.13.0
crystal 1.cr 833ms 8.7ms 81.7MB 817ms 3ms crystal 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 162ms 1.4ms 22.3MB 147ms 0ms crystal 1.14.0
zig 1.zig 168ms 1.4ms 11.1MB 157ms 0ms zig 0.13.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 273ms 0.3ms 1.1MB 263ms 0ms zig 0.13.0
zig 1.zig 313ms 0.6ms 1.3MB 300ms 0ms zig 0.13.0
crystal 2.cr 343ms 1.1ms 3.4MB 330ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.1ms 3.4MB 330ms 0ms crystal 1.14.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2.zig 29ms 0.1ms 1.3MB 20ms 0ms zig 0.13.0
zig 1.zig 33ms 0.2ms 1.3MB 23ms 0ms zig 0.13.0
crystal 1.cr 38ms 0.8ms 3.4MB 30ms 0ms crystal 1.14.0
crystal 2.cr 38ms 1.0ms 3.4MB 27ms 0ms crystal 1.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 261ms 9.1ms 40.3MB 247ms 0ms zig 0.13.0
zig 2.zig 331ms 1.3ms 6.1MB 320ms 0ms zig 0.13.0
crystal 2.cr 349ms 3.6ms 8.3MB 340ms 0ms crystal 1.14.0
crystal 1.cr 386ms 1.2ms 43.1MB 373ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 1.zig 54ms 5.1ms 11.0MB 43ms 0ms zig 0.13.0
zig 2.zig 81ms 0.7ms 2.4MB 70ms 0ms zig 0.13.0
crystal 1.cr 82ms 1.2ms 13.3MB 70ms 0ms crystal 1.14.0
crystal 2.cr 91ms 2.2ms 4.6MB 80ms 0ms crystal 1.14.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2001ms 73ms 6.4MB 1963ms 20ms crystal 1.14.0
zig 1.zig 2452ms 1.2ms 2.3MB 2417ms 20ms zig 0.13.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 454ms 18ms 5.2MB 440ms 0ms crystal 1.14.0
zig 1.zig 568ms 3.4ms 1.8MB 557ms 0ms zig 0.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 476ms 6.6ms 3.8MB 1563ms 3ms zig 0.13.0
zig 2.zig 917ms 5.5ms 1.5MB 907ms 0ms zig 0.13.0
zig 1.zig 3670ms 5.0ms 1.5MB 3663ms 0ms zig 0.13.0
crystal 1.cr 3904ms 21ms 4.6MB 3893ms 0ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 125ms 0.4ms 3.7MB 273ms 7ms zig 0.13.0
zig 2.zig 230ms 0.8ms 1.4MB 220ms 0ms zig 0.13.0
zig 1.zig 924ms 1.5ms 1.4MB 910ms 0ms zig 0.13.0
crystal 1.cr 979ms 2.1ms 4.3MB 967ms 0ms crystal 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
zig 2-m.zig 38ms 0.6ms 3.7MB 37ms 0ms zig 0.13.0
zig 2.zig 60ms 0.3ms 1.4MB 50ms 0ms zig 0.13.0
zig 1.zig 232ms 0.9ms 1.4MB 220ms 0ms zig 0.13.0
crystal 1.cr 249ms 2.4ms 4.0MB 240ms 0ms crystal 1.14.0