Programming Language and compiler
Benchmarks

Crystal VS Codon benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1363ms 1.9ms 64.6MB 1337ms 10ms crystal 1.11.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 104ms 0.1ms 11.4MB 93ms 0ms crystal 1.11.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1546ms 60ms 20.6MB 1490ms 40ms crystal 1.11.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 82ms 3.7ms 7.6MB 60ms 13ms crystal 1.11.2

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 60ms 1.4ms 7.0MB 40ms 7ms crystal 1.11.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.1ms 5.6MB 10ms 3ms crystal 1.11.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2458ms 1.6ms 3.3MB 2450ms 0ms crystal 1.11.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 0.9ms 3.1MB 190ms 0ms crystal 1.11.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 530ms 2.1ms 3.8MB 430ms 83ms crystal 1.11.2
crystal 1.cr 695ms 1.7ms 14.9MB 580ms 100ms crystal 1.11.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 57ms 1.0ms 3.6MB 40ms 3ms crystal 1.11.2
crystal 1.cr 74ms 1.2ms 4.8MB 57ms 3ms crystal 1.11.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.11.2
codon 1.py 4.5ms 0.8ms 7.2MB 0ms 0ms codon 0.16.3

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3454ms 121ms 214.8MB 293ms 433ms crystal 1.11.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1157ms 109ms 53.9MB 27ms 77ms crystal 1.11.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 38ms 0.7ms 3.3MB 30ms 0ms crystal 1.11.2
crystal 1.cr 67ms 1.0ms 3.3MB 57ms 0ms crystal 1.11.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 106ms 1.1ms 3.3MB 97ms 0ms crystal 1.11.2
crystal 1.cr 188ms 1.0ms 3.3MB 180ms 0ms crystal 1.11.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 20ms 1.2ms 3.1MB 10ms 0ms crystal 1.11.2
crystal 1.cr 35ms 1.1ms 3.1MB 27ms 0ms crystal 1.11.2

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 373ms 1.3ms 9.5MB 360ms 0ms crystal 1.11.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 20ms 0.3ms 6.0MB 10ms 0ms crystal 1.11.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 928ms 8.2ms 64.6MB 903ms 7ms crystal 1.11.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 171ms 2.6ms 17.6MB 157ms 0ms crystal 1.11.2

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 0.8ms 3.5MB 330ms 0ms crystal 1.11.2
crystal 2.cr 348ms 10ms 3.5MB 337ms 0ms crystal 1.11.2
codon 1.py 1295ms 1.9ms 7.7MB 1287ms 0ms codon 0.16.3

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.5ms 3.5MB 27ms 0ms crystal 1.11.2
crystal 1.cr 39ms 1.2ms 3.6MB 30ms 0ms crystal 1.11.2
codon 1.py 140ms 2.4ms 5.8MB 127ms 0ms codon 0.16.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 380ms 2.1ms 42.7MB 363ms 0ms crystal 1.11.2
crystal 2.cr 381ms 2.1ms 8.4MB 370ms 0ms crystal 1.11.2
codon 1.py 406ms 0.9ms 46.5MB 390ms 0ms codon 0.16.3
codon 2.py 482ms 8.3ms 107.0MB 463ms 13ms codon 0.16.3

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 80ms 1.2ms 13.3MB 70ms 0ms crystal 1.11.2
codon 1.py 81ms 2.0ms 17.2MB 70ms 0ms codon 0.16.3
crystal 2.cr 93ms 0.9ms 4.8MB 80ms 0ms crystal 1.11.2
codon 2.py 110ms 3.4ms 26.0MB 97ms 3ms codon 0.16.3

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1944ms 14ms 6.5MB 1910ms 17ms crystal 1.11.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 452ms 10ms 5.4MB 437ms 3ms crystal 1.11.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3743ms 15ms 4.8MB 3727ms 0ms crystal 1.11.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 945ms 4.4ms 4.4MB 933ms 0ms crystal 1.11.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 238ms 0.1ms 4.1MB 227ms 0ms crystal 1.11.2