Odin VS Crystal benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1357ms 14ms 64.3MB 1337ms 10ms crystal 1.14.0
odin 1.odin 2340ms 23ms 49.5MB 2310ms 13ms odin 2024

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 3.0ms 11.1MB 93ms 0ms crystal 1.14.0
odin 1.odin 219ms 0.7ms 7.5MB 210ms 0ms odin 2024

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1.2ms 0.1ms 1.6MB 0ms 0ms odin 2024
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 0.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 65ms 0.9ms 3.1MB 53ms 0ms crystal 1.14.0
odin 1.odin 162ms 12ms 1.6MB 150ms 0ms odin 2024

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 100ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 183ms 1.6ms 3.1MB 170ms 0ms crystal 1.14.0
odin 1.odin 457ms 5.4ms 1.6MB 447ms 0ms odin 2024

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 19ms 1.1ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 1.0ms 3.0MB 20ms 0ms crystal 1.14.0
odin 1.odin 70ms 1.7ms 1.6MB 63ms 0ms odin 2024

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 284ms 1.0ms 4.6MB 270ms 0ms odin 2024
crystal 1.cr 314ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 14ms 0.4ms 1.6MB 10ms 0ms odin 2024
crystal 1.cr 18ms 0.3ms 6.3MB 10ms 0ms crystal 1.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 342ms 2.6ms 3.4MB 327ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.9ms 3.4MB 333ms 0ms crystal 1.14.0
odin 1.odin 353ms 1.7ms 1.5MB 340ms 0ms odin 2024
odin 1-i.odin 355ms 1.2ms 1.5MB 340ms 0ms odin 2024

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 37ms 0.5ms 1.5MB 27ms 0ms odin 2024
crystal 1.cr 38ms 0.2ms 3.4MB 27ms 0ms crystal 1.14.0
odin 1-i.odin 38ms 0.6ms 1.5MB 30ms 0ms odin 2024
crystal 2.cr 39ms 0.3ms 3.4MB 30ms 0ms crystal 1.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 283ms 4.5ms 40.6MB 263ms 3ms odin 2024
crystal 2.cr 351ms 1.7ms 8.4MB 340ms 0ms crystal 1.14.0
crystal 1.cr 373ms 4.3ms 43.0MB 357ms 0ms crystal 1.14.0
odin 2.odin 744ms 10ms 6.5MB 733ms 3ms odin 2024

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 59ms 0.9ms 11.4MB 50ms 0ms odin 2024
crystal 1.cr 79ms 1.1ms 13.3MB 70ms 0ms crystal 1.14.0
crystal 2.cr 87ms 1.7ms 4.6MB 80ms 0ms crystal 1.14.0
odin 2.odin 177ms 11ms 2.8MB 167ms 0ms odin 2024

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 3586ms 7.2ms 2.9MB 3573ms 0ms odin 2024
crystal 1.cr 3898ms 25ms 4.6MB 3887ms 0ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 904ms 9.0ms 2.3MB 893ms 0ms odin 2024
crystal 1.cr 981ms 2.7ms 4.5MB 967ms 0ms crystal 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 227ms 1.7ms 1.9MB 220ms 0ms odin 2024
crystal 1.cr 251ms 3.2ms 4.0MB 240ms 0ms crystal 1.14.0