Programming Language and compiler
Benchmarks

Nim VS Crystal benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 741ms 8.3ms 34.9MB 727ms 0ms nim 2.2.0
nim 2.nim 919ms 4.1ms 34.7MB 900ms 7ms nim/clang 2.2.0
crystal 1.cr 1267ms 4.6ms 64.3MB 1247ms 7ms crystal 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 67ms 0.5ms 5.5MB 57ms 0ms nim 2.2.0
nim 2.nim 85ms 2.2ms 5.8MB 77ms 0ms nim/clang 2.2.0
crystal 1.cr 102ms 0.9ms 11.1MB 90ms 0ms crystal 1.14.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1297ms 25ms 20.1MB 1213ms 63ms crystal 1.14.0
nim 1.nim timeout 0.0ms 561.4MB 2450ms 2080ms nim 2.2.0
nim 1.nim timeout 0.0ms 570.6MB 2543ms 1987ms nim/clang 2.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 69ms 2.7ms 7.5MB 47ms 10ms crystal 1.14.0
nim 1.nim 4127ms 12ms 519.8MB 2037ms 1663ms nim/clang 2.2.0
nim 1.nim 4262ms 22ms 519.3MB 2010ms 1827ms nim 2.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 174ms 1.9ms 1.5MB 160ms 0ms nim 2.2.0
nim 2.nim 226ms 6.1ms 1.8MB 213ms 0ms nim/clang 2.2.0
crystal 2.cr 515ms 7.3ms 3.4MB 413ms 90ms crystal 1.14.0
nim 1.nim 542ms 6.4ms 1.8MB 420ms 110ms nim/clang 2.2.0
nim 1.nim 569ms 4.4ms 1.5MB 470ms 87ms nim 2.2.0
crystal 1.cr 693ms 6.0ms 14.7MB 553ms 127ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 20ms 0.4ms 1.5MB 10ms 0ms nim 2.2.0
nim 2.nim 25ms 1.4ms 1.8MB 17ms 0ms nim/clang 2.2.0
crystal 2.cr 55ms 0.3ms 3.4MB 33ms 10ms crystal 1.14.0
nim 1.nim 58ms 0.7ms 1.8MB 30ms 17ms nim/clang 2.2.0
nim 1.nim 60ms 2.1ms 1.5MB 37ms 10ms nim 2.2.0
crystal 1.cr 72ms 1.1ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.0ms 0.0ms 1.6MB 0ms 0ms nim 2.2.0
nim 1.nim 1.1ms 0.1ms 1.8MB 0ms 0ms nim/clang 2.2.0
crystal 1.cr 2.0ms 0.1ms 3.0MB 0ms 0ms crystal 1.14.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 930ms 5.9ms 99.3MB 260ms 647ms nim 2.2.0
nim 1.nim 934ms 16ms 99.4MB 237ms 673ms nim/clang 2.2.0
crystal 1.cr 2050ms 398ms 189.3MB 260ms 487ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 152ms 5.5ms 18.1MB 30ms 107ms nim/clang 2.2.0
nim 1.nim 155ms 3.4ms 18.2MB 37ms 100ms nim 2.2.0
crystal 1.cr 1162ms 112ms 53.7MB 40ms 63ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 35ms 1.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 62ms 2.8ms 3.1MB 50ms 0ms crystal 1.14.0
nim 2.nim 105ms 4.1ms 1.6MB 97ms 0ms nim/clang 2.2.0
nim 2.nim 108ms 2.2ms 1.8MB 100ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 94ms 2.9ms 3.1MB 83ms 0ms crystal 1.14.0
crystal 1.cr 173ms 1.9ms 3.1MB 163ms 0ms crystal 1.14.0
nim 2.nim 307ms 6.6ms 1.6MB 297ms 0ms nim/clang 2.2.0
nim 2.nim 319ms 3.0ms 1.4MB 310ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 17ms 0.4ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 28ms 0.6ms 3.0MB 20ms 0ms crystal 1.14.0
nim 2.nim 46ms 1.6ms 1.8MB 40ms 0ms nim/clang 2.2.0
nim 2.nim 49ms 1.9ms 1.5MB 40ms 0ms nim 2.2.0
nim 1.nim 463ms 5.7ms 1.5MB 450ms 0ms nim/clang 2.2.0
nim 1.nim 467ms 5.4ms 1.3MB 453ms 0ms nim 2.2.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 300ms 7.0ms 9.2MB 287ms 0ms crystal 1.14.0
nim 1.nim 366ms 3.5ms 4.8MB 353ms 0ms nim/clang 2.2.0
nim 1.nim 542ms 1.7ms 4.5MB 533ms 0ms nim 2.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 16ms 0.1ms 6.3MB 10ms 0ms crystal 1.14.0
nim 1.nim 18ms 0.5ms 1.9MB 10ms 0ms nim/clang 2.2.0
nim 1.nim 25ms 0.8ms 1.8MB 20ms 0ms nim 2.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 520ms 10ms 34.9MB 497ms 7ms nim 2.2.0
nim 1.nim 578ms 6.2ms 34.7MB 553ms 10ms nim/clang 2.2.0
crystal 1.cr 756ms 9.3ms 81.6MB 727ms 13ms crystal 1.14.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 112ms 2.9ms 9.6MB 100ms 0ms nim 2.2.0
nim 1.nim 124ms 3.0ms 9.9MB 110ms 0ms nim/clang 2.2.0
crystal 1.cr 149ms 3.4ms 22.3MB 133ms 0ms crystal 1.14.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 302ms 2.8ms 1.8MB 290ms 0ms nim 2.2.0
crystal 1.cr 327ms 5.3ms 3.4MB 313ms 0ms crystal 1.14.0
crystal 2.cr 327ms 8.1ms 3.4MB 313ms 0ms crystal 1.14.0
nim 2.nim 330ms 8.5ms 2.0MB 320ms 0ms nim/clang 2.2.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 32ms 0.5ms 1.8MB 20ms 0ms nim 2.2.0
nim 2.nim 35ms 0.9ms 2.0MB 23ms 0ms nim/clang 2.2.0
crystal 2.cr 36ms 0.6ms 3.4MB 23ms 0ms crystal 1.14.0
crystal 1.cr 36ms 0.8ms 3.4MB 30ms 0ms crystal 1.14.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 252ms 0.5ms 41.5MB 240ms 0ms nim 2.2.0
nim 1.nim 293ms 2.6ms 41.8MB 280ms 0ms nim/clang 2.2.0
crystal 2.cr 327ms 5.2ms 8.4MB 313ms 0ms crystal 1.14.0
crystal 1.cr 348ms 6.2ms 43.1MB 337ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 53ms 2.2ms 11.5MB 40ms 0ms nim 2.2.0
nim 1.nim 60ms 3.6ms 11.8MB 50ms 0ms nim/clang 2.2.0
crystal 1.cr 74ms 2.1ms 13.3MB 60ms 0ms crystal 1.14.0
crystal 2.cr 82ms 1.0ms 4.6MB 70ms 0ms crystal 1.14.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1541ms 6.9ms 152.3MB 1513ms 13ms nim/clang 2.2.0
nim 1.nim 1567ms 8.6ms 151.5MB 1530ms 23ms nim 2.2.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 162ms 0.2ms 17.6MB 143ms 3ms nim/clang 2.2.0
nim 1.nim 163ms 1.8ms 17.4MB 153ms 0ms nim 2.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3383ms 20ms 1.6MB 3370ms 0ms nim/clang 2.2.0
nim 1.nim 3439ms 35ms 1.4MB 3430ms 0ms nim 2.2.0
crystal 1.cr 3700ms 16ms 4.6MB 3683ms 3ms crystal 1.14.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 848ms 4.3ms 1.5MB 837ms 0ms nim/clang 2.2.0
nim 1.nim 860ms 8.6ms 1.3MB 853ms 0ms nim 2.2.0
crystal 1.cr 933ms 19ms 4.5MB 923ms 0ms crystal 1.14.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 214ms 1.3ms 1.3MB 203ms 0ms nim 2.2.0
nim 1.nim 217ms 5.1ms 1.5MB 207ms 0ms nim/clang 2.2.0
crystal 1.cr 237ms 1.8ms 4.0MB 223ms 0ms crystal 1.14.0