Programming Language and compiler
Benchmarks

Nim VS Crystal benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1788ms 5.5ms 64.4MB 1767ms 10ms crystal 1.9.0
nim 2.nim 1955ms 2.8ms 34.1MB 1930ms 10ms nim 1.6.14
nim 2.nim 2105ms 6.7ms 35.0MB 2087ms 7ms nim/clang 1.6.14

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 139ms 2.3ms 11.3MB 127ms 0ms crystal 1.9.0
nim 2.nim 186ms 1.2ms 5.6MB 177ms 0ms nim 1.6.14
nim 2.nim 194ms 3.4ms 5.7MB 183ms 0ms nim/clang 1.6.14

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1819ms 61ms 20.4MB 1783ms 17ms crystal 1.9.0
nim 1.nim timeout 0.0ms 423.4MB 3330ms 1317ms nim 1.6.14
nim 1.nim timeout 0.0ms 424.2MB 3350ms 1300ms nim/clang 1.6.14

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 97ms 1.5ms 7.7MB 77ms 10ms crystal 1.9.0
nim 1.nim timeout 0.0ms 421.6MB 3370ms 1283ms nim 1.6.14
nim 1.nim timeout 0.0ms 423.3MB 3447ms 1203ms nim/clang 1.6.14

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 80ms 0.7ms 7.2MB 63ms 7ms crystal 1.9.0
nim 1.nim timeout 0.0ms 3.0MB 4990ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 3.0MB 4983ms 0ms nim/clang 1.6.14

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 29ms 0.7ms 5.4MB 17ms 3ms crystal 1.9.0
nim 1.nim timeout 0.0ms 2.3MB 4990ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 2.2MB 4983ms 0ms nim/clang 1.6.14

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 259ms 0.7ms 1.0MB 250ms 0ms nim 1.6.14
nim 2.nim 346ms 1.7ms 1.3MB 330ms 0ms nim/clang 1.6.14
nim 1.nim 785ms 2.8ms 1.0MB 687ms 83ms nim 1.6.14
nim 1.nim 799ms 1.3ms 1.2MB 690ms 90ms nim/clang 1.6.14
crystal 2.cr 821ms 5.8ms 3.3MB 710ms 93ms crystal 1.9.0
crystal 1.cr 1041ms 2.4ms 14.8MB 917ms 107ms crystal 1.9.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 28ms 0.5ms 1.0MB 20ms 0ms nim 1.6.14
nim 2.nim 36ms 0.3ms 1.3MB 30ms 0ms nim/clang 1.6.14
nim 1.nim 81ms 0.5ms 1.0MB 60ms 7ms nim 1.6.14
nim 1.nim 83ms 0.8ms 1.2MB 70ms 0ms nim/clang 1.6.14
crystal 2.cr 85ms 0.7ms 3.4MB 73ms 0ms crystal 1.9.0
crystal 1.cr 108ms 0.1ms 4.7MB 80ms 10ms crystal 1.9.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.2ms 0.1ms 1.0MB 0ms 0ms nim 1.6.14
crystal 1.cr 2.3ms 0.5ms 3.0MB 0ms 0ms crystal 1.9.0
nim 1.nim 2.9ms 2.0ms 1.2MB 0ms 0ms nim/clang 1.6.14

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 718ms 6.0ms 94.6MB 340ms 347ms nim/clang 1.6.14
nim 1.nim 722ms 2.7ms 94.2MB 313ms 377ms nim 1.6.14
crystal 1.cr 3497ms 61ms 192.3MB 360ms 360ms crystal 1.9.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 121ms 1.3ms 18.3MB 50ms 53ms nim/clang 1.6.14
nim 1.nim 124ms 2.1ms 18.0MB 57ms 53ms nim 1.6.14
crystal 1.cr 1284ms 15ms 52.6MB 47ms 50ms crystal 1.9.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 54ms 0.3ms 3.0MB 50ms 0ms crystal 1.9.0
crystal 1.cr 143ms 54ms 3.0MB 130ms 0ms crystal 1.9.0
nim 2.nim 145ms 0.9ms 1.2MB 137ms 0ms nim/clang 1.6.14
nim 2.nim 152ms 0.8ms 1.1MB 140ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 1.1MB 4990ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 1.2MB 4983ms 0ms nim/clang 1.6.14

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 213ms 80ms 3.0MB 193ms 0ms crystal 1.9.0
crystal 1.cr 273ms 1.2ms 3.0MB 263ms 0ms crystal 1.9.0
nim 2.nim 428ms 0.6ms 1.3MB 417ms 0ms nim/clang 1.6.14
nim 2.nim 450ms 0.8ms 1.1MB 440ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 1.0MB 4987ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim/clang 1.6.14

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 29ms 5.2ms 3.0MB 20ms 0ms crystal 1.9.0
crystal 1.cr 49ms 4.2ms 3.1MB 37ms 0ms crystal 1.9.0
nim 2.nim 63ms 0.5ms 1.2MB 50ms 0ms nim/clang 1.6.14
nim 2.nim 65ms 1.7ms 1.0MB 57ms 0ms nim 1.6.14
nim 1.nim 389ms 5.3ms 1.2MB 373ms 0ms nim/clang 1.6.14
nim 1.nim 444ms 3.1ms 1.0MB 430ms 0ms nim 1.6.14

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 585ms 11ms 9.8MB 570ms 0ms crystal 1.9.0
nim 1.nim 656ms 0.7ms 4.8MB 647ms 0ms nim/clang 1.6.14
nim 1.nim 983ms 0.4ms 4.3MB 970ms 0ms nim 1.6.14

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 29ms 0.2ms 6.9MB 20ms 0ms crystal 1.9.0
nim 1.nim 30ms 0.7ms 1.2MB 20ms 0ms nim/clang 1.6.14
nim 1.nim 43ms 0.7ms 1.1MB 30ms 0ms nim 1.6.14

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 992ms 2.9ms 34.7MB 977ms 0ms nim 1.6.14
nim 1.nim 1065ms 6.2ms 34.5MB 1047ms 3ms nim/clang 1.6.14
crystal 1.cr 1237ms 24ms 64.4MB 1210ms 13ms crystal 1.9.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 211ms 1.7ms 9.3MB 197ms 0ms nim 1.6.14
crystal 1.cr 226ms 8.6ms 17.5MB 210ms 0ms crystal 1.9.0
nim 1.nim 229ms 2.5ms 9.5MB 217ms 0ms nim/clang 1.6.14

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 382ms 0.6ms 1.3MB 370ms 0ms nim 1.6.14
nim 2.nim 411ms 0.8ms 1.3MB 400ms 0ms nim/clang 1.6.14
crystal 2.cr 450ms 0.3ms 2.9MB 437ms 0ms crystal 1.9.0
crystal 1.cr 468ms 29ms 3.0MB 457ms 0ms crystal 1.9.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 41ms 0.3ms 1.3MB 30ms 0ms nim 1.6.14
nim 2.nim 43ms 0.0ms 1.2MB 30ms 0ms nim/clang 1.6.14
crystal 2.cr 48ms 0.1ms 2.9MB 40ms 0ms crystal 1.9.0
crystal 1.cr 48ms 0.8ms 3.0MB 40ms 0ms crystal 1.9.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 458ms 6.2ms 8.0MB 443ms 0ms crystal 1.9.0
nim 1.nim 568ms 14ms 40.3MB 550ms 0ms nim 1.6.14
crystal 1.cr 604ms 9.8ms 42.6MB 583ms 0ms crystal 1.9.0
nim 2.nim 608ms 6.1ms 6.5MB 597ms 0ms nim/clang 1.6.14
nim 2.nim 633ms 1.1ms 6.1MB 617ms 0ms nim 1.6.14
nim 1.nim 758ms 55ms 41.3MB 743ms 0ms nim/clang 1.6.14

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 103ms 0.3ms 4.1MB 90ms 0ms crystal 1.9.0
nim 1.nim 129ms 0.5ms 11.0MB 120ms 0ms nim 1.6.14
nim 1.nim 136ms 0.4ms 11.3MB 123ms 0ms nim/clang 1.6.14
crystal 1.cr 140ms 4.1ms 13.0MB 127ms 0ms crystal 1.9.0
nim 2.nim 142ms 1.0ms 3.3MB 130ms 0ms nim/clang 1.6.14
nim 2.nim 148ms 0.7ms 3.0MB 140ms 0ms nim 1.6.14

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2576ms 68ms 6.6MB 2557ms 3ms crystal 1.9.0
nim 1.nim timeout 0.0ms 5.9MB 4990ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 6.0MB 4990ms 0ms nim/clang 1.6.14

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 583ms 11ms 5.4MB 570ms 0ms crystal 1.9.0
nim 1.nim timeout 0.0ms 5.8MB 4990ms 0ms nim 1.6.14
nim 1.nim timeout 0.0ms 6.1MB 4983ms 0ms nim/clang 1.6.14

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2492ms 6.4ms 168.0MB 2437ms 37ms nim/clang 1.6.14
nim 1.nim 2557ms 7.1ms 167.1MB 2500ms 37ms nim 1.6.14

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 255ms 0.2ms 17.2MB 240ms 0ms nim/clang 1.6.14
nim 1.nim 264ms 1.1ms 16.8MB 250ms 0ms nim 1.6.14

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4117ms 0.5ms 1.2MB 4103ms 0ms nim/clang 1.6.14
nim 1.nim 4119ms 0.2ms 1.3MB 4110ms 0ms nim 1.6.14
crystal 1.cr timeout 0.0ms 4.4MB 4983ms 0ms crystal 1.9.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1031ms 0.5ms 1.3MB 1020ms 0ms nim/clang 1.6.14
nim 1.nim 1034ms 3.4ms 1.3MB 1020ms 0ms nim 1.6.14
crystal 1.cr 1433ms 0.2ms 3.9MB 1423ms 0ms crystal 1.9.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 261ms 0.8ms 1.3MB 250ms 0ms nim/clang 1.6.14
nim 1.nim 261ms 1.1ms 1.3MB 250ms 0ms nim 1.6.14
crystal 1.cr 364ms 0.3ms 4.0MB 350ms 0ms crystal 1.9.0