Programming Language and compiler
Benchmarks

Crystal VS Nim benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1532ms 4.2ms 64.5MB 1837ms 13ms crystal 1.5.1
nim 2.nim 3377ms 55ms 34.4MB 3353ms 7ms nim/clang 1.6.8
nim 2.nim 3539ms 69ms 35.1MB 3510ms 13ms nim 1.6.8

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 132ms 0.9ms 11.1MB 133ms 3ms crystal 1.5.1
nim 2.nim 319ms 3.0ms 5.7MB 307ms 0ms nim/clang 1.6.8
nim 2.nim 330ms 0.7ms 5.4MB 317ms 0ms nim 1.6.8

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1933ms 16ms 20.5MB 1897ms 23ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 108ms 3.8ms 9.3MB 97ms 0ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 83ms 1.3ms 7.4MB 73ms 0ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 1.0ms 5.2MB 20ms 0ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3968ms 1.9ms 4.9MB 3953ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 323ms 1.9ms 3.0MB 310ms 0ms crystal 1.5.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 257ms 0.4ms 0.7MB 250ms 0ms nim 1.6.8
nim 2.nim 339ms 2.7ms 1.0MB 327ms 0ms nim/clang 1.6.8
nim 1.nim 786ms 1.8ms 0.6MB 683ms 80ms nim 1.6.8
nim 1.nim 809ms 2.8ms 1.0MB 720ms 70ms nim/clang 1.6.8
crystal 2.cr 860ms 0.8ms 3.6MB 753ms 93ms crystal 1.5.1
crystal 1.cr 1071ms 23ms 14.7MB 917ms 137ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 29ms 0.4ms 0.7MB 20ms 0ms nim 1.6.8
nim 2.nim 37ms 0.6ms 0.9MB 30ms 0ms nim/clang 1.6.8
nim 1.nim 83ms 0.4ms 1.0MB 67ms 3ms nim/clang 1.6.8
nim 1.nim 84ms 4.0ms 0.7MB 67ms 3ms nim 1.6.8
crystal 2.cr 91ms 2.6ms 3.6MB 67ms 7ms crystal 1.5.1
crystal 1.cr 110ms 0.6ms 6.4MB 87ms 10ms crystal 1.5.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.6ms 0.4ms 0.7MB 0ms 0ms nim 1.6.8
nim 1.nim 1.9ms 0.7ms 1.0MB 0ms 0ms nim/clang 1.6.8
crystal 1.cr 3.0ms 0.8ms 3.1MB 0ms 0ms crystal 1.5.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 731ms 2.3ms 94.2MB 330ms 367ms nim 1.6.8
nim 1.nim 735ms 1.5ms 94.3MB 297ms 407ms nim/clang 1.6.8
crystal 1.cr 3452ms 67ms 120.4MB 307ms 273ms crystal 1.5.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 123ms 0.9ms 18.3MB 53ms 57ms nim 1.6.8
nim 1.nim 125ms 0.9ms 18.7MB 40ms 67ms nim/clang 1.6.8
crystal 1.cr 1170ms 104ms 35.0MB 43ms 40ms crystal 1.5.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 61ms 0.1ms 3.1MB 50ms 0ms crystal 1.5.1
crystal 1.cr 108ms 3.9ms 3.1MB 100ms 0ms crystal 1.5.1
nim 2.nim 147ms 0.8ms 1.0MB 140ms 0ms nim/clang 1.6.8
nim 2.nim 158ms 1.3ms 0.7MB 150ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 174ms 1.0ms 3.1MB 163ms 0ms crystal 1.5.1
crystal 1.cr 312ms 1.1ms 5.0MB 300ms 0ms crystal 1.5.1
nim 2.nim 434ms 0.5ms 0.9MB 420ms 0ms nim/clang 1.6.8
nim 2.nim 466ms 0.8ms 0.7MB 457ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 30ms 0.9ms 3.1MB 20ms 0ms crystal 1.5.1
crystal 1.cr 55ms 0.8ms 3.1MB 47ms 0ms crystal 1.5.1
nim 2.nim 65ms 0.6ms 1.0MB 53ms 0ms nim/clang 1.6.8
nim 2.nim 68ms 0.9ms 0.6MB 60ms 0ms nim 1.6.8
nim 1.nim 419ms 6.5ms 1.0MB 407ms 0ms nim/clang 1.6.8
nim 1.nim 448ms 0.6ms 0.7MB 440ms 0ms nim 1.6.8

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 575ms 0.8ms 4.9MB 563ms 0ms nim/clang 1.6.8
crystal 1.cr 995ms 1.1ms 7.5MB 980ms 0ms crystal 1.5.1
nim 1.nim 996ms 0.9ms 4.5MB 983ms 0ms nim 1.6.8

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 27ms 0.3ms 2.0MB 20ms 0ms nim/clang 1.6.8
nim 1.nim 44ms 0.9ms 0.7MB 33ms 0ms nim 1.6.8
crystal 1.cr 46ms 0.8ms 6.5MB 40ms 0ms crystal 1.5.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1058ms 30ms 66.1MB 1223ms 13ms crystal 1.5.1
nim 1.nim 1605ms 45ms 34.8MB 1583ms 3ms nim/clang 1.6.8
nim 1.nim 1659ms 3.2ms 35.1MB 1637ms 3ms nim 1.6.8

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 202ms 6.2ms 17.5MB 213ms 7ms crystal 1.5.1
nim 1.nim 340ms 1.1ms 9.9MB 327ms 0ms nim/clang 1.6.8
nim 1.nim 359ms 2.9ms 9.3MB 343ms 0ms nim 1.6.8

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 405ms 1.0ms 1.0MB 393ms 0ms nim/clang 1.6.8
nim 2.nim 428ms 0.3ms 1.0MB 413ms 0ms nim 1.6.8
crystal 1.cr 509ms 0.5ms 4.9MB 500ms 0ms crystal 1.5.1
crystal 2.cr 541ms 1.0ms 3.0MB 530ms 0ms crystal 1.5.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 46ms 0.7ms 1.0MB 37ms 0ms nim 1.6.8
nim 2.nim 47ms 4.8ms 1.0MB 33ms 0ms nim/clang 1.6.8
crystal 1.cr 55ms 0.9ms 3.1MB 47ms 0ms crystal 1.5.1
crystal 2.cr 60ms 2.6ms 2.9MB 50ms 0ms crystal 1.5.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 468ms 0.8ms 8.0MB 457ms 0ms crystal 1.5.1
nim 2.nim 588ms 1.8ms 6.4MB 577ms 0ms nim/clang 1.6.8
nim 2.nim 642ms 0.9ms 6.0MB 630ms 0ms nim 1.6.8
nim 1.nim 665ms 15ms 41.1MB 643ms 0ms nim 1.6.8
crystal 1.cr 726ms 51ms 44.8MB 703ms 3ms crystal 1.5.1
nim 1.nim 734ms 6.6ms 40.6MB 713ms 3ms nim/clang 1.6.8

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 109ms 0.9ms 6.4MB 90ms 0ms crystal 1.5.1
nim 1.nim 122ms 0.5ms 11.1MB 110ms 0ms nim 1.6.8
nim 1.nim 128ms 0.3ms 11.4MB 117ms 0ms nim/clang 1.6.8
nim 2.nim 140ms 0.6ms 3.2MB 130ms 0ms nim/clang 1.6.8
crystal 1.cr 151ms 0.5ms 14.9MB 140ms 0ms crystal 1.5.1
nim 2.nim 153ms 1.0ms 2.9MB 140ms 0ms nim 1.6.8

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2755ms 38ms 6.8MB 3000ms 277ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 639ms 4.2ms 7.2MB 660ms 73ms crystal 1.5.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2465ms 3.9ms 195.7MB 2400ms 50ms crystal 1.5.1
nim 1.nim 2569ms 0.7ms 167.2MB 2520ms 30ms nim/clang 1.6.8
nim 1.nim 2574ms 3.7ms 167.2MB 2527ms 33ms nim 1.6.8

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 254ms 1.5ms 22.9MB 233ms 3ms crystal 1.5.1
nim 1.nim 265ms 1.4ms 17.0MB 250ms 3ms nim/clang 1.6.8
nim 1.nim 266ms 2.0ms 16.7MB 250ms 3ms nim 1.6.8

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4121ms 3.1ms 1.9MB 4107ms 0ms nim 1.6.8
nim 1.nim 4122ms 2.2ms 1.8MB 4107ms 0ms nim/clang 1.6.8
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1032ms 0.1ms 1.0MB 1020ms 0ms nim/clang 1.6.8
nim 1.nim 1032ms 0.5ms 0.9MB 1020ms 0ms nim 1.6.8
crystal 1.cr 1510ms 2.7ms 5.9MB 1497ms 0ms crystal 1.5.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.9ms 1.0MB 250ms 0ms nim 1.6.8
nim 1.nim 261ms 1.0ms 1.0MB 250ms 0ms nim/clang 1.6.8
crystal 1.cr 381ms 0.4ms 5.6MB 370ms 0ms crystal 1.5.1