Programming Language and compiler
Benchmarks

Crystal VS Kotlin benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 482ms 0.5ms 578.0MB 560ms 90ms kotlin/jvm 21
crystal 1.cr 1276ms 8.3ms 64.0MB 1257ms 0ms crystal 1.15.1
kotlin 1-m.kt 3201ms 42ms 246.5MB 5153ms 850ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 105ms 2.2ms 10.9MB 90ms 0ms crystal 1.15.1
kotlin 1.kt 107ms 0.7ms 160.3MB 117ms 27ms kotlin/jvm 21
kotlin 1-m.kt 283ms 2.6ms 30.5MB 453ms 67ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1381ms 34ms 19.6MB 1307ms 57ms crystal 1.15.1
kotlin 2-m.kt 1971ms 329ms 240.9MB 7313ms 117ms kotlin/jvm 21
kotlin 1.kt 2173ms 16ms 221.5MB 2997ms 77ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 12.7MB 5997ms 487ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 69.6MB 19047ms 153ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 71ms 3.7ms 7.1MB 50ms 10ms crystal 1.15.1
kotlin 2-m.kt 432ms 2.7ms 14.5MB 1600ms 20ms kotlin/native 1.8.21
kotlin 1-m.kt 468ms 13ms 76.2MB 1060ms 43ms kotlin/jvm 21
kotlin 1.kt 689ms 14ms 8.8MB 817ms 63ms kotlin/native 1.8.21
kotlin 2-m.kt 815ms 9.7ms 96.8MB 2827ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 59ms 1.7ms 6.4MB 43ms 0ms crystal 1.15.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 22ms 0.7ms 5.1MB 10ms 0ms crystal 1.15.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2508ms 6.1ms 2.8MB 2493ms 0ms crystal 1.15.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 207ms 1.2ms 2.8MB 200ms 0ms crystal 1.15.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 555ms 3.0ms 3.4MB 450ms 90ms crystal 1.15.1
crystal 1.cr 694ms 0.6ms 14.4MB 573ms 107ms crystal 1.15.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 59ms 0.3ms 3.4MB 40ms 7ms crystal 1.15.1
crystal 1.cr 75ms 1.4ms 4.8MB 57ms 7ms crystal 1.15.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.0ms 0.5ms 2.8MB 0ms 0ms crystal 1.15.1
kotlin 1.kt 2.2ms 0.4ms 2.6MB 0ms 0ms kotlin/native 1.8.21
kotlin 1.kt 59ms 4.0ms 47.2MB 56ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1690ms 21ms 287.8MB 323ms 510ms crystal 1.15.1
kotlin 2-m.kt 4877ms 110ms 433.3MB 14973ms 2650ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 400.8MB 16150ms 2810ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1190ms 102ms 59.1MB 37ms 83ms crystal 1.15.1
kotlin 1-m.kt 2051ms 215ms 216.8MB 5830ms 630ms kotlin/jvm 21
kotlin 2-m.kt 2169ms 316ms 243.8MB 3967ms 420ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.3ms 2.9MB 30ms 0ms crystal 1.15.1
crystal 1.cr 65ms 2.1ms 2.9MB 57ms 0ms crystal 1.15.1
kotlin 1-m.kt 181ms 4.2ms 96.8MB 300ms 27ms kotlin/jvm 21
kotlin 2-m.kt 198ms 2.0ms 103.5MB 420ms 40ms kotlin/jvm 21
kotlin 2.kt 310ms 2.1ms 5.9MB 433ms 20ms kotlin/native 1.8.21
kotlin 1.kt 518ms 11ms 5.8MB 620ms 3ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 103ms 1.4ms 2.9MB 90ms 0ms crystal 1.15.1
crystal 1.cr 186ms 1.8ms 2.9MB 177ms 0ms crystal 1.15.1
kotlin 2-m.kt 307ms 3.5ms 215.7MB 537ms 43ms kotlin/jvm 21
kotlin 1.kt 335ms 2.6ms 204.7MB 443ms 43ms kotlin/jvm 21
kotlin 2.kt 927ms 16ms 7.1MB 1330ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1539ms 8.4ms 5.8MB 1870ms 23ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 17ms 0.5ms 2.9MB 10ms 0ms crystal 1.15.1
crystal 1.cr 31ms 1.7ms 2.9MB 20ms 0ms crystal 1.15.1
kotlin 2.kt 142ms 1.4ms 3.6MB 200ms 0ms kotlin/native 1.8.21
kotlin 1-m.kt 142ms 1.4ms 92.3MB 267ms 30ms kotlin/jvm 21
kotlin 2-m.kt 153ms 3.2ms 95.8MB 303ms 30ms kotlin/jvm 21
kotlin 1.kt 171ms 1.8ms 3.8MB 217ms 0ms kotlin/native 1.8.21

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 313ms 0.7ms 9.2MB 300ms 0ms crystal 1.15.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.5ms 6.3MB 10ms 0ms crystal 1.15.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 361ms 2.6ms 681.5MB 383ms 97ms kotlin/jvm 21
crystal 1.cr 864ms 6.5ms 64.0MB 843ms 10ms crystal 1.15.1
kotlin 1-m.kt 1532ms 6.5ms 134.6MB 2337ms 353ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 133ms 0.6ms 208.5MB 157ms 37ms kotlin/jvm 21
crystal 1.cr 157ms 3.4ms 22.1MB 143ms 0ms crystal 1.15.1
kotlin 1-m.kt 312ms 1.7ms 38.5MB 457ms 73ms kotlin/native 1.8.21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 344ms 4.8ms 3.3MB 333ms 0ms crystal 1.15.1
crystal 1.cr 345ms 2.6ms 3.3MB 333ms 0ms crystal 1.15.1
kotlin 1n.kt 404ms 1.3ms 2.5MB 393ms 0ms kotlin/native 1.8.21
kotlin 1.kt 453ms 4.2ms 49.4MB 497ms 20ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 38ms 1.5ms 3.1MB 30ms 0ms crystal 1.15.1
crystal 2.cr 38ms 0.5ms 3.1MB 30ms 0ms crystal 1.15.1
kotlin 1n.kt 44ms 0.5ms 2.5MB 37ms 0ms kotlin/native 1.8.21
kotlin 1.kt 123ms 1.5ms 49.5MB 170ms 13ms kotlin/jvm 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 301ms 3.6ms 8.1MB 290ms 0ms crystal 1.15.1
crystal 1.cr 440ms 6.5ms 42.3MB 430ms 0ms crystal 1.15.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 77ms 2.1ms 4.4MB 67ms 0ms crystal 1.15.1
crystal 1.cr 91ms 3.7ms 13.0MB 80ms 0ms crystal 1.15.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1886ms 42ms 6.2MB 1853ms 17ms crystal 1.15.1
kotlin 1.kt 3765ms 63ms 355.2MB 4593ms 107ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.4MB 6277ms 300ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.3MB 4990ms 180ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 479ms 12ms 5.0MB 463ms 0ms crystal 1.15.1
kotlin 1-m.kt 1000ms 30ms 355.3MB 1780ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.4MB 6287ms 287ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.2MB 5010ms 157ms kotlin/native 1.8.21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3792ms 11ms 4.5MB 3783ms 0ms crystal 1.15.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 952ms 1.2ms 4.3MB 940ms 0ms crystal 1.15.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 248ms 11ms 3.8MB 237ms 0ms crystal 1.15.1