Programming Language and compiler
Benchmarks

Crystal VS Kotlin benchmarks

Current benchmark data was generated on Mon Apr 14 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 513ms 4.4ms 577.8MB 603ms 107ms kotlin/jvm 21
crystal 1.cr 1247ms 8.3ms 64.0MB 1223ms 13ms crystal 1.16.0
kotlin 1.kt 4515ms 38ms 146.1MB 4703ms 67ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 107ms 2.4ms 10.9MB 97ms 0ms crystal 1.16.0
kotlin 1.kt 126ms 1.8ms 161.2MB 150ms 37ms kotlin/jvm 21
kotlin 1.kt 318ms 32ms 17.9MB 327ms 7ms kotlin/native 2.1.20

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1555ms 17ms 19.8MB 1483ms 60ms crystal 1.16.0
kotlin 2-m.kt 2184ms 180ms 244.6MB 8133ms 130ms kotlin/jvm 21
kotlin 1.kt 2217ms 57ms 220.3MB 3067ms 70ms kotlin/jvm 21
kotlin 2-m.kt 4498ms 30ms 21.5MB 14707ms 610ms kotlin/native 2.1.20
kotlin 1.kt timeout 0.0ms 17.4MB 5523ms 30ms kotlin/native 2.1.20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 86ms 2.7ms 7.0MB 67ms 10ms crystal 1.16.0
kotlin 2-m.kt 253ms 6.4ms 21.3MB 847ms 40ms kotlin/native 2.1.20
kotlin 1.kt 409ms 11ms 17.4MB 420ms 10ms kotlin/native 2.1.20
kotlin 1-m.kt 492ms 12ms 77.2MB 1140ms 43ms kotlin/jvm 21
kotlin 2-m.kt 969ms 186ms 109.2MB 3360ms 83ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 59ms 0.2ms 6.4MB 40ms 3ms crystal 1.16.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.2ms 5.1MB 10ms 0ms crystal 1.16.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2465ms 3.2ms 2.8MB 2457ms 0ms crystal 1.16.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 204ms 1.4ms 2.8MB 190ms 0ms crystal 1.16.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 553ms 1.2ms 3.5MB 453ms 87ms crystal 1.16.0
crystal 1.cr 691ms 0.8ms 14.4MB 573ms 107ms crystal 1.16.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 61ms 0.9ms 3.5MB 40ms 10ms crystal 1.16.0
crystal 1.cr 74ms 1.6ms 4.8MB 50ms 10ms crystal 1.16.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.1ms 2.8MB 0ms 0ms crystal 1.16.0
kotlin 1.kt 2.1ms 0.1ms 3.1MB 0ms 0ms kotlin/native 2.1.20
kotlin 1.kt 67ms 2.3ms 47.7MB 82ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2319ms 124ms 255.6MB 313ms 490ms crystal 1.16.0
kotlin 1.kt timeout 0.0ms 405.5MB 16143ms 2733ms kotlin/jvm 21
kotlin 2.kt timeout 0.0ms 458.9MB 15747ms 2687ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1250ms 107ms 59.0MB 37ms 80ms crystal 1.16.0
kotlin 1-m.kt 2223ms 205ms 254.3MB 6403ms 687ms kotlin/jvm 21
kotlin 2-m.kt 2233ms 250ms 249.5MB 6100ms 650ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.4ms 2.9MB 30ms 0ms crystal 1.16.0
crystal 1.cr 64ms 0.9ms 2.9MB 53ms 0ms crystal 1.16.0
kotlin 2.kt 171ms 2.7ms 12.4MB 173ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 200ms 3.0ms 96.7MB 333ms 27ms kotlin/jvm 21
kotlin 2-m.kt 212ms 8.2ms 105.3MB 453ms 40ms kotlin/jvm 21
kotlin 1.kt 357ms 2.2ms 12.5MB 363ms 3ms kotlin/native 2.1.20

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 99ms 1.1ms 2.9MB 90ms 0ms crystal 1.16.0
crystal 1.cr 185ms 0.7ms 2.9MB 173ms 0ms crystal 1.16.0
kotlin 2-m.kt 325ms 2.7ms 215.9MB 557ms 50ms kotlin/jvm 21
kotlin 1.kt 344ms 2.7ms 204.8MB 463ms 40ms kotlin/jvm 21
kotlin 2.kt 476ms 6.0ms 12.6MB 507ms 3ms kotlin/native 2.1.20
kotlin 1.kt 1043ms 15ms 12.6MB 1080ms 3ms kotlin/native 2.1.20

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 1.3ms 2.9MB 10ms 0ms crystal 1.16.0
crystal 1.cr 30ms 1.7ms 2.9MB 20ms 0ms crystal 1.16.0
kotlin 2.kt 94ms 0.7ms 12.8MB 87ms 3ms kotlin/native 2.1.20
kotlin 1.kt 122ms 2.7ms 12.9MB 117ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 159ms 1.4ms 92.7MB 320ms 20ms kotlin/jvm 21
kotlin 2-m.kt 167ms 2.2ms 98.3MB 350ms 37ms kotlin/jvm 21

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 313ms 1.1ms 9.1MB 300ms 0ms crystal 1.16.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 17ms 0.4ms 6.3MB 10ms 0ms crystal 1.16.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 391ms 4.1ms 682.5MB 453ms 93ms kotlin/jvm 21
crystal 1.cr 843ms 7.3ms 64.0MB 823ms 10ms crystal 1.16.0
kotlin 1.kt 2170ms 19ms 88.8MB 2273ms 40ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 163ms 0.8ms 209.4MB 213ms 50ms kotlin/jvm 21
crystal 1.cr 174ms 5.4ms 22.1MB 157ms 0ms crystal 1.16.0
kotlin 1.kt 426ms 7.1ms 25.7MB 437ms 10ms kotlin/native 2.1.20

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 344ms 0.9ms 3.1MB 333ms 0ms crystal 1.16.0
crystal 2.cr 344ms 2.7ms 3.1MB 333ms 0ms crystal 1.16.0
kotlin 1n.kt 352ms 1.7ms 3.5MB 340ms 0ms kotlin/native 2.1.20
kotlin 1.kt 448ms 1.3ms 49.3MB 493ms 17ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.6ms 3.1MB 30ms 0ms crystal 1.16.0
crystal 1.cr 39ms 0.7ms 3.3MB 30ms 0ms crystal 1.16.0
kotlin 1n.kt 39ms 0.9ms 3.5MB 30ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 126ms 3.5ms 49.4MB 173ms 20ms kotlin/jvm 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 298ms 3.7ms 8.1MB 287ms 0ms crystal 1.16.0
crystal 1.cr 425ms 7.5ms 62.4MB 410ms 0ms crystal 1.16.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 74ms 1.4ms 4.4MB 67ms 0ms crystal 1.16.0
crystal 1.cr 88ms 0.8ms 13.0MB 80ms 0ms crystal 1.16.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1901ms 45ms 6.2MB 1870ms 17ms crystal 1.16.0
kotlin 1.kt 3792ms 49ms 385.9MB 4713ms 107ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 27.0MB 4077ms 1520ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.4MB 5163ms 130ms kotlin/native 2.1.20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 438ms 9.9ms 5.1MB 423ms 0ms crystal 1.16.0
kotlin 1-m.kt 992ms 27ms 355.5MB 1823ms 100ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 26.6MB 4110ms 1483ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.9MB 5130ms 163ms kotlin/native 2.1.20

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 3762ms 7.2ms 4.5MB 3753ms 0ms crystal 1.16.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 950ms 9.5ms 4.3MB 940ms 0ms crystal 1.16.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 240ms 2.6ms 3.8MB 233ms 0ms crystal 1.16.0