Programming Language and compiler
Benchmarks

Kotlin VS Crystal benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 492ms 10ms 578.8MB 590ms 93ms kotlin/jvm 21
crystal 1.cr 1235ms 5.9ms 64.2MB 1210ms 10ms crystal 1.16.2
kotlin 1.kt 3846ms 34ms 144.1MB 4020ms 77ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 107ms 1.5ms 11.0MB 93ms 0ms crystal 1.16.2
kotlin 1.kt 121ms 3.2ms 163.1MB 143ms 33ms kotlin/jvm 21
kotlin 1.kt 204ms 3.4ms 17.6MB 210ms 3ms kotlin/native 2.1.20

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1514ms 13ms 19.9MB 1450ms 53ms crystal 1.16.2
kotlin 2-m.kt 1966ms 64ms 237.9MB 7327ms 110ms kotlin/jvm 21
kotlin 1.kt 2131ms 19ms 217.3MB 2937ms 73ms kotlin/jvm 21
kotlin 2-m.kt 4241ms 30ms 21.4MB 14193ms 557ms kotlin/native 2.1.20
kotlin 1.kt timeout 0.0ms 17.4MB 5507ms 27ms kotlin/native 2.1.20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 85ms 1.3ms 7.1MB 63ms 10ms crystal 1.16.2
kotlin 2-m.kt 250ms 1.5ms 21.3MB 833ms 47ms kotlin/native 2.1.20
kotlin 1.kt 387ms 13ms 17.4MB 397ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 480ms 15ms 74.4MB 1100ms 47ms kotlin/jvm 21
kotlin 2-m.kt 881ms 82ms 95.9MB 3080ms 67ms kotlin/jvm 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.1ms 2.9MB 0ms 0ms crystal 1.16.2
kotlin 1.kt 2.2ms 0.2ms 3.1MB 0ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 61ms 0.9ms 47.6MB 78ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2259ms 358ms 211.1MB 313ms 487ms crystal 1.16.2
kotlin 2-m.kt 4772ms 83ms 444.0MB 14403ms 2467ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 404.3MB 15977ms 2973ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1184ms 99ms 54.9MB 33ms 83ms crystal 1.16.2
kotlin 1-m.kt 2042ms 296ms 229.7MB 6220ms 627ms kotlin/jvm 21
kotlin 2-m.kt 2149ms 29ms 238.8MB 5513ms 630ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 779ms 88ms 173.9MB 2120ms 73ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 1881ms 40ms 702.6MB 4407ms 157ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 0.6ms 3.0MB 30ms 0ms crystal 1.16.2
crystal 1.cr 65ms 1.4ms 3.0MB 57ms 0ms crystal 1.16.2
kotlin 1-m.kt 196ms 4.7ms 95.0MB 317ms 33ms kotlin/jvm 21
kotlin 2.kt 197ms 54ms 12.5MB 197ms 3ms kotlin/native 2.1.20
kotlin 2-m.kt 203ms 3.6ms 101.8MB 443ms 37ms kotlin/jvm 21
kotlin 1.kt 359ms 0.8ms 12.4MB 363ms 0ms kotlin/native 2.1.20

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 99ms 0.9ms 3.0MB 90ms 0ms crystal 1.16.2
crystal 1.cr 187ms 2.0ms 3.0MB 180ms 0ms crystal 1.16.2
kotlin 2-m.kt 316ms 6.8ms 213.9MB 543ms 50ms kotlin/jvm 21
kotlin 1.kt 342ms 5.5ms 202.7MB 460ms 30ms kotlin/jvm 21
kotlin 2.kt 485ms 11ms 12.4MB 523ms 0ms kotlin/native 2.1.20
kotlin 1.kt 1055ms 17ms 12.5MB 1087ms 3ms kotlin/native 2.1.20

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 17ms 0.3ms 3.0MB 10ms 0ms crystal 1.16.2
crystal 1.cr 30ms 1.3ms 3.0MB 20ms 0ms crystal 1.16.2
kotlin 2.kt 93ms 1.7ms 12.9MB 87ms 0ms kotlin/native 2.1.20
kotlin 1.kt 122ms 1.5ms 12.8MB 113ms 3ms kotlin/native 2.1.20
kotlin 1-m.kt 150ms 3.8ms 90.8MB 293ms 20ms kotlin/jvm 21
kotlin 2-m.kt 163ms 4.5ms 96.5MB 353ms 27ms kotlin/jvm 21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 406ms 17ms 680.2MB 453ms 90ms kotlin/jvm 21
crystal 1.cr 846ms 6.4ms 64.2MB 823ms 10ms crystal 1.16.2
kotlin 1.kt 1821ms 13ms 89.8MB 1913ms 43ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 159ms 7.9ms 207.3MB 207ms 40ms kotlin/jvm 21
crystal 1.cr 175ms 0.8ms 22.2MB 160ms 0ms crystal 1.16.2
kotlin 1.kt 259ms 1.7ms 24.9MB 263ms 10ms kotlin/native 2.1.20

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 343ms 0.7ms 3.3MB 330ms 0ms crystal 1.16.2
crystal 2.cr 344ms 2.9ms 3.3MB 333ms 0ms crystal 1.16.2
kotlin 1n.kt 350ms 1.7ms 3.5MB 340ms 0ms kotlin/native 2.1.20
kotlin 1.kt 443ms 1.3ms 49.4MB 487ms 13ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.5ms 3.3MB 30ms 0ms crystal 1.16.2
crystal 1.cr 38ms 1.1ms 3.3MB 30ms 0ms crystal 1.16.2
kotlin 1n.kt 39ms 0.9ms 3.6MB 30ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 119ms 0.7ms 49.7MB 167ms 20ms kotlin/jvm 21

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1973ms 67ms 6.3MB 1947ms 17ms crystal 1.16.2
kotlin 1.kt 3800ms 74ms 352.9MB 4630ms 117ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 26.3MB 4013ms 1483ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.8MB 5123ms 127ms kotlin/native 2.1.20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 457ms 15ms 5.1MB 443ms 0ms crystal 1.16.2
kotlin 1-m.kt 984ms 36ms 353.1MB 1740ms 87ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 26.6MB 4027ms 1493ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.9MB 5110ms 130ms kotlin/native 2.1.20

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt timeout 0.0ms 173.5MB 5410ms 47ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 226.8MB 5060ms 130ms kotlin/native 2.1.20

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 842ms 18ms 134.5MB 1290ms 40ms kotlin/jvm 21
kotlin 1n.kt 3207ms 14ms 51.3MB 3277ms 73ms kotlin/native 2.1.20

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 3072ms 52ms 231.6MB 4040ms 80ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 1010ms 43ms 231.7MB 1910ms 67ms kotlin/jvm 21