Programming Language and compiler
Benchmarks

Chapel VS Kotlin benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 482ms 0.5ms 578.0MB 560ms 90ms kotlin/jvm 21
chapel 3.chpl 2069ms 6.5ms 60.3MB 2057ms 0ms chpl 1.31.0
chapel 4.chpl 2076ms 200ms 62.2MB 2063ms 3ms chpl 1.31.0
kotlin 1-m.kt 3201ms 42ms 246.5MB 5153ms 850ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 107ms 0.7ms 160.3MB 117ms 27ms kotlin/jvm 21
chapel 3.chpl 188ms 1.6ms 32.2MB 180ms 0ms chpl 1.31.0
chapel 4.chpl 196ms 21ms 32.3MB 190ms 0ms chpl 1.31.0
kotlin 1-m.kt 283ms 2.6ms 30.5MB 453ms 67ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1971ms 329ms 240.9MB 7313ms 117ms kotlin/jvm 21
kotlin 1.kt 2173ms 16ms 221.5MB 2997ms 77ms kotlin/jvm 21
chapel 1-m.chpl 2266ms 93ms 525.8MB 4393ms 80ms chpl 1.31.0
kotlin 1.kt timeout 0.0ms 12.7MB 5997ms 487ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 69.6MB 19047ms 153ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 198ms 4.8ms 494.6MB 317ms 50ms chpl 1.31.0
kotlin 2-m.kt 432ms 2.7ms 14.5MB 1600ms 20ms kotlin/native 1.8.21
kotlin 1-m.kt 468ms 13ms 76.2MB 1060ms 43ms kotlin/jvm 21
kotlin 1.kt 689ms 14ms 8.8MB 817ms 63ms kotlin/native 1.8.21
kotlin 2-m.kt 815ms 9.7ms 96.8MB 2827ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 73ms 2.7ms 32.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 34ms 1.3ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 106ms 1.8ms 28.3MB 190ms 0ms chpl 1.31.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 21ms 1.3ms 28.4MB 20ms 0ms chpl 1.31.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.2ms 0.4ms 2.6MB 0ms 0ms kotlin/native 1.8.21
chapel 1.chpl 11ms 0.5ms 28.8MB 0ms 0ms chpl 1.31.0
kotlin 1.kt 59ms 4.0ms 47.2MB 56ms 16ms kotlin/jvm 21

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 747ms 1.1ms 87.0MB 1410ms 10ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 116ms 0.5ms 87.0MB 200ms 3ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 326ms 5.3ms 28.9MB 317ms 0ms chpl 1.31.0
kotlin 1n.kt 404ms 1.3ms 2.5MB 393ms 0ms kotlin/native 1.8.21
kotlin 1.kt 453ms 4.2ms 49.4MB 497ms 20ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 44ms 0.5ms 2.5MB 37ms 0ms kotlin/native 1.8.21
chapel 2.chpl 45ms 2.3ms 28.8MB 40ms 0ms chpl 1.31.0
kotlin 1.kt 123ms 1.5ms 49.5MB 170ms 13ms kotlin/jvm 21

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 446ms 2.3ms 28.4MB 440ms 0ms chpl 1.31.0
kotlin 1.kt 3765ms 63ms 355.2MB 4593ms 107ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.4MB 6277ms 300ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.3MB 4990ms 180ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 116ms 1.2ms 30.3MB 110ms 0ms chpl 1.31.0
kotlin 1-m.kt 1000ms 30ms 355.3MB 1780ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.4MB 6287ms 287ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.2MB 5010ms 157ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1399ms 7.7ms 222.1MB 1347ms 43ms chpl 1.31.0
kotlin 1.kt timeout 0.0ms 171.3MB 5430ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 277.0MB 5163ms 730ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 164ms 2.9ms 49.0MB 150ms 10ms chpl 1.31.0
kotlin 1-m.kt 821ms 21ms 137.7MB 1247ms 47ms kotlin/jvm 21
kotlin 1n.kt 3187ms 12ms 65.0MB 3933ms 17ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1181ms 3.6ms 29.2MB 1177ms 0ms chpl 1.31.0
kotlin 1.kt 3098ms 21ms 233.4MB 3973ms 77ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 308ms 2.9ms 29.0MB 303ms 0ms chpl 1.31.0
kotlin 1-m.kt 1009ms 48ms 235.5MB 1923ms 73ms kotlin/jvm 21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1928ms 19ms 28.8MB 3830ms 0ms chpl 1.31.0
chapel 1.chpl 3725ms 17ms 28.8MB 3720ms 0ms chpl 1.31.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 0.6ms 28.5MB 957ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 1.1ms 28.8MB 933ms 0ms chpl 1.31.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 135ms 1.0ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 247ms 2.4ms 28.8MB 240ms 0ms chpl 1.31.0