Programming Language and compiler
Benchmarks

Chapel VS Kotlin benchmarks

Current benchmark data was generated on Mon May 19 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 491ms 9.8ms 576.6MB 603ms 80ms kotlin/jvm 21
chapel 4.chpl 1952ms 9.9ms 62.3MB 1943ms 3ms chpl 1.31.0
chapel 3.chpl 2127ms 36ms 62.3MB 2120ms 0ms chpl 1.31.0
kotlin 1.kt 4175ms 24ms 143.7MB 4367ms 73ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 121ms 0.9ms 159.3MB 150ms 30ms kotlin/jvm 21
chapel 4.chpl 184ms 1.8ms 30.3MB 180ms 0ms chpl 1.31.0
chapel 3.chpl 186ms 1.6ms 32.3MB 183ms 0ms chpl 1.31.0
kotlin 1.kt 235ms 15ms 17.6MB 240ms 7ms kotlin/native 2.1.20

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1893ms 160ms 233.8MB 7030ms 100ms kotlin/jvm 21
kotlin 1.kt 2169ms 49ms 220.1MB 3017ms 67ms kotlin/jvm 21
chapel 1-m.chpl 2280ms 43ms 659.8MB 4437ms 87ms chpl 1.31.0
kotlin 2-m.kt 4283ms 17ms 21.6MB 14280ms 553ms kotlin/native 2.1.20
kotlin 1.kt timeout 0.0ms 17.4MB 5517ms 30ms kotlin/native 2.1.20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 206ms 4.4ms 630.1MB 320ms 60ms chpl 1.31.0
kotlin 2-m.kt 248ms 4.5ms 21.1MB 837ms 40ms kotlin/native 2.1.20
kotlin 1.kt 395ms 2.7ms 17.4MB 403ms 7ms kotlin/native 2.1.20
kotlin 1-m.kt 495ms 6.5ms 76.4MB 1130ms 40ms kotlin/jvm 21
kotlin 2-m.kt 920ms 72ms 97.4MB 3233ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 71ms 1.6ms 32.5MB 70ms 0ms chpl 1.31.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 33ms 3.0ms 30.5MB 30ms 0ms chpl 1.31.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 105ms 0.9ms 28.4MB 190ms 0ms chpl 1.31.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 22ms 2.1ms 28.4MB 20ms 0ms chpl 1.31.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.1ms 0.2ms 3.0MB 0ms 0ms kotlin/native 2.1.20
chapel 1.chpl 11ms 0.3ms 28.8MB 0ms 0ms chpl 1.31.0
kotlin 1.kt 64ms 5.9ms 47.6MB 78ms 18ms kotlin/jvm 21

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 749ms 3.1ms 86.9MB 1420ms 7ms chpl 1.31.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 115ms 1.4ms 77.0MB 200ms 0ms chpl 1.31.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 322ms 4.1ms 28.9MB 317ms 0ms chpl 1.31.0
kotlin 1n.kt 353ms 3.9ms 3.6MB 343ms 0ms kotlin/native 2.1.20
kotlin 1.kt 445ms 1.8ms 49.2MB 490ms 20ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 39ms 0.2ms 3.6MB 30ms 0ms kotlin/native 2.1.20
chapel 2.chpl 45ms 0.3ms 28.9MB 40ms 0ms chpl 1.31.0
kotlin 1-m.kt 121ms 2.3ms 49.4MB 170ms 20ms kotlin/jvm 21

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 445ms 2.1ms 30.4MB 440ms 0ms chpl 1.31.0
kotlin 1.kt 3724ms 64ms 352.5MB 4500ms 100ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 26.3MB 3990ms 1497ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.6MB 5130ms 127ms kotlin/native 2.1.20

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 115ms 0.6ms 30.4MB 110ms 0ms chpl 1.31.0
kotlin 1-m.kt 1018ms 20ms 353.5MB 1703ms 90ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 26.7MB 3990ms 1510ms kotlin/native 2.1.20
kotlin 2n.kt timeout 0.0ms 30.6MB 5113ms 130ms kotlin/native 2.1.20

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1396ms 9.0ms 220.1MB 1353ms 37ms chpl 1.31.0
kotlin 1.kt timeout 0.0ms 173.6MB 5407ms 47ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 226.8MB 5080ms 117ms kotlin/native 2.1.20

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 163ms 2.2ms 48.9MB 140ms 13ms chpl 1.31.0
kotlin 1-m.kt 839ms 12ms 134.6MB 1270ms 40ms kotlin/jvm 21
kotlin 1n.kt 3231ms 31ms 51.1MB 3300ms 70ms kotlin/native 2.1.20

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1184ms 16ms 29.1MB 1177ms 0ms chpl 1.31.0
kotlin 1.kt 3038ms 2.3ms 231.8MB 4063ms 77ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 315ms 8.4ms 29.1MB 310ms 0ms chpl 1.31.0
kotlin 1-m.kt 979ms 51ms 232.1MB 1937ms 67ms kotlin/jvm 21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 1912ms 1.5ms 28.9MB 3800ms 0ms chpl 1.31.0
chapel 1.chpl 3730ms 9.2ms 28.8MB 3720ms 0ms chpl 1.31.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 492ms 1.7ms 28.8MB 960ms 0ms chpl 1.31.0
chapel 1.chpl 940ms 3.7ms 28.8MB 933ms 0ms chpl 1.31.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 134ms 0.9ms 28.9MB 240ms 0ms chpl 1.31.0
chapel 1.chpl 249ms 2.0ms 28.8MB 243ms 0ms chpl 1.31.0