Programming Language and compiler
Benchmarks

OCaml VS Kotlin benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 482ms 0.5ms 578.0MB 560ms 90ms kotlin/jvm 21
ocaml 1.ml 3139ms 30ms 157.2MB 3050ms 73ms ocaml 5.3.0
kotlin 1-m.kt 3201ms 42ms 246.5MB 5153ms 850ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 107ms 0.7ms 160.3MB 117ms 27ms kotlin/jvm 21
ocaml 1.ml 228ms 11ms 19.2MB 213ms 0ms ocaml 5.3.0
kotlin 1-m.kt 283ms 2.6ms 30.5MB 453ms 67ms kotlin/native 1.8.21

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2918ms 4.8ms 4.9MB 2910ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 1.4ms 4.9MB 237ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 0.3ms 24.8MB 330ms 0ms ocaml 5.3.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.3ms 7.3MB 30ms 0ms ocaml 5.3.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.2ms 5.1MB 0ms 0ms ocaml 5.3.0
kotlin 1.kt 2.2ms 0.4ms 2.6MB 0ms 0ms kotlin/native 1.8.21
kotlin 1.kt 59ms 4.0ms 47.2MB 56ms 16ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 178ms 2.2ms 6.4MB 170ms 0ms ocaml 5.3.0
kotlin 1-m.kt 181ms 4.2ms 96.8MB 300ms 27ms kotlin/jvm 21
kotlin 2-m.kt 198ms 2.0ms 103.5MB 420ms 40ms kotlin/jvm 21
kotlin 2.kt 310ms 2.1ms 5.9MB 433ms 20ms kotlin/native 1.8.21
kotlin 1.kt 518ms 11ms 5.8MB 620ms 3ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 307ms 3.5ms 215.7MB 537ms 43ms kotlin/jvm 21
kotlin 1.kt 335ms 2.6ms 204.7MB 443ms 43ms kotlin/jvm 21
ocaml 1.ml 535ms 18ms 6.6MB 523ms 0ms ocaml 5.3.0
kotlin 2.kt 927ms 16ms 7.1MB 1330ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1539ms 8.4ms 5.8MB 1870ms 23ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 77ms 0.5ms 6.1MB 70ms 0ms ocaml 5.3.0
kotlin 2.kt 142ms 1.4ms 3.6MB 200ms 0ms kotlin/native 1.8.21
kotlin 1-m.kt 142ms 1.4ms 92.3MB 267ms 30ms kotlin/jvm 21
kotlin 2-m.kt 153ms 3.2ms 95.8MB 303ms 30ms kotlin/jvm 21
kotlin 1.kt 171ms 1.8ms 3.8MB 217ms 0ms kotlin/native 1.8.21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 361ms 2.6ms 681.5MB 383ms 97ms kotlin/jvm 21
ocaml 1.ml 1104ms 1.1ms 70.3MB 1060ms 30ms ocaml 5.3.0
kotlin 1-m.kt 1532ms 6.5ms 134.6MB 2337ms 353ms kotlin/native 1.8.21
ocaml 2.ml 2279ms 5.8ms 91.8MB 2220ms 43ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 133ms 0.6ms 208.5MB 157ms 37ms kotlin/jvm 21
ocaml 1.ml 149ms 3.1ms 21.6MB 130ms 7ms ocaml 5.3.0
kotlin 1-m.kt 312ms 1.7ms 38.5MB 457ms 73ms kotlin/native 1.8.21
ocaml 2.ml 396ms 3.4ms 27.7MB 377ms 7ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 374ms 0.4ms 5.3MB 367ms 0ms ocaml 5.3.0
kotlin 1n.kt 404ms 1.3ms 2.5MB 393ms 0ms kotlin/native 1.8.21
kotlin 1.kt 453ms 4.2ms 49.4MB 497ms 20ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 41ms 0.7ms 5.2MB 30ms 0ms ocaml 5.3.0
kotlin 1n.kt 44ms 0.5ms 2.5MB 37ms 0ms kotlin/native 1.8.21
kotlin 1.kt 123ms 1.5ms 49.5MB 170ms 13ms kotlin/jvm 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1019ms 4.4ms 544.4MB 960ms 43ms ocaml 5.3.0
ocaml 2.ml 1896ms 11ms 17.2MB 1883ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 197ms 0.6ms 128.8MB 173ms 10ms ocaml 5.3.0
ocaml 2.ml 469ms 5.3ms 9.1MB 457ms 0ms ocaml 5.3.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt timeout 0.0ms 171.3MB 5430ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 277.0MB 5163ms 730ms kotlin/native 1.8.21
ocaml 2.ml timeout 0.0ms 462.7MB 4810ms 173ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 550ms 6.1ms 57.1MB 507ms 27ms ocaml 5.3.0
kotlin 1-m.kt 821ms 21ms 137.7MB 1247ms 47ms kotlin/jvm 21
kotlin 1n.kt 3187ms 12ms 65.0MB 3933ms 17ms kotlin/native 1.8.21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4585ms 15ms 6.4MB 4573ms 0ms ocaml 5.3.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1148ms 6.8ms 6.1MB 1140ms 0ms ocaml 5.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 296ms 5.1ms 5.2MB 287ms 0ms ocaml 5.3.0