Programming Language and compiler
Benchmarks

OCaml VS Kotlin benchmarks

Current benchmark data was generated on Thu May 01 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 492ms 10ms 578.8MB 590ms 93ms kotlin/jvm 21
ocaml 1.ml 3316ms 13ms 157.1MB 3237ms 67ms ocaml 5.3.0
kotlin 1.kt 3846ms 34ms 144.1MB 4020ms 77ms kotlin/native 2.1.20

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 121ms 3.2ms 163.1MB 143ms 33ms kotlin/jvm 21
kotlin 1.kt 204ms 3.4ms 17.6MB 210ms 3ms kotlin/native 2.1.20
ocaml 1.ml 247ms 3.4ms 19.1MB 233ms 0ms ocaml 5.3.0

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2912ms 1.6ms 4.9MB 2900ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 244ms 1.2ms 4.9MB 237ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 1.2ms 24.8MB 330ms 0ms ocaml 5.3.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 38ms 0.9ms 7.5MB 30ms 0ms ocaml 5.3.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.7ms 0.2ms 5.0MB 0ms 0ms ocaml 5.3.0
kotlin 1.kt 2.2ms 0.2ms 3.1MB 0ms 0ms kotlin/native 2.1.20
kotlin 1-m.kt 61ms 0.9ms 47.6MB 78ms 16ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 180ms 3.9ms 6.4MB 167ms 0ms ocaml 5.3.0
kotlin 1-m.kt 196ms 4.7ms 95.0MB 317ms 33ms kotlin/jvm 21
kotlin 2.kt 197ms 54ms 12.5MB 197ms 3ms kotlin/native 2.1.20
kotlin 2-m.kt 203ms 3.6ms 101.8MB 443ms 37ms kotlin/jvm 21
kotlin 1.kt 359ms 0.8ms 12.4MB 363ms 0ms kotlin/native 2.1.20

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 316ms 6.8ms 213.9MB 543ms 50ms kotlin/jvm 21
kotlin 1.kt 342ms 5.5ms 202.7MB 460ms 30ms kotlin/jvm 21
kotlin 2.kt 485ms 11ms 12.4MB 523ms 0ms kotlin/native 2.1.20
ocaml 1.ml 539ms 20ms 6.6MB 530ms 0ms ocaml 5.3.0
kotlin 1.kt 1055ms 17ms 12.5MB 1087ms 3ms kotlin/native 2.1.20

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 77ms 1.5ms 5.9MB 70ms 0ms ocaml 5.3.0
kotlin 2.kt 93ms 1.7ms 12.9MB 87ms 0ms kotlin/native 2.1.20
kotlin 1.kt 122ms 1.5ms 12.8MB 113ms 3ms kotlin/native 2.1.20
kotlin 1-m.kt 150ms 3.8ms 90.8MB 293ms 20ms kotlin/jvm 21
kotlin 2-m.kt 163ms 4.5ms 96.5MB 353ms 27ms kotlin/jvm 21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 406ms 17ms 680.2MB 453ms 90ms kotlin/jvm 21
ocaml 1.ml 1072ms 7.8ms 70.2MB 1030ms 23ms ocaml 5.3.0
kotlin 1.kt 1821ms 13ms 89.8MB 1913ms 43ms kotlin/native 2.1.20
ocaml 2.ml 2063ms 33ms 91.7MB 2003ms 47ms ocaml 5.3.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 144ms 1.3ms 21.6MB 130ms 3ms ocaml 5.3.0
kotlin 1-m.kt 159ms 7.9ms 207.3MB 207ms 40ms kotlin/jvm 21
kotlin 1.kt 259ms 1.7ms 24.9MB 263ms 10ms kotlin/native 2.1.20
ocaml 2.ml 352ms 1.6ms 27.7MB 333ms 7ms ocaml 5.3.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 350ms 1.7ms 3.5MB 340ms 0ms kotlin/native 2.1.20
ocaml 1.ml 372ms 2.6ms 5.2MB 363ms 0ms ocaml 5.3.0
kotlin 1.kt 443ms 1.3ms 49.4MB 487ms 13ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 39ms 0.9ms 3.6MB 30ms 0ms kotlin/native 2.1.20
ocaml 1.ml 40ms 0.0ms 5.3MB 30ms 0ms ocaml 5.3.0
kotlin 1-m.kt 119ms 0.7ms 49.7MB 167ms 20ms kotlin/jvm 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 955ms 5.3ms 552.0MB 893ms 43ms ocaml 5.3.0
ocaml 2.ml 1880ms 9.6ms 17.1MB 1867ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 185ms 5.7ms 139.6MB 163ms 10ms ocaml 5.3.0
ocaml 2.ml 469ms 4.3ms 9.1MB 457ms 0ms ocaml 5.3.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt timeout 0.0ms 173.5MB 5410ms 47ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 226.8MB 5060ms 130ms kotlin/native 2.1.20
ocaml 2.ml timeout 0.0ms 462.8MB 4817ms 170ms ocaml 5.3.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 547ms 3.7ms 57.1MB 510ms 23ms ocaml 5.3.0
kotlin 1-m.kt 842ms 18ms 134.5MB 1290ms 40ms kotlin/jvm 21
kotlin 1n.kt 3207ms 14ms 51.3MB 3277ms 73ms kotlin/native 2.1.20

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4563ms 8.7ms 6.4MB 4553ms 0ms ocaml 5.3.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1146ms 6.2ms 6.1MB 1137ms 0ms ocaml 5.3.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 293ms 2.5ms 5.2MB 283ms 0ms ocaml 5.3.0