Programming Language and compiler
Benchmarks

Kotlin VS Java benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 428ms 6.0ms 574.2MB 503ms 83ms openjdk 21
java 2-m.java 448ms 5.4ms 648.6MB 620ms 120ms graal/jvm 17.0.8
java 2.java 451ms 8.7ms 650.1MB 557ms 87ms openjdk 23
kotlin 1.kt 455ms 16ms 575.5MB 540ms 63ms kotlin/jvm 21
java 2.java 1140ms 6.2ms 1085.8MB 540ms 753ms openjdk/zgc 21
kotlin 1-m.kt 2928ms 6.8ms 248.5MB 4967ms 627ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 95ms 2.4ms 158.2MB 103ms 23ms kotlin/jvm 21
java 2-m.java 117ms 3.3ms 167.6MB 147ms 30ms openjdk 21
java 2.java 122ms 6.2ms 98.2MB 143ms 33ms openjdk 23
java 2-m.java 153ms 9.8ms 226.4MB 223ms 60ms graal/jvm 17.0.8
kotlin 1-m.kt 257ms 6.2ms 32.6MB 400ms 63ms kotlin/native 1.8.21
java 2.java 289ms 1.8ms 241.5MB 147ms 187ms openjdk/zgc 21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1799ms 182ms 235.5MB 6667ms 90ms kotlin/jvm 21
java 1-m.java 1839ms 107ms 260.2MB 6950ms 100ms openjdk 21
kotlin 1.kt 2058ms 23ms 217.3MB 2833ms 57ms kotlin/jvm 21
java 1-m.java 2281ms 118ms 242.8MB 8683ms 107ms openjdk 23
java 1-m.java 2455ms 149ms 1194.8MB 7670ms 997ms openjdk/zgc 21
kotlin 1.kt timeout 0.0ms 14.8MB 6030ms 500ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 52.1MB 19097ms 113ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 366ms 8.9ms 38.2MB 1350ms 13ms kotlin/native 1.8.21
java 1-m.java 393ms 19ms 91.0MB 1263ms 60ms openjdk 23
java 1-m.java 413ms 23ms 131.0MB 1357ms 63ms openjdk 21
kotlin 1-m.kt 450ms 15ms 73.3MB 1017ms 37ms kotlin/jvm 21
java 1-m.java 622ms 34ms 224.1MB 1667ms 243ms openjdk/zgc 21
kotlin 1.kt 646ms 7.8ms 10.8MB 807ms 53ms kotlin/native 1.8.21
kotlin 2-m.kt 757ms 71ms 99.7MB 2643ms 70ms kotlin/jvm 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.3ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
kotlin 1.kt 55ms 4.2ms 47.4MB 46ms 14ms kotlin/jvm 21
java 1.java 61ms 1.3ms 58.6MB 60ms 20ms graal/jvm 17.0.8
java 1.java 69ms 2.9ms 44.7MB 66ms 14ms openjdk 23
java 1.java 69ms 1.0ms 43.8MB 72ms 10ms openjdk 21
java 1.java 174ms 5.3ms 44.5MB 80ms 116ms openjdk/zgc 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 4837ms 51ms 400.1MB 14360ms 2470ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 405.3MB 16127ms 2747ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 2173ms 206ms 269.1MB 6403ms 597ms kotlin/jvm 21
kotlin 2.kt 2226ms 288ms 241.9MB 2337ms 253ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 863ms 53ms 202.0MB 2353ms 83ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 2217ms 99ms 784.2MB 4773ms 140ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 172ms 3.8ms 94.9MB 283ms 30ms kotlin/jvm 21
kotlin 2-m.kt 188ms 5.4ms 102.2MB 397ms 30ms kotlin/jvm 21
kotlin 2.kt 285ms 1.3ms 7.8MB 413ms 3ms kotlin/native 1.8.21
kotlin 1.kt 501ms 15ms 7.8MB 600ms 7ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 298ms 25ms 214.4MB 503ms 57ms kotlin/jvm 21
kotlin 1.kt 308ms 0.6ms 204.7MB 413ms 40ms kotlin/jvm 21
kotlin 2.kt 863ms 8.2ms 7.6MB 1240ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1456ms 8.2ms 7.9MB 1763ms 17ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 132ms 1.5ms 92.4MB 250ms 20ms kotlin/jvm 21
kotlin 2.kt 134ms 3.9ms 5.7MB 190ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 159ms 9.9ms 90.8MB 307ms 27ms kotlin/jvm 21
kotlin 1.kt 162ms 4.0ms 5.8MB 207ms 0ms kotlin/native 1.8.21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 329ms 3.6ms 677.6MB 360ms 70ms kotlin/jvm 21
java 1.java 377ms 8.2ms 679.9MB 450ms 77ms openjdk 21
java 1.java 383ms 9.9ms 546.0MB 480ms 80ms openjdk 23
java 1-m.java 408ms 27ms 589.2MB 630ms 77ms graal/jvm 17.0.8
java 1.java 1004ms 16ms 1000.0MB 447ms 697ms openjdk/zgc 21
kotlin 1-m.kt 1426ms 20ms 136.5MB 2193ms 330ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 122ms 2.0ms 206.5MB 157ms 23ms kotlin/jvm 21
java 1-m.java 153ms 0.5ms 206.4MB 210ms 50ms openjdk 21
java 1-m.java 154ms 0.8ms 158.8MB 213ms 47ms openjdk 23
java 1-m.java 210ms 8.6ms 260.7MB 360ms 47ms graal/jvm 17.0.8
kotlin 1-m.kt 283ms 1.7ms 40.4MB 410ms 57ms kotlin/native 1.8.21
java 1.java 386ms 10ms 343.0MB 210ms 247ms openjdk/zgc 21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 386ms 8.6ms 4.7MB 373ms 0ms kotlin/native 1.8.21
java 1.java 417ms 2.4ms 45.2MB 450ms 13ms openjdk 21
java 1.java 420ms 6.1ms 48.2MB 450ms 20ms openjdk 23
kotlin 1.kt 422ms 3.5ms 49.7MB 463ms 13ms kotlin/jvm 21
java 1.java 429ms 7.0ms 85.0MB 457ms 27ms graal/jvm 17.0.8
java 1.java 530ms 6.4ms 46.5MB 450ms 130ms openjdk/zgc 21
java 2.java 1166ms 4.4ms 571.8MB 1293ms 77ms openjdk 21
java 2.java 1187ms 9.7ms 717.8MB 1287ms 90ms openjdk 23
java 2.java 3101ms 57ms 2431.6MB 1560ms 1743ms openjdk/zgc 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 43ms 0.8ms 4.6MB 30ms 0ms kotlin/native 1.8.21
java 1.java 111ms 2.5ms 45.2MB 137ms 20ms openjdk 21
kotlin 1.kt 112ms 0.7ms 49.4MB 150ms 17ms kotlin/jvm 21
java 1.java 112ms 0.7ms 87.3MB 130ms 30ms graal/jvm 17.0.8
java 1.java 114ms 1.2ms 48.5MB 140ms 20ms openjdk 23
java 1.java 230ms 5.1ms 46.5MB 150ms 133ms openjdk/zgc 21
java 2-m.java 289ms 6.3ms 348.4MB 407ms 70ms openjdk 23
java 2-m.java 293ms 18ms 355.0MB 440ms 30ms openjdk 21
java 2.java 658ms 2.3ms 536.9MB 437ms 403ms openjdk/zgc 21

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 3054ms 20ms 378.6MB 3497ms 93ms graal/jvm 17.0.8
kotlin 1.kt 3505ms 35ms 353.8MB 4313ms 93ms kotlin/jvm 21
java 1.java 3512ms 55ms 352.2MB 4263ms 100ms openjdk 21
java 1.java 3516ms 17ms 467.6MB 4333ms 110ms openjdk 23
java 1.java 4911ms 83ms 1847.1MB 4407ms 1287ms openjdk/zgc 21
kotlin 1n.kt timeout 0.0ms 7.5MB 6350ms 310ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 13.3MB 4990ms 177ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 862ms 30ms 376.3MB 1213ms 93ms graal/jvm 17.0.8
kotlin 1-m.kt 939ms 37ms 355.0MB 1617ms 70ms kotlin/jvm 21
java 1-m.java 946ms 37ms 351.6MB 1657ms 93ms openjdk 21
java 1-m.java 959ms 18ms 387.9MB 1673ms 93ms openjdk 23
java 1.java 1914ms 12ms 1374.3MB 1617ms 980ms openjdk/zgc 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6420ms 257ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 5000ms 150ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3.java timeout 0.0ms 501.9MB 5477ms 97ms graal/jvm 17.0.8
java 3.java timeout 0.0ms 328.2MB 5333ms 50ms openjdk 21
java 3.java timeout 0.0ms 350.8MB 5360ms 57ms openjdk 23
java 3.java timeout 0.0ms 488.6MB 4940ms 307ms openjdk/zgc 21
kotlin 1.kt timeout 0.0ms 171.4MB 5370ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 278.9MB 5463ms 463ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3-m.java 749ms 10ms 130.7MB 1110ms 37ms openjdk 21
kotlin 1-m.kt 759ms 8.2ms 133.8MB 1143ms 27ms kotlin/jvm 21
java 3-m.java 765ms 72ms 178.4MB 1157ms 47ms graal/jvm 17.0.8
java 3-m.java 770ms 25ms 134.3MB 1160ms 43ms openjdk 23
java 3.java 902ms 21ms 136.0MB 1070ms 167ms openjdk/zgc 21
kotlin 1n.kt 2968ms 26ms 65.1MB 3653ms 3ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2939ms 35ms 231.8MB 3747ms 60ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 926ms 27ms 209.8MB 1550ms 43ms kotlin/jvm 21