Programming Language and compiler
Benchmarks

Kotlin VS Java benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 680ms 32ms 605.5MB 653ms 140ms kotlin/jvm 17.0.2
java 2.java 741ms 67ms 604.5MB 693ms 140ms openjdk 20
java 2.java 785ms 70ms 601.6MB 723ms 153ms openjdk 19
java 2.java 929ms 77ms 665.9MB 940ms 233ms graal/jvm 17.0.6
java 2.java 1459ms 59ms 1085.7MB 960ms 723ms openjdk/zgc 19
kotlin 1.kt timeout 0.0ms 214.4MB 8197ms 1193ms kotlin/native 1.8.10

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 148ms 16ms 109.3MB 117ms 33ms kotlin/jvm 17.0.2
java 2.java 187ms 22ms 108.8MB 167ms 37ms openjdk 20
java 2.java 192ms 10ms 111.6MB 187ms 33ms openjdk 19
java 2.java 204ms 15ms 162.8MB 223ms 60ms graal/jvm 17.0.6
java 2.java 346ms 6.2ms 239.6MB 207ms 167ms openjdk/zgc 19
kotlin 1-m.kt 596ms 9.2ms 30.5MB 1030ms 100ms kotlin/native 1.8.10

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 3157ms 743ms 180.6MB 5957ms 97ms kotlin/jvm 17.0.2
kotlin 1.kt 3186ms 97ms 160.2MB 4060ms 70ms kotlin/jvm 17.0.2
java 1-m.java 3410ms 117ms 198.3MB 6373ms 130ms openjdk 19
java 1-m.java 4472ms 132ms 924.9MB 7827ms 667ms openjdk/zgc 19
java 1.java timeout 0.0ms 143.3MB 9577ms 97ms openjdk 20
kotlin 1.kt timeout 0.0ms 10.7MB 6297ms 270ms kotlin/native 1.8.10
kotlin 2-m.kt timeout 0.0ms 31.8MB 9370ms 150ms kotlin/native 1.8.10

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 752ms 40ms 101.1MB 1307ms 60ms kotlin/jvm 17.0.2
java 1-m.java 854ms 61ms 112.8MB 1507ms 50ms openjdk 19
java 1-m.java 907ms 79ms 112.3MB 1597ms 60ms openjdk 20
java 1-m.java 1004ms 94ms 238.1MB 1497ms 207ms openjdk/zgc 19
kotlin 2-m.kt 1041ms 62ms 99.5MB 1863ms 50ms kotlin/jvm 17.0.2
kotlin 2-m.kt 1092ms 41ms 26.4MB 1957ms 43ms kotlin/native 1.8.10
kotlin 1.kt 1175ms 17ms 8.7MB 1417ms 97ms kotlin/native 1.8.10

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.7ms 0.5ms 1.5MB 0ms 0ms kotlin/native 1.8.10
kotlin 1.kt 68ms 5.9ms 40.9MB 54ms 12ms kotlin/jvm 17.0.2
java 1.java 80ms 2.1ms 48.1MB 72ms 14ms graal/jvm 17.0.6
java 1.java 87ms 9.2ms 39.3MB 78ms 16ms openjdk 20
java 1.java 93ms 4.7ms 42.4MB 76ms 24ms openjdk 19
java 1.java 150ms 9.1ms 41.0MB 86ms 64ms openjdk/zgc 19

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt timeout 0.0ms 240.0MB 8973ms 560ms kotlin/jvm 17.0.2
kotlin 2.kt timeout 0.0ms 296.4MB 8620ms 767ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 2762ms 277ms 199.6MB 4230ms 370ms kotlin/jvm 17.0.2
kotlin 1-m.kt 3108ms 353ms 192.5MB 4943ms 437ms kotlin/jvm 17.0.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 1233ms 3.7ms 216.0MB 2020ms 103ms kotlin/jvm 17.0.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 4641ms 52ms 858.7MB 6480ms 293ms kotlin/jvm 17.0.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2.kt 253ms 4.6ms 113.5MB 353ms 23ms kotlin/jvm 17.0.2
kotlin 1.kt 271ms 20ms 113.4MB 323ms 43ms kotlin/jvm 17.0.2
kotlin 2-m.kt 468ms 3.6ms 48.2MB 687ms 23ms kotlin/native 1.8.10
kotlin 1.kt timeout 0.0ms 14.9MB 5003ms 7ms kotlin/native 1.8.10

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2.kt 423ms 8.2ms 125.2MB 493ms 50ms kotlin/jvm 17.0.2
kotlin 1.kt 490ms 5.2ms 132.5MB 530ms 37ms kotlin/jvm 17.0.2
kotlin 2.kt 1471ms 4.0ms 115.4MB 2097ms 90ms kotlin/native 1.8.10
kotlin 1.kt timeout 0.0ms 17.3MB 4993ms 13ms kotlin/native 1.8.10

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 190ms 6.1ms 73.7MB 247ms 23ms kotlin/jvm 17.0.2
kotlin 2-m.kt 198ms 6.4ms 75.8MB 280ms 20ms kotlin/jvm 17.0.2
kotlin 2-m.kt 232ms 1.0ms 28.3MB 357ms 7ms kotlin/native 1.8.10
kotlin 1.kt timeout 0.0ms 17.1MB 5000ms 7ms kotlin/native 1.8.10

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 514ms 21ms 361.1MB 490ms 93ms kotlin/jvm 17.0.2
java 1.java 578ms 25ms 374.6MB 570ms 107ms openjdk 20
java 1.java 599ms 5.4ms 373.3MB 597ms 100ms openjdk 19
java 1.java 607ms 1.8ms 351.7MB 767ms 110ms graal/jvm 17.0.6
java 1.java 1062ms 7.0ms 737.3MB 673ms 530ms openjdk/zgc 19
kotlin 1-m.kt 3231ms 169ms 138.5MB 4950ms 777ms kotlin/native 1.8.10

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 203ms 3.9ms 221.1MB 177ms 57ms kotlin/jvm 17.0.2
java 1.java 259ms 11ms 174.3MB 250ms 63ms openjdk 19
java 1.java 264ms 11ms 222.1MB 263ms 60ms openjdk 20
java 1-m.java 301ms 2.6ms 279.6MB 410ms 60ms graal/jvm 17.0.6
java 1.java 460ms 1.7ms 307.8MB 270ms 230ms openjdk/zgc 19
kotlin 1-m.kt 648ms 0.2ms 38.4MB 1067ms 100ms kotlin/native 1.8.10

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 599ms 11ms 89.9MB 623ms 27ms graal/jvm 17.0.6
java 1.java 651ms 5.4ms 40.6MB 660ms 10ms openjdk 20
kotlin 1.kt 660ms 1.7ms 43.2MB 647ms 23ms kotlin/jvm 17.0.2
kotlin 1n.kt 660ms 9.2ms 1.5MB 650ms 0ms kotlin/native 1.8.10
java 1.java 661ms 11ms 42.0MB 657ms 23ms openjdk 19
java 1.java 707ms 18ms 41.7MB 650ms 70ms openjdk/zgc 19
java 2.java 2110ms 21ms 516.4MB 2083ms 167ms openjdk 20
java 2.java 2163ms 14ms 550.9MB 2123ms 173ms openjdk 19
java 2.java 2913ms 129ms 1417.8MB 2140ms 963ms openjdk/zgc 19

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 75ms 2.4ms 5.5MB 67ms 0ms kotlin/native 1.8.10
kotlin 1.kt 156ms 6.4ms 42.8MB 153ms 20ms kotlin/jvm 17.0.2
java 1.java 160ms 6.0ms 40.5MB 167ms 23ms openjdk 20
java 1.java 163ms 3.2ms 89.9MB 190ms 30ms graal/jvm 17.0.6
java 1.java 178ms 5.1ms 42.0MB 170ms 23ms openjdk 19
java 1.java 217ms 7.7ms 43.8MB 173ms 63ms openjdk/zgc 19
java 2.java 460ms 1.3ms 347.4MB 490ms 107ms openjdk 20
java 2.java 488ms 15ms 362.6MB 517ms 107ms openjdk 19
java 2.java 793ms 2.4ms 487.0MB 563ms 377ms openjdk/zgc 19

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java timeout 0.0ms 331.1MB 5447ms 97ms graal/jvm 17.0.6
java 1.java timeout 0.0ms 284.6MB 5387ms 110ms openjdk 19
java 1.java timeout 0.0ms 270.7MB 5410ms 100ms openjdk 20
java 1.java timeout 0.0ms 1375.1MB 4547ms 903ms openjdk/zgc 19
kotlin 1.kt timeout 0.0ms 212.7MB 5380ms 73ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 18.8MB 6640ms 163ms kotlin/native 1.8.10
kotlin 2n.kt timeout 0.0ms 11.0MB 5047ms 123ms kotlin/native 1.8.10

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 1451ms 18ms 261.6MB 1790ms 90ms openjdk 19
java 1.java 1458ms 14ms 295.9MB 1767ms 100ms openjdk 20
kotlin 1.kt 1500ms 20ms 248.1MB 1817ms 97ms kotlin/jvm 17.0.2
java 1.java 1543ms 16ms 342.7MB 1893ms 113ms graal/jvm 17.0.6
java 1.java 2059ms 27ms 987.0MB 1660ms 750ms openjdk/zgc 19
kotlin 1n.kt timeout 0.0ms 19.0MB 6643ms 180ms kotlin/native 1.8.10
kotlin 2n.kt timeout 0.0ms 8.2MB 5037ms 130ms kotlin/native 1.8.10

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3.java timeout 0.0ms 251.3MB 5357ms 113ms graal/jvm 17.0.6
java 3.java timeout 0.0ms 206.2MB 5233ms 87ms openjdk 19
java 3.java timeout 0.0ms 204.3MB 5237ms 77ms openjdk 20
java 3.java timeout 0.0ms 339.7MB 4920ms 277ms openjdk/zgc 19
kotlin 1.kt timeout 0.0ms 161.4MB 5330ms 63ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 277.2MB 5207ms 970ms kotlin/native 1.8.10

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3-m.java 1022ms 5.4ms 166.2MB 1477ms 57ms graal/jvm 17.0.6
java 3.java 1024ms 24ms 111.9MB 1353ms 50ms openjdk 20
kotlin 1.kt 1024ms 13ms 95.3MB 1387ms 47ms kotlin/jvm 17.0.2
java 3.java 1028ms 9.0ms 109.8MB 1363ms 37ms openjdk 19
java 3.java 1174ms 17ms 157.9MB 1323ms 147ms openjdk/zgc 19
kotlin 1n.kt 4777ms 65ms 65.3MB 6153ms 33ms kotlin/native 1.8.10

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 4515ms 7.7ms 187.0MB 5427ms 73ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 1387ms 15ms 186.2MB 2147ms 67ms kotlin/jvm 17.0.2