Programming Language and compiler
Benchmarks

Kotlin VS Go benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 733ms 92ms 842.9MB 710ms 130ms kotlin/jvm 17.0.2
go 1.go 3208ms 18ms 45.7MB 4603ms 63ms go 1.18.2
kotlin 1.kt 3949ms 18ms 514.4MB 3847ms 87ms kotlin/native 1.6.21
go 1.go 4543ms 15ms 39.4MB 4520ms 7ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 133ms 2.6ms 109.5MB 117ms 20ms kotlin/jvm 17.0.2
go 1.go 282ms 9.2ms 8.2MB 330ms 0ms go 1.18.2
kotlin 1.kt 304ms 2.8ms 62.2MB 283ms 3ms kotlin/native 1.6.21
go 1.go 360ms 1.9ms 6.3MB 350ms 0ms tinygo 0.23.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 838ms 145ms 13.6MB 1630ms 0ms go 1.18.2
go 1.go 1779ms 20ms 257.5MB 1707ms 57ms tinygo 0.23.0
kotlin 1.kt 2944ms 38ms 157.9MB 3853ms 60ms kotlin/jvm 17.0.2
kotlin 2-m.kt 3273ms 617ms 187.2MB 6243ms 67ms kotlin/jvm 17.0.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2-m.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 62ms 0.8ms 5.4MB 97ms 0ms go 1.18.2
go 1.go 275ms 1.2ms 66.3MB 257ms 3ms tinygo 0.23.0
kotlin 1-m.kt 689ms 63ms 100.4MB 1230ms 27ms kotlin/jvm 17.0.2
kotlin 2-m.kt 848ms 12ms 70.4MB 1487ms 23ms kotlin/native 1.6.21
kotlin 1.kt 1044ms 5.6ms 32.7MB 1030ms 7ms kotlin/native 1.6.21
kotlin 2-m.kt 1092ms 73ms 106.9MB 1977ms 57ms kotlin/jvm 17.0.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.7ms 0.1ms 0.0MB 0ms 0ms tinygo 0.23.0
kotlin 1.kt 2.5ms 0.4ms 1.2MB 0ms 0ms kotlin/native 1.6.21
go 1.go 2.9ms 0.3ms 2.8MB 0ms 0ms go 1.18.2
kotlin 1.kt 66ms 2.9ms 40.8MB 52ms 8ms kotlin/jvm 17.0.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 207ms 52ms 54.5MB 287ms 33ms go 1.18.2
go 2-m.go 548ms 19ms 165.5MB 467ms 393ms go 1.18.2
go 1-m.go 624ms 90ms 186.4MB 577ms 403ms go 1.18.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 2.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 30ms 19ms 20.5MB 35ms 15ms go 1.18.2
go 2.go 124ms 16ms 39.2MB 77ms 53ms go 1.18.2
go 1.go 137ms 2.7ms 38.9MB 93ms 50ms go 1.18.2
kotlin 2-m.kt 2117ms 172ms 241.9MB 3383ms 230ms kotlin/jvm 17.0.2
kotlin 1-m.kt 2372ms 280ms 228.1MB 3690ms 287ms kotlin/jvm 17.0.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 81ms 2.9ms 45.2MB 67ms 7ms go 1.18.2
go 1.go 171ms 3.0ms 20.4MB 163ms 3ms go 1.18.2
kotlin 1-m.kt 1068ms 28ms 216.8MB 1817ms 83ms kotlin/jvm 17.0.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 385ms 6.8ms 211.3MB 387ms 40ms go 1.18.2
go 1.go 1052ms 3.0ms 110.5MB 1023ms 40ms go 1.18.2
kotlin 1-m.kt 3906ms 112ms 949.9MB 5693ms 247ms kotlin/jvm 17.0.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 165ms 0.4ms 2.0MB 153ms 0ms tinygo 0.23.0
go 3.go 173ms 2.5ms 2.9MB 160ms 0ms go 1.18.2
kotlin 2-m.kt 223ms 5.9ms 113.8MB 330ms 30ms kotlin/jvm 17.0.2
kotlin 1.kt 234ms 3.0ms 109.7MB 300ms 20ms kotlin/jvm 17.0.2
kotlin 2.kt 363ms 3.4ms 88.5MB 337ms 10ms kotlin/native 1.6.21
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2.kt 367ms 3.8ms 130.7MB 470ms 27ms kotlin/jvm 17.0.2
kotlin 1.kt 455ms 2.2ms 132.6MB 517ms 27ms kotlin/jvm 17.0.2
go 3.go 490ms 0.9ms 2.0MB 480ms 0ms tinygo 0.23.0
go 3.go 506ms 3.4ms 2.9MB 490ms 0ms go 1.18.2
kotlin 2.kt 1125ms 1.8ms 134.1MB 1087ms 23ms kotlin/native 1.6.21
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 80ms 0.2ms 0.0MB 70ms 0ms tinygo 0.23.0
go 3.go 90ms 0.8ms 3.8MB 80ms 0ms go 1.18.2
kotlin 1.kt 173ms 4.0ms 74.2MB 237ms 17ms kotlin/jvm 17.0.2
kotlin 2.kt 174ms 8.8ms 42.1MB 163ms 0ms kotlin/native 1.6.21
kotlin 2-m.kt 186ms 22ms 83.1MB 273ms 20ms kotlin/jvm 17.0.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 461ms 8.2ms 362.9MB 450ms 80ms kotlin/jvm 17.0.2
go 1.go 2093ms 7.9ms 40.0MB 2973ms 50ms go 1.18.2
go 2.go 2355ms 17ms 49.2MB 3370ms 53ms go 1.18.2
go 1.go 4907ms 0.8ms 160.4MB 4863ms 27ms tinygo 0.23.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 178ms 1.5ms 220.8MB 160ms 47ms kotlin/jvm 17.0.2
go 1.go 433ms 9.3ms 12.2MB 590ms 10ms go 1.18.2
go 2.go 497ms 3.8ms 12.9MB 697ms 7ms go 1.18.2
kotlin 1.kt 560ms 1.8ms 62.4MB 537ms 10ms kotlin/native 1.6.21
go 1.go 861ms 4.0ms 38.3MB 843ms 0ms tinygo 0.23.0
go 2.go 1481ms 5.6ms 38.6MB 1467ms 0ms tinygo 0.23.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 456ms 2.9ms 2.8MB 447ms 0ms go 1.18.2
kotlin 1.kt 570ms 1.1ms 43.1MB 583ms 13ms kotlin/jvm 17.0.2
kotlin 1n.kt 583ms 1.1ms 1.1MB 570ms 0ms kotlin/native 1.6.21
go 1.go 844ms 2.5ms 2.0MB 830ms 0ms tinygo 0.23.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 52ms 0.6ms 2.8MB 37ms 0ms go 1.18.2
kotlin 1n.kt 61ms 0.3ms 1.1MB 50ms 0ms kotlin/native 1.6.21
go 1.go 87ms 1.1ms 2.0MB 80ms 0ms tinygo 0.23.0
kotlin 1.kt 134ms 4.0ms 43.2MB 143ms 17ms kotlin/jvm 17.0.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1377ms 4.0ms 8.6MB 1357ms 3ms go 1.18.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 329ms 1.8ms 8.5MB 310ms 0ms go 1.18.2
kotlin 1.kt 1456ms 23ms 227.6MB 1820ms 50ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 172ms 1.0ms 9.7MB 157ms 7ms go 1.18.2
kotlin 1.kt 4527ms 12ms 182.2MB 5443ms 70ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.5ms 9.5MB 43ms 0ms go 1.18.2
kotlin 1-m.kt 1369ms 13ms 182.1MB 2103ms 53ms kotlin/jvm 17.0.2