Programming Language and compiler
Benchmarks

Go VS Kotlin benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 712ms 0.5ms 307.9MB 740ms 87ms kotlin/jvm 17.0.2
go 1.go 3203ms 14ms 45.3MB 4650ms 50ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 137ms 1.9ms 109.6MB 113ms 33ms kotlin/jvm 17.0.2
go 1.go 267ms 12ms 8.2MB 310ms 3ms go 1.18.2
kotlin 1.kt 380ms 1.3ms 62.1MB 350ms 13ms kotlin/native 1.6.21
go 1.go 418ms 1.6ms 6.6MB 410ms 0ms tinygo 0.23.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 906ms 100ms 15.3MB 1760ms 0ms go 1.18.2
go 1.go 1828ms 5.3ms 253.7MB 1727ms 87ms tinygo 0.23.0
kotlin 2-m.kt 3070ms 596ms 182.5MB 5807ms 87ms kotlin/jvm 17.0.2
kotlin 1.kt 3092ms 4.3ms 170.9MB 3890ms 70ms kotlin/jvm 17.0.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2-m.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 69ms 9.2ms 5.4MB 113ms 0ms go 1.18.2
go 1.go 266ms 2.8ms 68.7MB 227ms 20ms tinygo 0.23.0
kotlin 1-m.kt 706ms 27ms 93.2MB 1247ms 43ms kotlin/jvm 17.0.2
kotlin 2-m.kt 976ms 5.7ms 68.2MB 1703ms 33ms kotlin/native 1.6.21
kotlin 2-m.kt 1003ms 75ms 105.5MB 1820ms 40ms kotlin/jvm 17.0.2
kotlin 1.kt 1172ms 4.8ms 48.7MB 1147ms 10ms kotlin/native 1.6.21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 164ms 2.5ms 10.0MB 153ms 0ms go 1.18.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 1.5ms 8.1MB 33ms 0ms go 1.18.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1212ms 1.5ms 4.9MB 2340ms 0ms go 1.18.2
go 3.go 2794ms 3.0ms 50.1MB 2770ms 7ms tinygo 0.23.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 125ms 1.0ms 4.9MB 190ms 0ms go 1.18.2
go 3.go 320ms 0.8ms 49.9MB 295ms 10ms tinygo 0.23.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 209ms 1.8ms 2.9MB 370ms 0ms go 1.18.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 27ms 0.6ms 2.9MB 33ms 0ms go 1.18.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.1ms 0.5ms 0.0MB 0ms 0ms tinygo 0.23.0
kotlin 1.kt 2.6ms 0.9ms 1.2MB 0ms 0ms kotlin/native 1.6.21
go 1.go 3.0ms 0.5ms 2.8MB 0ms 0ms go 1.18.2
kotlin 1.kt 73ms 2.6ms 41.1MB 52ms 12ms kotlin/jvm 17.0.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 198ms 6.8ms 60.4MB 297ms 47ms go 1.18.2
go 2-m.go 716ms 81ms 175.4MB 700ms 487ms go 1.18.2
go 1-m.go 720ms 67ms 182.0MB 697ms 463ms go 1.18.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 2.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 47ms 5.2ms 24.1MB 43ms 13ms go 1.18.2
go 2.go 132ms 20ms 39.0MB 80ms 73ms go 1.18.2
go 1.go 149ms 24ms 38.3MB 87ms 77ms go 1.18.2
kotlin 2-m.kt 2250ms 240ms 237.8MB 3337ms 303ms kotlin/jvm 17.0.2
kotlin 1-m.kt 2284ms 167ms 236.0MB 3647ms 287ms kotlin/jvm 17.0.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 90ms 1.2ms 44.8MB 70ms 17ms go 1.18.2
go 1.go 178ms 0.5ms 20.6MB 173ms 0ms go 1.18.2
kotlin 1-m.kt 1042ms 27ms 215.1MB 1737ms 83ms kotlin/jvm 17.0.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 413ms 2.5ms 183.4MB 413ms 70ms go 1.18.2
go 1.go 1010ms 46ms 111.0MB 997ms 33ms go 1.18.2
kotlin 1.kt 4142ms 313ms 954.1MB 5743ms 387ms kotlin/jvm 17.0.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1376ms 28ms 41.2MB 2520ms 33ms go 1.18.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 229ms 3.1ms 21.3MB 357ms 10ms go 1.18.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 168ms 2.8ms 2.9MB 160ms 0ms go 1.18.2
go 3.go 173ms 0.5ms 0.3MB 160ms 0ms tinygo 0.23.0
kotlin 2-m.kt 243ms 1.3ms 112.3MB 323ms 47ms kotlin/jvm 17.0.2
kotlin 1.kt 256ms 2.6ms 109.7MB 307ms 33ms kotlin/jvm 17.0.2
kotlin 2.kt 395ms 25ms 92.1MB 363ms 13ms kotlin/native 1.6.21
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2.kt 417ms 7.8ms 127.4MB 510ms 47ms kotlin/jvm 17.0.2
kotlin 1.kt 484ms 10.0ms 138.4MB 517ms 53ms kotlin/jvm 17.0.2
go 3.go 490ms 1.6ms 2.9MB 477ms 0ms go 1.18.2
go 3.go 512ms 0.2ms 2.3MB 500ms 0ms tinygo 0.23.0
kotlin 2.kt 1335ms 16ms 150.2MB 1290ms 30ms kotlin/native 1.6.21
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 85ms 0.3ms 0.0MB 77ms 0ms tinygo 0.23.0
go 3.go 88ms 0.8ms 4.1MB 80ms 0ms go 1.18.2
kotlin 1.kt 184ms 1.5ms 74.1MB 240ms 27ms kotlin/jvm 17.0.2
kotlin 2.kt 192ms 3.8ms 42.1MB 167ms 10ms kotlin/native 1.6.21
kotlin 2-m.kt 199ms 1.9ms 78.8MB 280ms 30ms kotlin/jvm 17.0.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 3792ms 3.3ms 5.3MB 3777ms 7ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 159ms 0.3ms 2.9MB 150ms 0ms go 1.18.2
go 1.go 329ms 1.8ms 0.0MB 320ms 0ms tinygo 0.23.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 538ms 9.7ms 363.9MB 503ms 113ms kotlin/jvm 17.0.2
go 1.go 2139ms 35ms 38.9MB 3060ms 33ms go 1.18.2
go 2.go 2329ms 6.4ms 42.1MB 3320ms 63ms go 1.18.2
go 1.go 4944ms 13ms 212.8MB 4870ms 57ms tinygo 0.23.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 203ms 1.8ms 221.2MB 180ms 57ms kotlin/jvm 17.0.2
go 1.go 443ms 6.3ms 12.3MB 610ms 10ms go 1.18.2
go 2.go 516ms 13ms 13.4MB 713ms 20ms go 1.18.2
kotlin 1.kt 689ms 9.9ms 74.3MB 657ms 10ms kotlin/native 1.6.21
go 1.go 1016ms 1.9ms 39.1MB 993ms 7ms tinygo 0.23.0
go 2.go 1278ms 2.3ms 51.9MB 1257ms 7ms tinygo 0.23.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 443ms 3.4ms 4.8MB 430ms 0ms go 1.18.2
kotlin 1.kt 633ms 16ms 43.1MB 647ms 10ms kotlin/jvm 17.0.2
go 1.go 705ms 0.5ms 0.0MB 697ms 0ms tinygo 0.23.0
kotlin 1n.kt 705ms 4.2ms 1.1MB 693ms 0ms kotlin/native 1.6.21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 54ms 2.0ms 2.8MB 43ms 0ms go 1.18.2
kotlin 1n.kt 73ms 1.5ms 1.1MB 67ms 0ms kotlin/native 1.6.21
go 1.go 74ms 1.3ms 0.0MB 60ms 0ms tinygo 0.23.0
kotlin 1.kt 149ms 1.4ms 43.2MB 160ms 17ms kotlin/jvm 17.0.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2.go 767ms 1.7ms 17.9MB 753ms 0ms tinygo 0.23.0
go 2.go 984ms 7.8ms 19.9MB 977ms 0ms go 1.18.2
go 1.go 1255ms 42ms 73.6MB 1217ms 23ms go 1.18.2
go 1.go 1580ms 44ms 43.9MB 1560ms 7ms tinygo 0.23.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 117ms 2.7ms 22.1MB 100ms 0ms go 1.18.2
go 1.go 148ms 1.5ms 12.9MB 137ms 0ms tinygo 0.23.0
go 2.go 181ms 0.3ms 4.9MB 167ms 0ms tinygo 0.23.0
go 2.go 228ms 0.9ms 7.6MB 213ms 0ms go 1.18.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1276ms 0.8ms 8.5MB 1253ms 7ms go 1.18.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 309ms 2.7ms 8.5MB 290ms 3ms go 1.18.2
kotlin 1.kt 1560ms 32ms 249.6MB 1917ms 100ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.6.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 2430ms 14ms 18.2MB 2413ms 30ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 151ms 0.9ms 9.4MB 137ms 0ms go 1.18.2
kotlin 1.kt 4437ms 132ms 187.6MB 5327ms 63ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 51ms 0.8ms 11.5MB 33ms 0ms go 1.18.2
kotlin 1-m.kt 1370ms 11ms 193.2MB 2130ms 77ms kotlin/jvm 17.0.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2219ms 4.5ms 5.3MB 4303ms 3ms go 1.18.2
go 1.go 4402ms 2.2ms 5.3MB 4397ms 0ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 568ms 0.8ms 3.3MB 1077ms 0ms go 1.18.2
go 1.go 1113ms 2.6ms 3.3MB 1097ms 3ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 151ms 1.3ms 2.8MB 267ms 0ms go 1.18.2
go 1.go 284ms 0.9ms 2.8MB 270ms 0ms go 1.18.2
go 1.go 1604ms 0.3ms 0.0MB 1590ms 0ms tinygo 0.23.0