Programming Language and compiler
Benchmarks

Go VS Kotlin benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 635ms 11ms 411.2MB 670ms 73ms kotlin/jvm 17.0.2
go 1.go 3006ms 7.3ms 46.0MB 4327ms 47ms go 1.19.1
go 1.go 4239ms 23ms 37.9MB 4220ms 0ms tinygo 0.25.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 129ms 4.6ms 109.4MB 117ms 30ms kotlin/jvm 17.0.2
go 1.go 259ms 1.5ms 8.1MB 337ms 3ms go 1.19.1
go 1.go 349ms 0.6ms 6.0MB 340ms 0ms tinygo 0.25.0
kotlin 1-m.kt 435ms 7.8ms 30.0MB 717ms 0ms kotlin/native 1.7.10

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 787ms 149ms 13.6MB 1523ms 3ms go 1.19.1
go 1.go 1694ms 7.1ms 257.2MB 1627ms 53ms tinygo 0.25.0
kotlin 2-m.kt 2894ms 281ms 161.2MB 5497ms 73ms kotlin/jvm 17.0.2
kotlin 1.kt 2933ms 3.9ms 187.2MB 3770ms 77ms kotlin/jvm 17.0.2
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10
kotlin 2-m.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 57ms 8.6ms 5.4MB 87ms 0ms go 1.19.1
go 1.go 272ms 0.3ms 68.7MB 247ms 10ms tinygo 0.25.0
kotlin 1-m.kt 709ms 20ms 100.4MB 1243ms 50ms kotlin/jvm 17.0.2
kotlin 2-m.kt 872ms 11ms 32.4MB 1560ms 20ms kotlin/native 1.7.10
kotlin 2-m.kt 996ms 102ms 104.9MB 1797ms 57ms kotlin/jvm 17.0.2
kotlin 1.kt 1082ms 4.7ms 10.7MB 1243ms 0ms kotlin/native 1.7.10

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 168ms 2.7ms 8.5MB 157ms 0ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 1.8ms 8.2MB 37ms 0ms go 1.19.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1443ms 1.4ms 3.0MB 2800ms 0ms go 1.19.1
go 3.go 2937ms 1.2ms 49.1MB 2913ms 7ms tinygo 0.25.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 147ms 2.4ms 3.0MB 223ms 0ms go 1.19.1
go 3.go 314ms 1.1ms 49.9MB 283ms 7ms tinygo 0.25.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 242ms 1.6ms 2.9MB 440ms 0ms go 1.19.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 30ms 0.1ms 2.9MB 40ms 0ms go 1.19.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.6ms 0.9ms 0.0MB 0ms 0ms tinygo 0.25.0
kotlin 1.kt 2.4ms 0.7ms 1.1MB 0ms 0ms kotlin/native 1.7.10
go 1.go 2.6ms 0.5ms 2.9MB 0ms 0ms go 1.19.1
kotlin 1.kt 65ms 4.3ms 41.0MB 52ms 8ms kotlin/jvm 17.0.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 172ms 6.5ms 55.9MB 260ms 40ms go 1.19.1
go 2-m.go 551ms 17ms 170.1MB 487ms 367ms go 1.19.1
go 1-m.go 613ms 42ms 165.7MB 613ms 370ms go 1.19.1
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 2.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 31ms 20ms 22.7MB 45ms 5ms go 1.19.1
go 1.go 131ms 9.7ms 38.4MB 73ms 67ms go 1.19.1
go 2.go 135ms 3.5ms 39.1MB 83ms 60ms go 1.19.1
kotlin 2-m.kt 2345ms 39ms 197.2MB 3470ms 233ms kotlin/jvm 17.0.2
kotlin 1-m.kt 2534ms 62ms 182.6MB 4067ms 260ms kotlin/jvm 17.0.2

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 71ms 3.9ms 45.0MB 57ms 3ms go 1.19.1
go 1.go 171ms 1.4ms 18.7MB 157ms 3ms go 1.19.1
kotlin 1-m.kt 1150ms 25ms 207.2MB 1990ms 70ms kotlin/jvm 17.0.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 407ms 3.6ms 165.2MB 370ms 113ms go 1.19.1
go 1.go 1043ms 0.4ms 109.0MB 1030ms 47ms go 1.19.1
kotlin 1-m.kt 3933ms 75ms 951.0MB 5633ms 287ms kotlin/jvm 17.0.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1505ms 5.6ms 42.6MB 2817ms 23ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 224ms 3.0ms 22.4MB 363ms 17ms go 1.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 166ms 1.1ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 175ms 0.9ms 2.9MB 160ms 0ms go 1.19.1
kotlin 2-m.kt 225ms 3.4ms 113.9MB 340ms 23ms kotlin/jvm 17.0.2
kotlin 1.kt 240ms 2.6ms 109.7MB 297ms 27ms kotlin/jvm 17.0.2
kotlin 2-m.kt 464ms 7.9ms 41.9MB 737ms 10ms kotlin/native 1.7.10
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2.kt 371ms 3.0ms 132.6MB 473ms 30ms kotlin/jvm 17.0.2
kotlin 1.kt 457ms 2.5ms 132.8MB 507ms 30ms kotlin/jvm 17.0.2
go 3.go 491ms 0.4ms 0.3MB 480ms 0ms tinygo 0.25.0
go 3.go 513ms 2.7ms 3.4MB 500ms 0ms go 1.19.1
kotlin 2-m.kt 1412ms 23ms 147.3MB 2163ms 50ms kotlin/native 1.7.10
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 81ms 1.2ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 94ms 1.0ms 3.9MB 83ms 0ms go 1.19.1
kotlin 1-m.kt 173ms 0.8ms 73.9MB 243ms 17ms kotlin/jvm 17.0.2
kotlin 2-m.kt 177ms 6.2ms 78.8MB 257ms 20ms kotlin/jvm 17.0.2
kotlin 2-m.kt 239ms 3.0ms 29.9MB 400ms 0ms kotlin/native 1.7.10
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 4105ms 9.6ms 7.3MB 4087ms 3ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 172ms 1.6ms 2.8MB 160ms 0ms go 1.19.1
go 1.go 248ms 4.4ms 0.0MB 240ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 448ms 11ms 356.9MB 457ms 57ms kotlin/jvm 17.0.2
go 1.go 1976ms 5.3ms 48.1MB 2803ms 43ms go 1.19.1
go 2.go 2305ms 5.9ms 41.3MB 3270ms 43ms go 1.19.1
kotlin 1.kt 2377ms 11ms 136.8MB 3457ms 27ms kotlin/native 1.7.10
go 1.go 3286ms 4.0ms 212.1MB 3233ms 33ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 175ms 7.3ms 221.7MB 147ms 53ms kotlin/jvm 17.0.2
go 1.go 413ms 2.9ms 12.3MB 567ms 13ms go 1.19.1
kotlin 1.kt 455ms 0.4ms 38.1MB 657ms 3ms kotlin/native 1.7.10
go 2.go 485ms 2.0ms 13.0MB 663ms 17ms go 1.19.1
go 1.go 792ms 1.5ms 52.1MB 773ms 3ms tinygo 0.25.0
go 2.go 1083ms 3.6ms 39.4MB 1057ms 10ms tinygo 0.25.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 455ms 2.1ms 2.9MB 443ms 0ms go 1.19.1
kotlin 1n.kt 549ms 12ms 1.1MB 537ms 0ms kotlin/native 1.7.10
kotlin 1.kt 566ms 1.3ms 43.0MB 577ms 17ms kotlin/jvm 17.0.2
go 1.go 843ms 0.9ms 0.0MB 830ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 50ms 1.4ms 2.9MB 40ms 0ms go 1.19.1
kotlin 1n.kt 57ms 0.6ms 1.2MB 50ms 0ms kotlin/native 1.7.10
go 1.go 88ms 2.5ms 0.0MB 80ms 0ms tinygo 0.25.0
kotlin 1.kt 136ms 3.1ms 42.8MB 143ms 10ms kotlin/jvm 17.0.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2.go 621ms 1.4ms 17.1MB 603ms 0ms tinygo 0.25.0
go 1.go 759ms 9.3ms 73.5MB 737ms 10ms go 1.19.1
go 1.go 797ms 15ms 42.5MB 777ms 7ms tinygo 0.25.0
go 2.go 905ms 4.0ms 19.8MB 890ms 7ms go 1.19.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 129ms 1.0ms 13.6MB 120ms 0ms tinygo 0.25.0
go 1.go 131ms 3.7ms 23.9MB 117ms 3ms go 1.19.1
go 2.go 148ms 1.7ms 5.4MB 140ms 0ms tinygo 0.25.0
go 2.go 216ms 2.6ms 7.6MB 203ms 0ms go 1.19.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1424ms 4.4ms 8.5MB 1400ms 7ms go 1.19.1
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 341ms 0.8ms 8.4MB 323ms 3ms go 1.19.1
kotlin 1.kt 1436ms 7.1ms 244.7MB 1790ms 53ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10
kotlin 2n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0
kotlin 1.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 0.0MB 0ms 0ms kotlin/native 1.7.10

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 1072ms 10ms 95.4MB 1477ms 30ms kotlin/jvm 17.0.2
go 3.go 2503ms 23ms 18.2MB 2473ms 33ms go 1.19.1
kotlin 1n.kt 4863ms 23ms 75.2MB 6080ms 17ms kotlin/native 1.7.10
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 171ms 1.4ms 7.9MB 157ms 3ms go 1.19.1
kotlin 1.kt 4510ms 26ms 192.2MB 5413ms 70ms kotlin/jvm 17.0.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 0.2ms 9.6MB 43ms 0ms go 1.19.1
kotlin 1-m.kt 1359ms 7.8ms 183.9MB 2143ms 50ms kotlin/jvm 17.0.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2511ms 29ms 5.4MB 4843ms 7ms go 1.19.1
go 1.go 4887ms 5.0ms 5.5MB 4870ms 3ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 630ms 0.5ms 4.9MB 1200ms 0ms go 1.19.1
go 1.go 1229ms 3.9ms 2.9MB 1213ms 3ms go 1.19.1
go 1.go 2577ms 1.0ms 0.0MB 2560ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 166ms 0.9ms 4.9MB 293ms 0ms go 1.19.1
go 1.go 309ms 0.2ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 648ms 0.7ms 0.0MB 637ms 0ms tinygo 0.25.0