Programming Language and compiler
Benchmarks

Go VS Kotlin benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 469ms 5.8ms 575.8MB 550ms 80ms kotlin/jvm 21
go 1-m.go 2665ms 13ms 44.2MB 5553ms 47ms go 1.21.6
kotlin 1-m.kt 3056ms 54ms 248.5MB 5070ms 700ms kotlin/native 1.8.21
go 1.go 4172ms 25ms 51.6MB 4157ms 3ms tinygo 0.30.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 99ms 0.6ms 158.3MB 107ms 30ms kotlin/jvm 21
go 1-m.go 237ms 1.8ms 7.8MB 393ms 3ms go 1.21.6
kotlin 1-m.kt 270ms 4.6ms 28.5MB 430ms 60ms kotlin/native 1.8.21
go 1.go 316ms 4.0ms 6.6MB 307ms 0ms tinygo 0.30.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 464ms 54ms 15.4MB 1767ms 0ms go 1.21.6
kotlin 2-m.kt 1773ms 358ms 242.2MB 6577ms 93ms kotlin/jvm 21
kotlin 1.kt 2141ms 6.2ms 220.2MB 3003ms 67ms kotlin/jvm 21
go 1.go 2438ms 2.9ms 256.6MB 2400ms 23ms tinygo 0.30.0
kotlin 1.kt timeout 0.0ms 14.8MB 6140ms 457ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 72.9MB 19063ms 127ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 39ms 4.8ms 7.2MB 127ms 0ms go 1.21.6
go 1.go 387ms 1.7ms 65.8MB 373ms 0ms tinygo 0.30.0
kotlin 2-m.kt 404ms 0.7ms 32.8MB 1477ms 27ms kotlin/native 1.8.21
kotlin 1-m.kt 465ms 18ms 74.9MB 1057ms 50ms kotlin/jvm 21
kotlin 1.kt 683ms 4.2ms 10.8MB 820ms 57ms kotlin/native 1.8.21
kotlin 2-m.kt 912ms 14ms 99.8MB 3203ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 119ms 0.4ms 10.2MB 110ms 0ms go 1.21.6

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 35ms 1.4ms 8.3MB 27ms 0ms go 1.21.6

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 720ms 0.8ms 3.3MB 2777ms 0ms go 1.21.6
go 3.go 2326ms 13ms 49.0MB 2310ms 3ms tinygo 0.30.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 75ms 0.3ms 5.3MB 203ms 0ms go 1.21.6
go 3.go 509ms 2.2ms 49.0MB 493ms 3ms tinygo 0.30.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 123ms 0.2ms 5.3MB 370ms 0ms go 1.21.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 17ms 0.4ms 5.3MB 30ms 0ms go 1.21.6

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.6ms 0.1ms 0.1MB 0ms 0ms tinygo 0.30.0
go 1.go 1.5ms 0.1ms 3.1MB 0ms 0ms go 1.21.6
kotlin 1.kt 2.3ms 0.1ms 4.7MB 0ms 0ms kotlin/native 1.8.21
kotlin 1.kt 58ms 4.5ms 47.3MB 58ms 14ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 121ms 6.0ms 59.4MB 300ms 103ms go 1.21.6
go 2-m.go 445ms 7.9ms 175.9MB 593ms 670ms go 1.21.6
go 1-m.go 454ms 8.3ms 167.7MB 667ms 603ms go 1.21.6
kotlin 2-m.kt 3188ms 2764ms 353.0MB 15630ms 2370ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 405.5MB 16613ms 2393ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 25ms 14ms 25.4MB 50ms 30ms go 1.21.6
go 2-m.go 111ms 29ms 33.9MB 87ms 83ms go 1.21.6
go 1-m.go 112ms 8.6ms 38.1MB 97ms 97ms go 1.21.6
kotlin 2-m.kt 2166ms 328ms 250.2MB 3897ms 460ms kotlin/jvm 21
kotlin 1-m.kt 2399ms 24ms 215.3MB 6757ms 710ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 45ms 1.3ms 39.9MB 30ms 10ms go 1.21.6
go 1.go 151ms 0.8ms 18.1MB 143ms 0ms go 1.21.6
kotlin 1-m.kt 829ms 56ms 212.4MB 2217ms 83ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 242ms 7.8ms 180.2MB 230ms 30ms go 1.21.6
go 1.go 833ms 2.8ms 105.0MB 827ms 13ms go 1.21.6
kotlin 1-m.kt 2357ms 60ms 1045.0MB 5193ms 157ms kotlin/jvm 21

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 783ms 4.0ms 40.2MB 2817ms 27ms go 1.21.6

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 147ms 4.5ms 30.6MB 373ms 37ms go 1.21.6

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 128ms 1.8ms 3.3MB 120ms 0ms go 1.21.6
go 3.go 135ms 4.0ms 0.3MB 127ms 0ms tinygo 0.30.0
kotlin 1-m.kt 179ms 1.1ms 94.8MB 310ms 17ms kotlin/jvm 21
kotlin 2-m.kt 199ms 5.9ms 100.7MB 413ms 33ms kotlin/jvm 21
kotlin 2.kt 303ms 2.6ms 7.8MB 433ms 10ms kotlin/native 1.8.21
kotlin 1.kt 507ms 10ms 7.8MB 607ms 3ms kotlin/native 1.8.21

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 302ms 3.3ms 212.9MB 523ms 57ms kotlin/jvm 21
kotlin 1.kt 326ms 4.4ms 204.4MB 440ms 33ms kotlin/jvm 21
go 3.go 371ms 1.4ms 3.3MB 360ms 0ms go 1.21.6
go 3.go 388ms 1.8ms 2.3MB 380ms 0ms tinygo 0.30.0
kotlin 2.kt 911ms 18ms 7.8MB 1313ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1534ms 5.9ms 7.8MB 1860ms 30ms kotlin/native 1.8.21

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 63ms 0.8ms 3.1MB 53ms 0ms go 1.21.6
go 3.go 71ms 5.8ms 0.1MB 63ms 0ms tinygo 0.30.0
kotlin 2.kt 141ms 2.9ms 5.8MB 193ms 3ms kotlin/native 1.8.21
kotlin 1-m.kt 143ms 4.2ms 90.6MB 260ms 37ms kotlin/jvm 21
kotlin 2-m.kt 158ms 11ms 95.6MB 307ms 40ms kotlin/jvm 21
kotlin 1.kt 180ms 1.3ms 5.8MB 237ms 0ms kotlin/native 1.8.21

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 3215ms 5.5ms 7.3MB 3203ms 3ms go 1.21.6
go 1.go 4022ms 4.0ms 5.8MB 4013ms 0ms tinygo 0.30.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 138ms 2.8ms 3.3MB 127ms 0ms go 1.21.6
go 1.go 168ms 2.2ms 0.3MB 160ms 0ms tinygo 0.30.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 352ms 3.1ms 677.8MB 383ms 80ms kotlin/jvm 21
kotlin 1-m.kt 1499ms 16ms 136.6MB 2307ms 317ms kotlin/native 1.8.21
go 1-m.go 1632ms 20ms 39.1MB 3303ms 47ms go 1.21.6
go 2-m.go 1860ms 6.1ms 41.4MB 3863ms 37ms go 1.21.6
go 1.go 2314ms 36ms 51.7MB 2297ms 7ms tinygo 0.30.0
go 2.go 3797ms 21ms 119.4MB 3773ms 7ms tinygo 0.30.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 129ms 0.4ms 206.5MB 147ms 47ms kotlin/jvm 21
kotlin 1-m.kt 323ms 19ms 40.4MB 467ms 77ms kotlin/native 1.8.21
go 1-m.go 365ms 1.8ms 13.8MB 710ms 13ms go 1.21.6
go 2-m.go 409ms 1.0ms 13.8MB 820ms 20ms go 1.21.6
go 1.go 445ms 1.4ms 13.8MB 433ms 0ms tinygo 0.30.0
go 2.go 684ms 10ms 39.5MB 670ms 0ms tinygo 0.30.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 348ms 1.1ms 2.1MB 340ms 0ms tinygo 0.30.0
go 1.go 364ms 0.9ms 3.3MB 350ms 0ms go 1.21.6
kotlin 1n.kt 406ms 3.4ms 4.6MB 393ms 0ms kotlin/native 1.8.21
kotlin 1.kt 442ms 1.8ms 49.2MB 497ms 7ms kotlin/jvm 21

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 36ms 0.1ms 0.1MB 30ms 0ms tinygo 0.30.0
go 1.go 39ms 0.2ms 3.3MB 30ms 0ms go 1.21.6
kotlin 1n.kt 44ms 0.9ms 4.6MB 33ms 0ms kotlin/native 1.8.21
kotlin 1-m.kt 120ms 0.3ms 49.4MB 167ms 17ms kotlin/jvm 21

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 311ms 4.6ms 72.5MB 297ms 0ms go 1.21.6
go 1.go 331ms 2.1ms 42.8MB 320ms 0ms tinygo 0.30.0
go 2.go 437ms 5.1ms 17.8MB 427ms 0ms tinygo 0.30.0
go 2.go 740ms 3.8ms 21.7MB 723ms 3ms go 1.21.6

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 62ms 1.2ms 21.6MB 47ms 0ms go 1.21.6
go 1.go 66ms 1.0ms 12.6MB 53ms 0ms tinygo 0.30.0
go 2.go 110ms 2.0ms 4.6MB 100ms 0ms tinygo 0.30.0
go 2.go 181ms 1.7ms 7.2MB 170ms 0ms go 1.21.6

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1129ms 7.4ms 8.4MB 1110ms 7ms go 1.21.6
kotlin 1.kt 3719ms 43ms 355.7MB 4563ms 90ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.5MB 6490ms 283ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 4980ms 173ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 271ms 3.7ms 8.5MB 257ms 3ms go 1.21.6
kotlin 1-m.kt 976ms 35ms 353.3MB 1717ms 97ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6410ms 283ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 5020ms 130ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 128.0MB 4977ms 47ms go 1.21.6
go 3.go timeout 0.0ms 106.6MB 4980ms 7ms tinygo 0.30.0
kotlin 1.kt timeout 0.0ms 173.0MB 5387ms 50ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 279.0MB 4880ms 1073ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 825ms 28ms 134.0MB 1250ms 40ms kotlin/jvm 21
go 3.go 1859ms 155ms 20.2MB 1833ms 33ms go 1.21.6
go 3.go 2681ms 113ms 30.4MB 2667ms 0ms tinygo 0.30.0
kotlin 1n.kt 3285ms 241ms 65.0MB 4160ms 13ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 141ms 1.0ms 12.2MB 137ms 3ms go 1.21.6
kotlin 1.kt 3058ms 41ms 233.9MB 3943ms 80ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 46ms 1.0ms 11.9MB 40ms 0ms go 1.21.6
kotlin 1-m.kt 975ms 45ms 233.6MB 1800ms 47ms kotlin/jvm 21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 1911ms 7.7ms 5.3MB 7327ms 0ms go 1.21.6
go 1.go 3639ms 25ms 5.4MB 3630ms 0ms go 1.21.6
go 1.go timeout 0.0ms 2.4MB 4990ms 0ms tinygo 0.30.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 479ms 0.9ms 5.3MB 1817ms 3ms go 1.21.6
go 1.go 928ms 8.2ms 3.3MB 923ms 0ms go 1.21.6
go 1.go 1394ms 5.3ms 0.4MB 1383ms 0ms tinygo 0.30.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 126ms 1.3ms 5.3MB 437ms 0ms go 1.21.6
go 1.go 236ms 5.1ms 3.3MB 223ms 0ms go 1.21.6
go 1.go 349ms 0.4ms 0.3MB 340ms 0ms tinygo 0.30.0