Programming Language and compiler
Benchmarks

Kotlin VS C# benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 487ms 33ms 1217.6MB 527ms 123ms kotlin/jvm 21
csharp 1.cs 912ms 14ms 187.1MB 903ms 140ms dotnet/aot 9.0.102
csharp 1.cs 964ms 9.3ms 206.6MB 947ms 153ms dotnet 9.0.102
csharp 1.cs 1752ms 85ms 103.6MB 1933ms 253ms mono 6.12.0
kotlin 1-m.kt 3121ms 31ms 248.4MB 5273ms 667ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 99ms 1.2ms 158.3MB 103ms 30ms kotlin/jvm 21
csharp 1.cs 117ms 2.5ms 41.9MB 80ms 30ms dotnet/aot 9.0.102
csharp 1.cs 151ms 2.8ms 46.3MB 127ms 10ms mono 6.12.0
csharp 1.cs 204ms 17ms 64.6MB 153ms 37ms dotnet 9.0.102
kotlin 1-m.kt 266ms 1.2ms 28.5MB 413ms 67ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1809ms 268ms 235.5MB 6717ms 107ms kotlin/jvm 21
kotlin 1.kt 2109ms 6.9ms 219.7MB 2923ms 63ms kotlin/jvm 21
csharp 1-m.cs 2167ms 61ms 71.6MB 7430ms 90ms dotnet/aot 9.0.102
csharp 1-m.cs 2627ms 90ms 82.1MB 8133ms 107ms dotnet 9.0.102
kotlin 1.kt timeout 0.0ms 14.8MB 6100ms 460ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 69.5MB 18963ms 130ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 174ms 6.3ms 28.9MB 467ms 20ms dotnet/aot 9.0.102
csharp 1-m.cs 285ms 11ms 50.6MB 790ms 33ms dotnet 9.0.102
kotlin 2-m.kt 386ms 11ms 54.6MB 1410ms 27ms kotlin/native 1.8.21
kotlin 1-m.kt 463ms 6.2ms 73.9MB 1070ms 43ms kotlin/jvm 21
kotlin 1.kt 675ms 7.0ms 10.7MB 803ms 70ms kotlin/native 1.8.21
kotlin 2-m.kt 742ms 27ms 99.3MB 2503ms 90ms kotlin/jvm 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.4ms 0.5ms 4.7MB 0ms 0ms kotlin/native 1.8.21
csharp 1.cs 18ms 10ms 12.5MB 0ms 0ms dotnet/aot 9.0.102
csharp 1.cs 31ms 0.2ms 23.3MB 22ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.3ms 30.3MB 16ms 4ms dotnet 9.0.102
kotlin 1.kt 54ms 6.4ms 47.4MB 54ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 512ms 4.2ms 120.8MB 737ms 140ms dotnet 9.0.102
csharp 2-m.cs 646ms 11ms 152.9MB 707ms 517ms dotnet 9.0.102
csharp 2-http3.cs 695ms 16ms 157.2MB 1120ms 290ms dotnet 9.0.102
csharp 1-m.cs 790ms 13ms 171.7MB 1097ms 717ms dotnet 9.0.102
kotlin 2-m.kt 807ms 1397ms 456.2MB 10660ms 1630ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 393.0MB 16180ms 2813ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 390ms 4.2ms 101.0MB 387ms 197ms dotnet 9.0.102
csharp 2-http2.cs 433ms 2.9ms 97.8MB 477ms 100ms dotnet 9.0.102
csharp 1-m.cs 441ms 9.6ms 110.2MB 540ms 250ms dotnet 9.0.102
csharp 2-http3.cs 498ms 11ms 107.6MB 613ms 107ms dotnet 9.0.102
kotlin 2-m.kt 2185ms 260ms 239.6MB 4107ms 410ms kotlin/jvm 21
kotlin 1-m.kt 2220ms 269ms 241.0MB 6507ms 647ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 310ms 6.9ms 79.1MB 273ms 23ms dotnet 9.0.102
csharp 1.cs 709ms 4.2ms 153.6MB 727ms 93ms dotnet 9.0.102
kotlin 1-m.kt 832ms 44ms 198.9MB 2267ms 67ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1545ms 50ms 223.7MB 1733ms 100ms dotnet 9.0.102
kotlin 1-m.kt 2318ms 66ms 1048.1MB 5023ms 170ms kotlin/jvm 21
csharp 1.cs 2599ms 54ms 757.2MB 2993ms 383ms dotnet 9.0.102

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 99ms 1.7ms 13.9MB 83ms 0ms dotnet/aot 9.0.102
csharp 2.cs 146ms 1.3ms 22.7MB 133ms 3ms mono 6.12.0
kotlin 1-m.kt 177ms 0.9ms 94.9MB 293ms 37ms kotlin/jvm 21
kotlin 2-m.kt 197ms 4.0ms 102.2MB 413ms 37ms kotlin/jvm 21
csharp 2.cs 257ms 11ms 33.4MB 233ms 13ms dotnet 9.0.102
kotlin 2.kt 305ms 3.4ms 7.8MB 437ms 7ms kotlin/native 1.8.21
kotlin 1.kt 521ms 19ms 7.8MB 623ms 3ms kotlin/native 1.8.21
csharp 1.cs 1004ms 6.7ms 17.2MB 980ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1439ms 251ms 38.9MB 1417ms 13ms dotnet 9.0.102
csharp 1.cs 3311ms 41ms 47.6MB 3270ms 30ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 273ms 2.4ms 13.7MB 257ms 0ms dotnet/aot 9.0.102
kotlin 2-m.kt 317ms 11ms 213.0MB 513ms 47ms kotlin/jvm 21
kotlin 1.kt 325ms 3.6ms 202.9MB 443ms 30ms kotlin/jvm 21
csharp 2.cs 402ms 2.3ms 35.6MB 387ms 10ms dotnet 9.0.102
csharp 2.cs 412ms 97ms 24.8MB 397ms 0ms mono 6.12.0
kotlin 2.kt 907ms 26ms 7.8MB 1293ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1564ms 31ms 7.9MB 1900ms 33ms kotlin/native 1.8.21
csharp 1.cs 2970ms 21ms 17.1MB 2943ms 13ms dotnet/aot 9.0.102
csharp 1.cs 3581ms 35ms 39.1MB 3560ms 20ms dotnet 9.0.102
csharp 1.cs timeout 0.0ms 47.8MB 4953ms 37ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 52ms 1.8ms 15.9MB 40ms 0ms dotnet/aot 9.0.102
csharp 2.cs 94ms 1.2ms 24.5MB 80ms 3ms mono 6.12.0
kotlin 1-m.kt 141ms 6.8ms 90.5MB 270ms 27ms kotlin/jvm 21
kotlin 2.kt 141ms 4.0ms 5.7MB 193ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 152ms 8.3ms 93.7MB 300ms 33ms kotlin/jvm 21
csharp 2.cs 166ms 1.3ms 35.5MB 147ms 7ms dotnet 9.0.102
kotlin 1.kt 178ms 5.5ms 5.9MB 230ms 0ms kotlin/native 1.8.21
csharp 1.cs 1609ms 2.2ms 36.8MB 1597ms 7ms dotnet 9.0.102
csharp 1.cs 1817ms 2.0ms 16.9MB 1793ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1821ms 18ms 30.8MB 1803ms 7ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 344ms 1.7ms 679.6MB 383ms 67ms kotlin/jvm 21
csharp 2.cs 540ms 17ms 126.2MB 480ms 90ms dotnet/aot 9.0.102
csharp 1.cs 585ms 1.6ms 153.7MB 523ms 133ms dotnet/aot 9.0.102
csharp 2.cs 687ms 11ms 142.9MB 637ms 97ms dotnet 9.0.102
csharp 1.cs 740ms 30ms 169.4MB 690ms 120ms dotnet 9.0.102
csharp 1.cs 1320ms 56ms 146.4MB 1527ms 183ms mono 6.12.0
kotlin 1-m.kt 1514ms 66ms 136.5MB 2323ms 343ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 127ms 2.3ms 208.6MB 157ms 30ms kotlin/jvm 21
csharp 2.cs 135ms 1.9ms 64.0MB 103ms 33ms dotnet/aot 9.0.102
csharp 1.cs 153ms 2.5ms 80.5MB 120ms 43ms dotnet/aot 9.0.102
csharp 1.cs 260ms 7.3ms 69.5MB 233ms 33ms mono 6.12.0
csharp 2.cs 263ms 7.3ms 82.8MB 210ms 47ms dotnet 9.0.102
csharp 1.cs 288ms 18ms 99.0MB 240ms 50ms dotnet 9.0.102
kotlin 1-m.kt 302ms 3.5ms 40.6MB 430ms 70ms kotlin/native 1.8.21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 360ms 2.4ms 34.2MB 340ms 10ms dotnet 9.0.102
csharp 8.cs 370ms 0.4ms 15.7MB 357ms 0ms dotnet/aot 9.0.102
kotlin 1n.kt 405ms 5.4ms 4.7MB 393ms 0ms kotlin/native 1.8.21
csharp 8.cs 418ms 0.9ms 33.8MB 393ms 10ms dotnet 9.0.102
kotlin 1.kt 443ms 4.4ms 49.6MB 483ms 17ms kotlin/jvm 21
csharp 8.cs 1246ms 5.3ms 22.4MB 1230ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 46ms 1.6ms 4.6MB 33ms 0ms kotlin/native 1.8.21
csharp 8.cs 46ms 1.7ms 16.0MB 30ms 0ms dotnet/aot 9.0.102
csharp 9.cs 92ms 1.1ms 34.0MB 77ms 0ms dotnet 9.0.102
csharp 8.cs 105ms 9.8ms 34.0MB 73ms 10ms dotnet 9.0.102
kotlin 1.kt 120ms 1.7ms 49.7MB 160ms 20ms kotlin/jvm 21
csharp 8.cs 162ms 2.1ms 26.3MB 147ms 3ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 3242ms 11ms 19.9MB 3120ms 117ms dotnet/aot 9.0.102
csharp 1.cs 3579ms 48ms 42.2MB 3567ms 147ms dotnet 9.0.102
kotlin 1.kt 3713ms 77ms 353.7MB 4497ms 83ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6367ms 257ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.3MB 4983ms 173ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 761ms 6.6ms 19.2MB 713ms 33ms dotnet/aot 9.0.102
csharp 1.cs 996ms 11ms 43.7MB 1077ms 40ms dotnet 9.0.102
kotlin 1-m.kt 1005ms 20ms 353.8MB 1740ms 70ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.3MB 6397ms 293ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 10.3MB 5003ms 153ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1747ms 9.0ms 429.4MB 1660ms 133ms dotnet/aot 9.0.102
csharp 5.cs 2081ms 40ms 454.7MB 2120ms 190ms dotnet 9.0.102
csharp 6.cs 2702ms 39ms 451.9MB 2663ms 167ms dotnet 9.0.102
csharp 5.cs 4204ms 37ms 425.2MB 4097ms 153ms dotnet/aot 9.0.102
kotlin 1.kt timeout 0.0ms 171.6MB 5427ms 37ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 279.1MB 5003ms 860ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 191ms 1.2ms 54.4MB 167ms 17ms dotnet/aot 9.0.102
csharp 5.cs 293ms 6.7ms 80.4MB 240ms 43ms dotnet 9.0.102
csharp 6.cs 390ms 2.9ms 78.2MB 350ms 37ms dotnet 9.0.102
csharp 5.cs 429ms 2.0ms 58.0MB 403ms 17ms dotnet/aot 9.0.102
kotlin 1-m.kt 836ms 29ms 134.6MB 1223ms 50ms kotlin/jvm 21
kotlin 1n.kt 3337ms 226ms 65.0MB 4233ms 10ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 2807ms 10ms 17.1MB 2760ms 40ms dotnet/aot 9.0.102
csharp 1.cs 2940ms 11ms 39.4MB 2987ms 57ms dotnet 9.0.102
kotlin 1.kt 3090ms 36ms 231.3MB 3953ms 63ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 718ms 12ms 15.0MB 697ms 3ms dotnet/aot 9.0.102
kotlin 1-m.kt 950ms 29ms 231.2MB 1920ms 57ms kotlin/jvm 21
csharp 1.cs 999ms 20ms 40.3MB 1080ms 20ms dotnet 9.0.102