Programming Language and compiler
Benchmarks

C# VS Kotlin benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 487ms 33ms 1217.6MB 527ms 123ms kotlin/jvm 21
csharp 1.cs 912ms 14ms 187.1MB 903ms 140ms dotnet/aot 9.0.102
csharp 1.cs 964ms 9.3ms 206.6MB 947ms 153ms dotnet 9.0.102
csharp 1.cs 1752ms 85ms 103.6MB 1933ms 253ms mono 6.12.0
kotlin 1-m.kt 3121ms 31ms 248.4MB 5273ms 667ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 99ms 1.2ms 158.3MB 103ms 30ms kotlin/jvm 21
csharp 1.cs 117ms 2.5ms 41.9MB 80ms 30ms dotnet/aot 9.0.102
csharp 1.cs 151ms 2.8ms 46.3MB 127ms 10ms mono 6.12.0
csharp 1.cs 204ms 17ms 64.6MB 153ms 37ms dotnet 9.0.102
kotlin 1-m.kt 266ms 1.2ms 28.5MB 413ms 67ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1809ms 268ms 235.5MB 6717ms 107ms kotlin/jvm 21
kotlin 1.kt 2109ms 6.9ms 219.7MB 2923ms 63ms kotlin/jvm 21
csharp 1-m.cs 2167ms 61ms 71.6MB 7430ms 90ms dotnet/aot 9.0.102
csharp 1-m.cs 2627ms 90ms 82.1MB 8133ms 107ms dotnet 9.0.102
kotlin 1.kt timeout 0.0ms 14.8MB 6100ms 460ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 69.5MB 18963ms 130ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 174ms 6.3ms 28.9MB 467ms 20ms dotnet/aot 9.0.102
csharp 1-m.cs 285ms 11ms 50.6MB 790ms 33ms dotnet 9.0.102
kotlin 2-m.kt 386ms 11ms 54.6MB 1410ms 27ms kotlin/native 1.8.21
kotlin 1-m.kt 463ms 6.2ms 73.9MB 1070ms 43ms kotlin/jvm 21
kotlin 1.kt 675ms 7.0ms 10.7MB 803ms 70ms kotlin/native 1.8.21
kotlin 2-m.kt 742ms 27ms 99.3MB 2503ms 90ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4084ms 2.2ms 24.3MB 4053ms 17ms dotnet/aot 9.0.102
csharp 1.cs 4938ms 22ms 43.7MB 4910ms 17ms dotnet 9.0.102

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 685ms 5.5ms 20.5MB 660ms 3ms dotnet/aot 9.0.102
csharp 1.cs 858ms 3.8ms 40.0MB 827ms 17ms dotnet 9.0.102

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 138ms 5.4ms 33.9MB 347ms 123ms dotnet/aot 9.0.102
csharp 5-m.cs 188ms 2.6ms 50.8MB 470ms 113ms dotnet 9.0.102
csharp 5-m.cs 259ms 14ms 58.4MB 653ms 157ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 26ms 1.6ms 23.7MB 33ms 17ms dotnet/aot 9.0.102
csharp 5-m.cs 61ms 1.5ms 47.1MB 83ms 20ms dotnet 9.0.102
csharp 5-m.cs 70ms 1.0ms 39.6MB 103ms 17ms mono 6.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.4ms 0.5ms 4.7MB 0ms 0ms kotlin/native 1.8.21
csharp 1.cs 18ms 10ms 12.5MB 0ms 0ms dotnet/aot 9.0.102
csharp 1.cs 31ms 0.2ms 23.3MB 22ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.3ms 30.3MB 16ms 4ms dotnet 9.0.102
kotlin 1.kt 54ms 6.4ms 47.4MB 54ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 512ms 4.2ms 120.8MB 737ms 140ms dotnet 9.0.102
csharp 2-m.cs 646ms 11ms 152.9MB 707ms 517ms dotnet 9.0.102
csharp 2-http3.cs 695ms 16ms 157.2MB 1120ms 290ms dotnet 9.0.102
csharp 1-m.cs 790ms 13ms 171.7MB 1097ms 717ms dotnet 9.0.102
kotlin 2-m.kt 807ms 1397ms 456.2MB 10660ms 1630ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 393.0MB 16180ms 2813ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 390ms 4.2ms 101.0MB 387ms 197ms dotnet 9.0.102
csharp 2-http2.cs 433ms 2.9ms 97.8MB 477ms 100ms dotnet 9.0.102
csharp 1-m.cs 441ms 9.6ms 110.2MB 540ms 250ms dotnet 9.0.102
csharp 2-http3.cs 498ms 11ms 107.6MB 613ms 107ms dotnet 9.0.102
kotlin 2-m.kt 2185ms 260ms 239.6MB 4107ms 410ms kotlin/jvm 21
kotlin 1-m.kt 2220ms 269ms 241.0MB 6507ms 647ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 310ms 6.9ms 79.1MB 273ms 23ms dotnet 9.0.102
csharp 1.cs 709ms 4.2ms 153.6MB 727ms 93ms dotnet 9.0.102
kotlin 1-m.kt 832ms 44ms 198.9MB 2267ms 67ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1545ms 50ms 223.7MB 1733ms 100ms dotnet 9.0.102
kotlin 1-m.kt 2318ms 66ms 1048.1MB 5023ms 170ms kotlin/jvm 21
csharp 1.cs 2599ms 54ms 757.2MB 2993ms 383ms dotnet 9.0.102

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 481ms 30ms 54.6MB 1310ms 20ms dotnet/aot 9.0.102
csharp 6-m.cs 761ms 32ms 77.6MB 2040ms 37ms dotnet 9.0.102
csharp 6-m.cs 999ms 25ms 64.5MB 2880ms 20ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 89ms 4.3ms 43.4MB 157ms 13ms dotnet/aot 9.0.102
csharp 6-m.cs 171ms 13ms 64.0MB 250ms 20ms dotnet 9.0.102
csharp 6-m.cs 193ms 0.8ms 49.5MB 377ms 13ms mono 6.12.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 99ms 1.7ms 13.9MB 83ms 0ms dotnet/aot 9.0.102
csharp 2.cs 146ms 1.3ms 22.7MB 133ms 3ms mono 6.12.0
kotlin 1-m.kt 177ms 0.9ms 94.9MB 293ms 37ms kotlin/jvm 21
kotlin 2-m.kt 197ms 4.0ms 102.2MB 413ms 37ms kotlin/jvm 21
csharp 2.cs 257ms 11ms 33.4MB 233ms 13ms dotnet 9.0.102
kotlin 2.kt 305ms 3.4ms 7.8MB 437ms 7ms kotlin/native 1.8.21
kotlin 1.kt 521ms 19ms 7.8MB 623ms 3ms kotlin/native 1.8.21
csharp 1.cs 1004ms 6.7ms 17.2MB 980ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1439ms 251ms 38.9MB 1417ms 13ms dotnet 9.0.102
csharp 1.cs 3311ms 41ms 47.6MB 3270ms 30ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 273ms 2.4ms 13.7MB 257ms 0ms dotnet/aot 9.0.102
kotlin 2-m.kt 317ms 11ms 213.0MB 513ms 47ms kotlin/jvm 21
kotlin 1.kt 325ms 3.6ms 202.9MB 443ms 30ms kotlin/jvm 21
csharp 2.cs 402ms 2.3ms 35.6MB 387ms 10ms dotnet 9.0.102
csharp 2.cs 412ms 97ms 24.8MB 397ms 0ms mono 6.12.0
kotlin 2.kt 907ms 26ms 7.8MB 1293ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1564ms 31ms 7.9MB 1900ms 33ms kotlin/native 1.8.21
csharp 1.cs 2970ms 21ms 17.1MB 2943ms 13ms dotnet/aot 9.0.102
csharp 1.cs 3581ms 35ms 39.1MB 3560ms 20ms dotnet 9.0.102
csharp 1.cs timeout 0.0ms 47.8MB 4953ms 37ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 52ms 1.8ms 15.9MB 40ms 0ms dotnet/aot 9.0.102
csharp 2.cs 94ms 1.2ms 24.5MB 80ms 3ms mono 6.12.0
kotlin 1-m.kt 141ms 6.8ms 90.5MB 270ms 27ms kotlin/jvm 21
kotlin 2.kt 141ms 4.0ms 5.7MB 193ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 152ms 8.3ms 93.7MB 300ms 33ms kotlin/jvm 21
csharp 2.cs 166ms 1.3ms 35.5MB 147ms 7ms dotnet 9.0.102
kotlin 1.kt 178ms 5.5ms 5.9MB 230ms 0ms kotlin/native 1.8.21
csharp 1.cs 1609ms 2.2ms 36.8MB 1597ms 7ms dotnet 9.0.102
csharp 1.cs 1817ms 2.0ms 16.9MB 1793ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1821ms 18ms 30.8MB 1803ms 7ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1093ms 64ms 46.0MB 1057ms 20ms dotnet 9.0.102
csharp 1.cs 2043ms 10ms 42.9MB 2010ms 20ms dotnet 9.0.102
csharp 3.cs 2350ms 7.8ms 22.1MB 2337ms 3ms dotnet/aot 9.0.102
csharp 3.cs 2712ms 331ms 42.9MB 2683ms 10ms dotnet 9.0.102
csharp 1.cs 3946ms 98ms 22.2MB 3927ms 3ms dotnet/aot 9.0.102
csharp 1.cs timeout 0.0ms 24.4MB 4983ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3.cs 111ms 1.1ms 18.9MB 93ms 3ms dotnet/aot 9.0.102
csharp 2.cs 132ms 0.7ms 42.9MB 113ms 7ms dotnet 9.0.102
csharp 1.cs 139ms 1.8ms 40.0MB 120ms 3ms dotnet 9.0.102
csharp 3.cs 169ms 5.2ms 40.2MB 143ms 7ms dotnet 9.0.102
csharp 1.cs 173ms 2.3ms 19.2MB 160ms 0ms dotnet/aot 9.0.102
csharp 1.cs 566ms 2.5ms 23.4MB 547ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 344ms 1.7ms 679.6MB 383ms 67ms kotlin/jvm 21
csharp 2.cs 540ms 17ms 126.2MB 480ms 90ms dotnet/aot 9.0.102
csharp 1.cs 585ms 1.6ms 153.7MB 523ms 133ms dotnet/aot 9.0.102
csharp 2.cs 687ms 11ms 142.9MB 637ms 97ms dotnet 9.0.102
csharp 1.cs 740ms 30ms 169.4MB 690ms 120ms dotnet 9.0.102
csharp 1.cs 1320ms 56ms 146.4MB 1527ms 183ms mono 6.12.0
kotlin 1-m.kt 1514ms 66ms 136.5MB 2323ms 343ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 127ms 2.3ms 208.6MB 157ms 30ms kotlin/jvm 21
csharp 2.cs 135ms 1.9ms 64.0MB 103ms 33ms dotnet/aot 9.0.102
csharp 1.cs 153ms 2.5ms 80.5MB 120ms 43ms dotnet/aot 9.0.102
csharp 1.cs 260ms 7.3ms 69.5MB 233ms 33ms mono 6.12.0
csharp 2.cs 263ms 7.3ms 82.8MB 210ms 47ms dotnet 9.0.102
csharp 1.cs 288ms 18ms 99.0MB 240ms 50ms dotnet 9.0.102
kotlin 1-m.kt 302ms 3.5ms 40.6MB 430ms 70ms kotlin/native 1.8.21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 360ms 2.4ms 34.2MB 340ms 10ms dotnet 9.0.102
csharp 8.cs 370ms 0.4ms 15.7MB 357ms 0ms dotnet/aot 9.0.102
kotlin 1n.kt 405ms 5.4ms 4.7MB 393ms 0ms kotlin/native 1.8.21
csharp 8.cs 418ms 0.9ms 33.8MB 393ms 10ms dotnet 9.0.102
kotlin 1.kt 443ms 4.4ms 49.6MB 483ms 17ms kotlin/jvm 21
csharp 8.cs 1246ms 5.3ms 22.4MB 1230ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 46ms 1.6ms 4.6MB 33ms 0ms kotlin/native 1.8.21
csharp 8.cs 46ms 1.7ms 16.0MB 30ms 0ms dotnet/aot 9.0.102
csharp 9.cs 92ms 1.1ms 34.0MB 77ms 0ms dotnet 9.0.102
csharp 8.cs 105ms 9.8ms 34.0MB 73ms 10ms dotnet 9.0.102
kotlin 1.kt 120ms 1.7ms 49.7MB 160ms 20ms kotlin/jvm 21
csharp 8.cs 162ms 2.1ms 26.3MB 147ms 3ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 308ms 4.3ms 54.8MB 287ms 10ms dotnet/aot 9.0.102
csharp 1.cs 349ms 1.7ms 70.4MB 323ms 10ms dotnet 9.0.102
csharp 2.cs 396ms 1.6ms 19.9MB 380ms 3ms dotnet/aot 9.0.102
csharp 2.cs 400ms 11ms 38.9MB 370ms 10ms dotnet 9.0.102
csharp 1.cs 535ms 6.8ms 86.0MB 507ms 10ms mono 6.12.0
csharp 2.cs 1874ms 13ms 31.5MB 1860ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 65ms 0.2ms 27.5MB 50ms 3ms dotnet/aot 9.0.102
csharp 1.cs 98ms 1.1ms 45.5MB 73ms 10ms dotnet 9.0.102
csharp 2.cs 102ms 0.7ms 17.8MB 87ms 3ms dotnet/aot 9.0.102
csharp 2.cs 130ms 1.9ms 36.2MB 107ms 7ms dotnet 9.0.102
csharp 1.cs 144ms 1.5ms 40.3MB 127ms 7ms mono 6.12.0
csharp 2.cs 484ms 8.1ms 24.9MB 463ms 3ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 3242ms 11ms 19.9MB 3120ms 117ms dotnet/aot 9.0.102
csharp 1.cs 3579ms 48ms 42.2MB 3567ms 147ms dotnet 9.0.102
kotlin 1.kt 3713ms 77ms 353.7MB 4497ms 83ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6367ms 257ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.3MB 4983ms 173ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 761ms 6.6ms 19.2MB 713ms 33ms dotnet/aot 9.0.102
csharp 1.cs 996ms 11ms 43.7MB 1077ms 40ms dotnet 9.0.102
kotlin 1-m.kt 1005ms 20ms 353.8MB 1740ms 70ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.3MB 6397ms 293ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 10.3MB 5003ms 153ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1747ms 9.0ms 429.4MB 1660ms 133ms dotnet/aot 9.0.102
csharp 5.cs 2081ms 40ms 454.7MB 2120ms 190ms dotnet 9.0.102
csharp 6.cs 2702ms 39ms 451.9MB 2663ms 167ms dotnet 9.0.102
csharp 5.cs 4204ms 37ms 425.2MB 4097ms 153ms dotnet/aot 9.0.102
kotlin 1.kt timeout 0.0ms 171.6MB 5427ms 37ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 279.1MB 5003ms 860ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 191ms 1.2ms 54.4MB 167ms 17ms dotnet/aot 9.0.102
csharp 5.cs 293ms 6.7ms 80.4MB 240ms 43ms dotnet 9.0.102
csharp 6.cs 390ms 2.9ms 78.2MB 350ms 37ms dotnet 9.0.102
csharp 5.cs 429ms 2.0ms 58.0MB 403ms 17ms dotnet/aot 9.0.102
kotlin 1-m.kt 836ms 29ms 134.6MB 1223ms 50ms kotlin/jvm 21
kotlin 1n.kt 3337ms 226ms 65.0MB 4233ms 10ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 2807ms 10ms 17.1MB 2760ms 40ms dotnet/aot 9.0.102
csharp 1.cs 2940ms 11ms 39.4MB 2987ms 57ms dotnet 9.0.102
kotlin 1.kt 3090ms 36ms 231.3MB 3953ms 63ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 718ms 12ms 15.0MB 697ms 3ms dotnet/aot 9.0.102
kotlin 1-m.kt 950ms 29ms 231.2MB 1920ms 57ms kotlin/jvm 21
csharp 1.cs 999ms 20ms 40.3MB 1080ms 20ms dotnet 9.0.102

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1873ms 37ms 18.4MB 7180ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 1971ms 75ms 38.1MB 7220ms 13ms dotnet 9.0.102
csharp 3-m.cs 4634ms 249ms 30.7MB 17543ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 476ms 1.6ms 18.2MB 1790ms 10ms dotnet/aot 9.0.102
csharp 3-m.cs 542ms 12ms 39.9MB 1870ms 10ms dotnet 9.0.102
csharp 3-m.cs 1203ms 18ms 31.0MB 4483ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 129ms 1.0ms 18.4MB 440ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 193ms 15ms 36.4MB 497ms 10ms dotnet 9.0.102
csharp 3-m.cs 348ms 2.4ms 26.4MB 1160ms 7ms mono 6.12.0