Programming Language and compiler
Benchmarks

C# VS Kotlin benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 475ms 17ms 579.4MB 547ms 97ms kotlin/jvm 21
csharp 1.cs 942ms 23ms 178.5MB 930ms 140ms dotnet/aot 9.0.100
csharp 1.cs 1121ms 32ms 206.4MB 1067ms 147ms dotnet 9.0.100
csharp 1.cs 1708ms 66ms 101.6MB 1907ms 207ms mono 6.12.0
kotlin 1-m.kt 3085ms 72ms 252.5MB 5140ms 680ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 102ms 2.5ms 160.0MB 107ms 27ms kotlin/jvm 21
csharp 1.cs 122ms 3.4ms 41.6MB 83ms 27ms dotnet/aot 9.0.100
csharp 1.cs 143ms 1.2ms 46.1MB 117ms 17ms mono 6.12.0
csharp 1.cs 196ms 4.9ms 59.9MB 153ms 33ms dotnet 9.0.100
kotlin 1-m.kt 266ms 3.6ms 32.5MB 413ms 67ms kotlin/native 1.8.21

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 1840ms 308ms 239.6MB 6827ms 123ms kotlin/jvm 21
csharp 1-m.cs 2081ms 50ms 67.5MB 7203ms 80ms dotnet/aot 9.0.100
kotlin 1.kt 2169ms 43ms 219.8MB 3023ms 67ms kotlin/jvm 21
csharp 1-m.cs 2673ms 129ms 80.2MB 9237ms 100ms dotnet 9.0.100
kotlin 1.kt timeout 0.0ms 14.7MB 6043ms 460ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 73.0MB 19093ms 107ms kotlin/native 1.8.21

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 165ms 8.7ms 31.4MB 450ms 13ms dotnet/aot 9.0.100
csharp 1-m.cs 290ms 22ms 49.2MB 813ms 13ms dotnet 9.0.100
kotlin 2-m.kt 395ms 5.2ms 34.8MB 1433ms 40ms kotlin/native 1.8.21
kotlin 1-m.kt 464ms 3.6ms 73.7MB 1043ms 47ms kotlin/jvm 21
kotlin 1.kt 674ms 5.0ms 10.9MB 807ms 53ms kotlin/native 1.8.21
kotlin 2-m.kt 883ms 143ms 98.4MB 3080ms 77ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4073ms 4.1ms 24.1MB 4040ms 17ms dotnet/aot 9.0.100
csharp 1.cs 4945ms 5.6ms 43.9MB 4920ms 13ms dotnet 9.0.100

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 677ms 0.3ms 20.4MB 657ms 3ms dotnet/aot 9.0.100
csharp 1.cs 917ms 60ms 40.2MB 887ms 20ms dotnet 9.0.100

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 137ms 6.7ms 44.9MB 370ms 110ms dotnet/aot 9.0.100
csharp 5-m.cs 193ms 4.9ms 51.1MB 457ms 133ms dotnet 9.0.100
csharp 5-m.cs 248ms 3.8ms 55.4MB 683ms 97ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 27ms 0.5ms 24.8MB 37ms 13ms dotnet/aot 9.0.100
csharp 5-m.cs 61ms 1.8ms 44.5MB 77ms 20ms dotnet 9.0.100
csharp 5-m.cs 70ms 1.9ms 44.3MB 100ms 20ms mono 6.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.3ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
csharp 1.cs 9.1ms 5.6ms 15.6MB 0ms 0ms dotnet/aot 9.0.100
csharp 1.cs 31ms 0.9ms 23.4MB 20ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.6ms 32.3MB 20ms 6ms dotnet 9.0.100
kotlin 1.kt 55ms 4.0ms 47.5MB 58ms 14ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 545ms 8.9ms 120.8MB 720ms 160ms dotnet 9.0.100
csharp 2-m.cs 682ms 35ms 144.9MB 717ms 573ms dotnet 9.0.100
csharp 2-http3.cs 706ms 29ms 160.4MB 1150ms 260ms dotnet 9.0.100
csharp 1-m.cs 827ms 39ms 188.6MB 1083ms 753ms dotnet 9.0.100
kotlin 2-m.kt 4705ms 97ms 372.4MB 14620ms 2427ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 382.6MB 16320ms 2680ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 422ms 13ms 98.9MB 373ms 207ms dotnet 9.0.100
csharp 1-m.cs 466ms 7.7ms 109.6MB 507ms 263ms dotnet 9.0.100
csharp 2-http2.cs 468ms 11ms 98.5MB 490ms 93ms dotnet 9.0.100
csharp 2-http3.cs 521ms 1.4ms 107.2MB 587ms 127ms dotnet 9.0.100
kotlin 1-m.kt 2187ms 374ms 258.9MB 6430ms 637ms kotlin/jvm 21
kotlin 2-m.kt 2195ms 62ms 249.1MB 5710ms 610ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 306ms 2.5ms 80.6MB 277ms 23ms dotnet 9.0.100
csharp 1.cs 721ms 29ms 151.5MB 760ms 67ms dotnet 9.0.100
kotlin 1-m.kt 893ms 18ms 206.2MB 2427ms 80ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1581ms 74ms 223.9MB 1753ms 97ms dotnet 9.0.100
kotlin 1-m.kt 2296ms 21ms 773.1MB 4957ms 173ms kotlin/jvm 21
csharp 1.cs 2538ms 31ms 759.0MB 2750ms 410ms dotnet 9.0.100

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 452ms 5.9ms 54.4MB 1193ms 23ms dotnet/aot 9.0.100
csharp 6-m.cs 695ms 42ms 78.3MB 1920ms 33ms dotnet 9.0.100
csharp 6-m.cs 1020ms 12ms 69.1MB 2967ms 30ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 85ms 4.5ms 45.0MB 153ms 10ms dotnet/aot 9.0.100
csharp 6-m.cs 169ms 7.9ms 66.9MB 240ms 37ms dotnet 9.0.100
csharp 6-m.cs 193ms 4.6ms 56.0MB 360ms 30ms mono 6.12.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 95ms 2.1ms 13.7MB 80ms 3ms dotnet/aot 9.0.100
csharp 2.cs 150ms 1.1ms 23.2MB 140ms 0ms mono 6.12.0
kotlin 1-m.kt 179ms 2.4ms 96.4MB 293ms 27ms kotlin/jvm 21
kotlin 2-m.kt 193ms 1.1ms 103.4MB 407ms 40ms kotlin/jvm 21
csharp 2.cs 249ms 2.0ms 35.6MB 230ms 10ms dotnet 9.0.100
kotlin 2.kt 304ms 3.0ms 7.9MB 427ms 13ms kotlin/native 1.8.21
kotlin 1.kt 515ms 18ms 7.8MB 623ms 3ms kotlin/native 1.8.21
csharp 1.cs 1058ms 2.9ms 16.9MB 1037ms 7ms dotnet/aot 9.0.100
csharp 1.cs 1361ms 146ms 36.7MB 1350ms 10ms dotnet 9.0.100
csharp 1.cs 3309ms 45ms 47.6MB 3260ms 43ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 265ms 1.2ms 13.6MB 250ms 0ms dotnet/aot 9.0.100
kotlin 2-m.kt 304ms 11ms 212.8MB 533ms 40ms kotlin/jvm 21
kotlin 1.kt 325ms 2.9ms 202.8MB 440ms 27ms kotlin/jvm 21
csharp 2.cs 357ms 1.6ms 26.6MB 343ms 0ms mono 6.12.0
csharp 2.cs 401ms 4.2ms 35.5MB 380ms 13ms dotnet 9.0.100
kotlin 2.kt 898ms 0.8ms 7.8MB 1297ms 43ms kotlin/native 1.8.21
kotlin 1.kt 1591ms 14ms 7.9MB 1973ms 20ms kotlin/native 1.8.21
csharp 1.cs 3169ms 19ms 17.0MB 3133ms 20ms dotnet/aot 9.0.100
csharp 1.cs 3580ms 13ms 39.1MB 3560ms 20ms dotnet 9.0.100
csharp 1.cs timeout 0.0ms 45.8MB 4940ms 43ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 54ms 0.7ms 13.5MB 37ms 3ms dotnet/aot 9.0.100
csharp 2.cs 99ms 9.0ms 26.8MB 90ms 0ms mono 6.12.0
kotlin 1-m.kt 140ms 3.1ms 90.2MB 267ms 27ms kotlin/jvm 21
kotlin 2.kt 142ms 3.9ms 5.7MB 200ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 154ms 12ms 98.0MB 293ms 37ms kotlin/jvm 21
csharp 2.cs 163ms 2.9ms 35.6MB 137ms 17ms dotnet 9.0.100
kotlin 1.kt 170ms 6.0ms 5.7MB 210ms 3ms kotlin/native 1.8.21
csharp 1.cs 1613ms 13ms 38.5MB 1600ms 13ms dotnet 9.0.100
csharp 1.cs 1805ms 4.2ms 16.9MB 1787ms 3ms dotnet/aot 9.0.100
csharp 1.cs 1806ms 4.7ms 30.7MB 1790ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1057ms 66ms 45.8MB 1033ms 13ms dotnet 9.0.100
csharp 1.cs 2046ms 9.1ms 42.7MB 2030ms 3ms dotnet 9.0.100
csharp 3.cs 2461ms 4.0ms 43.0MB 2433ms 7ms dotnet 9.0.100
csharp 3.cs 2516ms 11ms 22.3MB 2497ms 0ms dotnet/aot 9.0.100
csharp 1.cs 3557ms 10ms 22.4MB 3540ms 3ms dotnet/aot 9.0.100
csharp 1.cs timeout 0.0ms 22.4MB 4990ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3.cs 117ms 2.9ms 19.2MB 100ms 3ms dotnet/aot 9.0.100
csharp 2.cs 129ms 4.2ms 43.1MB 107ms 10ms dotnet 9.0.100
csharp 1.cs 138ms 2.3ms 39.5MB 120ms 7ms dotnet 9.0.100
csharp 1.cs 156ms 1.7ms 19.3MB 150ms 0ms dotnet/aot 9.0.100
csharp 3.cs 177ms 13ms 40.1MB 147ms 7ms dotnet 9.0.100
csharp 1.cs 573ms 2.0ms 23.9MB 553ms 7ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 350ms 2.1ms 679.4MB 383ms 77ms kotlin/jvm 21
csharp 2.cs 543ms 7.0ms 124.9MB 480ms 93ms dotnet/aot 9.0.100
csharp 1.cs 598ms 27ms 152.8MB 520ms 123ms dotnet/aot 9.0.100
csharp 2.cs 679ms 13ms 140.7MB 630ms 100ms dotnet 9.0.100
csharp 1.cs 754ms 16ms 173.0MB 683ms 140ms dotnet 9.0.100
csharp 1.cs 1318ms 93ms 142.6MB 1553ms 177ms mono 6.12.0
kotlin 1-m.kt 1501ms 11ms 136.5MB 2307ms 327ms kotlin/native 1.8.21

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 127ms 2.6ms 206.6MB 150ms 40ms kotlin/jvm 21
csharp 2.cs 135ms 1.1ms 66.2MB 107ms 30ms dotnet/aot 9.0.100
csharp 1.cs 149ms 4.0ms 80.6MB 110ms 47ms dotnet/aot 9.0.100
csharp 2.cs 256ms 2.6ms 84.5MB 213ms 53ms dotnet 9.0.100
csharp 1.cs 264ms 7.8ms 69.4MB 230ms 40ms mono 6.12.0
csharp 1.cs 274ms 1.4ms 99.3MB 243ms 57ms dotnet 9.0.100
kotlin 1-m.kt 314ms 24ms 40.5MB 453ms 73ms kotlin/native 1.8.21

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 358ms 1.2ms 34.0MB 347ms 0ms dotnet 9.0.100
csharp 8.cs 371ms 1.4ms 15.8MB 360ms 0ms dotnet/aot 9.0.100
kotlin 1n.kt 407ms 3.5ms 4.6MB 397ms 0ms kotlin/native 1.8.21
csharp 8.cs 424ms 8.4ms 33.8MB 397ms 10ms dotnet 9.0.100
kotlin 1.kt 443ms 2.0ms 49.1MB 483ms 17ms kotlin/jvm 21
csharp 8.cs 1247ms 5.7ms 24.3MB 1230ms 7ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 45ms 1.6ms 4.6MB 33ms 0ms kotlin/native 1.8.21
csharp 8.cs 45ms 1.6ms 15.8MB 30ms 0ms dotnet/aot 9.0.100
csharp 9.cs 93ms 1.7ms 33.7MB 77ms 7ms dotnet 9.0.100
csharp 8.cs 94ms 0.7ms 33.7MB 73ms 10ms dotnet 9.0.100
kotlin 1.kt 118ms 1.0ms 49.6MB 160ms 17ms kotlin/jvm 21
csharp 8.cs 165ms 1.7ms 24.4MB 150ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 304ms 5.3ms 57.4MB 280ms 7ms dotnet/aot 9.0.100
csharp 1.cs 348ms 16ms 70.3MB 307ms 20ms dotnet 9.0.100
csharp 2.cs 401ms 5.9ms 40.2MB 370ms 10ms dotnet 9.0.100
csharp 2.cs 424ms 1.2ms 21.9MB 403ms 7ms dotnet/aot 9.0.100
csharp 1.cs 542ms 6.6ms 86.0MB 517ms 10ms mono 6.12.0
csharp 2.cs 1867ms 11ms 31.7MB 1850ms 7ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 67ms 0.9ms 23.9MB 50ms 0ms dotnet/aot 9.0.100
csharp 1.cs 99ms 1.6ms 43.2MB 73ms 17ms dotnet 9.0.100
csharp 2.cs 109ms 0.4ms 17.8MB 97ms 0ms dotnet/aot 9.0.100
csharp 2.cs 132ms 12ms 34.2MB 100ms 10ms dotnet 9.0.100
csharp 1.cs 145ms 2.5ms 41.9MB 130ms 3ms mono 6.12.0
csharp 2.cs 483ms 1.3ms 23.1MB 470ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 3199ms 6.2ms 19.7MB 3087ms 107ms dotnet/aot 9.0.100
csharp 1.cs 3600ms 78ms 44.2MB 3597ms 130ms dotnet 9.0.100
kotlin 1.kt 3780ms 66ms 353.7MB 4587ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.6MB 6390ms 297ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 4990ms 167ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 751ms 1.3ms 19.6MB 710ms 30ms dotnet/aot 9.0.100
csharp 1.cs 991ms 26ms 44.0MB 1090ms 37ms dotnet 9.0.100
kotlin 1-m.kt 992ms 31ms 352.8MB 1700ms 87ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.3MB 6427ms 263ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 5007ms 150ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1754ms 4.8ms 426.6MB 1663ms 143ms dotnet/aot 9.0.100
csharp 5.cs 2108ms 44ms 452.8MB 2167ms 183ms dotnet 9.0.100
csharp 6.cs 2778ms 82ms 451.7MB 2720ms 180ms dotnet 9.0.100
csharp 5.cs 4294ms 41ms 430.2MB 4173ms 170ms dotnet/aot 9.0.100
kotlin 1.kt timeout 0.0ms 171.4MB 5383ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 279.0MB 5193ms 690ms kotlin/native 1.8.21

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 192ms 0.4ms 57.4MB 160ms 20ms dotnet/aot 9.0.100
csharp 5.cs 295ms 8.5ms 81.4MB 263ms 20ms dotnet 9.0.100
csharp 6.cs 389ms 1.3ms 77.9MB 353ms 30ms dotnet 9.0.100
csharp 5.cs 440ms 1.5ms 55.9MB 413ms 20ms dotnet/aot 9.0.100
kotlin 1-m.kt 816ms 17ms 133.5MB 1237ms 33ms kotlin/jvm 21
kotlin 1n.kt 3103ms 11ms 67.1MB 3820ms 7ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 2841ms 7.7ms 17.0MB 2797ms 27ms dotnet/aot 9.0.100
kotlin 1.kt 3097ms 63ms 230.9MB 3970ms 60ms kotlin/jvm 21
csharp 1.cs 3124ms 139ms 38.4MB 3177ms 40ms dotnet 9.0.100

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 719ms 0.5ms 17.0MB 697ms 3ms dotnet/aot 9.0.100
kotlin 1-m.kt 971ms 46ms 231.8MB 1847ms 70ms kotlin/jvm 21
csharp 1.cs 982ms 2.4ms 41.6MB 1067ms 23ms dotnet 9.0.100

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1872ms 21ms 18.3MB 7233ms 7ms dotnet/aot 9.0.100
csharp 3-m.cs 1919ms 8.5ms 39.9MB 7290ms 23ms dotnet 9.0.100
csharp 3-m.cs 4604ms 45ms 26.8MB 17770ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 497ms 35ms 18.3MB 1783ms 3ms dotnet/aot 9.0.100
csharp 3-m.cs 530ms 1.5ms 37.9MB 1857ms 20ms dotnet 9.0.100
csharp 3-m.cs 1290ms 128ms 25.6MB 4493ms 13ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 130ms 0.9ms 18.3MB 437ms 0ms dotnet/aot 9.0.100
csharp 3-m.cs 178ms 2.3ms 36.4MB 500ms 7ms dotnet 9.0.100
csharp 3-m.cs 346ms 0.2ms 28.4MB 1153ms 13ms mono 6.12.0