Programming Language and compiler
Benchmarks

Nim VS C# benchmarks

Current benchmark data was generated on Wed Feb 08 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1718ms 34ms 303.4MB 1583ms 217ms dotnet/aot 7.0.102
csharp 1.cs 1977ms 81ms 433.3MB 1717ms 333ms dotnet 7.0.102
nim 2.nim 2517ms 18ms 33.9MB 2493ms 3ms nim 1.6.10
nim 2.nim 2531ms 9.3ms 34.8MB 2507ms 7ms nim/clang 1.6.10
csharp 1.cs 2754ms 23ms 106.2MB 3340ms 227ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 173ms 7.2ms 60.2MB 137ms 30ms dotnet/aot 7.0.102
csharp 1.cs 190ms 1.8ms 46.1MB 167ms 13ms mono 6.12.0
nim 2.nim 239ms 0.4ms 5.7MB 227ms 0ms nim/clang 1.6.10
nim 2.nim 240ms 1.4ms 5.5MB 220ms 0ms nim 1.6.10
csharp 1.cs 345ms 16ms 151.8MB 240ms 73ms dotnet 7.0.102

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 159.0MB 9133ms 113ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 65.9MB 9127ms 70ms dotnet/aot 7.0.102
nim 1.nim timeout 0.0ms 405.0MB 3300ms 1353ms nim 1.6.10
nim 1.nim timeout 0.0ms 405.5MB 3347ms 1307ms nim/clang 1.6.10

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 374ms 8.9ms 54.9MB 623ms 27ms dotnet/aot 7.0.102
csharp 1-m.cs 729ms 80ms 145.2MB 1137ms 70ms dotnet 7.0.102
nim 1.nim timeout 0.0ms 405.3MB 3357ms 1303ms nim 1.6.10
nim 1.nim timeout 0.0ms 407.5MB 3353ms 1290ms nim/clang 1.6.10

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 112.0MB 4923ms 37ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 22.6MB 4990ms 0ms dotnet/aot 7.0.102
nim 1.nim timeout 0.0ms 3.1MB 4990ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 3.0MB 4983ms 0ms nim/clang 1.6.10

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1006ms 2.0ms 19.3MB 990ms 10ms dotnet/aot 7.0.102
csharp 1.cs 1148ms 0.6ms 109.6MB 1083ms 37ms dotnet 7.0.102
nim 1.nim timeout 0.0ms 2.3MB 4983ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 2.2MB 4980ms 0ms nim/clang 1.6.10

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 291ms 3.7ms 1.0MB 277ms 0ms nim 1.6.10
nim 2.nim 367ms 10.0ms 1.3MB 353ms 0ms nim/clang 1.6.10
csharp 5-m.cs 372ms 28ms 67.2MB 583ms 107ms dotnet/aot 7.0.102
csharp 5-m.cs 590ms 61ms 156.5MB 887ms 137ms dotnet 7.0.102
csharp 5-m.cs 645ms 15ms 60.3MB 1077ms 137ms mono 6.12.0
nim 1.nim 823ms 13ms 1.3MB 707ms 97ms nim/clang 1.6.10
nim 1.nim 839ms 20ms 1.0MB 723ms 100ms nim 1.6.10

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 34ms 2.2ms 1.1MB 20ms 0ms nim 1.6.10
nim 2.nim 39ms 0.2ms 1.3MB 30ms 0ms nim/clang 1.6.10
csharp 5.cs 73ms 29ms 24.4MB 77ms 27ms dotnet/aot 7.0.102
nim 1.nim 84ms 1.5ms 1.2MB 63ms 7ms nim/clang 1.6.10
nim 1.nim 89ms 0.6ms 1.1MB 67ms 7ms nim 1.6.10
csharp 5.cs 107ms 3.8ms 34.1MB 137ms 23ms mono 6.12.0
csharp 5.cs 163ms 6.8ms 111.5MB 130ms 70ms dotnet 7.0.102

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2.1ms 0.5ms 1.0MB 0ms 0ms nim 1.6.10
nim 1.nim 2.3ms 0.9ms 1.9MB 0ms 0ms nim/clang 1.6.10
csharp 1.cs 8.0ms 0.9ms 10.1MB 0ms 0ms dotnet/aot 7.0.102
csharp 1.cs 24ms 1.3ms 23.6MB 10ms 2ms mono 6.12.0
csharp 1.cs 91ms 4.1ms 101.5MB 30ms 32ms dotnet 7.0.102

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 954ms 7.7ms 94.1MB 447ms 470ms nim/clang 1.6.10
nim 1.nim 989ms 9.0ms 94.7MB 460ms 487ms nim 1.6.10
csharp 2-http2.cs 1129ms 7.3ms 198.2MB 1167ms 170ms dotnet 7.0.102
csharp 2.cs 1150ms 43ms 235.2MB 973ms 657ms dotnet 7.0.102
csharp 1-m.cs 1248ms 24ms 252.7MB 1233ms 663ms dotnet 7.0.102
csharp 2-http3.cs 2141ms 126ms 363.6MB 2693ms 497ms dotnet 7.0.102

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 154ms 1.8ms 17.8MB 63ms 73ms nim 1.6.10
nim 1.nim 158ms 3.7ms 18.1MB 60ms 83ms nim/clang 1.6.10
csharp 2.cs 607ms 25ms 158.8MB 497ms 173ms dotnet 7.0.102
csharp 1.cs 697ms 40ms 172.1MB 660ms 237ms dotnet 7.0.102
csharp 2-http2.cs 973ms 6.4ms 165.2MB 897ms 153ms dotnet 7.0.102
csharp 2-http3.cs 1082ms 25ms 178.1MB 1060ms 167ms dotnet 7.0.102

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 165ms 1.5ms 10.2MB 160ms 0ms dotnet/aot 7.0.102
nim 2.nim 180ms 1.4ms 1.3MB 170ms 0ms nim/clang 1.6.10
nim 2.nim 184ms 1.5ms 1.0MB 170ms 0ms nim 1.6.10
csharp 2.cs 247ms 7.9ms 27.3MB 227ms 3ms mono 6.12.0
csharp 2.cs 272ms 2.4ms 102.2MB 213ms 27ms dotnet 7.0.102
csharp 1.cs 1879ms 12ms 56.1MB 1850ms 27ms dotnet/aot 7.0.102
csharp 1.cs 2048ms 2.1ms 145.7MB 1967ms 67ms dotnet 7.0.102
csharp 1.cs 4010ms 16ms 47.7MB 3953ms 50ms mono 6.12.0
nim 1.nim timeout 0.0ms 1.1MB 4983ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 1.2MB 4987ms 0ms nim/clang 1.6.10

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 492ms 13ms 10.1MB 483ms 0ms dotnet/aot 7.0.102
nim 2.nim 535ms 14ms 1.3MB 520ms 0ms nim/clang 1.6.10
csharp 2.cs 535ms 11ms 101.9MB 483ms 30ms dotnet 7.0.102
nim 2.nim 540ms 0.9ms 1.1MB 530ms 0ms nim 1.6.10
csharp 2.cs 634ms 5.8ms 25.3MB 617ms 3ms mono 6.12.0
csharp 1.cs timeout 0.0ms 146.6MB 4930ms 57ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 56.4MB 4970ms 23ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 47.9MB 4960ms 33ms mono 6.12.0
nim 1.nim timeout 0.0ms 1.0MB 4990ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 1.3MB 4983ms 0ms nim/clang 1.6.10

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 77ms 2.3ms 1.2MB 67ms 0ms nim/clang 1.6.10
nim 2.nim 80ms 1.7ms 1.0MB 70ms 0ms nim 1.6.10
csharp 2.cs 85ms 0.6ms 8.1MB 80ms 0ms dotnet/aot 7.0.102
csharp 2.cs 132ms 0.6ms 25.3MB 120ms 0ms mono 6.12.0
csharp 2.cs 190ms 5.7ms 102.2MB 127ms 30ms dotnet 7.0.102
nim 1.nim 449ms 7.2ms 1.3MB 437ms 0ms nim/clang 1.6.10
nim 1.nim 496ms 1.6ms 1.0MB 483ms 0ms nim 1.6.10
csharp 1.cs timeout 0.0ms 137.6MB 4907ms 57ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 51.2MB 4953ms 40ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 29.4MB 4967ms 0ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 697ms 0.6ms 4.8MB 687ms 0ms nim/clang 1.6.10
csharp 2.cs 811ms 21ms 152.7MB 723ms 67ms dotnet 7.0.102
nim 1.nim 1040ms 3.5ms 4.4MB 1030ms 0ms nim 1.6.10
csharp 3.cs 4091ms 2.9ms 109.3MB 4027ms 33ms dotnet 7.0.102
csharp 1.cs 4129ms 38ms 111.2MB 4033ms 40ms dotnet 7.0.102
csharp 3.cs 4181ms 64ms 17.4MB 4173ms 0ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 15.6MB 4987ms 3ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 26.7MB 4977ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 33ms 0.4ms 1.3MB 20ms 0ms nim/clang 1.6.10
nim 1.nim 49ms 1.0ms 1.0MB 40ms 0ms nim 1.6.10
csharp 2.cs 180ms 5.5ms 111.5MB 110ms 40ms dotnet 7.0.102
csharp 3.cs 185ms 4.1ms 12.8MB 177ms 3ms dotnet/aot 7.0.102
csharp 1.cs 265ms 14ms 15.1MB 253ms 0ms dotnet/aot 7.0.102
csharp 1.cs 277ms 2.9ms 108.3MB 213ms 30ms dotnet 7.0.102
csharp 3.cs 307ms 13ms 106.7MB 240ms 37ms dotnet 7.0.102
csharp 1.cs 887ms 1.3ms 28.1MB 863ms 7ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1053ms 5.7ms 382.4MB 917ms 193ms dotnet/aot 7.0.102
csharp 1.cs 1147ms 32ms 303.2MB 1003ms 183ms dotnet/aot 7.0.102
nim 1.nim 1276ms 2.5ms 35.1MB 1243ms 10ms nim/clang 1.6.10
csharp 2.cs 1283ms 16ms 497.2MB 1037ms 270ms dotnet 7.0.102
nim 1.nim 1294ms 0.4ms 34.6MB 1267ms 7ms nim 1.6.10
csharp 1.cs 1342ms 22ms 501.9MB 1127ms 263ms dotnet 7.0.102
csharp 1.cs 2174ms 53ms 142.9MB 2760ms 160ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 249ms 14ms 141.6MB 183ms 60ms dotnet/aot 7.0.102
nim 1.nim 275ms 0.8ms 9.3MB 260ms 0ms nim 1.6.10
nim 1.nim 275ms 4.2ms 9.5MB 260ms 0ms nim/clang 1.6.10
csharp 1.cs 308ms 9.8ms 190.9MB 203ms 93ms dotnet/aot 7.0.102
csharp 1.cs 399ms 3.3ms 72.0MB 393ms 33ms mono 6.12.0
csharp 1.cs 444ms 10ms 249.0MB 327ms 103ms dotnet 7.0.102
csharp 2.cs 463ms 4.4ms 208.9MB 367ms 77ms dotnet 7.0.102

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 489ms 4.9ms 1.2MB 477ms 0ms nim/clang 1.6.10
nim 2.nim 489ms 14ms 1.3MB 477ms 0ms nim 1.6.10
csharp 9.cs 531ms 2.8ms 98.0MB 463ms 33ms dotnet 7.0.102
csharp 8.cs 686ms 14ms 12.3MB 680ms 0ms dotnet/aot 7.0.102
csharp 8.cs 742ms 6.0ms 99.9MB 673ms 37ms dotnet 7.0.102
csharp 8.cs 1535ms 1.6ms 25.0MB 1513ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 52ms 1.6ms 1.3MB 43ms 0ms nim 1.6.10
nim 2.nim 53ms 2.1ms 1.2MB 40ms 0ms nim/clang 1.6.10
csharp 8.cs 78ms 3.2ms 10.0MB 73ms 0ms dotnet/aot 7.0.102
csharp 9.cs 144ms 2.8ms 98.4MB 83ms 33ms dotnet 7.0.102
csharp 8.cs 172ms 6.9ms 102.3MB 117ms 27ms dotnet 7.0.102
csharp 8.cs 181ms 0.8ms 25.0MB 157ms 3ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 758ms 4.2ms 17.9MB 753ms 0ms dotnet/aot 7.0.102
nim 2.nim 782ms 1.9ms 6.3MB 770ms 0ms nim/clang 1.6.10
csharp 2.cs 923ms 3.8ms 109.3MB 860ms 37ms dotnet 7.0.102
nim 2.nim 988ms 18ms 6.0MB 973ms 0ms nim 1.6.10
nim 1.nim 1048ms 48ms 41.3MB 1023ms 10ms nim/clang 1.6.10
nim 1.nim 1053ms 31ms 40.6MB 1027ms 7ms nim 1.6.10
csharp 1.cs 1090ms 39ms 71.9MB 1063ms 20ms dotnet/aot 7.0.102
csharp 1.cs 1355ms 47ms 82.5MB 1317ms 23ms mono 6.12.0
csharp 1.cs 1931ms 106ms 158.9MB 1843ms 53ms dotnet 7.0.102
csharp 2.cs 3286ms 22ms 31.9MB 3267ms 7ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 153ms 1.5ms 11.1MB 140ms 0ms nim 1.6.10
nim 1.nim 156ms 2.8ms 11.3MB 140ms 0ms nim/clang 1.6.10
csharp 1.cs 174ms 11ms 30.5MB 153ms 13ms dotnet/aot 7.0.102
nim 2.nim 174ms 4.5ms 3.2MB 163ms 0ms nim/clang 1.6.10
csharp 2.cs 189ms 9.5ms 11.4MB 173ms 0ms dotnet/aot 7.0.102
csharp 1.cs 225ms 4.3ms 40.6MB 200ms 7ms mono 6.12.0
nim 2.nim 240ms 7.1ms 3.1MB 230ms 0ms nim 1.6.10
csharp 2.cs 290ms 2.2ms 104.8MB 233ms 23ms dotnet 7.0.102
csharp 1.cs 405ms 14ms 114.9MB 337ms 33ms dotnet 7.0.102
csharp 2.cs 805ms 2.3ms 26.1MB 787ms 3ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 155.9MB 4923ms 147ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 57.3MB 4960ms 33ms dotnet/aot 7.0.102
nim 1.nim timeout 0.0ms 5.6MB 4990ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 5.8MB 4987ms 0ms nim/clang 1.6.10

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1333ms 7.2ms 56.5MB 1290ms 33ms dotnet/aot 7.0.102
csharp 1.cs 1458ms 0.2ms 156.3MB 1413ms 90ms dotnet 7.0.102
nim 1.nim timeout 0.0ms 5.6MB 4983ms 0ms nim 1.6.10
nim 1.nim timeout 0.0ms 5.8MB 4990ms 0ms nim/clang 1.6.10

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2873ms 14ms 168.2MB 2813ms 40ms nim/clang 1.6.10
nim 1.nim 2937ms 11ms 166.9MB 2870ms 50ms nim 1.6.10
csharp 5.cs 3780ms 13ms 600.5MB 3770ms 253ms dotnet 7.0.102
csharp 6.cs 4186ms 22ms 591.0MB 4060ms 253ms dotnet 7.0.102
csharp 6.cs 4329ms 8.4ms 504.8MB 4173ms 210ms dotnet/aot 7.0.102
csharp 5.cs timeout 0.0ms 185.8MB 4950ms 103ms dotnet/aot 7.0.102

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 295ms 9.2ms 17.1MB 277ms 3ms nim/clang 1.6.10
nim 1.nim 299ms 3.5ms 16.7MB 280ms 0ms nim 1.6.10
csharp 6.cs 461ms 10ms 73.9MB 433ms 27ms dotnet/aot 7.0.102
csharp 5.cs 575ms 9.7ms 168.1MB 487ms 70ms dotnet 7.0.102
csharp 6.cs 669ms 16ms 163.9MB 573ms 70ms dotnet 7.0.102
csharp 5.cs 841ms 9.2ms 72.1MB 797ms 43ms dotnet/aot 7.0.102

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2549ms 81ms 13.6MB 4870ms 13ms dotnet/aot 7.0.102
nim 1.nim 4075ms 23ms 1.2MB 4060ms 0ms nim/clang 1.6.10
nim 1.nim 4100ms 19ms 1.3MB 4087ms 0ms nim 1.6.10
csharp 3-m.cs 4653ms 9.5ms 106.8MB 8870ms 43ms dotnet 7.0.102
csharp 3.cs timeout 0.0ms 27.1MB 9733ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 649ms 1.7ms 12.2MB 1230ms 0ms dotnet/aot 7.0.102
nim 1.nim 1028ms 4.7ms 1.3MB 1020ms 0ms nim 1.6.10
nim 1.nim 1040ms 16ms 1.2MB 1027ms 0ms nim/clang 1.6.10
csharp 3-m.cs 1335ms 16ms 104.6MB 2427ms 30ms dotnet 7.0.102
csharp 3-m.cs 3239ms 166ms 29.5MB 6070ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 186ms 7.1ms 12.2MB 320ms 3ms dotnet/aot 7.0.102
nim 1.nim 261ms 1.5ms 1.2MB 250ms 0ms nim/clang 1.6.10
nim 1.nim 262ms 2.0ms 1.3MB 250ms 0ms nim 1.6.10
csharp 3-m.cs 440ms 7.6ms 104.3MB 670ms 33ms dotnet 7.0.102
csharp 3-m.cs 820ms 6.1ms 29.6MB 1540ms 0ms mono 6.12.0