Programming Language and compiler
Benchmarks

C# VS Nim benchmarks

Current benchmark data was generated on Wed Sep 28 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1331ms 9.4ms 391.1MB 1237ms 157ms dotnet 6.0.401
csharp 1.cs 2177ms 35ms 102.7MB 2453ms 197ms mono 6.12.0
nim 2.nim 3344ms 2.3ms 35.2MB 3323ms 3ms nim/clang 1.6.8
nim 2.nim 3490ms 2.8ms 34.6MB 3467ms 10ms nim 1.6.8

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 151ms 2.5ms 44.6MB 130ms 7ms mono 6.12.0
csharp 1.cs 184ms 6.7ms 90.9MB 140ms 23ms dotnet 6.0.401
nim 2.nim 315ms 0.7ms 5.7MB 303ms 0ms nim/clang 1.6.8
nim 2.nim 330ms 1.8ms 5.4MB 317ms 0ms nim 1.6.8

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 4095ms 60ms 104.8MB 6900ms 57ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 414ms 34ms 88.5MB 643ms 33ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1108ms 5.3ms 45.9MB 1060ms 17ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 257ms 0.2ms 0.7MB 240ms 0ms nim 1.6.8
nim 2.nim 336ms 0.6ms 1.0MB 323ms 0ms nim/clang 1.6.8
csharp 5-m.cs 480ms 11ms 80.2MB 827ms 77ms mono 6.12.0
csharp 5.cs 534ms 47ms 87.3MB 590ms 117ms dotnet 6.0.401
nim 1.nim 788ms 5.6ms 0.7MB 703ms 67ms nim 1.6.8
nim 1.nim 807ms 0.6ms 1.0MB 720ms 70ms nim/clang 1.6.8

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 28ms 0.5ms 0.7MB 20ms 0ms nim 1.6.8
nim 2.nim 36ms 0.4ms 1.0MB 27ms 0ms nim/clang 1.6.8
nim 1.nim 81ms 0.6ms 0.7MB 57ms 10ms nim 1.6.8
nim 1.nim 84ms 0.9ms 0.9MB 70ms 0ms nim/clang 1.6.8
csharp 5-m.cs 90ms 7.4ms 39.1MB 110ms 27ms mono 6.12.0
csharp 5.cs 143ms 14ms 47.4MB 100ms 20ms dotnet 6.0.401

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.6ms 0.9ms 1.6MB 0ms 0ms nim 1.6.8
nim 1.nim 2.0ms 0.8ms 1.0MB 0ms 0ms nim/clang 1.6.8
csharp 1.cs 18ms 1.2ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 51ms 1.8ms 29.1MB 20ms 2ms dotnet 6.0.401

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 631ms 3.1ms 122.6MB 733ms 60ms dotnet 6.0.401
nim 1.nim 710ms 5.4ms 94.0MB 317ms 367ms nim 1.6.8
nim 1.nim 712ms 0.7ms 93.4MB 280ms 403ms nim/clang 1.6.8
csharp 2-http3.cs 824ms 16ms 270.4MB 890ms 257ms dotnet 7.0.100-rc.1.22431.12
csharp 2.cs 838ms 25ms 147.3MB 770ms 393ms dotnet 6.0.401
csharp 1.cs 890ms 24ms 171.1MB 883ms 440ms dotnet 6.0.401

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 121ms 1.9ms 17.9MB 50ms 57ms nim 1.6.8
nim 1.nim 124ms 2.1ms 18.2MB 53ms 50ms nim/clang 1.6.8
csharp 2.cs 446ms 12ms 75.3MB 373ms 87ms dotnet 6.0.401
csharp 1.cs 468ms 7.9ms 84.0MB 490ms 90ms dotnet 6.0.401
csharp 2-http2.cs 505ms 7.7ms 80.3MB 517ms 37ms dotnet 6.0.401
csharp 2-http3.cs 512ms 9.3ms 186.7MB 420ms 130ms dotnet 7.0.100-rc.1.22431.12

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 359ms 4.0ms 65.8MB 313ms 27ms dotnet 6.0.401
csharp 1.cs 528ms 3.5ms 145.7MB 497ms 53ms dotnet 6.0.401

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 2028ms 4.5ms 275.5MB 2087ms 107ms dotnet 6.0.401
csharp 1.cs 3220ms 136ms 762.9MB 3243ms 340ms dotnet 6.0.401

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 1216ms 108ms 75.7MB 1827ms 23ms dotnet 6.0.401
csharp 6-m.cs 1592ms 74ms 68.8MB 2630ms 30ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 231ms 1.9ms 53.0MB 303ms 10ms mono 6.12.0
csharp 6.cs 236ms 3.9ms 65.5MB 243ms 37ms dotnet 6.0.401

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 146ms 0.2ms 1.9MB 140ms 0ms nim/clang 1.6.8
nim 2.nim 158ms 2.6ms 0.7MB 150ms 0ms nim 1.6.8
csharp 2.cs 184ms 0.1ms 25.2MB 170ms 0ms mono 6.12.0
csharp 2.cs 199ms 3.1ms 27.6MB 163ms 7ms dotnet 6.0.401
csharp 1.cs 1743ms 88ms 89.8MB 1700ms 23ms dotnet 6.0.401
csharp 1.cs 3000ms 7.7ms 49.6MB 2960ms 33ms mono 6.12.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 433ms 0.7ms 1.0MB 420ms 0ms nim/clang 1.6.8
csharp 2.cs 454ms 1.3ms 28.2MB 430ms 3ms dotnet 6.0.401
nim 2.nim 465ms 0.3ms 0.7MB 457ms 0ms nim 1.6.8
csharp 2.cs 506ms 7.8ms 25.0MB 490ms 3ms mono 6.12.0
csharp 1.cs 4626ms 14ms 90.9MB 4570ms 40ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 64ms 0.8ms 0.9MB 53ms 0ms nim/clang 1.6.8
nim 2.nim 69ms 0.2ms 0.7MB 60ms 0ms nim 1.6.8
csharp 2.cs 104ms 1.1ms 25.2MB 100ms 0ms mono 6.12.0
csharp 2.cs 128ms 0.6ms 29.9MB 107ms 0ms dotnet 6.0.401
nim 1.nim 416ms 2.7ms 1.0MB 403ms 0ms nim/clang 1.6.8
nim 1.nim 495ms 34ms 0.7MB 483ms 0ms nim 1.6.8
csharp 1.cs 3189ms 11ms 30.6MB 3163ms 0ms mono 6.12.0
csharp 1.cs 3191ms 8.4ms 77.3MB 3143ms 23ms dotnet 6.0.401

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 574ms 0.4ms 4.7MB 560ms 0ms nim/clang 1.6.8
csharp 2.cs 736ms 3.6ms 96.9MB 677ms 27ms dotnet 6.0.401
nim 1.nim 996ms 1.3ms 4.5MB 980ms 0ms nim 1.6.8
csharp 1.cs 3772ms 103ms 36.2MB 3720ms 7ms dotnet 6.0.401
csharp 3.cs 4333ms 2.8ms 36.2MB 4303ms 0ms dotnet 6.0.401
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 26ms 0.3ms 1.0MB 20ms 0ms nim/clang 1.6.8
nim 1.nim 45ms 1.2ms 0.7MB 33ms 0ms nim 1.6.8
csharp 2.cs 95ms 4.7ms 38.8MB 60ms 3ms dotnet 6.0.401
csharp 3.cs 248ms 2.5ms 33.1MB 220ms 0ms dotnet 6.0.401
csharp 1.cs 292ms 1.3ms 33.5MB 260ms 3ms dotnet 6.0.401
csharp 1.cs 832ms 1.3ms 28.3MB 820ms 0ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 921ms 4.2ms 391.9MB 793ms 163ms dotnet 6.0.401
csharp 2.cs 927ms 18ms 378.4MB 787ms 173ms dotnet 6.0.401
nim 1.nim 1576ms 4.4ms 35.2MB 1553ms 10ms nim/clang 1.6.8
nim 1.nim 1655ms 3.7ms 34.6MB 1633ms 3ms nim 1.6.8
csharp 1.cs 1675ms 7.1ms 148.6MB 2093ms 110ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 252ms 2.7ms 94.2MB 203ms 30ms dotnet 6.0.401
csharp 1.cs 291ms 3.1ms 185.8MB 197ms 73ms dotnet 6.0.401
csharp 1.cs 306ms 5.3ms 72.7MB 277ms 27ms mono 6.12.0
nim 1.nim 339ms 0.5ms 9.9MB 330ms 0ms nim/clang 1.6.8
nim 1.nim 364ms 14ms 9.3MB 353ms 0ms nim 1.6.8

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 404ms 0.3ms 0.9MB 390ms 0ms nim/clang 1.6.8
csharp 9.cs 404ms 2.6ms 29.3MB 377ms 3ms dotnet 6.0.401
nim 2.nim 427ms 0.5ms 1.0MB 420ms 0ms nim 1.6.8
csharp 8.cs 532ms 4.1ms 25.4MB 503ms 3ms dotnet 6.0.401
csharp 8.cs 1107ms 0.7ms 25.1MB 1090ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 43ms 1.2ms 1.0MB 33ms 0ms nim/clang 1.6.8
nim 2.nim 45ms 0.8ms 1.0MB 33ms 0ms nim 1.6.8
csharp 9.cs 91ms 6.8ms 29.4MB 63ms 3ms dotnet 6.0.401
csharp 8.cs 103ms 0.3ms 27.3MB 73ms 0ms dotnet 6.0.401
csharp 8.cs 135ms 5.0ms 25.3MB 123ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 525ms 30ms 41.2MB 507ms 0ms nim 1.6.8
nim 1.nim 551ms 31ms 41.0MB 530ms 3ms nim/clang 1.6.8
nim 2.nim 598ms 1.5ms 6.6MB 587ms 0ms nim/clang 1.6.8
nim 2.nim 635ms 1.3ms 6.1MB 627ms 0ms nim 1.6.8
csharp 1.cs 657ms 54ms 88.1MB 613ms 13ms dotnet 6.0.401
csharp 1.cs 778ms 31ms 86.7MB 757ms 7ms mono 6.12.0
csharp 2.cs 1003ms 12ms 36.1MB 977ms 3ms dotnet 6.0.401
csharp 2.cs 2442ms 17ms 34.4MB 2423ms 7ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 127ms 0.8ms 11.1MB 120ms 0ms nim 1.6.8
nim 1.nim 129ms 4.5ms 11.3MB 117ms 0ms nim/clang 1.6.8
nim 2.nim 138ms 0.8ms 3.3MB 123ms 0ms nim/clang 1.6.8
nim 2.nim 151ms 0.4ms 3.0MB 140ms 0ms nim 1.6.8
csharp 1.cs 184ms 9.3ms 47.9MB 147ms 7ms dotnet 6.0.401
csharp 1.cs 192ms 0.4ms 41.1MB 173ms 3ms mono 6.12.0
csharp 2.cs 281ms 2.2ms 31.7MB 247ms 3ms dotnet 6.0.401
csharp 2.cs 604ms 0.8ms 27.7MB 590ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4943ms 41ms 94.3MB 4933ms 43ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1216ms 9.0ms 94.9MB 1203ms 40ms dotnet 6.0.401
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.8
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.8

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 2565ms 5.6ms 167.2MB 2520ms 33ms nim 1.6.8
nim 1.nim 2568ms 4.8ms 167.8MB 2523ms 27ms nim/clang 1.6.8
csharp 5.cs 3081ms 14ms 614.1MB 2997ms 247ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 4161ms 25ms 528.0MB 4063ms 213ms dotnet 6.0.401

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 264ms 0.7ms 16.7MB 247ms 3ms nim 1.6.8
nim 1.nim 264ms 2.3ms 17.0MB 250ms 0ms nim/clang 1.6.8
csharp 5.cs 449ms 4.7ms 180.3MB 383ms 47ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 526ms 1.6ms 90.1MB 493ms 17ms dotnet 6.0.401

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4306ms 30ms 92.8MB 4263ms 33ms dotnet 6.0.401

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1169ms 3.6ms 92.6MB 1127ms 50ms dotnet 6.0.401

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2677ms 2.3ms 32.6MB 5163ms 10ms dotnet 6.0.401
nim 1.nim 4118ms 1.2ms 1.8MB 4110ms 0ms nim/clang 1.6.8
nim 1.nim 4120ms 4.8ms 1.8MB 4107ms 0ms nim 1.6.8
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 714ms 1.1ms 30.3MB 1290ms 13ms dotnet 6.0.401
nim 1.nim 1031ms 0.3ms 0.9MB 1017ms 0ms nim 1.6.8
nim 1.nim 1032ms 0.5ms 1.0MB 1017ms 0ms nim/clang 1.6.8
csharp 3-m.cs 3179ms 76ms 27.6MB 6040ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 229ms 2.9ms 29.9MB 347ms 10ms dotnet 6.0.401
nim 1.nim 260ms 0.7ms 1.0MB 247ms 0ms nim 1.6.8
nim 1.nim 260ms 0.3ms 1.0MB 250ms 0ms nim/clang 1.6.8
csharp 3-m.cs 800ms 2.0ms 28.0MB 1520ms 3ms mono 6.12.0