Programming Language and compiler
Benchmarks

C VS C# benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.8ms 0.5ms 1.4MB 0ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 1.c 1.9ms 0.8ms 1.3MB 0ms 0ms gcc 13.1.0
c 1.c 1.9ms 0.5ms 1.4MB 0ms 0ms clang 14.0.0
csharp 1.cs 6.8ms 0.8ms 12.1MB 0ms 0ms dotnet/aot 7.0.306
csharp 1.cs 19ms 0.6ms 25.6MB 10ms 0ms mono 6.12.0
csharp 1.cs 59ms 1.9ms 28.8MB 26ms 2ms dotnet 7.0.306

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 251ms 3.8ms 23.5MB 417ms 13ms gcc 13.1.0
c 1-m.c 490ms 15ms 20.5MB 837ms 17ms clang 14.0.0
csharp 6-m.cs 971ms 8.0ms 51.8MB 1473ms 27ms dotnet/aot 7.0.306
csharp 6-m.cs 1667ms 172ms 68.9MB 2523ms 20ms mono 6.12.0
csharp 6-m.cs 3820ms 672ms 73.4MB 7300ms 23ms dotnet 7.0.306

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 35ms 1.5ms 12.8MB 43ms 0ms gcc 13.1.0
c 1-m.c 62ms 2.1ms 9.7MB 100ms 0ms clang 14.0.0
csharp 6.cs 152ms 4.0ms 42.6MB 177ms 23ms dotnet/aot 7.0.306
csharp 6.cs 233ms 3.9ms 51.1MB 310ms 10ms mono 6.12.0
csharp 6-m.cs 501ms 70ms 61.9MB 793ms 23ms dotnet 7.0.306

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 2.c 312ms 0.6ms 1.3MB 300ms 0ms gcc 13.1.0
c 5.c 315ms 2.8ms 1.0MB 307ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 320ms 0.8ms 1.3MB 310ms 0ms gcc 13.1.0
c 8-i.c 320ms 0.4ms 1.3MB 310ms 0ms gcc 13.1.0
c 2.c 320ms 0.2ms 1.0MB 310ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 331ms 2.0ms 1.4MB 320ms 0ms clang 14.0.0
c 2.c 341ms 0.6ms 1.4MB 327ms 0ms clang 14.0.0
c 8-i.c 361ms 0.1ms 1.0MB 350ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 367ms 5.2ms 1.4MB 357ms 0ms clang 14.0.0
csharp 9.cs 407ms 0.4ms 29.8MB 380ms 0ms dotnet 7.0.306
csharp 8.cs 498ms 4.0ms 10.1MB 497ms 0ms dotnet/aot 7.0.306
csharp 8.cs 538ms 1.3ms 25.7MB 503ms 0ms dotnet 7.0.306
csharp 8.cs 1108ms 0.6ms 24.9MB 1093ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 5.c 34ms 0.5ms 1.0MB 23ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 34ms 0.1ms 1.3MB 30ms 0ms gcc 13.1.0
c 5.c 34ms 0.3ms 1.3MB 27ms 0ms gcc 13.1.0
c 2.c 35ms 1.7ms 1.3MB 23ms 0ms gcc 13.1.0
c 2.c 35ms 0.1ms 1.0MB 23ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 5.c 36ms 0.5ms 1.4MB 30ms 0ms clang 14.0.0
c 2.c 37ms 0.3ms 1.4MB 30ms 0ms clang 14.0.0
c 8-i.c 38ms 0.2ms 1.0MB 30ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 8-i.c 40ms 1.2ms 1.4MB 30ms 0ms clang 14.0.0
csharp 8.cs 57ms 2.2ms 10.1MB 53ms 0ms dotnet/aot 7.0.306
csharp 9.cs 101ms 3.9ms 29.3MB 70ms 3ms dotnet 7.0.306
csharp 8.cs 120ms 8.5ms 29.8MB 77ms 3ms dotnet 7.0.306
csharp 8.cs 133ms 3.3ms 24.9MB 120ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 604ms 35ms 40.8MB 577ms 10ms clang 14.0.0
c 1.c 610ms 8.4ms 40.9MB 580ms 13ms gcc 13.1.0
csharp 1.cs 620ms 16ms 69.7MB 600ms 13ms dotnet/aot 7.0.306
c 1.c 642ms 41ms 40.1MB 613ms 13ms zigcc 0.11.0-dev.3978+711b4e93e
csharp 1.cs 762ms 8.7ms 86.6MB 740ms 10ms mono 6.12.0
csharp 2.cs 767ms 3.1ms 21.7MB 757ms 0ms dotnet/aot 7.0.306
csharp 2.cs 942ms 5.1ms 38.8MB 900ms 7ms dotnet 7.0.306
csharp 1.cs 1381ms 38ms 86.3MB 1333ms 23ms dotnet 7.0.306
csharp 2.cs 2479ms 43ms 34.3MB 2460ms 3ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 123ms 3.8ms 11.6MB 107ms 0ms clang 14.0.0
c 1.c 124ms 3.7ms 11.0MB 107ms 0ms zigcc 0.11.0-dev.3978+711b4e93e
c 1.c 127ms 4.4ms 11.7MB 117ms 0ms gcc 13.1.0
csharp 1.cs 146ms 4.5ms 29.8MB 140ms 0ms dotnet/aot 7.0.306
csharp 1.cs 185ms 0.9ms 40.7MB 163ms 7ms mono 6.12.0
csharp 2.cs 190ms 2.0ms 15.3MB 187ms 0ms dotnet/aot 7.0.306
csharp 2.cs 272ms 2.7ms 28.1MB 233ms 7ms dotnet 7.0.306
csharp 1.cs 336ms 2.1ms 44.3MB 293ms 13ms dotnet 7.0.306
csharp 2.cs 605ms 1.1ms 25.5MB 583ms 7ms mono 6.12.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1388ms 5.9ms 1.3MB 2723ms 0ms gcc 13.1.0
c 6-im.c 1655ms 1.8ms 1.2MB 3250ms 0ms gcc 13.1.0
c 6-im.c 1681ms 1.9ms 5.2MB 3297ms 0ms clang 14.0.0
c 4-m.c 1696ms 0.6ms 3.3MB 3330ms 0ms clang 14.0.0
c 5-im.c 1852ms 16ms 1.3MB 3630ms 0ms gcc 13.1.0
c 5-im.c 2158ms 12ms 3.2MB 4240ms 0ms clang 14.0.0
c 3-m.c 2211ms 13ms 3.2MB 4343ms 0ms clang 14.0.0
c 3-m.c 2214ms 25ms 1.3MB 4343ms 0ms gcc 13.1.0
csharp 3-m.cs 2524ms 7.5ms 13.7MB 4930ms 0ms dotnet/aot 7.0.306
csharp 3-m.cs 4435ms 37ms 34.9MB 8597ms 10ms dotnet 7.0.306
csharp 3.cs timeout 0.0ms 26.5MB 9777ms 7ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 358ms 1.2ms 1.3MB 680ms 0ms gcc 13.1.0
c 6-im.c 425ms 3.0ms 1.3MB 813ms 0ms gcc 13.1.0
c 6-im.c 431ms 1.8ms 3.3MB 823ms 0ms clang 14.0.0
c 4-m.c 433ms 0.8ms 3.2MB 830ms 3ms clang 14.0.0
c 5-im.c 472ms 1.8ms 1.3MB 907ms 0ms gcc 13.1.0
c 5-im.c 558ms 12ms 3.2MB 1067ms 0ms clang 14.0.0
c 3-m.c 559ms 2.5ms 1.2MB 1083ms 0ms gcc 13.1.0
c 3-m.c 563ms 4.0ms 3.2MB 1087ms 0ms clang 14.0.0
csharp 3-m.cs 651ms 2.8ms 8.3MB 1233ms 10ms dotnet/aot 7.0.306
csharp 3-m.cs 1230ms 6.9ms 31.6MB 2307ms 3ms dotnet 7.0.306
csharp 3-m.cs 3185ms 152ms 27.8MB 6040ms 0ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 99ms 1.6ms 1.3MB 170ms 0ms gcc 13.1.0
c 6-im.c 114ms 1.0ms 3.2MB 207ms 0ms gcc 13.1.0
c 6-im.c 116ms 1.1ms 3.2MB 200ms 0ms clang 14.0.0
c 4-m.c 116ms 0.5ms 3.2MB 203ms 0ms clang 14.0.0
c 5-im.c 129ms 2.7ms 1.3MB 230ms 0ms gcc 13.1.0
c 5-im.c 148ms 2.0ms 3.1MB 267ms 0ms clang 14.0.0
c 3-m.c 150ms 3.9ms 1.3MB 273ms 0ms gcc 13.1.0
c 3-m.c 159ms 15ms 3.5MB 287ms 0ms clang 14.0.0
csharp 3-m.cs 179ms 2.9ms 12.2MB 310ms 7ms dotnet/aot 7.0.306
csharp 3.cs 433ms 78ms 29.7MB 567ms 13ms dotnet 7.0.306
csharp 3-m.cs 802ms 3.6ms 29.7MB 1520ms 7ms mono 6.12.0