C++ VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 404ms 1.1ms 4.7MB 1547ms 0ms g++ 11.4.0
cpp 1-im.cpp 407ms 3.0ms 7.9MB 1560ms 7ms clang++ 14.0.0-1ubuntu1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 43ms 0.6ms 5.9MB 133ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1-im.cpp 43ms 0.4ms 4.5MB 140ms 0ms g++ 11.4.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.0ms 0.0ms 1.4MB 0ms 0ms g++ 11.4.0
cpp 1.cpp 1.4ms 0.1ms 2.3MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 167ms 0.1ms 1.5MB 160ms 0ms g++ 11.4.0
cpp 0-i.cpp 172ms 3.6ms 2.3MB 163ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 313ms 1.4ms 1.9MB 300ms 0ms g++ 11.4.0
cpp 1.cpp 314ms 1.2ms 2.3MB 307ms 0ms clang++ 14.0.0-1ubuntu1.1
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 19ms 0.2ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 19ms 0.2ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.4ms 2.3MB 20ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.9ms 1.8MB 27ms 0ms g++ 11.4.0
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 346ms 5.2ms 101.3MB 303ms 10ms dotnet 8.0.101
csharp 1.cs 353ms 5.9ms 55.6MB 340ms 3ms dotnet/aot 8.0.101
csharp 2.cs 427ms 2.0ms 21.2MB 423ms 3ms dotnet/aot 8.0.101
csharp 2.cs 441ms 0.4ms 41.7MB 397ms 13ms dotnet 8.0.101
cpp 1.cpp 484ms 2.6ms 7.3MB 470ms 0ms g++ 11.4.0
cpp 1.cpp 526ms 2.3ms 7.8MB 513ms 0ms clang++ 14.0.0-1ubuntu1.1
csharp 1.cs 544ms 3.3ms 86.6MB 520ms 13ms mono 6.12.0
csharp 2.cs 1861ms 11ms 29.9MB 1843ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 81ms 1.1ms 23.9MB 70ms 7ms dotnet/aot 8.0.101
csharp 2.cs 111ms 0.4ms 18.2MB 110ms 0ms dotnet/aot 8.0.101
csharp 1.cs 114ms 3.7ms 49.8MB 77ms 7ms dotnet 8.0.101
cpp 1.cpp 120ms 1.4ms 3.6MB 110ms 0ms g++ 11.4.0
cpp 1.cpp 131ms 1.3ms 4.1MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
csharp 1.cs 144ms 0.9ms 40.8MB 127ms 7ms mono 6.12.0
csharp 2.cs 153ms 1.7ms 35.4MB 117ms 7ms dotnet 8.0.101
csharp 2.cs 482ms 4.0ms 25.5MB 467ms 0ms mono 6.12.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 479ms 0.8ms 4.2MB 1863ms 0ms g++ 11.4.0
cpp 8-m.cpp 482ms 26ms 7.3MB 1840ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 916ms 3.0ms 5.3MB 3587ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 917ms 3.4ms 4.3MB 3607ms 0ms g++ 11.4.0
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 126ms 0.2ms 7.3MB 450ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 128ms 0.2ms 4.1MB 477ms 0ms g++ 11.4.0
cpp 6-im.cpp 238ms 0.4ms 5.4MB 890ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 242ms 4.2ms 4.2MB 907ms 0ms g++ 11.4.0
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 38ms 0.6ms 7.3MB 107ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 44ms 8.7ms 4.0MB 140ms 0ms g++ 11.4.0
cpp 6-im.cpp 67ms 0.9ms 5.4MB 227ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 68ms 0.2ms 4.2MB 237ms 0ms g++ 11.4.0
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0