Programming Language and compiler
Benchmarks

Chapel VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1213ms 21ms 132.8MB 1443ms 180ms dotnet/aot 8.0.101
csharp 1.cs 1714ms 70ms 109.8MB 1903ms 220ms mono 6.12.0
csharp 1.cs 1868ms 70ms 2126.1MB 710ms 1117ms dotnet 8.0.101
chapel 4.chpl 1944ms 12ms 66.2MB 1933ms 7ms chpl 1.31.0
chapel 3.chpl 2115ms 17ms 66.3MB 2100ms 0ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 92ms 2.7ms 29.1MB 93ms 13ms dotnet/aot 8.0.101
csharp 1.cs 142ms 1.4ms 44.9MB 117ms 13ms mono 6.12.0
chapel 4.chpl 191ms 2.3ms 36.3MB 180ms 7ms chpl 1.31.0
chapel 3.chpl 198ms 1.7ms 34.3MB 183ms 7ms chpl 1.31.0
csharp 1.cs 283ms 5.7ms 229.7MB 130ms 113ms dotnet 8.0.101

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2296ms 27ms 506.1MB 4477ms 70ms chpl 1.31.0
csharp 1-m.cs 2301ms 32ms 38.5MB 7933ms 73ms dotnet/aot 8.0.101
csharp 1-m.cs 2776ms 120ms 746.6MB 7507ms 713ms dotnet 8.0.101

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 159ms 15ms 29.8MB 443ms 20ms dotnet/aot 8.0.101
chapel 1-m.chpl 203ms 23ms 450.8MB 333ms 33ms chpl 1.31.0
csharp 1-m.cs 294ms 6.8ms 93.7MB 733ms 47ms dotnet 8.0.101

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 79ms 0.6ms 36.5MB 70ms 0ms chpl 1.31.0
csharp 1.cs 4390ms 10ms 24.9MB 4380ms 7ms dotnet/aot 8.0.101
csharp 1.cs 4615ms 25ms 49.5MB 4570ms 33ms dotnet 8.0.101

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 40ms 0.2ms 34.5MB 30ms 0ms chpl 1.31.0
csharp 1.cs 738ms 1.4ms 21.0MB 730ms 3ms dotnet/aot 8.0.101
csharp 1.cs 848ms 3.6ms 40.1MB 807ms 10ms dotnet 8.0.101

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 111ms 1.0ms 32.4MB 193ms 0ms chpl 1.31.0
csharp 5-m.cs 133ms 7.9ms 36.2MB 380ms 83ms dotnet/aot 8.0.101
csharp 5-m.cs 205ms 9.6ms 45.3MB 477ms 117ms dotnet 8.0.101
csharp 5-m.cs 262ms 5.6ms 47.9MB 683ms 147ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 29ms 0.6ms 32.4MB 23ms 3ms chpl 1.31.0
csharp 5-m.cs 34ms 1.8ms 27.0MB 50ms 27ms dotnet/aot 8.0.101
csharp 5-m.cs 85ms 10ms 42.7MB 110ms 30ms mono 6.12.0
csharp 5.cs 86ms 6.4ms 42.0MB 83ms 20ms dotnet 8.0.101

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
chapel 1.chpl 16ms 0.2ms 32.8MB 10ms 0ms chpl 1.31.0
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 511ms 13ms 56.0MB 1300ms 30ms dotnet/aot 8.0.101
csharp 6-m.cs 629ms 31ms 82.6MB 1287ms 43ms dotnet 8.0.101
chapel 3-m.chpl 766ms 18ms 101.0MB 1443ms 7ms chpl 1.31.0
csharp 6-m.cs 1015ms 14ms 69.1MB 2943ms 27ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 98ms 5.9ms 46.2MB 173ms 23ms dotnet/aot 8.0.101
chapel 3-m.chpl 120ms 0.8ms 90.9MB 207ms 3ms chpl 1.31.0
csharp 6.cs 167ms 13ms 72.2MB 207ms 30ms dotnet 8.0.101
csharp 6-m.cs 198ms 0.7ms 57.8MB 380ms 20ms mono 6.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 329ms 2.0ms 32.8MB 313ms 7ms chpl 1.31.0
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
chapel 2.chpl 51ms 1.6ms 32.9MB 47ms 0ms chpl 1.31.0
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.3ms 34.4MB 443ms 0ms chpl 1.31.0
csharp 1.cs 3233ms 16ms 19.9MB 3110ms 137ms dotnet/aot 8.0.101
csharp 1.cs timeout 0.0ms 4256.5MB 3027ms 1923ms dotnet 8.0.101

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 122ms 1.3ms 34.2MB 113ms 0ms chpl 1.31.0
csharp 1.cs 760ms 5.7ms 19.4MB 723ms 33ms dotnet/aot 8.0.101
csharp 1.cs 1552ms 36ms 1164.4MB 1013ms 597ms dotnet 8.0.101

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1388ms 3.3ms 224.1MB 1340ms 40ms chpl 1.31.0
csharp 6.cs 1736ms 3.9ms 420.5MB 1720ms 107ms dotnet/aot 8.0.101
csharp 5.cs 2003ms 27ms 442.9MB 2103ms 167ms dotnet 8.0.101
csharp 6.cs 2791ms 7.4ms 441.8MB 2800ms 163ms dotnet 8.0.101
csharp 5.cs 4198ms 19ms 422.4MB 4183ms 120ms dotnet/aot 8.0.101

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 169ms 0.9ms 52.9MB 150ms 10ms chpl 1.31.0
csharp 6.cs 198ms 2.5ms 56.4MB 187ms 20ms dotnet/aot 8.0.101
csharp 5.cs 299ms 0.8ms 79.2MB 253ms 37ms dotnet 8.0.101
csharp 6.cs 407ms 1.8ms 77.2MB 367ms 37ms dotnet 8.0.101
csharp 5.cs 448ms 9.0ms 58.2MB 440ms 10ms dotnet/aot 8.0.101

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1183ms 3.7ms 33.0MB 1170ms 3ms chpl 1.31.0
csharp 1.cs 2745ms 25ms 17.2MB 2707ms 37ms dotnet/aot 8.0.101
csharp 1.cs 3518ms 28ms 1354.7MB 2813ms 747ms dotnet 8.0.101

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 311ms 1.6ms 33.1MB 307ms 0ms chpl 1.31.0
csharp 1.cs 714ms 21ms 14.9MB 703ms 10ms dotnet/aot 8.0.101
csharp 1.cs 1074ms 24ms 365.8MB 920ms 193ms dotnet 8.0.101

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
chapel 1-m.chpl 1911ms 0.6ms 32.9MB 3783ms 0ms chpl 1.31.0
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
chapel 1.chpl 3712ms 4.9ms 32.8MB 3703ms 0ms chpl 1.31.0
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
chapel 1-m.chpl 496ms 1.2ms 32.9MB 953ms 0ms chpl 1.31.0
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
chapel 1.chpl 944ms 2.4ms 32.8MB 933ms 0ms chpl 1.31.0
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
chapel 1-m.chpl 140ms 0.8ms 33.0MB 240ms 7ms chpl 1.31.0
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
chapel 1.chpl 252ms 1.7ms 32.8MB 247ms 0ms chpl 1.31.0
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0