Programming Language and compiler
Benchmarks

Chapel VS C# benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 960ms 14ms 181.9MB 970ms 120ms dotnet/aot 9.0.100
csharp 1.cs 1111ms 56ms 201.7MB 1013ms 177ms dotnet 9.0.100
csharp 1.cs 1775ms 93ms 101.7MB 2017ms 210ms mono 6.12.0
chapel 4.chpl 1950ms 11ms 66.4MB 1937ms 0ms chpl 1.31.0
chapel 3.chpl 2095ms 33ms 66.4MB 2087ms 3ms chpl 1.31.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 134ms 12ms 40.8MB 70ms 47ms dotnet/aot 9.0.100
csharp 1.cs 145ms 2.2ms 48.1MB 120ms 13ms mono 6.12.0
chapel 4.chpl 193ms 3.0ms 36.4MB 183ms 7ms chpl 1.31.0
csharp 1.cs 202ms 6.0ms 58.2MB 147ms 47ms dotnet 9.0.100
chapel 3.chpl 205ms 18ms 34.3MB 190ms 3ms chpl 1.31.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 2131ms 158ms 64.3MB 7320ms 87ms dotnet/aot 9.0.100
chapel 1-m.chpl 2252ms 19ms 555.7MB 4367ms 70ms chpl 1.31.0
csharp 1-m.cs 2544ms 83ms 88.7MB 8743ms 133ms dotnet 9.0.100

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 169ms 15ms 31.1MB 443ms 23ms dotnet/aot 9.0.100
chapel 1-m.chpl 196ms 3.7ms 508.7MB 307ms 43ms chpl 1.31.0
csharp 1-m.cs 299ms 25ms 49.4MB 797ms 27ms dotnet 9.0.100

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 80ms 1.0ms 36.4MB 73ms 0ms chpl 1.31.0
csharp 1.cs 4076ms 2.4ms 24.2MB 4047ms 13ms dotnet/aot 9.0.100
csharp 1.cs 4962ms 5.9ms 43.5MB 4920ms 33ms dotnet 9.0.100

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 41ms 1.3ms 34.4MB 30ms 7ms chpl 1.31.0
csharp 1.cs 677ms 0.7ms 20.4MB 660ms 3ms dotnet/aot 9.0.100
csharp 1.cs 871ms 0.8ms 38.1MB 857ms 7ms dotnet 9.0.100

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 127ms 4.5ms 34.2MB 353ms 77ms dotnet/aot 9.0.100
chapel 5-m.chpl 130ms 27ms 32.4MB 217ms 0ms chpl 1.31.0
csharp 5-m.cs 204ms 5.4ms 48.8MB 460ms 110ms dotnet 9.0.100
csharp 5-m.cs 247ms 11ms 53.3MB 680ms 113ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 27ms 1.1ms 25.1MB 37ms 13ms dotnet/aot 9.0.100
chapel 5.chpl 29ms 0.1ms 32.4MB 27ms 0ms chpl 1.31.0
csharp 5-m.cs 65ms 4.3ms 46.5MB 80ms 23ms dotnet 9.0.100
csharp 5-m.cs 71ms 1.3ms 39.4MB 100ms 20ms mono 6.12.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 9.1ms 5.1ms 13.5MB 0ms 0ms dotnet/aot 9.0.100
chapel 1.chpl 16ms 0.7ms 32.8MB 7ms 3ms chpl 1.31.0
csharp 1.cs 32ms 0.8ms 23.7MB 20ms 0ms mono 6.12.0
csharp 1.cs 37ms 0.4ms 32.6MB 20ms 4ms dotnet 9.0.100

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 450ms 7.7ms 53.2MB 1203ms 23ms dotnet/aot 9.0.100
chapel 3-m.chpl 760ms 11ms 91.1MB 1427ms 7ms chpl 1.31.0
csharp 6-m.cs 762ms 42ms 79.1MB 2107ms 30ms dotnet 9.0.100
csharp 6-m.cs 1023ms 12ms 70.2MB 2927ms 23ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 84ms 1.7ms 42.9MB 143ms 13ms dotnet/aot 9.0.100
chapel 3-m.chpl 122ms 1.7ms 92.9MB 200ms 7ms chpl 1.31.0
csharp 6-m.cs 177ms 6.8ms 64.3MB 270ms 30ms dotnet 9.0.100
csharp 6-m.cs 197ms 3.4ms 55.0MB 383ms 17ms mono 6.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 334ms 4.0ms 32.8MB 317ms 7ms chpl 1.31.0
csharp 9.cs 362ms 1.8ms 33.9MB 337ms 13ms dotnet 9.0.100
csharp 8.cs 370ms 2.0ms 15.7MB 350ms 0ms dotnet/aot 9.0.100
csharp 8.cs 436ms 9.8ms 33.7MB 410ms 3ms dotnet 9.0.100
csharp 8.cs 1249ms 3.5ms 24.2MB 1233ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 0.3ms 15.7MB 33ms 0ms dotnet/aot 9.0.100
chapel 2.chpl 52ms 0.2ms 32.8MB 40ms 0ms chpl 1.31.0
csharp 8.cs 96ms 0.6ms 31.9MB 70ms 10ms dotnet 9.0.100
csharp 9.cs 97ms 7.6ms 34.1MB 67ms 13ms dotnet 9.0.100
csharp 8.cs 166ms 2.5ms 24.2MB 150ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 452ms 1.7ms 32.4MB 440ms 3ms chpl 1.31.0
csharp 1.cs 3219ms 8.8ms 21.8MB 3090ms 130ms dotnet/aot 9.0.100
csharp 1.cs 3623ms 63ms 44.3MB 3610ms 137ms dotnet 9.0.100

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 121ms 1.7ms 34.4MB 117ms 3ms chpl 1.31.0
csharp 1.cs 760ms 6.6ms 21.2MB 727ms 20ms dotnet/aot 9.0.100
csharp 1.cs 983ms 4.7ms 44.0MB 1063ms 43ms dotnet 9.0.100

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1395ms 6.8ms 224.1MB 1333ms 53ms chpl 1.31.0
csharp 6.cs 1763ms 7.0ms 426.0MB 1673ms 140ms dotnet/aot 9.0.100
csharp 5.cs 2089ms 43ms 458.3MB 2153ms 177ms dotnet 9.0.100
csharp 6.cs 2779ms 77ms 450.3MB 2717ms 193ms dotnet 9.0.100
csharp 5.cs 4277ms 14ms 428.0MB 4177ms 153ms dotnet/aot 9.0.100

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 170ms 2.9ms 53.0MB 143ms 20ms chpl 1.31.0
csharp 6.cs 194ms 4.0ms 54.2MB 163ms 17ms dotnet/aot 9.0.100
csharp 5.cs 309ms 13ms 80.6MB 273ms 23ms dotnet 9.0.100
csharp 6.cs 410ms 7.1ms 78.3MB 377ms 30ms dotnet 9.0.100
csharp 5.cs 444ms 2.4ms 56.4MB 417ms 17ms dotnet/aot 9.0.100

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1235ms 79ms 33.1MB 1227ms 3ms chpl 1.31.0
csharp 1.cs 2838ms 4.6ms 17.0MB 2797ms 30ms dotnet/aot 9.0.100
csharp 1.cs 2989ms 14ms 39.4MB 3057ms 47ms dotnet 9.0.100

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 313ms 1.6ms 33.1MB 300ms 7ms chpl 1.31.0
csharp 1.cs 720ms 3.0ms 17.0MB 697ms 13ms dotnet/aot 9.0.100
csharp 1.cs 987ms 1.3ms 41.1MB 1080ms 20ms dotnet 9.0.100

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1876ms 14ms 18.4MB 7223ms 10ms dotnet/aot 9.0.100
chapel 1-m.chpl 1933ms 21ms 33.0MB 3823ms 0ms chpl 1.31.0
csharp 3-m.cs 1941ms 14ms 38.2MB 7280ms 23ms dotnet 9.0.100
chapel 1.chpl 3709ms 10.0ms 32.8MB 3703ms 0ms chpl 1.31.0
csharp 3-m.cs 4666ms 74ms 28.5MB 17763ms 20ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 476ms 0.7ms 18.1MB 1800ms 0ms dotnet/aot 9.0.100
chapel 1-m.chpl 496ms 1.0ms 32.8MB 960ms 0ms chpl 1.31.0
csharp 3-m.cs 754ms 13ms 37.5MB 1653ms 30ms dotnet 9.0.100
chapel 1.chpl 946ms 5.3ms 32.8MB 937ms 7ms chpl 1.31.0
csharp 3-m.cs 1224ms 32ms 30.7MB 4513ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 129ms 0.8ms 18.3MB 443ms 3ms dotnet/aot 9.0.100
chapel 1-m.chpl 140ms 0.3ms 32.9MB 243ms 3ms chpl 1.31.0
csharp 3-m.cs 250ms 3.1ms 36.7MB 457ms 13ms dotnet 9.0.100
chapel 1.chpl 257ms 3.3ms 32.8MB 247ms 0ms chpl 1.31.0
csharp 3-m.cs 345ms 2.9ms 28.4MB 1153ms 10ms mono 6.12.0