Programming Language and compiler
Benchmarks

Chapel VS C# benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1219ms 41ms 381.4MB 1150ms 170ms dotnet/aot 7.0.102
csharp 1.cs 1518ms 32ms 478.5MB 1357ms 213ms dotnet 7.0.102
csharp 1.cs 2160ms 13ms 97.0MB 2463ms 157ms mono 6.12.0
chapel 4.chpl 2288ms 12ms 46.2MB 2260ms 7ms chpl 1.29.0
chapel 3.chpl 2449ms 12ms 46.2MB 2427ms 13ms chpl 1.29.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 123ms 4.5ms 75.0MB 100ms 20ms dotnet/aot 7.0.102
csharp 1.cs 152ms 1.0ms 42.2MB 133ms 7ms mono 6.12.0
chapel 4.chpl 219ms 3.7ms 14.0MB 207ms 0ms chpl 1.29.0
chapel 3.chpl 226ms 0.3ms 14.0MB 220ms 0ms chpl 1.29.0
csharp 1.cs 257ms 5.5ms 170.0MB 187ms 43ms dotnet 7.0.102

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 3927ms 97ms 59.5MB 7640ms 30ms chpl 1.29.0
csharp 1-m.cs 4430ms 86ms 177.3MB 8227ms 73ms dotnet 7.0.102
csharp 1-m.cs 4903ms 68ms 81.8MB 9207ms 57ms dotnet/aot 7.0.102

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 270ms 6.8ms 20.4MB 480ms 7ms chpl 1.29.0
csharp 1-m.cs 309ms 21ms 60.1MB 513ms 27ms dotnet/aot 7.0.102
csharp 1-m.cs 549ms 12ms 157.4MB 870ms 40ms dotnet 7.0.102

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 0.6ms 11.7MB 90ms 0ms chpl 1.29.0
csharp 1.cs timeout 0.0ms 110.3MB 4933ms 23ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 22.4MB 4980ms 3ms dotnet/aot 7.0.102

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 43ms 1.8ms 20.9MB 37ms 0ms chpl 1.29.0
csharp 1.cs 1006ms 1.8ms 19.1MB 1000ms 0ms dotnet/aot 7.0.102
csharp 1.cs 1115ms 4.9ms 105.6MB 1063ms 23ms dotnet 7.0.102

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 145ms 1.2ms 9.5MB 250ms 3ms chpl 1.29.0
csharp 5-m.cs 345ms 24ms 60.9MB 567ms 77ms dotnet/aot 7.0.102
csharp 5-m.cs 501ms 41ms 126.4MB 763ms 123ms dotnet 7.0.102
csharp 5-m.cs 507ms 27ms 83.1MB 870ms 87ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 28ms 0.9ms 10.6MB 23ms 0ms chpl 1.29.0
csharp 5-m.cs 65ms 5.3ms 24.4MB 80ms 23ms dotnet/aot 7.0.102
csharp 5-m.cs 86ms 3.0ms 36.2MB 107ms 23ms mono 6.12.0
csharp 5.cs 128ms 12ms 109.4MB 113ms 37ms dotnet 7.0.102

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 6.0ms 1.1ms 9.2MB 0ms 0ms dotnet/aot 7.0.102
chapel 1.chpl 15ms 2.8ms 10.2MB 13ms 0ms chpl 1.29.0
csharp 1.cs 19ms 0.4ms 24.2MB 10ms 0ms mono 6.12.0
csharp 1.cs 72ms 2.1ms 101.6MB 32ms 12ms dotnet 7.0.102

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 942ms 7.8ms 53.5MB 1393ms 17ms dotnet/aot 7.0.102
chapel 3-m.chpl 1012ms 59ms 88.2MB 1780ms 33ms chpl 1.29.0
csharp 6-m.cs 1168ms 31ms 145.7MB 1973ms 37ms dotnet 7.0.102
csharp 6-m.cs 1634ms 77ms 71.9MB 2640ms 27ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 145ms 1.0ms 40.2MB 167ms 17ms dotnet/aot 7.0.102
chapel 3-m.chpl 165ms 1.3ms 63.5MB 267ms 13ms chpl 1.29.0
csharp 6.cs 235ms 6.8ms 51.1MB 303ms 13ms mono 6.12.0
csharp 6.cs 280ms 4.4ms 132.9MB 300ms 40ms dotnet 7.0.102

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 374ms 1.0ms 2.6MB 363ms 0ms chpl 1.29.0
csharp 9.cs 428ms 2.1ms 100.0MB 387ms 13ms dotnet 7.0.102
csharp 8.cs 500ms 2.6ms 10.2MB 493ms 0ms dotnet/aot 7.0.102
csharp 8.cs 554ms 1.4ms 102.3MB 510ms 10ms dotnet 7.0.102
csharp 8.cs 1108ms 0.6ms 24.3MB 1090ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 52ms 1.1ms 20.2MB 47ms 0ms chpl 1.29.0
csharp 8.cs 55ms 0.5ms 12.0MB 50ms 0ms dotnet/aot 7.0.102
csharp 9.cs 118ms 2.6ms 100.0MB 73ms 17ms dotnet 7.0.102
csharp 8.cs 127ms 4.5ms 102.3MB 77ms 23ms dotnet 7.0.102
csharp 8.cs 132ms 1.4ms 25.1MB 120ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 593ms 3.5ms 4.1MB 577ms 3ms chpl 1.29.0
csharp 1.cs 4447ms 3.7ms 78.2MB 4410ms 43ms dotnet/aot 7.0.102
csharp 1.cs 4713ms 26ms 169.5MB 4653ms 77ms dotnet 7.0.102

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 147ms 0.9ms 3.8MB 140ms 0ms chpl 1.29.0
csharp 1.cs 1055ms 1.9ms 73.6MB 1033ms 17ms dotnet/aot 7.0.102
csharp 1.cs 1180ms 6.7ms 165.3MB 1170ms 37ms dotnet 7.0.102

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1995ms 11ms 221.6MB 1847ms 137ms chpl 1.29.0
csharp 5.cs 3329ms 22ms 600.0MB 3280ms 227ms dotnet 7.0.102
csharp 6.cs 3601ms 2.5ms 459.1MB 3513ms 140ms dotnet/aot 7.0.102
csharp 6.cs 3875ms 36ms 596.2MB 3773ms 167ms dotnet 7.0.102
csharp 5.cs timeout 0.0ms 182.2MB 4977ms 67ms dotnet/aot 7.0.102

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 218ms 3.7ms 35.6MB 187ms 17ms chpl 1.29.0
csharp 6.cs 379ms 3.0ms 68.4MB 360ms 13ms dotnet/aot 7.0.102
csharp 5.cs 480ms 5.5ms 163.8MB 417ms 43ms dotnet 7.0.102
csharp 6.cs 575ms 2.7ms 161.8MB 507ms 47ms dotnet 7.0.102
csharp 5.cs 691ms 5.9ms 71.3MB 667ms 17ms dotnet/aot 7.0.102

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1539ms 19ms 32.3MB 1507ms 13ms chpl 1.29.0
csharp 1.cs 3852ms 27ms 73.5MB 3823ms 27ms dotnet/aot 7.0.102
csharp 1.cs 4192ms 81ms 168.8MB 4133ms 57ms dotnet 7.0.102

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 398ms 0.6ms 32.3MB 387ms 0ms chpl 1.29.0
csharp 1.cs 989ms 1.4ms 66.5MB 960ms 20ms dotnet/aot 7.0.102
csharp 1.cs 1174ms 1.1ms 162.8MB 1167ms 47ms dotnet 7.0.102

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2300ms 88ms 32.3MB 4430ms 7ms chpl 1.29.0
csharp 3-m.cs 2524ms 1.5ms 13.6MB 4923ms 3ms dotnet/aot 7.0.102
chapel 1.chpl 4374ms 2.3ms 32.4MB 4363ms 3ms chpl 1.29.0
csharp 3-m.cs 4419ms 13ms 103.0MB 8520ms 33ms dotnet 7.0.102
csharp 3.cs timeout 0.0ms 26.7MB 9787ms 0ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 0.8ms 32.3MB 1110ms 0ms chpl 1.29.0
csharp 3-m.cs 650ms 4.1ms 12.3MB 1233ms 3ms dotnet/aot 7.0.102
chapel 1.chpl 1111ms 1.9ms 32.3MB 1100ms 0ms chpl 1.29.0
csharp 3-m.cs 1215ms 14ms 104.4MB 2240ms 23ms dotnet 7.0.102
csharp 3-m.cs 3182ms 84ms 27.5MB 6037ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 164ms 3.6ms 32.3MB 287ms 3ms chpl 1.29.0
csharp 3-m.cs 181ms 3.8ms 12.3MB 317ms 3ms dotnet/aot 7.0.102
chapel 1.chpl 297ms 1.7ms 32.3MB 287ms 0ms chpl 1.29.0
csharp 3-m.cs 392ms 1.6ms 104.3MB 620ms 20ms dotnet 7.0.102
csharp 3-m.cs 802ms 4.1ms 27.8MB 1517ms 7ms mono 6.12.0