Programming Language and compiler
Benchmarks

Chapel VS C# benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1356ms 24ms 392.1MB 1253ms 170ms dotnet 6.0.401
csharp 1.cs 2170ms 29ms 100.2MB 2493ms 153ms mono 6.12.0
chapel 4.chpl 2316ms 24ms 60.2MB 2290ms 13ms chpl 1.28.0
chapel 3.chpl 2468ms 4.1ms 50.3MB 2450ms 10ms chpl 1.28.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 153ms 1.8ms 44.8MB 127ms 7ms mono 6.12.0
csharp 1.cs 188ms 2.9ms 89.2MB 127ms 33ms dotnet 6.0.401
chapel 4.chpl 220ms 0.8ms 26.1MB 207ms 3ms chpl 1.28.0
chapel 3.chpl 229ms 1.1ms 18.1MB 217ms 3ms chpl 1.28.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 3847ms 71ms 87.6MB 7483ms 30ms chpl 1.28.0
csharp 1-m.cs 4272ms 154ms 104.3MB 7873ms 80ms dotnet 6.0.401

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 259ms 1.5ms 32.2MB 480ms 0ms chpl 1.28.0
csharp 1-m.cs 408ms 26ms 82.3MB 623ms 43ms dotnet 6.0.401

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 97ms 1.7ms 36.0MB 83ms 3ms chpl 1.28.0
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 47ms 1.1ms 34.0MB 37ms 0ms chpl 1.28.0
csharp 1.cs 1107ms 3.4ms 47.8MB 1070ms 7ms dotnet 6.0.401

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5-m.chpl 147ms 0.4ms 32.1MB 253ms 3ms chpl 1.28.0
csharp 5-m.cs 404ms 16ms 83.6MB 610ms 107ms dotnet 6.0.401
csharp 5-m.cs 504ms 35ms 85.0MB 833ms 113ms mono 6.12.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 5.chpl 33ms 0.9ms 32.1MB 33ms 0ms chpl 1.28.0
csharp 5.cs 85ms 4.3ms 36.8MB 103ms 20ms mono 6.12.0
csharp 5.cs 97ms 5.2ms 39.7MB 87ms 17ms dotnet 6.0.401

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 19ms 0.8ms 24.3MB 10ms 0ms mono 6.12.0
chapel 1.chpl 20ms 3.3ms 32.4MB 10ms 3ms chpl 1.28.0
csharp 1.cs 50ms 7.0ms 27.1MB 18ms 6ms dotnet 6.0.401

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 965ms 11ms 96.7MB 1783ms 17ms chpl 1.28.0
csharp 6-m.cs 1144ms 5.2ms 70.7MB 1687ms 30ms dotnet 6.0.401
csharp 6-m.cs 1568ms 60ms 69.8MB 2570ms 17ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3-m.chpl 167ms 2.3ms 87.2MB 263ms 17ms chpl 1.28.0
csharp 6.cs 229ms 1.0ms 51.2MB 303ms 13ms mono 6.12.0
csharp 6.cs 229ms 4.3ms 62.1MB 257ms 17ms dotnet 6.0.401

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 377ms 3.1ms 32.4MB 363ms 0ms chpl 1.28.0
csharp 9.cs 403ms 4.5ms 29.4MB 370ms 0ms dotnet 6.0.401
csharp 8.cs 535ms 3.0ms 29.4MB 503ms 0ms dotnet 6.0.401
csharp 8.cs 1111ms 5.5ms 26.4MB 1093ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 58ms 0.7ms 32.4MB 47ms 3ms chpl 1.28.0
csharp 9.cs 87ms 3.3ms 27.5MB 60ms 0ms dotnet 6.0.401
csharp 8.cs 103ms 6.9ms 29.3MB 73ms 3ms dotnet 6.0.401
csharp 8.cs 132ms 0.5ms 23.0MB 120ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 594ms 3.6ms 34.1MB 583ms 3ms chpl 1.28.0
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.401

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 2.chpl 152ms 0.4ms 34.1MB 147ms 0ms chpl 1.28.0
csharp 1.cs 1271ms 5.4ms 96.5MB 1257ms 37ms dotnet 6.0.401

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 1965ms 33ms 221.9MB 1803ms 147ms chpl 1.28.0
csharp 5.cs 3119ms 121ms 618.6MB 2993ms 207ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 4149ms 49ms 527.8MB 4090ms 197ms dotnet 6.0.401

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 3.chpl 217ms 2.1ms 52.8MB 183ms 23ms chpl 1.28.0
csharp 5.cs 456ms 3.6ms 179.6MB 390ms 57ms dotnet 7.0.100-rc.1.22431.12
csharp 5.cs 542ms 4.3ms 90.5MB 493ms 27ms dotnet 6.0.401

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 1533ms 0.6ms 32.3MB 1520ms 0ms chpl 1.28.0
csharp 1.cs 4397ms 116ms 91.0MB 4377ms 27ms dotnet 6.0.401

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1.chpl 400ms 0.4ms 32.3MB 390ms 3ms chpl 1.28.0
csharp 1.cs 1170ms 9.4ms 90.6MB 1147ms 27ms dotnet 6.0.401

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 2302ms 99ms 32.3MB 4450ms 3ms chpl 1.28.0
csharp 3-m.cs 3138ms 699ms 32.7MB 5223ms 17ms dotnet 6.0.401
chapel 1.chpl 4379ms 1.9ms 32.3MB 4363ms 7ms chpl 1.28.0
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 581ms 1.0ms 32.3MB 1110ms 0ms chpl 1.28.0
csharp 3-m.cs 721ms 1.6ms 30.6MB 1313ms 10ms dotnet 6.0.401
chapel 1.chpl 1113ms 1.7ms 32.3MB 1100ms 0ms chpl 1.28.0
csharp 3-m.cs 3184ms 138ms 29.2MB 6040ms 3ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
chapel 1-m.chpl 166ms 1.7ms 32.3MB 290ms 0ms chpl 1.28.0
csharp 3-m.cs 232ms 2.2ms 30.0MB 357ms 7ms dotnet 6.0.401
chapel 1.chpl 296ms 1.4ms 32.3MB 287ms 3ms chpl 1.28.0
csharp 3-m.cs 800ms 2.0ms 27.8MB 1523ms 0ms mono 6.12.0