Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 1.cs | 1213ms | 21ms | 132.8MB | 1443ms | 180ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 1714ms | 70ms | 109.8MB | 1903ms | 220ms | mono 6.12.0 |
csharp | 1.cs | 1868ms | 70ms | 2126.1MB | 710ms | 1117ms | dotnet 8.0.101 |
chapel | 4.chpl | 1944ms | 12ms | 66.2MB | 1933ms | 7ms | chpl 1.31.0 |
chapel | 3.chpl | 2115ms | 17ms | 66.3MB | 2100ms | 0ms | chpl 1.31.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 1.cs | 92ms | 2.7ms | 29.1MB | 93ms | 13ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 142ms | 1.4ms | 44.9MB | 117ms | 13ms | mono 6.12.0 |
chapel | 4.chpl | 191ms | 2.3ms | 36.3MB | 180ms | 7ms | chpl 1.31.0 |
chapel | 3.chpl | 198ms | 1.7ms | 34.3MB | 183ms | 7ms | chpl 1.31.0 |
csharp | 1.cs | 283ms | 5.7ms | 229.7MB | 130ms | 113ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
chapel | 5-m.chpl | 111ms | 1.0ms | 32.4MB | 193ms | 0ms | chpl 1.31.0 |
csharp | 5-m.cs | 133ms | 7.9ms | 36.2MB | 380ms | 83ms | dotnet/aot 8.0.101 |
csharp | 5-m.cs | 205ms | 9.6ms | 45.3MB | 477ms | 117ms | dotnet 8.0.101 |
csharp | 5-m.cs | 262ms | 5.6ms | 47.9MB | 683ms | 147ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
chapel | 5.chpl | 29ms | 0.6ms | 32.4MB | 23ms | 3ms | chpl 1.31.0 |
csharp | 5-m.cs | 34ms | 1.8ms | 27.0MB | 50ms | 27ms | dotnet/aot 8.0.101 |
csharp | 5-m.cs | 85ms | 10ms | 42.7MB | 110ms | 30ms | mono 6.12.0 |
csharp | 5.cs | 86ms | 6.4ms | 42.0MB | 83ms | 20ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 1.cs | 12ms | 11ms | 16.2MB | 0ms | 0ms | dotnet/aot 8.0.101 |
chapel | 1.chpl | 16ms | 0.2ms | 32.8MB | 10ms | 0ms | chpl 1.31.0 |
csharp | 1.cs | 32ms | 0.5ms | 23.8MB | 18ms | 2ms | mono 6.12.0 |
csharp | 1.cs | 56ms | 6.0ms | 31.4MB | 20ms | 2ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2-http2.cs | 629ms | 6.5ms | 119.0MB | 820ms | 160ms | dotnet 8.0.101 |
csharp | 2-m.cs | 716ms | 35ms | 148.5MB | 767ms | 627ms | dotnet 8.0.101 |
csharp | 1-m.cs | 846ms | 24ms | 171.9MB | 1123ms | 817ms | dotnet 8.0.101 |
csharp | 2-http3.cs | 857ms | 32ms | 151.8MB | 1227ms | 317ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 434ms | 9.7ms | 98.1MB | 387ms | 183ms | dotnet 8.0.101 |
csharp | 1-m.cs | 471ms | 12ms | 106.5MB | 527ms | 223ms | dotnet 8.0.101 |
csharp | 2-http2.cs | 559ms | 14ms | 95.7MB | 530ms | 123ms | dotnet 8.0.101 |
csharp | 2-http3.cs | 622ms | 17ms | 106.2MB | 660ms | 150ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 6-m.cs | 511ms | 13ms | 56.0MB | 1300ms | 30ms | dotnet/aot 8.0.101 |
csharp | 6-m.cs | 629ms | 31ms | 82.6MB | 1287ms | 43ms | dotnet 8.0.101 |
chapel | 3-m.chpl | 766ms | 18ms | 101.0MB | 1443ms | 7ms | chpl 1.31.0 |
csharp | 6-m.cs | 1015ms | 14ms | 69.1MB | 2943ms | 27ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 6-m.cs | 98ms | 5.9ms | 46.2MB | 173ms | 23ms | dotnet/aot 8.0.101 |
chapel | 3-m.chpl | 120ms | 0.8ms | 90.9MB | 207ms | 3ms | chpl 1.31.0 |
csharp | 6.cs | 167ms | 13ms | 72.2MB | 207ms | 30ms | dotnet 8.0.101 |
csharp | 6-m.cs | 198ms | 0.7ms | 57.8MB | 380ms | 20ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 106ms | 1.6ms | 14.1MB | 100ms | 0ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 148ms | 4.4ms | 23.7MB | 133ms | 0ms | mono 6.12.0 |
csharp | 2.cs | 275ms | 12ms | 32.4MB | 233ms | 10ms | dotnet 8.0.101 |
csharp | 1.cs | 1019ms | 3.2ms | 17.3MB | 1010ms | 10ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 1444ms | 29ms | 163.2MB | 1333ms | 93ms | dotnet 8.0.101 |
csharp | 1.cs | 3317ms | 12ms | 48.3MB | 3263ms | 47ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 293ms | 5.4ms | 12.1MB | 287ms | 0ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 358ms | 4.8ms | 27.1MB | 347ms | 0ms | mono 6.12.0 |
csharp | 2.cs | 421ms | 6.2ms | 34.8MB | 383ms | 10ms | dotnet 8.0.101 |
csharp | 1.cs | 3057ms | 18ms | 17.1MB | 3037ms | 17ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 3997ms | 26ms | 422.9MB | 3770ms | 203ms | dotnet 8.0.101 |
csharp | 1.cs | timeout | 0.0ms | 46.4MB | 4930ms | 60ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 59ms | 0.4ms | 16.1MB | 55ms | 5ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 96ms | 0.3ms | 25.4MB | 83ms | 3ms | mono 6.12.0 |
csharp | 2.cs | 195ms | 1.6ms | 32.5MB | 147ms | 13ms | dotnet 8.0.101 |
csharp | 1.cs | 1709ms | 2.4ms | 16.9MB | 1707ms | 0ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 1719ms | 9.1ms | 86.6MB | 1663ms | 33ms | dotnet 8.0.101 |
csharp | 1.cs | 1812ms | 7.4ms | 29.2MB | 1793ms | 3ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 666ms | 69ms | 209.7MB | 540ms | 90ms | dotnet 8.0.101 |
csharp | 1.cs | 2059ms | 1.7ms | 42.1MB | 2023ms | 10ms | dotnet 8.0.101 |
csharp | 3.cs | 2491ms | 24ms | 42.5MB | 2443ms | 20ms | dotnet 8.0.101 |
csharp | 3.cs | 2491ms | 7.0ms | 22.6MB | 2487ms | 0ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 3587ms | 56ms | 22.7MB | 3583ms | 0ms | dotnet/aot 8.0.101 |
csharp | 1.cs | timeout | 0.0ms | 25.1MB | 4980ms | 3ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 3.cs | 116ms | 1.6ms | 19.4MB | 110ms | 0ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 138ms | 11ms | 46.2MB | 103ms | 7ms | dotnet 8.0.101 |
csharp | 1.cs | 160ms | 4.9ms | 39.4MB | 127ms | 3ms | dotnet 8.0.101 |
csharp | 1.cs | 162ms | 2.6ms | 19.7MB | 157ms | 3ms | dotnet/aot 8.0.101 |
csharp | 3.cs | 218ms | 31ms | 39.6MB | 177ms | 13ms | dotnet 8.0.101 |
csharp | 1.cs | 569ms | 2.0ms | 26.0MB | 553ms | 3ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 520ms | 2.4ms | 155.2MB | 587ms | 87ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 601ms | 10ms | 107.3MB | 693ms | 97ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 1201ms | 5.0ms | 1295.1MB | 493ms | 673ms | dotnet 8.0.101 |
csharp | 1.cs | 1308ms | 29ms | 144.8MB | 1517ms | 157ms | mono 6.12.0 |
csharp | 1.cs | 1565ms | 4.3ms | 1869.6MB | 580ms | 943ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 2.cs | 110ms | 2.0ms | 38.0MB | 113ms | 17ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 123ms | 1.1ms | 48.4MB | 130ms | 23ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 262ms | 7.9ms | 73.9MB | 237ms | 33ms | mono 6.12.0 |
csharp | 2.cs | 371ms | 4.9ms | 305.1MB | 183ms | 157ms | dotnet 8.0.101 |
csharp | 1.cs | 441ms | 8.6ms | 428.5MB | 170ms | 237ms | dotnet 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
chapel | 2.chpl | 329ms | 2.0ms | 32.8MB | 313ms | 7ms | chpl 1.31.0 |
csharp | 8.cs | 375ms | 1.6ms | 14.2MB | 370ms | 3ms | dotnet/aot 8.0.101 |
csharp | 9.cs | 383ms | 7.2ms | 33.1MB | 343ms | 10ms | dotnet 8.0.101 |
csharp | 8.cs | 433ms | 3.3ms | 32.9MB | 393ms | 7ms | dotnet 8.0.101 |
csharp | 8.cs | 1248ms | 6.8ms | 24.9MB | 1230ms | 3ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 8.cs | 48ms | 1.3ms | 16.1MB | 43ms | 3ms | dotnet/aot 8.0.101 |
chapel | 2.chpl | 51ms | 1.6ms | 32.9MB | 47ms | 0ms | chpl 1.31.0 |
csharp | 8.cs | 106ms | 7.9ms | 33.2MB | 67ms | 10ms | dotnet 8.0.101 |
csharp | 9.cs | 114ms | 2.8ms | 33.1MB | 77ms | 10ms | dotnet 8.0.101 |
csharp | 8.cs | 162ms | 1.0ms | 27.0MB | 150ms | 0ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 1.cs | 346ms | 5.2ms | 101.3MB | 303ms | 10ms | dotnet 8.0.101 |
csharp | 1.cs | 353ms | 5.9ms | 55.6MB | 340ms | 3ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 427ms | 2.0ms | 21.2MB | 423ms | 3ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 441ms | 0.4ms | 41.7MB | 397ms | 13ms | dotnet 8.0.101 |
csharp | 1.cs | 544ms | 3.3ms | 86.6MB | 520ms | 13ms | mono 6.12.0 |
csharp | 2.cs | 1861ms | 11ms | 29.9MB | 1843ms | 0ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 1.cs | 81ms | 1.1ms | 23.9MB | 70ms | 7ms | dotnet/aot 8.0.101 |
csharp | 2.cs | 111ms | 0.4ms | 18.2MB | 110ms | 0ms | dotnet/aot 8.0.101 |
csharp | 1.cs | 114ms | 3.7ms | 49.8MB | 77ms | 7ms | dotnet 8.0.101 |
csharp | 1.cs | 144ms | 0.9ms | 40.8MB | 127ms | 7ms | mono 6.12.0 |
csharp | 2.cs | 153ms | 1.7ms | 35.4MB | 117ms | 7ms | dotnet 8.0.101 |
csharp | 2.cs | 482ms | 4.0ms | 25.5MB | 467ms | 0ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
chapel | 3.chpl | 1388ms | 3.3ms | 224.1MB | 1340ms | 40ms | chpl 1.31.0 |
csharp | 6.cs | 1736ms | 3.9ms | 420.5MB | 1720ms | 107ms | dotnet/aot 8.0.101 |
csharp | 5.cs | 2003ms | 27ms | 442.9MB | 2103ms | 167ms | dotnet 8.0.101 |
csharp | 6.cs | 2791ms | 7.4ms | 441.8MB | 2800ms | 163ms | dotnet 8.0.101 |
csharp | 5.cs | 4198ms | 19ms | 422.4MB | 4183ms | 120ms | dotnet/aot 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
chapel | 3.chpl | 169ms | 0.9ms | 52.9MB | 150ms | 10ms | chpl 1.31.0 |
csharp | 6.cs | 198ms | 2.5ms | 56.4MB | 187ms | 20ms | dotnet/aot 8.0.101 |
csharp | 5.cs | 299ms | 0.8ms | 79.2MB | 253ms | 37ms | dotnet 8.0.101 |
csharp | 6.cs | 407ms | 1.8ms | 77.2MB | 367ms | 37ms | dotnet 8.0.101 |
csharp | 5.cs | 448ms | 9.0ms | 58.2MB | 440ms | 10ms | dotnet/aot 8.0.101 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 3-m.cs | 1868ms | 28ms | 18.9MB | 7187ms | 17ms | dotnet/aot 8.0.101 |
chapel | 1-m.chpl | 1911ms | 0.6ms | 32.9MB | 3783ms | 0ms | chpl 1.31.0 |
csharp | 3-m.cs | 2016ms | 168ms | 39.0MB | 7077ms | 27ms | dotnet 8.0.101 |
chapel | 1.chpl | 3712ms | 4.9ms | 32.8MB | 3703ms | 0ms | chpl 1.31.0 |
csharp | 3-m.cs | 4685ms | 117ms | 29.1MB | 17887ms | 20ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 3-m.cs | 477ms | 2.0ms | 18.7MB | 1807ms | 10ms | dotnet/aot 8.0.101 |
chapel | 1-m.chpl | 496ms | 1.2ms | 32.9MB | 953ms | 0ms | chpl 1.31.0 |
csharp | 3-m.cs | 536ms | 3.2ms | 36.9MB | 1843ms | 17ms | dotnet 8.0.101 |
chapel | 1.chpl | 944ms | 2.4ms | 32.8MB | 933ms | 0ms | chpl 1.31.0 |
csharp | 3-m.cs | 1178ms | 36ms | 29.3MB | 4430ms | 7ms | mono 6.12.0 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
csharp | 3-m.cs | 132ms | 0.4ms | 18.9MB | 453ms | 3ms | dotnet/aot 8.0.101 |
chapel | 1-m.chpl | 140ms | 0.8ms | 33.0MB | 240ms | 7ms | chpl 1.31.0 |
csharp | 3-m.cs | 191ms | 6.2ms | 35.6MB | 490ms | 10ms | dotnet 8.0.101 |
chapel | 1.chpl | 252ms | 1.7ms | 32.8MB | 247ms | 0ms | chpl 1.31.0 |
csharp | 3-m.cs | 344ms | 4.8ms | 33.1MB | 1147ms | 17ms | mono 6.12.0 |