Programming Language and compiler
Benchmarks

C# VS Julia benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1131ms 0.4ms 243.3MB 1017ms 193ms julia 1.7.2
csharp 1.cs 1400ms 22ms 390.6MB 1260ms 180ms dotnet 6.0.300
csharp 1.cs 2295ms 25ms 103.2MB 2610ms 193ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 160ms 4.1ms 44.7MB 143ms 3ms mono 6.12.0
csharp 1.cs 194ms 16ms 93.0MB 140ms 20ms dotnet 6.0.300
julia 4.jl 331ms 3.0ms 225.4MB 277ms 130ms julia 1.7.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 4355ms 373ms 104.4MB 7393ms 87ms dotnet 6.0.300

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 410ms 20ms 82.8MB 407ms 47ms dotnet 6.0.300

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1112ms 0.9ms 47.9MB 1067ms 13ms dotnet 6.0.300

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 386ms 15ms 89.8MB 553ms 117ms dotnet 6.0.300
csharp 5-m.cs 493ms 9.8ms 59.0MB 813ms 110ms mono 6.12.0
julia 7-m.jl 659ms 7.7ms 287.8MB 917ms 150ms julia 1.7.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 90ms 15ms 36.1MB 100ms 33ms mono 6.12.0
csharp 5.cs 99ms 9.1ms 45.3MB 90ms 23ms dotnet 6.0.300
julia 7.jl 483ms 2.2ms 219.2MB 550ms 137ms julia 1.7.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 19ms 0.4ms 24.3MB 10ms 0ms mono 6.12.0
csharp 1.cs 50ms 4.7ms 32.9MB 24ms 2ms dotnet 6.0.300
julia 1.jl 182ms 0.8ms 169.6MB 112ms 68ms julia 1.7.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 662ms 13ms 120.7MB 753ms 77ms dotnet 6.0.300
csharp 2.cs 856ms 17ms 159.7MB 723ms 460ms dotnet 6.0.300
csharp 1-m.cs 884ms 50ms 151.7MB 923ms 407ms dotnet 6.0.300

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 462ms 13ms 80.6MB 373ms 110ms dotnet 6.0.300
csharp 1.cs 494ms 12ms 89.7MB 483ms 123ms dotnet 6.0.300
csharp 2-http2.cs 522ms 2.0ms 83.1MB 543ms 33ms dotnet 6.0.300

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 350ms 7.5ms 67.9MB 313ms 23ms dotnet 6.0.300
csharp 1.cs 530ms 6.0ms 146.6MB 507ms 53ms dotnet 6.0.300

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 2029ms 17ms 267.6MB 2117ms 100ms dotnet 6.0.300
csharp 1.cs 3283ms 134ms 761.6MB 3160ms 380ms dotnet 6.0.300

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 1339ms 8.1ms 267.8MB 1633ms 153ms julia 1.7.2
csharp 6.cs 1349ms 172ms 78.1MB 1697ms 40ms dotnet 6.0.300
csharp 6-m.cs 1608ms 60ms 71.9MB 2610ms 23ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 237ms 6.1ms 66.0MB 250ms 23ms dotnet 6.0.300
csharp 6.cs 251ms 7.8ms 52.7MB 333ms 10ms mono 6.12.0
julia 8.jl 910ms 1.5ms 256.3MB 997ms 153ms julia 1.7.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 187ms 1.3ms 25.5MB 170ms 0ms mono 6.12.0
csharp 2.cs 208ms 4.7ms 28.0MB 170ms 0ms dotnet 6.0.300
csharp 1.cs 1670ms 5.3ms 91.7MB 1620ms 37ms dotnet 6.0.300
csharp 1.cs 3070ms 3.0ms 49.8MB 3023ms 37ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 457ms 3.5ms 28.1MB 427ms 3ms dotnet 6.0.300
csharp 2.cs 511ms 13ms 24.4MB 497ms 0ms mono 6.12.0
csharp 1.cs 4722ms 92ms 92.7MB 4683ms 27ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 107ms 1.5ms 27.3MB 93ms 0ms mono 6.12.0
csharp 2.cs 130ms 4.5ms 27.7MB 103ms 0ms dotnet 6.0.300
csharp 1.cs 3190ms 8.7ms 33.8MB 3163ms 3ms mono 6.12.0
csharp 1.cs 3201ms 7.3ms 73.2MB 3160ms 20ms dotnet 6.0.300

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1289ms 18ms 94.2MB 1220ms 40ms dotnet 6.0.300
csharp 3.cs 4409ms 23ms 98.9MB 4353ms 33ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 146ms 5.0ms 68.2MB 77ms 30ms dotnet 6.0.300
csharp 3.cs 296ms 2.4ms 62.3MB 260ms 13ms dotnet 6.0.300
csharp 1.cs 1762ms 21ms 94.1MB 1713ms 30ms dotnet 6.0.300
csharp 1.cs 3330ms 5.6ms 34.2MB 3307ms 10ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 908ms 3.1ms 378.4MB 773ms 167ms dotnet 6.0.300
csharp 1.cs 922ms 7.6ms 395.6MB 780ms 173ms dotnet 6.0.300
csharp 1.cs 1729ms 34ms 153.0MB 2073ms 143ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 253ms 3.7ms 94.1MB 203ms 30ms dotnet 6.0.300
csharp 1.cs 284ms 3.0ms 183.8MB 197ms 67ms dotnet 6.0.300
csharp 1.cs 315ms 3.6ms 74.8MB 283ms 40ms mono 6.12.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 438ms 9.0ms 29.3MB 410ms 0ms dotnet 6.0.300
csharp 8.cs 537ms 3.7ms 29.1MB 503ms 3ms dotnet 6.0.300
julia 7.jl 757ms 1.2ms 221.8MB 700ms 133ms julia 1.7.2
csharp 8.cs 1110ms 1.7ms 27.0MB 1097ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 95ms 4.6ms 29.2MB 67ms 0ms dotnet 6.0.300
csharp 8.cs 101ms 4.9ms 31.2MB 77ms 0ms dotnet 6.0.300
csharp 8.cs 135ms 4.1ms 27.0MB 123ms 0ms mono 6.12.0
julia 7.jl 446ms 1.1ms 222.5MB 377ms 147ms julia 1.7.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 580ms 1.3ms 208.4MB 520ms 137ms julia 1.7.2
csharp 1.cs 910ms 19ms 88.6MB 880ms 17ms mono 6.12.0
csharp 1.cs 960ms 29ms 87.9MB 910ms 20ms dotnet 6.0.300
csharp 2.cs 1031ms 0.9ms 40.1MB 993ms 7ms dotnet 6.0.300
csharp 2.cs 2587ms 3.8ms 32.5MB 2577ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 185ms 0.6ms 40.7MB 173ms 3ms mono 6.12.0
csharp 1.cs 187ms 4.3ms 45.9MB 153ms 7ms dotnet 6.0.300
csharp 2.cs 301ms 3.8ms 31.7MB 273ms 0ms dotnet 6.0.300
julia 1.jl 378ms 1.5ms 205.3MB 323ms 133ms julia 1.7.2
csharp 2.cs 644ms 0.3ms 25.9MB 630ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 823ms 6.9ms 181.6MB 770ms 127ms julia 1.7.2
julia 1.jl 1408ms 3.0ms 257.9MB 1313ms 170ms julia 1.7.2
csharp 1.cs timeout 0.0ms 0.0MB 0ms 0ms dotnet 6.0.300

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 373ms 1.0ms 177.7MB 323ms 127ms julia 1.7.2
julia 1.jl 768ms 21ms 261.2MB 653ms 180ms julia 1.7.2
csharp 1.cs 1281ms 9.1ms 90.8MB 1277ms 30ms dotnet 6.0.300

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3271ms 13ms 592.6MB 3217ms 230ms dotnet 7.0.100
csharp 5p.cs 3951ms 19ms 590.4MB 3800ms 233ms dotnet 7.0.100
csharp 5.cs 4122ms 67ms 525.8MB 4037ms 210ms dotnet 6.0.300

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 481ms 24ms 162.1MB 410ms 47ms dotnet 7.0.100
csharp 5.cs 536ms 3.8ms 88.8MB 493ms 30ms dotnet 6.0.300
csharp 5p.cs 572ms 13ms 156.9MB 470ms 50ms dotnet 7.0.100

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4316ms 16ms 90.5MB 4300ms 27ms dotnet 6.0.300

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1164ms 13ms 88.3MB 1157ms 13ms dotnet 6.0.300

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1402ms 3.5ms 197.3MB 2453ms 110ms julia 1.7.2
julia 3-m.jl 2112ms 3.7ms 210.9MB 3757ms 133ms julia 1.7.2
csharp 3-m.cs 2999ms 510ms 30.9MB 5187ms 20ms dotnet 6.0.300
csharp 3.cs timeout 0.0ms 0.0MB 0ms 0ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 613ms 3.3ms 196.8MB 867ms 150ms julia 1.7.2
csharp 3-m.cs 719ms 3.7ms 29.5MB 1297ms 13ms dotnet 6.0.300
julia 3-m.jl 833ms 3.1ms 210.7MB 1250ms 130ms julia 1.7.2
csharp 3-m.cs 3181ms 129ms 29.4MB 6040ms 10ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 235ms 3.5ms 30.1MB 360ms 3ms dotnet 6.0.300
julia 2-m.jl 413ms 1.1ms 197.9MB 523ms 103ms julia 1.7.2
julia 3.jl 517ms 4.6ms 214.2MB 627ms 130ms julia 1.7.2
csharp 3-m.cs 805ms 2.5ms 30.0MB 1530ms 3ms mono 6.12.0