Programming Language and compiler
Benchmarks

C# VS V benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1219ms 41ms 381.4MB 1150ms 170ms dotnet/aot 7.0.102
v 1.v 1286ms 4.6ms 37.1MB 1260ms 13ms v/clang+gc 0.3.2
v 1.v 1296ms 49ms 37.2MB 1277ms 3ms v/clang 0.3.2
csharp 1.cs 1518ms 32ms 478.5MB 1357ms 213ms dotnet 7.0.102
csharp 1.cs 2160ms 13ms 97.0MB 2463ms 157ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 94ms 1.4ms 5.6MB 83ms 0ms v/clang+gc 0.3.2
v 1.v 95ms 1.3ms 5.5MB 83ms 0ms v/clang 0.3.2
csharp 1.cs 123ms 4.5ms 75.0MB 100ms 20ms dotnet/aot 7.0.102
csharp 1.cs 152ms 1.0ms 42.2MB 133ms 7ms mono 6.12.0
csharp 1.cs 257ms 5.5ms 170.0MB 187ms 43ms dotnet 7.0.102

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 4430ms 86ms 177.3MB 8227ms 73ms dotnet 7.0.102
csharp 1-m.cs 4903ms 68ms 81.8MB 9207ms 57ms dotnet/aot 7.0.102
v 1.v timeout 0.0ms 16.6MB 5250ms 4327ms v/clang 0.3.2
v 1.v timeout 0.0ms 21.1MB 5033ms 4270ms v/clang+gc 0.3.2

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 309ms 21ms 60.1MB 513ms 27ms dotnet/aot 7.0.102
csharp 1-m.cs 549ms 12ms 157.4MB 870ms 40ms dotnet 7.0.102
v 1-m.v 3602ms 203ms 24.5MB 3690ms 3160ms v/clang+gc 0.3.2
v 1-m.v 3937ms 909ms 16.5MB 3953ms 3430ms v/clang 0.3.2

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs timeout 0.0ms 110.3MB 4933ms 23ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 22.4MB 4980ms 3ms dotnet/aot 7.0.102
v 1.v timeout 0.0ms 28.8MB 4983ms 0ms v/clang+gc 0.3.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1006ms 1.8ms 19.1MB 1000ms 0ms dotnet/aot 7.0.102
csharp 1.cs 1115ms 4.9ms 105.6MB 1063ms 23ms dotnet 7.0.102
v 1.v timeout 0.0ms 12.8MB 4973ms 0ms v/clang+gc 0.3.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 345ms 24ms 60.9MB 567ms 77ms dotnet/aot 7.0.102
csharp 5-m.cs 501ms 41ms 126.4MB 763ms 123ms dotnet 7.0.102
csharp 5-m.cs 507ms 27ms 83.1MB 870ms 87ms mono 6.12.0
v 1.v 651ms 2.0ms 2.0MB 633ms 0ms v/clang+gc 0.3.2
v 1.v 653ms 3.2ms 2.0MB 637ms 0ms v/clang 0.3.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 65ms 5.3ms 24.4MB 80ms 23ms dotnet/aot 7.0.102
v 1.v 68ms 0.6ms 2.0MB 60ms 0ms v/clang+gc 0.3.2
v 1.v 70ms 1.7ms 2.1MB 60ms 0ms v/clang 0.3.2
csharp 5-m.cs 86ms 3.0ms 36.2MB 107ms 23ms mono 6.12.0
csharp 5.cs 128ms 12ms 109.4MB 113ms 37ms dotnet 7.0.102

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 1.8ms 0.6ms 2.0MB 0ms 0ms v/clang+gc 0.3.2
v 1.v 1.8ms 0.6ms 2.1MB 0ms 0ms v/clang 0.3.2
csharp 1.cs 6.0ms 1.1ms 9.2MB 0ms 0ms dotnet/aot 7.0.102
csharp 1.cs 19ms 0.4ms 24.2MB 10ms 0ms mono 6.12.0
csharp 1.cs 72ms 2.1ms 101.6MB 32ms 12ms dotnet 7.0.102

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 888ms 43ms 232.1MB 727ms 470ms dotnet 7.0.102
csharp 2-http2.cs 921ms 0.9ms 205.9MB 970ms 110ms dotnet 7.0.102
csharp 1.cs 980ms 45ms 252.9MB 1000ms 457ms dotnet 7.0.102
csharp 2-http3.cs 1314ms 10ms 262.7MB 1520ms 260ms dotnet 7.0.102
v 1.v timeout 0.0ms 9.5MB 537ms 797ms v/clang+gc 0.3.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 193ms 38ms 14.8MB 87ms 80ms v/clang+gc 0.3.2
csharp 2.cs 497ms 10ms 154.6MB 403ms 117ms dotnet 7.0.102
csharp 1.cs 533ms 11ms 165.8MB 503ms 150ms dotnet 7.0.102
csharp 2-http2.cs 812ms 9.7ms 161.4MB 767ms 87ms dotnet 7.0.102
csharp 2-http3.cs 897ms 15ms 180.9MB 883ms 113ms dotnet 7.0.102

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 414ms 3.8ms 144.9MB 347ms 50ms dotnet 7.0.102
csharp 1.cs 696ms 5.3ms 214.0MB 687ms 67ms dotnet 7.0.102

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1829ms 39ms 333.6MB 1957ms 113ms dotnet 7.0.102
csharp 1.cs 2922ms 18ms 856.8MB 2907ms 353ms dotnet 7.0.102

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 942ms 7.8ms 53.5MB 1393ms 17ms dotnet/aot 7.0.102
csharp 6-m.cs 1168ms 31ms 145.7MB 1973ms 37ms dotnet 7.0.102
csharp 6-m.cs 1634ms 77ms 71.9MB 2640ms 27ms mono 6.12.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 145ms 1.0ms 40.2MB 167ms 17ms dotnet/aot 7.0.102
csharp 6.cs 235ms 6.8ms 51.1MB 303ms 13ms mono 6.12.0
csharp 6.cs 280ms 4.4ms 132.9MB 300ms 40ms dotnet 7.0.102

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 138ms 3.9ms 10.2MB 133ms 0ms dotnet/aot 7.0.102
csharp 2.cs 186ms 3.9ms 25.1MB 173ms 0ms mono 6.12.0
csharp 2.cs 218ms 8.5ms 101.9MB 177ms 13ms dotnet 7.0.102
v 1.v 403ms 1.5ms 2.2MB 390ms 0ms v/clang+gc 0.3.2
v 1.v 424ms 0.3ms 2.2MB 410ms 0ms v/clang 0.3.2
csharp 1.cs 1296ms 5.7ms 75.3MB 1273ms 17ms dotnet/aot 7.0.102
csharp 1.cs 1692ms 20ms 163.6MB 1627ms 47ms dotnet 7.0.102
csharp 1.cs 3054ms 61ms 49.6MB 3017ms 30ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 394ms 2.8ms 10.0MB 390ms 0ms dotnet/aot 7.0.102
csharp 2.cs 432ms 5.9ms 100.1MB 390ms 23ms dotnet 7.0.102
csharp 2.cs 502ms 1.9ms 24.2MB 487ms 0ms mono 6.12.0
v 1.v 1205ms 2.4ms 2.3MB 1193ms 0ms v/clang+gc 0.3.2
v 1.v 1265ms 1.6ms 2.3MB 1257ms 0ms v/clang 0.3.2
csharp 1.cs 3809ms 8.4ms 73.7MB 3783ms 20ms dotnet/aot 7.0.102
csharp 1.cs 4680ms 14ms 159.6MB 4607ms 57ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 47.9MB 4937ms 50ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 71ms 1.2ms 8.3MB 67ms 0ms dotnet/aot 7.0.102
csharp 2.cs 107ms 2.0ms 25.6MB 93ms 0ms mono 6.12.0
v 1.v 134ms 1.0ms 2.3MB 123ms 0ms v/clang+gc 0.3.2
v 1.v 140ms 0.3ms 2.3MB 130ms 0ms v/clang 0.3.2
csharp 2.cs 150ms 3.1ms 104.0MB 100ms 20ms dotnet 7.0.102
csharp 1.cs 2831ms 3.6ms 62.5MB 2810ms 17ms dotnet/aot 7.0.102
csharp 1.cs 3108ms 42ms 150.6MB 3047ms 40ms dotnet 7.0.102
csharp 1.cs 3186ms 6.2ms 33.9MB 3167ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 753ms 12ms 165.8MB 687ms 37ms dotnet 7.0.102
csharp 3.cs 3602ms 62ms 111.5MB 3550ms 17ms dotnet 7.0.102
csharp 1.cs 4047ms 52ms 107.7MB 3987ms 17ms dotnet 7.0.102
csharp 3.cs 4739ms 130ms 19.7MB 4733ms 0ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 12.5MB 4993ms 0ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 22.9MB 4987ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 143ms 7.9ms 111.8MB 93ms 20ms dotnet 7.0.102
csharp 3.cs 207ms 3.2ms 14.4MB 200ms 0ms dotnet/aot 7.0.102
csharp 1.cs 222ms 2.9ms 12.3MB 213ms 0ms dotnet/aot 7.0.102
csharp 1.cs 246ms 1.2ms 104.4MB 197ms 17ms dotnet 7.0.102
csharp 3.cs 251ms 3.2ms 104.6MB 203ms 20ms dotnet 7.0.102
csharp 1.cs 832ms 2.4ms 26.3MB 817ms 0ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 774ms 7.0ms 370.7MB 663ms 153ms dotnet/aot 7.0.102
csharp 1.cs 823ms 7.1ms 382.8MB 703ms 163ms dotnet/aot 7.0.102
csharp 2.cs 1003ms 12ms 469.9MB 807ms 203ms dotnet 7.0.102
csharp 1.cs 1053ms 12ms 510.7MB 840ms 220ms dotnet 7.0.102
csharp 1.cs 1638ms 16ms 145.5MB 1970ms 133ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 156ms 2.7ms 73.9MB 130ms 27ms dotnet/aot 7.0.102
csharp 1.cs 235ms 4.3ms 207.9MB 157ms 70ms dotnet/aot 7.0.102
csharp 1.cs 303ms 2.1ms 72.0MB 277ms 33ms mono 6.12.0
csharp 2.cs 386ms 1.7ms 171.0MB 323ms 47ms dotnet 7.0.102
csharp 1.cs 386ms 9.3ms 279.7MB 250ms 103ms dotnet 7.0.102

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 428ms 2.1ms 100.0MB 387ms 13ms dotnet 7.0.102
csharp 8.cs 500ms 2.6ms 10.2MB 493ms 0ms dotnet/aot 7.0.102
csharp 8.cs 554ms 1.4ms 102.3MB 510ms 10ms dotnet 7.0.102
v 1.v 871ms 0.8ms 2.3MB 860ms 0ms v/clang 0.3.2
v 1.v 879ms 6.2ms 2.3MB 863ms 0ms v/clang+gc 0.3.2
csharp 8.cs 1108ms 0.6ms 24.3MB 1090ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 55ms 0.5ms 12.0MB 50ms 0ms dotnet/aot 7.0.102
v 1.v 90ms 0.2ms 2.3MB 80ms 0ms v/clang+gc 0.3.2
v 1.v 91ms 1.3ms 2.3MB 80ms 0ms v/clang 0.3.2
csharp 9.cs 118ms 2.6ms 100.0MB 73ms 17ms dotnet 7.0.102
csharp 8.cs 127ms 4.5ms 102.3MB 77ms 23ms dotnet 7.0.102
csharp 8.cs 132ms 1.4ms 25.1MB 120ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 507ms 3.1ms 11.0MB 497ms 0ms v/clang 0.3.2
v 2.v 510ms 3.1ms 10.7MB 493ms 3ms v/clang+gc 0.3.2
csharp 1.cs 655ms 63ms 71.8MB 633ms 13ms dotnet/aot 7.0.102
csharp 1.cs 722ms 25ms 86.7MB 700ms 3ms mono 6.12.0
csharp 2.cs 760ms 2.5ms 21.6MB 757ms 3ms dotnet/aot 7.0.102
csharp 2.cs 953ms 0.2ms 111.1MB 903ms 23ms dotnet 7.0.102
v 1.v 1164ms 113ms 41.1MB 1143ms 7ms v/clang+gc 0.3.2
csharp 1.cs 1273ms 20ms 161.1MB 1220ms 23ms dotnet 7.0.102
v 1.v 1352ms 95ms 41.2MB 1330ms 7ms v/clang 0.3.2
csharp 2.cs 2426ms 5.4ms 31.9MB 2410ms 3ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 2.v 116ms 0.4ms 4.0MB 107ms 0ms v/clang+gc 0.3.2
v 2.v 117ms 0.7ms 4.1MB 107ms 0ms v/clang 0.3.2
v 1.v 122ms 1.8ms 20.0MB 110ms 0ms v/clang+gc 0.3.2
v 1.v 129ms 2.2ms 20.8MB 113ms 0ms v/clang 0.3.2
csharp 1.cs 134ms 0.6ms 27.8MB 127ms 3ms dotnet/aot 7.0.102
csharp 1.cs 181ms 0.5ms 39.0MB 167ms 0ms mono 6.12.0
csharp 2.cs 191ms 1.3ms 15.3MB 190ms 0ms dotnet/aot 7.0.102
csharp 2.cs 290ms 1.4ms 104.7MB 247ms 13ms dotnet 7.0.102
csharp 1.cs 344ms 6.0ms 114.8MB 290ms 23ms dotnet 7.0.102
csharp 2.cs 613ms 8.9ms 25.7MB 590ms 3ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 3901ms 88ms 3.2MB 3873ms 10ms v/clang+gc 0.3.2
csharp 1.cs 4447ms 3.7ms 78.2MB 4410ms 43ms dotnet/aot 7.0.102
csharp 1.cs 4713ms 26ms 169.5MB 4653ms 77ms dotnet 7.0.102
v 1.v timeout 0.0ms 4.0MB 4980ms 7ms v/clang 0.3.2
v 2.v timeout 0.0ms 3.3MB 4983ms 7ms v/clang+gc 0.3.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
v 1.v 959ms 2.4ms 2.9MB 947ms 0ms v/clang+gc 0.3.2
csharp 1.cs 1055ms 1.9ms 73.6MB 1033ms 17ms dotnet/aot 7.0.102
csharp 1.cs 1180ms 6.7ms 165.3MB 1170ms 37ms dotnet 7.0.102
v 1.v 1425ms 42ms 2.9MB 1410ms 0ms v/clang 0.3.2
v 2.v 1737ms 35ms 2.7MB 1723ms 0ms v/clang+gc 0.3.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3329ms 22ms 600.0MB 3280ms 227ms dotnet 7.0.102
csharp 6.cs 3601ms 2.5ms 459.1MB 3513ms 140ms dotnet/aot 7.0.102
csharp 6.cs 3875ms 36ms 596.2MB 3773ms 167ms dotnet 7.0.102
csharp 5.cs timeout 0.0ms 182.2MB 4977ms 67ms dotnet/aot 7.0.102

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 379ms 3.0ms 68.4MB 360ms 13ms dotnet/aot 7.0.102
csharp 5.cs 480ms 5.5ms 163.8MB 417ms 43ms dotnet 7.0.102
csharp 6.cs 575ms 2.7ms 161.8MB 507ms 47ms dotnet 7.0.102
csharp 5.cs 691ms 5.9ms 71.3MB 667ms 17ms dotnet/aot 7.0.102

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 3852ms 27ms 73.5MB 3823ms 27ms dotnet/aot 7.0.102
csharp 1.cs 4192ms 81ms 168.8MB 4133ms 57ms dotnet 7.0.102

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 989ms 1.4ms 66.5MB 960ms 20ms dotnet/aot 7.0.102
csharp 1.cs 1174ms 1.1ms 162.8MB 1167ms 47ms dotnet 7.0.102

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2524ms 1.5ms 13.6MB 4923ms 3ms dotnet/aot 7.0.102
csharp 3-m.cs 4419ms 13ms 103.0MB 8520ms 33ms dotnet 7.0.102
csharp 3.cs timeout 0.0ms 26.7MB 9787ms 0ms mono 6.12.0
v 1.v timeout 0.0ms 3.0MB 4983ms 0ms v/clang 0.3.2
v 1.v timeout 0.0ms 3.1MB 4987ms 0ms v/clang+gc 0.3.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 650ms 4.1ms 12.3MB 1233ms 3ms dotnet/aot 7.0.102
csharp 3-m.cs 1215ms 14ms 104.4MB 2240ms 23ms dotnet 7.0.102
v 1.v 1551ms 0.4ms 2.8MB 1537ms 0ms v/clang 0.3.2
v 1.v 1556ms 5.3ms 2.8MB 1543ms 0ms v/clang+gc 0.3.2
csharp 3-m.cs 3182ms 84ms 27.5MB 6037ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 181ms 3.8ms 12.3MB 317ms 3ms dotnet/aot 7.0.102
csharp 3-m.cs 392ms 1.6ms 104.3MB 620ms 20ms dotnet 7.0.102
v 1.v 393ms 0.4ms 2.6MB 380ms 0ms v/clang+gc 0.3.2
v 1.v 400ms 9.6ms 2.5MB 380ms 0ms v/clang 0.3.2
csharp 3-m.cs 802ms 4.1ms 27.8MB 1517ms 7ms mono 6.12.0