Programming Language and compiler
Benchmarks

Crystal VS C# benchmarks

Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 912ms 14ms 187.1MB 903ms 140ms dotnet/aot 9.0.102
csharp 1.cs 964ms 9.3ms 206.6MB 947ms 153ms dotnet 9.0.102
crystal 1.cr 1316ms 80ms 64.1MB 1290ms 10ms crystal 1.15.0
csharp 1.cs 1752ms 85ms 103.6MB 1933ms 253ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 9.3ms 10.9MB 100ms 0ms crystal 1.15.0
csharp 1.cs 117ms 2.5ms 41.9MB 80ms 30ms dotnet/aot 9.0.102
csharp 1.cs 151ms 2.8ms 46.3MB 127ms 10ms mono 6.12.0
csharp 1.cs 204ms 17ms 64.6MB 153ms 37ms dotnet 9.0.102

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1367ms 11ms 19.8MB 1300ms 50ms crystal 1.15.0
csharp 1-m.cs 2167ms 61ms 71.6MB 7430ms 90ms dotnet/aot 9.0.102
csharp 1-m.cs 2627ms 90ms 82.1MB 8133ms 107ms dotnet 9.0.102

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 76ms 1.4ms 7.1MB 57ms 7ms crystal 1.15.0
csharp 1-m.cs 174ms 6.3ms 28.9MB 467ms 20ms dotnet/aot 9.0.102
csharp 1-m.cs 285ms 11ms 50.6MB 790ms 33ms dotnet 9.0.102

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 62ms 1.9ms 6.4MB 43ms 3ms crystal 1.15.0
csharp 1.cs 4084ms 2.2ms 24.3MB 4053ms 17ms dotnet/aot 9.0.102
csharp 1.cs 4938ms 22ms 43.7MB 4910ms 17ms dotnet 9.0.102

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.6ms 5.1MB 10ms 0ms crystal 1.15.0
csharp 1.cs 685ms 5.5ms 20.5MB 660ms 3ms dotnet/aot 9.0.102
csharp 1.cs 858ms 3.8ms 40.0MB 827ms 17ms dotnet 9.0.102

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2495ms 6.5ms 2.8MB 2483ms 0ms crystal 1.15.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 1.5ms 2.8MB 193ms 0ms crystal 1.15.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 138ms 5.4ms 33.9MB 347ms 123ms dotnet/aot 9.0.102
csharp 5-m.cs 188ms 2.6ms 50.8MB 470ms 113ms dotnet 9.0.102
csharp 5-m.cs 259ms 14ms 58.4MB 653ms 157ms mono 6.12.0
crystal 2.cr 573ms 3.5ms 3.5MB 450ms 107ms crystal 1.15.0
crystal 1.cr 720ms 0.6ms 14.6MB 573ms 127ms crystal 1.15.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 26ms 1.6ms 23.7MB 33ms 17ms dotnet/aot 9.0.102
csharp 5-m.cs 61ms 1.5ms 47.1MB 83ms 20ms dotnet 9.0.102
crystal 2.cr 61ms 1.2ms 3.5MB 43ms 7ms crystal 1.15.0
csharp 5-m.cs 70ms 1.0ms 39.6MB 103ms 17ms mono 6.12.0
crystal 1.cr 76ms 0.8ms 4.9MB 53ms 7ms crystal 1.15.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1.9ms 0.2ms 2.9MB 0ms 0ms crystal 1.15.0
csharp 1.cs 18ms 10ms 12.5MB 0ms 0ms dotnet/aot 9.0.102
csharp 1.cs 31ms 0.2ms 23.3MB 22ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.3ms 30.3MB 16ms 4ms dotnet 9.0.102

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 512ms 4.2ms 120.8MB 737ms 140ms dotnet 9.0.102
csharp 2-m.cs 646ms 11ms 152.9MB 707ms 517ms dotnet 9.0.102
csharp 2-http3.cs 695ms 16ms 157.2MB 1120ms 290ms dotnet 9.0.102
csharp 1-m.cs 790ms 13ms 171.7MB 1097ms 717ms dotnet 9.0.102
crystal 1.cr 2547ms 222ms 197.7MB 403ms 490ms crystal 1.15.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 390ms 4.2ms 101.0MB 387ms 197ms dotnet 9.0.102
csharp 2-http2.cs 433ms 2.9ms 97.8MB 477ms 100ms dotnet 9.0.102
csharp 1-m.cs 441ms 9.6ms 110.2MB 540ms 250ms dotnet 9.0.102
csharp 2-http3.cs 498ms 11ms 107.6MB 613ms 107ms dotnet 9.0.102
crystal 1.cr 1102ms 0.9ms 36.6MB 47ms 77ms crystal 1.15.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 37ms 1.0ms 2.9MB 23ms 0ms crystal 1.15.0
crystal 1.cr 65ms 1.7ms 3.0MB 57ms 0ms crystal 1.15.0
csharp 2.cs 99ms 1.7ms 13.9MB 83ms 0ms dotnet/aot 9.0.102
csharp 2.cs 146ms 1.3ms 22.7MB 133ms 3ms mono 6.12.0
csharp 2.cs 257ms 11ms 33.4MB 233ms 13ms dotnet 9.0.102
csharp 1.cs 1004ms 6.7ms 17.2MB 980ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1439ms 251ms 38.9MB 1417ms 13ms dotnet 9.0.102
csharp 1.cs 3311ms 41ms 47.6MB 3270ms 30ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 101ms 1.0ms 2.9MB 90ms 0ms crystal 1.15.0
crystal 1.cr 184ms 2.6ms 2.9MB 170ms 0ms crystal 1.15.0
csharp 2.cs 273ms 2.4ms 13.7MB 257ms 0ms dotnet/aot 9.0.102
csharp 2.cs 402ms 2.3ms 35.6MB 387ms 10ms dotnet 9.0.102
csharp 2.cs 412ms 97ms 24.8MB 397ms 0ms mono 6.12.0
csharp 1.cs 2970ms 21ms 17.1MB 2943ms 13ms dotnet/aot 9.0.102
csharp 1.cs 3581ms 35ms 39.1MB 3560ms 20ms dotnet 9.0.102
csharp 1.cs timeout 0.0ms 47.8MB 4953ms 37ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 18ms 0.6ms 2.9MB 10ms 0ms crystal 1.15.0
crystal 1.cr 30ms 1.5ms 2.9MB 20ms 0ms crystal 1.15.0
csharp 2.cs 52ms 1.8ms 15.9MB 40ms 0ms dotnet/aot 9.0.102
csharp 2.cs 94ms 1.2ms 24.5MB 80ms 3ms mono 6.12.0
csharp 2.cs 166ms 1.3ms 35.5MB 147ms 7ms dotnet 9.0.102
csharp 1.cs 1609ms 2.2ms 36.8MB 1597ms 7ms dotnet 9.0.102
csharp 1.cs 1817ms 2.0ms 16.9MB 1793ms 7ms dotnet/aot 9.0.102
csharp 1.cs 1821ms 18ms 30.8MB 1803ms 7ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 3.9ms 9.2MB 303ms 0ms crystal 1.15.0
csharp 2.cs 1093ms 64ms 46.0MB 1057ms 20ms dotnet 9.0.102
csharp 1.cs 2043ms 10ms 42.9MB 2010ms 20ms dotnet 9.0.102
csharp 3.cs 2350ms 7.8ms 22.1MB 2337ms 3ms dotnet/aot 9.0.102
csharp 3.cs 2712ms 331ms 42.9MB 2683ms 10ms dotnet 9.0.102
csharp 1.cs 3946ms 98ms 22.2MB 3927ms 3ms dotnet/aot 9.0.102
csharp 1.cs timeout 0.0ms 24.4MB 4983ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 5.8MB 10ms 0ms crystal 1.15.0
csharp 3.cs 111ms 1.1ms 18.9MB 93ms 3ms dotnet/aot 9.0.102
csharp 2.cs 132ms 0.7ms 42.9MB 113ms 7ms dotnet 9.0.102
csharp 1.cs 139ms 1.8ms 40.0MB 120ms 3ms dotnet 9.0.102
csharp 3.cs 169ms 5.2ms 40.2MB 143ms 7ms dotnet 9.0.102
csharp 1.cs 173ms 2.3ms 19.2MB 160ms 0ms dotnet/aot 9.0.102
csharp 1.cs 566ms 2.5ms 23.4MB 547ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 540ms 17ms 126.2MB 480ms 90ms dotnet/aot 9.0.102
csharp 1.cs 585ms 1.6ms 153.7MB 523ms 133ms dotnet/aot 9.0.102
csharp 2.cs 687ms 11ms 142.9MB 637ms 97ms dotnet 9.0.102
csharp 1.cs 740ms 30ms 169.4MB 690ms 120ms dotnet 9.0.102
crystal 1.cr 860ms 29ms 64.1MB 830ms 10ms crystal 1.15.0
csharp 1.cs 1320ms 56ms 146.4MB 1527ms 183ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 135ms 1.9ms 64.0MB 103ms 33ms dotnet/aot 9.0.102
csharp 1.cs 153ms 2.5ms 80.5MB 120ms 43ms dotnet/aot 9.0.102
crystal 1.cr 178ms 4.4ms 22.0MB 160ms 3ms crystal 1.15.0
csharp 1.cs 260ms 7.3ms 69.5MB 233ms 33ms mono 6.12.0
csharp 2.cs 263ms 7.3ms 82.8MB 210ms 47ms dotnet 9.0.102
csharp 1.cs 288ms 18ms 99.0MB 240ms 50ms dotnet 9.0.102

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 2.4ms 3.3MB 330ms 0ms crystal 1.15.0
crystal 2.cr 342ms 1.6ms 3.3MB 330ms 0ms crystal 1.15.0
csharp 9.cs 360ms 2.4ms 34.2MB 340ms 10ms dotnet 9.0.102
csharp 8.cs 370ms 0.4ms 15.7MB 357ms 0ms dotnet/aot 9.0.102
csharp 8.cs 418ms 0.9ms 33.8MB 393ms 10ms dotnet 9.0.102
csharp 8.cs 1246ms 5.3ms 22.4MB 1230ms 0ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.7ms 3.3MB 23ms 0ms crystal 1.15.0
crystal 1.cr 38ms 1.4ms 3.3MB 30ms 0ms crystal 1.15.0
csharp 8.cs 46ms 1.7ms 16.0MB 30ms 0ms dotnet/aot 9.0.102
csharp 9.cs 92ms 1.1ms 34.0MB 77ms 0ms dotnet 9.0.102
csharp 8.cs 105ms 9.8ms 34.0MB 73ms 10ms dotnet 9.0.102
csharp 8.cs 162ms 2.1ms 26.3MB 147ms 3ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 299ms 3.7ms 8.2MB 287ms 0ms crystal 1.15.0
csharp 1.cs 308ms 4.3ms 54.8MB 287ms 10ms dotnet/aot 9.0.102
csharp 1.cs 349ms 1.7ms 70.4MB 323ms 10ms dotnet 9.0.102
csharp 2.cs 396ms 1.6ms 19.9MB 380ms 3ms dotnet/aot 9.0.102
csharp 2.cs 400ms 11ms 38.9MB 370ms 10ms dotnet 9.0.102
crystal 1.cr 419ms 1.3ms 42.8MB 403ms 0ms crystal 1.15.0
csharp 1.cs 535ms 6.8ms 86.0MB 507ms 10ms mono 6.12.0
csharp 2.cs 1874ms 13ms 31.5MB 1860ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 65ms 0.2ms 27.5MB 50ms 3ms dotnet/aot 9.0.102
crystal 2.cr 75ms 1.4ms 4.4MB 67ms 0ms crystal 1.15.0
crystal 1.cr 89ms 2.6ms 13.0MB 77ms 0ms crystal 1.15.0
csharp 1.cs 98ms 1.1ms 45.5MB 73ms 10ms dotnet 9.0.102
csharp 2.cs 102ms 0.7ms 17.8MB 87ms 3ms dotnet/aot 9.0.102
csharp 2.cs 130ms 1.9ms 36.2MB 107ms 7ms dotnet 9.0.102
csharp 1.cs 144ms 1.5ms 40.3MB 127ms 7ms mono 6.12.0
csharp 2.cs 484ms 8.1ms 24.9MB 463ms 3ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1907ms 10ms 6.2MB 1877ms 13ms crystal 1.15.0
csharp 1.cs 3242ms 11ms 19.9MB 3120ms 117ms dotnet/aot 9.0.102
csharp 1.cs 3579ms 48ms 42.2MB 3567ms 147ms dotnet 9.0.102

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 449ms 18ms 5.1MB 430ms 0ms crystal 1.15.0
csharp 1.cs 761ms 6.6ms 19.2MB 713ms 33ms dotnet/aot 9.0.102
csharp 1.cs 996ms 11ms 43.7MB 1077ms 40ms dotnet 9.0.102

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1873ms 37ms 18.4MB 7180ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 1971ms 75ms 38.1MB 7220ms 13ms dotnet 9.0.102
crystal 1.cr 3801ms 27ms 4.4MB 3787ms 0ms crystal 1.15.0
csharp 3-m.cs 4634ms 249ms 30.7MB 17543ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 476ms 1.6ms 18.2MB 1790ms 10ms dotnet/aot 9.0.102
csharp 3-m.cs 542ms 12ms 39.9MB 1870ms 10ms dotnet 9.0.102
crystal 1.cr 955ms 2.5ms 4.3MB 943ms 0ms crystal 1.15.0
csharp 3-m.cs 1203ms 18ms 31.0MB 4483ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 129ms 1.0ms 18.4MB 440ms 7ms dotnet/aot 9.0.102
csharp 3-m.cs 193ms 15ms 36.4MB 497ms 10ms dotnet 9.0.102
crystal 1.cr 245ms 2.9ms 3.8MB 237ms 0ms crystal 1.15.0
csharp 3-m.cs 348ms 2.4ms 26.4MB 1160ms 7ms mono 6.12.0