Programming Language and compiler
Benchmarks

Crystal VS C# benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1213ms 21ms 132.8MB 1443ms 180ms dotnet/aot 8.0.101
crystal 1.cr 1363ms 1.9ms 64.6MB 1337ms 10ms crystal 1.11.2
csharp 1.cs 1714ms 70ms 109.8MB 1903ms 220ms mono 6.12.0
csharp 1.cs 1868ms 70ms 2126.1MB 710ms 1117ms dotnet 8.0.101

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 92ms 2.7ms 29.1MB 93ms 13ms dotnet/aot 8.0.101
crystal 1.cr 104ms 0.1ms 11.4MB 93ms 0ms crystal 1.11.2
csharp 1.cs 142ms 1.4ms 44.9MB 117ms 13ms mono 6.12.0
csharp 1.cs 283ms 5.7ms 229.7MB 130ms 113ms dotnet 8.0.101

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1546ms 60ms 20.6MB 1490ms 40ms crystal 1.11.2
csharp 1-m.cs 2301ms 32ms 38.5MB 7933ms 73ms dotnet/aot 8.0.101
csharp 1-m.cs 2776ms 120ms 746.6MB 7507ms 713ms dotnet 8.0.101

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 82ms 3.7ms 7.6MB 60ms 13ms crystal 1.11.2
csharp 1-m.cs 159ms 15ms 29.8MB 443ms 20ms dotnet/aot 8.0.101
csharp 1-m.cs 294ms 6.8ms 93.7MB 733ms 47ms dotnet 8.0.101

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 60ms 1.4ms 7.0MB 40ms 7ms crystal 1.11.2
csharp 1.cs 4390ms 10ms 24.9MB 4380ms 7ms dotnet/aot 8.0.101
csharp 1.cs 4615ms 25ms 49.5MB 4570ms 33ms dotnet 8.0.101

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.1ms 5.6MB 10ms 3ms crystal 1.11.2
csharp 1.cs 738ms 1.4ms 21.0MB 730ms 3ms dotnet/aot 8.0.101
csharp 1.cs 848ms 3.6ms 40.1MB 807ms 10ms dotnet 8.0.101

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2458ms 1.6ms 3.3MB 2450ms 0ms crystal 1.11.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 205ms 0.9ms 3.1MB 190ms 0ms crystal 1.11.2

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 133ms 7.9ms 36.2MB 380ms 83ms dotnet/aot 8.0.101
csharp 5-m.cs 205ms 9.6ms 45.3MB 477ms 117ms dotnet 8.0.101
csharp 5-m.cs 262ms 5.6ms 47.9MB 683ms 147ms mono 6.12.0
crystal 2.cr 530ms 2.1ms 3.8MB 430ms 83ms crystal 1.11.2
crystal 1.cr 695ms 1.7ms 14.9MB 580ms 100ms crystal 1.11.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 34ms 1.8ms 27.0MB 50ms 27ms dotnet/aot 8.0.101
crystal 2.cr 57ms 1.0ms 3.6MB 40ms 3ms crystal 1.11.2
crystal 1.cr 74ms 1.2ms 4.8MB 57ms 3ms crystal 1.11.2
csharp 5-m.cs 85ms 10ms 42.7MB 110ms 30ms mono 6.12.0
csharp 5.cs 86ms 6.4ms 42.0MB 83ms 20ms dotnet 8.0.101

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.11.2
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 629ms 6.5ms 119.0MB 820ms 160ms dotnet 8.0.101
csharp 2-m.cs 716ms 35ms 148.5MB 767ms 627ms dotnet 8.0.101
csharp 1-m.cs 846ms 24ms 171.9MB 1123ms 817ms dotnet 8.0.101
csharp 2-http3.cs 857ms 32ms 151.8MB 1227ms 317ms dotnet 8.0.101
crystal 1.cr 3454ms 121ms 214.8MB 293ms 433ms crystal 1.11.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 434ms 9.7ms 98.1MB 387ms 183ms dotnet 8.0.101
csharp 1-m.cs 471ms 12ms 106.5MB 527ms 223ms dotnet 8.0.101
csharp 2-http2.cs 559ms 14ms 95.7MB 530ms 123ms dotnet 8.0.101
csharp 2-http3.cs 622ms 17ms 106.2MB 660ms 150ms dotnet 8.0.101
crystal 1.cr 1157ms 109ms 53.9MB 27ms 77ms crystal 1.11.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 38ms 0.7ms 3.3MB 30ms 0ms crystal 1.11.2
crystal 1.cr 67ms 1.0ms 3.3MB 57ms 0ms crystal 1.11.2
csharp 2.cs 106ms 1.6ms 14.1MB 100ms 0ms dotnet/aot 8.0.101
csharp 2.cs 148ms 4.4ms 23.7MB 133ms 0ms mono 6.12.0
csharp 2.cs 275ms 12ms 32.4MB 233ms 10ms dotnet 8.0.101
csharp 1.cs 1019ms 3.2ms 17.3MB 1010ms 10ms dotnet/aot 8.0.101
csharp 1.cs 1444ms 29ms 163.2MB 1333ms 93ms dotnet 8.0.101
csharp 1.cs 3317ms 12ms 48.3MB 3263ms 47ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 106ms 1.1ms 3.3MB 97ms 0ms crystal 1.11.2
crystal 1.cr 188ms 1.0ms 3.3MB 180ms 0ms crystal 1.11.2
csharp 2.cs 293ms 5.4ms 12.1MB 287ms 0ms dotnet/aot 8.0.101
csharp 2.cs 358ms 4.8ms 27.1MB 347ms 0ms mono 6.12.0
csharp 2.cs 421ms 6.2ms 34.8MB 383ms 10ms dotnet 8.0.101
csharp 1.cs 3057ms 18ms 17.1MB 3037ms 17ms dotnet/aot 8.0.101
csharp 1.cs 3997ms 26ms 422.9MB 3770ms 203ms dotnet 8.0.101
csharp 1.cs timeout 0.0ms 46.4MB 4930ms 60ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 20ms 1.2ms 3.1MB 10ms 0ms crystal 1.11.2
crystal 1.cr 35ms 1.1ms 3.1MB 27ms 0ms crystal 1.11.2
csharp 2.cs 59ms 0.4ms 16.1MB 55ms 5ms dotnet/aot 8.0.101
csharp 2.cs 96ms 0.3ms 25.4MB 83ms 3ms mono 6.12.0
csharp 2.cs 195ms 1.6ms 32.5MB 147ms 13ms dotnet 8.0.101
csharp 1.cs 1709ms 2.4ms 16.9MB 1707ms 0ms dotnet/aot 8.0.101
csharp 1.cs 1719ms 9.1ms 86.6MB 1663ms 33ms dotnet 8.0.101
csharp 1.cs 1812ms 7.4ms 29.2MB 1793ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 373ms 1.3ms 9.5MB 360ms 0ms crystal 1.11.2
csharp 2.cs 666ms 69ms 209.7MB 540ms 90ms dotnet 8.0.101
csharp 1.cs 2059ms 1.7ms 42.1MB 2023ms 10ms dotnet 8.0.101
csharp 3.cs 2491ms 24ms 42.5MB 2443ms 20ms dotnet 8.0.101
csharp 3.cs 2491ms 7.0ms 22.6MB 2487ms 0ms dotnet/aot 8.0.101
csharp 1.cs 3587ms 56ms 22.7MB 3583ms 0ms dotnet/aot 8.0.101
csharp 1.cs timeout 0.0ms 25.1MB 4980ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 20ms 0.3ms 6.0MB 10ms 0ms crystal 1.11.2
csharp 3.cs 116ms 1.6ms 19.4MB 110ms 0ms dotnet/aot 8.0.101
csharp 2.cs 138ms 11ms 46.2MB 103ms 7ms dotnet 8.0.101
csharp 1.cs 160ms 4.9ms 39.4MB 127ms 3ms dotnet 8.0.101
csharp 1.cs 162ms 2.6ms 19.7MB 157ms 3ms dotnet/aot 8.0.101
csharp 3.cs 218ms 31ms 39.6MB 177ms 13ms dotnet 8.0.101
csharp 1.cs 569ms 2.0ms 26.0MB 553ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 520ms 2.4ms 155.2MB 587ms 87ms dotnet/aot 8.0.101
csharp 1.cs 601ms 10ms 107.3MB 693ms 97ms dotnet/aot 8.0.101
crystal 1.cr 928ms 8.2ms 64.6MB 903ms 7ms crystal 1.11.2
csharp 2.cs 1201ms 5.0ms 1295.1MB 493ms 673ms dotnet 8.0.101
csharp 1.cs 1308ms 29ms 144.8MB 1517ms 157ms mono 6.12.0
csharp 1.cs 1565ms 4.3ms 1869.6MB 580ms 943ms dotnet 8.0.101

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 110ms 2.0ms 38.0MB 113ms 17ms dotnet/aot 8.0.101
csharp 1.cs 123ms 1.1ms 48.4MB 130ms 23ms dotnet/aot 8.0.101
crystal 1.cr 171ms 2.6ms 17.6MB 157ms 0ms crystal 1.11.2
csharp 1.cs 262ms 7.9ms 73.9MB 237ms 33ms mono 6.12.0
csharp 2.cs 371ms 4.9ms 305.1MB 183ms 157ms dotnet 8.0.101
csharp 1.cs 441ms 8.6ms 428.5MB 170ms 237ms dotnet 8.0.101

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 0.8ms 3.5MB 330ms 0ms crystal 1.11.2
crystal 2.cr 348ms 10ms 3.5MB 337ms 0ms crystal 1.11.2
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 37ms 0.5ms 3.5MB 27ms 0ms crystal 1.11.2
crystal 1.cr 39ms 1.2ms 3.6MB 30ms 0ms crystal 1.11.2
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 346ms 5.2ms 101.3MB 303ms 10ms dotnet 8.0.101
csharp 1.cs 353ms 5.9ms 55.6MB 340ms 3ms dotnet/aot 8.0.101
crystal 1.cr 380ms 2.1ms 42.7MB 363ms 0ms crystal 1.11.2
crystal 2.cr 381ms 2.1ms 8.4MB 370ms 0ms crystal 1.11.2
csharp 2.cs 427ms 2.0ms 21.2MB 423ms 3ms dotnet/aot 8.0.101
csharp 2.cs 441ms 0.4ms 41.7MB 397ms 13ms dotnet 8.0.101
csharp 1.cs 544ms 3.3ms 86.6MB 520ms 13ms mono 6.12.0
csharp 2.cs 1861ms 11ms 29.9MB 1843ms 0ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 80ms 1.2ms 13.3MB 70ms 0ms crystal 1.11.2
csharp 1.cs 81ms 1.1ms 23.9MB 70ms 7ms dotnet/aot 8.0.101
crystal 2.cr 93ms 0.9ms 4.8MB 80ms 0ms crystal 1.11.2
csharp 2.cs 111ms 0.4ms 18.2MB 110ms 0ms dotnet/aot 8.0.101
csharp 1.cs 114ms 3.7ms 49.8MB 77ms 7ms dotnet 8.0.101
csharp 1.cs 144ms 0.9ms 40.8MB 127ms 7ms mono 6.12.0
csharp 2.cs 153ms 1.7ms 35.4MB 117ms 7ms dotnet 8.0.101
csharp 2.cs 482ms 4.0ms 25.5MB 467ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1944ms 14ms 6.5MB 1910ms 17ms crystal 1.11.2
csharp 1.cs 3233ms 16ms 19.9MB 3110ms 137ms dotnet/aot 8.0.101
csharp 1.cs timeout 0.0ms 4256.5MB 3027ms 1923ms dotnet 8.0.101

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 452ms 10ms 5.4MB 437ms 3ms crystal 1.11.2
csharp 1.cs 760ms 5.7ms 19.4MB 723ms 33ms dotnet/aot 8.0.101
csharp 1.cs 1552ms 36ms 1164.4MB 1013ms 597ms dotnet 8.0.101

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
crystal 1.cr 3743ms 15ms 4.8MB 3727ms 0ms crystal 1.11.2
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
crystal 1.cr 945ms 4.4ms 4.4MB 933ms 0ms crystal 1.11.2
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
crystal 1.cr 238ms 0.1ms 4.1MB 227ms 0ms crystal 1.11.2
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0