Programming Language and compiler
Benchmarks

Crystal VS C# benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 942ms 23ms 178.5MB 930ms 140ms dotnet/aot 9.0.100
csharp 1.cs 1121ms 32ms 206.4MB 1067ms 147ms dotnet 9.0.100
crystal 1.cr 1357ms 14ms 64.3MB 1337ms 10ms crystal 1.14.0
csharp 1.cs 1708ms 66ms 101.6MB 1907ms 207ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 3.0ms 11.1MB 93ms 0ms crystal 1.14.0
csharp 1.cs 122ms 3.4ms 41.6MB 83ms 27ms dotnet/aot 9.0.100
csharp 1.cs 143ms 1.2ms 46.1MB 117ms 17ms mono 6.12.0
csharp 1.cs 196ms 4.9ms 59.9MB 153ms 33ms dotnet 9.0.100

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1420ms 28ms 20.1MB 1340ms 63ms crystal 1.14.0
csharp 1-m.cs 2081ms 50ms 67.5MB 7203ms 80ms dotnet/aot 9.0.100
csharp 1-m.cs 2673ms 129ms 80.2MB 9237ms 100ms dotnet 9.0.100

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 78ms 1.8ms 7.5MB 50ms 10ms crystal 1.14.0
csharp 1-m.cs 165ms 8.7ms 31.4MB 450ms 13ms dotnet/aot 9.0.100
csharp 1-m.cs 290ms 22ms 49.2MB 813ms 13ms dotnet 9.0.100

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 59ms 1.0ms 6.6MB 43ms 0ms crystal 1.14.0
csharp 1.cs 4073ms 4.1ms 24.1MB 4040ms 17ms dotnet/aot 9.0.100
csharp 1.cs 4945ms 5.6ms 43.9MB 4920ms 13ms dotnet 9.0.100

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.5ms 5.4MB 10ms 0ms crystal 1.14.0
csharp 1.cs 677ms 0.3ms 20.4MB 657ms 3ms dotnet/aot 9.0.100
csharp 1.cs 917ms 60ms 40.2MB 887ms 20ms dotnet 9.0.100

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2479ms 10ms 3.0MB 2467ms 0ms crystal 1.14.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 206ms 2.2ms 3.0MB 190ms 0ms crystal 1.14.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 137ms 6.7ms 44.9MB 370ms 110ms dotnet/aot 9.0.100
csharp 5-m.cs 193ms 4.9ms 51.1MB 457ms 133ms dotnet 9.0.100
csharp 5-m.cs 248ms 3.8ms 55.4MB 683ms 97ms mono 6.12.0
crystal 2.cr 539ms 2.5ms 3.4MB 407ms 113ms crystal 1.14.0
crystal 1.cr 727ms 0.8ms 14.7MB 597ms 120ms crystal 1.14.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 27ms 0.5ms 24.8MB 37ms 13ms dotnet/aot 9.0.100
crystal 2.cr 59ms 1.6ms 3.4MB 40ms 3ms crystal 1.14.0
csharp 5-m.cs 61ms 1.8ms 44.5MB 77ms 20ms dotnet 9.0.100
csharp 5-m.cs 70ms 1.9ms 44.3MB 100ms 20ms mono 6.12.0
crystal 1.cr 77ms 1.6ms 4.5MB 50ms 10ms crystal 1.14.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.14.0
csharp 1.cs 9.1ms 5.6ms 15.6MB 0ms 0ms dotnet/aot 9.0.100
csharp 1.cs 31ms 0.9ms 23.4MB 20ms 0ms mono 6.12.0
csharp 1.cs 35ms 0.6ms 32.3MB 20ms 6ms dotnet 9.0.100

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 545ms 8.9ms 120.8MB 720ms 160ms dotnet 9.0.100
csharp 2-m.cs 682ms 35ms 144.9MB 717ms 573ms dotnet 9.0.100
csharp 2-http3.cs 706ms 29ms 160.4MB 1150ms 260ms dotnet 9.0.100
csharp 1-m.cs 827ms 39ms 188.6MB 1083ms 753ms dotnet 9.0.100
crystal 1.cr 2213ms 195ms 186.4MB 290ms 500ms crystal 1.14.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 422ms 13ms 98.9MB 373ms 207ms dotnet 9.0.100
csharp 1-m.cs 466ms 7.7ms 109.6MB 507ms 263ms dotnet 9.0.100
csharp 2-http2.cs 468ms 11ms 98.5MB 490ms 93ms dotnet 9.0.100
csharp 2-http3.cs 521ms 1.4ms 107.2MB 587ms 127ms dotnet 9.0.100
crystal 1.cr 1222ms 100ms 53.8MB 27ms 83ms crystal 1.14.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 36ms 0.9ms 3.1MB 23ms 0ms crystal 1.14.0
crystal 1.cr 65ms 0.9ms 3.1MB 53ms 0ms crystal 1.14.0
csharp 2.cs 95ms 2.1ms 13.7MB 80ms 3ms dotnet/aot 9.0.100
csharp 2.cs 150ms 1.1ms 23.2MB 140ms 0ms mono 6.12.0
csharp 2.cs 249ms 2.0ms 35.6MB 230ms 10ms dotnet 9.0.100
csharp 1.cs 1058ms 2.9ms 16.9MB 1037ms 7ms dotnet/aot 9.0.100
csharp 1.cs 1361ms 146ms 36.7MB 1350ms 10ms dotnet 9.0.100
csharp 1.cs 3309ms 45ms 47.6MB 3260ms 43ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 100ms 0.6ms 3.1MB 90ms 0ms crystal 1.14.0
crystal 1.cr 183ms 1.6ms 3.1MB 170ms 0ms crystal 1.14.0
csharp 2.cs 265ms 1.2ms 13.6MB 250ms 0ms dotnet/aot 9.0.100
csharp 2.cs 357ms 1.6ms 26.6MB 343ms 0ms mono 6.12.0
csharp 2.cs 401ms 4.2ms 35.5MB 380ms 13ms dotnet 9.0.100
csharp 1.cs 3169ms 19ms 17.0MB 3133ms 20ms dotnet/aot 9.0.100
csharp 1.cs 3580ms 13ms 39.1MB 3560ms 20ms dotnet 9.0.100
csharp 1.cs timeout 0.0ms 45.8MB 4940ms 43ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 19ms 1.1ms 3.0MB 10ms 0ms crystal 1.14.0
crystal 1.cr 30ms 1.0ms 3.0MB 20ms 0ms crystal 1.14.0
csharp 2.cs 54ms 0.7ms 13.5MB 37ms 3ms dotnet/aot 9.0.100
csharp 2.cs 99ms 9.0ms 26.8MB 90ms 0ms mono 6.12.0
csharp 2.cs 163ms 2.9ms 35.6MB 137ms 17ms dotnet 9.0.100
csharp 1.cs 1613ms 13ms 38.5MB 1600ms 13ms dotnet 9.0.100
csharp 1.cs 1805ms 4.2ms 16.9MB 1787ms 3ms dotnet/aot 9.0.100
csharp 1.cs 1806ms 4.7ms 30.7MB 1790ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 314ms 1.8ms 9.2MB 303ms 0ms crystal 1.14.0
csharp 2.cs 1057ms 66ms 45.8MB 1033ms 13ms dotnet 9.0.100
csharp 1.cs 2046ms 9.1ms 42.7MB 2030ms 3ms dotnet 9.0.100
csharp 3.cs 2461ms 4.0ms 43.0MB 2433ms 7ms dotnet 9.0.100
csharp 3.cs 2516ms 11ms 22.3MB 2497ms 0ms dotnet/aot 9.0.100
csharp 1.cs 3557ms 10ms 22.4MB 3540ms 3ms dotnet/aot 9.0.100
csharp 1.cs timeout 0.0ms 22.4MB 4990ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 18ms 0.3ms 6.3MB 10ms 0ms crystal 1.14.0
csharp 3.cs 117ms 2.9ms 19.2MB 100ms 3ms dotnet/aot 9.0.100
csharp 2.cs 129ms 4.2ms 43.1MB 107ms 10ms dotnet 9.0.100
csharp 1.cs 138ms 2.3ms 39.5MB 120ms 7ms dotnet 9.0.100
csharp 1.cs 156ms 1.7ms 19.3MB 150ms 0ms dotnet/aot 9.0.100
csharp 3.cs 177ms 13ms 40.1MB 147ms 7ms dotnet 9.0.100
csharp 1.cs 573ms 2.0ms 23.9MB 553ms 7ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 543ms 7.0ms 124.9MB 480ms 93ms dotnet/aot 9.0.100
csharp 1.cs 598ms 27ms 152.8MB 520ms 123ms dotnet/aot 9.0.100
csharp 2.cs 679ms 13ms 140.7MB 630ms 100ms dotnet 9.0.100
csharp 1.cs 754ms 16ms 173.0MB 683ms 140ms dotnet 9.0.100
crystal 1.cr 804ms 11ms 81.7MB 773ms 13ms crystal 1.14.0
csharp 1.cs 1318ms 93ms 142.6MB 1553ms 177ms mono 6.12.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 135ms 1.1ms 66.2MB 107ms 30ms dotnet/aot 9.0.100
csharp 1.cs 149ms 4.0ms 80.6MB 110ms 47ms dotnet/aot 9.0.100
crystal 1.cr 160ms 0.7ms 22.4MB 140ms 3ms crystal 1.14.0
csharp 2.cs 256ms 2.6ms 84.5MB 213ms 53ms dotnet 9.0.100
csharp 1.cs 264ms 7.8ms 69.4MB 230ms 40ms mono 6.12.0
csharp 1.cs 274ms 1.4ms 99.3MB 243ms 57ms dotnet 9.0.100

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 342ms 2.6ms 3.4MB 327ms 0ms crystal 1.14.0
crystal 1.cr 344ms 2.9ms 3.4MB 333ms 0ms crystal 1.14.0
csharp 9.cs 358ms 1.2ms 34.0MB 347ms 0ms dotnet 9.0.100
csharp 8.cs 371ms 1.4ms 15.8MB 360ms 0ms dotnet/aot 9.0.100
csharp 8.cs 424ms 8.4ms 33.8MB 397ms 10ms dotnet 9.0.100
csharp 8.cs 1247ms 5.7ms 24.3MB 1230ms 7ms mono 6.12.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 38ms 0.2ms 3.4MB 27ms 0ms crystal 1.14.0
crystal 2.cr 39ms 0.3ms 3.4MB 30ms 0ms crystal 1.14.0
csharp 8.cs 45ms 1.6ms 15.8MB 30ms 0ms dotnet/aot 9.0.100
csharp 9.cs 93ms 1.7ms 33.7MB 77ms 7ms dotnet 9.0.100
csharp 8.cs 94ms 0.7ms 33.7MB 73ms 10ms dotnet 9.0.100
csharp 8.cs 165ms 1.7ms 24.4MB 150ms 0ms mono 6.12.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 304ms 5.3ms 57.4MB 280ms 7ms dotnet/aot 9.0.100
csharp 1.cs 348ms 16ms 70.3MB 307ms 20ms dotnet 9.0.100
crystal 2.cr 351ms 1.7ms 8.4MB 340ms 0ms crystal 1.14.0
crystal 1.cr 373ms 4.3ms 43.0MB 357ms 0ms crystal 1.14.0
csharp 2.cs 401ms 5.9ms 40.2MB 370ms 10ms dotnet 9.0.100
csharp 2.cs 424ms 1.2ms 21.9MB 403ms 7ms dotnet/aot 9.0.100
csharp 1.cs 542ms 6.6ms 86.0MB 517ms 10ms mono 6.12.0
csharp 2.cs 1867ms 11ms 31.7MB 1850ms 7ms mono 6.12.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 67ms 0.9ms 23.9MB 50ms 0ms dotnet/aot 9.0.100
crystal 1.cr 79ms 1.1ms 13.3MB 70ms 0ms crystal 1.14.0
crystal 2.cr 87ms 1.7ms 4.6MB 80ms 0ms crystal 1.14.0
csharp 1.cs 99ms 1.6ms 43.2MB 73ms 17ms dotnet 9.0.100
csharp 2.cs 109ms 0.4ms 17.8MB 97ms 0ms dotnet/aot 9.0.100
csharp 2.cs 132ms 12ms 34.2MB 100ms 10ms dotnet 9.0.100
csharp 1.cs 145ms 2.5ms 41.9MB 130ms 3ms mono 6.12.0
csharp 2.cs 483ms 1.3ms 23.1MB 470ms 0ms mono 6.12.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2001ms 13ms 6.4MB 1953ms 30ms crystal 1.14.0
csharp 1.cs 3199ms 6.2ms 19.7MB 3087ms 107ms dotnet/aot 9.0.100
csharp 1.cs 3600ms 78ms 44.2MB 3597ms 130ms dotnet 9.0.100

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 451ms 17ms 5.2MB 433ms 0ms crystal 1.14.0
csharp 1.cs 751ms 1.3ms 19.6MB 710ms 30ms dotnet/aot 9.0.100
csharp 1.cs 991ms 26ms 44.0MB 1090ms 37ms dotnet 9.0.100

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1872ms 21ms 18.3MB 7233ms 7ms dotnet/aot 9.0.100
csharp 3-m.cs 1919ms 8.5ms 39.9MB 7290ms 23ms dotnet 9.0.100
crystal 1.cr 3898ms 25ms 4.6MB 3887ms 0ms crystal 1.14.0
csharp 3-m.cs 4604ms 45ms 26.8MB 17770ms 10ms mono 6.12.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 497ms 35ms 18.3MB 1783ms 3ms dotnet/aot 9.0.100
csharp 3-m.cs 530ms 1.5ms 37.9MB 1857ms 20ms dotnet 9.0.100
crystal 1.cr 981ms 2.7ms 4.5MB 967ms 0ms crystal 1.14.0
csharp 3-m.cs 1290ms 128ms 25.6MB 4493ms 13ms mono 6.12.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 130ms 0.9ms 18.3MB 437ms 0ms dotnet/aot 9.0.100
csharp 3-m.cs 178ms 2.3ms 36.4MB 500ms 7ms dotnet 9.0.100
crystal 1.cr 251ms 3.2ms 4.0MB 240ms 0ms crystal 1.14.0
csharp 3-m.cs 346ms 0.2ms 28.4MB 1153ms 13ms mono 6.12.0