Programming Language and compiler
Benchmarks

Crystal VS Go benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1363ms 1.9ms 64.6MB 1337ms 10ms crystal 1.11.2
go 1-m.go 2665ms 13ms 44.2MB 5553ms 47ms go 1.21.6
go 1.go 4172ms 25ms 51.6MB 4157ms 3ms tinygo 0.30.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 104ms 0.1ms 11.4MB 93ms 0ms crystal 1.11.2
go 1-m.go 237ms 1.8ms 7.8MB 393ms 3ms go 1.21.6
go 1.go 316ms 4.0ms 6.6MB 307ms 0ms tinygo 0.30.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 464ms 54ms 15.4MB 1767ms 0ms go 1.21.6
crystal 1.cr 1546ms 60ms 20.6MB 1490ms 40ms crystal 1.11.2
go 1.go 2438ms 2.9ms 256.6MB 2400ms 23ms tinygo 0.30.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 39ms 4.8ms 7.2MB 127ms 0ms go 1.21.6
crystal 1.cr 82ms 3.7ms 7.6MB 60ms 13ms crystal 1.11.2
go 1.go 387ms 1.7ms 65.8MB 373ms 0ms tinygo 0.30.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 60ms 1.4ms 7.0MB 40ms 7ms crystal 1.11.2
go 1.go 119ms 0.4ms 10.2MB 110ms 0ms go 1.21.6

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 23ms 1.1ms 5.6MB 10ms 3ms crystal 1.11.2
go 1.go 35ms 1.4ms 8.3MB 27ms 0ms go 1.21.6

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 720ms 0.8ms 3.3MB 2777ms 0ms go 1.21.6
go 3.go 2326ms 13ms 49.0MB 2310ms 3ms tinygo 0.30.0
crystal 1.cr 2458ms 1.6ms 3.3MB 2450ms 0ms crystal 1.11.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 75ms 0.3ms 5.3MB 203ms 0ms go 1.21.6
crystal 1.cr 205ms 0.9ms 3.1MB 190ms 0ms crystal 1.11.2
go 3.go 509ms 2.2ms 49.0MB 493ms 3ms tinygo 0.30.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 123ms 0.2ms 5.3MB 370ms 0ms go 1.21.6
crystal 2.cr 530ms 2.1ms 3.8MB 430ms 83ms crystal 1.11.2
crystal 1.cr 695ms 1.7ms 14.9MB 580ms 100ms crystal 1.11.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 17ms 0.4ms 5.3MB 30ms 0ms go 1.21.6
crystal 2.cr 57ms 1.0ms 3.6MB 40ms 3ms crystal 1.11.2
crystal 1.cr 74ms 1.2ms 4.8MB 57ms 3ms crystal 1.11.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 0.6ms 0.1ms 0.1MB 0ms 0ms tinygo 0.30.0
go 1.go 1.5ms 0.1ms 3.1MB 0ms 0ms go 1.21.6
crystal 1.cr 2.2ms 0.2ms 3.1MB 0ms 0ms crystal 1.11.2

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 121ms 6.0ms 59.4MB 300ms 103ms go 1.21.6
go 2-m.go 445ms 7.9ms 175.9MB 593ms 670ms go 1.21.6
go 1-m.go 454ms 8.3ms 167.7MB 667ms 603ms go 1.21.6
crystal 1.cr 3454ms 121ms 214.8MB 293ms 433ms crystal 1.11.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 25ms 14ms 25.4MB 50ms 30ms go 1.21.6
go 2-m.go 111ms 29ms 33.9MB 87ms 83ms go 1.21.6
go 1-m.go 112ms 8.6ms 38.1MB 97ms 97ms go 1.21.6
crystal 1.cr 1157ms 109ms 53.9MB 27ms 77ms crystal 1.11.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 38ms 0.7ms 3.3MB 30ms 0ms crystal 1.11.2
crystal 1.cr 67ms 1.0ms 3.3MB 57ms 0ms crystal 1.11.2
go 3.go 128ms 1.8ms 3.3MB 120ms 0ms go 1.21.6
go 3.go 135ms 4.0ms 0.3MB 127ms 0ms tinygo 0.30.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 106ms 1.1ms 3.3MB 97ms 0ms crystal 1.11.2
crystal 1.cr 188ms 1.0ms 3.3MB 180ms 0ms crystal 1.11.2
go 3.go 371ms 1.4ms 3.3MB 360ms 0ms go 1.21.6
go 3.go 388ms 1.8ms 2.3MB 380ms 0ms tinygo 0.30.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 20ms 1.2ms 3.1MB 10ms 0ms crystal 1.11.2
crystal 1.cr 35ms 1.1ms 3.1MB 27ms 0ms crystal 1.11.2
go 3.go 63ms 0.8ms 3.1MB 53ms 0ms go 1.21.6
go 3.go 71ms 5.8ms 0.1MB 63ms 0ms tinygo 0.30.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 373ms 1.3ms 9.5MB 360ms 0ms crystal 1.11.2
go 1.go 3215ms 5.5ms 7.3MB 3203ms 3ms go 1.21.6
go 1.go 4022ms 4.0ms 5.8MB 4013ms 0ms tinygo 0.30.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 20ms 0.3ms 6.0MB 10ms 0ms crystal 1.11.2
go 1.go 138ms 2.8ms 3.3MB 127ms 0ms go 1.21.6
go 1.go 168ms 2.2ms 0.3MB 160ms 0ms tinygo 0.30.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 928ms 8.2ms 64.6MB 903ms 7ms crystal 1.11.2
go 1-m.go 1632ms 20ms 39.1MB 3303ms 47ms go 1.21.6
go 2-m.go 1860ms 6.1ms 41.4MB 3863ms 37ms go 1.21.6
go 1.go 2314ms 36ms 51.7MB 2297ms 7ms tinygo 0.30.0
go 2.go 3797ms 21ms 119.4MB 3773ms 7ms tinygo 0.30.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 171ms 2.6ms 17.6MB 157ms 0ms crystal 1.11.2
go 1-m.go 365ms 1.8ms 13.8MB 710ms 13ms go 1.21.6
go 2-m.go 409ms 1.0ms 13.8MB 820ms 20ms go 1.21.6
go 1.go 445ms 1.4ms 13.8MB 433ms 0ms tinygo 0.30.0
go 2.go 684ms 10ms 39.5MB 670ms 0ms tinygo 0.30.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 342ms 0.8ms 3.5MB 330ms 0ms crystal 1.11.2
crystal 2.cr 348ms 10ms 3.5MB 337ms 0ms crystal 1.11.2
go 1.go 348ms 1.1ms 2.1MB 340ms 0ms tinygo 0.30.0
go 1.go 364ms 0.9ms 3.3MB 350ms 0ms go 1.21.6

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 36ms 0.1ms 0.1MB 30ms 0ms tinygo 0.30.0
crystal 2.cr 37ms 0.5ms 3.5MB 27ms 0ms crystal 1.11.2
crystal 1.cr 39ms 1.2ms 3.6MB 30ms 0ms crystal 1.11.2
go 1.go 39ms 0.2ms 3.3MB 30ms 0ms go 1.21.6

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 311ms 4.6ms 72.5MB 297ms 0ms go 1.21.6
go 1.go 331ms 2.1ms 42.8MB 320ms 0ms tinygo 0.30.0
crystal 1.cr 380ms 2.1ms 42.7MB 363ms 0ms crystal 1.11.2
crystal 2.cr 381ms 2.1ms 8.4MB 370ms 0ms crystal 1.11.2
go 2.go 437ms 5.1ms 17.8MB 427ms 0ms tinygo 0.30.0
go 2.go 740ms 3.8ms 21.7MB 723ms 3ms go 1.21.6

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 62ms 1.2ms 21.6MB 47ms 0ms go 1.21.6
go 1.go 66ms 1.0ms 12.6MB 53ms 0ms tinygo 0.30.0
crystal 1.cr 80ms 1.2ms 13.3MB 70ms 0ms crystal 1.11.2
crystal 2.cr 93ms 0.9ms 4.8MB 80ms 0ms crystal 1.11.2
go 2.go 110ms 2.0ms 4.6MB 100ms 0ms tinygo 0.30.0
go 2.go 181ms 1.7ms 7.2MB 170ms 0ms go 1.21.6

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1129ms 7.4ms 8.4MB 1110ms 7ms go 1.21.6
crystal 1.cr 1944ms 14ms 6.5MB 1910ms 17ms crystal 1.11.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 271ms 3.7ms 8.5MB 257ms 3ms go 1.21.6
crystal 1.cr 452ms 10ms 5.4MB 437ms 3ms crystal 1.11.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 1911ms 7.7ms 5.3MB 7327ms 0ms go 1.21.6
go 1.go 3639ms 25ms 5.4MB 3630ms 0ms go 1.21.6
crystal 1.cr 3743ms 15ms 4.8MB 3727ms 0ms crystal 1.11.2
go 1.go timeout 0.0ms 2.4MB 4990ms 0ms tinygo 0.30.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 479ms 0.9ms 5.3MB 1817ms 3ms go 1.21.6
go 1.go 928ms 8.2ms 3.3MB 923ms 0ms go 1.21.6
crystal 1.cr 945ms 4.4ms 4.4MB 933ms 0ms crystal 1.11.2
go 1.go 1394ms 5.3ms 0.4MB 1383ms 0ms tinygo 0.30.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 126ms 1.3ms 5.3MB 437ms 0ms go 1.21.6
go 1.go 236ms 5.1ms 3.3MB 223ms 0ms go 1.21.6
crystal 1.cr 238ms 0.1ms 4.1MB 227ms 0ms crystal 1.11.2
go 1.go 349ms 0.4ms 0.3MB 340ms 0ms tinygo 0.30.0