Programming Language and compiler
Benchmarks

Go VS Crystal benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1959ms 5.7ms 64.5MB 2317ms 27ms crystal 1.4.1
go 1.go 3203ms 14ms 45.3MB 4650ms 50ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 143ms 1.4ms 12.9MB 150ms 0ms crystal 1.4.1
go 1.go 267ms 12ms 8.2MB 310ms 3ms go 1.18.2
go 1.go 418ms 1.6ms 6.6MB 410ms 0ms tinygo 0.23.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 906ms 100ms 15.3MB 1760ms 0ms go 1.18.2
go 1.go 1828ms 5.3ms 253.7MB 1727ms 87ms tinygo 0.23.0
crystal 1.cr 2268ms 8.4ms 22.3MB 2203ms 47ms crystal 1.4.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 69ms 9.2ms 5.4MB 113ms 0ms go 1.18.2
crystal 1.cr 126ms 3.3ms 7.6MB 110ms 3ms crystal 1.4.1
go 1.go 266ms 2.8ms 68.7MB 227ms 20ms tinygo 0.23.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 74ms 6.3ms 9.1MB 60ms 0ms crystal 1.4.1
go 1.go 164ms 2.5ms 10.0MB 153ms 0ms go 1.18.2

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 28ms 1.1ms 5.3MB 13ms 0ms crystal 1.4.1
go 1.go 49ms 1.5ms 8.1MB 33ms 0ms go 1.18.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1212ms 1.5ms 4.9MB 2340ms 0ms go 1.18.2
go 3.go 2794ms 3.0ms 50.1MB 2770ms 7ms tinygo 0.23.0
crystal 1.cr 4207ms 3.7ms 3.1MB 4190ms 0ms crystal 1.4.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 125ms 1.0ms 4.9MB 190ms 0ms go 1.18.2
go 3.go 320ms 0.8ms 49.9MB 295ms 10ms tinygo 0.23.0
crystal 1.cr 321ms 21ms 5.1MB 307ms 0ms crystal 1.4.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 209ms 1.8ms 2.9MB 370ms 0ms go 1.18.2
crystal 2.cr 757ms 52ms 5.3MB 650ms 90ms crystal 1.4.1
crystal 1.cr 1008ms 2.5ms 14.6MB 893ms 107ms crystal 1.4.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 27ms 0.6ms 2.9MB 33ms 0ms go 1.18.2
crystal 2.cr 80ms 5.6ms 3.6MB 63ms 3ms crystal 1.4.1
crystal 1.cr 106ms 0.8ms 6.7MB 80ms 13ms crystal 1.4.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 1.1ms 0.5ms 0.0MB 0ms 0ms tinygo 0.23.0
go 1.go 3.0ms 0.5ms 2.8MB 0ms 0ms go 1.18.2
crystal 1.cr 3.8ms 0.8ms 2.8MB 0ms 0ms crystal 1.4.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 198ms 6.8ms 60.4MB 297ms 47ms go 1.18.2
go 2-m.go 716ms 81ms 175.4MB 700ms 487ms go 1.18.2
go 1-m.go 720ms 67ms 182.0MB 697ms 463ms go 1.18.2
crystal 1.cr 3786ms 625ms 130.5MB 420ms 280ms crystal 1.4.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 47ms 5.2ms 24.1MB 43ms 13ms go 1.18.2
go 2.go 132ms 20ms 39.0MB 80ms 73ms go 1.18.2
go 1.go 149ms 24ms 38.3MB 87ms 77ms go 1.18.2
crystal 1.cr 1184ms 111ms 35.7MB 50ms 47ms crystal 1.4.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 90ms 1.2ms 44.8MB 70ms 17ms go 1.18.2
go 1.go 178ms 0.5ms 20.6MB 173ms 0ms go 1.18.2

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 413ms 2.5ms 183.4MB 413ms 70ms go 1.18.2
go 1.go 1010ms 46ms 111.0MB 997ms 33ms go 1.18.2

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1376ms 28ms 41.2MB 2520ms 33ms go 1.18.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 229ms 3.1ms 21.3MB 357ms 10ms go 1.18.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 63ms 1.8ms 3.0MB 50ms 0ms crystal 1.4.1
crystal 1.cr 110ms 0.2ms 3.1MB 100ms 0ms crystal 1.4.1
go 3.go 168ms 2.8ms 2.9MB 160ms 0ms go 1.18.2
go 3.go 173ms 0.5ms 0.3MB 160ms 0ms tinygo 0.23.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 176ms 0.2ms 4.9MB 160ms 0ms crystal 1.4.1
crystal 1.cr 323ms 4.4ms 5.1MB 310ms 0ms crystal 1.4.1
go 3.go 490ms 1.6ms 2.9MB 477ms 0ms go 1.18.2
go 3.go 512ms 0.2ms 2.3MB 500ms 0ms tinygo 0.23.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 31ms 2.3ms 3.1MB 20ms 0ms crystal 1.4.1
crystal 1.cr 57ms 1.1ms 5.1MB 47ms 0ms crystal 1.4.1
go 3.go 85ms 0.3ms 0.0MB 77ms 0ms tinygo 0.23.0
go 3.go 88ms 0.8ms 4.1MB 80ms 0ms go 1.18.2

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 882ms 4.1ms 7.6MB 867ms 0ms crystal 1.4.1
go 1.go 3792ms 3.3ms 5.3MB 3777ms 7ms go 1.18.2
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 42ms 0.8ms 4.9MB 30ms 0ms crystal 1.4.1
go 1.go 159ms 0.3ms 2.9MB 150ms 0ms go 1.18.2
go 1.go 329ms 1.8ms 0.0MB 320ms 0ms tinygo 0.23.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1471ms 5.0ms 64.3MB 1713ms 20ms crystal 1.4.1
go 1.go 2139ms 35ms 38.9MB 3060ms 33ms go 1.18.2
go 2.go 2329ms 6.4ms 42.1MB 3320ms 63ms go 1.18.2
go 1.go 4944ms 13ms 212.8MB 4870ms 57ms tinygo 0.23.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 246ms 2.3ms 17.7MB 260ms 13ms crystal 1.4.1
go 1.go 443ms 6.3ms 12.3MB 610ms 10ms go 1.18.2
go 2.go 516ms 13ms 13.4MB 713ms 20ms go 1.18.2
go 1.go 1016ms 1.9ms 39.1MB 993ms 7ms tinygo 0.23.0
go 2.go 1278ms 2.3ms 51.9MB 1257ms 7ms tinygo 0.23.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 443ms 3.4ms 4.8MB 430ms 0ms go 1.18.2
crystal 1.cr 593ms 0.5ms 3.2MB 577ms 0ms crystal 1.4.1
crystal 2.cr 623ms 0.5ms 3.4MB 610ms 0ms crystal 1.4.1
go 1.go 705ms 0.5ms 0.0MB 697ms 0ms tinygo 0.23.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 54ms 2.0ms 2.8MB 43ms 0ms go 1.18.2
crystal 1.cr 65ms 1.7ms 5.0MB 53ms 0ms crystal 1.4.1
crystal 2.cr 67ms 1.8ms 3.2MB 57ms 0ms crystal 1.4.1
go 1.go 74ms 1.3ms 0.0MB 60ms 0ms tinygo 0.23.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 451ms 0.3ms 9.9MB 440ms 0ms crystal 1.4.1
go 2.go 767ms 1.7ms 17.9MB 753ms 0ms tinygo 0.23.0
go 2.go 984ms 7.8ms 19.9MB 977ms 0ms go 1.18.2
go 1.go 1255ms 42ms 73.6MB 1217ms 23ms go 1.18.2
crystal 1.cr 1312ms 19ms 44.1MB 1287ms 7ms crystal 1.4.1
go 1.go 1580ms 44ms 43.9MB 1560ms 7ms tinygo 0.23.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 101ms 0.1ms 6.3MB 90ms 0ms crystal 1.4.1
go 1.go 117ms 2.7ms 22.1MB 100ms 0ms go 1.18.2
crystal 1.cr 140ms 1.0ms 12.9MB 127ms 0ms crystal 1.4.1
go 1.go 148ms 1.5ms 12.9MB 137ms 0ms tinygo 0.23.0
go 2.go 181ms 0.3ms 4.9MB 167ms 0ms tinygo 0.23.0
go 2.go 228ms 0.9ms 7.6MB 213ms 0ms go 1.18.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1276ms 0.8ms 8.5MB 1253ms 7ms go 1.18.2
crystal 1.cr 2792ms 50ms 8.8MB 3063ms 283ms crystal 1.4.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 309ms 2.7ms 8.5MB 290ms 3ms go 1.18.2
crystal 1.cr 645ms 7.0ms 7.5MB 663ms 83ms crystal 1.4.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 2430ms 14ms 18.2MB 2413ms 30ms go 1.18.2
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 151ms 0.9ms 9.4MB 137ms 0ms go 1.18.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 51ms 0.8ms 11.5MB 33ms 0ms go 1.18.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2219ms 4.5ms 5.3MB 4303ms 3ms go 1.18.2
go 1.go 4402ms 2.2ms 5.3MB 4397ms 0ms go 1.18.2
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.4.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 568ms 0.8ms 3.3MB 1077ms 0ms go 1.18.2
go 1.go 1113ms 2.6ms 3.3MB 1097ms 3ms go 1.18.2
crystal 1.cr 1386ms 101ms 6.1MB 1370ms 0ms crystal 1.4.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.23.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 151ms 1.3ms 2.8MB 267ms 0ms go 1.18.2
go 1.go 284ms 0.9ms 2.8MB 270ms 0ms go 1.18.2
crystal 1.cr 381ms 1.7ms 3.8MB 370ms 0ms crystal 1.4.1
go 1.go 1604ms 0.3ms 0.0MB 1590ms 0ms tinygo 0.23.0