Programming Language and compiler
Benchmarks

Go VS Crystal benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1532ms 4.2ms 64.5MB 1837ms 13ms crystal 1.5.1
go 1.go 2979ms 18ms 45.5MB 4293ms 50ms go 1.19.1
go 1.go 4141ms 20ms 38.9MB 4123ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 132ms 0.9ms 11.1MB 133ms 3ms crystal 1.5.1
go 1.go 256ms 1.9ms 8.2MB 337ms 3ms go 1.19.1
go 1.go 305ms 2.0ms 6.0MB 290ms 0ms tinygo 0.25.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 774ms 126ms 13.6MB 1500ms 0ms go 1.19.1
go 1.go 1695ms 3.7ms 257.3MB 1643ms 33ms tinygo 0.25.0
crystal 1.cr 1933ms 16ms 20.5MB 1897ms 23ms crystal 1.5.1

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-m.go 66ms 16ms 5.4MB 107ms 0ms go 1.19.1
crystal 1.cr 108ms 3.8ms 9.3MB 97ms 0ms crystal 1.5.1
go 1.go 270ms 1.9ms 64.5MB 250ms 10ms tinygo 0.25.0

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 83ms 1.3ms 7.4MB 73ms 0ms crystal 1.5.1
go 1.go 168ms 3.8ms 8.2MB 157ms 0ms go 1.19.1

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 1.0ms 5.2MB 20ms 0ms crystal 1.5.1
go 1.go 52ms 0.2ms 8.2MB 37ms 3ms go 1.19.1

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 1455ms 14ms 5.0MB 2800ms 0ms go 1.19.1
go 3.go 2939ms 3.9ms 49.9MB 2913ms 7ms tinygo 0.25.0
crystal 1.cr 3968ms 1.9ms 4.9MB 3953ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 147ms 1.4ms 5.0MB 217ms 3ms go 1.19.1
go 3.go 311ms 0.3ms 50.1MB 290ms 10ms tinygo 0.25.0
crystal 1.cr 323ms 1.9ms 3.0MB 310ms 0ms crystal 1.5.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3-m.go 241ms 1.5ms 2.9MB 447ms 0ms go 1.19.1
crystal 2.cr 860ms 0.8ms 3.6MB 753ms 93ms crystal 1.5.1
crystal 1.cr 1071ms 23ms 14.7MB 917ms 137ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 3.go 31ms 1.5ms 2.9MB 40ms 0ms go 1.19.1
crystal 2.cr 91ms 2.6ms 3.6MB 67ms 7ms crystal 1.5.1
crystal 1.cr 110ms 0.6ms 6.4MB 87ms 10ms crystal 1.5.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 2.4ms 2.4ms 0.0MB 0ms 0ms tinygo 0.25.0
go 1.go 2.7ms 0.2ms 2.9MB 0ms 0ms go 1.19.1
crystal 1.cr 3.0ms 0.8ms 3.1MB 0ms 0ms crystal 1.5.1

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 180ms 17ms 60.5MB 263ms 47ms go 1.19.1
go 2-m.go 614ms 113ms 179.5MB 590ms 367ms go 1.19.1
go 1-m.go 704ms 12ms 186.5MB 727ms 440ms go 1.19.1
crystal 1.cr 3452ms 67ms 120.4MB 307ms 273ms crystal 1.5.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1-http2.go 29ms 16ms 22.8MB 35ms 15ms go 1.19.1
go 1.go 124ms 9.9ms 38.8MB 90ms 37ms go 1.19.1
go 2.go 125ms 16ms 39.1MB 73ms 57ms go 1.19.1
crystal 1.cr 1170ms 104ms 35.0MB 43ms 40ms crystal 1.5.1

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 72ms 4.2ms 44.2MB 57ms 10ms go 1.19.1
go 1.go 177ms 0.9ms 18.8MB 163ms 3ms go 1.19.1

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 2-ffi.go 406ms 4.5ms 182.2MB 360ms 120ms go 1.19.1
go 1.go 1037ms 3.0ms 102.8MB 1020ms 43ms go 1.19.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 1518ms 53ms 38.8MB 2787ms 30ms go 1.19.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 7-m.go 226ms 5.6ms 22.4MB 367ms 13ms go 1.19.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 61ms 0.1ms 3.1MB 50ms 0ms crystal 1.5.1
crystal 1.cr 108ms 3.9ms 3.1MB 100ms 0ms crystal 1.5.1
go 3.go 166ms 1.0ms 0.3MB 160ms 0ms tinygo 0.25.0
go 3.go 174ms 2.3ms 4.8MB 160ms 0ms go 1.19.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 174ms 1.0ms 3.1MB 163ms 0ms crystal 1.5.1
crystal 1.cr 312ms 1.1ms 5.0MB 300ms 0ms crystal 1.5.1
go 3.go 490ms 1.3ms 2.0MB 480ms 0ms tinygo 0.25.0
go 3.go 512ms 1.0ms 2.8MB 500ms 0ms go 1.19.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 0-unsafe.cr 30ms 0.9ms 3.1MB 20ms 0ms crystal 1.5.1
crystal 1.cr 55ms 0.8ms 3.1MB 47ms 0ms crystal 1.5.1
go 3.go 81ms 1.1ms 0.0MB 70ms 0ms tinygo 0.25.0
go 3.go 93ms 2.6ms 6.1MB 83ms 0ms go 1.19.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 995ms 1.1ms 7.5MB 980ms 0ms crystal 1.5.1
go 1.go 4115ms 9.8ms 7.4MB 4107ms 0ms go 1.19.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 46ms 0.8ms 6.5MB 40ms 0ms crystal 1.5.1
go 1.go 173ms 2.0ms 2.8MB 163ms 0ms go 1.19.1
go 1.go 246ms 0.5ms 0.0MB 233ms 0ms tinygo 0.25.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1058ms 30ms 66.1MB 1223ms 13ms crystal 1.5.1
go 1.go 1925ms 30ms 40.0MB 2697ms 50ms go 1.19.1
go 2.go 2277ms 32ms 41.4MB 3220ms 33ms go 1.19.1
go 1.go 3090ms 7.1ms 159.9MB 3043ms 27ms tinygo 0.25.0
go 2.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 202ms 6.2ms 17.5MB 213ms 7ms crystal 1.5.1
go 1.go 408ms 1.4ms 12.4MB 560ms 7ms go 1.19.1
go 2.go 480ms 2.4ms 14.3MB 663ms 17ms go 1.19.1
go 1.go 811ms 0.9ms 39.4MB 793ms 3ms tinygo 0.25.0
go 2.go 1365ms 7.7ms 51.8MB 1343ms 3ms tinygo 0.25.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 454ms 2.6ms 2.9MB 440ms 0ms go 1.19.1
crystal 1.cr 509ms 0.5ms 4.9MB 500ms 0ms crystal 1.5.1
crystal 2.cr 541ms 1.0ms 3.0MB 530ms 0ms crystal 1.5.1
go 1.go 843ms 0.3ms 0.0MB 833ms 0ms tinygo 0.25.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 1.go 49ms 2.2ms 2.9MB 40ms 0ms go 1.19.1
crystal 1.cr 55ms 0.9ms 3.1MB 47ms 0ms crystal 1.5.1
crystal 2.cr 60ms 2.6ms 2.9MB 50ms 0ms crystal 1.5.1
go 1.go 87ms 1.4ms 2.0MB 80ms 0ms tinygo 0.25.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 468ms 0.8ms 8.0MB 457ms 0ms crystal 1.5.1
go 1.go 614ms 8.2ms 71.7MB 587ms 10ms go 1.19.1
go 2.go 621ms 1.4ms 17.4MB 610ms 0ms tinygo 0.25.0
go 1.go 649ms 24ms 42.8MB 637ms 0ms tinygo 0.25.0
crystal 1.cr 726ms 51ms 44.8MB 703ms 3ms crystal 1.5.1
go 2.go 909ms 0.8ms 19.8MB 890ms 7ms go 1.19.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 109ms 0.9ms 6.4MB 90ms 0ms crystal 1.5.1
go 1.go 126ms 0.4ms 12.8MB 117ms 0ms tinygo 0.25.0
go 1.go 132ms 1.7ms 22.1MB 120ms 0ms go 1.19.1
go 2.go 146ms 1.2ms 5.1MB 140ms 0ms tinygo 0.25.0
crystal 1.cr 151ms 0.5ms 14.9MB 140ms 0ms crystal 1.5.1
go 2.go 219ms 1.7ms 7.3MB 200ms 3ms go 1.19.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 1418ms 0.7ms 10.5MB 1403ms 0ms go 1.19.1
crystal 1.cr 2755ms 38ms 6.8MB 3000ms 277ms crystal 1.5.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 8.go 339ms 1.7ms 10.2MB 327ms 0ms go 1.19.1
crystal 1.cr 639ms 4.2ms 7.2MB 660ms 73ms crystal 1.5.1

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2465ms 3.9ms 195.7MB 2400ms 50ms crystal 1.5.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 254ms 1.5ms 22.9MB 233ms 3ms crystal 1.5.1
go 3.go 2469ms 6.8ms 22.0MB 2450ms 20ms go 1.19.1
go 3.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 171ms 1.2ms 10.0MB 160ms 3ms go 1.19.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 0-ffi.go 56ms 1.0ms 10.2MB 43ms 0ms go 1.19.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 2504ms 30ms 5.4MB 4837ms 0ms go 1.19.1
go 1.go 4900ms 5.4ms 5.5MB 4893ms 0ms go 1.19.1
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
go 1.go timeout 0.0ms 0.0MB 0ms 0ms tinygo 0.25.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 629ms 1.6ms 2.9MB 1193ms 3ms go 1.19.1
go 1.go 1229ms 2.2ms 2.9MB 1217ms 0ms go 1.19.1
crystal 1.cr 1510ms 2.7ms 5.9MB 1497ms 0ms crystal 1.5.1
go 1.go 2576ms 1.1ms 0.0MB 2563ms 0ms tinygo 0.25.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
go 4-m.go 167ms 1.5ms 2.9MB 300ms 0ms go 1.19.1
go 1.go 310ms 2.0ms 2.9MB 300ms 0ms go 1.19.1
crystal 1.cr 381ms 0.4ms 5.6MB 370ms 0ms crystal 1.5.1
go 1.go 647ms 0.3ms 0.0MB 640ms 0ms tinygo 0.25.0