Programming Language and compiler
Benchmarks

Julia VS Crystal benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2.9ms 0.7ms 2.9MB 0ms 0ms crystal 1.7.2
julia 1.jl 211ms 11ms 166.7MB 103ms 110ms julia/aot 1.8.5
julia 1.jl 226ms 7.5ms 171.7MB 130ms 104ms julia 1.8.5

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 547ms 0.9ms 3.0MB 537ms 0ms crystal 1.7.2
julia 7.jl 551ms 2.0ms 168.3MB 490ms 147ms julia/aot 1.8.5
crystal 2.cr 575ms 6.4ms 2.9MB 563ms 0ms crystal 1.7.2
julia 7.jl 716ms 7.3ms 223.4MB 647ms 150ms julia 1.8.5

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 60ms 0.5ms 2.9MB 50ms 0ms crystal 1.7.2
crystal 1.cr 60ms 1.8ms 2.9MB 50ms 0ms crystal 1.7.2
julia 7.jl 271ms 3.4ms 170.4MB 197ms 143ms julia/aot 1.8.5
julia 7.jl 435ms 3.0ms 225.1MB 367ms 150ms julia 1.8.5

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 439ms 1.7ms 156.1MB 383ms 140ms julia/aot 1.8.5
crystal 2.cr 441ms 2.4ms 7.8MB 423ms 0ms crystal 1.7.2
julia 1.jl 557ms 3.6ms 201.2MB 487ms 153ms julia 1.8.5
crystal 1.cr 1153ms 37ms 42.3MB 1130ms 10ms crystal 1.7.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 97ms 0.5ms 4.1MB 90ms 0ms crystal 1.7.2
crystal 1.cr 149ms 0.7ms 12.8MB 140ms 0ms crystal 1.7.2
julia 1.jl 240ms 0.8ms 150.3MB 173ms 107ms julia/aot 1.8.5
julia 1.jl 361ms 2.5ms 197.4MB 303ms 143ms julia 1.8.5

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1231ms 4.7ms 241.4MB 1120ms 197ms julia 1.8.5
crystal 1.cr 2277ms 6.4ms 64.1MB 2247ms 20ms crystal 1.7.2

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 166ms 2.6ms 10.9MB 153ms 0ms crystal 1.7.2
julia 4.jl 343ms 1.7ms 219.2MB 270ms 157ms julia 1.8.5

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1676ms 9.2ms 211.9MB 2847ms 160ms julia 1.8.5
crystal 1.cr 3751ms 1.7ms 3.0MB 3737ms 0ms crystal 1.7.2

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 304ms 0.8ms 2.9MB 290ms 0ms crystal 1.7.2
julia 2-m.jl 562ms 2.3ms 209.7MB 690ms 153ms julia 1.8.5

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 7-m.jl 676ms 2.2ms 302.8MB 877ms 187ms julia 1.8.5
crystal 2.cr 725ms 2.3ms 3.2MB 637ms 73ms crystal 1.7.2
crystal 1.cr 963ms 1.4ms 14.6MB 850ms 100ms crystal 1.7.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 76ms 0.3ms 3.3MB 60ms 0ms crystal 1.7.2
crystal 1.cr 101ms 0.7ms 4.6MB 77ms 10ms crystal 1.7.2
julia 7.jl 501ms 1.6ms 221.6MB 617ms 130ms julia 1.8.5

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 1218ms 8.6ms 273.9MB 1553ms 187ms julia 1.8.5

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 846ms 13ms 267.0MB 930ms 153ms julia 1.8.5

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 722ms 3.3ms 176.1MB 667ms 140ms julia 1.8.5
julia 1.jl 1553ms 16ms 260.9MB 1447ms 190ms julia 1.8.5
crystal 1.cr 2850ms 21ms 7.5MB 2820ms 17ms crystal 1.7.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 354ms 0.7ms 174.9MB 277ms 163ms julia 1.8.5
crystal 1.cr 614ms 9.2ms 5.3MB 587ms 10ms crystal 1.7.2
julia 1.jl 916ms 52ms 260.0MB 790ms 187ms julia 1.8.5

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1237ms 1.0ms 193.9MB 2083ms 140ms julia 1.8.5
julia 3-m.jl 2142ms 2.6ms 211.2MB 3783ms 160ms julia 1.8.5
crystal 1.cr timeout 0.0ms 4.0MB 4983ms 0ms crystal 1.7.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 571ms 2.5ms 192.3MB 777ms 147ms julia 1.8.5
julia 3-m.jl 855ms 17ms 210.0MB 1257ms 160ms julia 1.8.5
crystal 1.cr 1524ms 1.0ms 3.8MB 1507ms 0ms crystal 1.7.2

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 385ms 0.4ms 3.8MB 373ms 0ms crystal 1.7.2
julia 2.jl 408ms 1.0ms 194.4MB 473ms 127ms julia 1.8.5
julia 3.jl 519ms 5.1ms 210.5MB 603ms 167ms julia 1.8.5