Programming Language and compiler
Benchmarks

Julia VS Nim benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.3ms 0.1ms 0.9MB 0ms 0ms nim/clang 1.6.6
nim 1.nim 2.2ms 0.8ms 0.7MB 0ms 0ms nim 1.6.6
julia 1.jl 197ms 0.7ms 187.2MB 124ms 86ms julia 1.8.1
julia 1.jl 205ms 48ms 178.5MB 114ms 86ms julia/aot 1.8.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 405ms 0.6ms 0.9MB 390ms 0ms nim/clang 1.6.6
nim 2.nim 428ms 0.4ms 1.0MB 420ms 0ms nim 1.6.6
julia 7.jl 554ms 1.2ms 180.3MB 510ms 120ms julia/aot 1.8.1
julia 7.jl 715ms 1.2ms 245.9MB 680ms 110ms julia 1.8.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 44ms 0.7ms 1.0MB 30ms 0ms nim/clang 1.6.6
nim 2.nim 46ms 0.3ms 1.0MB 37ms 0ms nim 1.6.6
julia 7.jl 285ms 60ms 182.1MB 203ms 127ms julia/aot 1.8.1
julia 7.jl 405ms 0.7ms 245.8MB 343ms 143ms julia 1.8.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 1.jl 427ms 1.7ms 175.5MB 410ms 97ms julia/aot 1.8.1
julia 1.jl 538ms 1.0ms 220.4MB 510ms 110ms julia 1.8.1
nim 2.nim 588ms 1.5ms 6.8MB 577ms 0ms nim/clang 1.6.6
nim 2.nim 671ms 3.4ms 6.1MB 663ms 0ms nim 1.6.6
nim 1.nim 744ms 0.6ms 40.2MB 727ms 0ms nim 1.6.6
nim 1.nim 824ms 35ms 41.0MB 803ms 3ms nim/clang 1.6.6

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 122ms 2.1ms 11.1MB 110ms 0ms nim 1.6.6
nim 1.nim 129ms 0.4ms 11.4MB 120ms 0ms nim/clang 1.6.6
nim 2.nim 140ms 1.0ms 3.3MB 130ms 0ms nim/clang 1.6.6
nim 2.nim 159ms 1.2ms 2.9MB 150ms 0ms nim 1.6.6
julia 1.jl 239ms 30ms 169.1MB 187ms 87ms julia/aot 1.8.1
julia 1.jl 336ms 1.0ms 211.2MB 310ms 107ms julia 1.8.1

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 1155ms 55ms 258.8MB 1073ms 157ms julia 1.8.1
nim 2.nim 3403ms 74ms 34.2MB 3380ms 3ms nim/clang 1.6.6
nim 2.nim 3563ms 91ms 34.8MB 3533ms 10ms nim 1.6.6

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 4.jl 307ms 1.6ms 240.5MB 250ms 133ms julia 1.8.1
nim 2.nim 320ms 2.8ms 5.7MB 307ms 0ms nim/clang 1.6.6
nim 2.nim 331ms 1.2ms 5.4MB 320ms 0ms nim 1.6.6

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1825ms 22ms 230.2MB 3183ms 130ms julia 1.8.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 555ms 1.4ms 230.5MB 700ms 133ms julia 1.8.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 261ms 0.2ms 0.7MB 250ms 0ms nim 1.6.6
nim 2.nim 338ms 1.1ms 0.9MB 327ms 0ms nim/clang 1.6.6
julia 7-m.jl 636ms 1.4ms 299.2MB 890ms 133ms julia 1.8.1
nim 1.nim 789ms 1.3ms 0.7MB 683ms 93ms nim 1.6.6
nim 1.nim 808ms 1.1ms 0.9MB 697ms 93ms nim/clang 1.6.6

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 31ms 2.5ms 0.7MB 20ms 0ms nim 1.6.6
nim 2.nim 37ms 0.2ms 1.0MB 30ms 0ms nim/clang 1.6.6
nim 1.nim 84ms 0.3ms 1.0MB 67ms 3ms nim/clang 1.6.6
nim 1.nim 84ms 3.1ms 0.7MB 60ms 7ms nim 1.6.6
julia 7.jl 460ms 1.4ms 228.1MB 557ms 113ms julia 1.8.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 1162ms 1.6ms 318.3MB 1493ms 167ms julia 1.8.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 8.jl 817ms 3.9ms 303.8MB 927ms 123ms julia 1.8.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 793ms 3.9ms 196.0MB 767ms 100ms julia 1.8.1
julia 1.jl 1425ms 3.7ms 276.0MB 1337ms 170ms julia 1.8.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 3.jl 349ms 1.4ms 193.8MB 310ms 120ms julia 1.8.1
julia 1.jl 801ms 26ms 277.4MB 707ms 157ms julia 1.8.1
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim 1.6.6
nim 1.nim timeout 0.0ms 0.0MB 0ms 0ms nim/clang 1.6.6

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 1373ms 2.1ms 205.1MB 2407ms 117ms julia 1.8.1
julia 3-m.jl 2069ms 3.9ms 220.3MB 3703ms 130ms julia 1.8.1
nim 1.nim 4122ms 1.4ms 1.9MB 4110ms 0ms nim 1.6.6
nim 1.nim 4122ms 4.1ms 1.8MB 4110ms 0ms nim/clang 1.6.6

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
julia 2-m.jl 582ms 1.2ms 206.8MB 873ms 103ms julia 1.8.1
julia 3-m.jl 795ms 4.6ms 219.1MB 1213ms 120ms julia 1.8.1
nim 1.nim 1033ms 1.0ms 1.0MB 1020ms 0ms nim/clang 1.6.6
nim 1.nim 1033ms 0.4ms 1.0MB 1020ms 0ms nim 1.6.6

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 260ms 0.2ms 1.0MB 250ms 0ms nim/clang 1.6.6
nim 1.nim 261ms 1.2ms 1.0MB 250ms 0ms nim 1.6.6
julia 2-m.jl 385ms 1.0ms 204.8MB 477ms 107ms julia 1.8.1
julia 3.jl 476ms 2.8ms 220.2MB 580ms 130ms julia 1.8.1