Programming Language and compiler
Benchmarks

Nim VS Codon benchmarks

Current benchmark data was generated on Sat Nov 16 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 775ms 7.6ms 34.4MB 753ms 3ms nim 2.2.0
nim 2.nim 952ms 0.1ms 34.7MB 933ms 3ms nim/clang 2.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 75ms 1.3ms 5.5MB 60ms 0ms nim 2.2.0
nim 2.nim 93ms 2.7ms 5.8MB 80ms 0ms nim/clang 2.2.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim timeout 0.0ms 548.2MB 2457ms 2090ms nim 2.2.0
nim 1.nim timeout 0.0ms 556.6MB 2397ms 2143ms nim/clang 2.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 4356ms 13ms 518.7MB 2117ms 1810ms nim/clang 2.2.0
nim 1.nim 4483ms 29ms 519.4MB 2187ms 1867ms nim 2.2.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 185ms 1.2ms 1.5MB 170ms 0ms nim 2.2.0
nim 2.nim 237ms 2.1ms 1.8MB 220ms 0ms nim/clang 2.2.0
nim 1.nim 572ms 3.7ms 1.8MB 427ms 130ms nim/clang 2.2.0
nim 1.nim 596ms 1.5ms 1.5MB 473ms 107ms nim 2.2.0

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 21ms 0.6ms 1.5MB 10ms 0ms nim 2.2.0
nim 2.nim 26ms 0.7ms 1.8MB 13ms 0ms nim/clang 2.2.0
nim 1.nim 61ms 0.8ms 1.8MB 47ms 0ms nim/clang 2.2.0
nim 1.nim 63ms 1.0ms 1.5MB 43ms 3ms nim 2.2.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1.1ms 0.0ms 1.9MB 0ms 0ms nim/clang 2.2.0
nim 1.nim 1.2ms 0.1ms 1.6MB 0ms 0ms nim 2.2.0
codon 1.py 4.6ms 0.6ms 7.4MB 0ms 0ms codon 0.17.0

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 995ms 24ms 98.7MB 293ms 673ms nim 2.2.0
nim 1.nim 995ms 19ms 99.1MB 257ms 710ms nim/clang 2.2.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 161ms 1.8ms 18.2MB 33ms 110ms nim 2.2.0
nim 1.nim 163ms 3.0ms 18.3MB 33ms 113ms nim/clang 2.2.0

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 116ms 1.8ms 1.6MB 110ms 0ms nim 2.2.0
nim 2.nim 117ms 0.9ms 1.6MB 110ms 0ms nim/clang 2.2.0
nim 1.nim timeout 0.0ms 1.3MB 4990ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 334ms 3.3ms 1.6MB 323ms 0ms nim/clang 2.2.0
nim 2.nim 338ms 3.9ms 1.4MB 327ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.3MB 4987ms 0ms nim 2.2.0
nim 1.nim timeout 0.0ms 1.5MB 4990ms 0ms nim/clang 2.2.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 50ms 1.5ms 1.5MB 40ms 0ms nim/clang 2.2.0
nim 2.nim 52ms 1.2ms 1.3MB 43ms 0ms nim 2.2.0
nim 1.nim 482ms 6.4ms 1.5MB 477ms 0ms nim/clang 2.2.0
nim 1.nim 492ms 2.4ms 1.3MB 480ms 0ms nim 2.2.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 386ms 0.9ms 4.8MB 377ms 0ms nim/clang 2.2.0
nim 1.nim 577ms 2.3ms 4.5MB 567ms 0ms nim 2.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 19ms 0.6ms 1.9MB 10ms 0ms nim/clang 2.2.0
nim 1.nim 27ms 0.8ms 1.6MB 20ms 0ms nim 2.2.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 560ms 17ms 34.4MB 540ms 0ms nim 2.2.0
nim 1.nim 630ms 12ms 35.2MB 613ms 3ms nim/clang 2.2.0

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 118ms 2.1ms 9.6MB 107ms 0ms nim 2.2.0
nim 1.nim 133ms 5.2ms 9.9MB 120ms 0ms nim/clang 2.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 320ms 1.8ms 1.8MB 310ms 0ms nim 2.2.0
nim 2.nim 340ms 1.1ms 2.0MB 330ms 0ms nim/clang 2.2.0
codon 1.py 1302ms 15ms 7.9MB 1287ms 0ms codon 0.17.0

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 2.nim 35ms 1.2ms 1.8MB 27ms 0ms nim 2.2.0
nim 2.nim 37ms 1.1ms 2.0MB 30ms 0ms nim/clang 2.2.0
codon 1.py 136ms 1.4ms 7.9MB 130ms 0ms codon 0.17.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 270ms 7.2ms 41.5MB 253ms 0ms nim 2.2.0
nim 1.nim 318ms 4.7ms 41.7MB 303ms 0ms nim/clang 2.2.0
codon 1.py 374ms 2.0ms 46.6MB 357ms 0ms codon 0.17.0
codon 2.py 856ms 4.9ms 99.8MB 833ms 20ms codon 0.17.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 54ms 2.7ms 11.5MB 47ms 0ms nim 2.2.0
nim 1.nim 65ms 2.6ms 11.8MB 53ms 0ms nim/clang 2.2.0
codon 1.py 73ms 2.7ms 17.3MB 60ms 0ms codon 0.17.0
codon 2.py 197ms 1.6ms 25.6MB 187ms 3ms codon 0.17.0

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 1625ms 3.5ms 151.9MB 1590ms 13ms nim/clang 2.2.0
nim 1.nim 1649ms 6.6ms 152.1MB 1613ms 20ms nim 2.2.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 172ms 0.2ms 16.8MB 160ms 0ms nim/clang 2.2.0
nim 1.nim 175ms 1.9ms 17.1MB 160ms 0ms nim 2.2.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 3574ms 3.5ms 1.6MB 3563ms 0ms nim/clang 2.2.0
nim 1.nim 3585ms 8.7ms 1.4MB 3577ms 0ms nim 2.2.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 899ms 7.6ms 1.5MB 890ms 0ms nim/clang 2.2.0
nim 1.nim 900ms 3.3ms 1.8MB 890ms 0ms nim 2.2.0

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
nim 1.nim 225ms 0.1ms 1.5MB 210ms 0ms nim/clang 2.2.0
nim 1.nim 228ms 1.4ms 1.3MB 220ms 0ms nim 2.2.0