Programming Language and compiler
Benchmarks

Odin VS Python benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1.9ms 0.9ms 0.9MB 0ms 0ms odin 2022
python 1.py 14ms 0.8ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 0.6ms 7.6MB 10ms 0ms cpython 3.10.7
python 1.py 32ms 0.6ms 54.9MB 16ms 2ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 149ms 4.0ms 1.8MB 140ms 0ms odin 2022
python 2.py 206ms 8.8ms 80.0MB 177ms 13ms pypy 3.8.13
python 1.py 239ms 0.8ms 81.1MB 213ms 13ms pypy 3.8.13
python 1.py 980ms 3.6ms 9.0MB 963ms 0ms pyston 3.8.12
python 2.py 1155ms 3.7ms 8.7MB 1140ms 0ms pyston 3.8.12
python 1.py 1854ms 29ms 8.4MB 1843ms 0ms cpython 3.10.7
python 2.py 2594ms 29ms 8.3MB 2583ms 0ms cpython 3.10.7

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 435ms 4.8ms 1.8MB 427ms 0ms odin 2022
python 2.py 469ms 1.8ms 80.3MB 437ms 13ms pypy 3.8.13
python 1.py 509ms 5.6ms 81.5MB 490ms 7ms pypy 3.8.13
python 1.py 2897ms 7.1ms 9.0MB 2880ms 0ms pyston 3.8.12
python 2.py 3450ms 16ms 8.7MB 3437ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 66ms 0.3ms 0.9MB 60ms 0ms odin 2022
python 2.py 147ms 2.5ms 80.0MB 120ms 10ms pypy 3.8.13
python 1.py 162ms 1.0ms 81.0MB 130ms 20ms pypy 3.8.13
python 1.py 477ms 4.2ms 8.7MB 457ms 0ms pyston 3.8.12
python 2.py 540ms 4.5ms 8.2MB 527ms 0ms pyston 3.8.12
python 1.py 869ms 9.9ms 7.9MB 857ms 0ms cpython 3.10.7
python 2.py 1253ms 11ms 7.3MB 1237ms 0ms cpython 3.10.7

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1583ms 4.0ms 4.5MB 1573ms 0ms odin 2022

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 68ms 0.6ms 0.8MB 60ms 0ms odin 2022

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 1898ms 18ms 79.9MB 1873ms 10ms pypy 3.8.13
odin 1.odin 2504ms 2.8ms 0.9MB 2493ms 0ms odin 2022
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 249ms 3.9ms 79.8MB 220ms 10ms pypy 3.8.13
odin 1.odin 254ms 0.9ms 0.8MB 240ms 0ms odin 2022
python 1.py 560ms 16ms 79.4MB 523ms 13ms pypy 3.8.13
python 1.py 1195ms 5.3ms 8.3MB 1180ms 0ms pyston 3.8.12
python 2.py 1583ms 1.2ms 8.2MB 1570ms 0ms pyston 3.8.12
python 1.py 4606ms 4.4ms 7.2MB 4597ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 731ms 17ms 40.6MB 703ms 10ms odin 2022
odin 2.odin 1218ms 9.6ms 6.4MB 1207ms 3ms odin 2022
python 1.py 3979ms 12ms 391.6MB 3850ms 110ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 123ms 0.6ms 11.3MB 110ms 0ms odin 2022
odin 2.odin 304ms 3.0ms 2.8MB 293ms 0ms odin 2022
python 1.py 985ms 51ms 215.7MB 930ms 37ms pypy 3.8.13
python 1.py 1795ms 29ms 86.0MB 1750ms 27ms pyston 3.8.12
python 1.py 4178ms 13ms 85.9MB 4140ms 23ms cpython 3.10.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 4495ms 0.6ms 2.8MB 4483ms 0ms odin 2022
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 1127ms 0.6ms 2.1MB 1117ms 0ms odin 2022
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
odin 1.odin 284ms 1.0ms 1.8MB 273ms 0ms odin 2022
python 8-m.py 3224ms 95ms 109.9MB 5487ms 373ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12