Programming Language and compiler
Benchmarks

Elixir VS Python benchmarks

Current benchmark data was generated on Mon Oct 03 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1089ms 26ms 197.1MB 1007ms 63ms pypy 3.8.13
elixir 1.ex 4662ms 52ms 53.9MB 4710ms 103ms elixir 13.1.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 276ms 9.7ms 95.5MB 233ms 20ms pypy 3.8.13
elixir 1.ex 503ms 6.1ms 48.1MB 523ms 57ms elixir 13.1.0
python 1.py 936ms 4.7ms 16.9MB 913ms 3ms pyston 3.8.12
python 1.py 989ms 23ms 17.1MB 967ms 0ms cpython 3.10.7

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 825ms 3.2ms 88.0MB 797ms 10ms pypy 3.8.13
python 1.py 1668ms 0.6ms 9.3MB 1650ms 3ms cpython 3.10.7
python 1.py 2780ms 0.6ms 9.6MB 2763ms 0ms pyston 3.8.12
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 212ms 0.7ms 81.9MB 187ms 10ms pypy 3.8.13
python 1.py 307ms 0.8ms 8.5MB 293ms 0ms cpython 3.10.7
python 1.py 479ms 0.5ms 8.9MB 463ms 0ms pyston 3.8.12
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 14ms 0.8ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 0.6ms 7.6MB 10ms 0ms cpython 3.10.7
python 1.py 32ms 0.6ms 54.9MB 16ms 2ms pypy 3.8.13
elixir 1.ex 214ms 2.3ms 46.4MB 238ms 32ms elixir 13.1.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2593ms 5.4ms 119.3MB 2537ms 43ms pypy 3.8.13
python 4.py 2770ms 1.9ms 8.6MB 2733ms 20ms cpython 3.10.7
python 4.py 2779ms 1.2ms 9.0MB 2740ms 20ms pyston 3.8.12
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 652ms 5.0ms 84.5MB 630ms 10ms pypy 3.8.13
python 4.py 657ms 1.0ms 8.6MB 640ms 0ms pyston 3.8.12
python 4.py 661ms 1.8ms 8.3MB 650ms 0ms cpython 3.10.7
elixir 1.ex 1309ms 14ms 48.0MB 1340ms 137ms elixir 13.1.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8-m.py 3224ms 95ms 109.9MB 5487ms 373ms pypy 3.8.13
elixir 1.ex timeout 0.0ms 0.0MB 0ms 0ms elixir 13.1.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12