Acton VS Python benchmarks

Current benchmark data was generated on Fri Dec 09 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 548ms 11ms 7.4MB 487ms 43ms actonc 0.14.2
python 1.py 588ms 0.8ms 78.8MB 563ms 7ms pypy 3.9.15
python 1.py 1402ms 0.8ms 10.1MB 1390ms 0ms cpython 3.11.1
python 1.py 2296ms 0.6ms 9.7MB 2280ms 3ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 162ms 0.8ms 73.3MB 133ms 13ms pypy 3.9.15
acton 1.act 202ms 1.2ms 5.3MB 183ms 3ms actonc 0.14.2
python 1.py 261ms 0.9ms 9.3MB 247ms 0ms cpython 3.11.1
python 1.py 402ms 0.7ms 9.0MB 387ms 0ms pyston 3.8.12

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
acton 1.act 5.2ms 3.9ms 3.1MB 0ms 0ms actonc 0.14.2
python 1.py 13ms 1.1ms 8.5MB 10ms 0ms cpython 3.11.1
python 1.py 14ms 2.5ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 33ms 0.8ms 52.8MB 14ms 8ms pypy 3.9.15

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2406ms 1.8ms 9.4MB 2360ms 30ms cpython 3.11.1
python 4.py 2409ms 0.6ms 9.1MB 2380ms 10ms pyston 3.8.12
python 4.py 2424ms 38ms 125.1MB 2353ms 57ms pypy 3.9.15
acton 1.act 4902ms 85ms 7.8MB 4477ms 777ms actonc 0.14.2

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 576ms 1.8ms 9.2MB 560ms 0ms cpython 3.11.1
python 4.py 576ms 3.1ms 8.8MB 560ms 0ms pyston 3.8.12
python 4.py 609ms 2.8ms 77.3MB 573ms 17ms pypy 3.9.15
acton 1.act 1475ms 7.3ms 6.4MB 1327ms 277ms actonc 0.14.2