Pony VS Python benchmarks

Current benchmark data was generated on Fri May 20 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1667ms 61ms 273.7MB 1530ms 110ms pypy 3.8.13
pony 1.pony 1898ms 22ms 2224.4MB 1343ms 597ms ponyc 0.50.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 128ms 2.2ms 82.9MB 83ms 20ms pypy 3.8.13
pony 1.pony 150ms 1.4ms 214.4MB 123ms 37ms ponyc 0.50.0
python 1.py 641ms 4.3ms 12.3MB 610ms 13ms pyston 3.8.12
python 1.py 1532ms 2.7ms 11.8MB 1517ms 0ms cpython 3.10.4

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 4.5ms 0.4ms 8.4MB 0ms 0ms ponyc 0.50.0
python 1.py 14ms 1.1ms 7.6MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.6ms 7.5MB 10ms 0ms cpython 3.10.4
python 1.py 34ms 1.1ms 53.6MB 10ms 10ms pypy 3.8.13

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 204ms 2.0ms 79.9MB 160ms 23ms pypy 3.8.13
python 1.py 244ms 0.9ms 81.2MB 217ms 10ms pypy 3.8.13
python 1.py 1052ms 3.9ms 9.3MB 1040ms 0ms pyston 3.8.12
python 2.py 1290ms 15ms 9.0MB 1277ms 0ms pyston 3.8.12
python 1.py 1848ms 8.2ms 8.3MB 1830ms 0ms cpython 3.10.4
python 2.py 2609ms 24ms 8.3MB 2597ms 0ms cpython 3.10.4
pony 1.pony timeout 0.0ms 0.0MB 0ms 0ms ponyc 0.50.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 470ms 1.2ms 80.1MB 443ms 10ms pypy 3.8.13
python 1.py 513ms 2.9ms 81.2MB 490ms 10ms pypy 3.8.13
python 1.py 3126ms 28ms 9.3MB 3117ms 0ms pyston 3.8.12
python 2.py 3831ms 16ms 9.1MB 3817ms 0ms pyston 3.8.12
pony 1.pony timeout 0.0ms 0.0MB 0ms 0ms ponyc 0.50.0
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 147ms 0.7ms 80.0MB 117ms 13ms pypy 3.8.13
python 1.py 164ms 1.1ms 80.8MB 137ms 13ms pypy 3.8.13
python 1.py 519ms 1.1ms 9.0MB 503ms 0ms pyston 3.8.12
python 2.py 597ms 5.7ms 8.5MB 583ms 0ms pyston 3.8.12
python 1.py 868ms 2.3ms 7.8MB 857ms 0ms cpython 3.10.4
python 2.py 1256ms 4.4ms 7.4MB 1240ms 0ms cpython 3.10.4
pony 1.pony 2666ms 0.5ms 36.7MB 2783ms 13ms ponyc 0.50.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 427ms 1.0ms 6.6MB 423ms 3ms ponyc 0.50.0
python 2.py 2186ms 36ms 79.8MB 2157ms 13ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
pony 1.pony 48ms 3.2ms 2.5MB 40ms 0ms ponyc 0.50.0
python 2.py 282ms 2.1ms 79.5MB 257ms 10ms pypy 3.8.13
python 1.py 590ms 2.3ms 79.7MB 563ms 10ms pypy 3.8.13
python 1.py 1463ms 3.4ms 8.6MB 1450ms 0ms pyston 3.8.12
python 2.py 2152ms 28ms 8.5MB 2140ms 0ms pyston 3.8.12
python 1.py 4709ms 32ms 7.3MB 4693ms 0ms cpython 3.10.4
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.4