Programming Language and compiler
Benchmarks

C++ VS Python benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 404ms 2.2ms 4.5MB 1547ms 0ms g++ 11.4.0
cpp 1-im.cpp 408ms 0.7ms 5.9MB 1573ms 0ms clang++ 14.0.0-1ubuntu1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 43ms 1.1ms 7.9MB 130ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1-im.cpp 44ms 0.2ms 4.5MB 140ms 0ms g++ 11.4.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.1ms 0.1ms 1.4MB 0ms 0ms g++ 11.4.0
cpp 1.cpp 1.5ms 0.2ms 2.3MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 12ms 1.2ms 7.6MB 5ms 5ms pyston 3.8.12
python 1.py 15ms 0.3ms 8.5MB 10ms 0ms cpython 3.13.0
python 1.py 29ms 1.5ms 51.0MB 4ms 12ms pypy 3.10.14

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 167ms 0.6ms 1.5MB 157ms 0ms g++ 11.4.0
cpp 0-i.cpp 170ms 0.3ms 2.3MB 160ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 313ms 0.8ms 1.8MB 300ms 0ms g++ 11.4.0
cpp 1.cpp 314ms 1.2ms 2.4MB 303ms 0ms clang++ 14.0.0-1ubuntu1.1
python 2.py 1352ms 14ms 59.8MB 1320ms 17ms pypy 3.10.14
python 1.py 2641ms 30ms 56.6MB 2610ms 13ms pypy 3.10.14
python 1.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.0
python 2.py timeout 0.0ms 8.8MB 4983ms 0ms cpython 3.13.0
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 19ms 0.1ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 20ms 0.2ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 33ms 0.2ms 1.8MB 20ms 0ms g++ 11.4.0
cpp 1.cpp 34ms 0.2ms 2.3MB 27ms 0ms clang++ 14.0.0-1ubuntu1.1
python 2.py 180ms 2.7ms 57.6MB 153ms 10ms pypy 3.10.14
python 1.py 304ms 5.3ms 56.8MB 277ms 10ms pypy 3.10.14
python 1.py 1078ms 255ms 8.3MB 1063ms 0ms pyston 3.8.12
python 2.py 1319ms 15ms 8.1MB 1303ms 0ms pyston 3.8.12
python 1.py 2912ms 17ms 8.8MB 2900ms 0ms cpython 3.13.0
python 2.py 3132ms 41ms 8.8MB 3123ms 0ms cpython 3.13.0

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 486ms 4.6ms 7.3MB 470ms 0ms g++ 11.4.0
cpp 1.cpp 530ms 4.9ms 7.7MB 517ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 2489ms 28ms 369.0MB 2417ms 57ms pypy 3.10.14
python 2.py 2905ms 8.7ms 632.9MB 2723ms 167ms pyston 3.8.12
python 1.py 4843ms 56ms 320.4MB 4783ms 43ms pyston 3.8.12
python 1.py timeout 0.0ms 321.2MB 4963ms 23ms cpython 3.13.0
python 2.py timeout 0.0ms 633.6MB 4813ms 170ms cpython 3.13.0
python 2.py timeout 0.0ms 959.3MB 4733ms 250ms pypy 3.10.14

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 119ms 0.3ms 3.6MB 110ms 0ms g++ 11.4.0
cpp 1.cpp 130ms 0.6ms 4.1MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 540ms 2.4ms 134.6MB 500ms 27ms pypy 3.10.14
python 2.py 709ms 4.9ms 164.2MB 657ms 33ms pyston 3.8.12
python 1.py 1118ms 29ms 86.0MB 1090ms 10ms pyston 3.8.12
python 2.py 1383ms 21ms 164.9MB 1333ms 30ms cpython 3.13.0
python 2.py 1531ms 11ms 289.6MB 1443ms 73ms pypy 3.10.14
python 1.py 2652ms 13ms 86.9MB 2623ms 10ms cpython 3.13.0

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 471ms 1.8ms 5.4MB 1820ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 481ms 1.7ms 4.2MB 1863ms 0ms g++ 11.4.0
cpp 6-im.cpp 926ms 12ms 7.4MB 3607ms 10ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 929ms 8.1ms 4.2MB 3630ms 0ms g++ 11.4.0
python 8.py timeout 0.0ms 16.7MB 53ms 10ms cpython 3.13.0
python 8.py timeout 0.0ms 100.0MB 833ms 137ms pypy 3.10.14
python 8.py timeout 0.0ms 18.2MB 70ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 126ms 0.4ms 7.4MB 450ms 3ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 133ms 6.0ms 4.1MB 487ms 0ms g++ 11.4.0
cpp 6-im.cpp 240ms 3.2ms 7.4MB 900ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 240ms 0.9ms 4.1MB 907ms 3ms g++ 11.4.0
python 8.py timeout 0.0ms 16.4MB 93ms 30ms cpython 3.13.0
python 8.py timeout 0.0ms 99.8MB 1533ms 517ms pypy 3.10.14
python 8.py timeout 0.0ms 17.5MB 140ms 33ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 38ms 0.8ms 9.1MB 110ms 3ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 39ms 0.5ms 4.0MB 123ms 0ms g++ 11.4.0
cpp 6-im.cpp 67ms 0.2ms 7.4MB 220ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 79ms 17ms 4.0MB 260ms 0ms g++ 11.4.0
python 8-m.py 1973ms 18ms 95.1MB 6307ms 370ms pypy 3.10.14
python 8.py timeout 0.0ms 16.1MB 277ms 40ms cpython 3.13.0
python 8.py timeout 0.0ms 17.3MB 397ms 113ms pyston 3.8.12