C++ VS Python benchmarks

Current benchmark data was generated on Mon Apr 14 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 396ms 7.9ms 2.6MB 1530ms 0ms g++ 11.4.0
cpp 1-im.cpp 405ms 5.0ms 4.0MB 1567ms 0ms clang++ 14.0.0-1ubuntu1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 39ms 0.3ms 2.6MB 130ms 0ms g++ 11.4.0
cpp 1-im.cpp 39ms 0.2ms 3.9MB 130ms 0ms clang++ 14.0.0-1ubuntu1.1

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.1ms 0.1ms 1.4MB 0ms 0ms g++ 11.4.0
cpp 1.cpp 1.4ms 0.2ms 2.3MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 11ms 0.9ms 7.8MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 8.6MB 10ms 0ms cpython 3.13.3
python 1.py 28ms 0.4ms 51.6MB 10ms 10ms pypy 3.10.16

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 167ms 0.2ms 1.5MB 160ms 0ms g++ 11.4.0
cpp 0-i.cpp 171ms 0.3ms 2.3MB 160ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 314ms 0.6ms 2.3MB 303ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 314ms 1.5ms 1.8MB 310ms 0ms g++ 11.4.0
python 2.py 1350ms 3.5ms 57.9MB 1327ms 10ms pypy 3.10.16
python 1.py 2654ms 20ms 57.2MB 2627ms 13ms pypy 3.10.16
python 1.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.3
python 2.py timeout 0.0ms 8.9MB 4990ms 0ms cpython 3.13.3
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 19ms 0.1ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 19ms 0.2ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.6ms 2.3MB 27ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.6ms 1.8MB 30ms 0ms g++ 11.4.0
python 2.py 177ms 2.0ms 57.9MB 157ms 10ms pypy 3.10.16
python 1.py 309ms 11ms 57.1MB 287ms 7ms pypy 3.10.16
python 1.py 1009ms 134ms 8.3MB 997ms 0ms pyston 3.8.12
python 2.py 1304ms 5.0ms 8.3MB 1293ms 0ms pyston 3.8.12
python 1.py 2984ms 72ms 8.8MB 2970ms 0ms cpython 3.13.3
python 2.py 3398ms 9.8ms 8.9MB 3387ms 0ms cpython 3.13.3

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 489ms 5.4ms 7.3MB 477ms 0ms g++ 11.4.0
cpp 1.cpp 528ms 1.2ms 7.8MB 520ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 2598ms 14ms 369.5MB 2527ms 60ms pypy 3.10.16
python 2.py 3071ms 19ms 633.0MB 2897ms 157ms pyston 3.8.12
python 1.py 4831ms 76ms 320.4MB 4770ms 47ms pyston 3.8.12
python 1.py timeout 0.0ms 321.3MB 4960ms 27ms cpython 3.13.3
python 2.py timeout 0.0ms 633.8MB 4833ms 150ms cpython 3.13.3
python 2.py timeout 0.0ms 959.7MB 4723ms 260ms pypy 3.10.16

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 120ms 1.2ms 3.6MB 110ms 0ms g++ 11.4.0
cpp 1.cpp 132ms 1.5ms 4.1MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 545ms 16ms 135.2MB 510ms 20ms pypy 3.10.16
python 2.py 746ms 6.9ms 164.2MB 707ms 27ms pyston 3.8.12
python 1.py 1093ms 21ms 86.0MB 1070ms 10ms pyston 3.8.12
python 2.py 1471ms 14ms 165.0MB 1430ms 30ms cpython 3.13.3
python 2.py 1569ms 31ms 290.2MB 1480ms 77ms pypy 3.10.16
python 1.py 2775ms 8.1ms 86.9MB 2750ms 10ms cpython 3.13.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 470ms 3.9ms 3.4MB 1817ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 483ms 0.5ms 2.1MB 1883ms 0ms g++ 11.4.0
cpp 6-im.cpp 927ms 14ms 3.5MB 3627ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 930ms 9.8ms 2.1MB 3640ms 0ms g++ 11.4.0
python 8.py timeout 0.0ms 14.8MB 40ms 7ms cpython 3.13.3
python 8.py timeout 0.0ms 96.8MB 803ms 73ms pypy 3.10.16
python 8.py timeout 0.0ms 14.1MB 33ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 124ms 1.8ms 3.6MB 457ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 127ms 1.2ms 2.0MB 477ms 0ms g++ 11.4.0
cpp 6-im.cpp 237ms 0.4ms 3.4MB 903ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 239ms 0.7ms 2.0MB 917ms 0ms g++ 11.4.0
python 8.py timeout 0.0ms 14.6MB 50ms 10ms cpython 3.13.3
python 8.py timeout 0.0ms 96.2MB 1303ms 180ms pypy 3.10.16
python 8.py timeout 0.0ms 13.7MB 57ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 37ms 1.6ms 3.4MB 110ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 39ms 0.2ms 2.0MB 130ms 0ms g++ 11.4.0
cpp 6-im.cpp 65ms 0.1ms 3.5MB 227ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 68ms 0.6ms 2.0MB 243ms 0ms g++ 11.4.0
python 8-m.py 1955ms 10ms 93.2MB 6330ms 253ms pypy 3.10.16
python 8.py timeout 0.0ms 14.3MB 90ms 13ms cpython 3.13.3
python 8.py timeout 0.0ms 13.1MB 127ms 37ms pyston 3.8.12