C++ VS Python benchmarks

Current benchmark data was generated on Mon Mar 31 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 395ms 1.4ms 2.6MB 1530ms 0ms g++ 11.4.0
cpp 1-im.cpp 401ms 9.4ms 3.9MB 1550ms 0ms clang++ 14.0.0-1ubuntu1.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1-im.cpp 41ms 1.0ms 3.9MB 130ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1-im.cpp 43ms 4.4ms 2.4MB 137ms 0ms g++ 11.4.0

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 1.1ms 0.1ms 1.4MB 0ms 0ms g++ 11.4.0
cpp 1.cpp 1.4ms 0.1ms 2.3MB 0ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 11ms 0.5ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.0ms 8.6MB 10ms 0ms cpython 3.13.2
python 1.py 29ms 1.1ms 51.6MB 10ms 10ms pypy 3.10.16

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 167ms 0.5ms 1.5MB 160ms 0ms g++ 11.4.0
cpp 0-i.cpp 171ms 0.4ms 2.3MB 160ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 314ms 0.9ms 1.8MB 307ms 0ms g++ 11.4.0
cpp 1.cpp 316ms 1.6ms 2.3MB 310ms 0ms clang++ 14.0.0-1ubuntu1.1
python 2.py 1353ms 7.7ms 60.3MB 1330ms 10ms pypy 3.10.16
python 1.py 2647ms 8.4ms 57.2MB 2623ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.6MB 4990ms 0ms cpython 3.13.2
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 0-i.cpp 19ms 0.1ms 1.5MB 10ms 0ms g++ 11.4.0
cpp 0-i.cpp 19ms 0.0ms 2.3MB 10ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.5ms 2.3MB 27ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 1.cpp 34ms 0.9ms 1.8MB 30ms 0ms g++ 11.4.0
python 2.py 182ms 1.3ms 58.1MB 160ms 10ms pypy 3.10.16
python 1.py 299ms 2.7ms 57.1MB 280ms 10ms pypy 3.10.16
python 1.py 932ms 16ms 8.3MB 920ms 0ms pyston 3.8.12
python 2.py 1282ms 11ms 8.3MB 1270ms 0ms pyston 3.8.12
python 1.py 2968ms 4.6ms 8.8MB 2953ms 0ms cpython 3.13.2
python 2.py 3214ms 99ms 8.8MB 3200ms 0ms cpython 3.13.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 481ms 2.1ms 7.3MB 470ms 0ms g++ 11.4.0
cpp 1.cpp 527ms 0.7ms 7.7MB 517ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 2527ms 58ms 369.5MB 2457ms 57ms pypy 3.10.16
python 2.py 3022ms 8.2ms 633.0MB 2873ms 137ms pyston 3.8.12
python 1.py 4719ms 120ms 320.4MB 4657ms 50ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4960ms 27ms cpython 3.13.2
python 2.py timeout 0.0ms 633.6MB 4843ms 143ms cpython 3.13.2
python 2.py timeout 0.0ms 959.8MB 4730ms 260ms pypy 3.10.16

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 1.cpp 119ms 0.6ms 3.6MB 110ms 0ms g++ 11.4.0
cpp 1.cpp 131ms 0.7ms 4.1MB 120ms 0ms clang++ 14.0.0-1ubuntu1.1
python 1.py 524ms 3.5ms 135.2MB 490ms 20ms pypy 3.10.16
python 2.py 734ms 1.6ms 164.2MB 697ms 27ms pyston 3.8.12
python 1.py 1045ms 7.6ms 86.0MB 1023ms 10ms pyston 3.8.12
python 2.py 1423ms 16ms 164.8MB 1380ms 30ms cpython 3.13.2
python 2.py 1530ms 19ms 290.2MB 1440ms 77ms pypy 3.10.16
python 1.py 2661ms 20ms 86.8MB 2640ms 10ms cpython 3.13.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 469ms 0.5ms 3.5MB 1817ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 492ms 15ms 2.1MB 1897ms 0ms g++ 11.4.0
cpp 6-im.cpp 921ms 2.1ms 3.4MB 3610ms 3ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 922ms 0.6ms 2.1MB 3630ms 0ms g++ 11.4.0
python 8.py timeout 0.0ms 14.9MB 40ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 95.4MB 790ms 77ms pypy 3.10.16
python 8.py timeout 0.0ms 14.2MB 37ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 125ms 0.9ms 3.4MB 453ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 8-m.cpp 129ms 1.9ms 2.0MB 483ms 0ms g++ 11.4.0
cpp 6-im.cpp 240ms 2.2ms 2.0MB 923ms 0ms g++ 11.4.0
cpp 6-im.cpp 244ms 7.1ms 3.4MB 920ms 0ms clang++ 14.0.0-1ubuntu1.1
python 8.py timeout 0.0ms 14.4MB 43ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 96.7MB 1313ms 177ms pypy 3.10.16
python 8.py timeout 0.0ms 13.7MB 53ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
cpp 8-m.cpp 40ms 0.9ms 2.0MB 130ms 0ms g++ 11.4.0
cpp 8-m.cpp 41ms 5.0ms 3.4MB 117ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 66ms 0.6ms 3.4MB 227ms 0ms clang++ 14.0.0-1ubuntu1.1
cpp 6-im.cpp 68ms 1.1ms 2.0MB 243ms 0ms g++ 11.4.0
python 8-m.py 1974ms 19ms 92.9MB 6383ms 260ms pypy 3.10.16
python 8.py timeout 0.0ms 14.0MB 90ms 20ms cpython 3.13.2
python 8.py timeout 0.0ms 13.1MB 123ms 37ms pyston 3.8.12