Programming Language and compiler
Benchmarks

C VS Python benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 2.1ms 0.3ms 1.0MB 0ms 0ms gcc 12.2.0
c 1.c 3.1ms 1.7ms 0.6MB 0ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 1.c 3.1ms 1.3ms 1.1MB 0ms 0ms clang 11.0.0
python 1.py 13ms 0.7ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 15ms 0.3ms 7.3MB 10ms 0ms cpython 3.10.7
python 1.py 34ms 2.4ms 54.0MB 14ms 6ms pypy 3.8.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 255ms 11ms 23.5MB 407ms 13ms gcc 12.2.0
c 1-m.c 522ms 38ms 20.3MB 827ms 13ms clang 11.0.0
python 3-m.py 3577ms 8.2ms 203.7MB 6277ms 330ms pypy 3.8.13
python 3.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 3.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 34ms 0.8ms 12.7MB 40ms 0ms gcc 12.2.0
c 1.c 64ms 5.5ms 9.7MB 90ms 5ms clang 11.0.0
python 3-m.py 533ms 8.0ms 96.8MB 753ms 123ms pypy 3.8.13
python 3-m.py 594ms 7.7ms 14.8MB 1040ms 37ms pyston 3.8.12
python 3-m.py 864ms 11ms 15.3MB 1557ms 30ms cpython 3.10.7

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 308ms 0.1ms 0.5MB 300ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 5.c 321ms 0.7ms 1.0MB 310ms 0ms gcc 12.2.0
c 5.c 329ms 0.5ms 0.6MB 320ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 2.c 338ms 0.3ms 0.6MB 330ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 8-i.c 346ms 3.0ms 1.1MB 333ms 0ms clang 11.0.0
c 5.c 367ms 0.2ms 1.1MB 357ms 0ms clang 11.0.0
c 8-i.c 367ms 3.6ms 1.0MB 353ms 0ms gcc 12.2.0
c 2.c 415ms 7.0ms 1.0MB 397ms 0ms clang 11.0.0
c 2.c 624ms 0.5ms 1.0MB 610ms 0ms gcc 12.2.0
python 2.py 2065ms 46ms 80.0MB 2033ms 13ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 33ms 0.4ms 0.6MB 27ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 5.c 35ms 1.3ms 1.0MB 23ms 0ms gcc 12.2.0
c 5.c 36ms 0.3ms 0.6MB 27ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 2.c 36ms 0.1ms 0.6MB 30ms 0ms zigcc 0.10.0-dev.4060+61aaef0b0
c 8-i.c 39ms 0.4ms 1.0MB 30ms 0ms gcc 12.2.0
c 5.c 40ms 0.6ms 1.1MB 30ms 0ms clang 11.0.0
c 8-i.c 41ms 3.3ms 1.1MB 30ms 0ms clang 11.0.0
c 2.c 43ms 0.2ms 1.1MB 33ms 0ms clang 11.0.0
c 2.c 65ms 0.8ms 1.0MB 53ms 0ms gcc 12.2.0
python 2.py 269ms 5.8ms 79.6MB 237ms 13ms pypy 3.8.13
python 1.py 583ms 7.9ms 79.4MB 560ms 3ms pypy 3.8.13
python 1.py 1184ms 11ms 7.2MB 1167ms 0ms pyston 3.8.12
python 2.py 1613ms 7.5ms 8.1MB 1600ms 0ms pyston 3.8.12
python 1.py 4703ms 56ms 7.4MB 4687ms 0ms cpython 3.10.7
python 2.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 796ms 36ms 40.1MB 757ms 17ms zigcc 0.10.0-dev.4060+61aaef0b0
c 1.c 812ms 22ms 41.0MB 780ms 10ms gcc 12.2.0
c 1.c 820ms 13ms 40.9MB 773ms 27ms clang 11.0.0
python 1.py 4008ms 8.7ms 391.4MB 3873ms 117ms pypy 3.8.13
python 1.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 1.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 121ms 0.8ms 10.8MB 103ms 7ms zigcc 0.10.0-dev.4060+61aaef0b0
c 1.c 123ms 1.8ms 11.6MB 110ms 0ms clang 11.0.0
c 1.c 124ms 3.2ms 11.9MB 107ms 0ms gcc 12.2.0
python 1.py 1030ms 33ms 215.7MB 967ms 40ms pypy 3.8.13
python 1.py 1868ms 12ms 85.9MB 1830ms 17ms pyston 3.8.12
python 1.py 4326ms 5.5ms 85.9MB 4293ms 20ms cpython 3.10.7

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1397ms 12ms 1.0MB 2733ms 0ms gcc 12.2.0
c 6-im.c 1588ms 6.1ms 1.0MB 3110ms 0ms gcc 12.2.0
c 6-im.c 1722ms 4.5ms 3.0MB 3380ms 0ms clang 11.0.0
c 4-m.c 1749ms 11ms 2.9MB 3420ms 7ms clang 11.0.0
c 5-im.c 1847ms 1.6ms 1.0MB 3633ms 0ms gcc 12.2.0
c 5-im.c 2034ms 11ms 3.1MB 3990ms 0ms clang 11.0.0
c 3-m.c 2218ms 21ms 1.0MB 4350ms 0ms gcc 12.2.0
c 3-m.c 2222ms 12ms 3.2MB 4360ms 0ms clang 11.0.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 358ms 1.4ms 1.0MB 690ms 0ms gcc 12.2.0
c 6-im.c 406ms 1.9ms 1.0MB 780ms 0ms gcc 12.2.0
c 6-im.c 443ms 5.0ms 3.0MB 843ms 0ms clang 11.0.0
c 4-m.c 445ms 2.0ms 3.0MB 853ms 0ms clang 11.0.0
c 5-im.c 473ms 2.7ms 1.0MB 910ms 0ms gcc 12.2.0
c 5-im.c 522ms 9.3ms 3.1MB 1003ms 0ms clang 11.0.0
c 3-m.c 559ms 0.8ms 1.0MB 1087ms 0ms gcc 12.2.0
c 3-m.c 576ms 18ms 3.2MB 1100ms 0ms clang 11.0.0
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 97ms 0.9ms 1.0MB 170ms 0ms gcc 12.2.0
c 6-im.c 110ms 0.9ms 0.9MB 200ms 0ms gcc 12.2.0
c 6-im.c 118ms 0.6ms 3.1MB 210ms 0ms clang 11.0.0
c 4-m.c 121ms 3.1ms 3.1MB 213ms 0ms clang 11.0.0
c 5-im.c 128ms 2.7ms 1.0MB 233ms 0ms gcc 12.2.0
c 5-im.c 139ms 2.4ms 3.1MB 250ms 0ms clang 11.0.0
c 3-m.c 149ms 0.8ms 1.0MB 277ms 0ms gcc 12.2.0
c 3-m.c 153ms 2.3ms 3.2MB 273ms 0ms clang 11.0.0
python 8-m.py 3292ms 24ms 109.1MB 5633ms 357ms pypy 3.8.13
python 8.py timeout 0.0ms 0.0MB 0ms 0ms cpython 3.10.7
python 8.py timeout 0.0ms 0.0MB 0ms 0ms pyston 3.8.12