Programming Language and compiler
Benchmarks

C VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.1ms 0.1ms 1.4MB 0ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 1.c 1.3ms 0.1ms 2.1MB 0ms 0ms gcc 13.2.0
c 1.c 1.5ms 0.3ms 2.1MB 0ms 0ms clang 14.0.0-1ubuntu1.1
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 174ms 4.0ms 25.5MB 410ms 7ms gcc 13.2.0
c 1-m.c 306ms 28ms 29.7MB 1020ms 30ms clang 14.0.0-1ubuntu1.1
python 3-m.py 2331ms 35ms 135.9MB 7750ms 343ms pypy 3.10.13
python 3-m.py 3289ms 49ms 34.2MB 12493ms 123ms pyston 3.8.12
python 3.py timeout 0.0ms 35.9MB 87ms 27ms cpython 3.12.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 28ms 1.9ms 13.4MB 63ms 0ms gcc 13.2.0
c 1-m.c 41ms 4.7ms 16.8MB 107ms 7ms clang 14.0.0-1ubuntu1.1
python 3-m.py 404ms 0.9ms 17.7MB 1333ms 70ms pyston 3.8.12
python 3-m.py 409ms 2.6ms 71.4MB 1023ms 163ms pypy 3.10.13
python 3-m.py 694ms 3.6ms 17.5MB 2423ms 80ms cpython 3.12.1

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 245ms 0.5ms 1.5MB 233ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 8-i.c 255ms 1.1ms 2.3MB 243ms 0ms gcc 13.2.0
c 5.c 297ms 0.4ms 1.5MB 287ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 8-i.c 301ms 1.9ms 2.1MB 290ms 0ms clang 14.0.0-1ubuntu1.1
c 2.c 309ms 0.5ms 2.3MB 300ms 0ms gcc 13.2.0
c 2.c 311ms 1.1ms 1.5MB 300ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 5.c 311ms 1.0ms 2.3MB 300ms 0ms gcc 13.2.0
c 5.c 314ms 1.5ms 2.1MB 303ms 0ms clang 14.0.0-1ubuntu1.1
c 2.c 318ms 3.6ms 2.1MB 303ms 0ms clang 14.0.0-1ubuntu1.1
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 27ms 0.1ms 1.5MB 20ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 8-i.c 28ms 0.5ms 2.3MB 20ms 0ms gcc 13.2.0
c 5.c 32ms 0.4ms 1.5MB 20ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 2.c 33ms 0.3ms 2.3MB 23ms 0ms gcc 13.2.0
c 8-i.c 33ms 1.6ms 2.1MB 27ms 0ms clang 14.0.0-1ubuntu1.1
c 5.c 33ms 0.5ms 2.3MB 27ms 0ms gcc 13.2.0
c 2.c 34ms 0.8ms 1.5MB 27ms 0ms zigcc 0.12.0-dev.2341+92211135f
c 2.c 34ms 0.9ms 2.1MB 27ms 0ms clang 14.0.0-1ubuntu1.1
c 5.c 34ms 1.1ms 2.1MB 27ms 0ms clang 14.0.0-1ubuntu1.1
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 283ms 1.3ms 41.1MB 267ms 0ms gcc 13.2.0
c 1.c 287ms 7.5ms 40.8MB 273ms 0ms clang 14.0.0-1ubuntu1.1
c 1.c 295ms 2.4ms 40.3MB 273ms 3ms zigcc 0.12.0-dev.2341+92211135f
python 2.py 3061ms 79ms 632.9MB 2887ms 157ms pyston 3.8.12
python 1.py 3479ms 37ms 366.2MB 3410ms 50ms pypy 3.10.13
python 1.py 4862ms 92ms 320.5MB 4807ms 47ms pyston 3.8.12
python 2.py 4871ms 47ms 634.1MB 4697ms 160ms cpython 3.12.1
python 1.py timeout 0.0ms 321.7MB 4963ms 23ms cpython 3.12.1
python 2.py timeout 0.0ms 956.8MB 4737ms 247ms pypy 3.10.13

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 54ms 0.5ms 11.8MB 40ms 0ms gcc 13.2.0
c 1.c 58ms 1.7ms 11.5MB 47ms 0ms clang 14.0.0-1ubuntu1.1
c 1.c 59ms 1.3ms 11.0MB 47ms 0ms zigcc 0.12.0-dev.2341+92211135f
python 1.py 698ms 9.1ms 131.7MB 667ms 17ms pypy 3.10.13
python 2.py 735ms 2.3ms 164.3MB 690ms 23ms pyston 3.8.12
python 1.py 1113ms 6.9ms 86.0MB 1087ms 7ms pyston 3.8.12
python 2.py 1213ms 1.8ms 165.4MB 1170ms 30ms cpython 3.12.1
python 1.py 2241ms 84ms 87.3MB 2217ms 10ms cpython 3.12.1
python 2.py 2612ms 31ms 283.0MB 2523ms 77ms pypy 3.10.13

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 947ms 11ms 4.1MB 3703ms 0ms gcc 13.2.0
c 6-im.c 981ms 47ms 4.1MB 3790ms 0ms gcc 13.2.0
c 6-im.c 1003ms 11ms 9.1MB 3920ms 3ms clang 14.0.0-1ubuntu1.1
c 4-m.c 1117ms 3.7ms 5.1MB 4367ms 10ms clang 14.0.0-1ubuntu1.1
c 5-im.c 1145ms 6.7ms 4.1MB 4493ms 0ms gcc 13.2.0
c 5-im.c 1335ms 18ms 5.3MB 5220ms 13ms clang 14.0.0-1ubuntu1.1
c 3-m.c 1825ms 3.8ms 7.3MB 7183ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 1933ms 0.6ms 4.1MB 7637ms 3ms gcc 13.2.0
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 246ms 0.5ms 4.1MB 937ms 0ms gcc 13.2.0
c 6-im.c 252ms 6.4ms 4.0MB 957ms 0ms gcc 13.2.0
c 6-im.c 258ms 0.1ms 9.2MB 973ms 3ms clang 14.0.0-1ubuntu1.1
c 4-m.c 288ms 1.9ms 7.0MB 1090ms 3ms clang 14.0.0-1ubuntu1.1
c 5-im.c 297ms 1.3ms 4.0MB 1130ms 0ms gcc 13.2.0
c 5-im.c 340ms 0.0ms 7.3MB 1300ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 462ms 0.4ms 5.3MB 1787ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 487ms 1.0ms 4.0MB 1893ms 0ms gcc 13.2.0
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 69ms 0.7ms 4.1MB 243ms 0ms gcc 13.2.0
c 6-im.c 70ms 0.0ms 4.0MB 247ms 0ms gcc 13.2.0
c 6-im.c 72ms 1.1ms 7.1MB 247ms 0ms clang 14.0.0-1ubuntu1.1
c 4-m.c 80ms 0.5ms 5.1MB 280ms 0ms clang 14.0.0-1ubuntu1.1
c 5-im.c 83ms 0.5ms 4.0MB 300ms 0ms gcc 13.2.0
c 5-im.c 109ms 28ms 5.2MB 363ms 3ms clang 14.0.0-1ubuntu1.1
c 3-m.c 124ms 0.7ms 7.0MB 447ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 129ms 1.4ms 4.0MB 480ms 0ms gcc 13.2.0
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12