Programming Language and compiler
Benchmarks

C VS Python benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 0.9ms 0.0ms 1.4MB 0ms 0ms zigcc 0.13.0
c 1.c 1.2ms 0.0ms 2.1MB 0ms 0ms gcc 14.2.0
c 1.c 1.3ms 0.2ms 2.1MB 0ms 0ms clang 14.0.0-1ubuntu1.1
python 1.py 11ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 1.3ms 8.5MB 10ms 0ms cpython 3.13.1
python 1.py 26ms 0.9ms 51.0MB 8ms 8ms pypy 3.10.14

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 175ms 15ms 26.1MB 410ms 7ms gcc 14.2.0
c 1-m.c 282ms 6.9ms 29.6MB 953ms 30ms clang 14.0.0-1ubuntu1.1
python 3-m.py 2164ms 33ms 137.9MB 7297ms 307ms pypy 3.10.14
python 3-m.py 2926ms 28ms 34.0MB 11103ms 117ms pyston 3.8.12
python 3.py timeout 0.0ms 35.7MB 93ms 7ms cpython 3.13.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 27ms 0.6ms 13.2MB 57ms 3ms gcc 14.2.0
c 1-m.c 35ms 1.3ms 14.9MB 103ms 0ms clang 14.0.0-1ubuntu1.1
python 3-m.py 356ms 2.8ms 75.7MB 893ms 163ms pypy 3.10.14
python 3-m.py 377ms 10ms 15.6MB 1223ms 73ms pyston 3.8.12
python 3-m.py 607ms 6.1ms 17.1MB 2127ms 67ms cpython 3.13.1

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-mffi.c 207ms 11ms 9.4MB 763ms 10ms clang 14.0.0-1ubuntu1.1
c 1-mffi.c 257ms 3.9ms 6.6MB 780ms 0ms gcc 14.2.0
c 1-mffi.c 410ms 4.7ms 6.0MB 397ms 0ms zigcc 0.13.0
c 1-ffi.c 411ms 7.0ms 6.0MB 403ms 0ms zigcc 0.13.0
c 1-ffi.c 429ms 6.2ms 6.7MB 417ms 0ms clang 14.0.0-1ubuntu1.1
c 1-ffi.c 509ms 5.2ms 6.6MB 500ms 0ms gcc 14.2.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-mffi.c 15ms 0.9ms 8.5MB 23ms 0ms clang 14.0.0-1ubuntu1.1
c 1-ffi.c 19ms 0.1ms 3.0MB 10ms 0ms zigcc 0.13.0
c 1-mffi.c 19ms 0.1ms 3.0MB 10ms 0ms zigcc 0.13.0
c 1-ffi.c 21ms 0.1ms 3.8MB 10ms 0ms clang 14.0.0-1ubuntu1.1
c 1-mffi.c 23ms 1.2ms 5.6MB 60ms 0ms gcc 14.2.0
c 1-ffi.c 24ms 0.3ms 3.6MB 17ms 0ms gcc 14.2.0

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 233ms 2.3ms 1.5MB 223ms 0ms zigcc 0.13.0
c 5.c 280ms 2.5ms 1.5MB 270ms 0ms zigcc 0.13.0
c 8-i.c 289ms 1.5ms 2.1MB 280ms 0ms clang 14.0.0-1ubuntu1.1
c 2.c 291ms 2.9ms 2.3MB 280ms 0ms gcc 14.2.0
c 2.c 297ms 4.6ms 1.5MB 287ms 0ms zigcc 0.13.0
c 5.c 300ms 5.4ms 2.3MB 287ms 0ms gcc 14.2.0
c 5.c 301ms 3.6ms 2.1MB 293ms 0ms clang 14.0.0-1ubuntu1.1
c 2.c 303ms 3.9ms 2.1MB 293ms 0ms clang 14.0.0-1ubuntu1.1
c 8-i.c 317ms 4.6ms 2.3MB 307ms 0ms gcc 14.2.0
python 2.py 1278ms 0.7ms 59.8MB 1253ms 10ms pypy 3.10.14
python 1.py 2492ms 13ms 56.6MB 2467ms 10ms pypy 3.10.14
python 1.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.13.1
python 2.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.1
python 1.py timeout 0.0ms 8.3MB 4987ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 26ms 0.1ms 1.5MB 20ms 0ms zigcc 0.13.0
c 5.c 30ms 0.2ms 1.5MB 20ms 0ms zigcc 0.13.0
c 8-i.c 30ms 0.4ms 2.1MB 20ms 0ms clang 14.0.0-1ubuntu1.1
c 2.c 31ms 0.4ms 1.5MB 20ms 0ms zigcc 0.13.0
c 2.c 31ms 0.4ms 2.3MB 20ms 0ms gcc 14.2.0
c 5.c 32ms 0.8ms 2.1MB 20ms 0ms clang 14.0.0-1ubuntu1.1
c 5.c 32ms 0.5ms 2.3MB 20ms 0ms gcc 14.2.0
c 2.c 33ms 1.7ms 2.1MB 23ms 0ms clang 14.0.0-1ubuntu1.1
c 8-i.c 33ms 0.3ms 2.3MB 23ms 0ms gcc 14.2.0
python 2.py 165ms 1.2ms 57.8MB 143ms 10ms pypy 3.10.14
python 1.py 284ms 2.2ms 56.6MB 267ms 3ms pypy 3.10.14
python 1.py 892ms 9.1ms 8.3MB 883ms 0ms pyston 3.8.12
python 2.py 1234ms 13ms 8.3MB 1220ms 0ms pyston 3.8.12
python 1.py 2829ms 9.3ms 8.8MB 2813ms 0ms cpython 3.13.1
python 2.py 3043ms 23ms 8.8MB 3030ms 0ms cpython 3.13.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 247ms 8.8ms 40.9MB 227ms 3ms gcc 14.2.0
c 1.c 249ms 8.5ms 40.8MB 230ms 3ms clang 14.0.0-1ubuntu1.1
c 1.c 261ms 8.3ms 40.3MB 243ms 0ms zigcc 0.13.0
python 1.py 2328ms 43ms 369.1MB 2263ms 47ms pypy 3.10.14
python 2.py 2768ms 15ms 632.9MB 2590ms 163ms pyston 3.8.12
python 1.py 4623ms 31ms 320.4MB 4567ms 40ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4953ms 27ms cpython 3.13.1
python 2.py timeout 0.0ms 633.5MB 4813ms 170ms cpython 3.13.1
python 2.py timeout 0.0ms 959.3MB 4743ms 243ms pypy 3.10.14

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 49ms 2.3ms 11.8MB 37ms 0ms gcc 14.2.0
c 1.c 50ms 3.8ms 11.5MB 40ms 0ms clang 14.0.0-1ubuntu1.1
c 1.c 55ms 3.7ms 11.0MB 43ms 0ms zigcc 0.13.0
python 1.py 497ms 14ms 134.7MB 467ms 17ms pypy 3.10.14
python 2.py 679ms 22ms 164.2MB 630ms 30ms pyston 3.8.12
python 1.py 1022ms 10ms 86.0MB 1000ms 3ms pyston 3.8.12
python 2.py 1327ms 14ms 164.8MB 1283ms 27ms cpython 3.13.1
python 2.py 1463ms 8.1ms 289.7MB 1363ms 80ms pypy 3.10.14
python 1.py 2501ms 11ms 86.9MB 2473ms 10ms cpython 3.13.1

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 912ms 4.9ms 4.1MB 3580ms 0ms gcc 14.2.0
c 6-im.c 916ms 6.9ms 4.1MB 3603ms 0ms gcc 14.2.0
c 6-im.c 957ms 5.6ms 7.3MB 3750ms 3ms clang 14.0.0-1ubuntu1.1
c 5-im.c 1032ms 4.9ms 4.1MB 4060ms 0ms gcc 14.2.0
c 4-m.c 1101ms 27ms 5.1MB 4260ms 13ms clang 14.0.0-1ubuntu1.1
c 5-im.c 1258ms 3.2ms 5.2MB 4933ms 7ms clang 14.0.0-1ubuntu1.1
c 3-m.c 1730ms 10ms 7.2MB 6810ms 3ms clang 14.0.0-1ubuntu1.1
c 3-m.c 1868ms 12ms 4.1MB 7353ms 7ms gcc 14.2.0
python 8.py timeout 0.0ms 16.7MB 43ms 13ms cpython 3.13.1
python 8.py timeout 0.0ms 99.4MB 790ms 163ms pypy 3.10.14
python 8.py timeout 0.0ms 16.5MB 67ms 20ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 242ms 7.9ms 4.0MB 927ms 0ms gcc 14.2.0
c 6-im.c 249ms 5.3ms 5.3MB 937ms 3ms clang 14.0.0-1ubuntu1.1
c 6-im.c 250ms 20ms 4.0MB 937ms 0ms gcc 14.2.0
c 4-m.c 272ms 1.5ms 5.1MB 1027ms 0ms clang 14.0.0-1ubuntu1.1
c 5-im.c 278ms 9.7ms 4.0MB 1050ms 0ms gcc 14.2.0
c 5-im.c 327ms 5.4ms 5.3MB 1250ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 452ms 20ms 7.3MB 1713ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 477ms 2.5ms 4.0MB 1860ms 0ms gcc 14.2.0
python 8.py timeout 0.0ms 16.5MB 87ms 20ms cpython 3.13.1
python 8.py timeout 0.0ms 100.4MB 1460ms 480ms pypy 3.10.14
python 8.py timeout 0.0ms 15.6MB 147ms 37ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 67ms 0.5ms 4.0MB 233ms 0ms gcc 14.2.0
c 6-im.c 69ms 3.3ms 7.3MB 240ms 0ms clang 14.0.0-1ubuntu1.1
c 6-im.c 70ms 6.7ms 4.0MB 240ms 0ms gcc 14.2.0
c 5-im.c 76ms 1.5ms 4.0MB 270ms 0ms gcc 14.2.0
c 4-m.c 83ms 7.1ms 5.0MB 277ms 7ms clang 14.0.0-1ubuntu1.1
c 5-im.c 89ms 2.8ms 5.1MB 320ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 117ms 2.1ms 5.1MB 417ms 0ms clang 14.0.0-1ubuntu1.1
c 3-m.c 126ms 1.7ms 4.0MB 470ms 0ms gcc 14.2.0
python 8-m.py 1880ms 5.8ms 95.0MB 6000ms 323ms pypy 3.10.14
python 8.py timeout 0.0ms 16.2MB 233ms 33ms cpython 3.13.1
python 8.py timeout 0.0ms 17.2MB 440ms 127ms pyston 3.8.12