Programming Language and compiler
Benchmarks

OCaml VS Python benchmarks

Current benchmark data was generated on Tue Mar 25 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1197ms 3.3ms 96.2MB 1130ms 53ms pypy 3.10.16
ocaml 1.ml 3139ms 30ms 157.2MB 3050ms 73ms ocaml 5.3.0
python 1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.2
python 1.py timeout 0.0ms 40.5MB 4740ms 250ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 97ms 2.2ms 68.7MB 67ms 17ms pypy 3.10.16
ocaml 1.ml 228ms 11ms 19.2MB 213ms 0ms ocaml 5.3.0
python 1.py 487ms 1.2ms 11.9MB 460ms 13ms pyston 3.8.12
python 1.py 726ms 15ms 12.6MB 713ms 0ms cpython 3.13.2

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 2918ms 4.8ms 4.9MB 2910ms 0ms ocaml 5.3.0

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 245ms 1.4ms 4.9MB 237ms 0ms ocaml 5.3.0

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 345ms 0.3ms 24.8MB 330ms 0ms ocaml 5.3.0
python 1.py 1866ms 18ms 88.8MB 1820ms 33ms pypy 3.10.16
python 5-m.py 2278ms 15ms 65.4MB 3513ms 857ms pypy 3.10.16
python 5-m.py 2482ms 19ms 12.5MB 3550ms 1030ms pyston 3.8.12
python 1.py 3030ms 3.8ms 8.1MB 3020ms 0ms pyston 3.8.12
python 5-m.py 3399ms 44ms 13.5MB 4503ms 963ms cpython 3.13.2
python 1.py 4712ms 79ms 8.8MB 4703ms 0ms cpython 3.13.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 6.ml 39ms 0.3ms 7.3MB 30ms 0ms ocaml 5.3.0
python 1.py 249ms 2.9ms 63.3MB 220ms 13ms pypy 3.10.16
python 1.py 317ms 7.5ms 8.1MB 303ms 0ms pyston 3.8.12
python 5-m.py 321ms 4.6ms 12.5MB 420ms 147ms pyston 3.8.12
python 5-m.py 405ms 4.6ms 13.5MB 490ms 133ms cpython 3.13.2
python 5-m.py 450ms 2.3ms 65.4MB 730ms 327ms pypy 3.10.16
python 1.py 484ms 3.0ms 8.8MB 473ms 0ms cpython 3.13.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1.9ms 0.2ms 5.1MB 0ms 0ms ocaml 5.3.0
python 1.py 12ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.2ms 8.6MB 10ms 0ms cpython 3.13.2
python 1.py 30ms 1.2ms 51.4MB 10ms 10ms pypy 3.10.16

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 147ms 1.7ms 58.3MB 127ms 10ms pypy 3.10.16
ocaml 1.ml 178ms 2.2ms 6.4MB 170ms 0ms ocaml 5.3.0
python 1.py 184ms 4.8ms 59.3MB 160ms 10ms pypy 3.10.16
python 1.py 721ms 2.1ms 8.9MB 707ms 0ms pyston 3.8.12
python 2.py 846ms 12ms 8.5MB 837ms 0ms pyston 3.8.12
python 1.py 1125ms 14ms 9.3MB 1113ms 0ms cpython 3.13.2
python 2.py 1331ms 3.3ms 9.0MB 1320ms 0ms cpython 3.13.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 345ms 4.6ms 59.2MB 320ms 10ms pypy 3.10.16
python 1.py 383ms 1.7ms 60.3MB 360ms 10ms pypy 3.10.16
ocaml 1.ml 535ms 18ms 6.6MB 523ms 0ms ocaml 5.3.0
python 1.py 2123ms 11ms 8.9MB 2107ms 0ms pyston 3.8.12
python 2.py 2478ms 14ms 8.5MB 2463ms 0ms pyston 3.8.12
python 1.py 3384ms 51ms 9.3MB 3370ms 0ms cpython 3.13.2
python 2.py 4191ms 262ms 9.0MB 4180ms 0ms cpython 3.13.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 77ms 0.5ms 6.1MB 70ms 0ms ocaml 5.3.0
python 2.py 108ms 2.1ms 57.9MB 83ms 10ms pypy 3.10.16
python 1.py 124ms 2.8ms 58.7MB 97ms 13ms pypy 3.10.16
python 1.py 350ms 0.8ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 388ms 2.7ms 8.1MB 380ms 0ms pyston 3.8.12
python 1.py 535ms 0.5ms 9.0MB 520ms 0ms cpython 3.13.2
python 2.py 638ms 8.7ms 8.6MB 623ms 0ms cpython 3.13.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1104ms 1.1ms 70.3MB 1060ms 30ms ocaml 5.3.0
python 1.py 2242ms 13ms 202.7MB 2123ms 100ms pypy 3.10.16
ocaml 2.ml 2279ms 5.8ms 91.8MB 2220ms 43ms ocaml 5.3.0
python 1.py timeout 0.0ms 93.6MB 4953ms 30ms cpython 3.13.2
python 1.py timeout 0.0ms 130.4MB 4930ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 149ms 3.1ms 21.6MB 130ms 7ms ocaml 5.3.0
python 1.py 384ms 3.7ms 105.2MB 320ms 47ms pypy 3.10.16
ocaml 2.ml 396ms 3.4ms 27.7MB 377ms 7ms ocaml 5.3.0
python 1.py 3229ms 20ms 37.2MB 3203ms 13ms cpython 3.13.2
python 1.py timeout 0.0ms 48.4MB 4963ms 23ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 374ms 0.4ms 5.3MB 367ms 0ms ocaml 5.3.0
python 2.py 1357ms 7.5ms 57.9MB 1330ms 10ms pypy 3.10.16
python 1.py 2662ms 11ms 57.2MB 2640ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 41ms 0.7ms 5.2MB 30ms 0ms ocaml 5.3.0
python 2.py 179ms 2.5ms 57.9MB 157ms 10ms pypy 3.10.16
python 1.py 310ms 12ms 57.0MB 287ms 10ms pypy 3.10.16
python 1.py 934ms 14ms 8.3MB 920ms 0ms pyston 3.8.12
python 2.py 1326ms 45ms 8.1MB 1313ms 0ms pyston 3.8.12
python 1.py 3035ms 123ms 8.6MB 3020ms 0ms cpython 3.13.2
python 2.py 3207ms 87ms 8.8MB 3197ms 0ms cpython 3.13.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 1019ms 4.4ms 544.4MB 960ms 43ms ocaml 5.3.0
ocaml 2.ml 1896ms 11ms 17.2MB 1883ms 0ms ocaml 5.3.0
python 1.py 2644ms 5.0ms 369.5MB 2577ms 57ms pypy 3.10.16
python 2.py 3165ms 30ms 633.0MB 2990ms 157ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4960ms 30ms cpython 3.13.2
python 2.py timeout 0.0ms 633.6MB 4830ms 153ms cpython 3.13.2
python 2.py timeout 0.0ms 959.7MB 4717ms 270ms pypy 3.10.16
python 1.py timeout 0.0ms 320.4MB 4933ms 50ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 1.ml 197ms 0.6ms 128.8MB 173ms 10ms ocaml 5.3.0
ocaml 2.ml 469ms 5.3ms 9.1MB 457ms 0ms ocaml 5.3.0
python 1.py 554ms 4.7ms 135.2MB 517ms 23ms pypy 3.10.16
python 2.py 754ms 4.9ms 164.2MB 710ms 27ms pyston 3.8.12
python 1.py 1144ms 17ms 86.0MB 1117ms 10ms pyston 3.8.12
python 2.py 1460ms 5.5ms 164.8MB 1417ms 30ms cpython 3.13.2
python 2.py 1589ms 53ms 290.2MB 1500ms 77ms pypy 3.10.16
python 1.py 2736ms 37ms 86.8MB 2710ms 10ms cpython 3.13.2

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2254ms 9.7ms 243.7MB 2197ms 43ms pypy 3.10.16
python 1.py 4766ms 18ms 268.3MB 4583ms 167ms pyston 3.8.12
ocaml 2.ml timeout 0.0ms 462.7MB 4810ms 173ms ocaml 5.3.0
python 1.py timeout 0.0ms 144.0MB 4937ms 47ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 331ms 4.0ms 85.9MB 290ms 27ms pypy 3.10.16
python 1.py 498ms 3.7ms 36.1MB 467ms 20ms pyston 3.8.12
ocaml 2.ml 550ms 6.1ms 57.1MB 507ms 27ms ocaml 5.3.0
python 1.py 611ms 4.7ms 31.0MB 580ms 13ms cpython 3.13.2

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 4585ms 15ms 6.4MB 4573ms 0ms ocaml 5.3.0
python 8.py timeout 0.0ms 14.8MB 30ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 95.8MB 803ms 87ms pypy 3.10.16
python 8.py timeout 0.0ms 14.2MB 40ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 1148ms 6.8ms 6.1MB 1140ms 0ms ocaml 5.3.0
python 8.py timeout 0.0ms 14.3MB 47ms 13ms cpython 3.13.2
python 8.py timeout 0.0ms 96.3MB 1323ms 190ms pypy 3.10.16
python 8.py timeout 0.0ms 13.6MB 63ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
ocaml 2.ml 296ms 5.1ms 5.2MB 287ms 0ms ocaml 5.3.0
python 8-m.py 1978ms 5.9ms 93.1MB 6363ms 257ms pypy 3.10.16
python 8.py timeout 0.0ms 14.0MB 90ms 17ms cpython 3.13.2
python 8.py timeout 0.0ms 13.2MB 130ms 40ms pyston 3.8.12