Programming Language and compiler
Benchmarks

Python VS Kotlin benchmarks

Current benchmark data was generated on Mon Mar 31 2025, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 474ms 2.2ms 577.6MB 567ms 83ms kotlin/jvm 21
python 1.py 1210ms 7.0ms 96.2MB 1147ms 47ms pypy 3.10.16
kotlin 1-m.kt 3074ms 28ms 246.4MB 5113ms 703ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 40.8MB 4963ms 20ms cpython 3.13.2
python 1.py timeout 0.0ms 40.5MB 4747ms 240ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 95ms 1.1ms 68.8MB 67ms 17ms pypy 3.10.16
kotlin 1.kt 100ms 0.6ms 160.2MB 110ms 27ms kotlin/jvm 21
kotlin 1-m.kt 267ms 2.6ms 28.5MB 427ms 57ms kotlin/native 1.8.21
python 1.py 479ms 4.3ms 11.9MB 453ms 10ms pyston 3.8.12
python 1.py 718ms 7.5ms 12.6MB 703ms 0ms cpython 3.13.2

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1217ms 27ms 107.0MB 1170ms 30ms pypy 3.10.16
kotlin 2-m.kt 1924ms 65ms 240.6MB 7167ms 113ms kotlin/jvm 21
kotlin 1.kt 2164ms 23ms 222.7MB 2980ms 73ms kotlin/jvm 21
python 1.py 2643ms 6.3ms 25.0MB 2620ms 13ms cpython 3.13.2
kotlin 1.kt timeout 0.0ms 12.7MB 6027ms 467ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 53.1MB 19010ms 150ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 224ms 3.9ms 86.3MB 190ms 20ms pypy 3.10.16
python 1.py 228ms 1.1ms 20.2MB 207ms 10ms cpython 3.13.2
kotlin 2-m.kt 433ms 6.8ms 12.8MB 1593ms 23ms kotlin/native 1.8.21
kotlin 1-m.kt 480ms 14ms 77.5MB 1110ms 53ms kotlin/jvm 21
python 1.py 685ms 12ms 16.8MB 667ms 7ms pyston 3.8.12
kotlin 1.kt 685ms 0.7ms 8.8MB 813ms 63ms kotlin/native 1.8.21
kotlin 2-m.kt 926ms 49ms 105.6MB 3263ms 83ms kotlin/jvm 21

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 254ms 5.1ms 83.6MB 217ms 20ms pypy 3.10.16
python 1.py 360ms 1.5ms 12.5MB 343ms 3ms cpython 3.13.2
python 1.py 2006ms 5.2ms 9.6MB 1990ms 0ms pyston 3.8.12

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 100ms 1.7ms 63.4MB 73ms 13ms pypy 3.10.16
python 1.py 139ms 55ms 12.0MB 100ms 0ms cpython 3.13.2
python 1.py 350ms 0.8ms 8.8MB 340ms 0ms pyston 3.8.12

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1852ms 1.6ms 88.8MB 1807ms 30ms pypy 3.10.16
python 5-m.py 2282ms 30ms 65.4MB 3493ms 843ms pypy 3.10.16
python 5-m.py 2455ms 13ms 12.5MB 3537ms 1010ms pyston 3.8.12
python 1.py 3017ms 14ms 8.1MB 3007ms 0ms pyston 3.8.12
python 5-m.py 3351ms 11ms 13.5MB 4443ms 913ms cpython 3.13.2
python 1.py 4656ms 26ms 8.8MB 4640ms 0ms cpython 3.13.2

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 251ms 5.7ms 63.3MB 223ms 13ms pypy 3.10.16
python 5-m.py 311ms 1.4ms 12.4MB 393ms 143ms pyston 3.8.12
python 1.py 318ms 0.3ms 8.1MB 310ms 0ms pyston 3.8.12
python 5-m.py 397ms 5.6ms 13.6MB 480ms 133ms cpython 3.13.2
python 5-m.py 445ms 6.3ms 65.4MB 737ms 310ms pypy 3.10.16
python 1.py 488ms 7.2ms 8.6MB 477ms 0ms cpython 3.13.2

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.0ms 0.2ms 2.5MB 0ms 0ms kotlin/native 1.8.21
python 1.py 11ms 0.5ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.0ms 8.6MB 10ms 0ms cpython 3.13.2
python 1.py 29ms 1.1ms 51.6MB 10ms 10ms pypy 3.10.16
kotlin 1.kt 56ms 5.4ms 47.2MB 50ms 20ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2132ms 36ms 26.8MB 1117ms 1563ms pyston 3.8.12
python 1.py 2559ms 231ms 27.3MB 1567ms 1620ms cpython 3.13.2
kotlin 2-m.kt 3184ms 1331ms 354.5MB 5353ms 940ms kotlin/jvm 21
python 1.py 4884ms 99ms 101.8MB 2890ms 1217ms pypy 3.10.16
kotlin 1.kt timeout 0.0ms 407.6MB 15893ms 3003ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1096ms 17ms 21.3MB 240ms 270ms pyston 3.8.12
python 1.py 1100ms 22ms 22.9MB 307ms 290ms cpython 3.13.2
python 1.py 1425ms 69ms 87.3MB 723ms 237ms pypy 3.10.16
kotlin 1-m.kt 2024ms 205ms 231.8MB 6097ms 673ms kotlin/jvm 21
kotlin 2-m.kt 2068ms 276ms 242.2MB 5587ms 597ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 194ms 6.5ms 38.4MB 163ms 20ms pyston 3.8.12
python 1.py 214ms 1.4ms 38.6MB 187ms 13ms cpython 3.13.2
python 1.py 298ms 2.7ms 89.5MB 260ms 20ms pypy 3.10.16
kotlin 1-m.kt 806ms 107ms 204.8MB 2167ms 87ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1815ms 17ms 220.5MB 1643ms 160ms pyston 3.8.12
python 1.py 1915ms 31ms 222.2MB 1830ms 73ms pypy 3.10.16
python 1.py 1927ms 7.1ms 221.4MB 1830ms 87ms cpython 3.13.2
kotlin 1-m.kt 2329ms 35ms 828.1MB 5040ms 157ms kotlin/jvm 21

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 2435ms 14ms 136.4MB 8277ms 343ms pypy 3.10.16
python 3-m.py 3135ms 60ms 34.3MB 11840ms 123ms pyston 3.8.12
python 3.py timeout 0.0ms 35.6MB 93ms 20ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 3-m.py 389ms 1.1ms 75.7MB 983ms 170ms pypy 3.10.16
python 3-m.py 393ms 4.9ms 14.2MB 1303ms 70ms pyston 3.8.12
python 3-m.py 634ms 4.3ms 15.1MB 2240ms 53ms cpython 3.13.2

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 144ms 0.5ms 58.3MB 120ms 10ms pypy 3.10.16
python 1.py 179ms 2.6ms 59.4MB 157ms 10ms pypy 3.10.16
kotlin 1-m.kt 181ms 3.8ms 96.7MB 300ms 30ms kotlin/jvm 21
kotlin 2-m.kt 197ms 1.3ms 103.5MB 420ms 40ms kotlin/jvm 21
kotlin 2.kt 299ms 2.1ms 5.8MB 420ms 10ms kotlin/native 1.8.21
kotlin 1.kt 515ms 4.2ms 5.9MB 613ms 10ms kotlin/native 1.8.21
python 1.py 719ms 5.8ms 8.9MB 707ms 0ms pyston 3.8.12
python 2.py 833ms 11ms 8.5MB 820ms 0ms pyston 3.8.12
python 1.py 1138ms 4.4ms 9.4MB 1127ms 0ms cpython 3.13.2
python 2.py 1348ms 40ms 9.0MB 1337ms 0ms cpython 3.13.2

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 311ms 8.5ms 212.5MB 533ms 47ms kotlin/jvm 21
python 2.py 338ms 2.7ms 59.3MB 320ms 3ms pypy 3.10.16
kotlin 1.kt 343ms 9.7ms 204.4MB 443ms 43ms kotlin/jvm 21
python 1.py 380ms 6.1ms 60.3MB 353ms 10ms pypy 3.10.16
kotlin 2.kt 893ms 4.3ms 5.8MB 1280ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1545ms 11ms 5.8MB 1860ms 23ms kotlin/native 1.8.21
python 1.py 2132ms 18ms 8.9MB 2123ms 0ms pyston 3.8.12
python 2.py 2501ms 6.7ms 8.5MB 2490ms 0ms pyston 3.8.12
python 1.py 3370ms 28ms 9.4MB 3357ms 0ms cpython 3.13.2
python 2.py 3950ms 27ms 9.0MB 3937ms 0ms cpython 3.13.2

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 106ms 5.2ms 57.9MB 83ms 10ms pypy 3.10.16
python 1.py 122ms 1.9ms 58.7MB 100ms 10ms pypy 3.10.16
kotlin 1-m.kt 138ms 2.2ms 92.7MB 273ms 23ms kotlin/jvm 21
kotlin 2.kt 140ms 1.1ms 3.6MB 193ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 166ms 21ms 95.2MB 347ms 23ms kotlin/jvm 21
kotlin 1.kt 171ms 1.1ms 3.8MB 210ms 3ms kotlin/native 1.8.21
python 1.py 348ms 6.0ms 8.5MB 333ms 0ms pyston 3.8.12
python 2.py 387ms 2.2ms 8.1MB 373ms 0ms pyston 3.8.12
python 1.py 539ms 4.9ms 9.0MB 523ms 0ms cpython 3.13.2
python 2.py 634ms 5.0ms 8.6MB 623ms 0ms cpython 3.13.2

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 351ms 4.3ms 679.4MB 377ms 93ms kotlin/jvm 21
kotlin 1-m.kt 1499ms 16ms 134.5MB 2310ms 327ms kotlin/native 1.8.21
python 1.py 2202ms 10ms 203.1MB 2083ms 107ms pypy 3.10.16
python 1.py timeout 0.0ms 93.9MB 4950ms 40ms cpython 3.13.2
python 1.py timeout 0.0ms 130.4MB 4940ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 129ms 2.5ms 208.5MB 153ms 40ms kotlin/jvm 21
kotlin 1-m.kt 310ms 3.8ms 38.6MB 453ms 67ms kotlin/native 1.8.21
python 1.py 377ms 5.4ms 105.2MB 323ms 40ms pypy 3.10.16
python 1.py 3111ms 151ms 37.2MB 3083ms 13ms cpython 3.13.2
python 1.py timeout 0.0ms 48.9MB 4940ms 43ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 406ms 0.5ms 2.5MB 397ms 0ms kotlin/native 1.8.21
kotlin 1.kt 445ms 1.6ms 49.5MB 487ms 20ms kotlin/jvm 21
python 2.py 1353ms 7.7ms 60.3MB 1330ms 10ms pypy 3.10.16
python 1.py 2647ms 8.4ms 57.2MB 2623ms 10ms pypy 3.10.16
python 1.py timeout 0.0ms 8.6MB 4990ms 0ms cpython 3.13.2
python 2.py timeout 0.0ms 8.8MB 4990ms 0ms cpython 3.13.2
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 47ms 1.9ms 2.5MB 40ms 0ms kotlin/native 1.8.21
kotlin 1-m.kt 119ms 0.0ms 49.6MB 163ms 17ms kotlin/jvm 21
python 2.py 182ms 1.3ms 58.1MB 160ms 10ms pypy 3.10.16
python 1.py 299ms 2.7ms 57.1MB 280ms 10ms pypy 3.10.16
python 1.py 932ms 16ms 8.3MB 920ms 0ms pyston 3.8.12
python 2.py 1282ms 11ms 8.3MB 1270ms 0ms pyston 3.8.12
python 1.py 2968ms 4.6ms 8.8MB 2953ms 0ms cpython 3.13.2
python 2.py 3214ms 99ms 8.8MB 3200ms 0ms cpython 3.13.2

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2527ms 58ms 369.5MB 2457ms 57ms pypy 3.10.16
python 2.py 3022ms 8.2ms 633.0MB 2873ms 137ms pyston 3.8.12
python 1.py 4719ms 120ms 320.4MB 4657ms 50ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4960ms 27ms cpython 3.13.2
python 2.py timeout 0.0ms 633.6MB 4843ms 143ms cpython 3.13.2
python 2.py timeout 0.0ms 959.8MB 4730ms 260ms pypy 3.10.16

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 524ms 3.5ms 135.2MB 490ms 20ms pypy 3.10.16
python 2.py 734ms 1.6ms 164.2MB 697ms 27ms pyston 3.8.12
python 1.py 1045ms 7.6ms 86.0MB 1023ms 10ms pyston 3.8.12
python 2.py 1423ms 16ms 164.8MB 1380ms 30ms cpython 3.13.2
python 2.py 1530ms 19ms 290.2MB 1440ms 77ms pypy 3.10.16
python 1.py 2661ms 20ms 86.8MB 2640ms 10ms cpython 3.13.2

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1915ms 5.6ms 8.9MB 1873ms 30ms pyston 3.8.12
python 4.py 1945ms 3.8ms 9.4MB 1893ms 40ms cpython 3.13.2
python 4.py 2174ms 1.1ms 89.4MB 2133ms 30ms pypy 3.10.16
kotlin 1.kt 3686ms 7.3ms 354.4MB 4587ms 103ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.5MB 6277ms 270ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.2MB 5017ms 143ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 451ms 0.7ms 8.6MB 440ms 0ms pyston 3.8.12
python 4.py 468ms 3.4ms 9.0MB 457ms 0ms cpython 3.13.2
python 4.py 549ms 3.3ms 83.8MB 513ms 20ms pypy 3.10.16
kotlin 1-m.kt 1008ms 11ms 355.1MB 1733ms 90ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 5.4MB 6273ms 273ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 6.3MB 5003ms 160ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2244ms 5.8ms 243.6MB 2190ms 40ms pypy 3.10.16
python 1.py 4741ms 7.8ms 225.5MB 4550ms 173ms pyston 3.8.12
kotlin 1.kt timeout 0.0ms 171.1MB 5397ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 277.0MB 5010ms 877ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 146.4MB 4933ms 57ms cpython 3.13.2

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 330ms 3.2ms 85.6MB 293ms 20ms pypy 3.10.16
python 1.py 497ms 6.0ms 29.8MB 463ms 17ms pyston 3.8.12
python 1.py 606ms 2.2ms 30.7MB 573ms 20ms cpython 3.13.2
kotlin 1-m.kt 812ms 1.6ms 133.5MB 1233ms 33ms kotlin/jvm 21
kotlin 1n.kt 3187ms 38ms 63.0MB 3923ms 17ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 3092ms 51ms 235.3MB 4100ms 73ms kotlin/jvm 21
python 1.py 3178ms 4.3ms 8.3MB 3167ms 0ms pyston 3.8.12
python 1.py 3503ms 25ms 74.3MB 3470ms 20ms pypy 3.10.16
python 1.py 3792ms 25ms 8.6MB 3780ms 0ms cpython 3.13.2

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 811ms 3.4ms 8.3MB 800ms 0ms pyston 3.8.12
python 1.py 973ms 13ms 8.6MB 963ms 0ms cpython 3.13.2
python 1.py 974ms 6.2ms 67.3MB 940ms 20ms pypy 3.10.16
kotlin 1-m.kt 978ms 29ms 233.2MB 1787ms 60ms kotlin/jvm 21

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 14.9MB 40ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 95.4MB 790ms 77ms pypy 3.10.16
python 8.py timeout 0.0ms 14.2MB 37ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8.py timeout 0.0ms 14.4MB 43ms 10ms cpython 3.13.2
python 8.py timeout 0.0ms 96.7MB 1313ms 177ms pypy 3.10.16
python 8.py timeout 0.0ms 13.7MB 53ms 20ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 8-m.py 1974ms 19ms 92.9MB 6383ms 260ms pypy 3.10.16
python 8.py timeout 0.0ms 14.0MB 90ms 20ms cpython 3.13.2
python 8.py timeout 0.0ms 13.1MB 123ms 37ms pyston 3.8.12