Programming Language and compiler
Benchmarks

Kotlin VS Python benchmarks

Current benchmark data was generated on Tue Dec 31 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 455ms 16ms 575.5MB 540ms 63ms kotlin/jvm 21
python 1.py 1086ms 7.1ms 95.8MB 1023ms 47ms pypy 3.10.14
kotlin 1-m.kt 2928ms 6.8ms 248.5MB 4967ms 627ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 40.8MB 4967ms 17ms cpython 3.13.1
python 1.py timeout 0.0ms 40.5MB 4750ms 237ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 93ms 4.4ms 68.1MB 57ms 20ms pypy 3.10.14
kotlin 1.kt 95ms 2.4ms 158.2MB 103ms 23ms kotlin/jvm 21
kotlin 1-m.kt 257ms 6.2ms 32.6MB 400ms 63ms kotlin/native 1.8.21
python 1.py 448ms 2.5ms 11.9MB 423ms 7ms pyston 3.8.12
python 1.py 675ms 16ms 12.6MB 660ms 0ms cpython 3.13.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1119ms 8.2ms 102.5MB 1053ms 50ms pypy 3.10.14
kotlin 2-m.kt 1799ms 182ms 235.5MB 6667ms 90ms kotlin/jvm 21
kotlin 1.kt 2058ms 23ms 217.3MB 2833ms 57ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 14.8MB 6030ms 500ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 52.1MB 19097ms 113ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 21.3MB 4980ms 3ms cpython 3.13.1
python 1.py timeout 0.0ms 17.4MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 203ms 0.3ms 84.2MB 163ms 27ms pypy 3.10.14
kotlin 2-m.kt 366ms 8.9ms 38.2MB 1350ms 13ms kotlin/native 1.8.21
kotlin 1-m.kt 450ms 15ms 73.3MB 1017ms 37ms kotlin/jvm 21
python 1.py 554ms 29ms 20.5MB 530ms 3ms cpython 3.13.1
python 1.py 598ms 6.9ms 16.8MB 577ms 10ms pyston 3.8.12
kotlin 1.kt 646ms 7.8ms 10.8MB 807ms 53ms kotlin/native 1.8.21
kotlin 2-m.kt 757ms 71ms 99.7MB 2643ms 70ms kotlin/jvm 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.3ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
python 1.py 11ms 0.8ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 13ms 1.3ms 8.5MB 10ms 0ms cpython 3.13.1
python 1.py 26ms 0.9ms 51.0MB 8ms 8ms pypy 3.10.14
kotlin 1.kt 55ms 4.2ms 47.4MB 46ms 14ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2185ms 130ms 36.3MB 963ms 1550ms pyston 3.8.12
python 1.py 2293ms 260ms 33.2MB 1447ms 1537ms cpython 3.13.1
python 1.py 4404ms 18ms 106.6MB 2683ms 1083ms pypy 3.10.14
kotlin 2-m.kt 4837ms 51ms 400.1MB 14360ms 2470ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 405.3MB 16127ms 2747ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1091ms 7.1ms 30.8MB 230ms 243ms pyston 3.8.12
python 1.py 1188ms 161ms 28.8MB 293ms 250ms cpython 3.13.1
python 1.py 1741ms 161ms 88.8MB 650ms 203ms pypy 3.10.14
kotlin 1-m.kt 2173ms 206ms 269.1MB 6403ms 597ms kotlin/jvm 21
kotlin 2.kt 2226ms 288ms 241.9MB 2337ms 253ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 182ms 0.5ms 38.4MB 143ms 20ms pyston 3.8.12
python 1.py 202ms 5.2ms 38.5MB 170ms 13ms cpython 3.13.1
python 1.py 281ms 7.9ms 87.3MB 240ms 23ms pypy 3.10.14
kotlin 1-m.kt 863ms 53ms 202.0MB 2353ms 83ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1728ms 15ms 220.5MB 1570ms 140ms pyston 3.8.12
python 1.py 1788ms 9.0ms 221.8MB 1693ms 80ms pypy 3.10.14
python 1.py 1796ms 4.2ms 221.7MB 1690ms 87ms cpython 3.13.1
kotlin 1-m.kt 2217ms 99ms 784.2MB 4773ms 140ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 143ms 0.8ms 57.9MB 117ms 13ms pypy 3.10.14
kotlin 1-m.kt 172ms 3.8ms 94.9MB 283ms 30ms kotlin/jvm 21
python 1.py 172ms 3.1ms 59.5MB 147ms 10ms pypy 3.10.14
kotlin 2-m.kt 188ms 5.4ms 102.2MB 397ms 30ms kotlin/jvm 21
kotlin 2.kt 285ms 1.3ms 7.8MB 413ms 3ms kotlin/native 1.8.21
kotlin 1.kt 501ms 15ms 7.8MB 600ms 7ms kotlin/native 1.8.21
python 1.py 694ms 2.8ms 8.9MB 687ms 0ms pyston 3.8.12
python 2.py 790ms 4.9ms 8.5MB 773ms 0ms pyston 3.8.12
python 1.py 1060ms 5.7ms 9.3MB 1043ms 0ms cpython 3.13.1
python 2.py 1262ms 16ms 9.0MB 1247ms 0ms cpython 3.13.1

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 298ms 25ms 214.4MB 503ms 57ms kotlin/jvm 21
kotlin 1.kt 308ms 0.6ms 204.7MB 413ms 40ms kotlin/jvm 21
python 2.py 321ms 7.8ms 58.9MB 293ms 10ms pypy 3.10.14
python 1.py 360ms 5.5ms 60.4MB 337ms 10ms pypy 3.10.14
kotlin 2.kt 863ms 8.2ms 7.6MB 1240ms 50ms kotlin/native 1.8.21
kotlin 1.kt 1456ms 8.2ms 7.9MB 1763ms 17ms kotlin/native 1.8.21
python 1.py 2016ms 25ms 8.9MB 2000ms 0ms pyston 3.8.12
python 2.py 2346ms 34ms 8.5MB 2333ms 0ms pyston 3.8.12
python 1.py 3111ms 15ms 9.3MB 3093ms 3ms cpython 3.13.1
python 2.py 3679ms 12ms 9.0MB 3667ms 0ms cpython 3.13.1

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 101ms 2.0ms 57.8MB 77ms 10ms pypy 3.10.14
python 1.py 115ms 1.3ms 58.5MB 90ms 10ms pypy 3.10.14
kotlin 1-m.kt 132ms 1.5ms 92.4MB 250ms 20ms kotlin/jvm 21
kotlin 2.kt 134ms 3.9ms 5.7MB 190ms 0ms kotlin/native 1.8.21
kotlin 2-m.kt 159ms 9.9ms 90.8MB 307ms 27ms kotlin/jvm 21
kotlin 1.kt 162ms 4.0ms 5.8MB 207ms 0ms kotlin/native 1.8.21
python 1.py 328ms 7.8ms 8.5MB 313ms 0ms pyston 3.8.12
python 2.py 366ms 15ms 8.1MB 350ms 0ms pyston 3.8.12
python 1.py 503ms 5.9ms 9.1MB 483ms 0ms cpython 3.13.1
python 2.py 613ms 10ms 8.8MB 600ms 0ms cpython 3.13.1

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 329ms 3.6ms 677.6MB 360ms 70ms kotlin/jvm 21
kotlin 1-m.kt 1426ms 20ms 136.5MB 2193ms 330ms kotlin/native 1.8.21
python 1.py 2111ms 2.8ms 210.1MB 2007ms 83ms pypy 3.10.14
python 1.py timeout 0.0ms 93.9MB 4963ms 23ms cpython 3.13.1
python 1.py timeout 0.0ms 130.4MB 4933ms 53ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 122ms 2.0ms 206.5MB 157ms 23ms kotlin/jvm 21
kotlin 1-m.kt 283ms 1.7ms 40.4MB 410ms 57ms kotlin/native 1.8.21
python 1.py 360ms 5.1ms 103.6MB 297ms 50ms pypy 3.10.14
python 1.py 2752ms 61ms 37.2MB 2727ms 7ms cpython 3.13.1
python 1.py 4838ms 94ms 48.9MB 4770ms 50ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 386ms 8.6ms 4.7MB 373ms 0ms kotlin/native 1.8.21
kotlin 1.kt 422ms 3.5ms 49.7MB 463ms 13ms kotlin/jvm 21
python 2.py 1278ms 0.7ms 59.8MB 1253ms 10ms pypy 3.10.14
python 1.py 2492ms 13ms 56.6MB 2467ms 10ms pypy 3.10.14
python 1.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.13.1
python 2.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.1
python 1.py timeout 0.0ms 8.3MB 4987ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 43ms 0.8ms 4.6MB 30ms 0ms kotlin/native 1.8.21
kotlin 1.kt 112ms 0.7ms 49.4MB 150ms 17ms kotlin/jvm 21
python 2.py 165ms 1.2ms 57.8MB 143ms 10ms pypy 3.10.14
python 1.py 284ms 2.2ms 56.6MB 267ms 3ms pypy 3.10.14
python 1.py 892ms 9.1ms 8.3MB 883ms 0ms pyston 3.8.12
python 2.py 1234ms 13ms 8.3MB 1220ms 0ms pyston 3.8.12
python 1.py 2829ms 9.3ms 8.8MB 2813ms 0ms cpython 3.13.1
python 2.py 3043ms 23ms 8.8MB 3030ms 0ms cpython 3.13.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1803ms 1.7ms 8.9MB 1750ms 37ms pyston 3.8.12
python 4.py 1882ms 15ms 9.4MB 1823ms 40ms cpython 3.13.1
python 4.py 2018ms 13ms 89.1MB 1983ms 20ms pypy 3.10.14
kotlin 1.kt 3505ms 35ms 353.8MB 4313ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.5MB 6350ms 310ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 13.3MB 4990ms 177ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 427ms 4.9ms 8.8MB 413ms 0ms pyston 3.8.12
python 4.py 450ms 5.6ms 9.1MB 437ms 0ms cpython 3.13.1
python 4.py 515ms 2.6ms 83.8MB 480ms 17ms pypy 3.10.14
kotlin 1-m.kt 939ms 37ms 355.0MB 1617ms 70ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6420ms 257ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 5000ms 150ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2122ms 9.7ms 243.2MB 2060ms 43ms pypy 3.10.14
python 1.py 4481ms 9.0ms 226.3MB 4283ms 180ms pyston 3.8.12
kotlin 1.kt timeout 0.0ms 171.4MB 5370ms 43ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 278.9MB 5463ms 463ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 165.8MB 4940ms 40ms cpython 3.13.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 310ms 4.2ms 85.0MB 273ms 20ms pypy 3.10.14
python 1.py 468ms 2.3ms 30.5MB 440ms 13ms pyston 3.8.12
python 1.py 594ms 8.6ms 31.0MB 557ms 23ms cpython 3.13.1
kotlin 1-m.kt 759ms 8.2ms 133.8MB 1143ms 27ms kotlin/jvm 21
kotlin 1n.kt 2968ms 26ms 65.1MB 3653ms 3ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2939ms 35ms 231.8MB 3747ms 60ms kotlin/jvm 21
python 1.py 3007ms 4.8ms 8.3MB 2997ms 0ms pyston 3.8.12
python 1.py 3542ms 41ms 74.6MB 3513ms 13ms pypy 3.10.14
python 1.py 3659ms 51ms 8.8MB 3650ms 0ms cpython 3.13.1

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 765ms 9.3ms 8.3MB 750ms 0ms pyston 3.8.12
python 1.py 922ms 10.0ms 8.8MB 913ms 0ms cpython 3.13.1
kotlin 1-m.kt 926ms 27ms 209.8MB 1550ms 43ms kotlin/jvm 21
python 1.py 973ms 12ms 67.5MB 947ms 10ms pypy 3.10.14