Programming Language and compiler
Benchmarks

Kotlin VS Python benchmarks

Current benchmark data was generated on Sun Dec 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 480ms 16ms 575.9MB 567ms 87ms kotlin/jvm 21
python 1.py 1149ms 16ms 95.7MB 1087ms 47ms pypy 3.10.14
kotlin 1-m.kt 3116ms 32ms 248.5MB 5177ms 713ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 40.8MB 4970ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 40.6MB 4743ms 240ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 94ms 1.9ms 68.0MB 63ms 20ms pypy 3.10.14
kotlin 1.kt 102ms 1.9ms 158.0MB 110ms 27ms kotlin/jvm 21
kotlin 1-m.kt 299ms 30ms 32.5MB 463ms 60ms kotlin/native 1.8.21
python 1.py 491ms 25ms 11.9MB 463ms 7ms pyston 3.8.12
python 1.py 710ms 4.2ms 12.8MB 697ms 0ms cpython 3.13.0

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1178ms 15ms 102.5MB 1133ms 30ms pypy 3.10.14
kotlin 2-m.kt 1604ms 72ms 235.4MB 5907ms 97ms kotlin/jvm 21
kotlin 1.kt 2135ms 35ms 220.1MB 2943ms 63ms kotlin/jvm 21
kotlin 1.kt timeout 0.0ms 14.9MB 6260ms 513ms kotlin/native 1.8.21
kotlin 2-m.kt timeout 0.0ms 85.0MB 19090ms 157ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 21.1MB 4977ms 7ms cpython 3.13.0
python 1.py timeout 0.0ms 17.1MB 4977ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 219ms 6.3ms 84.3MB 183ms 20ms pypy 3.10.14
kotlin 2-m.kt 419ms 4.7ms 54.7MB 1533ms 27ms kotlin/native 1.8.21
kotlin 1-m.kt 483ms 3.9ms 74.0MB 1130ms 37ms kotlin/jvm 21
python 1.py 572ms 3.4ms 20.4MB 543ms 10ms cpython 3.13.0
kotlin 1.kt 678ms 2.7ms 10.8MB 817ms 63ms kotlin/native 1.8.21
python 1.py 685ms 13ms 16.8MB 663ms 7ms pyston 3.8.12
kotlin 2-m.kt 790ms 26ms 99.0MB 2727ms 67ms kotlin/jvm 21

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 2.4ms 0.2ms 4.7MB 0ms 0ms kotlin/native 1.8.21
python 1.py 12ms 1.2ms 7.6MB 5ms 5ms pyston 3.8.12
python 1.py 15ms 0.3ms 8.5MB 10ms 0ms cpython 3.13.0
python 1.py 29ms 1.5ms 51.0MB 4ms 12ms pypy 3.10.14
kotlin 1.kt 58ms 4.7ms 47.4MB 56ms 16ms kotlin/jvm 21

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2123ms 18ms 36.4MB 1133ms 1507ms pyston 3.8.12
python 1.py 2379ms 301ms 33.3MB 1593ms 1627ms cpython 3.13.0
python 1.py 4814ms 17ms 107.0MB 2870ms 1220ms pypy 3.10.14
kotlin 1.kt timeout 0.0ms 394.9MB 16237ms 2760ms kotlin/jvm 21
kotlin 2.kt timeout 0.0ms 429.2MB 15370ms 2387ms kotlin/jvm 21

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1101ms 27ms 28.8MB 217ms 287ms pyston 3.8.12
python 1.py 1170ms 92ms 28.7MB 317ms 273ms cpython 3.13.0
python 1.py 1611ms 66ms 89.5MB 723ms 200ms pypy 3.10.14
kotlin 2-m.kt 2027ms 55ms 244.2MB 5847ms 583ms kotlin/jvm 21
kotlin 1-m.kt 2574ms 75ms 211.5MB 7400ms 730ms kotlin/jvm 21

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 197ms 4.7ms 38.1MB 170ms 10ms pyston 3.8.12
python 1.py 218ms 1.6ms 38.5MB 190ms 10ms cpython 3.13.0
python 1.py 292ms 7.9ms 87.4MB 247ms 30ms pypy 3.10.14
kotlin 1-m.kt 892ms 33ms 202.2MB 2373ms 113ms kotlin/jvm 21

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1808ms 8.0ms 220.5MB 1643ms 143ms pyston 3.8.12
python 1.py 1885ms 7.7ms 222.0MB 1820ms 50ms pypy 3.10.14
python 1.py 1937ms 18ms 223.0MB 1830ms 93ms cpython 3.13.0
kotlin 1-m.kt 2318ms 69ms 758.1MB 5017ms 187ms kotlin/jvm 21

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 146ms 5.0ms 57.9MB 120ms 7ms pypy 3.10.14
python 1.py 176ms 0.5ms 59.5MB 150ms 10ms pypy 3.10.14
kotlin 1-m.kt 185ms 5.2ms 96.3MB 300ms 30ms kotlin/jvm 21
kotlin 2-m.kt 198ms 2.7ms 103.3MB 427ms 33ms kotlin/jvm 21
kotlin 2.kt 303ms 3.4ms 7.6MB 423ms 17ms kotlin/native 1.8.21
kotlin 1.kt 505ms 3.2ms 7.8MB 597ms 7ms kotlin/native 1.8.21
python 1.py 713ms 3.1ms 8.9MB 703ms 0ms pyston 3.8.12
python 2.py 841ms 12ms 8.5MB 830ms 0ms pyston 3.8.12
python 1.py 1118ms 25ms 9.4MB 1110ms 0ms cpython 3.13.0
python 2.py 1290ms 15ms 9.1MB 1273ms 0ms cpython 3.13.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 2-m.kt 310ms 1.0ms 213.2MB 547ms 50ms kotlin/jvm 21
kotlin 1.kt 329ms 4.8ms 204.6MB 437ms 40ms kotlin/jvm 21
python 2.py 339ms 1.0ms 58.9MB 313ms 13ms pypy 3.10.14
python 1.py 372ms 2.9ms 60.4MB 347ms 10ms pypy 3.10.14
kotlin 2.kt 910ms 4.1ms 7.8MB 1313ms 40ms kotlin/native 1.8.21
kotlin 1.kt 1549ms 11ms 7.8MB 1893ms 20ms kotlin/native 1.8.21
python 1.py 2130ms 31ms 8.9MB 2117ms 3ms pyston 3.8.12
python 2.py 2504ms 61ms 8.5MB 2490ms 0ms pyston 3.8.12
python 1.py 3298ms 41ms 9.4MB 3283ms 0ms cpython 3.13.0
python 2.py 3869ms 4.9ms 9.1MB 3853ms 0ms cpython 3.13.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 2.py 103ms 0.8ms 57.8MB 77ms 13ms pypy 3.10.14
python 1.py 120ms 2.9ms 58.5MB 97ms 7ms pypy 3.10.14
kotlin 2.kt 137ms 0.1ms 5.7MB 190ms 0ms kotlin/native 1.8.21
kotlin 1-m.kt 142ms 1.1ms 90.9MB 277ms 27ms kotlin/jvm 21
kotlin 2-m.kt 158ms 11ms 93.7MB 300ms 37ms kotlin/jvm 21
kotlin 1.kt 166ms 2.7ms 5.8MB 203ms 0ms kotlin/native 1.8.21
python 1.py 349ms 5.9ms 8.5MB 333ms 0ms pyston 3.8.12
python 2.py 384ms 5.3ms 8.1MB 367ms 3ms pyston 3.8.12
python 1.py 536ms 14ms 9.3MB 520ms 0ms cpython 3.13.0
python 2.py 617ms 1.4ms 8.8MB 607ms 0ms cpython 3.13.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 353ms 4.0ms 679.4MB 377ms 90ms kotlin/jvm 21
kotlin 1-m.kt 1537ms 54ms 136.5MB 2363ms 343ms kotlin/native 1.8.21
python 1.py 2247ms 43ms 210.1MB 2133ms 97ms pypy 3.10.14
python 1.py timeout 0.0ms 93.9MB 4953ms 30ms cpython 3.13.0
python 1.py timeout 0.0ms 130.3MB 4930ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1-m.kt 131ms 0.9ms 206.5MB 157ms 40ms kotlin/jvm 21
kotlin 1-m.kt 319ms 4.8ms 40.5MB 470ms 77ms kotlin/native 1.8.21
python 1.py 378ms 2.6ms 103.6MB 327ms 33ms pypy 3.10.14
python 1.py 3059ms 119ms 37.1MB 3030ms 17ms cpython 3.13.0
python 1.py timeout 0.0ms 48.9MB 4953ms 33ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 407ms 3.6ms 4.7MB 400ms 0ms kotlin/native 1.8.21
kotlin 1.kt 446ms 1.4ms 49.5MB 480ms 23ms kotlin/jvm 21
python 2.py 1352ms 14ms 59.8MB 1320ms 17ms pypy 3.10.14
python 1.py 2641ms 30ms 56.6MB 2610ms 13ms pypy 3.10.14
python 1.py timeout 0.0ms 8.8MB 4987ms 0ms cpython 3.13.0
python 2.py timeout 0.0ms 8.8MB 4983ms 0ms cpython 3.13.0
python 1.py timeout 0.0ms 8.3MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4990ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1n.kt 46ms 0.7ms 4.7MB 40ms 0ms kotlin/native 1.8.21
kotlin 1.kt 123ms 1.1ms 49.4MB 163ms 20ms kotlin/jvm 21
python 2.py 180ms 2.7ms 57.6MB 153ms 10ms pypy 3.10.14
python 1.py 304ms 5.3ms 56.8MB 277ms 10ms pypy 3.10.14
python 1.py 1078ms 255ms 8.3MB 1063ms 0ms pyston 3.8.12
python 2.py 1319ms 15ms 8.1MB 1303ms 0ms pyston 3.8.12
python 1.py 2912ms 17ms 8.8MB 2900ms 0ms cpython 3.13.0
python 2.py 3132ms 41ms 8.8MB 3123ms 0ms cpython 3.13.0

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1907ms 12ms 8.9MB 1853ms 37ms pyston 3.8.12
python 4.py 1961ms 9.8ms 9.5MB 1897ms 47ms cpython 3.13.0
python 4.py 2141ms 12ms 89.1MB 2093ms 33ms pypy 3.10.14
kotlin 1.kt 3707ms 69ms 352.5MB 4577ms 93ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 20.9MB 6393ms 267ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.2MB 4993ms 160ms kotlin/native 1.8.21

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 450ms 3.5ms 8.6MB 437ms 0ms pyston 3.8.12
python 4.py 484ms 30ms 9.1MB 470ms 0ms cpython 3.13.0
python 4.py 545ms 13ms 83.5MB 503ms 27ms pypy 3.10.14
kotlin 1-m.kt 1004ms 32ms 354.5MB 1770ms 80ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 7.4MB 6367ms 263ms kotlin/native 1.8.21
kotlin 2n.kt timeout 0.0ms 8.3MB 5000ms 160ms kotlin/native 1.8.21

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 2217ms 5.8ms 243.1MB 2157ms 43ms pypy 3.10.14
python 1.py 4742ms 15ms 226.2MB 4557ms 170ms pyston 3.8.12
kotlin 1.kt timeout 0.0ms 171.4MB 5410ms 40ms kotlin/jvm 21
kotlin 1n.kt timeout 0.0ms 279.1MB 4977ms 917ms kotlin/native 1.8.21
python 1.py timeout 0.0ms 179.6MB 4903ms 77ms cpython 3.13.0

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 330ms 5.3ms 85.5MB 283ms 30ms pypy 3.10.14
python 1.py 493ms 3.6ms 30.3MB 450ms 27ms pyston 3.8.12
python 1.py 587ms 4.1ms 29.9MB 547ms 23ms cpython 3.13.0
kotlin 1-m.kt 814ms 12ms 134.0MB 1243ms 23ms kotlin/jvm 21
kotlin 1n.kt 3217ms 72ms 65.1MB 4043ms 10ms kotlin/native 1.8.21

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
kotlin 1.kt 3074ms 58ms 231.7MB 3977ms 60ms kotlin/jvm 21
python 1.py 3142ms 2.3ms 8.3MB 3133ms 0ms pyston 3.8.12
python 1.py 3709ms 13ms 74.6MB 3663ms 30ms pypy 3.10.14
python 1.py 3866ms 69ms 8.8MB 3857ms 0ms cpython 3.13.0

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 799ms 3.3ms 8.3MB 783ms 0ms pyston 3.8.12
python 1.py 976ms 18ms 8.8MB 960ms 0ms cpython 3.13.0
kotlin 1-m.kt 1039ms 9.3ms 232.3MB 1953ms 67ms kotlin/jvm 21
python 1.py 1043ms 10ms 67.5MB 1003ms 17ms pypy 3.10.14