Current benchmark data was generated on Wed Jan 22 2025, full log can be found HERE
CONTRIBUTIONS are WELCOME!
* -m in a file name stands for multi-threading or multi-processing
* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)
* -ffi in a file name stands for non-stdlib FFI usage
* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1.kt | 487ms | 33ms | 1217.6MB | 527ms | 123ms | kotlin/jvm 21 |
python | 1.py | 1189ms | 1.9ms | 95.8MB | 1113ms | 57ms | pypy 3.10.14 |
kotlin | 1-m.kt | 3121ms | 31ms | 248.4MB | 5273ms | 667ms | kotlin/native 1.8.21 |
python | 1.py | timeout | 0.0ms | 40.9MB | 4970ms | 17ms | cpython 3.13.1 |
python | 1.py | timeout | 0.0ms | 40.6MB | 4760ms | 227ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 96ms | 2.4ms | 68.1MB | 67ms | 20ms | pypy 3.10.14 |
kotlin | 1.kt | 99ms | 1.2ms | 158.3MB | 103ms | 30ms | kotlin/jvm 21 |
kotlin | 1-m.kt | 266ms | 1.2ms | 28.5MB | 413ms | 67ms | kotlin/native 1.8.21 |
python | 1.py | 486ms | 19ms | 11.9MB | 457ms | 13ms | pyston 3.8.12 |
python | 1.py | 705ms | 9.2ms | 12.6MB | 693ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1197ms | 18ms | 104.0MB | 1157ms | 23ms | pypy 3.10.14 |
kotlin | 2-m.kt | 1809ms | 268ms | 235.5MB | 6717ms | 107ms | kotlin/jvm 21 |
kotlin | 1.kt | 2109ms | 6.9ms | 219.7MB | 2923ms | 63ms | kotlin/jvm 21 |
kotlin | 1.kt | timeout | 0.0ms | 14.8MB | 6100ms | 460ms | kotlin/native 1.8.21 |
kotlin | 2-m.kt | timeout | 0.0ms | 69.5MB | 18963ms | 130ms | kotlin/native 1.8.21 |
python | 1.py | timeout | 0.0ms | 21.1MB | 4977ms | 7ms | cpython 3.13.1 |
python | 1.py | timeout | 0.0ms | 17.3MB | 4977ms | 7ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 223ms | 3.7ms | 84.4MB | 177ms | 27ms | pypy 3.10.14 |
kotlin | 2-m.kt | 386ms | 11ms | 54.6MB | 1410ms | 27ms | kotlin/native 1.8.21 |
kotlin | 1-m.kt | 463ms | 6.2ms | 73.9MB | 1070ms | 43ms | kotlin/jvm 21 |
python | 1.py | 575ms | 1.9ms | 20.5MB | 553ms | 7ms | cpython 3.13.1 |
python | 1.py | 669ms | 11ms | 16.8MB | 647ms | 7ms | pyston 3.8.12 |
kotlin | 1.kt | 675ms | 7.0ms | 10.7MB | 803ms | 70ms | kotlin/native 1.8.21 |
kotlin | 2-m.kt | 742ms | 27ms | 99.3MB | 2503ms | 90ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1.kt | 2.4ms | 0.5ms | 4.7MB | 0ms | 0ms | kotlin/native 1.8.21 |
python | 1.py | 12ms | 1.1ms | 7.6MB | 0ms | 0ms | pyston 3.8.12 |
python | 1.py | 14ms | 1.2ms | 8.5MB | 10ms | 0ms | cpython 3.13.1 |
python | 1.py | 28ms | 0.6ms | 51.0MB | 10ms | 8ms | pypy 3.10.14 |
kotlin | 1.kt | 54ms | 6.4ms | 47.4MB | 54ms | 16ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 2-m.kt | 807ms | 1397ms | 456.2MB | 10660ms | 1630ms | kotlin/jvm 21 |
python | 1.py | 2089ms | 98ms | 36.3MB | 1090ms | 1573ms | pyston 3.8.12 |
python | 1.py | 2602ms | 353ms | 33.4MB | 1593ms | 1583ms | cpython 3.13.1 |
python | 1.py | 4715ms | 247ms | 107.1MB | 2877ms | 1207ms | pypy 3.10.14 |
kotlin | 1.kt | timeout | 0.0ms | 393.0MB | 16180ms | 2813ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1097ms | 19ms | 28.7MB | 237ms | 273ms | pyston 3.8.12 |
python | 1.py | 1169ms | 48ms | 28.7MB | 317ms | 277ms | cpython 3.13.1 |
python | 1.py | 1648ms | 408ms | 90.6MB | 717ms | 220ms | pypy 3.10.14 |
kotlin | 2-m.kt | 2185ms | 260ms | 239.6MB | 4107ms | 410ms | kotlin/jvm 21 |
kotlin | 1-m.kt | 2220ms | 269ms | 241.0MB | 6507ms | 647ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 199ms | 3.1ms | 38.1MB | 170ms | 13ms | pyston 3.8.12 |
python | 1.py | 219ms | 2.4ms | 38.6MB | 190ms | 10ms | cpython 3.13.1 |
python | 1.py | 295ms | 1.7ms | 87.4MB | 257ms | 23ms | pypy 3.10.14 |
kotlin | 1-m.kt | 832ms | 44ms | 198.9MB | 2267ms | 67ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 1828ms | 10ms | 220.4MB | 1650ms | 163ms | pyston 3.8.12 |
python | 1.py | 1906ms | 5.8ms | 222.2MB | 1817ms | 73ms | pypy 3.10.14 |
python | 1.py | 1909ms | 11ms | 221.8MB | 1807ms | 87ms | cpython 3.13.1 |
kotlin | 1-m.kt | 2318ms | 66ms | 1048.1MB | 5023ms | 170ms | kotlin/jvm 21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 146ms | 1.1ms | 57.9MB | 120ms | 13ms | pypy 3.10.14 |
kotlin | 1-m.kt | 177ms | 0.9ms | 94.9MB | 293ms | 37ms | kotlin/jvm 21 |
python | 1.py | 181ms | 1.4ms | 59.5MB | 153ms | 10ms | pypy 3.10.14 |
kotlin | 2-m.kt | 197ms | 4.0ms | 102.2MB | 413ms | 37ms | kotlin/jvm 21 |
kotlin | 2.kt | 305ms | 3.4ms | 7.8MB | 437ms | 7ms | kotlin/native 1.8.21 |
kotlin | 1.kt | 521ms | 19ms | 7.8MB | 623ms | 3ms | kotlin/native 1.8.21 |
python | 1.py | 718ms | 4.4ms | 8.9MB | 707ms | 0ms | pyston 3.8.12 |
python | 2.py | 832ms | 3.1ms | 8.5MB | 817ms | 0ms | pyston 3.8.12 |
python | 1.py | 1101ms | 2.8ms | 9.3MB | 1083ms | 0ms | cpython 3.13.1 |
python | 2.py | 1309ms | 4.2ms | 9.1MB | 1297ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 2-m.kt | 317ms | 11ms | 213.0MB | 513ms | 47ms | kotlin/jvm 21 |
kotlin | 1.kt | 325ms | 3.6ms | 202.9MB | 443ms | 30ms | kotlin/jvm 21 |
python | 2.py | 338ms | 1.6ms | 58.9MB | 313ms | 7ms | pypy 3.10.14 |
python | 1.py | 385ms | 6.4ms | 60.4MB | 353ms | 13ms | pypy 3.10.14 |
kotlin | 2.kt | 907ms | 26ms | 7.8MB | 1293ms | 50ms | kotlin/native 1.8.21 |
kotlin | 1.kt | 1564ms | 31ms | 7.9MB | 1900ms | 33ms | kotlin/native 1.8.21 |
python | 1.py | 2127ms | 17ms | 8.9MB | 2110ms | 0ms | pyston 3.8.12 |
python | 2.py | 2489ms | 22ms | 8.5MB | 2473ms | 0ms | pyston 3.8.12 |
python | 1.py | 3291ms | 15ms | 9.3MB | 3283ms | 0ms | cpython 3.13.1 |
python | 2.py | 3877ms | 18ms | 9.0MB | 3860ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 2.py | 106ms | 2.6ms | 57.8MB | 83ms | 7ms | pypy 3.10.14 |
python | 1.py | 122ms | 2.7ms | 58.5MB | 103ms | 10ms | pypy 3.10.14 |
kotlin | 1-m.kt | 141ms | 6.8ms | 90.5MB | 270ms | 27ms | kotlin/jvm 21 |
kotlin | 2.kt | 141ms | 4.0ms | 5.7MB | 193ms | 0ms | kotlin/native 1.8.21 |
kotlin | 2-m.kt | 152ms | 8.3ms | 93.7MB | 300ms | 33ms | kotlin/jvm 21 |
kotlin | 1.kt | 178ms | 5.5ms | 5.9MB | 230ms | 0ms | kotlin/native 1.8.21 |
python | 1.py | 345ms | 2.4ms | 8.5MB | 337ms | 0ms | pyston 3.8.12 |
python | 2.py | 390ms | 1.7ms | 8.1MB | 377ms | 0ms | pyston 3.8.12 |
python | 1.py | 523ms | 7.0ms | 9.0MB | 510ms | 0ms | cpython 3.13.1 |
python | 2.py | 622ms | 5.9ms | 8.6MB | 607ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1.kt | 344ms | 1.7ms | 679.6MB | 383ms | 67ms | kotlin/jvm 21 |
kotlin | 1-m.kt | 1514ms | 66ms | 136.5MB | 2323ms | 343ms | kotlin/native 1.8.21 |
python | 1.py | 2276ms | 12ms | 209.9MB | 2153ms | 103ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 93.9MB | 4953ms | 33ms | cpython 3.13.1 |
python | 1.py | timeout | 0.0ms | 130.4MB | 4923ms | 57ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1.kt | 127ms | 2.3ms | 208.6MB | 157ms | 30ms | kotlin/jvm 21 |
kotlin | 1-m.kt | 302ms | 3.5ms | 40.6MB | 430ms | 70ms | kotlin/native 1.8.21 |
python | 1.py | 389ms | 1.4ms | 103.6MB | 330ms | 43ms | pypy 3.10.14 |
python | 1.py | 3030ms | 33ms | 37.1MB | 3000ms | 17ms | cpython 3.13.1 |
python | 1.py | timeout | 0.0ms | 48.9MB | 4937ms | 47ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1n.kt | 405ms | 5.4ms | 4.7MB | 393ms | 0ms | kotlin/native 1.8.21 |
kotlin | 1.kt | 443ms | 4.4ms | 49.6MB | 483ms | 17ms | kotlin/jvm 21 |
python | 2.py | 1366ms | 23ms | 59.8MB | 1340ms | 10ms | pypy 3.10.14 |
python | 1.py | 2633ms | 17ms | 56.6MB | 2607ms | 13ms | pypy 3.10.14 |
python | 1.py | timeout | 0.0ms | 8.6MB | 4983ms | 3ms | cpython 3.13.1 |
python | 2.py | timeout | 0.0ms | 8.8MB | 4990ms | 0ms | cpython 3.13.1 |
python | 1.py | timeout | 0.0ms | 8.3MB | 4983ms | 3ms | pyston 3.8.12 |
python | 2.py | timeout | 0.0ms | 8.1MB | 4987ms | 0ms | pyston 3.8.12 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1n.kt | 46ms | 1.6ms | 4.6MB | 33ms | 0ms | kotlin/native 1.8.21 |
kotlin | 1.kt | 120ms | 1.7ms | 49.7MB | 160ms | 20ms | kotlin/jvm 21 |
python | 2.py | 177ms | 2.3ms | 57.6MB | 150ms | 13ms | pypy 3.10.14 |
python | 1.py | 306ms | 2.6ms | 56.6MB | 280ms | 10ms | pypy 3.10.14 |
python | 1.py | 921ms | 5.6ms | 8.3MB | 907ms | 0ms | pyston 3.8.12 |
python | 2.py | 1297ms | 37ms | 8.3MB | 1283ms | 0ms | pyston 3.8.12 |
python | 1.py | 2982ms | 117ms | 8.6MB | 2973ms | 0ms | cpython 3.13.1 |
python | 2.py | 3119ms | 42ms | 8.8MB | 3103ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 1907ms | 9.4ms | 8.9MB | 1860ms | 30ms | pyston 3.8.12 |
python | 4.py | 1988ms | 11ms | 9.4MB | 1930ms | 40ms | cpython 3.13.1 |
python | 4.py | 2128ms | 6.9ms | 89.0MB | 2090ms | 23ms | pypy 3.10.14 |
kotlin | 1.kt | 3713ms | 77ms | 353.7MB | 4497ms | 83ms | kotlin/jvm 21 |
kotlin | 1n.kt | timeout | 0.0ms | 7.4MB | 6367ms | 257ms | kotlin/native 1.8.21 |
kotlin | 2n.kt | timeout | 0.0ms | 8.3MB | 4983ms | 173ms | kotlin/native 1.8.21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 4.py | 451ms | 1.8ms | 8.6MB | 440ms | 0ms | pyston 3.8.12 |
python | 4.py | 470ms | 4.4ms | 9.3MB | 457ms | 0ms | cpython 3.13.1 |
python | 4.py | 542ms | 7.0ms | 83.4MB | 507ms | 17ms | pypy 3.10.14 |
kotlin | 1-m.kt | 1005ms | 20ms | 353.8MB | 1740ms | 70ms | kotlin/jvm 21 |
kotlin | 1n.kt | timeout | 0.0ms | 7.3MB | 6397ms | 293ms | kotlin/native 1.8.21 |
kotlin | 2n.kt | timeout | 0.0ms | 10.3MB | 5003ms | 153ms | kotlin/native 1.8.21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 2225ms | 7.0ms | 243.0MB | 2163ms | 47ms | pypy 3.10.14 |
python | 1.py | 4757ms | 33ms | 226.3MB | 4560ms | 180ms | pyston 3.8.12 |
kotlin | 1.kt | timeout | 0.0ms | 171.6MB | 5427ms | 37ms | kotlin/jvm 21 |
kotlin | 1n.kt | timeout | 0.0ms | 279.1MB | 5003ms | 860ms | kotlin/native 1.8.21 |
python | 1.py | timeout | 0.0ms | 108.7MB | 4957ms | 30ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 334ms | 2.9ms | 85.5MB | 293ms | 27ms | pypy 3.10.14 |
python | 1.py | 497ms | 5.0ms | 30.3MB | 460ms | 23ms | pyston 3.8.12 |
python | 1.py | 621ms | 3.4ms | 31.0MB | 593ms | 10ms | cpython 3.13.1 |
kotlin | 1-m.kt | 836ms | 29ms | 134.6MB | 1223ms | 50ms | kotlin/jvm 21 |
kotlin | 1n.kt | 3337ms | 226ms | 65.0MB | 4233ms | 10ms | kotlin/native 1.8.21 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
kotlin | 1.kt | 3090ms | 36ms | 231.3MB | 3953ms | 63ms | kotlin/jvm 21 |
python | 1.py | 3144ms | 17ms | 8.4MB | 3130ms | 0ms | pyston 3.8.12 |
python | 1.py | 3691ms | 14ms | 74.6MB | 3657ms | 17ms | pypy 3.10.14 |
python | 1.py | 3791ms | 31ms | 8.8MB | 3773ms | 0ms | cpython 3.13.1 |
lang | code | time | stddev | peak-mem mem | time(user) | time(sys) | compiler compiler/runtime |
---|---|---|---|---|---|---|---|
python | 1.py | 803ms | 5.5ms | 8.3MB | 787ms | 0ms | pyston 3.8.12 |
kotlin | 1-m.kt | 950ms | 29ms | 231.2MB | 1920ms | 57ms | kotlin/jvm 21 |
python | 1.py | 972ms | 12ms | 8.8MB | 957ms | 0ms | cpython 3.13.1 |
python | 1.py | 1037ms | 13ms | 67.6MB | 1010ms | 13ms | pypy 3.10.14 |