C# VS Python benchmarks

Current benchmark data was generated on Thu Feb 01 2024, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][4 cores] AMD EPYC 7763 64-Core Processor (Model 1)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1213ms 21ms 132.8MB 1443ms 180ms dotnet/aot 8.0.101
python 1.py 1568ms 90ms 79.1MB 1510ms 40ms pypy 3.10.13
csharp 1.cs 1714ms 70ms 109.8MB 1903ms 220ms mono 6.12.0
csharp 1.cs 1868ms 70ms 2126.1MB 710ms 1117ms dotnet 8.0.101
python 1.py timeout 0.0ms 41.3MB 4977ms 10ms cpython 3.12.1
python 1.py timeout 0.0ms 40.5MB 4763ms 223ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 92ms 2.7ms 29.1MB 93ms 13ms dotnet/aot 8.0.101
python 1.py 116ms 0.7ms 62.6MB 80ms 20ms pypy 3.10.13
csharp 1.cs 142ms 1.4ms 44.9MB 117ms 13ms mono 6.12.0
csharp 1.cs 283ms 5.7ms 229.7MB 130ms 113ms dotnet 8.0.101
python 1.py 478ms 4.3ms 11.9MB 450ms 13ms pyston 3.8.12
python 1.py 732ms 6.5ms 13.1MB 713ms 0ms cpython 3.12.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 301ms 0.9ms 20.4MB 277ms 7ms cpython 3.12.1
csharp 1-m.cs 2301ms 32ms 38.5MB 7933ms 73ms dotnet/aot 8.0.101
csharp 1-m.cs 2776ms 120ms 746.6MB 7507ms 713ms dotnet 8.0.101
python 1.py 3056ms 23ms 116.4MB 2993ms 47ms pypy 3.10.13
python 1.py timeout 0.0ms 17.3MB 4980ms 7ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1-m.cs 159ms 15ms 29.8MB 443ms 20ms dotnet/aot 8.0.101
python 1.py 292ms 2.9ms 82.9MB 243ms 30ms pypy 3.10.13
csharp 1-m.cs 294ms 6.8ms 93.7MB 733ms 47ms dotnet 8.0.101
python 1.py 303ms 0.9ms 20.4MB 280ms 7ms cpython 3.12.1
python 1.py 653ms 8.2ms 16.8MB 637ms 0ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 257ms 4.7ms 63.0MB 223ms 17ms pypy 3.10.13
python 1.py 355ms 7.3ms 13.0MB 333ms 7ms cpython 3.12.1
python 1.py 1998ms 10ms 9.6MB 1980ms 3ms pyston 3.8.12
csharp 1.cs 4390ms 10ms 24.9MB 4380ms 7ms dotnet/aot 8.0.101
csharp 1.cs 4615ms 25ms 49.5MB 4570ms 33ms dotnet 8.0.101

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 105ms 3.0ms 61.5MB 77ms 17ms pypy 3.10.13
python 1.py 132ms 49ms 12.0MB 93ms 0ms cpython 3.12.1
python 1.py 347ms 2.1ms 8.8MB 330ms 0ms pyston 3.8.12
csharp 1.cs 738ms 1.4ms 21.0MB 730ms 3ms dotnet/aot 8.0.101
csharp 1.cs 848ms 3.6ms 40.1MB 807ms 10ms dotnet 8.0.101

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 133ms 7.9ms 36.2MB 380ms 83ms dotnet/aot 8.0.101
csharp 5-m.cs 205ms 9.6ms 45.3MB 477ms 117ms dotnet 8.0.101
csharp 5-m.cs 262ms 5.6ms 47.9MB 683ms 147ms mono 6.12.0
python 1.py 1945ms 8.0ms 62.7MB 1917ms 10ms pypy 3.10.13
python 5-m.py 2465ms 14ms 12.4MB 3553ms 1027ms pyston 3.8.12
python 5-m.py 2926ms 14ms 63.1MB 4217ms 773ms pypy 3.10.13
python 1.py 3002ms 24ms 8.1MB 2987ms 0ms pyston 3.8.12
python 5-m.py 3316ms 15ms 14.3MB 4393ms 993ms cpython 3.12.1
python 1.py 4481ms 71ms 9.3MB 4473ms 0ms cpython 3.12.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 34ms 1.8ms 27.0MB 50ms 27ms dotnet/aot 8.0.101
csharp 5-m.cs 85ms 10ms 42.7MB 110ms 30ms mono 6.12.0
csharp 5.cs 86ms 6.4ms 42.0MB 83ms 20ms dotnet 8.0.101
python 1.py 267ms 4.6ms 61.3MB 240ms 7ms pypy 3.10.13
python 5-m.py 314ms 12ms 12.5MB 407ms 147ms pyston 3.8.12
python 1.py 316ms 1.5ms 8.1MB 303ms 3ms pyston 3.8.12
python 5-m.py 401ms 1.6ms 14.3MB 463ms 167ms cpython 3.12.1
python 1.py 469ms 14ms 9.3MB 457ms 0ms cpython 3.12.1
python 5-m.py 657ms 11ms 63.1MB 880ms 367ms pypy 3.10.13

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 12ms 11ms 16.2MB 0ms 0ms dotnet/aot 8.0.101
python 1.py 12ms 0.9ms 7.6MB 0ms 0ms pyston 3.8.12
python 1.py 14ms 1.3ms 9.0MB 0ms 0ms cpython 3.12.1
python 1.py 30ms 1.2ms 48.6MB 8ms 8ms pypy 3.10.13
csharp 1.cs 32ms 0.5ms 23.8MB 18ms 2ms mono 6.12.0
csharp 1.cs 56ms 6.0ms 31.4MB 20ms 2ms dotnet 8.0.101

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 629ms 6.5ms 119.0MB 820ms 160ms dotnet 8.0.101
csharp 2-m.cs 716ms 35ms 148.5MB 767ms 627ms dotnet 8.0.101
csharp 1-m.cs 846ms 24ms 171.9MB 1123ms 817ms dotnet 8.0.101
csharp 2-http3.cs 857ms 32ms 151.8MB 1227ms 317ms dotnet 8.0.101
python 1.py 2025ms 149ms 36.9MB 1037ms 1437ms pyston 3.8.12
python 1.py 2549ms 259ms 33.6MB 1583ms 1460ms cpython 3.12.1
python 1.py 4777ms 225ms 98.0MB 3277ms 1110ms pypy 3.10.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 434ms 9.7ms 98.1MB 387ms 183ms dotnet 8.0.101
csharp 1-m.cs 471ms 12ms 106.5MB 527ms 223ms dotnet 8.0.101
csharp 2-http2.cs 559ms 14ms 95.7MB 530ms 123ms dotnet 8.0.101
csharp 2-http3.cs 622ms 17ms 106.2MB 660ms 150ms dotnet 8.0.101
python 1.py 1113ms 9.9ms 28.9MB 323ms 247ms cpython 3.12.1
python 1.py 1119ms 55ms 30.6MB 210ms 260ms pyston 3.8.12
python 1.py 1605ms 357ms 88.8MB 810ms 207ms pypy 3.10.13

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 201ms 6.4ms 38.4MB 160ms 27ms pyston 3.8.12
python 1.py 230ms 2.7ms 39.0MB 203ms 10ms cpython 3.12.1
csharp 2.cs 312ms 1.6ms 80.6MB 257ms 23ms dotnet 8.0.101
python 1.py 326ms 1.1ms 85.7MB 280ms 27ms pypy 3.10.13
csharp 1.cs 740ms 51ms 155.1MB 740ms 90ms dotnet 8.0.101

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1420ms 45ms 316.0MB 1503ms 157ms dotnet 8.0.101
python 1.py 1829ms 10ms 220.5MB 1663ms 147ms pyston 3.8.12
python 1.py 1914ms 6.7ms 221.7MB 1797ms 100ms cpython 3.12.1
python 1.py 1969ms 28ms 221.1MB 1883ms 70ms pypy 3.10.13
csharp 1.cs 2325ms 42ms 805.3MB 2287ms 427ms dotnet 8.0.101

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 511ms 13ms 56.0MB 1300ms 30ms dotnet/aot 8.0.101
csharp 6-m.cs 629ms 31ms 82.6MB 1287ms 43ms dotnet 8.0.101
csharp 6-m.cs 1015ms 14ms 69.1MB 2943ms 27ms mono 6.12.0
python 3-m.py 2331ms 35ms 135.9MB 7750ms 343ms pypy 3.10.13
python 3-m.py 3289ms 49ms 34.2MB 12493ms 123ms pyston 3.8.12
python 3.py timeout 0.0ms 35.9MB 87ms 27ms cpython 3.12.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 98ms 5.9ms 46.2MB 173ms 23ms dotnet/aot 8.0.101
csharp 6.cs 167ms 13ms 72.2MB 207ms 30ms dotnet 8.0.101
csharp 6-m.cs 198ms 0.7ms 57.8MB 380ms 20ms mono 6.12.0
python 3-m.py 404ms 0.9ms 17.7MB 1333ms 70ms pyston 3.8.12
python 3-m.py 409ms 2.6ms 71.4MB 1023ms 163ms pypy 3.10.13
python 3-m.py 694ms 3.6ms 17.5MB 2423ms 80ms cpython 3.12.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 106ms 1.6ms 14.1MB 100ms 0ms dotnet/aot 8.0.101
csharp 2.cs 148ms 4.4ms 23.7MB 133ms 0ms mono 6.12.0
python 2.py 154ms 4.7ms 56.8MB 123ms 17ms pypy 3.10.13
python 1.py 189ms 6.3ms 59.5MB 160ms 13ms pypy 3.10.13
csharp 2.cs 275ms 12ms 32.4MB 233ms 10ms dotnet 8.0.101
python 1.py 729ms 10ms 8.9MB 713ms 0ms pyston 3.8.12
python 2.py 851ms 3.5ms 8.5MB 840ms 0ms pyston 3.8.12
csharp 1.cs 1019ms 3.2ms 17.3MB 1010ms 10ms dotnet/aot 8.0.101
python 1.py 1105ms 12ms 9.9MB 1093ms 0ms cpython 3.12.1
python 2.py 1288ms 22ms 9.5MB 1277ms 0ms cpython 3.12.1
csharp 1.cs 1444ms 29ms 163.2MB 1333ms 93ms dotnet 8.0.101
csharp 1.cs 3317ms 12ms 48.3MB 3263ms 47ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 293ms 5.4ms 12.1MB 287ms 0ms dotnet/aot 8.0.101
python 2.py 349ms 3.5ms 59.9MB 327ms 10ms pypy 3.10.13
csharp 2.cs 358ms 4.8ms 27.1MB 347ms 0ms mono 6.12.0
python 1.py 395ms 5.9ms 60.9MB 367ms 17ms pypy 3.10.13
csharp 2.cs 421ms 6.2ms 34.8MB 383ms 10ms dotnet 8.0.101
python 1.py 2192ms 83ms 8.9MB 2180ms 0ms pyston 3.8.12
python 2.py 2556ms 13ms 8.5MB 2547ms 0ms pyston 3.8.12
csharp 1.cs 3057ms 18ms 17.1MB 3037ms 17ms dotnet/aot 8.0.101
python 1.py 3250ms 26ms 9.9MB 3233ms 0ms cpython 3.12.1
python 2.py 3744ms 9.6ms 9.5MB 3733ms 0ms cpython 3.12.1
csharp 1.cs 3997ms 26ms 422.9MB 3770ms 203ms dotnet 8.0.101
csharp 1.cs timeout 0.0ms 46.4MB 4930ms 60ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 59ms 0.4ms 16.1MB 55ms 5ms dotnet/aot 8.0.101
csharp 2.cs 96ms 0.3ms 25.4MB 83ms 3ms mono 6.12.0
python 2.py 113ms 4.7ms 56.5MB 87ms 10ms pypy 3.10.13
python 1.py 122ms 0.4ms 57.5MB 93ms 10ms pypy 3.10.13
csharp 2.cs 195ms 1.6ms 32.5MB 147ms 13ms dotnet 8.0.101
python 1.py 349ms 6.2ms 8.5MB 337ms 0ms pyston 3.8.12
python 2.py 391ms 3.9ms 8.1MB 380ms 0ms pyston 3.8.12
python 1.py 528ms 10ms 9.5MB 517ms 0ms cpython 3.12.1
python 2.py 616ms 7.8ms 9.3MB 603ms 0ms cpython 3.12.1
csharp 1.cs 1709ms 2.4ms 16.9MB 1707ms 0ms dotnet/aot 8.0.101
csharp 1.cs 1719ms 9.1ms 86.6MB 1663ms 33ms dotnet 8.0.101
csharp 1.cs 1812ms 7.4ms 29.2MB 1793ms 3ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 666ms 69ms 209.7MB 540ms 90ms dotnet 8.0.101
csharp 1.cs 2059ms 1.7ms 42.1MB 2023ms 10ms dotnet 8.0.101
csharp 3.cs 2491ms 24ms 42.5MB 2443ms 20ms dotnet 8.0.101
csharp 3.cs 2491ms 7.0ms 22.6MB 2487ms 0ms dotnet/aot 8.0.101
csharp 1.cs 3587ms 56ms 22.7MB 3583ms 0ms dotnet/aot 8.0.101
csharp 1.cs timeout 0.0ms 25.1MB 4980ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3.cs 116ms 1.6ms 19.4MB 110ms 0ms dotnet/aot 8.0.101
csharp 2.cs 138ms 11ms 46.2MB 103ms 7ms dotnet 8.0.101
csharp 1.cs 160ms 4.9ms 39.4MB 127ms 3ms dotnet 8.0.101
csharp 1.cs 162ms 2.6ms 19.7MB 157ms 3ms dotnet/aot 8.0.101
csharp 3.cs 218ms 31ms 39.6MB 177ms 13ms dotnet 8.0.101
csharp 1.cs 569ms 2.0ms 26.0MB 553ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 520ms 2.4ms 155.2MB 587ms 87ms dotnet/aot 8.0.101
csharp 1.cs 601ms 10ms 107.3MB 693ms 97ms dotnet/aot 8.0.101
csharp 2.cs 1201ms 5.0ms 1295.1MB 493ms 673ms dotnet 8.0.101
csharp 1.cs 1308ms 29ms 144.8MB 1517ms 157ms mono 6.12.0
csharp 1.cs 1565ms 4.3ms 1869.6MB 580ms 943ms dotnet 8.0.101
python 1.py 2604ms 19ms 201.5MB 2490ms 97ms pypy 3.10.13
python 1.py timeout 0.0ms 81.6MB 4970ms 20ms cpython 3.12.1
python 1.py timeout 0.0ms 130.4MB 4943ms 40ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 110ms 2.0ms 38.0MB 113ms 17ms dotnet/aot 8.0.101
csharp 1.cs 123ms 1.1ms 48.4MB 130ms 23ms dotnet/aot 8.0.101
csharp 1.cs 262ms 7.9ms 73.9MB 237ms 33ms mono 6.12.0
csharp 2.cs 371ms 4.9ms 305.1MB 183ms 157ms dotnet 8.0.101
csharp 1.cs 441ms 8.6ms 428.5MB 170ms 237ms dotnet 8.0.101
python 1.py 487ms 3.0ms 94.2MB 440ms 30ms pypy 3.10.13
python 1.py timeout 0.0ms 34.1MB 4977ms 7ms cpython 3.12.1
python 1.py timeout 0.0ms 41.4MB 4970ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 375ms 1.6ms 14.2MB 370ms 3ms dotnet/aot 8.0.101
csharp 9.cs 383ms 7.2ms 33.1MB 343ms 10ms dotnet 8.0.101
csharp 8.cs 433ms 3.3ms 32.9MB 393ms 7ms dotnet 8.0.101
csharp 8.cs 1248ms 6.8ms 24.9MB 1230ms 3ms mono 6.12.0
python 2.py 1386ms 17ms 60.4MB 1357ms 17ms pypy 3.10.13
python 1.py 2647ms 17ms 54.1MB 2617ms 10ms pypy 3.10.13
python 1.py timeout 0.0ms 9.1MB 4987ms 0ms cpython 3.12.1
python 2.py timeout 0.0ms 9.3MB 4990ms 0ms cpython 3.12.1
python 1.py timeout 0.0ms 8.3MB 4980ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.1MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 48ms 1.3ms 16.1MB 43ms 3ms dotnet/aot 8.0.101
csharp 8.cs 106ms 7.9ms 33.2MB 67ms 10ms dotnet 8.0.101
csharp 9.cs 114ms 2.8ms 33.1MB 77ms 10ms dotnet 8.0.101
csharp 8.cs 162ms 1.0ms 27.0MB 150ms 0ms mono 6.12.0
python 2.py 179ms 0.4ms 55.8MB 153ms 10ms pypy 3.10.13
python 1.py 305ms 5.4ms 54.0MB 283ms 10ms pypy 3.10.13
python 1.py 942ms 43ms 8.3MB 930ms 0ms pyston 3.8.12
python 2.py 1314ms 31ms 8.1MB 1300ms 0ms pyston 3.8.12
python 1.py 2986ms 131ms 9.1MB 2973ms 0ms cpython 3.12.1
python 2.py 3077ms 2.2ms 9.1MB 3063ms 0ms cpython 3.12.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 346ms 5.2ms 101.3MB 303ms 10ms dotnet 8.0.101
csharp 1.cs 353ms 5.9ms 55.6MB 340ms 3ms dotnet/aot 8.0.101
csharp 2.cs 427ms 2.0ms 21.2MB 423ms 3ms dotnet/aot 8.0.101
csharp 2.cs 441ms 0.4ms 41.7MB 397ms 13ms dotnet 8.0.101
csharp 1.cs 544ms 3.3ms 86.6MB 520ms 13ms mono 6.12.0
csharp 2.cs 1861ms 11ms 29.9MB 1843ms 0ms mono 6.12.0
python 2.py 3061ms 79ms 632.9MB 2887ms 157ms pyston 3.8.12
python 1.py 3479ms 37ms 366.2MB 3410ms 50ms pypy 3.10.13
python 1.py 4862ms 92ms 320.5MB 4807ms 47ms pyston 3.8.12
python 2.py 4871ms 47ms 634.1MB 4697ms 160ms cpython 3.12.1
python 1.py timeout 0.0ms 321.7MB 4963ms 23ms cpython 3.12.1
python 2.py timeout 0.0ms 956.8MB 4737ms 247ms pypy 3.10.13

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 81ms 1.1ms 23.9MB 70ms 7ms dotnet/aot 8.0.101
csharp 2.cs 111ms 0.4ms 18.2MB 110ms 0ms dotnet/aot 8.0.101
csharp 1.cs 114ms 3.7ms 49.8MB 77ms 7ms dotnet 8.0.101
csharp 1.cs 144ms 0.9ms 40.8MB 127ms 7ms mono 6.12.0
csharp 2.cs 153ms 1.7ms 35.4MB 117ms 7ms dotnet 8.0.101
csharp 2.cs 482ms 4.0ms 25.5MB 467ms 0ms mono 6.12.0
python 1.py 698ms 9.1ms 131.7MB 667ms 17ms pypy 3.10.13
python 2.py 735ms 2.3ms 164.3MB 690ms 23ms pyston 3.8.12
python 1.py 1113ms 6.9ms 86.0MB 1087ms 7ms pyston 3.8.12
python 2.py 1213ms 1.8ms 165.4MB 1170ms 30ms cpython 3.12.1
python 1.py 2241ms 84ms 87.3MB 2217ms 10ms cpython 3.12.1
python 2.py 2612ms 31ms 283.0MB 2523ms 77ms pypy 3.10.13

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 1897ms 5.0ms 8.9MB 1850ms 30ms pyston 3.8.12
python 4.py 1959ms 2.6ms 9.9MB 1910ms 33ms cpython 3.12.1
python 4.py 2334ms 11ms 63.4MB 2280ms 37ms pypy 3.10.13
csharp 1.cs 3233ms 16ms 19.9MB 3110ms 137ms dotnet/aot 8.0.101
csharp 1.cs timeout 0.0ms 4256.5MB 3027ms 1923ms dotnet 8.0.101

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 450ms 3.6ms 8.8MB 433ms 0ms pyston 3.8.12
python 4.py 466ms 5.6ms 9.6MB 450ms 0ms cpython 3.12.1
python 4.py 569ms 8.0ms 61.9MB 537ms 13ms pypy 3.10.13
csharp 1.cs 760ms 5.7ms 19.4MB 723ms 33ms dotnet/aot 8.0.101
csharp 1.cs 1552ms 36ms 1164.4MB 1013ms 597ms dotnet 8.0.101

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1736ms 3.9ms 420.5MB 1720ms 107ms dotnet/aot 8.0.101
csharp 5.cs 2003ms 27ms 442.9MB 2103ms 167ms dotnet 8.0.101
python 1.py 2250ms 4.5ms 233.5MB 2197ms 33ms pypy 3.10.13
csharp 6.cs 2791ms 7.4ms 441.8MB 2800ms 163ms dotnet 8.0.101
csharp 5.cs 4198ms 19ms 422.4MB 4183ms 120ms dotnet/aot 8.0.101
python 1.py 4736ms 9.4ms 226.2MB 4533ms 187ms pyston 3.8.12
python 1.py timeout 0.0ms 129.4MB 4950ms 37ms cpython 3.12.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 198ms 2.5ms 56.4MB 187ms 20ms dotnet/aot 8.0.101
csharp 5.cs 299ms 0.8ms 79.2MB 253ms 37ms dotnet 8.0.101
python 1.py 342ms 4.3ms 75.2MB 303ms 23ms pypy 3.10.13
csharp 6.cs 407ms 1.8ms 77.2MB 367ms 37ms dotnet 8.0.101
csharp 5.cs 448ms 9.0ms 58.2MB 440ms 10ms dotnet/aot 8.0.101
python 1.py 493ms 1.8ms 30.5MB 463ms 17ms pyston 3.8.12
python 1.py 616ms 5.5ms 29.9MB 577ms 20ms cpython 3.12.1

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 2745ms 25ms 17.2MB 2707ms 37ms dotnet/aot 8.0.101
python 1.py 3144ms 7.0ms 8.3MB 3127ms 0ms pyston 3.8.12
csharp 1.cs 3518ms 28ms 1354.7MB 2813ms 747ms dotnet 8.0.101
python 1.py 3598ms 18ms 9.1MB 3590ms 0ms cpython 3.12.1
python 1.py 3760ms 22ms 62.8MB 3723ms 20ms pypy 3.10.13

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 714ms 21ms 14.9MB 703ms 10ms dotnet/aot 8.0.101
python 1.py 801ms 9.6ms 8.3MB 790ms 0ms pyston 3.8.12
python 1.py 914ms 2.1ms 9.1MB 900ms 0ms cpython 3.12.1
python 1.py 1044ms 16ms 61.5MB 1020ms 10ms pypy 3.10.13
csharp 1.cs 1074ms 24ms 365.8MB 920ms 193ms dotnet 8.0.101

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 1868ms 28ms 18.9MB 7187ms 17ms dotnet/aot 8.0.101
csharp 3-m.cs 2016ms 168ms 39.0MB 7077ms 27ms dotnet 8.0.101
csharp 3-m.cs 4685ms 117ms 29.1MB 17887ms 20ms mono 6.12.0
python 8.py timeout 0.0ms 17.2MB 57ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 76.8MB 967ms 133ms pypy 3.10.13
python 8.py timeout 0.0ms 18.1MB 63ms 10ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 477ms 2.0ms 18.7MB 1807ms 10ms dotnet/aot 8.0.101
csharp 3-m.cs 536ms 3.2ms 36.9MB 1843ms 17ms dotnet 8.0.101
csharp 3-m.cs 1178ms 36ms 29.3MB 4430ms 7ms mono 6.12.0
python 8.py timeout 0.0ms 16.8MB 100ms 13ms cpython 3.12.1
python 8.py timeout 0.0ms 75.9MB 1767ms 440ms pypy 3.10.13
python 8.py timeout 0.0ms 17.8MB 150ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 132ms 0.4ms 18.9MB 453ms 3ms dotnet/aot 8.0.101
csharp 3-m.cs 191ms 6.2ms 35.6MB 490ms 10ms dotnet 8.0.101
csharp 3-m.cs 344ms 4.8ms 33.1MB 1147ms 17ms mono 6.12.0
python 8-m.py 2161ms 17ms 76.3MB 6830ms 320ms pypy 3.10.13
python 8.py timeout 0.0ms 14.6MB 293ms 40ms cpython 3.12.1
python 8.py timeout 0.0ms 17.2MB 430ms 120ms pyston 3.8.12