Programming Language and compiler
Benchmarks

C# VS Python benchmarks

Current benchmark data was generated on Mon Feb 06 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1487ms 35ms 306.6MB 1350ms 213ms dotnet/aot 7.0.102
csharp 1.cs 1715ms 29ms 426.3MB 1513ms 263ms dotnet 7.0.102
csharp 1.cs 2432ms 49ms 104.6MB 2877ms 213ms mono 6.12.0
python 1.py 2447ms 34ms 217.6MB 2300ms 130ms pypy 3.9.16
python 1.py timeout 0.0ms 40.8MB 4957ms 23ms cpython 3.11.1
python 1.py timeout 0.0ms 40.4MB 4933ms 47ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 144ms 6.2ms 59.4MB 120ms 17ms dotnet/aot 7.0.102
python 1.py 162ms 21ms 74.4MB 110ms 23ms pypy 3.9.16
csharp 1.cs 166ms 4.5ms 46.1MB 137ms 20ms mono 6.12.0
csharp 1.cs 281ms 3.2ms 151.0MB 200ms 53ms dotnet 7.0.102
python 1.py 674ms 6.1ms 12.0MB 653ms 7ms pyston 3.8.12
python 1.py 989ms 5.6ms 12.5MB 970ms 7ms cpython 3.11.1

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1606ms 14ms 219.5MB 1493ms 93ms pypy 3.9.16
csharp 1.cs timeout 0.0ms 159.7MB 9273ms 90ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 66.7MB 9393ms 50ms dotnet/aot 7.0.102
python 1.py timeout 0.0ms 20.1MB 4977ms 7ms cpython 3.11.1
python 1.py timeout 0.0ms 17.3MB 4970ms 3ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 316ms 15ms 87.9MB 260ms 37ms pypy 3.9.16
csharp 1-m.cs 384ms 14ms 52.2MB 663ms 27ms dotnet/aot 7.0.102
csharp 1-m.cs 619ms 42ms 143.6MB 960ms 63ms dotnet 7.0.102
python 1.py 816ms 26ms 20.0MB 783ms 0ms cpython 3.11.1
python 1.py 868ms 5.1ms 16.9MB 843ms 3ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 613ms 2.3ms 78.4MB 587ms 7ms pypy 3.9.16
python 1.py 1403ms 0.4ms 10.0MB 1387ms 0ms cpython 3.11.1
python 1.py 2299ms 1.8ms 9.8MB 2283ms 0ms pyston 3.8.12
csharp 1.cs timeout 0.0ms 109.7MB 4953ms 23ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 22.7MB 4990ms 0ms dotnet/aot 7.0.102

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 173ms 0.5ms 73.7MB 143ms 17ms pypy 3.9.16
python 1.py 263ms 3.7ms 9.3MB 250ms 0ms cpython 3.11.1
python 1.py 404ms 1.1ms 8.9MB 393ms 0ms pyston 3.8.12
csharp 1.cs 847ms 2.4ms 19.3MB 837ms 0ms dotnet/aot 7.0.102
csharp 1.cs 959ms 5.1ms 109.5MB 900ms 30ms dotnet 7.0.102

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 316ms 19ms 47.2MB 503ms 90ms dotnet/aot 7.0.102
csharp 5-m.cs 544ms 24ms 61.2MB 910ms 113ms mono 6.12.0
csharp 5-m.cs 569ms 35ms 171.4MB 853ms 150ms dotnet 7.0.102
python 5-m.py 3396ms 47ms 12.7MB 4827ms 1273ms pyston 3.8.12
python 1.py 3472ms 22ms 85.0MB 3427ms 23ms pypy 3.9.16
python 1.py 3936ms 36ms 7.9MB 3923ms 0ms pyston 3.8.12
python 5-m.py 4001ms 4.4ms 13.6MB 5693ms 1197ms cpython 3.11.1
python 5-m.py 4662ms 42ms 76.1MB 6713ms 1320ms pypy 3.9.16
python 1.py timeout 0.0ms 8.6MB 4980ms 0ms cpython 3.11.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 49ms 1.7ms 21.3MB 57ms 13ms dotnet/aot 7.0.102
csharp 5.cs 96ms 10ms 39.2MB 113ms 30ms mono 6.12.0
csharp 5.cs 143ms 4.6ms 114.0MB 117ms 53ms dotnet 7.0.102
python 1.py 407ms 1.7ms 8.0MB 390ms 3ms pyston 3.8.12
python 1.py 433ms 0.6ms 73.8MB 407ms 13ms pypy 3.9.16
python 5-m.py 436ms 14ms 12.6MB 557ms 160ms pyston 3.8.12
python 5-m.py 485ms 5.8ms 13.6MB 587ms 193ms cpython 3.11.1
python 1.py 594ms 1.0ms 8.6MB 580ms 0ms cpython 3.11.1
python 5-m.py 845ms 3.6ms 76.2MB 923ms 457ms pypy 3.9.16

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 6.8ms 0.7ms 12.1MB 0ms 0ms dotnet/aot 7.0.102
python 1.py 14ms 0.9ms 8.4MB 10ms 0ms cpython 3.11.1
python 1.py 14ms 0.7ms 7.3MB 10ms 0ms pyston 3.8.12
csharp 1.cs 21ms 0.6ms 25.6MB 10ms 0ms mono 6.12.0
python 1.py 37ms 0.6ms 51.6MB 8ms 14ms pypy 3.9.16
csharp 1.cs 79ms 2.2ms 101.4MB 28ms 26ms dotnet 7.0.102

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2-http2.cs 947ms 15ms 198.0MB 970ms 137ms dotnet 7.0.102
csharp 2.cs 996ms 24ms 244.1MB 853ms 527ms dotnet 7.0.102
csharp 1.cs 1358ms 118ms 249.1MB 1027ms 617ms dotnet 7.0.102
csharp 2-http3.cs 1383ms 20ms 269.8MB 1540ms 367ms dotnet 7.0.102
python 1.py 1784ms 8.6ms 33.7MB 1343ms 930ms pyston 3.8.12
python 1.py 2123ms 9.1ms 29.7MB 1690ms 937ms cpython 3.11.1
python 1.py 4893ms 77ms 125.1MB 3767ms 1003ms pypy 3.9.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 403ms 1.0ms 27.7MB 300ms 167ms pyston 3.8.12
python 1.py 436ms 5.0ms 24.9MB 333ms 163ms cpython 3.11.1
csharp 2.cs 518ms 16ms 158.5MB 410ms 143ms dotnet 7.0.102
csharp 1.cs 598ms 17ms 167.5MB 550ms 193ms dotnet 7.0.102
csharp 2-http2.cs 822ms 2.6ms 164.6MB 777ms 93ms dotnet 7.0.102
csharp 2-http3.cs 896ms 4.7ms 180.4MB 850ms 163ms dotnet 7.0.102
python 1.py 1158ms 29ms 95.4MB 917ms 207ms pypy 3.9.16

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 274ms 1.8ms 38.6MB 223ms 33ms pyston 3.8.12
python 1.py 281ms 0.9ms 41.3MB 253ms 13ms cpython 3.11.1
csharp 2.cs 413ms 9.4ms 146.7MB 337ms 60ms dotnet 7.0.102
python 1.py 418ms 5.8ms 98.6MB 370ms 33ms pypy 3.9.16
csharp 1.cs 709ms 7.7ms 218.7MB 670ms 90ms dotnet 7.0.102

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1856ms 53ms 346.0MB 1987ms 143ms dotnet 7.0.102
python 1.py 2498ms 12ms 220.7MB 2313ms 167ms pyston 3.8.12
python 1.py 2501ms 10ms 223.0MB 2357ms 127ms cpython 3.11.1
python 1.py 2634ms 7.8ms 239.5MB 2510ms 107ms pypy 3.9.16
csharp 1.cs 2972ms 9.9ms 862.9MB 2887ms 410ms dotnet 7.0.102

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 1021ms 26ms 51.9MB 1473ms 23ms dotnet/aot 7.0.102
csharp 6-m.cs 1387ms 9.1ms 148.2MB 2387ms 53ms dotnet 7.0.102
csharp 6-m.cs 1868ms 29ms 70.5MB 3010ms 30ms mono 6.12.0
python 3.py timeout 0.0ms 35.3MB 93ms 20ms cpython 3.11.1
python 3.py timeout 0.0ms 207.6MB 297ms 87ms pypy 3.9.16
python 3.py timeout 0.0ms 34.1MB 77ms 23ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 162ms 8.1ms 40.7MB 177ms 20ms dotnet/aot 7.0.102
csharp 6.cs 271ms 7.4ms 51.6MB 363ms 13ms mono 6.12.0
csharp 6.cs 309ms 2.5ms 132.8MB 337ms 43ms dotnet 7.0.102
python 3-m.py 670ms 8.9ms 86.2MB 1007ms 117ms pypy 3.9.16
python 3-m.py 718ms 12ms 15.9MB 1250ms 47ms pyston 3.8.12
python 3-m.py 942ms 1.3ms 17.0MB 1707ms 30ms cpython 3.11.1

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 138ms 1.7ms 10.0MB 133ms 0ms dotnet/aot 7.0.102
csharp 2.cs 196ms 1.8ms 25.4MB 173ms 7ms mono 6.12.0
csharp 2.cs 228ms 3.3ms 102.0MB 180ms 20ms dotnet 7.0.102
python 2.py 232ms 1.2ms 70.9MB 200ms 10ms pypy 3.9.16
python 1.py 284ms 6.6ms 71.9MB 240ms 23ms pypy 3.9.16
python 1.py 934ms 3.2ms 9.1MB 923ms 0ms pyston 3.8.12
python 2.py 1077ms 7.0ms 8.7MB 1063ms 0ms pyston 3.8.12
python 1.py 1255ms 16ms 9.3MB 1243ms 0ms cpython 3.11.1
python 2.py 1427ms 8.5ms 9.1MB 1410ms 0ms cpython 3.11.1
csharp 1.cs 1582ms 3.0ms 60.1MB 1560ms 20ms dotnet/aot 7.0.102
csharp 1.cs 1737ms 17ms 150.1MB 1657ms 63ms dotnet 7.0.102
csharp 1.cs 3349ms 1.6ms 47.6MB 3303ms 40ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 400ms 7.6ms 8.2MB 393ms 0ms dotnet/aot 7.0.102
csharp 2.cs 458ms 2.7ms 102.2MB 397ms 33ms dotnet 7.0.102
csharp 2.cs 526ms 2.5ms 24.9MB 510ms 0ms mono 6.12.0
python 2.py 557ms 5.6ms 71.3MB 520ms 23ms pypy 3.9.16
python 1.py 616ms 1.8ms 72.5MB 580ms 20ms pypy 3.9.16
python 1.py 2744ms 8.5ms 9.1MB 2723ms 0ms pyston 3.8.12
python 2.py 3201ms 18ms 8.7MB 3183ms 3ms pyston 3.8.12
python 1.py 3733ms 77ms 9.3MB 3717ms 0ms cpython 3.11.1
python 2.py 4232ms 26ms 9.1MB 4217ms 0ms cpython 3.11.1
csharp 1.cs 4665ms 7.4ms 58.3MB 4643ms 13ms dotnet/aot 7.0.102
csharp 1.cs 4831ms 4.1ms 145.1MB 4760ms 60ms dotnet 7.0.102
csharp 1.cs timeout 0.0ms 49.7MB 4947ms 43ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 73ms 3.0ms 12.2MB 70ms 0ms dotnet/aot 7.0.102
csharp 2.cs 111ms 1.4ms 27.3MB 100ms 0ms mono 6.12.0
csharp 2.cs 159ms 4.8ms 100.0MB 107ms 23ms dotnet 7.0.102
python 2.py 161ms 0.9ms 71.3MB 130ms 10ms pypy 3.9.16
python 1.py 187ms 2.1ms 72.3MB 157ms 17ms pypy 3.9.16
python 1.py 454ms 2.7ms 8.8MB 440ms 0ms pyston 3.8.12
python 2.py 501ms 1.5ms 8.2MB 487ms 0ms pyston 3.8.12
python 1.py 597ms 4.0ms 8.7MB 577ms 3ms cpython 3.11.1
python 2.py 709ms 5.6ms 8.4MB 693ms 0ms cpython 3.11.1
csharp 1.cs 4299ms 4.1ms 55.2MB 4263ms 23ms dotnet/aot 7.0.102
csharp 1.cs 4553ms 42ms 141.1MB 4467ms 43ms dotnet 7.0.102
csharp 1.cs 4613ms 9.1ms 31.3MB 4597ms 0ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 739ms 25ms 153.2MB 660ms 43ms dotnet 7.0.102
csharp 3.cs 3410ms 11ms 111.6MB 3357ms 23ms dotnet 7.0.102
csharp 1.cs 3427ms 7.0ms 109.1MB 3367ms 27ms dotnet 7.0.102
csharp 3.cs 3838ms 20ms 19.5MB 3827ms 0ms dotnet/aot 7.0.102
csharp 1.cs 4985ms 4.3ms 19.7MB 4970ms 0ms dotnet/aot 7.0.102
csharp 1.cs timeout 0.0ms 25.2MB 4977ms 0ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3.cs 169ms 0.5ms 14.9MB 160ms 0ms dotnet/aot 7.0.102
csharp 2.cs 171ms 21ms 111.6MB 117ms 23ms dotnet 7.0.102
csharp 1.cs 217ms 2.4ms 13.2MB 210ms 0ms dotnet/aot 7.0.102
csharp 1.cs 231ms 4.1ms 105.9MB 177ms 20ms dotnet 7.0.102
csharp 3.cs 247ms 0.6ms 108.4MB 187ms 30ms dotnet 7.0.102
csharp 1.cs 741ms 1.6ms 29.4MB 723ms 3ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 922ms 6.2ms 378.5MB 783ms 183ms dotnet/aot 7.0.102
csharp 1.cs 967ms 1.1ms 313.5MB 853ms 137ms dotnet/aot 7.0.102
csharp 2.cs 1115ms 10ms 492.0MB 890ms 233ms dotnet 7.0.102
csharp 1.cs 1151ms 7.1ms 499.3MB 970ms 213ms dotnet 7.0.102
csharp 1.cs 1944ms 32ms 143.5MB 2473ms 120ms mono 6.12.0
python 1.py 2938ms 261ms 230.3MB 2777ms 143ms pypy 3.9.16
python 1.py timeout 0.0ms 92.9MB 4947ms 33ms cpython 3.11.1
python 1.py timeout 0.0ms 130.2MB 4930ms 50ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 212ms 5.9ms 138.0MB 163ms 43ms dotnet/aot 7.0.102
csharp 1.cs 243ms 2.8ms 148.5MB 183ms 53ms dotnet/aot 7.0.102
csharp 1.cs 349ms 6.0ms 71.9MB 327ms 40ms mono 6.12.0
csharp 2.cs 366ms 4.4ms 206.1MB 270ms 80ms dotnet 7.0.102
csharp 1.cs 409ms 21ms 258.7MB 273ms 97ms dotnet 7.0.102
python 1.py 482ms 20ms 149.6MB 410ms 53ms pypy 3.9.16
python 1.py timeout 0.0ms 36.9MB 4967ms 13ms cpython 3.11.1
python 1.py timeout 0.0ms 41.5MB 4963ms 17ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 448ms 2.3ms 102.2MB 397ms 23ms dotnet 7.0.102
csharp 8.cs 580ms 4.8ms 12.2MB 577ms 0ms dotnet/aot 7.0.102
csharp 8.cs 635ms 6.9ms 100.1MB 573ms 27ms dotnet 7.0.102
csharp 8.cs 1299ms 31ms 24.8MB 1287ms 0ms mono 6.12.0
python 2.py 2170ms 15ms 71.1MB 2137ms 17ms pypy 3.9.16
python 1.py 3646ms 10ms 70.2MB 3617ms 7ms pypy 3.9.16
python 1.py timeout 0.0ms 8.5MB 4987ms 0ms cpython 3.11.1
python 2.py timeout 0.0ms 8.6MB 4980ms 3ms cpython 3.11.1
python 1.py timeout 0.0ms 8.5MB 4990ms 0ms pyston 3.8.12
python 2.py timeout 0.0ms 8.0MB 4983ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 67ms 2.9ms 12.1MB 63ms 0ms dotnet/aot 7.0.102
csharp 9.cs 124ms 3.7ms 101.9MB 80ms 20ms dotnet 7.0.102
csharp 8.cs 139ms 1.0ms 102.0MB 93ms 20ms dotnet 7.0.102
csharp 8.cs 159ms 5.7ms 24.9MB 140ms 3ms mono 6.12.0
python 2.py 267ms 1.3ms 70.9MB 233ms 17ms pypy 3.9.16
python 1.py 416ms 2.4ms 70.4MB 380ms 17ms pypy 3.9.16
python 1.py 1163ms 10ms 8.4MB 1150ms 0ms pyston 3.8.12
python 2.py 1601ms 24ms 7.9MB 1587ms 0ms pyston 3.8.12
python 1.py 3147ms 98ms 8.5MB 3133ms 0ms cpython 3.11.1
python 2.py 3709ms 215ms 8.6MB 3697ms 0ms cpython 3.11.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 659ms 5.1ms 21.7MB 647ms 0ms dotnet/aot 7.0.102
csharp 2.cs 782ms 5.7ms 107.2MB 727ms 30ms dotnet 7.0.102
csharp 1.cs 941ms 20ms 71.8MB 917ms 20ms dotnet/aot 7.0.102
csharp 1.cs 1256ms 13ms 86.6MB 1213ms 30ms mono 6.12.0
csharp 1.cs 1489ms 60ms 159.0MB 1407ms 57ms dotnet 7.0.102
csharp 2.cs 2819ms 24ms 34.0MB 2800ms 0ms mono 6.12.0
python 1.py 4962ms 19ms 382.8MB 4797ms 147ms pypy 3.9.16
python 1.py timeout 0.0ms 321.1MB 4897ms 87ms cpython 3.11.1
python 2.py timeout 0.0ms 633.6MB 4557ms 427ms cpython 3.11.1
python 2.py timeout 0.0ms 1000.1MB 4617ms 363ms pypy 3.9.16
python 1.py timeout 0.0ms 320.5MB 4903ms 80ms pyston 3.8.12
python 2.py timeout 0.0ms 633.0MB 4553ms 427ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 148ms 5.7ms 29.8MB 137ms 7ms dotnet/aot 7.0.102
csharp 2.cs 154ms 1.2ms 15.4MB 150ms 0ms dotnet/aot 7.0.102
csharp 1.cs 198ms 1.1ms 42.8MB 177ms 3ms mono 6.12.0
csharp 2.cs 244ms 0.6ms 100.7MB 187ms 23ms dotnet 7.0.102
csharp 1.cs 356ms 7.8ms 117.0MB 297ms 30ms dotnet 7.0.102
csharp 2.cs 672ms 0.6ms 25.9MB 657ms 3ms mono 6.12.0
python 1.py 1141ms 2.1ms 207.1MB 1077ms 50ms pypy 3.9.16
python 2.py 1452ms 29ms 164.4MB 1347ms 90ms pyston 3.8.12
python 2.py 1926ms 10ms 210.5MB 1793ms 117ms pypy 3.9.16
python 2.py 2006ms 13ms 164.8MB 1907ms 80ms cpython 3.11.1
python 1.py 3114ms 48ms 86.1MB 3063ms 33ms pyston 3.8.12
python 1.py 4358ms 46ms 86.8MB 4307ms 33ms cpython 3.11.1

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2411ms 0.4ms 9.1MB 2377ms 20ms pyston 3.8.12
python 4.py 2413ms 1.4ms 9.4MB 2383ms 17ms cpython 3.11.1
python 4.py 2667ms 37ms 125.2MB 2610ms 40ms pypy 3.9.16
csharp 1.cs 4777ms 8.2ms 57.3MB 4743ms 40ms dotnet/aot 7.0.102
csharp 1.cs 4893ms 9.0ms 155.4MB 4837ms 113ms dotnet 7.0.102

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 578ms 2.1ms 8.8MB 560ms 0ms pyston 3.8.12
python 4.py 581ms 0.7ms 9.2MB 563ms 0ms cpython 3.11.1
python 4.py 682ms 5.4ms 76.9MB 653ms 13ms pypy 3.9.16
csharp 1.cs 1134ms 1.8ms 58.7MB 1107ms 23ms dotnet/aot 7.0.102
csharp 1.cs 1225ms 2.5ms 155.8MB 1200ms 57ms dotnet 7.0.102

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5.cs 3174ms 7.1ms 598.3MB 3123ms 237ms dotnet 7.0.102
python 1.py 3319ms 11ms 273.9MB 3187ms 110ms pypy 3.9.16
csharp 6.cs 3664ms 57ms 592.5MB 3513ms 227ms dotnet 7.0.102
csharp 6.cs 3692ms 7.2ms 457.6MB 3580ms 167ms dotnet/aot 7.0.102
csharp 5.cs timeout 0.0ms 184.1MB 4953ms 93ms dotnet/aot 7.0.102
python 1.py timeout 0.0ms 108.4MB 4927ms 53ms cpython 3.11.1
python 1.py timeout 0.0ms 108.6MB 4927ms 53ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 387ms 3.2ms 69.5MB 353ms 33ms dotnet/aot 7.0.102
python 1.py 465ms 1.4ms 94.8MB 420ms 30ms pypy 3.9.16
csharp 5.cs 481ms 3.9ms 168.2MB 393ms 67ms dotnet 7.0.102
csharp 6.cs 571ms 1.5ms 163.5MB 457ms 67ms dotnet 7.0.102
csharp 5.cs 699ms 2.1ms 70.3MB 663ms 30ms dotnet/aot 7.0.102
python 1.py 776ms 1.9ms 30.4MB 733ms 23ms pyston 3.8.12
python 1.py 832ms 1.4ms 31.8MB 787ms 30ms cpython 3.11.1

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 4232ms 13ms 58.0MB 4203ms 23ms dotnet/aot 7.0.102
csharp 1.cs 4378ms 49ms 152.1MB 4320ms 63ms dotnet 7.0.102
python 1.py 4421ms 15ms 8.4MB 4410ms 0ms pyston 3.8.12
python 1.py 4722ms 2.6ms 8.4MB 4707ms 0ms cpython 3.11.1
python 1.py timeout 0.0ms 77.8MB 4967ms 17ms pypy 3.9.16

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1086ms 4.7ms 57.8MB 1060ms 17ms dotnet/aot 7.0.102
python 1.py 1117ms 1.0ms 8.4MB 1107ms 0ms pyston 3.8.12
python 1.py 1198ms 8.4ms 8.5MB 1180ms 0ms cpython 3.11.1
csharp 1.cs 1267ms 45ms 147.0MB 1203ms 57ms dotnet 7.0.102
python 1.py 1495ms 7.0ms 74.8MB 1467ms 17ms pypy 3.9.16

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2157ms 59ms 13.7MB 4067ms 7ms dotnet/aot 7.0.102
csharp 3-m.cs 4304ms 209ms 102.9MB 7280ms 33ms dotnet 7.0.102
csharp 3.cs timeout 0.0ms 27.0MB 9767ms 7ms mono 6.12.0
python 8.py timeout 0.0ms 16.5MB 53ms 13ms cpython 3.11.1
python 8.py timeout 0.0ms 100.3MB 660ms 83ms pypy 3.9.16
python 8.py timeout 0.0ms 17.8MB 77ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 541ms 2.0ms 12.0MB 1027ms 3ms dotnet/aot 7.0.102
csharp 3-m.cs 1131ms 2.6ms 102.5MB 2010ms 40ms dotnet 7.0.102
csharp 3-m.cs 2696ms 136ms 27.7MB 5060ms 17ms mono 6.12.0
python 8.py timeout 0.0ms 16.3MB 100ms 17ms cpython 3.11.1
python 8.py timeout 0.0ms 111.3MB 1097ms 220ms pypy 3.9.16
python 8.py timeout 0.0ms 17.2MB 160ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 152ms 2.5ms 12.3MB 267ms 3ms dotnet/aot 7.0.102
csharp 3-m.cs 376ms 2.3ms 104.4MB 563ms 30ms dotnet 7.0.102
csharp 3-m.cs 686ms 9.6ms 27.8MB 1283ms 0ms mono 6.12.0
python 8-m.py 3809ms 23ms 104.7MB 6577ms 407ms pypy 3.9.16
python 8.py timeout 0.0ms 15.8MB 277ms 47ms cpython 3.11.1
python 8.py timeout 0.0ms 16.8MB 297ms 63ms pyston 3.8.12