Programming Language and compiler
Benchmarks

C# VS Python benchmarks

Current benchmark data was generated on Thu Jul 13 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 1238ms 15ms 384.0MB 1173ms 167ms dotnet/aot 7.0.306
python 1.py 1431ms 7.2ms 271.9MB 1300ms 110ms pypy 3.10.12
csharp 1.cs 1474ms 24ms 397.6MB 1343ms 190ms dotnet 7.0.306
csharp 1.cs 2201ms 41ms 104.3MB 2517ms 157ms mono 6.12.0
python 1.py timeout 0.0ms 40.9MB 4970ms 10ms cpython 3.11.4
python 1.py timeout 0.0ms 40.3MB 4903ms 80ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 119ms 16ms 80.1MB 83ms 13ms pypy 3.10.12
csharp 1.cs 126ms 4.3ms 72.0MB 100ms 23ms dotnet/aot 7.0.306
csharp 1.cs 153ms 0.8ms 44.0MB 137ms 3ms mono 6.12.0
csharp 1.cs 237ms 4.4ms 95.5MB 180ms 33ms dotnet 7.0.306
python 1.py 610ms 3.8ms 12.0MB 587ms 7ms pyston 3.8.12
python 1.py 994ms 18ms 12.5MB 973ms 3ms cpython 3.11.4

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 1011ms 11ms 189.0MB 917ms 77ms pypy 3.10.12
csharp 1-m.cs 4416ms 189ms 106.6MB 7553ms 80ms dotnet 7.0.306
csharp 1.cs timeout 0.0ms 82.8MB 9367ms 53ms dotnet/aot 7.0.306
python 1.py timeout 0.0ms 20.3MB 4980ms 3ms cpython 3.11.4
python 1.py timeout 0.0ms 17.3MB 4983ms 0ms pyston 3.8.12

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 265ms 7.9ms 94.6MB 230ms 17ms pypy 3.10.12
csharp 1-m.cs 349ms 31ms 61.8MB 570ms 27ms dotnet/aot 7.0.306
csharp 1-m.cs 570ms 46ms 84.9MB 930ms 40ms dotnet 7.0.306
python 1.py 811ms 6.1ms 20.0MB 787ms 3ms cpython 3.11.4
python 1.py 930ms 2.5ms 16.8MB 910ms 3ms pyston 3.8.12

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 278ms 0.1ms 88.1MB 243ms 17ms pypy 3.10.12
python 1.py 1655ms 1.1ms 10.1MB 1640ms 0ms cpython 3.11.4
python 1.py 2783ms 0.3ms 9.7MB 2770ms 0ms pyston 3.8.12
csharp 1.cs timeout 0.0ms 39.5MB 4970ms 7ms dotnet 7.0.306
csharp 1.cs timeout 0.0ms 22.6MB 4987ms 3ms dotnet/aot 7.0.306

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 116ms 1.0ms 79.0MB 83ms 20ms pypy 3.10.12
python 1.py 301ms 0.2ms 9.3MB 290ms 0ms cpython 3.11.4
python 1.py 480ms 1.1ms 9.0MB 463ms 0ms pyston 3.8.12
csharp 1.cs 1048ms 11ms 19.0MB 1040ms 3ms dotnet/aot 7.0.306
csharp 1.cs 1108ms 13ms 32.8MB 1063ms 7ms dotnet 7.0.306

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 366ms 49ms 57.8MB 560ms 127ms dotnet/aot 7.0.306
csharp 5-m.cs 482ms 25ms 68.6MB 743ms 127ms dotnet 7.0.306
csharp 5-m.cs 482ms 6.9ms 38.3MB 823ms 80ms mono 6.12.0
python 1.py 2471ms 36ms 87.9MB 2433ms 20ms pypy 3.10.12
python 5-m.py 3926ms 65ms 83.2MB 4250ms 843ms pypy 3.10.12
python 5-m.py 3978ms 31ms 12.7MB 6003ms 1020ms pyston 3.8.12
python 5-m.py 4105ms 12ms 13.6MB 5733ms 1033ms cpython 3.11.4
python 1.py 4108ms 2.7ms 7.9MB 4093ms 0ms pyston 3.8.12
python 1.py timeout 0.0ms 8.6MB 4980ms 0ms cpython 3.11.4

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 5-m.cs 60ms 1.7ms 28.3MB 77ms 17ms dotnet/aot 7.0.306
csharp 5-m.cs 97ms 6.4ms 38.3MB 113ms 37ms mono 6.12.0
csharp 5.cs 108ms 2.9ms 39.9MB 93ms 20ms dotnet 7.0.306
python 1.py 335ms 15ms 78.9MB 307ms 17ms pypy 3.10.12
python 1.py 428ms 4.2ms 8.0MB 407ms 3ms pyston 3.8.12
python 5-m.py 469ms 12ms 12.7MB 693ms 123ms pyston 3.8.12
python 5-m.py 472ms 1.7ms 13.6MB 607ms 133ms cpython 3.11.4
python 1.py 617ms 1.4ms 8.6MB 603ms 0ms cpython 3.11.4
python 5-m.py 769ms 8.0ms 82.7MB 833ms 440ms pypy 3.10.12

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 6.8ms 0.8ms 12.1MB 0ms 0ms dotnet/aot 7.0.306
python 1.py 13ms 0.6ms 7.3MB 10ms 0ms pyston 3.8.12
python 1.py 14ms 1.4ms 8.5MB 10ms 0ms cpython 3.11.4
csharp 1.cs 19ms 0.6ms 25.6MB 10ms 0ms mono 6.12.0
python 1.py 30ms 0.7ms 52.1MB 12ms 2ms pypy 3.10.12
csharp 1.cs 59ms 1.9ms 28.8MB 26ms 2ms dotnet 7.0.306

http-server

Input: 3000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 882ms 26ms 173.6MB 810ms 410ms dotnet 7.0.306
csharp 1.cs 971ms 36ms 174.6MB 983ms 453ms dotnet 7.0.306
csharp 2-http2.cs 1037ms 83ms 134.0MB 1013ms 103ms dotnet 7.0.306
csharp 2-http3.cs 1211ms 30ms 194.8MB 1430ms 177ms dotnet 7.0.306
python 1.py 1502ms 5.2ms 35.2MB 1127ms 790ms pyston 3.8.12
python 1.py 1857ms 8.4ms 29.7MB 1490ms 803ms cpython 3.11.4
python 1.py 4045ms 60ms 127.2MB 3107ms 783ms pypy 3.10.12

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 350ms 3.4ms 27.6MB 273ms 127ms pyston 3.8.12
python 1.py 381ms 5.9ms 25.2MB 273ms 163ms cpython 3.11.4
csharp 2.cs 482ms 7.7ms 92.2MB 410ms 100ms dotnet 7.0.306
csharp 1.cs 526ms 6.7ms 97.2MB 513ms 137ms dotnet 7.0.306
csharp 2-http2.cs 827ms 18ms 90.8MB 813ms 73ms dotnet 7.0.306
csharp 2-http3.cs 970ms 86ms 107.6MB 913ms 110ms dotnet 7.0.306
python 1.py 1001ms 16ms 103.7MB 777ms 170ms pypy 3.10.12

json-serde

Input: sample 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 249ms 0.4ms 38.4MB 213ms 20ms pyston 3.8.12
python 1.py 256ms 1.4ms 41.1MB 233ms 7ms cpython 3.11.4
python 1.py 399ms 1.9ms 106.6MB 367ms 17ms pypy 3.10.12
csharp 2.cs 407ms 11ms 74.0MB 357ms 30ms dotnet 7.0.306
csharp 1.cs 679ms 2.9ms 144.7MB 660ms 80ms dotnet 7.0.306

Input: canada 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 1901ms 97ms 270.3MB 1947ms 120ms dotnet 7.0.306
python 1.py 2322ms 2.4ms 223.1MB 2223ms 80ms cpython 3.11.4
python 1.py 2332ms 3.8ms 220.6MB 2177ms 137ms pyston 3.8.12
python 1.py 2468ms 3.1ms 245.1MB 2380ms 70ms pypy 3.10.12
csharp 1.cs 2935ms 42ms 788.7MB 2877ms 377ms dotnet 7.0.306

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6-m.cs 971ms 8.0ms 51.8MB 1473ms 27ms dotnet/aot 7.0.306
csharp 6-m.cs 1667ms 172ms 68.9MB 2523ms 20ms mono 6.12.0
python 3-m.py 3506ms 21ms 213.7MB 6197ms 340ms pypy 3.10.12
csharp 6-m.cs 3820ms 672ms 73.4MB 7300ms 23ms dotnet 7.0.306
python 3-m.py 4859ms 118ms 34.3MB 9207ms 73ms pyston 3.8.12
python 3.py timeout 0.0ms 35.2MB 90ms 13ms cpython 3.11.4

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 152ms 4.0ms 42.6MB 177ms 23ms dotnet/aot 7.0.306
csharp 6.cs 233ms 3.9ms 51.1MB 310ms 10ms mono 6.12.0
csharp 6-m.cs 501ms 70ms 61.9MB 793ms 23ms dotnet 7.0.306
python 3-m.py 513ms 7.5ms 94.1MB 743ms 107ms pypy 3.10.12
python 3-m.py 562ms 2.8ms 17.9MB 987ms 30ms pyston 3.8.12
python 3-m.py 793ms 2.1ms 16.9MB 1430ms 30ms cpython 3.11.4

lru

Input: 1000 1000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 136ms 0.9ms 10.3MB 130ms 0ms dotnet/aot 7.0.306
csharp 2.cs 185ms 0.6ms 22.1MB 167ms 3ms mono 6.12.0
python 2.py 196ms 0.4ms 77.2MB 170ms 10ms pypy 3.10.12
csharp 2.cs 200ms 5.5ms 29.6MB 163ms 10ms dotnet 7.0.306
python 1.py 234ms 0.3ms 78.0MB 217ms 3ms pypy 3.10.12
python 1.py 981ms 0.5ms 9.0MB 967ms 0ms pyston 3.8.12
python 2.py 1165ms 1.0ms 8.7MB 1147ms 3ms pyston 3.8.12
csharp 1.cs 1284ms 2.6ms 73.3MB 1247ms 33ms dotnet/aot 7.0.306
python 1.py 1337ms 3.7ms 9.3MB 1323ms 0ms cpython 3.11.4
python 2.py 1548ms 20ms 9.1MB 1533ms 0ms cpython 3.11.4
csharp 1.cs 1624ms 6.4ms 90.7MB 1563ms 40ms dotnet 7.0.306
csharp 1.cs 3045ms 55ms 49.5MB 3013ms 23ms mono 6.12.0

Input: 1000 3000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 394ms 2.2ms 10.2MB 383ms 0ms dotnet/aot 7.0.306
csharp 2.cs 414ms 2.1ms 29.4MB 383ms 7ms dotnet 7.0.306
python 2.py 459ms 4.4ms 77.7MB 433ms 10ms pypy 3.10.12
csharp 2.cs 504ms 3.4ms 23.4MB 487ms 0ms mono 6.12.0
python 1.py 507ms 11ms 78.6MB 477ms 10ms pypy 3.10.12
python 1.py 2937ms 37ms 8.9MB 2920ms 0ms pyston 3.8.12
python 2.py 3476ms 17ms 8.7MB 3467ms 0ms pyston 3.8.12
csharp 1.cs 3944ms 317ms 71.6MB 3903ms 40ms dotnet/aot 7.0.306
python 1.py 3949ms 14ms 9.4MB 3937ms 0ms cpython 3.11.4
csharp 1.cs 4542ms 37ms 89.6MB 4480ms 37ms dotnet 7.0.306
python 2.py 4639ms 19ms 9.1MB 4620ms 3ms cpython 3.11.4
csharp 1.cs timeout 0.0ms 45.7MB 4957ms 37ms mono 6.12.0

Input: 100 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 73ms 3.2ms 10.1MB 73ms 0ms dotnet/aot 7.0.306
csharp 2.cs 105ms 1.2ms 25.2MB 90ms 3ms mono 6.12.0
csharp 2.cs 129ms 9.9ms 29.4MB 100ms 3ms dotnet 7.0.306
python 2.py 138ms 1.8ms 77.3MB 113ms 10ms pypy 3.10.12
python 1.py 156ms 2.2ms 78.1MB 127ms 13ms pypy 3.10.12
python 1.py 475ms 2.7ms 8.8MB 460ms 0ms pyston 3.8.12
python 2.py 542ms 1.7ms 8.2MB 530ms 0ms pyston 3.8.12
python 1.py 632ms 4.6ms 8.7MB 613ms 0ms cpython 3.11.4
python 2.py 773ms 8.4ms 8.4MB 757ms 3ms cpython 3.11.4
csharp 1.cs 2812ms 8.4ms 64.7MB 2783ms 17ms dotnet/aot 7.0.306
csharp 1.cs 3014ms 39ms 80.1MB 2957ms 33ms dotnet 7.0.306
csharp 1.cs 3185ms 2.8ms 31.4MB 3170ms 0ms mono 6.12.0

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 730ms 8.6ms 94.3MB 670ms 30ms dotnet 7.0.306
csharp 3.cs 3572ms 81ms 38.6MB 3537ms 3ms dotnet 7.0.306
csharp 1.cs 3945ms 14ms 38.7MB 3907ms 10ms dotnet 7.0.306
csharp 3.cs 4830ms 13ms 19.6MB 4823ms 0ms dotnet/aot 7.0.306
csharp 1.cs timeout 0.0ms 15.4MB 4980ms 3ms dotnet/aot 7.0.306
csharp 1.cs timeout 0.0ms 26.8MB 4977ms 3ms mono 6.12.0

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 128ms 6.6ms 43.0MB 97ms 3ms dotnet 7.0.306
csharp 3.cs 207ms 1.4ms 12.5MB 200ms 0ms dotnet/aot 7.0.306
csharp 1.cs 228ms 1.1ms 35.5MB 187ms 13ms dotnet 7.0.306
csharp 3.cs 230ms 4.3ms 35.9MB 193ms 3ms dotnet 7.0.306
csharp 1.cs 274ms 1.5ms 11.3MB 267ms 0ms dotnet/aot 7.0.306
csharp 1.cs 833ms 0.8ms 26.7MB 820ms 0ms mono 6.12.0

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 804ms 26ms 369.6MB 673ms 170ms dotnet/aot 7.0.306
csharp 1.cs 841ms 7.8ms 384.6MB 710ms 183ms dotnet/aot 7.0.306
csharp 2.cs 1026ms 11ms 413.9MB 847ms 167ms dotnet 7.0.306
csharp 1.cs 1047ms 13ms 441.4MB 860ms 210ms dotnet 7.0.306
csharp 1.cs 1681ms 23ms 145.1MB 2023ms 143ms mono 6.12.0
python 1.py 2210ms 33ms 292.6MB 2010ms 183ms pypy 3.10.12
python 1.py timeout 0.0ms 93.2MB 4963ms 20ms cpython 3.11.4
python 1.py timeout 0.0ms 130.2MB 4930ms 47ms pyston 3.8.12

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 2.cs 158ms 3.1ms 77.3MB 133ms 20ms dotnet/aot 7.0.306
csharp 1.cs 229ms 11ms 197.7MB 147ms 77ms dotnet/aot 7.0.306
csharp 1.cs 309ms 7.0ms 72.1MB 280ms 37ms mono 6.12.0
python 1.py 310ms 2.7ms 137.0MB 247ms 53ms pypy 3.10.12
csharp 1.cs 346ms 2.7ms 200.9MB 237ms 90ms dotnet 7.0.306
csharp 2.cs 369ms 0.4ms 101.9MB 313ms 37ms dotnet 7.0.306
python 1.py 4349ms 24ms 37.3MB 4320ms 10ms cpython 3.11.4
python 1.py timeout 0.0ms 48.8MB 4947ms 33ms pyston 3.8.12

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 9.cs 407ms 0.4ms 29.8MB 380ms 0ms dotnet 7.0.306
csharp 8.cs 498ms 4.0ms 10.1MB 497ms 0ms dotnet/aot 7.0.306
csharp 8.cs 538ms 1.3ms 25.7MB 503ms 0ms dotnet 7.0.306
csharp 8.cs 1108ms 0.6ms 24.9MB 1093ms 0ms mono 6.12.0
python 2.py 1880ms 4.6ms 77.3MB 1853ms 10ms pypy 3.10.12
python 1.py 3370ms 20ms 76.1MB 3337ms 13ms pypy 3.10.12
python 1.py timeout 0.0ms 8.4MB 4983ms 0ms cpython 3.11.4
python 2.py timeout 0.0ms 8.6MB 4983ms 0ms cpython 3.11.4
python 1.py timeout 0.0ms 8.3MB 4980ms 3ms pyston 3.8.12
python 2.py timeout 0.0ms 7.9MB 4980ms 0ms pyston 3.8.12

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 8.cs 57ms 2.2ms 10.1MB 53ms 0ms dotnet/aot 7.0.306
csharp 9.cs 101ms 3.9ms 29.3MB 70ms 3ms dotnet 7.0.306
csharp 8.cs 120ms 8.5ms 29.8MB 77ms 3ms dotnet 7.0.306
csharp 8.cs 133ms 3.3ms 24.9MB 120ms 0ms mono 6.12.0
python 2.py 242ms 1.9ms 77.0MB 217ms 10ms pypy 3.10.12
python 1.py 381ms 1.2ms 76.4MB 360ms 7ms pypy 3.10.12
python 1.py 1202ms 7.3ms 8.4MB 1190ms 0ms pyston 3.8.12
python 2.py 1603ms 2.5ms 7.9MB 1590ms 0ms pyston 3.8.12
python 1.py 3302ms 19ms 8.4MB 3287ms 0ms cpython 3.11.4
python 2.py 3358ms 33ms 8.6MB 3343ms 0ms cpython 3.11.4

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 620ms 16ms 69.7MB 600ms 13ms dotnet/aot 7.0.306
csharp 1.cs 762ms 8.7ms 86.6MB 740ms 10ms mono 6.12.0
csharp 2.cs 767ms 3.1ms 21.7MB 757ms 0ms dotnet/aot 7.0.306
csharp 2.cs 942ms 5.1ms 38.8MB 900ms 7ms dotnet 7.0.306
csharp 1.cs 1381ms 38ms 86.3MB 1333ms 23ms dotnet 7.0.306
csharp 2.cs 2479ms 43ms 34.3MB 2460ms 3ms mono 6.12.0
python 1.py 3962ms 23ms 388.8MB 3823ms 117ms pypy 3.10.12
python 2.py 4945ms 31ms 633.0MB 4633ms 293ms pyston 3.8.12
python 1.py timeout 0.0ms 321.1MB 4937ms 50ms cpython 3.11.4
python 2.py timeout 0.0ms 633.6MB 4703ms 277ms cpython 3.11.4
python 2.py timeout 0.0ms 1013.9MB 4687ms 287ms pypy 3.10.12
python 1.py timeout 0.0ms 320.5MB 4910ms 73ms pyston 3.8.12

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 146ms 4.5ms 29.8MB 140ms 0ms dotnet/aot 7.0.306
csharp 1.cs 185ms 0.9ms 40.7MB 163ms 7ms mono 6.12.0
csharp 2.cs 190ms 2.0ms 15.3MB 187ms 0ms dotnet/aot 7.0.306
csharp 2.cs 272ms 2.7ms 28.1MB 233ms 7ms dotnet 7.0.306
csharp 1.cs 336ms 2.1ms 44.3MB 293ms 13ms dotnet 7.0.306
csharp 2.cs 605ms 1.1ms 25.5MB 583ms 7ms mono 6.12.0
python 1.py 883ms 15ms 213.0MB 840ms 30ms pypy 3.10.12
python 2.py 1136ms 6.5ms 164.4MB 1070ms 50ms pyston 3.8.12
python 2.py 1412ms 11ms 266.7MB 1277ms 117ms pypy 3.10.12
python 1.py 1677ms 20ms 86.1MB 1640ms 23ms pyston 3.8.12
python 2.py 1697ms 29ms 164.8MB 1647ms 37ms cpython 3.11.4
python 1.py 2679ms 11ms 86.8MB 2640ms 20ms cpython 3.11.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 2543ms 2.7ms 117.0MB 2500ms 27ms pypy 3.10.12
python 4.py 2776ms 0.4ms 9.1MB 2743ms 17ms pyston 3.8.12
python 4.py 2798ms 0.7ms 9.4MB 2747ms 33ms cpython 3.11.4
csharp 1.cs 4565ms 6.9ms 76.2MB 4533ms 40ms dotnet/aot 7.0.306
csharp 1.cs 4718ms 42ms 98.2MB 4653ms 87ms dotnet 7.0.306

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 4.py 631ms 3.2ms 81.5MB 603ms 13ms pypy 3.10.12
python 4.py 657ms 0.1ms 8.9MB 647ms 0ms pyston 3.8.12
python 4.py 666ms 0.5ms 9.1MB 653ms 0ms cpython 3.11.4
csharp 1.cs 1086ms 9.4ms 75.7MB 1067ms 17ms dotnet/aot 7.0.306
csharp 1.cs 1163ms 10ms 94.9MB 1150ms 40ms dotnet 7.0.306

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
python 1.py 3325ms 5.1ms 258.9MB 3233ms 73ms pypy 3.10.12
csharp 5.cs 3416ms 65ms 527.1MB 3323ms 220ms dotnet 7.0.306
csharp 6.cs 3599ms 14ms 460.5MB 3483ms 167ms dotnet/aot 7.0.306
csharp 6.cs 3887ms 42ms 517.4MB 3740ms 203ms dotnet 7.0.306
csharp 5.cs timeout 0.0ms 182.6MB 4977ms 67ms dotnet/aot 7.0.306
python 1.py timeout 0.0ms 107.1MB 4937ms 43ms cpython 3.11.4
python 1.py timeout 0.0ms 107.2MB 4937ms 47ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 6.cs 376ms 0.7ms 72.6MB 353ms 23ms dotnet/aot 7.0.306
python 1.py 461ms 0.9ms 101.7MB 420ms 20ms pypy 3.10.12
csharp 5.cs 473ms 8.1ms 90.9MB 417ms 37ms dotnet 7.0.306
csharp 6.cs 563ms 2.8ms 89.0MB 510ms 30ms dotnet 7.0.306
csharp 5.cs 688ms 3.6ms 69.6MB 667ms 17ms dotnet/aot 7.0.306
python 1.py 697ms 1.5ms 30.5MB 660ms 17ms pyston 3.8.12
python 1.py 818ms 2.0ms 31.7MB 780ms 20ms cpython 3.11.4

secp256k1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 3863ms 8.0ms 73.5MB 3823ms 33ms dotnet/aot 7.0.306
csharp 1.cs 4150ms 3.6ms 95.2MB 4147ms 43ms dotnet 7.0.306
python 1.py 4452ms 3.7ms 8.4MB 4433ms 0ms pyston 3.8.12
python 1.py 4692ms 27ms 8.5MB 4677ms 0ms cpython 3.11.4
python 1.py 4720ms 4.9ms 84.7MB 4693ms 13ms pypy 3.10.12

Input: 500

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 1.cs 997ms 2.8ms 73.4MB 973ms 20ms dotnet/aot 7.0.306
python 1.py 1126ms 1.3ms 8.5MB 1113ms 0ms pyston 3.8.12
csharp 1.cs 1171ms 2.6ms 92.2MB 1173ms 33ms dotnet 7.0.306
python 1.py 1182ms 6.4ms 8.4MB 1170ms 0ms cpython 3.11.4
python 1.py 1308ms 2.3ms 81.7MB 1270ms 23ms pypy 3.10.12

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 2524ms 7.5ms 13.7MB 4930ms 0ms dotnet/aot 7.0.306
csharp 3-m.cs 4435ms 37ms 34.9MB 8597ms 10ms dotnet 7.0.306
csharp 3.cs timeout 0.0ms 26.5MB 9777ms 7ms mono 6.12.0
python 8.py timeout 0.0ms 16.6MB 53ms 10ms cpython 3.11.4
python 8.py timeout 0.0ms 106.2MB 663ms 87ms pypy 3.10.12
python 8.py timeout 0.0ms 18.0MB 80ms 13ms pyston 3.8.12

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 651ms 2.8ms 8.3MB 1233ms 10ms dotnet/aot 7.0.306
csharp 3-m.cs 1230ms 6.9ms 31.6MB 2307ms 3ms dotnet 7.0.306
csharp 3-m.cs 3185ms 152ms 27.8MB 6040ms 0ms mono 6.12.0
python 8.py timeout 0.0ms 14.4MB 127ms 13ms cpython 3.11.4
python 8.py timeout 0.0ms 111.5MB 1110ms 217ms pypy 3.10.12
python 8.py timeout 0.0ms 15.6MB 140ms 30ms pyston 3.8.12

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
csharp 3-m.cs 179ms 2.9ms 12.2MB 310ms 7ms dotnet/aot 7.0.306
csharp 3.cs 433ms 78ms 29.7MB 567ms 13ms dotnet 7.0.306
csharp 3-m.cs 802ms 3.6ms 29.7MB 1520ms 7ms mono 6.12.0
python 8-m.py 3124ms 25ms 105.3MB 5340ms 337ms pypy 3.10.12
python 8.py timeout 0.0ms 16.2MB 263ms 17ms cpython 3.11.4
python 8.py timeout 0.0ms 16.7MB 320ms 57ms pyston 3.8.12