All regex-redux problem benchmarks

Current benchmark data was generated on Sat Jan 28 2023, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 566ms 9.1ms 77.6MB 713ms 20ms rustc 1.67.0
d 3.d 815ms 1.9ms 165.8MB 1023ms 47ms ldc2 1.30.0
d 3.d 1647ms 5.7ms 171.3MB 1887ms 30ms dmd 2.101.2
chapel 3.chpl 1995ms 11ms 221.6MB 1847ms 137ms chpl 1.29.0
crystal 1.cr 2375ms 3.5ms 173.9MB 2313ms 43ms crystal 1.7.2
nim 1.nim 2490ms 1.9ms 168.2MB 2440ms 30ms nim/clang 1.6.10
nim 1.nim 2531ms 3.9ms 167.4MB 2480ms 33ms nim 1.6.10
csharp 5.cs 3329ms 22ms 600.0MB 3280ms 227ms dotnet 7.0.102
python 1.py 3568ms 25ms 262.2MB 3440ms 110ms pypy 3.9.16
csharp 6.cs 3601ms 2.5ms 459.1MB 3513ms 140ms dotnet/aot 7.0.102
csharp 6.cs 3875ms 36ms 596.2MB 3773ms 167ms dotnet 7.0.102
csharp 5.cs timeout 0.0ms 182.2MB 4977ms 67ms dotnet/aot 7.0.102
dart 1.dart timeout 0.0ms 102.4MB 4957ms 23ms dart/exe 2.19.0
go 3.go timeout 0.0ms 116.1MB 4973ms 67ms go 1.19.5
go 3.go timeout 0.0ms 120.9MB 4963ms 20ms tinygo 0.25.0
java 3.java timeout 0.0ms 251.6MB 5297ms 53ms graal/jvm 17.0.6
java 3.java timeout 0.0ms 205.8MB 5240ms 70ms openjdk 19
java 3.java timeout 0.0ms 204.2MB 5250ms 63ms openjdk 20
java 3.java timeout 0.0ms 337.4MB 4960ms 220ms openjdk/zgc 19
kotlin 1.kt timeout 0.0ms 159.4MB 5310ms 60ms kotlin/jvm 17.0.2
kotlin 1n.kt timeout 0.0ms 277.3MB 5447ms 763ms kotlin/native 1.8.0
ocaml 2.ml timeout 0.0ms 181.9MB 4913ms 67ms ocaml 5.0.0
python 1.py timeout 0.0ms 108.4MB 4953ms 27ms cpython 3.11.1
python 1.py timeout 0.0ms 106.9MB 4930ms 50ms pyston 3.8.12

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
rust 7.rs 64ms 0.7ms 11.1MB 73ms 0ms rustc 1.67.0
d 3.d 86ms 1.3ms 23.7MB 100ms 0ms ldc2 1.30.0
d 3.d 176ms 2.9ms 27.3MB 190ms 0ms dmd 2.101.2
chapel 3.chpl 218ms 3.7ms 35.6MB 187ms 17ms chpl 1.29.0
crystal 1.cr 252ms 3.1ms 32.1MB 227ms 3ms crystal 1.7.2
nim 1.nim 256ms 2.0ms 17.0MB 233ms 3ms nim/clang 1.6.10
nim 1.nim 260ms 2.1ms 16.8MB 247ms 0ms nim 1.6.10
csharp 6.cs 379ms 3.0ms 68.4MB 360ms 13ms dotnet/aot 7.0.102
csharp 5.cs 480ms 5.5ms 163.8MB 417ms 43ms dotnet 7.0.102
python 1.py 501ms 2.5ms 100.6MB 457ms 27ms pypy 3.9.16
csharp 6.cs 575ms 2.7ms 161.8MB 507ms 47ms dotnet 7.0.102
csharp 5.cs 691ms 5.9ms 71.3MB 667ms 17ms dotnet/aot 7.0.102
python 1.py 706ms 1.3ms 30.5MB 670ms 20ms pyston 3.8.12
ocaml 2.ml 715ms 2.1ms 52.5MB 687ms 13ms ocaml 5.0.0
dart 1.dart 785ms 3.3ms 54.1MB 757ms 10ms dart/exe 2.19.0
python 1.py 828ms 1.2ms 31.9MB 793ms 17ms cpython 3.11.1
java 3.java 1031ms 22ms 171.4MB 1417ms 47ms graal/jvm 17.0.6
java 3.java 1061ms 34ms 109.9MB 1380ms 37ms openjdk 19
java 3.java 1064ms 6.8ms 114.5MB 1403ms 27ms openjdk 20
kotlin 1.kt 1080ms 5.7ms 95.1MB 1430ms 33ms kotlin/jvm 17.0.2
java 3.java 1191ms 24ms 157.7MB 1353ms 120ms openjdk/zgc 19
go 3.go 2541ms 30ms 18.5MB 2523ms 17ms go 1.19.5
kotlin 1n.kt 4415ms 48ms 65.1MB 5760ms 13ms kotlin/native 1.8.0
go 3.go timeout 0.0ms 30.0MB 4977ms 3ms tinygo 0.25.0