C VS Java benchmarks

Current benchmark data was generated on Wed May 25 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz (Model 85)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 1.8ms 0.7ms 0.9MB 0ms 0ms gcc 12.1.0
c 1.c 2.2ms 0.7ms 1.1MB 0ms 0ms clang 11.0.0
c 1.c 2.9ms 1.6ms 0.6MB 0ms 0ms zigcc 0.10.0
java 1.java 79ms 1.8ms 61.3MB 73ms 18ms graal/jvm 17.0.3
java 1.java 81ms 2.9ms 38.9MB 82ms 10ms openjdk 18.0.1
java 1.java 85ms 4.6ms 38.3MB 78ms 14ms openjdk 19
java 1.java 131ms 1.4ms 38.7MB 86ms 58ms openjdk/zgc 18.0.1

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1-m.c 239ms 9.2ms 23.5MB 397ms 7ms gcc 12.1.0
c 1-m.c 534ms 27ms 20.4MB 853ms 13ms clang 11.0.0
java 3-m.java 1439ms 19ms 115.2MB 2607ms 50ms openjdk 18.0.1
java 3-m.java 1507ms 11ms 113.1MB 2753ms 47ms openjdk 19
java 3-m.java 1545ms 33ms 197.8MB 2800ms 77ms graal/jvm 17.0.3
java 3-m.java 2024ms 29ms 174.9MB 3523ms 173ms openjdk/zgc 18.0.1

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 34ms 0.3ms 12.8MB 40ms 3ms gcc 12.1.0
c 1-m.c 64ms 1.5ms 9.6MB 100ms 0ms clang 11.0.0
java 3-m.java 478ms 47ms 81.8MB 777ms 43ms openjdk 18.0.1
java 3-m.java 483ms 14ms 94.0MB 713ms 83ms openjdk/zgc 18.0.1
java 3-m.java 554ms 29ms 94.7MB 930ms 50ms openjdk 19
java 3-m.java 1462ms 0.8ms 192.7MB 2703ms 67ms graal/jvm 17.0.3

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 318ms 4.5ms 1.1MB 300ms 0ms clang 11.0.0
c 8-i.c 320ms 17ms 1.0MB 310ms 0ms gcc 12.1.0
c 5.c 334ms 0.4ms 1.0MB 320ms 0ms gcc 12.1.0
c 8-i.c 339ms 0.3ms 0.6MB 330ms 0ms zigcc 0.10.0
c 5.c 361ms 4.0ms 1.1MB 350ms 0ms clang 11.0.0
c 5.c 426ms 0.4ms 0.6MB 413ms 0ms zigcc 0.10.0
c 2.c 431ms 3.8ms 0.6MB 420ms 0ms zigcc 0.10.0
c 2.c 458ms 12ms 1.1MB 437ms 0ms clang 11.0.0
c 2.c 478ms 5.8ms 1.0MB 467ms 0ms gcc 12.1.0
java 1.java 626ms 14ms 40.9MB 643ms 13ms openjdk 18.0.1
java 1.java 628ms 13ms 39.7MB 637ms 17ms openjdk 19
java 1.java 696ms 1.2ms 38.4MB 663ms 53ms openjdk/zgc 18.0.1
java 1.java 891ms 1.3ms 88.1MB 610ms 33ms graal/jvm 17.0.3
java 2.java 2253ms 3.5ms 526.9MB 2250ms 147ms openjdk 18.0.1
java 2.java 2272ms 9.4ms 508.4MB 2277ms 157ms openjdk 19
java 2.java 3326ms 73ms 1646.8MB 2433ms 1097ms openjdk/zgc 18.0.1

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 8-i.c 36ms 0.4ms 0.6MB 30ms 0ms zigcc 0.10.0
c 8-i.c 36ms 0.3ms 0.9MB 23ms 0ms gcc 12.1.0
c 8-i.c 37ms 2.3ms 1.1MB 23ms 0ms clang 11.0.0
c 5.c 37ms 2.9ms 1.1MB 30ms 0ms clang 11.0.0
c 5.c 37ms 2.0ms 1.0MB 23ms 0ms gcc 12.1.0
c 5.c 45ms 0.2ms 0.6MB 37ms 0ms zigcc 0.10.0
c 2.c 45ms 0.1ms 0.6MB 33ms 0ms zigcc 0.10.0
c 2.c 47ms 3.4ms 1.1MB 37ms 0ms clang 11.0.0
c 2.c 50ms 0.4ms 1.0MB 40ms 0ms gcc 12.1.0
java 1.java 147ms 1.2ms 39.8MB 163ms 13ms openjdk 19
java 1.java 152ms 7.3ms 40.4MB 157ms 23ms openjdk 18.0.1
java 1.java 205ms 6.2ms 39.8MB 160ms 70ms openjdk/zgc 18.0.1
java 2.java 459ms 12ms 314.1MB 487ms 110ms openjdk 18.0.1
java 1.java 468ms 0.9ms 82.5MB 180ms 30ms graal/jvm 17.0.3
java 2.java 481ms 1.1ms 345.4MB 523ms 103ms openjdk 19
java 2.java 788ms 8.8ms 521.2MB 570ms 370ms openjdk/zgc 18.0.1

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 934ms 57ms 51.2MB 970ms 13ms openjdk 18.0.1
java 2.java 1037ms 49ms 50.1MB 1067ms 23ms openjdk 19
java 2.java 1090ms 3.0ms 47.3MB 1067ms 63ms openjdk/zgc 18.0.1
c 1.c 1127ms 26ms 41.1MB 1097ms 13ms gcc 12.1.0
c 1.c 1128ms 19ms 40.2MB 1097ms 13ms zigcc 0.10.0
c 1.c 1187ms 31ms 40.9MB 1150ms 20ms clang 11.0.0
java 1.java 1767ms 54ms 82.7MB 1787ms 20ms openjdk 18.0.1
java 1.java 1820ms 4.2ms 108.5MB 1753ms 103ms openjdk/zgc 18.0.1
java 1.java 1852ms 16ms 82.3MB 1873ms 30ms openjdk 19
java 1.java 2029ms 33ms 170.9MB 2880ms 70ms graal/jvm 17.0.3
java 2-m.java 2082ms 1.6ms 136.2MB 3847ms 73ms graal/jvm 17.0.3

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 1.c 117ms 1.8ms 11.6MB 103ms 0ms clang 11.0.0
c 1.c 117ms 5.1ms 11.8MB 100ms 0ms gcc 12.1.0
c 1.c 117ms 3.6ms 10.9MB 100ms 0ms zigcc 0.10.0
java 1.java 290ms 4.1ms 56.8MB 313ms 23ms openjdk 18.0.1
java 1.java 294ms 1.2ms 57.9MB 313ms 27ms openjdk 19
java 2.java 303ms 11ms 43.3MB 333ms 17ms openjdk 18.0.1
java 1.java 328ms 4.4ms 57.9MB 290ms 77ms openjdk/zgc 18.0.1
java 2.java 328ms 1.9ms 46.1MB 360ms 20ms openjdk 19
java 2.java 376ms 4.3ms 41.1MB 357ms 63ms openjdk/zgc 18.0.1
java 1.java 671ms 6.7ms 140.4MB 477ms 63ms graal/jvm 17.0.3
java 2.java 961ms 41ms 129.4MB 1160ms 33ms graal/jvm 17.0.3

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 1271ms 6.7ms 1.0MB 2483ms 0ms gcc 12.1.0
c 6-im.c 1437ms 4.1ms 3.1MB 2810ms 3ms clang 11.0.0
c 6-im.c 1518ms 1.7ms 0.9MB 2970ms 0ms gcc 12.1.0
c 4-m.c 1537ms 7.1ms 3.0MB 3007ms 3ms clang 11.0.0
c 5-im.c 1582ms 3.4ms 1.0MB 3097ms 0ms gcc 12.1.0
c 5-im.c 1742ms 4.8ms 3.1MB 3407ms 0ms clang 11.0.0
c 3-m.c 1874ms 2.0ms 0.9MB 3670ms 3ms gcc 12.1.0
c 3-m.c 1889ms 6.2ms 3.0MB 3700ms 0ms clang 11.0.0
java 2-m.java 4400ms 28ms 115.2MB 8420ms 57ms graal/jvm 17.0.3
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 18.0.1
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 18.0.1

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 329ms 6.5ms 2.4MB 620ms 0ms gcc 12.1.0
c 6-im.c 372ms 3.6ms 3.1MB 703ms 0ms clang 11.0.0
c 4-m.c 395ms 2.9ms 2.9MB 757ms 0ms clang 11.0.0
c 6-im.c 401ms 15ms 0.9MB 747ms 0ms gcc 12.1.0
c 5-im.c 411ms 1.9ms 1.0MB 787ms 0ms gcc 12.1.0
c 5-im.c 453ms 15ms 3.1MB 857ms 0ms clang 11.0.0
c 3-m.c 484ms 2.2ms 1.0MB 920ms 0ms gcc 12.1.0
c 3-m.c 488ms 12ms 3.1MB 927ms 0ms clang 11.0.0
java 2-m.java 1262ms 17ms 114.8MB 2297ms 53ms graal/jvm 17.0.3
java 2-m.java 1651ms 80ms 42.6MB 3087ms 23ms openjdk 19
java 2-m.java 2110ms 38ms 40.7MB 3980ms 13ms openjdk 18.0.1
java 2-m.java 2212ms 31ms 40.7MB 4127ms 67ms openjdk/zgc 18.0.1

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
c 4-m.c 90ms 0.5ms 1.0MB 160ms 0ms gcc 12.1.0
c 6-im.c 101ms 1.2ms 2.9MB 180ms 0ms clang 11.0.0
c 6-im.c 105ms 0.8ms 1.0MB 190ms 0ms gcc 12.1.0
c 4-m.c 107ms 0.4ms 3.0MB 190ms 0ms clang 11.0.0
c 5-im.c 111ms 0.5ms 1.0MB 200ms 0ms gcc 12.1.0
c 5-im.c 128ms 9.1ms 2.9MB 220ms 0ms clang 11.0.0
c 3-m.c 130ms 1.0ms 0.9MB 233ms 0ms gcc 12.1.0
c 3-m.c 132ms 4.3ms 3.1MB 230ms 0ms clang 11.0.0
java 2-m.java 522ms 28ms 40.2MB 907ms 13ms openjdk 19
java 2-m.java 634ms 6.8ms 39.1MB 1107ms 13ms openjdk 18.0.1
java 2-m.java 710ms 20ms 38.6MB 1183ms 53ms openjdk/zgc 18.0.1
java 2.java 755ms 14ms 104.2MB 733ms 37ms graal/jvm 17.0.3