Programming Language and compiler
Benchmarks

Java VS Crystal benchmarks

Current benchmark data was generated on Thu Sep 22 2022, full log can be found HERE

CONTRIBUTIONS are WELCOME!

[x86_64][2 cores] Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz (Model 106)

* -m in a file name stands for multi-threading or multi-processing

* -i in a file name stands for direct intrinsics usage. (Usage of simd intrinsics via libraries is not counted)

* -ffi in a file name stands for non-stdlib FFI usage

* (You may find time < time(user) + time(sys) for some non-parallelized programs, the overhead is from GC or JIT compiler, which are allowed to take advantage of multi-cores as that's more close to real-world scenarios.)

binarytrees

Input: 18

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2.java 664ms 1.0ms 413.9MB 690ms 83ms openjdk 20
java 2.java 690ms 43ms 602.5MB 673ms 120ms openjdk 19
java 2.java 744ms 45ms 680.0MB 807ms 163ms graal/jvm 17.0.4
java 2.java 1277ms 28ms 1069.2MB 903ms 583ms openjdk/zgc 19
crystal 1.cr 1541ms 5.5ms 66.2MB 1840ms 17ms crystal 1.5.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 131ms 0.2ms 13.1MB 140ms 0ms crystal 1.5.1
java 2.java 164ms 6.4ms 109.4MB 170ms 23ms openjdk 19
java 2.java 174ms 14ms 111.4MB 163ms 37ms openjdk 20
java 2-m.java 182ms 6.2ms 168.4MB 240ms 40ms graal/jvm 17.0.4
java 2.java 300ms 5.7ms 243.7MB 187ms 153ms openjdk/zgc 19

edigits

Input: 250001

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 85ms 3.4ms 9.2MB 70ms 0ms crystal 1.5.1
java 1-m.java 707ms 9.0ms 265.3MB 1220ms 77ms graal/jvm 17.0.4
java 1-m.java 855ms 53ms 199.0MB 1527ms 47ms openjdk 19
java 1-m.java 865ms 87ms 204.6MB 1517ms 80ms openjdk 20
java 1-m.java 1039ms 68ms 472.6MB 1557ms 310ms openjdk/zgc 19

Input: 100000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 31ms 0.4ms 7.0MB 20ms 0ms crystal 1.5.1
java 1-m.java 376ms 7.7ms 183.4MB 617ms 47ms graal/jvm 17.0.4
java 1-m.java 417ms 22ms 115.4MB 690ms 43ms openjdk 19
java 1-m.java 456ms 17ms 118.7MB 757ms 37ms openjdk 20
java 1-m.java 547ms 23ms 209.2MB 777ms 153ms openjdk/zgc 19

fannkuch-redux

Input: 11

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 1676ms 23ms 100.6MB 3180ms 33ms graal/jvm 17.0.4
java 1-m.java 1702ms 47ms 43.8MB 3257ms 17ms openjdk 20
java 1-m.java 1722ms 18ms 43.8MB 3290ms 13ms openjdk 19
java 1-m.java 1731ms 12ms 42.4MB 3233ms 50ms openjdk/zgc 19
crystal 1.cr 3970ms 6.7ms 3.0MB 3957ms 0ms crystal 1.5.1

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1-m.java 272ms 3.4ms 42.5MB 443ms 13ms openjdk 20
java 1-m.java 273ms 6.2ms 42.2MB 437ms 10ms openjdk 19
java 1-m.java 285ms 13ms 91.6MB 450ms 17ms graal/jvm 17.0.4
java 1-m.java 315ms 4.4ms 42.5MB 450ms 50ms openjdk/zgc 19
crystal 1.cr 323ms 0.4ms 3.0MB 310ms 0ms crystal 1.5.1

fasta

Input: 2500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 4.java 510ms 2.3ms 44.0MB 587ms 17ms openjdk 20
java 4.java 515ms 7.4ms 43.3MB 590ms 17ms openjdk 19
java 4.java 558ms 6.8ms 41.8MB 587ms 67ms openjdk/zgc 19
java 4-m.java 618ms 4.2ms 119.8MB 937ms 27ms graal/jvm 17.0.4
crystal 2.cr 859ms 3.2ms 5.6MB 750ms 97ms crystal 1.5.1
crystal 1.cr 1059ms 1.3ms 16.7MB 903ms 140ms crystal 1.5.1

Input: 250000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 91ms 1.0ms 5.3MB 70ms 3ms crystal 1.5.1
crystal 1.cr 111ms 0.2ms 4.6MB 87ms 10ms crystal 1.5.1
java 4.java 141ms 1.4ms 42.9MB 160ms 20ms openjdk 20
java 4.java 144ms 4.0ms 41.2MB 177ms 7ms openjdk 19
java 4.java 154ms 7.2ms 90.9MB 193ms 23ms graal/jvm 17.0.4
java 4.java 184ms 4.4ms 43.1MB 167ms 50ms openjdk/zgc 19

helloworld

Input: QwQ

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 4.6ms 2.2ms 3.1MB 0ms 0ms crystal 1.5.1
java 1.java 70ms 3.1ms 63.4MB 70ms 10ms graal/jvm 17.0.4
java 1.java 78ms 5.0ms 42.7MB 78ms 6ms openjdk 20
java 1.java 82ms 3.6ms 40.8MB 78ms 8ms openjdk 19
java 1.java 119ms 4.8ms 39.9MB 78ms 52ms openjdk/zgc 19

knucleotide

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3-m.java 1454ms 18ms 114.9MB 2660ms 40ms openjdk 20
java 3-m.java 1468ms 27ms 117.1MB 2693ms 47ms openjdk 19
java 3-m.java 1599ms 70ms 191.0MB 2963ms 53ms graal/jvm 17.0.4
java 3-m.java 1935ms 42ms 175.5MB 3417ms 150ms openjdk/zgc 19

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 3-m.java 459ms 22ms 93.2MB 763ms 27ms openjdk 20
java 3-m.java 475ms 7.0ms 94.5MB 717ms 80ms openjdk/zgc 19
java 3-m.java 487ms 66ms 96.8MB 830ms 23ms openjdk 19
java 3-m.java 679ms 63ms 161.5MB 1190ms 40ms graal/jvm 17.0.4

mandelbrot

Input: 5000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 994ms 0.9ms 7.6MB 980ms 0ms crystal 1.5.1
java 1b.java 1401ms 6.2ms 50.4MB 1487ms 10ms openjdk 20
java 1b.java 1420ms 20ms 50.1MB 1510ms 17ms openjdk 19
java 1b.java 1461ms 14ms 47.6MB 1520ms 50ms openjdk/zgc 19
java 1b.java 1467ms 10ms 120.7MB 1620ms 37ms graal/jvm 17.0.4
java 1a.java 1529ms 0.9ms 48.5MB 1617ms 10ms openjdk 19
java 1a.java 1537ms 4.1ms 50.9MB 1610ms 20ms openjdk 20
java 1a.java 1573ms 2.7ms 47.6MB 1617ms 53ms openjdk/zgc 19
java 1a.java 1577ms 3.0ms 112.9MB 1680ms 27ms graal/jvm 17.0.4
java 1.java 2025ms 21ms 165.5MB 2130ms 30ms graal/jvm 17.0.4
java 1.java 2115ms 8.5ms 198.3MB 2173ms 37ms openjdk 20
java 1.java 2138ms 4.5ms 192.1MB 2200ms 33ms openjdk 19
java 1.java 2503ms 14ms 581.3MB 2243ms 367ms openjdk/zgc 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 46ms 0.5ms 6.4MB 40ms 0ms crystal 1.5.1
java 1b.java 210ms 4.8ms 46.6MB 283ms 17ms openjdk 19
java 1b.java 210ms 4.2ms 46.7MB 287ms 10ms openjdk 20
java 1a.java 214ms 1.9ms 47.1MB 280ms 10ms openjdk 19
java 1a.java 215ms 15ms 46.8MB 283ms 13ms openjdk 20
java 1.java 216ms 6.0ms 95.9MB 263ms 23ms openjdk 19
java 1.java 218ms 4.9ms 99.6MB 270ms 17ms openjdk 20
java 1a.java 222ms 4.8ms 101.7MB 293ms 30ms graal/jvm 17.0.4
java 1.java 241ms 3.5ms 107.0MB 307ms 40ms graal/jvm 17.0.4
java 1b.java 260ms 24ms 45.7MB 300ms 57ms openjdk/zgc 19
java 1a.java 274ms 51ms 47.2MB 320ms 50ms openjdk/zgc 19
java 1b-m.java 281ms 24ms 118.7MB 413ms 43ms graal/jvm 17.0.4
java 1.java 287ms 18ms 113.1MB 293ms 77ms openjdk/zgc 19
java 2.java 761ms 27ms 547.8MB 943ms 127ms openjdk 19
java 2.java 766ms 10ms 566.9MB 947ms 110ms openjdk 20
java 2.java 1367ms 20ms 1026.7MB 1000ms 660ms openjdk/zgc 19

merkletrees

Input: 17

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 1.java 495ms 5.0ms 291.5MB 513ms 73ms openjdk 20
java 1.java 512ms 13ms 367.3MB 520ms 83ms openjdk 19
java 1.java 549ms 9.4ms 361.3MB 697ms 87ms graal/jvm 17.0.4
java 1.java 932ms 20ms 758.5MB 643ms 430ms openjdk/zgc 19
crystal 1.cr 1083ms 49ms 64.3MB 1230ms 23ms crystal 1.5.1

Input: 15

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 207ms 6.9ms 17.5MB 223ms 3ms crystal 1.5.1
java 1.java 219ms 2.1ms 173.3MB 243ms 37ms openjdk 19
java 1.java 223ms 6.1ms 174.3MB 237ms 43ms openjdk 20
java 1-m.java 267ms 8.9ms 245.9MB 380ms 60ms graal/jvm 17.0.4
java 1.java 433ms 6.0ms 353.0MB 260ms 230ms openjdk/zgc 19

nbody

Input: 5000000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 516ms 4.8ms 2.9MB 500ms 0ms crystal 1.5.1
java 1.java 539ms 2.8ms 86.1MB 583ms 20ms graal/jvm 17.0.4
crystal 2.cr 540ms 0.7ms 2.9MB 530ms 0ms crystal 1.5.1
java 1.java 558ms 2.9ms 44.4MB 563ms 23ms openjdk 20
java 1.java 558ms 2.6ms 42.4MB 577ms 13ms openjdk 19
java 1.java 614ms 4.4ms 42.3MB 590ms 57ms openjdk/zgc 19
java 2.java 1887ms 33ms 538.3MB 1923ms 107ms openjdk 19
java 2.java 1923ms 9.6ms 563.7MB 1950ms 127ms openjdk 20
java 2.java 2582ms 4.7ms 1219.4MB 2027ms 753ms openjdk/zgc 19

Input: 500000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 56ms 1.6ms 3.0MB 50ms 0ms crystal 1.5.1
crystal 2.cr 60ms 2.8ms 2.9MB 43ms 0ms crystal 1.5.1
java 1.java 142ms 3.9ms 42.7MB 157ms 17ms openjdk 20
java 1.java 144ms 1.6ms 86.4MB 190ms 20ms graal/jvm 17.0.4
java 1.java 146ms 5.8ms 42.7MB 167ms 10ms openjdk 19
java 1.java 190ms 3.5ms 42.2MB 160ms 57ms openjdk/zgc 19
java 2.java 414ms 4.9ms 363.3MB 493ms 70ms openjdk 20
java 2.java 417ms 2.1ms 355.0MB 483ms 73ms openjdk 19
java 2.java 676ms 0.7ms 455.4MB 547ms 290ms openjdk/zgc 19

nsieve

Input: 12

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 467ms 2.2ms 9.8MB 453ms 0ms crystal 1.5.1
java 1.java 781ms 22ms 88.1MB 807ms 23ms openjdk 20
crystal 1.cr 851ms 16ms 42.7MB 827ms 7ms crystal 1.5.1
java 1.java 922ms 29ms 84.4MB 943ms 23ms openjdk 19
java 1.java 982ms 26ms 110.6MB 940ms 87ms openjdk/zgc 19
java 2.java 1003ms 4.6ms 52.7MB 1043ms 13ms openjdk 20
java 2.java 1028ms 5.3ms 52.2MB 1010ms 60ms openjdk/zgc 19
java 2.java 1039ms 37ms 54.3MB 1077ms 17ms openjdk 19
java 1-m.java 1472ms 70ms 163.9MB 2240ms 53ms graal/jvm 17.0.4
java 2-m.java 1848ms 24ms 128.2MB 3400ms 50ms graal/jvm 17.0.4

Input: 10

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 2.cr 108ms 0.2ms 4.4MB 97ms 0ms crystal 1.5.1
crystal 1.cr 151ms 1.6ms 12.9MB 137ms 0ms crystal 1.5.1
java 1.java 236ms 2.7ms 62.5MB 270ms 13ms openjdk 20
java 1.java 237ms 4.6ms 62.3MB 257ms 27ms openjdk 19
java 1.java 280ms 5.4ms 60.9MB 263ms 60ms openjdk/zgc 19
java 2.java 325ms 6.4ms 48.8MB 363ms 10ms openjdk 20
java 2.java 326ms 0.8ms 48.2MB 360ms 17ms openjdk 19
java 1-m.java 332ms 8.9ms 135.3MB 470ms 43ms graal/jvm 17.0.4
java 2.java 360ms 3.3ms 44.2MB 353ms 50ms openjdk/zgc 19
java 2-m.java 611ms 3.6ms 127.9MB 1100ms 33ms graal/jvm 17.0.4

pidigits

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2779ms 53ms 9.0MB 3030ms 280ms crystal 1.5.1
java 1.java 4981ms 1.4ms 374.1MB 5360ms 117ms graal/jvm 17.0.4
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 644ms 5.5ms 5.3MB 670ms 70ms crystal 1.5.1
java 1.java 1362ms 9.0ms 390.5MB 1710ms 97ms graal/jvm 17.0.4
java 1.java 1411ms 34ms 288.1MB 1777ms 70ms openjdk 19
java 1.java 1453ms 6.4ms 302.3MB 1863ms 57ms openjdk 20
java 1.java 1946ms 8.4ms 924.1MB 1807ms 637ms openjdk/zgc 19

regex-redux

Input: 2500000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 2474ms 0.8ms 196.1MB 2397ms 57ms crystal 1.5.1
java 3.java timeout 0.0ms 0.0MB 0ms 0ms graal/jvm 17.0.4
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 3.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 250000_in

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 256ms 2.5ms 24.5MB 237ms 3ms crystal 1.5.1
java 3.java 1050ms 10ms 187.5MB 1453ms 50ms graal/jvm 17.0.4
java 3.java 1073ms 14ms 112.0MB 1417ms 40ms openjdk 20
java 3.java 1079ms 23ms 109.8MB 1417ms 43ms openjdk 19
java 3.java 1166ms 16ms 158.0MB 1343ms 123ms openjdk/zgc 19

spectral-norm

Input: 8000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 4306ms 8.2ms 104.9MB 8330ms 30ms graal/jvm 17.0.4
crystal 1.cr timeout 0.0ms 0.0MB 0ms 0ms crystal 1.5.1
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20
java 2.java timeout 0.0ms 0.0MB 0ms 0ms openjdk/zgc 19

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
java 2-m.java 1270ms 5.6ms 108.9MB 2323ms 37ms graal/jvm 17.0.4
crystal 1.cr 1510ms 2.5ms 5.8MB 1493ms 0ms crystal 1.5.1
java 2-m.java 1647ms 83ms 44.4MB 3100ms 20ms openjdk 19
java 2-m.java 1733ms 180ms 44.2MB 3290ms 17ms openjdk 20
java 2-m.java 1755ms 197ms 42.6MB 3250ms 57ms openjdk/zgc 19

Input: 2000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 382ms 1.3ms 3.8MB 370ms 0ms crystal 1.5.1
java 2-m.java 446ms 11ms 98.3MB 743ms 40ms graal/jvm 17.0.4
java 2-m.java 563ms 42ms 44.2MB 1017ms 10ms openjdk 20
java 2-m.java 582ms 12ms 44.6MB 1037ms 17ms openjdk 19
java 2-m.java 647ms 16ms 44.4MB 1083ms 50ms openjdk/zgc 19

coro-prime-sieve

Input: 4000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 1972ms 20ms 22.3MB 1920ms 30ms crystal 1.5.1
java 1-m.java 4259ms 124ms 932.0MB 7657ms 480ms openjdk/zgc 19
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 19
java 1.java timeout 0.0ms 0.0MB 0ms 0ms openjdk 20

Input: 1000

lang code time stddev peak-mem mem time(user) time(sys) compiler compiler/runtime
crystal 1.cr 110ms 4.1ms 7.6MB 97ms 3ms crystal 1.5.1
java 1-m.java 737ms 38ms 107.3MB 1317ms 30ms openjdk 19
java 1-m.java 840ms 118ms 99.6MB 1487ms 40ms openjdk 20
java 1-m.java 958ms 20ms 311.7MB 1573ms 170ms openjdk/zgc 19