Grand Cayman weather?

I was thinking about booking a vacation to the Grand Cayman island in late May early June. But I looked on there website and it said that is the rainiest part of the year. If I go will I have bad weather the whole time? Can somebody from there or somebody who has been there tell me how the weather will probably be that time of the year. I do not want to spend thousands on a rainy trip :(