What is the best Caribbean Island to retire to?

I've heard the Cayman Islands are the islands of choice to retire to but I also read that you need to have nearly half a million dollars U.S. to be allowed to retire there. They're restrictive on who they let in. Is this true and what might be a better choice for people who aren't wealthy.