We went last April, along with a trip to Rhodes & some time around Athens’ Acropolis.
Santorum it was a ton of fun. We were only to be there for a couple days so we hired a guide, which was lots of fun. In April it was cool enough that we didn’t swim, but there is a black sand beach I would go back for.