There are many trips you can buy in Sihanoukville, you can also just get on the ferry and decide when you wanna change the island. Worth to do the island hopping if you don'thave too much time, otherwise I recommend staying in each island for a few days to experience them better.