When we were there it was quite dirty at the shore, there were some spots at the far end that were fine and we didn't see the rubbish. It should've been taken care of.
The boats stop here while cruising Ha Long Bay. Pretty island, it's possible to swim around although the water isn't too clean given many boats polluting it.