Great suggestions so far.
I would say that if you find yourself down at King St. Wharf then its worth stopping past The Loft for a coughtail too. It is above Bungalow 8, at the very end of King St. Wharf.
Unfortunately public transport to/from Darling Harbour isn't amazing but there is a tram...