I live and drive in Sydney, but I wouldn't drive to the airport. Even in a taxi it's horrible. As others have said, why not take a train from Canberra or Bomaderry? The airport train link is easy.
It's scandalous that there is still no proper transport to Bermagui, though I suppose it helps to...