Tough conditions have taken their toll on the fleet on day one of the Sydney to Hobart, with three retirements at sea on the NSW coast, and a new leader taking over entering the night's racing.