Senior Liberal senator James Paterson has warned that his party is facing extinction. He has every right to be worried.