Iain Duncan Smith is facing an uphill battle after a survey found 70 per cent of people have no view about the merits of his election as leader of the Conservatives.