Prisons chief Martin Narey has removed the director of the privatised Ashfield prison following fears that conditions were so bad that staff and inmates were unsafe.