Rishi Sunak has been told to suspend Dominic Raab during an inquiry into bullying accusations during his time in three departments.
The Mirror revealed that civil servants claim they suffered breakdowns and felt suicidal over the Deputy PM's alleged conduct- with staff saying working the Tory felt like being in a “controlling and abusive relationship”.
Mr Raab is being investigated over eight complaints during his time at the Ministry of Justice, the Foreign Office and the former Brexit department, which are said to involve at least 24 staff. He denies accusations of bullying.
Phillip Rycroft, the former top official at the Department for Exiting the EU, confirmed he had given evidence to the probe led by top KC Adam Tolley.
He told Times Radio: "I'm pleased the investigation is happening.
"Clearly for everybody involved in this getting this sorted out is long overdue, but we'll have to wait and see what the investigator comes up with and ultimately the decision on the basis of that evidence is one for the Prime Minister."
Two other top mandarins - ex-Foreign Office chief Simon MacDonald and MOJ permanent secretary Antonia Romeo - have also been interviewed by the inquiry, according to The Guardian.
Dave Penman, leader of the FDA union, which represents senior officials, said Mr Raab should be suspended to protect other members of staff while the investigation is conducted.
"Dominic Raab is now facing investigations around eight separate complaints involving what we understand is dozens of civil servants in three separate government departments over a period of four years," he told BBC Radio 4's Today programme.
"If that was any other employee, if that was a permanent secretary in the civil service, they would in all likelihood be suspended from their job while the investigation took place.
"That's not to prejudge the investigation, that's to say if there are serious allegations of bullying and extensive allegations like this, that one of the considerations is how do you protect employees from that sort of behaviour?
"And while it's being determined, you would normally suspend someone, given the seriousness and extent of those accusations."
Labour's Steve Reed said the reports of complaints against Mr Raab were "hard to read".
"Nobody going into their place of work should be subject to bullying and intimidation like that," he told Sky News.
"The PM promised us when he came into Downing Street just a few months ago - integrity, professionalism and accountability.
"What did he know about these allegations against Dominic Raab?"
Mr Reed added: "With this number of allegations, of this level of severity, the normal thing would be to suspend somebody while they are investigated and yet Dominic Raab remains in post."
He said Mr Sunak was "too weak" to act and criticised the PM's delay in sacking Nadhim Zahawi and his reappointment of Suella Braverman as Home Secretary after she admitted to breaching the ministerial code.
But Education Secretary Gillian Keegan rejected calls for him to step aside while Mr Tolley carried out his work.
She told Sky News: "I personally think it is fair to let investigations continue.
"I think that is the fair process. I think it was Dom himself who instigated this investigation. That is ongoing. That will uncover all the facts. When you get the facts you discuss and take the action."
Ms Keegan said she doesn't feel uncomfortable sitting alongside someone accused of bullying.
"I sit round the Cabinet table and don't see that. I feel very comfortable with my colleagues around the Cabinet," she said.
Mr Raab’s spokesman refused to comment on the latest allegations. He has previously said he “looks forward to answering the allegations made of him directly”.
Mr Raab insisted last week: “I’m confident I behaved professionally, and of course the Government takes a zero-tolerance approach to bullying.”
Jacob Rees-Mogg provoked anger on Tuesday by suggesting officials are being “too snowflakey” about bullying claims.