Two MPs from the Shooters, Fishers and Farmers Party are threatening to quit the party if their leader does not resign.
Member for Barwon Roy Butler and Member for Orange Philip Donato have called on Shooters party leader Robert Borsak to leave politics altogether, as has Member of the Legislative Council Mark Banasiak.
If Mr Butler and Mr Donato quit, the party would be left without any lower house MPs.
The call comes two months after Mr Borsak was accused of bullying, for saying a female independent MP should have been "clocked."
Mr Butler said if no change was made, he would consider running as an independent at the March state election.
"The risk is that if it can't be resolved, then you go into the election with no lower house members, and potentially that also impacts the upper house vote," he said.
"So, to me the course of action for the executive and for Robert is pretty clear.
"I don't want to do that, but that is a possibility."
The only other Shooters party MP, Mr Donato, said he too may leave and run as an independent if Mr Borsak stayed.
"We do not want to leave the party, but ultimately if the executive doesn't choose to show some leadership on this issue and support … Roy, Mark and myself [and] the concerns we have, we may be left with no other choice," he said.
Mr Donato said Mr Borsak's refusal to apologise for the comments made about MP Helen Dalton wasn't good enough.
"I cannot continue to work under the leadership of Robert, and in a party that Robert's in, if he's not prepared to make those concessions.
"We don't stand for violence against anyone let alone women — it's something that was totally inappropriate."
'We've tried to give Robert feedback'
Mr Butler said the upper house comment two months ago was the last straw and the party had been discontent with their leader for years.
"We've tried to give Robert feedback about some of the things he's said, some of the things he's done, but it's a bit like water off a duck's back, it doesn't sink in," he said.
Mr Butler also confirmed he had been tapped on the shoulder to take the reins if Mr Borsak left.
He said it was something he would "consider", but it was not his ambition.
"My colleagues have suggested they would want me to do it, but I haven't yet nominated for it — if there is no option but for me to do it, I would do it," he said.
"It's not something that I would want to do — I've got enough to do with 44 per cent of the state frankly, but if it came to it yes I would."
Mr Donato has ruled out gunning for the leadership, and instead threw his support behind the Barwon MP.
"Roy would make a terrific leader of the party, he's a terrific communicator and leader in the community and represents our interests, I believe, in the best possible way," he said.
Mr Borsak has not responded to the ABC's requests for comment.
