As counting continued in the Mornington Peninsula seat of Nepean, Liberal candidate Anthony Marsh appeared to be in a commanding position in a significant boost to opposition leader Jess Wilson.
With close to 80 per cent of the vote counted, Mr Marsh had 38.5 per cent of the primary vote, and 63.4 per cent on a two-candidate basis.
However, the Victorian Electoral Commission was initially running the two-candidate vote as a race between the Liberals and independent Tracee Hutchinson.
Ms Hutchinson was in second place early in the count, but later slipped behind One Nation's Darren Hercus.
Mr Hercus had 24.7 per cent of the primary vote to Ms Hutchinson's 21.3 per cent.
In a speech to supporters, Mr Marsh said he was "so glad I could bring it home for you tonight".
"This is the honour of my life to be standing here as the next member for Nepean," he said.
"I'll be on the ground each and every single day fighting for the people of Nepean as we lead into one of the most important state elections that we've seen."
Welcoming the result, Ms Wilson said the party still had more work to do ahead of the November poll.
Labor opted not to field a candidate in the by-election and while the Liberals retained Nepean, the party suffered close to a 10 per cent swing against it on the primary vote.
Saturday's by-election was triggered by the sudden resignation of Victorian Liberal deputy leader Sam Groth, with the party holding the seat since its inception for all but four years when it fell to Labor.
Mr Marsh was forced to admit he didn't live in the electorate so couldn't vote for himself on Saturday, but said he had been mayor in the area three times over the past five years.
Mr Hercus told reporters it was a tight race with a mixed response from voters fed up with empty promises.
"We've had a few Liberal voters come over to us for frustrations they've been feeling with their own party," he said.
One Nation leader Pauline Hanson campaigned alongside Mr Hercus but was absent on polling day.
"People will vote for her rather than me," Mr Hercus said.
Ahead of the count, Ms Hutchison told reporters a lot of voters were looking for an alternative as the area had been overlooked and let down by the major parties for decades.
"I am putting myself forward as someone who is of this place, who cares deeply about this place," she said.
The strong One Nation showing backed up national polling and the South Australian election result, and could bode poorly for the Liberals in the Victorian state election, senior politics lecturer at Monash University Benjamin Moffitt said.
"If they even do somewhat well in Nepean, that's a real problem for the Liberal Party," Dr Moffitt said.
The electorate takes in the wealthy postcodes of Sorrento, Portsea and Flinders, and low socio-economic areas such as Capel Sound, formerly known as Rosebud West.
The Mornington Peninsula is officially part of metropolitan Melbourne, but does not have comparable services, with public transport and a planned revamp of Rosebud Hospital among key issues for locals.