Steven Bergwijn scored an incredible late double in added time to snatch victory from the jaws of defeat for Spurs.
Tottenham climbed above Arsenal into fifth with the dramatic win after Dutch ace Bergwijn came off the bench with the visitors 2-1 down.
Stats gurus Opta confirmed that the victory was the latest that a team has come from a losing position to win a match in Premier League history, with Spurs still trailing in after 94 minutes and 52 seconds before coming back to win.
The previous latest come from behind win was Manchester City's unforgettable title-clinching victory against QPR on the final day of the 2011-12 season, when they were still trailing 2-1 after 91 minutes and 14 seconds.
Spurs stay unbeaten in the Premier League under Antonio Conte after Bergwijn's heroics.
They are now just one point off fourth-placed West Ham with three games in hand.
Bergwijn, 24, after scoring his first Premier League goals of the season, said: “It was a rollercoaster.
"If I come on I want to show myself and I am really happy I scored two goals.
“We showed we are a team and we came back."
Spurs skipper Harry Kane equalised in the first half with his 250th career goal to cancel out Patson Daka's opener.
He then released Bergwijn to score the winner after thumping in in the 95th minute to make it 2-2 following James Maddison's effort.
Kane said: “Overall we thoroughly deserved the victory.
"It is what this team is about.
"I should have had a couple more out there but when you win it doesn’t hurt as much.
"Credit to all the boys for not giving up all the way until the final whistle.
"It has not been easy with injuries but he (Bergwijn) has been working hard behind the scenes."
Leicester had 13 shots in the entertaining contest but Tottenham had 27 - more than they have had all season.
Conte said: "It was a great win.
"Honestly I think we didn't deserve to lose the game and the draw was unfair too.
"We created many chances to score.
"They showed to me great will and a desire to not lose this game."
On match-winner Bergwijn, Conte added: "He is good technically and one v one.
"If he is in good physical condition, he is an importance choice I can make for the starting XI or in the game."