They were ahead in the game thanks to Harry Kane's second-half penalty, and though Yerry Mina's 93rd-minute leveller brought about a feeling of deja vu, England manager Southgate insists he always knew they would come through.
England is favored to win their first Round of 16 game since 2006, but Ramadel Falcao and Colombia will provide the Three Lions their first real test of the 2018 FIFA World Cup.
Then, in the penalty shootout at the end of the game, he saved England's bacon, as well as Carlos Bacca's spot kick.
Barring one, Colombia has never reached the quarter-finals.
Sure, Colombia were weakened by the absence of their finest player; the injured James Rodriguez.
Barrios should have seen red and Santiago Arias deserved more than one yellow card and the scenes of players surrounding referee Geiger after his penalty award for England were shameful.
Trump told what will speak with Putin
A new strategy for the US, Russia and Iran in the civil war in Syria could emerge from the summit. The Kremlin leader, on the other hand, can expect to gain a great deal from a Russia-US summit.
In the second half, Colombia's fouls ratcheted up - but backfired, when a blatant tackle that forced Harry Kane to the ground yards from Colombia's goal prompted a penalty kick that he booted squarely into the centre of the net.
After exiting the 2014 World Cup without winning a game in the group stage, the squad has been remodeled with a youthful, more street-wise mentality by Southgate at his first major tournament as coach. They were threatening but couldn't crack David Ospina.
All that preparation, and all that meticulous planning, not just when it came to how England would play but how they would cope inside the pressure cooker of a World Cup knock-out game.
England were the better side without looking too unsafe but were then gifted the lead when Carlos Sanchez hauled down England's captain and talisman Kane once too often.
Both Colombia and England are a threat from dead-ball situations. A 2-1 loss to Japan, which will be heavily credited to Colombia going down to 10 men early on.
It was Dier's attempt from the penalty spot that sent England into the quarterfinal and fans into an absolute frenzy. It was their first ever World Cup win via penalty shootout.
Pekerman also said this year's World Cup has shown the resurgence of centre back Yerry Mina, who managed only six appearances for Barcelona last season. But Colombia's Espina saved one fron England's Henderson, putting the side 3-2 up, before Uribe hit the crossbar, giving Trippier the chance to equalise, 3-3. But the Swedes could earn more respect by beating Switzerland and advancing to the quarter-finals for the first time since 1994, when they ultimately finished third.