Second half substitute Olivier Giroud rescued Arsenal with a late equaliser in a 1-1 draw at St Mary’s on Sunday after Southampton had looked like holding on for all three points.
The France international, who replaced compatriot Alexandre Lacazette in the 72nd minute of a lively game, scored two minutes from full time with a glancing header off an Alexis Sanchez cross.
Southampton had made Arsenal sweat until then with Charlie Austin grabbing a fourth goal from his last three league starts.
He scored with a third-minute shot past Petr Cech after being fed through by Dusan Tadic.
It was the 17th time Giroud has scored as a substitute for Arsenal.
He equalled Norwegian Ole Gunnar Solskjaer’s record with Manchester United for most goals scored off the bench for a single club.
If the draw remained a lost opportunity for the Gunners, there was still something to take home.
The goal at least staved off a second successive league defeat after a stinging 3-1 loss to Manchester United at the Emirates last weekend.
“Last week had an influence on today’s game,” Arsenal manager Arsene Wenger, whose side played in the Europa League on Thursday, said.
“They wanted to start strong but it took us time to get into the game again,” added the manager, who criticised the amount of time-wasting in the match.
“I think he (Giroud) has come back into a very good shape. He’s shown that today again. He’s mentally extremely strong as well. It’s a remarkable achievement what he has done again today.”
Arsenal moved up to fifth place, one point behind Liverpool.
Southampton moved up to 11th, ahead of Huddersfield Town on goal difference and a point behind Everton, who drew 1-1 in the Merseyside derby at Liverpool.
“We started really well, got the goal. Should have got the second really,” said Austin, who had a low shot from the right well saved by Cech minutes after scoring.
“Against Arsenal, you give them one chance and the big man’s come on and scored. It’s just one of those things…we take away a point from here but we should have taken all three.”
Austin also hit the post with another effort in the eighth minute with the Arsenal defence in disarray but the linesman flagging for offside.
Arsenal worked their way back, picking up the tempo as Southampton were forced on the defensive but without giving home goalkeeper Fraser Forster much to worry about.
Southampton were still dangerous against the run of play, however, with Spanish defensive midfielder Oriol Romeu firing in a long-range shot that smacked the crossbar in the 62nd.
Arsenal took off defender Per Mertesacker shortly afterwards, bringing on Danny Welbeck to add firepower, but Southampton could still feel unlucky not to increase their advantage.
Ryan Bertrand had a golden opportunity when he shook off Arsenal defender Laurent Koscielny, but lofted the ball high over Cech, while Austin saw another opportunity trickle past the post.