In front of the largest travelling support in the two-season history of Ashburton Grove - 9,000 Plymouth fans - Arsenal prevailed. But there will be concern from the home supporters, who were disgruntled throughout, that the three-year wait for silverware is not about to end soon.
Arsène Wenger was calm in his post-match verdict but he must be pondering a move in the transfer window. "We have done the job in a serious way, if we had not been focused we wouldn't have done it properly," he said. Yet this was not a convincing performance and it is difficult to recall the last occasion Arsenal managed one.
Not since winning this competition on penalties against Manchester United in 2005 has Wenger delivered. There has been promise, of course, including the Champions League final defeat to Barcelona the following year. Now, though, the Frenchman is talking of bad luck and near misses, as he did in his programme notes. Yet by definition winners overcome any malady that threatens them. Here his side managed the trick. But it was an effort laced with desperation until Robin van Persie's second strike late on allowed the Emirates to relax.
"Credit to Plymouth," Wenger said. "I said two weeks ago that the gap between the Championship and Premier League has narrowed and the results in the FA Cup today have shown this."
Both he and his injured skipper Cesc Fábregas outlined the importance of this cup in the programme, with the manager aiming a dig at Manchester United in 2000 being allowed "to pull out - that was a big blow". Fábregas, possibly worryingly for Arsenal fans, pointed out it is the only thing he has won in five years at the club. A European champion with Spain, he may be starting to ponder how long he sticks with Wenger's project.
After two crunching tackles from Argyle skipper Karl Duguid in the opening minutes, Arsenal began creating. Sami Nasri's trickery placed Plymouth left-back Chris Barker on his backside but was not followed by a killer ball. Seconds later Van Persie, skipper for the day, could not beat Romain Larrieu from close range. On the quarter-hour Emmanuel Eboué, who drew intermittent home jeers throughout, struck sweetly but Larrieu again saved well.
Arguably as concerning for Wenger was the fragility of his defence, especially from the high ball. From an early Chris Clark free-kick, the ball was allowed to fall for Jamie Mackie to shoot. That lapse was followed by Lukasz Fabianski, in for a rested Manuel Almunia, dropping a steepling ball. Is the manager concerned with his rearguard? "We'll see in the future - we've stabilised the defence in recent weeks," Wenger deadpanned, yet there has been a single clean sheet in the past six outings.
Ultimately, the visitors tired. From a 47th-minute Nasri corner Van Persie's free header began the first of three goals in six minutes. Next up Nicklas Bendtner's presence forced on-loan Manchester United defender David Gray to score a debut own goal. The tie appeared to be over, but Arsenal's flakiness from another free-kick drew a further fumble from Fabianski and Duguid made it 2-1.
Van Persie took his late goal but it feels like Arsenal's season could soon be over. "Naughty, very naughty. They hurt you from all over the pitch," Paul Sturrock, the Plymouth manager, said. Arsenal threaten to, of course, but need to be more ruthless.