Joleon Lescott’s second-half header, fumbled in by keeper Wayne Hennessey, handed Villa manager Remi Garde a first victory in charge, the bottom club’s first in the league at home this season, and ended a run of 19 games without a win.
Wayne Rooney’s 79th-minute strike, his second goal of the game, put United 3-2 up at Newcastle but Dummett struck in the last minute for the relegation-threatened hosts who had battled back from 2-0 down.
West Ham United moved above Manchester United into fifth place after coming from a goal down to win 3-1 at Bournemouth, Enner Valencia netting twice for the London side.
Villa, still eight points from safety, were gifted victory when Hennessey allowed defender Lescott’s 58th-minute effort to squirm through his hands.
The home team had appeared to be in for another 90 minutes of struggle when Palace’s Wilfried Zaha struck Villa’s post inside the opening minute but Garde’s men held firm.
The Villa players, abused by their fans after drawing with fourth-tier Wycombe Wanderers in the FA Cup at the weekend, this time received a standing ovation as they left the pitch.
“We suffered so much in the previous weeks and today we are very happy. Definitely the players showed pride and we deserved to win,” Garde told Sky Sports.
