Dylan Mackin started up top for Stirling Albion in a 4-5-1. Kyle Banner was in the midfield instead of his usual position at centre half.
Nathan Flanagan and Dylan Paterson started on the flanks for the Binos.
It was a close match statistically as both teams had about 50% possession and each had seven shots on goal, even though Stirling Albion were down to 10 men for the second half.
The first 15 minutes were decent from Stirling as they won multiple corners and Nathan Flanagan had a shot on goal saved.
There was only one other shot on target all half which came from Albion Rovers. Dylan Mackin got sent off in stoppage time just before the half, leaving a sour taste in the mouth of Stirling Albion as they went in for the half.
The second half started off even with a Jordan McGregor header nearly finding the back of the net in the 70th minute.
Akeel Francis was subbed on but could not make an impact and Albion Rovers then went down to 10 men after Kyle Doherty was sent off in the 82nd minute.
The killer blow came just nine minutes later as the match looked as though it would finish in a draw.
Sean Fagan’s last minute strike secured the three points for the visitors.
Stirling Albion now sit 7th in the table as they prepare for their third home match in a week, on Saturday versus Stranraer.
Stirling Albion: Currie, Dunsmore, Moore, McGregor, McGeachie, Cummins, Paterson (Francis 73), Robertson, Banner, Flanagan (Laird 89), Mackin. Subs (not used): Law, Creaney, McNiff, J Grant, I McLean.
Albion Rovers: Stone, Fernie, L Wilson, McGowan, Fagan, Leslie (Lynas 80), Jack (Malcolm 76), D Wilson, Doherty, C Wilson, Robertson. Subs (not used): Binnie, Leighton, Robinson, Dolan.
Goal: Fagan 88
Referee: Greg Soutar
by Damon Savenelli