Dylan Mackin came off the bench to score the winner with seven minutes left as Stirling moved to within a point of the play-offs.
Albion Rovers frustrated us for long spells but Mackin slammed the ball past Peter Morrison for his seventh goal of the season after being set up by fellow sub Neil McLaughlin.
It means Kevin Rutkiewicz’s men have now lost just once in 13 matches and are on a run of six wins and draw going into Saturday’s trip to Elgin.
There was one change to the team that beat Berwick 2-1, with Peter MacDonald replacing Mackin but they swapped places 10 minutes from time after MacDonald picked up a hamstring injury.
Rovers had lost 3-0 to Elgin at the weekend but Kevin Harper’s men proved tough opponents on their first visit to Forthbank since a 2-0 defeat in February 2014.
This match was rescheduled after the December 15 clash was postponed due to a frozen pitch and Stirling were strong favourites, having won 5-0 at the Reigart Stadium in late January.
In reality, this was a really hard-fought three points. There was little of note in the first half until just before the interval when Morrison denied Darren Smith and Ben Reilly had a shot blocked at the other end.
The Binos upped the tempo in the second half and Smith, Max Wright and Ross McGeachie all had chances as we enjoyed the bulk of the play but the best opportunity fell to Rovers’ Declan Byrne in 77 minutes – he fired over with the goal at his mercy.
Mackin then conjured up the winner and we held on through eight minutes of stoppage time – some of that due to a head knock suffered by Jordan McGregor – to claim a crucial win against the bottom club, who remain seven points adrift of Berwick at the foot of the table.
Stirling Albion: Ferrie, McGeachie, Allan, Hughes, Horne, McGregor, Jardine, Docherty, MacDonald (Mackin 80), Smith (McLaughlin 80), Wright (McLear 61). Subs (not used): Binnie (GK), Thomson, Banner, Glover.
Scorer: Mackin 83
Albion Rovers: Morrison, Hardie, Clarke, Fagan, Krones, Ross (Watson 86), Reilly, Fotheringham, Newell (Russell 63), Byrne, Wilson (McMahon 82). Subs (not used): Potts (GK), Escuriola, Phillips, Wharton.
Referee: David Lowe