Blair Henderson’s goal after just 25 seconds proved the difference at Shielfield as Sean Dickson missed an injury-time penalty to equalise.
The former Dunfermline and East Fife striker pounced from close range after being teed up by Michael McKenna as John Coughlin’s in-form side notched up their fourth clean sheet in a row.
Stuart McLaren made two changes to the team beaten 2-1 at Elgin, with Ross Smith and Darren Smith replacing Ross Forsyth and Mark Lamont. Scot Buist, Kevin McKinlay, Aurelien Mazel and Lewis McLear were again all ruled out.
In a poor opening spell we could have fallen further behind after Henderson’s first-minute goal but we came more into the game and David Verlaque should have equalised on the half-hour mark but was thwarted by keeper Kevin Walker after being played in by Steven Doris.
Chris Smith made a good stop to deny Finn Graham before the break but we enjoyed plenty of possession kicking up the slope in the second period and sub Moses Olanrewaju was denied the equaliser when Jonny Fairbairn made a great block as the winger got on the end of a Doris ball across goal.
Callum Crane came close at the other end when he robbed Ross McGeachie and was just too high with a curling effort towards the top corner.
Walker saved headers from Ross Smith and Darren Smith as the game entered stoppage time and our pressure paid off when we were awarded a 92nd-minute penalty after Brian Martin handled Craig Beattie’s goal-bound header.
Martin was sent off by referee David Lowe but Dickson blazed his kick over the bar to complete a miserable week that saw us lose out to an injury-time penalty at Elgin.
The result leaves us sixth in the Ladbrokes League 2 table, five points outside the play-offs with seven games remaining, as we prepare for a home double header against East Fife and East Stirlingshire on March 19 and 26.
Berwick Rangers: Walker, McNeil, Crane, Notman, Wilson, Fairbairn, Graham, McKenna (McGregor 90), Henderson, Lavery, Martin.
Subs (not used): Coultress, Beveridge, Stevenson, Walters (gk)
Goal: Henderson 1
Stirling Albion: C Smith, Verlaque (Forsyth 56), Smith, Robertson (Comrie 39), McGeachie (Olanrewaju 71), McMillan, D Smith, Dickson, Doris, Beattie, Johnston.
Subs (not used): Hamilton, Lamont, Burns, Binnie (gk)
Referee: David Lowe