Lee Hodges came on as a second half substitute to give Rovers their first home win of the campaign.
The fans had been calling for him before he replaced Kevin Street just after the hour.
Their cheers were doubled in the 70th minute when he cracked a fine right-foot shot into the yawning gap behind the left shoulder of Harriers keeper Stuart Brock.
Hodges has yet to start a match this season but the tiny winger has hit two goals which have brought Rovers six points.
It was often a scrappy match but Rovers determination just about deserved the points.
With Bo Henriksen a sole raider for Kidderminster and Rovers playing without wingers this was never going to shape up as a classic.
It became both competitive and open thanks to the speed of Lloyd Dyer on the Harriers left and the generous space he was allowed for the first half hour.
Given the freedom to run at Daniel Boxall he threatened to make it a non contest but Rovers tightened up on him while Henriksen was always too closely marked to be anything of a threat.
Although they had few crosses to feed off the energy of, Paul Tait and Junior Agogo kept Rovers on the edge of success.
Agogo had his best game since his summer move from Barnet linking up well with his partner.
As half time came up he out jumped his marker to flick a header towards Tait, but his strike partner fired over the bar.
Agogo had earlier produced an aggressive run in from the right ending with a snap shot which Brock was pleased to touch over for one of Rovers five corners of the first half.
Brock pulled out a similar save just short of the hour to deflect a Dave Savage header on to his left post as the midfielder met a deep cross from Tait.
Rovers by now had seized control but were rattled when Matt Gadsby broke away for a shot which Kevin Miller palmed away for a corner.
They was even more reason for the home fans to gasp as Rovers then failed to defend the corner leaving Gadsby to get in a free shot which, luckily for defenders, he steered wide.