Kinross were the visitors to Duffus Park last Saturday as newly appointed boss Lee Sibanda looked to register his first victory on home soil.
Hearts were looking to build on a strong first half showing last week after taking a two goal lead before eventually falling to a 3-2 defeat to Balgonie Scotia.
And it would be the same again this time round with Cupar unable to hold onto their lead.
It was the perfect start for the home team with a move straight off the training ground with only three minutes on the clock.
A short corner by Sibanda was played to Gary Sutherland to setup Aaron Leadbetter to fire into the net.
There was controversy just before the break when Sibanda was clean through on goal and ‘keeper Andrew Martin came rushing out his box and chopped him down.
Referee Andrew McGachan astonishingly only showed yellow leaving Kinross relieved and Hearts riling in the decision.
The resulting free kick by Scott McKay was well placed but ‘keeper Andrew Martin, lucky to still be on the pitch, made a good save.
Kinross were unlucky to see a shot come back off the post on 66 minutes but found their equaliser five minutes later.
A foul by Leadbetter on Shaun Lamont gave them a free kick in a dangerous position.
The same man stepped up and sent an unstoppable shot into the corner of the net.
Kinross took the lead with five minutes to go when Cupar lost possession and the visitors were quick to counter.
David Laing crossed to Daine Herald who fired home.
They added salt to the wounds on the whistle when they added a third with Paul Ferrier scoring a spectacular overhead kick.
Tomorrow Hearts travel to Windygates to face Greig Park Rangers in a League match at 2.00p.m.
Cupar Hearts - Rann, Anderson, Thomas, Leadbetter, Taylor, Mason, McKay, Sutherland, Sibanda, Laurie and Lawlor.
Subs - Bell, Brown.