The Sheffield potter needed just a couple of colours to clinch the deciding frame in the first-round clash, but a kick on the green on its spot proved a wretched piece of fortune as Perry duly cleaning up to reach round two.
That all came after Duffy had battled his way from 3-1 down against a potter ranked 99 places better off.
World No.107 Duffy said: “It was an unloseable position, I’ve never missed that shot in my life but as soon as I’ve connected it’s gone off course. What can you do? It’s so hard to take, he gave me a great chance and it was impossible to miss, I feel I’m getting scammed on the table at present.
You really need that luck sometimes, I can’t buy it.”
He added: “I feel I have the ability to go on a run, but when moments like that happen it’s hard to be able to put matches together.”
This was the fourth time Duffy had lost a final-frame decider this season, victorious in just two having struggled to get across the line.
But momentum had seemed to be in his favour having fought back to 3-3, despite not being able to make any meaningful break since his first-frame 57.
However, in the cruellest circumstances came his exit, a tough way to head into the festive period.
“I’d played well in the first frame, but at 3-1 down I just wanted to play my shots and I was able to come back in at him,” he continued.
“I took on a few more shots and it seemed to pay off, I player better like that so I need to do it more often.
“My form hadn’t been fantastic, I struggled against Mark Allen in last week’s German Masters qualifying, but I didn’t feel too far away.
“It’s hard but I have time to reflect and hopefully I can come back stronger.”
*Watch the Scottish Open LIVE on Eurosport 1 and Quest, featuring daily studio analysis from Ronnie O’Sullivan, Jimmy White and Neal Foulds