错,因为没有谓语.didn't 是助动词 did 的否定形式,本身不能做谓语动词.
可以改成：
my father did‘t work at home yesterday
或者：
my father wasn't at home yesterday