要看具体语境
如果是单句,一般可以用
What was he doing at this time yesterday?