We had the meeting at two yesterday afternoon .（如果在你原来的基础上就是这句）但常用下一句
/
We were having the meeting at two yesterday afternoon .（这句较好）