We'll be off duty in a minute.或
We'll be off work in a minute.或
We'll leave off work in a minute.