不行.Don't mind有作祈使句之嫌,容易引起歧义.

如果说don't mind,那么一定要带主语,说成
No, I don't mind./I don't mind at all.
可以简单地说Not at all.