I didn't expect that...
我（当时）没想到你会这么早回信.所以是过去时
再如：I didn't know it was you.
我不知道是你（当时）