I will not let go until the last moment.
I will not give up until the last minute.
I will give up at the very last moment