Of the two choices you present,the second - "on the morning of Sunday" - is the better choice,but still not very common.It sounds a bit stilted and overly formal for conversation and is more appropria...