x^2+y^2=4,
设x=2cosa,y=2sina,
则x^2-2√3xy-y^2
=4(cosa)^2-8√3cosasina-4(sina)^2
=4cos2a-4√3sin2a
=8cos(2a+60°),
所以最大值为8.