3a^2b-[2a^2b(2ab-a^2b)-4a^2]-ab
=3a^2b-4a^3b^2+2a^4b^2+4a^2-ab
=2a^4b^2-4a^3b^2+3a^2b+4a^2-ab