f(x)=2ab-a²+cos²x=2(sinxcosx-1/2)+(cos2x+1)/2=sin2x+cos2x-1/2
=根号下2sin(2x+π/4)-1/2
单调增区间为：2kπ-π/2≤2x+π/4≤2kπ+π/2
kπ-3π/8≤x≤kπ+π/8
即增区间为[kπ-3π/8,kπ+π/8].