look out of the window看窗户外面,可以理解为,站在窗口,看外面.
look through the window是通过窗户看,是指视线通过了窗户的切面看外面.