你的原句有一点错,漏了一个词.可按原句的顺序改正如下,不比重新组句：
I would stay quietly in the distance looking at you.