Do not meddle with others' stuff/things.

'meddle' would be a better word to explain as 'touch casually'.