You never with me不是一个完整的句子,它缺谓语动词.但在英语口语中可以有这样的非正式句子出现.
它是You were never with me的省略形式,You were never with me翻译为：你从未和我在一起过.