如果是名词就要to:
drive to school(school是名词)

如果是副词就不用to:
drive home(home是副词)
drive here(here是副词)
drive there(there是副词)