没有语病,用which或that都可以.
不过这么简单的定语从句在英语中很少用.你可以这样表达,会更好一些：
It's a country which has a long hisotry.
或：It's a country with a long history.