My GT has done the same thing since I've bought, it has got progressively worse over the years.
In my case, I know for a fact it's not the brakes. The rear end turns easily without any rough spots. Although it sounds to me like a wheel bearing or carrier bearing slowing dying?
Time to install my 3.27's. I've put it off for too long.