Check your ball joints, wheel bearings, tie rods, steering in general. If you don't decide to get poly bushings, check them out and replace with some sort of bushings anyways. Sounds like polys would suit you anyways.
(You can check out the carrier bearing while you're at it,)