You just need to move the steering rack, meaning turn the steering wheel until you have clearance to rotate the inner tie rod end. It's been a while since I messed with that while it was in the car, but I'm pretty sure it would clear without having to unbolt the rack. So there should be a spot where you can rotate the thing all the way around and get it off.
Tim