Well OK I need some line-line collision detection to sort out the new X values. Everything seemed fine so I had it draw the whole map.
Crap.
Mabye I'll have to figure out how DOOM does it 'cause right now the SEG and SSECTOR data isn't doing very much and I've had it with this method.