After connecting everything, I redrew the map using each sectors floor height for the colour for each line in it( two-sided lines are drawn twice ). Plus just for the hell of it I added some green vertices for each "thing".
If the line colours seem off it's because I had to make the colour between 0 and 255 and of course the floor heights didn't exactly like this.
Note the red line which actually isn't part of any sector. This is the first line on every map I loaded and is also where the user starts. Not sure what I'm supposed to do with this since it's visible in the game, but my code acts like it doesn't exist.
Hopefully some floor/ceiling drawing soon.