Alright, for the extra simple scene, I sent all the vertices to the debug output. To render, there is one index buffer per texture, and the buffer is sorted by visible clusters. The problem is that each cluster holds the same vertex information as the rest of the clusters..
Vertices: 24texture: 0 cluster: 0--184, -64, -184184, -64, -184-184, -64, 184texture: 0 cluster: 0--184, -64, 184184, -64, -184184, -64, 184texture: 0 cluster: 1--184, -64, -184184, -64, -184-184, -64, 184texture: 0 cluster: 1--184, -64, 184184, -64, -184184, -64, 184texture: 0 cluster: 2--184, -64, -184184, -64, -184-184, -64, 184texture: 0 cluster: 2--184, -64, 184184, -64, -184184, -64, 184texture: 0 cluster: 3--184, -64, -184184, -64, -184-184, -64, 184texture: 0 cluster: 3--184, -64, 184184, -64, -184184, -64, 184texture: 1 cluster: 0--184, 128, -184-184, -64, -184-184, 128, 184texture: 1 cluster: 0--184, 128, 184-184, -64, -184-184, -64, 184texture: 1 cluster: 0-184, -64, 184184, 128, 184-184, -64, 184texture: 1 cluster: 0--184, -64, 184184, 128, 184-184, 128, 184texture: 1 cluster: 1--184, 128, -184-184, -64, -184-184, 128, 184texture: 1 cluster: 1--184, 128, 184-184, -64, -184-184, -64, 184texture: 1 cluster: 1--184, 128, -184184, 128, -184-184, -64, -184texture: 1 cluster: 1--184, -64, -184184, 128, -184184, -64, -184texture: 1 cluster: 2-184, -64, -184184, 128, -184184, -64, 184texture: 1 cluster: 2-184, -64, 184184, 128, -184184, 128, 184texture: 1 cluster: 2-184, -64, 184184, 128, 184-184, -64, 184texture: 1 cluster: 2--184, -64, 184184, 128, 184-184, 128, 184texture: 1 cluster: 3-184, -64, -184184, 128, -184184, -64, 184texture: 1 cluster: 3-184, -64, 184184, 128, -184184, 128, 184texture: 1 cluster: 3--184, 128, -184184, 128, -184-184, -64, -184texture: 1 cluster: 3--184, -64, -184184, 128, -184184, -64, -184texture: 2 cluster: 0-184, 128, 184184, 128, -184-184, 128, 184texture: 2 cluster: 0--184, 128, 184184, 128, -184-184, 128, -184texture: 2 cluster: 1-184, 128, 184184, 128, -184-184, 128, 184texture: 2 cluster: 1--184, 128, 184184, 128, -184-184, 128, -184texture: 2 cluster: 2-184, 128, 184184, 128, -184-184, 128, 184texture: 2 cluster: 2--184, 128, 184184, 128, -184-184, 128, -184texture: 2 cluster: 3-184, 128, 184184, 128, -184-184, 128, 184texture: 2 cluster: 3--184, 128, 184184, 128, -184-184, 128, -184
You can see that the vertices are duplicated over each cluster.. but i don't know why this is. Maybe someone who has run into this duplicate vertices problem can help me.