Column or row major matrices is only half the question; column or row vectors is the second half. While the two APIs are written with different matrix storage modes, they are also written with different vector types, in mind. The net result is that both APIs have exactly the same memory layout of their matrices. In other words, you can use the same matrices as stored in memory in both APIs.
So whether you go with column major matrices and column vector, or row major matrices and row vectors, does not change anything as far as OpenGL or Direct3D are concerned. The only difference is whether you multiply your vectors on the left or the right hand side of the matrix as determined by whether you use row or column vectors.