If for example server 1 shut down, server 2 should gain control above the socket, therefore IPC and any relations falls out.

There are better solutions for taking over service on a port. Most commonly, you'll use something like HAProxy to serve requests on the port, and then configure HAProxy to forward the requests to some other process. If you grow in scale larger than what a single HAProxy machine can deal with, you can buy hardware load balancers that can do the same thing for a few million connections at a time :-)