OpenVPN multiple IPv4

I have got OpenVPN ruing & listening on all IPs on port 1194:

# netstat -tunlp | grep 1194
udp        0      0 0.0.0.0:1194            0.0.0.0:*                           1629/openvpn

But I am only able to coect on the first IPv4 & when I change "remote first.ip 1194" in client.ovpn to "remote second.ip 1194", it doesn't work & show the following errors:

Wed Jun 22 20:37:29 2016 TLS Error: TLS key negotiation failed to occur within 60 seconds (check your network coectivity)
Wed Jun 22 20:37:29 2016 TLS Error: TLS handshake failed

Can please one of you guide me in the right way? I will really appreciate it.

Thanks