It was easy
Do the following on both Load Balancers ( I did it on Nginx LBs)
1. apt-get install ucarp
2. vi /etc/network/interfaces and append the lines starting from ucarp-vid 3
3. replace password and ip (192.168.69.11) with your own
I have followed the link below. Tested it by shutting down both Load Balancers one by one.
Will dig more in to it. It is Awesome!.
Have Fun 🙂