I'm working on setting up an automatic failover for one of our locations and I wanted to bounce it off this group. This location is fed by a line of sight antenna with an MPLS/T1 backup. When this site is on the LOS it is on the same network as our main site (10.0.1.0). The T1 feed is on a different network that is routed by the MPLS (10.0.2.0).
Currently if the LOS goes down we have to go to that location, unplug the LOS from the switch, plug the MPLS router into the switch, reprogram the default gateway and IP on the switch, power cycle everything that uses DHCP or release/renew, and program a new ip into everything that is static.
A previous employee had purchased a Cisco RV042 to provide failover. Based on his notes we were told by Windstream that we needed a router that supports BGP, purchased this one, and then were told it needed to support RIP after we had kept it too long to return it. I inherited the ticket and thought hey, I could just use a pfSense box for auto failover. I have setup an old XP computer for this purpose. It is configured with two WAN ports in a gateway group. The LOS has higher priority with the T1 being a failover. I believe the best way to handle the LAN is to have the pfSense provide DHCP for the 10.0.2.0 network. Each WAN port is setup with the appropriate gateway (their network's respective router), and the LAN is configured to use the gateway group.
My concern is if I put everything on the 10.0.2.0 network is traffic going to this location going to always use the T1? What do I need to do to ensure that my traffic looking for my 10.0.2.0 network goes over the LOS instead of through my MPLS network? Do I need to get Windstream to configure the routing for my 10.0.2.0 network to go to the LOS wan ip, and failover to the MPLS? Is this not going to be possible using the pfSense and I'll have to go back to the drawing board?