perfSONAR User Q&A and Other Discussion

["Garnizov, Ivan (RRZE)" <>]

Hi Casey,

 

 

The “magic” of /opt/perfsonar_ps/toolkit/scripts/mod_interface_route is not purposed to fix routing. The idea is to make server replies exit through the interface that has received inquiries. Meaning that your tests should not be performed on the host itself, but from a remote host. In order to make sure that the source routing works, you should make dump on specific interface on the host you are configuring.

 

The “problem” you see there is probably because you have both interfaces in the same subnet, which means the routing is unable to determine, which is your desired path. It only sees that the second gateway is in the subnet of primary interface, therefore tries it through the primary interface, when initiating icmp tests.

 

Please share IP settings’ details in order to clear off this possibility.

 

Best regards,

Ivan

 

 

 

From: [mailto:] On Behalf Of Casey Russell
Sent: Saturday, January 24, 2015 3:28 PM
To:
Subject: [perfsonar-user] Dual Interface system

 

Group,

     I'm setting up a new dual-interface system (the first for us), and am using the instructions provided at http://docs.perfsonar.net/manage_dual_xface.html

     For clarity, the host will have 2 different physical interfaces in two separate subnets.  Each interface will have IPv4 and IPv4 connectivity.  The Basic IP and IPv6 setup goes simply enough, I get the device base connectivity through the primary interface.  And as you'd expect, the secondary interface can ping it's gateway, but can't talk to the outside world, because no policy (source routing) exists yet to give it a proper gateway.

     Then I ran the /opt/perfsonar_ps/toolkit/scripts/mod_interface_route script as suggested in the installation instructions.  I ran it once for each interface (modifying the examples to reflect the proper gateway info for my interfaces).  Each command ran cleanly (at least appeared to).  However, it appears to me that the script broke partway through executing each command and didn't properly build the routes for either interface. 

     After the commands are run.  Here is the output of "ip rule list"
[root@ps-ksu-bw iproute2]# ip rule list
0:      from all lookup local
200:    from 164.113.32.26 lookup p1p1_source_route
200:    from 164.113.32.66 lookup em1_source_route
32766:  from all lookup main
32767:  from all lookup default

     That looks good.  Looks like it installed the IPv4 gateway.  However, I still can only ping the gateway for that network from the second Linux interface (em1).  I have verified that other IPs in that subnet can talk to the world (to rule out routing issues or an ACL at the router).

     Also, if you look at the IPv6 table after the mod_interface_route script has been run for either interface, you see that it didn't appear to modify the IPv6 tables at all.  This is why I suspect it quietly broke mid-operation.

[root@ps-ksu-bw iproute2]# ip -6 rule list
0:      from all lookup local
32766:  from all lookup main

     Does anyone know if there is a debug or "verbose" switch for that mod_interface_route script?  (I tried the obvious -v --v)

Thank you,

Casey Russell

Network Engineer

Kansas Research and Education Network

2029 Becker Drive, Suite 282

Lawrence, KS  66047

(785)856-9820  ext 9809