Multiple NICs issue with VMs and Network

[demonmaestro]

So here is something that got me wondering.

My server has 4 NICs total

2 - 10gb onboard ethernet nics

2 - SFP+ pcie

 

I have the 2 ethernet nics set to bonded for redundancy.

 

The other 2 are left to there own devices.

 

On the switch side I have the 2 sfp+ ports set to VLAN16. 

 

I have a VM set to one of the sfp ports and I get the correct IP and everything. BUT I am able to see my other network as well...

Now the sfp  ports also run off of a different router/network. The switches are the only thing that is the same.

 

Something that is making me wonder is if for some reason the sfp ports are communicating through the unraid?

 

I am talking with the company over the switches and they say its correct on how I have it.

https://community.ubnt.com/t5/UniFi-Routing-Switching/routing-and-switching-question/m-p/2051298#M56532 

 

Any ideas?

 

 

Edit: Sorry if this is in the wrong section.

Edited October 18, 2017 by demonmaestro

[Vr2Io]

Does US-24 SFP connect US-16-XG wrongly assign in VLAN16 ?

[demonmaestro]

2 hours ago, Benson said:

Does US-24 SFP connect US-16-XG wrongly assign in VLAN16 ?

Its not connected to the VLAN16.

But I don't understand why that would cause an issue?

[Vr2Io]

If that connection in VLAN16, then both network will be connect each other.

 

You haven't state does node to node or whole path apply VLAN, so I will suppose VLAN16 only apply in US-16-XG.

 

I have 16-XG too and connect in similar way. Both network won't see each other.

Edited October 19, 2017 by Benson

[demonmaestro]

As of currently the vlan16 is only in the US-16-XG. On the ports for the pfsense box and the 2 SFP ports. 

[demonmaestro]

Does anyone have any idea on why this is happening?

[bonienl]

1 hour ago, demonmaestro said:

Does anyone have any idea on why this is happening?

 

You need to make two distinct paths, which are logically (VLAN) separated from each other.

 

In your drawing:

 

black = server - US24 - USG

orange = server -US16 - pfsense

 

The orange connection between US24 and US16 must be removed when there is no logical separation.

 

Edited December 5, 2017 by bonienl

[demonmaestro]

I was hoping to not have to go that route due to the server is 10g and the us16 is the only 10g switch I have.

 

Plus using one controller for the Unifi system.

 

That is why I was hoping I could do this with VLANs.