Set up Connectivity between Fabric Extender and Fabric Interconnect in UCS

Introduction

This document shows how to set up connectivity between Cisco UCS 2100 series Fabric Extender (or IO Module) within a Cisco UCS Chassis and the Cisco UCS 6100 series Fabric Interconnect:

• Setup Physical Connectivity between Fabric Extender and Cisco UCS Fabric Interconnect
  
• Configure Server Port between Fabric Extender and Cisco UCS Fabric Interconnect
  

Prerequisites

Requirements

Cisco recommends that you have a working knowledge of the Cisco UCS hardware and software.

Components Used

The information in this document is based on the Cisco UCS.
The information in this document was created from the devices in a specific lab environment. All of the devices used in this document started with a default configuration. If your network is live, make sure that you understand the potential impact of any command.

Conventions

Refer to the Cisco Technical Tips Conventions for more information on document conventions.

Background Information

This is an image of the UCS 2104XP Fabric Extender in the UCS 5100 Blade Chassis:

What does UCS 2104XP Fabric Extender do?

• Acts as a bridge between blades and Fabric Interconnects
  
• Helps users manage available bandwidth for chassis
  
• Eight 10G links to blades
  
• Four 10G, SFP+, links to Interconnect
  
• Flexible association between blade and fabric interfaces
  
• Discovery
  
• Embedded Processor
  
• Determines overall chassis health
  
• Control Fan speeds and Power supplies
  
• If available, two CMCs are configured for High Availability
  

Interactions between Cisco UCS 2100 Series Fabric Extender and UCS 5100 Blade Chassis backplane:

Configure

The Cisco UCS server chassis contains fabric extender modules that allow the blade servers in the chassis to communicate with the Cisco UCS fabric interconnect. The Cisco UCS server chassis supports up to two fabric extender modules, each with four I/O ports.
Note: Use the Command Lookup Tool (registered customers only) to obtain more information on the commands used in this section.

Network Diagram

This is a typical topology used with the Cisco UCS:

Setup Physical Connectivity between Fabric Extender and Fabric Interconnect

Complete these steps in order to install a fabric extenders:

1. Make sure that the two levers at the front of the fabric extender are pulled open.
   
2. Slide the fabric extender into the fabric extender slot, and ensure that the fabric extender is fully seated.
   
3. Close the levers and tighten the captive screw on each one.
   
4. Connect networking cables. See the Networking Cables between Fabric Extender and Fabric Interconnect section for more information.
   This diagram shows the proper way to connect the Cisco UCS 2104XP fabric extenders to two separate Cisco UCS fabric interconnects.
   Notice that each Cisco UCS Fabric Interconnects must be connected to the chassis through its own fabric extender.
   Proper Connection Between the Server Chassis and two Cisco UCS 6120XP 20 Port Fabric Interconnects:
   
   Note: All ports of a fabric extender can be connected to one and only one Fabric Interconnect. If a connection to a second Fabric Interconnect is required, a second fabric extender must be added to the server chassis. Furthermore, all ports of the second fabric extender can be connected only to the second Fabric Interconnect.
   Improper Connection Between the Server Chassis and two Cisco UCS Fabric Interconnects:
   
   Another thing to remember when you connect the Cisco UCS server chassis to the Fabric Interconnect is to not connect the fabric extender modules to the fibre expansion modules of the Fabric Interconnect. While similar in appearance to the other ports on the Fabric Interconnect, the expansion modules are never used for direct server chassis connections.
   Never Connect the Server Chassis to the Fabric Interconnect’s Expansion Module Ports:
   
   

Networking Cables between Fabric Extender and Fabric Interconnect

SFP+ Transceivers

Each Cisco UCS 2104XP fabric extender within the server chassis supports up to four Small Form-Factor Pluggable (SFP+) copper or optical fiber transceivers. Each of these transceivers run at 10-Gigabit.

SFP+ Copper Transceivers

The Cisco UCS 2104XP fabric extender supports Twinax copper-cable transceivers. The enhanced Small-Form-Factor Pluggable (SFP+) 10-Gigabit Ethernet transceiver module is a bidirectional device with a transmitter and receiver in the same physical package. It has a 20-pin connector on the electrical interface.

SFP+ Optical Transceivers

If distances greater than 5 meters must be spanned, the fabric extender supports the substitution of the copper SFP modules by an optical SFP transceiver. The Small-Form-Factor Pluggable (SFP+) 10-Gigabit Ethernet optical transceiver module is a bidirectional device with a transmitter and receiver in the same physical package. It has a duplex LC connector on the optical interface.

Configure Server Port between Fabric Extender and Fabric Interconnect

You can only configure server ports on the fixed port module. Expansion modules do not supports server ports. This task describes only one method of the configuration of ports. You can also configure ports through a right-click menu or from the General tab of the port. Complete these steps:

1. Log into Cisco UCS Manager.
   
2. In the Navigation pane, click the Equipment tab.
   
3. Choose Fabric Interconnect > Fabric Interconnect_Name> Fixed Module > Unconfigured Ports.
   
4. Choose one or more of the ports in the Unconfigured Ports folder.
   
5. Drag the chosen port or ports and drop them in the Server Ports folder.
   The port or ports are configured as server ports, removed from the list of unconfigured ports, and added to the Server Ports folder.
   
   The port was successfully moved to the Server Ports. Troubleshoot if necessary in order to bring up the connection between Fabric Extender (IO Module) to Fabric Interconnect.
   
   
6. Repeat the same previous steps for other ports from Chassis # IO Module 1 to Fabric Interconnect A.
   
7. Repeat the same previous steps for ports from Chassis # IO Module 2 to Fabric Interconnect B.
   

Verify

Use this section in order to confirm that your configuration works properly.
IO Module 1 is connected to Fabric Interconnect A on port 1/1 and it is in up status, as shown here:

IO Module 2 is connected to Fabric Interconnect B on port 2/1 and it is in up status, as shown here:


courtesy:CISCO UCS site