Brocade DCX 8510-4 Backbone Hardware Reference Manual Manuel d'utilisateur

53-1002177-0727 June 2014Brocade DCX 8510-4BackboneHardware Reference Manual

• Brocade Supplemental Support augments your existing OEM support contract, providing directaccess to Brocade expertise. For more information, contact

1. Open a Telnet session and log in to the Brocade DCX 8510-4 as admin. The default password ispassword. Enable the logging function on your Telnet or

Manufacture: Day: 1 Month: 1 Year: 2007Update: Day: 14 Month: 3 Year: 2012Time Alive: 187 daysTime Awake

1. Shut down the Brocade DCX 8510-4 using the sysShutdown command on the active CP.switch:admin> sysshutdownThis command will shutdown the operatin

Installing the replacement chassisComplete the following steps to install the replacement chassis.DANGERUse safe lifting practices when moving the pro

4. Replace the control processor blades (CP8) (Control processor blade (CP8) removal andreplacement on page 69).5. Replace the core switch blades (CR1

Verifying correct operation of systemComplete the following steps to verify the correct operation of the Brocade DCX 8510-4.1. Log in to the Brocade D

1 1 1 820100 id N8 Online FC F-Port 10:00:00:05:33:26:0e:65 2 1 2 820200 id N8 Online FC F-Port 10:

NOTEDo not route cables in front of the air exhaust vents.Verifying correct configuration of the fabricCopying the command outputs from this section i

Cable routing table for Brocade DCX 8510-4 (64 ports shown) TABLE 15 Slot/port Cable labels Connected device Slot/port of deviceSlot Port Switch end

Cable routing table for Brocade DCX 8510-4 (64 ports shown) (Continued)TABLE 15 Slot/port Cable labels Connected device Slot/port of device252627282

About This Document● Supported hardware and software... 11● What’s new

Cable routing table for Brocade DCX 8510-4 (64 ports shown) (Continued)TABLE 15 Slot/port Cable labels Connected device Slot/port of device515253545

Specifications● General specifications...111● System a

System architectureThe following table describes the system architecture of the Brocade DCX 8510-4.System architecture TABLE 17 Feature DescriptionF

System architecture (Continued)TABLE 17 Feature DescriptionPort types FC8-32E port blade : F_Port, E_Port, Ex_Port, and M_Port.FC8-48E port blade :

System size and weightThe weight of the Brocade DCX 8510-4 can vary considerably depending on the combination ofblades installed. Use the following ta

System FRU weights (Continued)TABLE 19 FRU WeightFC8-48E port blade 3.3 kg (7.3 lb) without mediaFC8-64 port blade 3.36 kg (7.4 lb) without mediaFC1

Environmental requirementsThe following table lists the environmental operating ranges for the Brocade DCX 8510-4. Therequirements for non-operating c

The QSFP transceiver part numbers supported on the core blades are different from the QSFPtransceiver part numbers supported on the FC16-64 port blade

Power demands per component TABLE 22 Blade or fanunitsMaximum PowerDraw (Watts)Type of Blade Ports per blade Number ofbladespermitted inchassisTotal

Power supply requirements (Continued)TABLE 23 Demand Power supplies @ 110 VAC (nominal) Power supplies @ 220 VAC (nominal)Greater than 2000W NA - ca

What’s new in this document12 Brocade DCX 8510-4 Backbone Hardware Reference Manual53-1002177-07

Power cord types (international) (Continued)TABLE 24 Plug style NEMA5-20P125VonlyUSA,Canada,Mexico,otherlocationsNEMAL6-20USA,Canada,Mexico,otherloc

Power cord types (international) (Continued)TABLE 24 Plug style NEMA5-20P125VonlyUSA,Canada,Mexico,otherlocationsNEMAL6-20USA,Canada,Mexico,otherloc

Power cord types (international) (Continued)TABLE 24 Plug style NEMA5-20P125VonlyUSA,Canada,Mexico,otherlocationsNEMAL6-20USA,Canada,Mexico,otherloc

DANGERIf the installation requires a different power cord than the one supplied with the device, makesure you use a power cord displaying the mark of

Supported optics, speeds, cables, and distances (Continued)TABLE 25 TransceivertypeFormfactorSpeed Multimodemedia (62.5microns)(OM1)Multimodemedia (

Qualified cables for mSFP connections for the FC8-64 high density port blade (Continued)TABLE 26 Description Length Corning part number Molex partnu

FIGURE 39 QSFP to QSFP standard cables1. QSFP MTP connectorFIGURE 40 QSFP-SFP/LC Break-out/Split-out cables1. QSFP MTP connector2. SFP+ LC connectorsW

Application and Encryption Blades● Introduction...

NOTEThe port diagram on the front panel uses the abbreviations GE for 1 GbE ports and 10 GE for 10 GbEports.NOTEThe 10 GbE SFPs used in the FX8-24 bla

‐ The Link Cost is equal to the sum of all established/low metric (or currently active) circuits’MAX rates in the tunnel‐ Fabrics connected through FC

Brocade DCX 8510-4 Overview● Brocade DCX 8510-4 features... 13● B

FX8-24 blade130 Brocade DCX 8510-4 Backbone Hardware Reference Manual53-1002177-07

Diagnostics and Troubleshooting● Introduction...

Environmental status and maintenance commands TABLE 27 Command Information displayedsensorShow Temperature readings for the port bladesTemperature r

Any errors detected during POST are written to the system log, which is accessible through theerrShow command. For information about error messages, r

TroubleshootingThe following table provides a list of issues, possible causes, and recommended actions.Troubleshooting the Brocade DCX 8510-4TABLE 28

Troubleshooting the Brocade DCX 8510-4 (Continued)TABLE 28 Issue Possible cause Recommended actionLEDs on one or morecomponents are changingrapidly

Troubleshooting the Brocade DCX 8510-4 (Continued)TABLE 28 Issue Possible cause Recommended actionBlades might be faulty. Enter the slotShow command

Port Numbering TemplatePrint or copy the following templates in this appendix and use them to document the port numberingpattern for the Brocade DCX 8

FIGURE 42 FC8-32E port blade1. Blade Power LED2. Blade Status LED3. FC ports 24-314. Port and trunking group map5. FC ports 16-236. FC ports 0-77. FC

7. FC ports 32-63 (right to left)8. FC ports 0-31 (right to left)FIGURE 45 FC16-32 port blade1. Blade Power LED2. Blade Status LED3. FC ports 24-314.

Brocade DCX 8510-4 hardware componentsThe Brocade DCX 8510-4 features a modular and scalable mechanical construction that allows a widerange of flexib

FIGURE 48 FS8-18 encryption blade1. Gigabit Ethernet ports GE0-GE12. Smart card port3. Fibre Channel ports 0-15FIGURE 49 FX8-24 extension blade1. 10 G

Regulatory Statements● Regulatory compliance...141● Env

Power-cord notice (Japan, Denan)DANGERNever use the power cord packed with your equipment for other products.BSMI statement (Taiwan)Warning:This is Cl

Canadian requirementsThis Class A digital apparatus meets all requirements of the Canadian Interference-Causing EquipmentRegulations, ICES-003 Class A

Regulatory compliance standards (Continued)TABLE 30 Country Standards Agency Certifications andMarkingsTaiwan (PS only) CNS 14336(94) or latest CNS

Caution and Danger Notices● Cautions...

PRECAUCIÓN Antes de conectar un cable en cualquier puerto, asegúrese de descargar la tensión acumuladaen el cable tocando la superficie de conexión a

Electrical dangersDANGERMake sure that the power source circuits are properly grounded, then use the power cordsupplied with the device to connect it

PELIGRO Para desconectar completamente la corriente del instrumento, desconecte el cordón decorriente de todas las fuentes de corriente.DANGERIf the i

DANGER Un commutateur Brocade DCX 8510-4 complet (quatre cartes de port FC16-64, 256 ports)pèse environ 69 kg et requiert un dispositif de levage hydr

• Blades that are serviced from the port side of the Brocade DCX 8510-4. Blowers, power supplies,and power cables that are serviced from the nonport s

Danger Notices150 Brocade DCX 8510-4 Backbone Hardware Reference Manual53-1002177-07

Index10 GbE ports 127Aairflow, requirement 116altitude, requirement 116ambient temperature, requirement 116ANSI protocol 111application bladedetermini

troubleshooting 134configure command 36, 39configuring IP address 34core switch bladedetermining status 56replacing 79CP bladedetermining status 54rep

GGbE ports 127Hhigh availability 19humidity, requirement 116Iinstallationitems required 24SFP 39installation tasks 23installed licenses 39inter-chassi

Rrack space requirement 24regulatory compliance 141reliability, features 19removal and replacement procedureSee RRP 61requirementpower 117requirement,

UusbStorage command 43VVCCI statement 141verifying, CP blade operation 74vibration, requirement 116Wweight and size 114WWN bezelreplacing 83WWN cardde

156 Brocade DCX 8510-4 Backbone Hardware Reference Manual53-1002177-07

FIGURE 2 Port side of the Brocade DCX 8510-4 with the Port Side Exhaust Kit installed (sampleconfiguration)Nonport side of the Brocade DCX 8510-4The f

FIGURE 3 Nonport side of the Brocade DCX 8510-4 (sample configuration)1. WWN card bezel (logo plate)2. Power supply3. Blower assembly4. Label with ser

Blades available for the Brocade DCX 8510-4 (Continued)TABLE 1 Description Name FunctionBrocade DCX 8510-4core switch bladeCR16-4 The CR16-4 blade c

High availabilityThe following features contribute to the Brocade DCX 8510-4 high availability design:• Redundant, hot-swappable FRUs, including blade

© 2014, Brocade Communications Systems, Inc. All Rights Reserved.Brocade, the B-wing symbol, Brocade Assurance, ADX, AnyIO, DCX, Fabric OS, FastIron,

• Memory scrubber, self test, and bus ping to determine if a bus is not functioning.• RASlog messages.• SMI-S compliant.• Hardware and software watchd

• Administrative domains/Virtual fabrics• Boot PROM password reset• Password hardening policies• Up front login in Web Tools• Login banner• Monitoring

Network manageability22 Brocade DCX 8510-4 Backbone Hardware Reference Manual53-1002177-07

Installation of the Brocade DCX 8510-4● Time and items required...

Installation tasks, time, and items required (Continued)TABLE 2 Installation task Time estimate Items requiredInstalling power cables andpowering on

• 200 - 240 VAC, 50-60 Hz (two branch circuits) - recommended for high availability and maximumblade usage• Two cables for 200 - 240 VAC service• Prot

3. Remove the Brocade DCX 8510-4 Port Side Exhaust Kit (if ordered), accessory kit, packing foam,and antistatic plastic from the chassis and set aside

Providing power to the Brocade DCX 8510-4 BackboneFor this procedure, refer to Power specifications on page 117 for power supply requirements for your

Blade Port numbering Trunking port groupsFC8-48E portblade• 0 through 23 from right to left on the lower set ofports.• 24 through 47 from right to lef

Chassis slotsChassis slots are numbered 1 through 8, from bottom to top when facing the port side of the BrocadeDCX 8510-4. Control processor blades (

ContentsPreface...7D

NOTEDo not route the cables in front of the air exhaust vent, which is located at the top of the port side ofthe chassis. If you are using the Port Si

Logging In and Configuring the Brocade DCX 8510-4● Configuring the Brocade DCX 8510-4...

FIGURE 5 Configuration tasksEstablishing a serial connection to the Brocade DCX 8510-4To establish a serial connection to the console port on the Broc

NOTEThe CONSOLE port is intended primarily for the initial setting of the IP address and for servicepurposes.3. Access the Brocade DCX 8510-4 using a

swDir:admin>2. (Optional) Modify passwords. To skip modifying the password, press Ctrl+C. For more informationon passwords, refer to the Fabric OS

Enter the information at the prompts.This is a sample IP configuration:swDir:admin> ipaddrset -chassisEthernet IP Address [0.0.0.0]: 192.168.1.1Eth

The Brocade DCX 8510-4 can be accessed through a remote connection using the command linevia Telnet or any of the management tools, such as Web Tools

3. Enter y at the Fabric parameters prompt:Fabric parameters (yes, y, no, n): [no] y4. Enter a unique domain ID:Domain: (1.239) [1] 35. Complete the r

The following example shows how to change the time zone to US/Central.switch:admin> tstimezoneTime Zone : US/Pacificswitch:admin> tstimezone US/

Verifying the PID modeBefore connecting the Brocade DCX 8510-4 to the fabric, verify that the WWN-based persistent portidentifier (PID) feature on the

Customizing a chassis name... 36Setting the domain ID...

Installing SFP+ and mSFP transceivers and cablesComplete the following steps to install SFP-type optical transceivers.NOTEmSFP transceivers are compat

Installing QSFP transceivers and cablesFollow these steps to install the QSFPs and cables in the FC16-64 port blades and 16-Gbps coreblades. In the co

261 3 5 1 ------ -- 16G No_Module FC262 3 6 1 ------ -- 16G No_Module FC263 3 7 1 ------ --

NOTERefer to "Cabling Best Practices" (available at http://www.brocade.com ) for cable managementguidelines.For the procedure to install the

Powering off the Brocade DCX 8510-4Perform the following steps to power off the Brocade DCX 8510-4.1. Shut down the Brocade DCX 8510-4 using the sysSh

Monitoring System Components● Monitoring overview...

18 1 18 821200 id N8 Online FC F-Port 10:00:00:05:1e:f9:72:46 19 1 19 821300 id N8 Online FC F-Port 10:

Time Awake: 0 daysCORE BLADE Slot: 3Header Version: 2Power Consume Factor: -135Power Usage (Watts): -88Factory Part Num:

Power Consume Factor: -1Factory Part Num: 60-1000888-05Factory Serial Num: ANN2524F01NManufacture: Day: 7 Month: 6 Year: 20

FIGURE 6 FC8-32E port blade1. Blade status LED2. Blade power LED3. Fibre Channel port4. Port status LEDFIGURE 7 FC8-48E port blade1. Blade status LED2

Removing a core switch blade (CR16-4)... 78Replacing a core switch blade (CR16-4)...

FIGURE 8 FC8-64 port blade1. Blade status LED2. Blade power LED3. Fibre Channel port4. Port status LEDNOTEThe FC8-64 port blade requires narrower OM-3

FIGURE 10 FC16-48 port blade1. Blade status LED2. Blade power LED3. Fibre Channel port4. Port status LEDFIGURE 11 FC16-64 port blade1. Blade status LE

1. Blade status LED2. Blade power LED3. Fibre Channel port4. Port status LEDFIGURE 13 FX8-24 extension blade1. Blade status LED2. Blade power LED3. Gb

Port and application blade LED descriptions (Continued)TABLE 4 LED purpose Color Status Recommended actionFast-flashing amber (on1/2 second, then of

Port and application blade LED descriptions (Continued)TABLE 4 LED purpose Color Status Recommended actionSteady green Port is online but has notraf

The following table describes the CP blade LED patterns and the recommended actions for thosepatterns.CP blade LED descriptions TABLE 5 LED purpose

Determining the status of a core switch blade (CR16-4)Complete the following steps to determine the status of a core switch blade (CR16-4).1. Check th

CR blade LED descriptions (Continued)TABLE 6 LED purpose Color Status Recommended actionQSFP connectorstatus LEDNo light (LED isoff)No QSFP module,

Power supply LED descriptions TABLE 7 LED purpose Color Status Recommended actionPower No light (LED isoff)Power supply does not haveincoming power

Blower assembly LED descriptions TABLE 8 LED purpose Color Status Recommended actionPower No light (LED is off) Blower assembly does nothave power.E

Qualified cables for the FC8-64 port blade... 124Cable types supported on the FC16-64 port blade...

Messages that may indicate WWN card failure (Continued)TABLE 9 Type of message Sample error messageWWN unit is being faulted.0x24c (fabos): Switch:

Removal and Replacement Procedures● Introduction...

Chassis door removal and replacementNOTEThe chassis door must be installed to ensure the Brocade DCX 8510-4 meets EMI and otherregulatory certificatio

Vertical cable management fingers removal and replacementThe Brocade DCX 8510-4 comes equipped with two vertical cable management finger assemblies. I

FIGURE 20 Removal and replacement of the vertical cable management finger assembliesReplacing a cable management finger assemblyComplete the following

This section is applicable for all the following port, application, and encryption blades supported on theDCX 8510 chassis:Blade DCX DCX-4S DCX 8510-4

Follow electrostatic discharge (ESD) precautions when removing a blade. Wear a wrist groundingstrap connected to chassis ground (if the Brocade DCX 85

FIGURE 21 Removal and replacement of the port, application, and encryption blades (FC16-48 portblade shown)Replacing a bladeComplete this procedure to

6. Verify that the Status LED on the blade shows amber until POST completes for the blade. It shouldthen display green. If it remains amber, the board

FIGURE 22 Removal and replacement of the blade filler panelReplacing a filler panelDo not leave a slot empty. This will adversely affect cooling of th

Preface● Document conventions...7● Brocade resource

specific and detailed process. Read the directions under Downloading firmware from an FTP server onpage 75 or Downloading firmware from a USB device o

Recording critical Brocade DCX 8510-4 informationBack up the backbone configuration before you replace a CP blade. Refer to the Fabric OSAdministrator

a) Run the fosconfig --show command to determine if virtual fabrics are enabled. If so, runthe configupload -vf command. This command uploads the Broc

FIGURE 23 Removal and replacement of the control processor blade (CP8)Replacing a control processor blade (CP8)NOTERead ALL of the instructions for re

Verifying operation of the new CP bladeTo verify that boot and POST are complete on the new CP blade and that the CP blade has achievedfailover redund

Downloading firmware from an FTP serverFor this task, determine the correct sequence of upgrading firmware versions to reach your targetversion.Comple

Downloading firmware from a USB deviceFor this task, determine the correct sequence of upgrading firmware versions to reach your targetversion.Complet

NOTEThe time stamp on the co-CPU may not be in sync with the main CPU on the blade. This is not acause for concern.8. Log back in to the standby CP bl

Core switch blade (CR16-4) removal and replacementThis section describes how to remove and replace a core switch blade (CR16-4). The Brocade DCX8510-4

Complete the following steps to remove the core switch blade.1. Remove the chassis door.2. Unscrew the two thumbscrews from the ejectors on the blade

Convention Descriptionvalue In Fibre Channel products, a fixed value provided as input to a commandoption is printed in plain text, for example, --sho

1. Open the ejectors by rotating them toward the center of the blade face. Orient the CR blade so thatthe handles are toward you.2. Align the flat sid

1. Power supply 1 (PS1)2. Power supply 2 (PS2))Removing a power supplyTo remove a power supply, complete the following steps.1. Perform the appropriat

4. Replace the power cord.5. Latch the power cord retainer clip.6. Turn on the power switch.7. Verify that the power LED on the power supply displays

FIGURE 27 Removal and replacement of the blower assemblyReplacing a blower assemblyComplete the following steps to replace the blower assembly in a ch

Time and items requiredAllow approximately 20 minutes to replace the WWN cards. The following items are needed to replacethe WWN cards:• Electrostatic

Follow electrostatic discharge (ESD) precautions. Wear a wrist grounding strap connected to chassisground (if the chassis is plugged in) or a bench gr

ensures they remain disabled after the power is cycled. This allows you to check all the settings sothat you can verify the settings before placing th

DANGERFor safety reasons, the ESD wrist strap should contain a series 1 megaohm resistor.1. Ensure that the chassis is still powered off. If not, powe

Blade Transceiver Auto-negotiate/Fixed Speeds supported(xGbps)CR16-4/8 QSFP Fixed 16Time and items requiredThe replacement procedure for a transceiver

FIGURE 30 Replacing an optical transceiver1. BailFIGURE 31 Replacing a 16 Gbps SFP+ optical transceiverReplacing an SFP+ transceiverComplete the follo

Brocade resourcesVisit the Brocade website to locate related documentation for your product and additional Brocaderesources.You can download additiona

regular SFP+ transceiver. You may damage the cable. Do not force a standard SFP cable into anmSFP transceiver. You may damage the transceiver.Removing

Removing and replacing a QSFP optical transceiverUse this procedure to remove and replace QSFP transceivers supported on the FC16-64 port bladesand co

Replacing a QSFP transceiverComplete the following steps to replace a QSFP transceiver.1. If the QSFP transceiver is being replaced, grasp the bail of

The following table describes the connector port LED patterns and the recommended actions for thosepatterns.ICL QSFP connector port LEDs TABLE 13 LE

1. Grasp the rubber housing on the end of the cable and pull it straight out of the QSFP transceiver.2. If the QSFP transceiver also needs to be repla

FIGURE 36 QSFP cable connections for Brocade DCX 8510 chassis (sample configuration)1. Chassis 1 - DCX 8510-82. Chassis 2 - DCX 8510-4The DCX 8510 cha

FIGURE 37 DCX 8510 core/edge ICL topologyThe DCX 8510 chassis can also be connected in a full mesh configuration as shown in the followingfigure. Alth

FIGURE 38 DCX 8510 full mesh ICL topologyBrocade DCX 8510-4 chassis removal and replacementThis section describes how to remove and replace the Brocad

6. Installing components into the new chassis on page 1037. Downloading the configuration on page 1048. Verifying correct operation of system on page

Recording critical Brocade DCX 8510-4 and SAN informationAll commands must be entered from a CLI session (Telnet or serial) to the active CP blade unl