The procedure for bringing up the Multi-Bunch Feedback processor system for the first time in a new environment is a little involved and is documented below.
Preparing Hardware
- Michael Abbott The hardware list is ...
- The two FMC cards must be placed in the AMC 525 carrier in the correct slots, with the Digital I/O card in slot 0 and the FMC 500 in slot 1. See the image below to verify the correct configuration:
- Note that in order to avoid an I2C collision with an AMC temperature sensor (and thus a MTCA IPMI alert which won't go away) it is necessary to cut a line on the Digital I/O card (is this documented anywhere?
- When placing the AMC cards in the crate it seems that it is necessary to be careful about which cards are (logically) adjacent to the processor card. To avoid problems, at DLS we have install the processor card in slot 6 and the carrier cards in slots 2 and 3 (note that these slot numbers don't correspond to the PCIe addresses which we'll encounter later). Specifically, it seems that with the processor card in slot 6 we need to avoid placing a carrier card in slot 5, as otherwise the processor card tries to boot from non-existent mass storage in this slot!
- Now e-keying must be configured. At this point we recommend that all serial ports are configured with the same data rate, ...
E-key configuration
CPU e-key
| Code Block |
|---|
Payload SOL Port : Serial1
Gbe Management Port: back0
Shutdown delay : 30s
Commands:
ekey - Configure Electronic Keying
lan - Configure LAN Parameters
plser - Configure Payload Serial Port
mgtport - Configure Gbe Management Port
wdcfg - Configure Watchdog Parameters
shutdowndelay - Configure shut down delay
> ekey
E-Keying configuration
* 1) Gigabit Ethernet - Port 0 * 2) Gigabit Ethernet - Port 1
* 3) PCIe Root - Ports 4-11 4) PCIe Root - Ports 4-7
5) PCIe Root - Ports 8-11 6) SATA Client - Port 2
7) SATA Client - Port 3
Commands:
1-7 to toggle option.
save, cancel
|
Ensure that the following are configured:
| Title | Purpose | |
|---|---|---|
| *1 | Gigabit Ethernet - Port 0 | Administration interface to AMC cards and MCH |
| *3 | PCIe Root - Ports 4-11 | 8 lane PCIe connection to AMC carrier cards |
AMC e-key
| Code Block |
|---|
AMC525 > ekey
E-Keying configuration
* 1) Gigabit Ethernet - Port 0 * 2) Gigabit Ethernet - Port 1
3) SATA Server - Port 2 4) SATA Client - Port 2
5) SATA Server - Port 3 6) SATA Client - Port 3
7) SAS - Port 2 8) SAS - Port 3
9) PCIe Root - Ports 4-11 10) PCIe Root - Ports 4-7
11) PCIe Root - Ports 8-11 * 12) PCIe Node - Ports 4-11
13) PCIe Node - Ports 4-7 14) PCIe Node - Ports 8-11
15) SRIO 3.125 Gbaud - Ports 4-7 16) SRIO 2.5 Gbaud - Ports 4-7
17) SRIO 1.25 Gbaud - Ports 4-7 18) SRIO 3.125 Gbaud - Ports 8-11
19) SRIO 2.5 Gbaud - Ports 8-11 20) SRIO 1.25 Gbaud - Ports 8-11
21) XAUI - Port 4-7 22) XAUI - Port 8-11
Commands:
1-22 to toggle option.
save, cancel |
Ensure that the following are configured:
| Title | Purpose | |
|---|---|---|
| *1 | Gigabit Ethernet - Port 0 | Administration interface from CPU |
| *12 | PCIe Node - Ports 4-11 | 8 lane PCIe connection to CPU carrier cards |
Also the vadj setting must be configured as otherwise the FMC cards will not be powered on.
| Code Block |
|---|
FMC0 EEPROM is invalid / missing
FMC1 VADJ range is 0.00V - 0.00V
VADJ setting is 1.80V
AMC525 > vadj
0: 1.80V
c: Cancel
Select Voltage (0-0, c): |
If VADJ is not already set to 1.80V select 0 above to configure.