Skip to end of metadata
Go to start of metadata

You are viewing an old version of this content. View the current version.

Compare with Current View Version History

« Previous Version 4 Next »

The procedure for bringing up the Multi-Bunch Feedback processor system for the first time in a new environment is a little involved and is documented below.

Preparing Hardware

  • The two FMC cards must be placed in the AMC 525 carrier in the correct slots, with the Digital I/O card in slot 0 and the FMC 500 in slot 1.  See the image below to verify the correct configuration:
  • Note that in order to avoid an I2C collision with an AMC temperature sensor (and thus a MTCA IPMI alert which won't go away) it is necessary to cut a line on the Digital I/O card (is this documented anywhere?
  • When placing the AMC cards in the crate it seems that it is necessary to be careful about which cards are (logically) adjacent to the processor card.  To avoid problems, at DLS we have install the processor card in slot 6 and the carrier cards in slots 2 and 3 (note that these slot numbers don't correspond to the PCIe addresses which we'll encounter later).  Specifically, it seems that with the processor card in slot 6 we need to avoid placing a carrier card in slot 5, as otherwise the processor card tries to boot from non-existent mass storage in this slot!
  • At this point we recommend that all serial ports are configured with the same data rate.  The default line speed is 115200 8N1 for all ports except for the CPU console which defaults to 9600 8N1.
  • Now e-keying must be configured.

Table of relevant serial ports

CardPortDescription
UTC002SERSerial console to MCH.  Not normally used.

AMC720

(CPU)

IPMI RS-232CPU IPMI port.  Use for ekey configuration only.
PCH RS-232CPI serial console port.  Use for BIOS and basic system administration.
AMC525MGT RS-232Carrier card IPMI port.  Use for ekey configuration only.
CPU RS-232P2040 CPU serial console.  Not normally used.

E-key configuration

Once the hardware has been configured as above the crate can be powered on and the e-keying for the CPU and AMC525 must be set up.  This will be particularly important to ensure that the PCIe link works properly.

CPU e-key

Payload SOL Port   : Serial1
Gbe Management Port: back0
Shutdown delay     : 30s

Commands:
  ekey          - Configure Electronic Keying
  lan           - Configure LAN Parameters
  plser         - Configure Payload Serial Port
  mgtport       - Configure Gbe Management Port
  wdcfg         - Configure Watchdog Parameters
  shutdowndelay - Configure shut down delay
> ekey

E-Keying configuration
*  1) Gigabit Ethernet - Port 0        *  2) Gigabit Ethernet - Port 1        
*  3) PCIe Root -  Ports 4-11             4) PCIe Root -  Ports 4-7           
   5) PCIe Root -  Ports 8-11             6) SATA Client - Port 2             
   7) SATA Client - Port 3             

Commands:
  1-7 to toggle option.
  save, cancel

Ensure that the following are configured:


TitlePurpose
*1Gigabit Ethernet - Port 0Administration interface to AMC cards and MCH
*3PCIe Root - Ports 4-118 lane PCIe connection to AMC carrier cards

Note: Port 1 is enabled but not used.

AMC e-key

Connect to the MGT-RS232 port on the AMC525 front panel, and type ekey at the prompt.  Adjust for the following settings:

AMC525 > ekey

E-Keying configuration
*  1) Gigabit Ethernet - Port 0        *  2) Gigabit Ethernet - Port 1        
   3) SATA Server - Port 2                4) SATA Client - Port 2             
   5) SATA Server - Port 3                6) SATA Client - Port 3             
   7) SAS - Port 2                        8) SAS - Port 3                     
   9) PCIe Root -  Ports 4-11            10) PCIe Root -  Ports 4-7           
  11) PCIe Root -  Ports 8-11          * 12) PCIe Node -  Ports 4-11          
  13) PCIe Node -  Ports 4-7             14) PCIe Node -  Ports 8-11          
  15) SRIO 3.125 Gbaud - Ports 4-7       16) SRIO 2.5   Gbaud - Ports 4-7     
  17) SRIO 1.25  Gbaud - Ports 4-7       18) SRIO 3.125 Gbaud - Ports 8-11    
  19) SRIO 2.5   Gbaud - Ports 8-11      20) SRIO 1.25  Gbaud - Ports 8-11    
  21) XAUI - Port 4-7                    22) XAUI - Port 8-11                 

Commands:
  1-22 to toggle option.
  save, cancel

Ensure that the following are configured:


TitlePurpose
*1Gigabit Ethernet - Port 0Administration interface from CPU
*12PCIe Node - Ports 4-118 lane PCIe connection to CPU carrier cards

Also the vadj setting must be configured as otherwise the FMC cards will not be powered on.

  FMC0 EEPROM is invalid / missing
  FMC1 VADJ range is 0.00V - 0.00V
  VADJ setting is 1.80V
AMC525 > vadj
0: 1.80V
c: Cancel
Select Voltage (0-0, c): 

If VADJ is not already set to 1.80V select 0 above to configure.

Cabling

Connections to Digital I/O card.

These are Limo ERA.00.250 sockets taking FFS.00.250 connectors.  All inputs are configured as 3.3V TTL high impedance (though 50Ω termination can be configured in software if desired), all outputs are driven as 3.3V TTL.  All inputs are acted on once per machine revolution in response to a rising edge, but are continuously sampled (at machine RF frequency).

PortDirDescription
1InGeneral purpose trigger.  Designed for general event triggering, connected to machine synchronous 5Hz source at DLS.
2InPostmortem trigger.  Alternative trigger source, connected to Machine Protection System loss event trigger for postmortem capture.
3InBlanking trigger.  Used for suppressing measurement of beam disturbance during injection transients.
4, 5OutProgrammable sequencer events.  These are pulsed (pulse width is 62 machine clock ticks) when the sequencer enters the selected state.  Each sequencer has its own pulsed output.  These are designed to be interface to external equipment if required.  Channel 0 drives port 4, channel 1 drives port 5.

Connections to FMC500 card

These are all SSMC sockets.  The connectors should not be tighter than finger tight, our experience is that over-tightening can use the inner conductor to lose contact.  The official documentation (see page 26) recommends 0.2 Nm coupling torque.

PortDirSignalDescription

DAC 1 OUT-

DAC 1 OUT+

Out±1V into 50Ω, DC to 500 MHzChannel 1 differential output.  Outputs are driven directly by a LMH6554 amplifier.  Unused outputs should probably be terminated into 50Ω.

DAC 0 OUT-

DAC 0 OUT+

OutChannel 0 differential output.
CLK INIn±0.3 to 3.3V into 50Ω, 250 to 500 MHz.Machine RF clock.
CLK OUTUnused
EXT TRGIn0 to 3.3V into 50Ω, threshold at 1.2V.To ensure synchronisation with the machine revolution a fast rising edge is expected at machine revolution frequency.  This signal is synchronised to once during startup, and is sampled continuously thereafter.
ADC 0In±1V into 50Ω, DC to 250 MHzChannel 0 single ended input.
ADC 1InChannel 1 single ended input.
  • No labels