====== Firmware ====== The card shipped with firmware for ''9300-8i'' even though it's an external port card (would have thought it were 9300-8e). Might be a knock-off with the wrong description flashed into it. Download from [[https://www.broadcom.com/support/download-search?pg=Storage+Adapters,+Controllers,+and+ICs&pf=Storage+Adapters,+Controllers,+and+ICs&pn=SAS+9300-8i+Host+Bus+Adapter&pa=&po=&dk=&pl=|Broadcom]] * ''Installer_P16_for_Linux'' - contains the ''sas3flash'' utility to apply the firmwares * ''9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows'' - contains the firmware images themselves There are three components to the firmwares: * The controller firmware file, e.g. ''Firmware/SAS9300_8i_IT/SAS9300_8i_IT.bin'' * The UEFI boot rom, e.g. ''uefi_bsd_rel/mpt3x64.rom'' * The BIOS boot rom, e.g. ''sasbios_rel/mptsas3.rom'' ===== Checking current versions ===== kowlan ~/Installer_P16_for_Linux # ./sas3flash_linux_x64_rel/sas3flash -list Avago Technologies SAS3 Flash Utility Version 17.00.00.00 (2018.04.02) Copyright 2008-2018 Avago Technologies. All rights reserved. Adapter Selected is a Avago SAS: SAS3008(C0) Controller Number : 0 Controller : SAS3008(C0) PCI Address : 00:04:00:00 SAS Address : 500605b-0-0b4e-c8d9 NVDATA Version (Default) : 0e.01.00.07 NVDATA Version (Persistent) : 0e.01.00.07 Firmware Product ID : 0x2221 (IT) Firmware Version : 16.00.10.00 NVDATA Vendor : LSI NVDATA Product ID : SAS9300-8i BIOS Version : 08.11.00.00 UEFI BSD Version : 18.00.00.00 FCODE Version : N/A Board Name : SAS9300-8i Board Assembly : N/A Board Tracer Number : N/A Finished Processing Commands Successfully. Exiting SAS3Flash. This shows the card is running an "IT" mode firmware, expects firmwares for ''SAS9300-8i'', is currently running contorller firmware ''16.00.10.00'' and UEFI boot rom ''18.00.00.00'', ===== Upgrading ===== ./sas3flash_linux_x64_rel/sas3flash -o -f ~/9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows/Firmware/SAS9300_8i_IT/SAS9300_8i_IT.bin -b ~/9300_8i_Package_P16_IR_IT_FW_BIOS_for_MSDOS_Windows/uefi_bsd_rel/mpt3x64.rom Flash the controller ahd UEFI firmwares at the same time. The flash tool will do a compatibility check and warn if there's a bad combination. Might prevent an accidental bricking of the card. ====== Operation ====== ===== Listing available controllers ===== kowlan ~ # /opt/lsi/sas3ircu LIST Avago Technologies SAS3 IR Configuration Utility. Version 17.00.00.00 (2018.04.02) Copyright (c) 2009-2018 Avago Technologies. All rights reserved. Adapter Vendor Device SubSys SubSys Index Type ID ID Pci Address Ven ID Dev ID ----- ------------ ------ ------ ----------------- ------ ------ 0 SAS3008 1000h 97h 00h:04h:00h:00h 1000h 30e0h SAS3IRCU: Utility Completed Successfully. ===== Viewing available disks ===== Needs ''sys-block/sas3ircu''. Have emerged this onto the box temporarily, but should try to get this packaged upstream. kowlan ~ # /opt/lsi/sas3ircu 0 DISPLAY Avago Technologies SAS3 IR Configuration Utility. Version 17.00.00.00 (2018.04.02) Copyright (c) 2009-2018 Avago Technologies. All rights reserved. Read configuration has been initiated for controller 0 ------------------------------------------------------------------------ Controller information ------------------------------------------------------------------------ Controller type : SAS3008 BIOS version : 8.11.00.00 Firmware version : 16.00.10.00 Channel description : 1 Serial Attached SCSI Initiator ID : 0 Maximum physical devices : 1023 Concurrent commands supported : 9856 Slot : 2 Segment : 0 Bus : 4 Device : 0 Function : 0 RAID Support : No ------------------------------------------------------------------------ IR Volume information ------------------------------------------------------------------------ ------------------------------------------------------------------------ Physical device information ------------------------------------------------------------------------ ------------------------------------------------------------------------ Enclosure information ------------------------------------------------------------------------ Enclosure# : 1 Logical ID : 500605b0:0b4ec8d9 Numslots : 8 StartSlot : 0 ------------------------------------------------------------------------ SAS3IRCU: Command DISPLAY Completed Successfully. SAS3IRCU: Utility Completed Successfully. No disks or SCSI enclosures here, need to check the cables. ===== Recovering lost arrays ===== [[https://www.thomas-krenn.com/en/wiki/StorCLI_commands#Incorporating_an_improperly_removed_device]] Seen before, during a reboot, all disks in a RAID1 were detected as ''UBUnsp'' (unconfigured, bad, unsupported). Reseating the drives helped. To bring them back online: * Show the foreign configurations: [root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /fall show CLI Version = 007.1323.0000.0000 May 25, 2020 Operating system = VMkernel 7.0.1 Controller = 0 Status = Success Description = Operation on foreign configuration Succeeded FOREIGN CONFIGURATION : ===================== ----------------------------------------- DG EID:Slot Type State Size NoVDs ----------------------------------------- 0 - RAID1 Frgn 931.000 GB 1 ----------------------------------------- NoVDs - Number of VD in Drive Group DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Optl=Optimal|Dgrd=Degraded Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present TR=Transport Ready Total foreign Drive Groups = 1 [root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /e8 /s14-15 show CLI Version = 007.1323.0000.0000 May 25, 2020 Operating system = VMkernel 7.0.1 Controller = 0 Status = Success Description = Show Drive Information Succeeded. Drive Information : ================= ----------------------------------------------------------------------------- EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp Type ----------------------------------------------------------------------------- 8:14 28 UGood F 931.000 GB SATA SSD N N 512B CT1000MX500SSD1 U - 8:15 29 UGood F 931.000 GB SATA SSD N N 512B CT1000MX500SSD1 U - ----------------------------------------------------------------------------- EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|DG=DriveGroup DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare UBad=Unconfigured Bad|Sntze=Sanitize|Onln=Online|Offln=Offline|Intf=Interface Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign UGUnsp=UGood Unsupported|UGShld=UGood shielded|HSPShld=Hotspare shielded CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded UBUnsp=UBad Unsupported|Rbld=Rebuild * Import foreign configurations: [root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /fall import CLI Version = 007.1323.0000.0000 May 25, 2020 Operating system = VMkernel 7.0.1 Controller = 0 Status = Success Description = Successfully imported foreign configuration * Recheck status: [root@devnull:/opt/lsi/storcli64] ./storcli64 /c0 /v1 show CLI Version = 007.1323.0000.0000 May 25, 2020 Operating system = VMkernel 7.0.1 Controller = 0 Status = Success Description = None Virtual Drives : ============== ----------------------------------------------------------------------- DG/VD TYPE State Access Consist Cache Cac sCC Size Name ----------------------------------------------------------------------- 2/1 RAID1 Optl RW No NRWTD - OFF 931.000 GB local-ssd-1t ----------------------------------------------------------------------- VD=Virtual Drive| DG=Drive Group|Rec=Recovery Cac=CacheCade|OfLn=OffLine|Pdgd=Partially Degraded|Dgrd=Degraded Optl=Optimal|dflt=Default|RO=Read Only|RW=Read Write|HD=Hidden|TRANS=TransportReady|B=Blocked| Consist=Consistent|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack| AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled Check Consistency