If you can't access the BMC, please check the network for BMC carefully to ensure a broken network does not cause the issue.
In some rare abnormal situations on the BMC network, BMC may become inaccessible. Please follow this SOP to resolve the issue.
Warning: Please prepare a 2.0 pitch mini jumper before you do the following steps. In the worst case, you can't power up the chassis vial BMC after the power is off. However, you can still force the chassis to power up without a working BMC. You can follow the steps in the Force the Chassis to Power Up section to power up the chassis.
Reboot the BMC
1. SSH to a monitor node and set no OSD down.
ceph osd set noout
2. SSH to all nodes in that chassis and shut down the node. Shot down nodes one by one.
3. Wait for three minutes for the node to shut down.
4. Unplug all the AC power and then re-plug the cords to reboot the BMC.
5. Wait 2 minutes for BMC to complete the boot and ensure the red ID LED blinks at one blink per second.
6. Ping or ssh with the BMC IP and see if you can reaccess the BMC. The BMC is working if you can reaccess it.
7. Press the PW button for more than three seconds to power on the chassis.
8. Make sure the nodes have entirely booted up.
9. Use the UVS manager Settings--> NTP page to push the NTP client config to force the time sync.
10. Unset the osd noout flag.
ceph osd unset noout
Restore the BMC
If BMC does not work after the power cycle reset, Please follow the following steps to restore the BMC.
1. You can restore BMC to the factory default. BMC IP will be reset to 192.168.1.100 after the BMC restore. Press PW and RS buttons simultaneously for longer than 5 seconds. The ID LED shall be lit up during the restoration and flashing after completion.
2. Ensure your computer network is configured to connect SSH to the BMC with IP 192.168.1.100.
3. SSH to the BMC and use the "confignet" command to re-config your BMC to a correct network setup.
4. Follow steps 7 to 9 in the Reboot BMC section to complete the process.
If your BMC is still inaccessible after the restoration, the BMC might have a hardware issue. Please get in touch with Ambedded to get a BMC replacement. Now you have to force the power up for this situation.
Force the Chassis to Power Up
1. Slide the chassis out of the rack and open the top cover.
2. Use a 2.0 pitch jumper cap to short the JP9 on the motherboard. Please refer to the attached picture for the location of JP9.
3. Slide the chassis back into the rack and plug the power cords. The chassis shall be powered up successfully.
4. Follow steps 7 to 9 in the Reboot BMC section to complete the process.