Linecard/Modules swap on CORE and DC routers #2

Scheduled Maintenance Report for Gandi.net

Completed

The scheduled maintenance has been completed.
Posted Nov 17, 2021 - 16:37 UTC

Update

tshoot status:
We have the same behavior on another slot.
Meanwhile, the LAG toward a core routers stays down for no reason.
The ASR is seeing an `old` partner MAC...

We have finally reloaded the chassis, with the card slotted.
On the reload, the card was discovered okay and the LAG that was previously down is now up and running.

We have taken traces to open the TAC.

We stop the maintenance until with have feedback from the support
Posted Nov 17, 2021 - 16:37 UTC

Update

We tried another card and it crashed again. Both cards were tested OKAY in LAB this morning.
We now suspects that the slot is messed up.

We are freeing another slot on the chassis to validate this.
We are still working isolated from the production
Posted Nov 17, 2021 - 14:53 UTC

Update

During the reload, we have removed all uplinks to the routers to work on it isolated.

We tried to insert the card back, the card is boot looping and crashed again the supervisor.
We will try another card after the next reload, and will open a TAC case anyway.
Posted Nov 17, 2021 - 14:33 UTC

Update

Ro-1.csd4 crashed during the OIR on the MPA.
The card has been slotted `powered down`, the crashed happened during the power up.

We are reloading the router

Impact might have been seen during the network convergence
Posted Nov 17, 2021 - 13:53 UTC

In progress

Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Nov 17, 2021 - 13:37 UTC

Scheduled

We are moving around some ASR9K MPA card on CORE/DC routers to maximize port usage.
Posted Nov 17, 2021 - 13:35 UTC
This scheduled maintenance affected: Network.