I have the same issue, my Xbox Series X controller rarely authenticates, or is recognized. The Xbox icon never shows up in Xim Manager.
I have an Xbox One controller that works fine.
I'm using the Beta firmware on the XIM, and my console and Controllers all have the latest Xbox updates.