Hi @srx_nstratton ,
@cchannon pointed out the right direction. The only documentation about using Fluent v9 is made for theming.
I would like to add, that there we see how we can use the virtual components with Fluent v9 (v9.4.0):
https://learn.microsoft.com/en-us/power-apps/developer/component-framework/fluent-modern-theming?WT.mc_id=BA-MVP-5004107

On the other side only the Fluent 8 is documented, where the platform library are listed: https://learn.microsoft.com/en-us/power-apps/developer/component-framework/react-controls-platform-libraries?WT.mc_id=BA-MVP-5004107
So it is possible to use Fluent 9 in virtual components, but I guess we should consider that as a preview for now.
On the other side, you can always switch to a supported way in case you have issues with Fluent 9, by removing the Fluent from the platform-library. That way you have a virtual component using React, but you bring your own Fluent version.
I know, React version in combination with Fluent 9 could also be an issue; I guess then we would need to switch to standard PCFs. But the change in code between standard and virtual component is not that big.. so it could be a strategy to start with Fluent 9 virtual, because we have a fallback with a small change, in case there are issue.
But of course, it depends on the project, if we can risk to work with "preview" features.
If you have already the component build with Fluent 8, you don't have to migrate for now. You could only apply the theming from Fluent. Have a look to the "Modern theming API" sample: there are examples of using Fluent 9 (virtual), but also how to theme a Fluent v8 component: https://learn.microsoft.com/en-us/power-apps/developer/component-framework/sample-controls/modern-theming-api-control?WT.mc_id=BA-MVP-5004107
Hope it helps 😊