I’m not fluent in React, but if the physics component only works with meshes, as a workaround, try loading the model with useGLTF, extracting the child mesh and wrapping it with the physics tag.
Here is an interesting discussion about useGLTF, you might need to convert your model to gltfjsx: