As per docs - you should not add / remove / modify any elements when using Object3D.traverse. If you need to do that - you can use children.forEach or save referenced to the elements you’d like to remove in an array outside of the traverse callback.
Note: Modifying the scene graph inside the callback is discouraged.