I found a bug in Drei Transform Controls. whenever I detach and reattach the transform controls, the scene geometry count is increasing. Maybe that’s the cause of getting the slower fps after using it for some time. I’ve opened the issue on Github.
i think you should use drei/pivot controls anyway. controls in threejs are kind of on the dirty side, they mutate, rip stuff out of their scene, inject objects, etc. this is hard to catch and causes leaks and issues. pivotcontrols has most of the functionality but is based on a cleaner approach.