TransformControls don't follow the nested group position

I’m seeing the example for TransformControls for react three fiber. I’m trying to add two groups with TransformControls, and I’m having issues with the controls always fixed to one of the groups.
I created a codesandbox example with the issue: r3f drei TransformControls (forked) - CodeSandbox

Hm, could you explain a bit more :thinking: ? In the sandbox you shared, when controls are changed to translate, they seem to stay with the proper group (initially they are just placed in (0,0,0)):

Screenshot 2021-02-13 at 04.45.02