The raycasting logic uses the bounding sphere of geometries for better performance. If you change the position of vertices, you should always recompute it. Updated fiddle: three.js ~ example ~ Mr.doob - JSFiddle - Code Playground
You eventually need points.geometry.computeBoundingSphere(); in your endMove() function.