Refracted objects are flickering

How to get higher resolution environment map reflections may be of some help - reflections and refractions work kinda the same, the mapping sphere is just bent the other way.