I noticed high quality is disabled when shooting 4K 50/60p. Is there a significant impact on footage?

The general opinion seems to be that high quality mode is best for lower light situations because it uses extra noise reduction which softens the image.  In lower light, it's best to use lower frame rates and lower shutter speeds.   So you might not want to be using HQ mode with more than 30 fps anyway.