Grey area as I'm not too sure if spotters are permitted in the UK - so yes if you have another person watching the drone otherwise no. I don't use spotters or goggles so not something I've had to look in to.
On quick glance this is taken from the UK CAA ANO - it merely stipulates that the operator must be able to see the drone and makes no reference to spotters. Goggles will therefore be considered a visual aid and breaks direct, visual contact of the drone so my interpretation is that they are indeed illegal when operating a drone for recreational use in UK airspace.