I sometimes find Surface blur much better than Gaussian.
Also - try duplicating the image (1 layer over another) - blur the top layer, then using the eraser tool, erase any areas of the top image that have lost too much detail, or look too muddy to reveal the untouched bottom layer - ie, facial features, of hair detail.
The bottom layer may need some blurring, but you can be more gentle with it.