When you increase the strength of an HDRi image, are you making the entire picture brighter or just the light source?

I'm not what you think the difference is between "brighter picture" and "just the light source". If you're rendering the World texture (as in you don't have "transparent" enabled) then it will be blown out with higher strength values.