Germany and Austria have some of the most strict privacy laws in the world so they are a good example of the extreme case. In Germany, you do not control the use of the image, only its publication. That is I can take your photo in public and hang it on my own wall. Publication of public figures is pretty much universally allowed. Use of your image taken in public for data purposes (not published) remains controversial.

If I take your photograph and you cannot be identified in it, I can publish it without your permission, (say in a crowd or in front of a building as you note, etc)