You see them not necessarily in places like wall street, but more in places with strong intellectual culture like universities and artsy neighborhoods.

I can use the existence of a country club as a useful signal about a place without being a member, or having any interest in it.

Also points towards local labor law and market.

In some countries, low cost of human labor enables staffing of low-volume businesses, including opening hours with low traffic.