Sort:  

"ye olde record shoppe" - you just haven't looked hard enough.
https://thevinylfactory.com/features/definitive-guide-london-best-record-shops/

It probably depends on the city, but if you see a millennium hipster try to follow him or her and I garantee that there is a fair chance of ending up in a combined coffee-shop and vinyl record shop :)