The internet is fragmenting since a few years, on the one hand you have the “surface web” where there is all the commercial stuff that google indices and finds… and then there are the other, way more interesting parts like webrings, the gopherverse, gemini, the whole “retro-web” scene, hell… even the BBS scene is very much alive and kicking.

Yeah, google is focussing more on easily marketable content that is easy to monetize… that is their business model.