The quality of search engines has gone down so much for technical questions.

I’m looking for a way to index sites like stack exchanges, reddit, quora, and research papers. Would this be possible to do this locally with metadata?