Every web search engine discovers URLs, fetches and renders them, stores what it understood in an index, and ranks indexed pages for each query. Google and Bing 31 now also write AI answers that cite some of those pages. Knowing where a page can drop out of this pipeline is the most useful SEO skill a developer can have.