web dev//crawling//search engine//ranking

Ordering results or URLs by some estimate of relevance or priority. Of a hundred possible things, which deserve attention first?

Ordering results or URLs by some estimate of relevance or priority. Of a hundred possible things, which deserve attention first?

Ranking happens twice in a search engine: once in the scheduler, to decide which URLs to fetch first, and once at query time, to order the documents the index returns.

The classic link-based signal, PageRank, treats the web as a graph and scores a page by the probability that a random surfer following links ends up on it. Text relevance, freshness, user signals and hundreds of other features are layered on top; the exact function is the engine's secret.

Anything designed to manipulate that estimate rather than to earn it is spam.