Take the 2-minute tour ×
Web Applications Stack Exchange is a question and answer site for power users of web applications. It's 100% free, no registration required.

I have a URL pattern that was found by the search engine, I've tried the link directive to find backward links. But to no avail.

So how could I know where / how the search engine found those page?

By search engine I specifically refer to Bing and Google


migration rejected from superuser.com Jun 22 '13 at 15:18

This question came from our site for computer enthusiasts and power users. Votes, comments, and answers are locked due to the question being closed here, but it may be eligible for editing and reopening on the site where it originated.

closed as off topic by Sathya Jun 22 '13 at 15:18

Questions on Web Applications Stack Exchange are expected to relate to web applications within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here. If this question can be reworded to fit the rules in the help center, please edit the question.

Welcome to the world of crawlers. A crawler indexes your main page, then follows links leading off that page. –  Nathan C Jun 20 '13 at 11:22

Browse other questions tagged or ask your own question.