1

How can I get all websites having covid keyword in their Base URL and ending with specific country domain e.g eu. So that i can get all websites like www.(.*covid.*).eu; examples below:-

I have tried combining google search operators: inurl and site however it shows results from suburls as well like these www.xyznews.com/abc-covid-trump-statement-xyz

1
  • 1
    Can you give one or two real examples of sites? Commented Nov 7, 2020 at 14:41

2 Answers 2

2

If you are doing a research of available domains, instead of using Google ( websearch) use an specialized tool like the Domain Availability Search tools offered by domain registrars like Google Domains, GoDaddy, among others. Besides of telling you if the domain is available, some of them offer a list of similar domains so yo could have an idea of how unique is the domain that you are searching

By the other hand if you are looking existing domains, as is mentioned in another answer, then you have get a list or registered domains. Some places publish interesting lists like Wikipedia:

Looking at this lists could give you hints about other lists that might give you what you are looking for.

The above because Google (websearch) is good for indexing content but no so good for searching domains / urls as it hasn't search operators like start with and doesn't support something like regular expressions.

Google (websearch) might help you find if someone already did a similar project and maybe also to learn about the knowledge/skills required to do it but not be the source to dump all the URLs in first place because Google doesn't index all the existing domains/websites.

3
  • My project require analytics-cum-analysis over the covid related websites that emanated in a particular country within particular time-frame. I thought i can dump all the URLs using google-search etc but it seems like a relatively complex and money spending task Commented Nov 7, 2020 at 20:21
  • @shaneaugmentin Google (websearch) might help you find if someone already did a similar project and maybe also to learn about the knowledge/skills required to do it but not be the source to dump all the URLs in first place because Google doesn't index all the existing domains/websites. Commented Nov 7, 2020 at 20:29
  • You write "it hasn't search operators like start with " Yet he isn't looking for "start with". He is looking for a keyword in a URL. And Google does have the inurl keyword. The problem is that doesn't specify base URL
    – barlop
    Commented Feb 12, 2023 at 5:11
0

The answer is: you should not be able to.

To get a list of all host names that are available, you would need to do a zone-transfer. Only miss-configured DNS servers will allow you to do such a zone transfer.

There are a number of companies that will sell you a dump of the "whois" database against extortionate prices. These databases contain the information that you need, but you may not be willing to spend $500 for just the Netherlands.

2
  • Thanks but I am looking for already built websites, basically i need to get list of all covid related websites built in this year especially within a particular country. Commented Nov 7, 2020 at 20:24
  • Read the question. Your understood it as pretty much the opposite of what he asked for
    – barlop
    Commented Feb 12, 2023 at 5:09

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.