24 votes
Accepted

How to archive the whole website?

Since Wayback Machine doesn't provide such feature, I've found some workaround. First, mirror the website using wget, e.g. wget -m https://example.com/ Then use curl to archive all pages one by one ...
kenorb's user avatar
  • 4,412
16 votes
Accepted

Web archive links without header

from "Wikipedia Help:Using the Wayback Machine" : (Source) Specific archive copy Once the target web page has been archived, each of the specific dated archives can be individually ...
ashleedawg's user avatar
15 votes

How to search Internet Archive for all pages from a particular domain

I think I found a way: Search for the domain, such as domain.com If there are any results, click on Summary of [domain] Scroll down to the link saying Explore [domain] URLs Then you'll get a list of ...
WebUserLearner's user avatar
13 votes

How to archive the whole website?

If you wish to archive a small website, the Archive Team maintains the ArchiveBot, an IRC bot where you can request to crawl websites. The Archive Team will then submit the crawled pages to the ...
Flux's user avatar
  • 301
9 votes

How to search Internet Archive for all pages from a particular domain

Goto archive.org. Use the asterisk: Wait for it to load when it says searching. (Works only for the top search box.) (web.archive.org will not show the top search box. (Go archive.org)) (The other ...
Pacerier's user avatar
  • 6,161
8 votes

On which country are the creators and servers of archive.today / archive.is based?

I've found some inconclusive but interesting information. LinkedIn logged in user on archives As of 2020, all archives of LinkedIn archives appear to be under the same account, e.g.: https://archive....
Ciro Santilli OurBigBook.com's user avatar
6 votes

How to archive the whole website?

Using the Wayback Machine's Save Page Now interface, you can now also save outlinks (linked pages). A quote from the original 2019 announcement: You can now save all the “outlinks” of a web page with ...
roneo.org's user avatar
  • 179
5 votes
Accepted

Direct link to web archive's first copy of a url

If you specify a timestamp in the URL then the Wayback Machine gives you the snapshot closest to that timestamp, so you can get the earliest timestamp by specifying a really early time, i.e https://...
pppery's user avatar
  • 327
5 votes
Accepted

Why does archive.org say that it got HTTP 302 for this URL?

It's a bug in the Wayback Machine, inserted in 2010. It's now fixed in the current Wayback Machine, and also our next-gen Wayback.
Greg Lindahl's user avatar
4 votes

How to archive the whole website?

The Wayback Machine doesn't offer a way to submit an entire site, only a single page as you've already found. This is touched on in a couple of points of their Wayback Machine FAQ: Can I add pages to ...
John C's user avatar
  • 9,360
4 votes
Accepted

Why does archive.org say that this URL is not available?

There's something about the way this server uses SNI that is incompatible with Java's libraries: https://www.ssllabs.com/ssltest/analyze.html?d=www.uni-ms.de So no, our crawler can't talk to it over ...
Greg Lindahl's user avatar
4 votes

How to save a web page on archive.org that has a "Accepting cookies" question button?

It's not quite the same, but if you save the files on your computer, you may be able to upload them to Archive.org (if "you have the right to share"). The largest image uploader on the site ...
Laurel's user avatar
  • 1,424
3 votes

full text searching on particular site archived via archive.org

It is not possible to do full text search on Internet Archive Wayback Machine. But according to this page it might be implemented in the future: Can I search the Archive? Using the Internet Archive ...
Timur's user avatar
  • 31
3 votes

On which country are the creators and servers of archive.today / archive.is based?

From Crunchbase, it is based on Greater New York Area, East Coast, Northeastern US. I can't help to wonder who is behind the website and if they can be trusted on different matters It is not yet ...
Severus Snape's user avatar
3 votes

Searching by keyword in a website in the Wayback Machine

Searches in the Wayback Machine are designed to return website homepages, rather than specific site content or pages within websites. You can't keyword search specific words/phrases on specific pages....
Blindspots's user avatar
  • 5,115
3 votes

Web archive links without header

As commenter fzbd states, appending if_ (not id_) to the date string works best. http://web.archive.org/web/20200101000208/https://webapps.stackexchange.com/ Header shown http://web.archive.org/web/...
Jan Kyu Peblik's user avatar
3 votes

How do I save a Google web cache version of page?

For whatever reason, I've gotten mixed results with Archive.org. In the past, I thought I was able to save cached pages. Today it said that the site was overloaded and to try again in 600 minutes. On ...
Laurel's user avatar
  • 1,424
3 votes

Why can't I get to each saved copy of a page on archive.org? It says it has 3 snapshots, but they redirect to other days

Avid users of IA know that for many years now, its webdev team is abysmal as there's just simply no focus in fundraising unlike Wikipedia. Plenty of other documented bugs with the UI that still ...
Pacerier's user avatar
  • 6,161
3 votes
Accepted

How to sign up for archive.org/download/project-name?

Try the top right corner of the site As stated in the respective official pages: About the Internet Archive Anyone with a free account can upload media to the Internet Archive. We work with ...
marikamitsos's user avatar
  • 12.8k
2 votes

Can an excluded URL from Wayback Machine be included again in future by Internet Archive?

In a similar situation, I simply sent an email to [email protected] requesting that my website be reincluded in the Wayback Machine. The following day they informed me that they had enabled archives ...
Telmo A.'s user avatar
2 votes

Is the source code for the Internet Archive website (archive.org, Wayback Machine) open source and if yes where is the source?

As you mentioned, some of the source code is available on https://github.com/internetarchive. This is mainly for projects such as the OpenLibrary. For the actual code that runs the Internet Archive ...
Hydra's user avatar
  • 6,075
2 votes

Device mapping in Internet Arcade

From Alexander Pruss's blog post, edited to only provide mouse support: To add mouse support, first, go to a game, but don't click the start button. Then put the following into the URL bar and press ...
glenviewjeff's user avatar
  • 1,047
1 vote

How can I see the size of an archive on archive.org?

Many archives on archive.org have a torrent file automatically generated by archive.org. Loading the torrent will show the total size of the archive without having to download the files, e.g.:
Franck Dernoncourt's user avatar
1 vote

Can the Wayback Machine reflect more recent information than dated in this context?

I suppose I could conceive of some odd dynamically generated page situations where it could happen, but... Whether archive.org can behave that way or not isn't particularly relevant here because in ...
Jason C's user avatar
  • 367
1 vote

How to add an entire forum to the Wayback Machine Internet Archive?

Many people have shown interest in making sure the Wayback Machine has copies of the web pages they care about most. These saved pages can be cited, shared, linked to – and they will continue to exist ...
user0's user avatar
  • 26.5k
1 vote

Using the Wayback Machine without loading scrolling images on its front page

It turns out you can simply go to the front page of https://archive.org and it has a Wayback Machine search box, without the infinite scrolling images.
krubo's user avatar
  • 290
1 vote

Using the Wayback Machine without loading scrolling images on its front page

All you need is Adblock Plus and block the element: web.archive.org###web_screenshots ____________________________________________________________ Result:
user0's user avatar
  • 26.5k
1 vote

How to search Internet Archive for all pages from a particular domain

A quick test indicates it uses the same syntax as Google: test site:microsoft.com Update 2023 Things have changed in the last 6 years, but this still works if you are searching the Wayback Machine: ...
Ian's user avatar
  • 124
1 vote

Is there a way to Google search the archive.org by date?

Probably not the way you're thinking, but you can search for results and limit by last update date. After performing your search, open up the "Search Tools" menu under the search field. Open the "...
ale's user avatar
  • 52.7k
1 vote

Can I search the internet with dead links included?

A dead link, see link rot, "by definition" is a "known" link that points somewhere but instead of a web page, a missing web page or website not found errors are returned. If you don't know the link ...
Rubén - Volunteer Moderator -'s user avatar

Only top scored, non community-wiki answers of a minimum length are eligible