5

Piazza has no official feature to download all posts. I can't use wget to crawl the site, because although I can get past the login using a cookies.txt file, the entire interface is dynamically generated with javascript, which wget doesn't support. I tried using the website-scraper-phantom nodejs package in addition to cookies.txt to read the cookie file, but then it crawls the home page instead of the posts.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.