Archiving CMS websites to static files with httrack
When a website made with a content management system like Drupal or Wordpress is no longer updated with content or a campaign has ended, sometimes the webpages need to be archived for reference or just stay online without any more changes. But it’s not always possible to upgrade all of the CMS along the way. Maybe there’s a major version change and it’s not economically reasonable to upgrade the custom modules for a site no longer in production use.
That’s why it’s convenient to know how to easily archive a site to static HTML files.
Using the httrack tool to archive a website
brew install httrack
These seem optimal httrack options for mirroring:
httrack http://SITE_TO_ARCHIVE -O DESTINATION_DIR -N "%h%p/%n/index%[page].%t" \
-WqQ%v --robots=0 --footer ''
The tool will prompt you if external links should be followed.
If you like, relative links can also be rewritten afterwards e.g. “about.html” to “about”. This is optional but useful if you want to preserve the URL paths (for inbound links).
find . -name "*.html" -type f -print0 | xargs -0 perl -i -pe "s/\/index.html/\//g"
Copy the homepage index index/index.html to the site root and change include paths and links in it (remove “../” everywhere).
If the source site uses HTTP authentication, provide username and password as part of the URL: username:email@example.com
The resulting files can be served from some inexpensive static web hosting like Netlify or Github Pages.