Website Downloader MCP Server

This MCP server provides a tool to download entire websites using wget. It preserves the website structure and converts links to work locally.

Prerequisites

The server requires `wget` to be installed on your system.

Installing wget

macOS

Using Homebrew:

brew install wget

Linux (Debian/Ubuntu)

sudo apt-get update
sudo apt-get install wget

Linux (Red Hat/Fedora)

sudo dnf install wget

Windows

1. Using Chocolatey:

choco install wget

2. Or download the binary from: https://eternallybored.org/misc/wget/

Usage

The server provides a tool called `download_website` with the following parameters:

• `url` (required): The URL of the website to download
• `outputPath` (optional): The directory where the website should be downloaded. Defaults to the current directory.
• `depth` (optional): Maximum depth level for recursive downloading. Defaults to infinite. Set to 0 for just the specified page, 1 for direct links, etc.

Example

{
  "url": "https://example.com",
  "outputPath": "/path/to/output",
  "depth": 2  // Optional: Download up to 2 levels deep
}

Features

The website downloader:

• Downloads recursively with infinite depth
• Includes all page requisites (CSS, images, etc.)
• Converts links to work locally
• Adds appropriate extensions to files
• Restricts downloads to the same domain
• Preserves the website structure

Installation

1. Build the server:

npm install
npm run build

2. Add to MCP settings:

{
  "mcpServers": {
    "website-downloader": {
      "command": "node",
      "args": ["/path/to/website-downloader/build/index.js"]
    }
  }
}