SiteSucker

SiteSucker is a macOS application that automatically downloads complete websites from the internet. It asynchronously copies web pages, images, PDF files, style sheets, and other resources to your local hard drive, replicating the directory structure of the original site. The process is initiated by entering a URL. The application generates local copies that can be viewed offline, after a process of localizing the downloaded files.

★★★★★

5.0(2 ratings)

• Asynchronous Downloading. SiteSucker manages multiple downloads simultaneously. This method speeds up the process of capturing an entire website, as it doesn't wait for one file to finish before starting the next. The management of parallel connections is configurable.
• Structural Replication. The application rebuilds the remote website's directory hierarchy locally. This replication facilitates offline navigation and content portability, maintaining the relative paths between files exactly as they were on the server.
• Link Localization. It modifies downloaded HTML files so that links point to local copies of resources, instead of the original URLs on the internet. This enables correct viewing of the site without a network connection.
• File Type Filtering. Allows you to include or exclude specific formats during download. You can define lists of accepted or rejected extensions, such as .html, .jpg, .pdf, .css, .js, to precisely control the stored content.
• Depth and Link Limits. Configures the maximum number of "hops" from the starting page. Restricts the download to a specific domain or allows following links to external domains. These controls delimit the scope of the capture.
• Download Queue Management. Supports queuing multiple URLs for sequential processing. The list of pending jobs is maintained, allowing you to pause, resume, or delete tasks. It keeps a complete history of all downloads performed.
• Embedded Content Download (Pro). The Pro version includes capabilities to extract and download videos embedded in web pages. It supports platforms using different streaming technologies, capturing the underlying video file when accessible.
• Speed and Interval Controls. Adjusts pauses between server requests to reduce load and avoid blocks. Configures timeouts for slow connections and a maximum number of retries on errors, improving robustness in complex downloads.
• User Agent Customization. Allows you to change the browser identification string sent to the server. This function may be necessary to access content that is displayed differently depending on the device or client making the request.
• File Size Limits. Sets minimum and maximum sizes for downloaded resources. Automatically discards files that are too small or excessively large, which is useful for ignoring icons or avoiding unwanted video file downloads in the standard version.
• Authentication and Cookies. Supports access to websites requiring login. It can handle HTTP basic authentication and store session cookies, allowing you to download private areas or content behind access forms.
• Unmodified Mirror Mode. Option to download files as-is, without the link localization process. This mode creates an exact bit-for-bit copy of the server's resources, suitable for archiving or backup tasks where the integrity of the original content is a priority.
• Download Resumption. Ability to continue an interrupted download from the point of failure. It identifies files already successfully transferred and only downloads missing or incomplete ones, saving bandwidth and time on large sites.
• Basic JavaScript Understanding. Analyzes simple JavaScript code in pages to identify dynamically generated URLs that might be necessary for site functionality. Its analysis does not run a full JavaScript engine.

SiteSucker was created by Rick Cranisky. Its development began in the early 2000s, with public records of versions dating back to 2002. The application is natively programmed for macOS using the Objective-C and Swift languages, leveraging the Cocoa and AppKit frameworks for its user interface and system functionalities.

Alternatives to SiteSucker:

Atomic Email Hunter

Atomic Email Hunter is a professional tool for collecting email addresses from websites and search engines.

Price: $89.90   Size: 84.1 MB   Version: 15.22.0.495   OS: Windows