Skip to content

Python project that allows you to download the contents of any website

License

Notifications You must be signed in to change notification settings

Weever1337/WebCopy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

✨WebCopy

WebCopy is a Python project that allows you to download the contents of any website, including HTML, images, CSS, and other assets

Features

  • Asynchronous downloading of website content
  • Saves all assets (HTML, CSS, images, etc.) in the appropriate folder structure
  • Folder named after the website's domain (e.g., example.com)
  • Easy to use: just enter the URL of the website

Installation

To get started with WebCopy, you'll need to install the required dependencies. You can do this by running the following command:

pip install -r requirements.txt

Usage

After installing the necessary libraries, you can run the script and input any website URL to copy its contents.

python main.py

The script will prompt you to enter the URL of the website you want to copy. The content will be saved in a folder named after the domain of the website. Or you can use the command line arguments:

python main.py -u https://example.com

Also you can use the debug mode:

python main.py -u https://example.com -d

Example

Enter the URL of the website: https://example.com

This will create a folder named example.com in your "copied" directory, containing the website's HTML and assets in their respective subfolders.

Requirements

  • Python 3.8+
  • aiohttp
  • beautifulsoup4

About

Python project that allows you to download the contents of any website

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages