1.0.3 • Published 3d agoCLI

clone-this-website

Licence

MIT

Version

1.0.3

Deps

Size

28 kB

Vulns

Weekly

Summary Dependency Versions

Website Cloner Pro

A professional, cross-platform website cloner with a beautiful CLI interface that can be executed directly with npx.

Features

Beautiful Professional UI - Modern, colorful terminal interface with progress bars and spinners
NPX Ready - No installation required, just run npx clone-this-website
Cross-Platform - Works on Windows, macOS, and Linux
Auto-Dependency Management - Automatically installs wget if not present
Smart Error Handling - Comprehensive error handling with user-friendly messages
Progress Tracking - Real-time progress bars and file counting
Website Testing - Tests website accessibility before cloning
Interactive Mode - Guided interactive setup for beginners
Advanced Options - Custom output directories, verbose mode, force cloning
Statistics - Shows file count and directory size after completion

Quick Start

Method 1: Direct Execution (Recommended)

npx clone-this-website https://example.com

Method 2: Interactive Mode

npx clone-this-website --interactive

Method 3: With Options

npx clone-this-website https://example.com --output my-site --verbose

Installation Options

Global Installation

npm install -g clone-this-website

Then use:

clone-this-website https://example.com

Local Installation

npm install clone-this-website

Then use:

npx clone-this-website https://example.com

Usage Examples

Basic Usage

# Clone a website
npx clone-this-website https://github.com

# Start interactive mode
npx clone-this-website --interactive

Advanced Usage

# Custom output directory
npx clone-this-website https://example.com --output my-website

# Skip website test and force clone
npx clone-this-website https://example.com --force --skip-test

# Verbose output for debugging
npx clone-this-website https://example.com --verbose

# Show help
npx clone-this-website --help

# Show version
npx clone-this-website --version

Command Line Options

Option	Alias	Description
`--output <directory>`	`-o`	Custom output directory name
`--force`	`-f`	Force cloning even if website test fails
`--skip-test`	`-s`	Skip website accessibility test
`--verbose`	`-v`	Enable verbose output
`--interactive`	`-i`	Start in interactive mode
`--help`	`-h`	Show help information
`--version`	`-V`	Show version number

System Requirements

Node.js >= 12.0.0
wget (auto-installed if not present)
Internet connection

Supported Platforms

Windows - Auto-downloads wget binary
macOS - Uses Homebrew if available
Linux - Supports apt, yum, pacman, dnf, zypper

How It Works

Dependency Check - Verifies wget installation
Auto-Installation - Installs wget if missing (platform-specific)
Website Test - Tests URL accessibility (optional)
Directory Setup - Creates output directory
Cloning Process - Uses wget with optimized parameters
Progress Tracking - Shows real-time progress
Statistics - Displays file count and size

Output Structure

example.com/
├── index.html
├── assets/
│   ├── css/
│   ├── js/
│   └── images/
├── about/
└── contact/

UI Features

Professional Terminal Interface

Color-coded output with chalk
Animated spinners and progress bars
Real-time statistics
Error highlighting
Success indicators

Interactive Mode

Step-by-step guidance
Input validation
Smart defaults
Progress feedback

Advanced Configuration

wget Parameters Used

wget --recursive \
     --page-requisites \
     --html-extension \
     --convert-links \
     --restrict-file-names=windows \
     --no-parent \
     --domains=example.com \
     --directory-prefix=example.com \
     --mirror \
     --no-check-certificate \
     https://example.com

Custom wget Options

You can modify the wget parameters in the source code for specific needs:

Change --mirror to --recursive for shallow cloning
Adjust --domains for multi-domain sites
Add --exclude-directories to skip folders
Modify --wait for rate limiting

Troubleshooting

Common Issues

1. "wget not found"

Solution: The tool auto-installs wget. If it fails:

Windows: Run as Administrator
macOS: Install Homebrew first
Linux: Use your package manager manually

2. "Permission denied"

Solution:

# On Linux/macOS
sudo npx clone-this-website https://example.com

# Or change output directory
npx clone-this-website https://example.com --output ~/my-site

3. "Website test failed"

Solution: Use force flag:

npx clone-this-website https://example.com --force

4. "Large sites timeout"

Solution: Use verbose mode to monitor:

npx clone-this-website https://example.com --verbose

Debug Mode

# Enable verbose output
npx clone-this-website https://example.com --verbose --skip-test

Examples

Clone a Documentation Site

npx clone-this-website https://docs.python.org --output python-docs

Clone with All Options

npx clone-this-website https://example.com \
  --output my-clone \
  --force \
  --verbose \
  --skip-test

Interactive Session

$ npx clone-this-website --interactive

╔══════════════════════════════════════════════════════════════╗
║                    WEBSITE CLONER PRO                        ║
║               Professional Cross-Platform Tool                ║
╚══════════════════════════════════════════════════════════════╝

🌐 Clone any website with ease and precision

? Enter website URL to clone: https://github.com
? Output directory name (optional): github-clone
? Skip website accessibility test? No
? Enable verbose output? Yes