Version 2.0

🚀 New Features & Enhancements

🔥 Performance & Scalability Improvements

• Fully asynchronous architecture using aiohttp for non-blocking HTTP requests.
• Parallel sitemap parsing for faster URL discovery and processing.
• Connection pooling & request batching for optimal network efficiency.

🎯 Improved Web Scraping & Phrase Matching

• Recursive sitemap discovery to identify hidden URLs.
• Optimized HTML parsing via BeautifulSoup for accurate text extraction.
• Regex-based phrase matching (optional) for flexible scanning.
• Case-insensitive search for more robust results.

🛡️ Security & Error Handling

• Robust exception handling with structured logging and retry logic.
• Automatic exponential backoff for transient network failures.
• Defused XML parsing for enhanced security.

📊 Better Data Output & Storage Options

• Support for multiple output formats: TXT, JSON, CSV.
• Efficient file I/O operations to minimize disk usage.
• Real-time progress tracking via tqdm.

🛠️ Configurability & User Experience

• Command-line options for flexible scanning (--regex, --concurrency, --output, --timeout).
• Automatic domain protocol detection (HTTPS preferred, fallback to HTTP).
• Verbose logging mode (--debug) for better troubleshooting.

📝 Known Issues

• Some highly dynamic sites may block rapid requests; consider rate limiting.
• Regex-based phrase search may impact performance on large pages.

Version 1.1 (Hotfix)

• Added parameters to method signature to fix "Method has no argument" error.

Version 1.0

New Features

• Internet Connectivity Check: The script now checks for internet availability before starting the scan and reports the status.
• Domain Validation: The script verifies the domain can be resolved to an IP address. It also automatically determines whether to use HTTP or HTTPS, falling back to HTTP if no valid SSL certificate is found.
• Logging and Debugging: Added color-coded logging and warnings for better clarity during scanning. You can customize this via the DEBUG and WARNINGS variables.
• Structured Class: The functionality is organized into a Tracebound class for better code structure.

Changes

• Removed Threadpooling: Threadpooling has been removed in this version, possibly to be re-introduced in a future update.

Improvements

• Error Reporting: The script provides more informative error messages, such as when unable to parse a sitemap or access a page.
• Usability: User prompts guide the process of providing a domain and search phrase.

Version 1.0 Beta

This release focuses on code maintenance and security:

• Removed unused variable to improve code clarity.
• Replaced standard XML parsing with defusedxml.ElementTree to mitigate XML-based attack vectors.
• Fixed function containing unused arguments.
• Included requirements.txt for clear and efficient dependency handling.

Version 1.0 Alpha

• Initial Release