v1.3.2-stable

ADDED

1. Added colorful icons in HTML report

CHANGED

1. Reworked menus style with rich library
2. Reworked scan progress bar with rich library
3. Fixed wrong spaces between menus and prompts in CLI
4. Fixed security issues with urllib3 library

v1.3.1-stable

ADDED

1. Added modern (now default) report template
2. Added config values support for HTML template selection
3. Added report printing functionality (only in modern report)
4. Added "General statistics" and diagram in modern HTML report
5. Added "Show/Hide ToC" button in modern HTML report
6. Added reading progress bar in modern HTML report
7. Added "Website technical files" paragraph in modern HMTL report (contains sitemap.xml, links and robots.txt)
8. Added reports comparison functionality in modern HTML report
9. Added context help functionality in modern HTML report
10. Added deleting website technical files text copies functionality in config file
11. Added separate columns for listings in modern HTML report
12. Added undetected_chromedriver requirement

DELETED

1. Deleted compromise, paragraph and monospaced HTML report templates

CHANGED

1. Renamed default report template into legacy
2. Cleaned up imports
3. Bumped requests required version to 2.32.4 (fixed security issue)

v1.3 - Snapshotting update

Introduction of Snapshotting

Snapshotting is an important method in OSINT used to preserve and document online content. It allows investigators to capture and save a webpage or its data at a specific point in time, which is crucial for verifying information and tracking changes over time. There are three snapshotting methods which were added in DPULSE with v1.3 release:

• Screenshot snapshotting: taking a picture of how a webpage looks visually, which provides a quick and clear record of the website’s appearance at a specific moment.
• HTML snapshotting: saving the webpage’s source code as HTML file, which allows detailed analysis of the content, structure, and embedded data, and helps detect any modifications.
• Wayback Machine snapshotting: using the Wayback Archive to access and save past versions of a website which is useful for viewing a site’s history, especially if the site has been changed or taken down.

These methods make DPULSE more complex in domain OSINT field, providing investigator with the means of proves capturing and changes detection.

Cleaning up

DPULSE is not ideal tool even after 30 different releases. That's what usually happens with open-source tool developed by only one person. I just want to say that polishing continues: during the work on version 1.3 I cleaned up lots of code, optimized performance, removed redundant modules and so on. In this regard, I want to say that v1.4 release won't contain any new OSINT features, but it will contain a lot of QoL updates. Stay tuned!

v1.2.3-stable

ADDED

1. Added Wayback Machine snapshotting
2. Added some functions and config values to work with Wayback Machine snapshotting
3. Added some new styles for HTML reports
4. Added new fields in config file to change HTML report styles

v1.2.2-stable

ADDED

1. Added steps counter for basic scan
2. Added counter for received and accessed subdomains
3. Reactivated XLSX report selection
4. Added system requirements in ReadTheDocs page

DELETED

1. Temporarily removed API scan results insertion in XLSX report
2. Removed pagesearch_keyword variable usage in HTML report
3. Removed transfer of unused variables into reporting functions
4. Removed some redundant imports
5. Removed redundant pagesearch_main module

CHANGED

1. Done some code clean up
2. Fixed wrong code (tried to join short_domain string)
3. Simplified logic of used API flag insertion in report_storage.db
4. Bumped version for required Jinja2 (security issue)
5. Clarified valid and tested Python versions in pyproject.toml
6. Minor CLI visual changes
7. Cleaned-up redundant requirements
8. Updated XLSX report with new content
9. Corrected installation ways in ReadTheDocs

v1.2.1-stable

ADDED

1. Added support of HudsonRock API. It doesn't require a key, so you can give it a try!
2. Added domain's main page snapshotting (with screenshot)
3. Added domain's main page snapshotting (by making HTML copy of domain's main page)
4. Added config parameters for selenium snapshotting setups
5. Added selenium and webdriver-manager requirements
6. Significantly widened amount of results returned from VirusTotal API

DELETED

1. Removed PageSearch Sitemap Inspection module

CHANGED

1. Fixed "dirty API key" problem for SecurityTrails API and VirusTotal API (API keys transfered with invisible symbols from SQLite DB)
2. Temporarily disabled XLSX reporting module
3. Unified returns from SecurityTrails API and VirusTotal API in individual variables
4. Significantly changed visual design for API reports in DPULSE CLI

v1.2 - API & Dorking update

Dorking mode rework

As you may remember, Google Dorking automatization was implemented in DPULSE for a long time. It was a very simple concept solution that only proved the functionality of this method. Since v1.1 this concept has been expanded into a working solution that offers much better interaction during investigation process. However, work on this mode is not finished and will continue in the future.

API integration

There are many third-party APIs that are useful in OSINT research. In order to simplify the process of their use it was decided to integrate several APIs (VirusTotal and SecurityTrails) directly into DPULSE with local API keys database. However, similar to Google Dorking mode, work on the more APIs integration will continue in the future.

PDF reports deprecation

Working with PDF reports in Python did not meet expectations. It requires a lot of effort in code development when it comes to appearance customization or supporting different encodings or languages. Therefore, it was decided to deprecate PDF reports, which were replaced by a more convenient and easier to support HTML reports.

ReadTheDocs documentation

High-quality and accurate documentation is one of the key factors in future development of open-source project. That's why Readthedocs documentation page was created. It is already filled with the basic details about the DPULSE, but during DPULSE development and updating process this page will be expanded.

v1.1.6-stable

ADDED

1. Added XLSX and HTML report examples

DELETED

1. Removed warning about deprecated PDF report

CHANGED

1. Changed XLSX report content in order to replicate HTML report content
2. Unified data_array content both for XLSX and HTML reports
3. Extended bad emails clean-up support for scans without PageSearch
4. Improved handling of API results returning in XLSX report
5. Fixed error when selecting only 1 API to scan crashes program entirely
6. Extended column sizes for some XLSX sheets
7. Updated Jinja2 required version to 3.1.5+ in order to fix security issue
8. Fixed wrong cosmetical wrap for not found SSL certificate info
9. Some code clean up

v1.1.5-stable

ADDED

1. Added keywords_list None value if PageSearch was not selected
2. Added proxifier.py to handle proxies gathering for Google Dorking
3. Added user-agents list support for config generator
4. Added user-agents rotation support
5. Added CLI output for user-agent changing
6. Added X.com links parsing support
7. Extended Twitter links paragraph with X.com links in HTML report
8. Added new paragraph for proxies file path
9. Added code to handle proxies usage
10. Added support of VirusTotal API and SecurityTrails API scans reporting

CHANGED

1. Moved Google Dorking DB related functions to db_creator.py
2. Modified color scheme for dorking results output
3. Corrected local imports names
4. HTML report cosmetical improvements (PS and SI)
5. Cosmetical update for N/A organization name filler
6. Some code clean-up and CLI cosmetical improvements

v1.1.4-stable

ADDED

1. Added Table of Contents in HTML report
2. Added paragraph separators in HTML report
3. Added PageSearch paragraphs in HTML report
4. Added Dorking results paragraph in HTML report
5. Added used API flag transfer to Report Storage DB
6. Added API scan status to show in Report Storage DB CLI Inspector
7. Added dorking_results.txt file removal after creating HTML report. You won't see this file anymore

DELETED

1. Deleted choice for PDF report creation. Forever
2. Removed deprecated HTML report templates
3. Removed PDF report handling functions and modules
4. Removed xhtml2pdf requirement
5. Removed empty line in basic_dorking.db
6. Removed some double imports

CHANGED

1. Rewritten "None" dorking mark to "N" when starting a scan
2. Fixed bug with wrong api_scan_db handling in XLSX report
3. Improved config editing exception hanling
4. Fixed some typos
5. Unified report creation calling function, so there'll be no more duplication of code
6. Fixed long spaces between some string and menus in some places
7. Adapted XLSX report for unified report creation function