PRINT
PRINT
SEND MAIL
SEND MAIL

Category: Crawler

Debian

Cerberus Linux v3

  Cerberus Linux v3  Cerberus is a penetration testing distribution focusing on automation and anonymity , it aims to have the best tools available on the hacking scene tools like Fuzzbunch, Dandespritz, Cobalt strike, Armitage, Metasploit framework and Metasploit community version set up and ready for use!! It includes custom scripts, custom themes, custom icons!Cerberus distribution is based on Debian testing, it has the capability to use 3 repositories to install packages from kali repo,Debian repo, and cyber sec repo! Cerberus is an Angry…

Windows Hacking

Black Window 10 Enterprise

Black Window 10 Enterprise is the first windows based penetration testing distribution with linux integraded ! The system comes activated with a digital license for windows enterprise ! It supports windows apps and linux apps, gui and terminal apps! It comes with a tone off hacking tools plus all the tools that are included with the latest release of cerberus linux! It has managed to implement cerberus os within windows.Offers the stability of a windows system and it offers the hacking part with a…

CrawlerEKFiddleFiddlerMacNEW TOOLSPcapVirusTotalVPN

EKFiddle v.0.8.2 – A Framework Based On The Fiddler Web Debugger To Study Exploit Kits, Malvertising And Malicious Traffic In General

A framework based on the Fiddler web debugger to study Exploit Kits, malvertising and malicious traffic in general.InstallationDownload and install the latest version of Fiddlerhttps://www.telerik.com/fiddlerSpecial instructions for Linux and Mac here: C# scripting (Windows only)Launch Fiddler, and go to Tools -> OptionsIn the Scripting tab, change the default (JScript.NET) to C#.Change default text editor (optional)In the same Tools -> Options menu, click on the Tools tab.Windows: notepad.exe or notepad++.exeLinux: geditMac: /Applications/TextEdit.app or /Applications/TextWrangler.appClose FiddlerDownload or clone CustomRules.cs into the appropriate folder based on your…

CrawlerCrawlingInformation GatheringMacNEW TOOLSPhoton

Photon v1.1.4 – Incredibly Fast Crawler Designed For Recon

Incredibly Fast Crawler Designed For Recon.Key FeaturesData ExtractionPhoton can extract the following data while crawling:URLs (in-scope & out-of-scope)URLs with parameters (example.com/gallery.php?id=2)Intel (emails, social media accounts, amazon buckets etc.)Files (pdf, png, xml etc.)Secret keys (auth/API keys & hashes)JavaScript files & Endpoints present in themStrings matching custom regex patternSubdomains & DNS related dataThe extracted information is saved in an organized manner or can be exported as json.FlexibleControl timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff. The extensive range of options…

CrawlerEKFiddleFiddlerMacNEW TOOLSPcapVirusTotalVPNWeb

EKFiddle – A Framework Based On The Fiddler Web Debugger To Study Exploit Kits, Malvertising And Malicious Traffic In General

A framework based on the Fiddler web debugger to study Exploit Kits, malvertising and malicious traffic in general.InstallationDownload and install the latest version of Fiddlerhttps://www.telerik.com/fiddlerSpecial instructions for Linux and Mac here: C# scripting (Windows only)Launch Fiddler, and go to Tools -> OptionsIn the Scripting tab, change the default (JScript.NET) to C#.Change default text editor (optional)In the same Tools -> Options menu, click on the Tools tab.Windows: notepad.exe or notepad++.exeLinux: geditMac: /Applications/TextEdit.app or /Applications/TextWrangler.appClose FiddlerDownload or clone CustomRules.cs into the appropriate folder based on your…

AWS BuiltCrawlerCrawlingMacNEW TOOLSPhoton

Photon – Incredibly Fast Crawler Which Extracts Urls, Emails, Files, Website Accounts And Much More

Photon is a lightning fast web crawler which extracts URLs, files, intel & endpoints from a target.Yep, you can use 100 threads and Photon won't complain about it because its in Ninja Mode.Why Photon?Not Your Regular CrawlerCrawlers are supposed to recursively extract links right? Well that's kind of boring so Photon goes beyond that. It extracts the following information:URLs (in-scope & out-of-scope)URLs with parameters (example.com/gallery.php?id=2)Intel (emails, social media accounts, amazon buckets etc.)Files (pdf, png, xml etc.)JavaScript files & Endpoints present in themStrings based on…

Command LineCrawlerGNUNEW TOOLSNoisyPrivacy OnlineRasberrypiRaspberry PiTraffic GeneratorTraffic Inspection

Noisy – Simple Random DNS, HTTP/S Internet Traffic Noise Generator

A simple python script that generates random HTTP/DNS traffic noise in the background while you go about your regular web browsing, to make your web traffic data less valuable for selling and for extra obscurity.Tested on MacOS High Sierra, Ubuntu 16.04 and Raspbian Stretch and is compatable with both Python 2.7 and 3.6Getting StartedThese instructions will get you a copy of the project up and running on your local machineDependenciesInstall requests if you do not have it already installed, using pip:pip install requestsUsageClone the…

CrawlerDirectory ScannerDirhuntDirscannerGoMacNEW TOOLSSecurity ToolsWebWebsecWithout Bruteforce

Dirhunt – Find Web Directories Without Bruteforce

Dirhunt is a web crawler optimize for search and analyze directories. This tool can find interesting things if the server has the "index of" mode enabled. Dirhunt is also useful if the directory listing is not enabled. It detects directories with false 404 errors, directories where an empty index file has been created to hide things and much more.$ dirhunt does not use brute force. But neither is it just a crawler. This tool is faster than others because it minimizes requests to…

AWSCrawlerDiskoverDuplicate FilesElasticsearchFile IndexingFilesystem AnalysisFilesystem IndexerFilesystem VisualizationKibanaNEW TOOLSRedisSearch Engine

Diskover – File System Crawler, Storage Search Engine And Analytics Powered By Elasticsearch

diskover is an open source file system crawler and disk usage software that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organize files and system administrators are able to manage storage infrastructure, efficiently provision storage, monitor and report on storage use, and effectively make decisions about new infrastructure purchases.As the amount of file data generated by business' continues to expand, the stress on expensive storage infrastructure, users and system administrators, and…

CrawlerDirBusterNEW TOOLSPenCrawLerpenetration testingWebWeb Crawler

PenCrawLer – An Advanced Web Crawler And DirBuster

An Advanced Web Crawler and DirBuster PeNCrawLer is an advanced webcrawler and dirbuster designed to using in penetration testing based on Windows Os.Web Crawler Features:Follow RedirectsRendering JavascriptExtract links from custom HTML-ElementsExtract links with Regex-PatternBlack-List extentionsWhite-List extentionsDownlaod files from white-list extentionsSetting-Up limit for crawling similar linksSearching for string in:UrlResponseAutomatic Form SubmissionSupport Http-ProxySupported Authentication:BasicDigestThrottling modeDirBuster Features:Dictionary attackBruteforce attackCustom bruteforce charsetCustom request method:GET ONLYAuto-Switch( GET and HEAD )Recursive modeBruteforce directoriesBruteforce files with custom extentionsAutomatic page detection by:Failure status-codeSuccess status-codeRegex patternHTML sourceDownload PenCrawLer