PRINT
PRINT
SEND MAIL
SEND MAIL

Category: Crawler

TUTORIALS

Earn Bitcoins just by surfing Online !

Use CryptoTab as your default browser to maximize your revenue Mining speed increases when your browser is active. Use CryptoTab browser for your everyday activities, visit your favorite sites, watch movies online, and take advantage of maximum mining power. Browser with built-in mining CryptoTab Browser includes built-in mining algorithm that allows using your computer resources more effectively than in extension format. It boosts your mining speed up to 8 times and increases BTC earnings. Enhance your browser with over 150 thousand extensions Set up…

TUTORIALS

Cerberus Linux v1 Subsystem for Windows 10!

Cerberus Linux subsystem is Linux to run on top windows! like the picture bellow^^^ Cerberus linux v1 tools and extras : 15 new Cerberus Frameworks : Metapackages , containers with custom scripts within! Exploits (to analyze): EARLYSHOVEL RedHat 7.0 – 7.1 Sendmail 8.11.x exploit EBBISLAND (EBBSHAVE) root RCE via RPC XDR overflow in Solaris 6, 7, 8, 9 & 10 (possibly newer) both SPARC and x86. ECHOWRECKER remote Samba 3.0.x Linux exploit. EASYBEE appears to be an MDaemon email server vulnerability EASYFUN EasyFun 2.2.0 Exploit for WDaemon…

Windows10

Black Window 10 v2

  Black Window Enterprise 10 Codename : Polemos Black Window 10 Enterprise is the first windows based penetration testing distribution with Linux integrated ! The system comes activated with a digital license for Windows enterprise! It supports windows apps and Linux apps, GUI and terminal apps! It comes with a tone off hacking tools plus all the tools that are included with the latest release of Cerberus Linux! It has managed to implement Cerberus os within windows. Offers the stability of a windows system…

Debian

Cerberus Linux v3

  Cerberus Linux v3  Cerberus is a penetration testing distribution focusing on automation and anonymity , it aims to have the best tools available on the hacking scene tools like Fuzzbunch, Dandespritz, Cobalt strike, Armitage, Metasploit framework and Metasploit community version set up and ready for use!! It includes custom scripts, custom themes, custom icons!Cerberus distribution is based on Debian testing, it has the capability to use 3 repositories to install packages from kali repo,Debian repo, and cyber sec repo! Cerberus is an Angry…

ACHECrawlerCrawlingDiscoverDomain Specific SearchElasticsearchFocused CrawlerHidden ServicesNEW TOOLSTORWeb CrawlerWeb ScrapingWeb SearchWeb Spider

ACHE – A Web Crawler For Domain-Specific Search

ACHE is a focused web crawler. It collects web pages that satisfy some specific criteria, e.g., pages that belong to a given domain or that contain a user-specified pattern. ACHE differs from generic crawlers in sense that it uses page classifiers to distinguish between relevant and irrelevant pages in a given domain. A page classifier can be from a simple regular expression (that matches every page that contains a specific word, for example), to a machine-learning based classification model. ACHE can also automatically learn…

CrawlerDirhuntDirscannerMacNEW TOOLSProcessesSecurity ToolsVirusTotalWebWebsecWithout Bruteforce

Dirhunt v0.6.0 – Find Web Directories Without Bruteforce

DEVELOPMENT BRANCH: The current branch is a development version. Go to the stable release by clicking on the master branch.Dirhunt is a web crawler optimize for search and analyze directories. This tool can find interesting things if the server has the "index of" mode enabled. Dirhunt is also useful if the directory listing is not enabled. It detects directories with false 404 errors, directories where an empty index file has been created to hide things and much more.$ dirhunt does not use brute…

CrawlerEKFiddleFiddlerMacNEW TOOLSPcapVirusTotalVPN

EKFiddle v.0.8.2 – A Framework Based On The Fiddler Web Debugger To Study Exploit Kits, Malvertising And Malicious Traffic In General

A framework based on the Fiddler web debugger to study Exploit Kits, malvertising and malicious traffic in general.InstallationDownload and install the latest version of Fiddlerhttps://www.telerik.com/fiddlerSpecial instructions for Linux and Mac here: C# scripting (Windows only)Launch Fiddler, and go to Tools -> OptionsIn the Scripting tab, change the default (JScript.NET) to C#.Change default text editor (optional)In the same Tools -> Options menu, click on the Tools tab.Windows: notepad.exe or notepad++.exeLinux: geditMac: /Applications/TextEdit.app or /Applications/TextWrangler.appClose FiddlerDownload or clone CustomRules.cs into the appropriate folder based on your…

CrawlerCrawlingInformation GatheringMacNEW TOOLSPhoton

Photon v1.1.4 – Incredibly Fast Crawler Designed For Recon

Incredibly Fast Crawler Designed For Recon.Key FeaturesData ExtractionPhoton can extract the following data while crawling:URLs (in-scope & out-of-scope)URLs with parameters (example.com/gallery.php?id=2)Intel (emails, social media accounts, amazon buckets etc.)Files (pdf, png, xml etc.)Secret keys (auth/API keys & hashes)JavaScript files & Endpoints present in themStrings matching custom regex patternSubdomains & DNS related dataThe extracted information is saved in an organized manner or can be exported as json.FlexibleControl timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff. The extensive range of options…

CrawlerEKFiddleFiddlerMacNEW TOOLSPcapVirusTotalVPNWeb

EKFiddle – A Framework Based On The Fiddler Web Debugger To Study Exploit Kits, Malvertising And Malicious Traffic In General

A framework based on the Fiddler web debugger to study Exploit Kits, malvertising and malicious traffic in general.InstallationDownload and install the latest version of Fiddlerhttps://www.telerik.com/fiddlerSpecial instructions for Linux and Mac here: C# scripting (Windows only)Launch Fiddler, and go to Tools -> OptionsIn the Scripting tab, change the default (JScript.NET) to C#.Change default text editor (optional)In the same Tools -> Options menu, click on the Tools tab.Windows: notepad.exe or notepad++.exeLinux: geditMac: /Applications/TextEdit.app or /Applications/TextWrangler.appClose FiddlerDownload or clone CustomRules.cs into the appropriate folder based on your…

AWS BuiltCrawlerCrawlingMacNEW TOOLSPhoton

Photon – Incredibly Fast Crawler Which Extracts Urls, Emails, Files, Website Accounts And Much More

Photon is a lightning fast web crawler which extracts URLs, files, intel & endpoints from a target.Yep, you can use 100 threads and Photon won't complain about it because its in Ninja Mode.Why Photon?Not Your Regular CrawlerCrawlers are supposed to recursively extract links right? Well that's kind of boring so Photon goes beyond that. It extracts the following information:URLs (in-scope & out-of-scope)URLs with parameters (example.com/gallery.php?id=2)Intel (emails, social media accounts, amazon buckets etc.)Files (pdf, png, xml etc.)JavaScript files & Endpoints present in themStrings based on…

Command LineCrawlerGNUNEW TOOLSNoisyPrivacy OnlineRasberrypiRaspberry PiTraffic GeneratorTraffic Inspection

Noisy – Simple Random DNS, HTTP/S Internet Traffic Noise Generator

A simple python script that generates random HTTP/DNS traffic noise in the background while you go about your regular web browsing, to make your web traffic data less valuable for selling and for extra obscurity.Tested on MacOS High Sierra, Ubuntu 16.04 and Raspbian Stretch and is compatable with both Python 2.7 and 3.6Getting StartedThese instructions will get you a copy of the project up and running on your local machineDependenciesInstall requests if you do not have it already installed, using pip:pip install requestsUsageClone the…

CrawlerDirectory ScannerDirhuntDirscannerGoMacNEW TOOLSSecurity ToolsWebWebsecWithout Bruteforce

Dirhunt – Find Web Directories Without Bruteforce

Dirhunt is a web crawler optimize for search and analyze directories. This tool can find interesting things if the server has the "index of" mode enabled. Dirhunt is also useful if the directory listing is not enabled. It detects directories with false 404 errors, directories where an empty index file has been created to hide things and much more.$ dirhunt does not use brute force. But neither is it just a crawler. This tool is faster than others because it minimizes requests to…

AWSCrawlerDiskoverDuplicate FilesElasticsearchFile IndexingFilesystem AnalysisFilesystem IndexerFilesystem VisualizationKibanaNEW TOOLSRedisSearch Engine

Diskover – File System Crawler, Storage Search Engine And Analytics Powered By Elasticsearch

diskover is an open source file system crawler and disk usage software that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organize files and system administrators are able to manage storage infrastructure, efficiently provision storage, monitor and report on storage use, and effectively make decisions about new infrastructure purchases.As the amount of file data generated by business' continues to expand, the stress on expensive storage infrastructure, users and system administrators, and…