Shining light into the Dark Web
The success of the Silk Road has provoked the exponential growth of numerous "dark web" marketplaces, providing criminal enterprise a new form to sell illicit items.
Traditional web scraping methodologies and techniques have proven to be inept at unmasking how these individuals interact on such platforms that are comprised of overlay networks known as "darknets”, one of which being the popularly known Tor network.
This has left current law enforcement to adopt manual methods of processing the data, as existing tools do not return structured scraped data. Using several Nightmare marketplaces and forums as a case studies, this project implements standalone dark web scrapers in Java to collect the data, this project implements standalone dark web scrapers in Java to collect the data, which writes the results as documents to Elasticsearch for searching.
This information is parsed into Kibana to visualise the interactions between individuals as graphs, detecting risks and producing informative visualisations for law enforcement.
Securing our future
Clara Don-Nhu Chu