getallurls (gau)

Fetch known URLs from AlienVault's Open Threat Exchange, the Wayback Machine, and Common Crawl. Originally built as a microservice.

usage:

▻ printf 'example.com' | gau

or

▻ gau example.com

flags:

  -providers string
    	providers to fetch urls for (default "wayback,otx,commoncrawl")
  -retries uint
    	amount of retries for http client (default 5)
  -subs
    	include subdomains of target domain

install:

▻ go get -u github.com/lc/gau

or

▻ git clone https://github.com/lc/gau && cd gau
▻ go build -o $GOPATH/bin/gau main.go

Useful?