There is a website that disallowed pages with robots.txt. So I need to find and access to these hidden pages. You CANNOT find these pages with screaming frog or with site:, inurl: techniques.
No access from from main page. So, I need something that gonna find these hidden pages.