Issues

• Proxy not working --proxy-server

  yujiosaka/headless-chrome-crawler#386 · Filter by author byposeidon opened on Jun 30, 2022

• How can i make customCrawl click on specific elements?

  yujiosaka/headless-chrome-crawler#384 · Filter by author michaelpapesch opened on Feb 21, 2022
  1

• i get a JSHandle@node string instead of a ElementHandle object

  yujiosaka/headless-chrome-crawler#382 · Filter by author jriffs opened on Feb 3, 2022

• subdomain crawl with "allowedDomains" parameter crawls top domain, too

  yujiosaka/headless-chrome-crawler#381 · Filter by author michaelpapesch opened on Nov 29, 2021

• Provide auth to page when using proxy

  yujiosaka/headless-chrome-crawler#378 · Filter by author tsrdatatech opened on Mar 12, 2021

• Is there a way to scroll?

  yujiosaka/headless-chrome-crawler#377 · Filter by author wemow opened on Jan 13, 2021
  4

• Crawling site with maxDepth > 2 causes hang

  yujiosaka/headless-chrome-crawler#376 · Filter by author TheTFo opened on Dec 18, 2020
  3

• Are links with empty href ignored? (button links handled by page js)

  yujiosaka/headless-chrome-crawler#373 · Filter by author YuriGor opened on Oct 16, 2020
  1

• Get current URL in customCrawl()

  feature
  yujiosaka/headless-chrome-crawler#364 · Filter by author popstas opened on Apr 27, 2020
  3

• preRequest function cuts the entire branch instead of a single page

  yujiosaka/headless-chrome-crawler#357 · Filter by author AleksandrBorkun opened on Nov 5, 2019

• Question: Handling of pdf files

  bug
  yujiosaka/headless-chrome-crawler#355 · Filter by author eladbitton opened on Sep 21, 2019
  1

• WebSocket is not open when 'maxrequestreached' event is reached

  bug
  yujiosaka/headless-chrome-crawler#349 · Filter by author LeMoussel opened on Jun 5, 2019
  1

• Error: Protocol error (Target.closeTarget): Target closed.

  bug
  yujiosaka/headless-chrome-crawler#344 · Filter by author yeekit-jewel opened on Mar 28, 2019
  3

• Pages with 403 errors not throwing errors

  feature
  yujiosaka/headless-chrome-crawler#343 · Filter by author mrispoli24 opened on Mar 18, 2019
  1

• Crawl stops on non-www URLs

  bug
  yujiosaka/headless-chrome-crawler#338 · Filter by author cosmiXs opened on Jan 9, 2019
  5

• How to handle the timeout error?

  feature
  yujiosaka/headless-chrome-crawler#336 · Filter by author gajus opened on Dec 25, 2018
  2

• Stuck for no reason?

  bug
  yujiosaka/headless-chrome-crawler#314 · Filter by author crapthings opened on Aug 31, 2018
  6

• duplicated url are crawled twice

  bug
  yujiosaka/headless-chrome-crawler#302 · Filter by author Minyar2004 opened on Jul 31, 2018
  6

• crawler listening new request url

  feature
  yujiosaka/headless-chrome-crawler#301 · Filter by author Minyar2004 opened on Jul 30, 2018
  1

• What is the intended method for re-enabling the Content-Security-Policy header?

  feature
  yujiosaka/headless-chrome-crawler#298 · Filter by author jamieweb opened on Jul 23, 2018
  1

• Queueing same url on multiple workers in cluster with Redis cache results in duplicates

  yujiosaka/headless-chrome-crawler#293 · Filter by author lioreshai opened on Jul 12, 2018
  4

• Suggestion: robots.txt shouldn't be reparsed every time

  feature
  yujiosaka/headless-chrome-crawler#198 · Filter by author panthony opened on Apr 4, 2018

• Crawler should honor the Crawl-Delay if obeyRobotsTxt:true

  feature
  yujiosaka/headless-chrome-crawler#194 · Filter by author panthony opened on Apr 3, 2018
  2

• You should be able to provides the robots.txt

  feature
  yujiosaka/headless-chrome-crawler#192 · Filter by author panthony opened on Apr 2, 2018

• Suggestion: Collect links should be extendable and/or have more infos than their URL

  feature
  yujiosaka/headless-chrome-crawler#191 · Filter by author panthony opened on Mar 31, 2018
  1