1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Web Crawling / Spidering

Discussion in 'Ethical hacking' started by Aspen Colton, Apr 16, 2017.

  1. Aspen Colton

    Aspen Colton Member

    Joined:
    Apr 21, 2016
    Messages:
    42
    Likes Received:
    0
    Trophy Points:
    6
    How does web crawling/spidering works? I want to know if this will help in web scanning and hack prevention. Your input will be highly appreciated. Thanks.
     
  2. Dara Strayhorn

    Dara Strayhorn New Member

    Joined:
    Jul 8, 2016
    Messages:
    12
    Likes Received:
    1
    Trophy Points:
    3
    A web crawler is a program that most search engines use to find the latest on the Internet. Likewise, it is also a scanner to identify vulnerabilities and this also help to find the next threat.
     
    Aspen Colton likes this.
  3. Aspen Colton

    Aspen Colton Member

    Joined:
    Apr 21, 2016
    Messages:
    42
    Likes Received:
    0
    Trophy Points:
    6
    Thanks for your input. I'm still trying understand it better before I make any recommendation for our business use.
     
  4. Aspen Colton

    Aspen Colton Member

    Joined:
    Apr 21, 2016
    Messages:
    42
    Likes Received:
    0
    Trophy Points:
    6
    Hello! I'm just updating this thread to let you know that I've already found a good scanner. We're having it installed this week.
     
  5. priya456

    priya456 New Member

    Joined:
    Jul 7, 2017
    Messages:
    26
    Likes Received:
    2
    Trophy Points:
    3
    Gender:
    Female
    Web crawling can be a very complicated and technical subject to understand. Every web page on the Internet is different from the next, which means every web crawler is different from the next.
     

Share This Page