clothing_search_engine.crawler
Class Crawler

java.lang.Object
  extended by clothing_search_engine.crawler.Crawler

public class Crawler
extends java.lang.Object

Author:
Sara Network Crawler

Constructor Summary
Crawler(java.lang.String m_domain, java.lang.String m_range, java.lang.String m_url_reg_expression)
          Constructor - initialize data structures and set domain, etc..
 
Method Summary
 boolean crawl(java.net.URL starting_url, int degree)
          Crawl the page of the current url.
static void main(java.lang.String[] args)
          main
 void printNodes()
          Print all the nodes
 
Methods inherited from class java.lang.Object
equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

Crawler

public Crawler(java.lang.String m_domain,
               java.lang.String m_range,
               java.lang.String m_url_reg_expression)
Constructor - initialize data structures and set domain, etc..

Parameters:
m_domain - domain of website
m_range - regular expression of range of page
m_url_reg_expression - regular expression for url's attempting to find
Method Detail

crawl

public boolean crawl(java.net.URL starting_url,
                     int degree)
Crawl the page of the current url. Extract url's on that page and then crawl them.

Parameters:
starting_url - url to start crawl from
degree - number of degrees to crawl
Returns:
return true upon succes

printNodes

public void printNodes()
Print all the nodes


main

public static void main(java.lang.String[] args)
main

Parameters:
args -