Multithreaded Internet Crawler

  • Mines and queues webpage links for continous crawling
  • Records links to already mined pages. Calculate most linked pages in the dataset.
  • Technologies: JavaSE, JDBC, PostgreSQL
  • Source