There are no tricks or hidden agendas. The purpose of this exercise is for you to demonstrate your technical knowledge, reasoning, and engineering practices using current software development ...
javascript-webcrawler is a JavaScript web crawler for collecting links. javascript-webcrawler is in it's alpha stage. Though there is room for improvement, it works right out of the box.