Commit graph

3 commits

Author SHA1 Message Date
85717a7fac
feat: use flags to configure the crawler
- Use flags to configure the worker pool and the maximum number of
  pages.
- Add README.md
2024-08-27 17:11:47 +01:00
4519de764e
feat: add the web crawler
All checks were successful
Tests / test (pull_request) Successful in 13s
Add the source code for the web crawler. The web crawler is a simple Go
CLI application that traverses through a website and generates a report
of all the internal links found in the site.
2024-08-27 15:42:26 +01:00
5d447923b1 Initial commit 2024-08-26 10:30:14 +01:00