web-crawler

5 commits 1 branch 0 tags 102 KiB

Author	SHA1	Message	Date
Dan Anglin	5498ac7b4e	feat: add external links to the report All checks were successful Tests / test (pull_request) Successful in 15s Details	2024-08-28 07:39:24 +01:00
Dan Anglin	0619c950f5	ci: use remote mage-ci action All checks were successful Tests / test (pull_request) Successful in 17s Details	2024-08-27 18:52:43 +01:00
Dan Anglin	85717a7fac	feat: use flags to configure the crawler - Use flags to configure the worker pool and the maximum number of pages. - Add README.md	2024-08-27 17:11:47 +01:00
Dan Anglin	4519de764e	feat: add the web crawler All checks were successful Tests / test (pull_request) Successful in 13s Details Add the source code for the web crawler. The web crawler is a simple Go CLI application that traverses through a website and generates a report of all the internal links found in the site.	2024-08-27 15:42:26 +01:00
Dan Anglin	5d447923b1	Initial commit	2024-08-26 10:30:14 +01:00