Dan Anglin 85717a7fac feat: use flags to configure the crawler ... - Use flags to configure the worker pool and the maximum number of pages. - Add README.md		2024-08-27 17:11:47 +01:00
..
crawler.go	feat: use flags to configure the crawler	2024-08-27 17:11:47 +01:00
crawler_test.go	feat: add the web crawler	2024-08-27 15:42:26 +01:00
gethtml.go	feat: add the web crawler	2024-08-27 15:42:26 +01:00