Dan Anglin dananglin · he/him
dananglin deleted branch wip from apollo/web-crawler 2024-08-27 18:56:01 +01:00
dananglin deleted branch use-remote-action from apollo/web-crawler 2024-08-27 18:55:48 +01:00
dananglin merged pull request apollo/web-crawler#2 2024-08-27 18:55:23 +01:00
ci: use remote mage-ci action
dananglin pushed to main at apollo/web-crawler 2024-08-27 18:55:21 +01:00
0619c950f5 ci: use remote mage-ci action
dananglin created pull request apollo/web-crawler#2 2024-08-27 18:53:26 +01:00
ci: use remote mage-ci action
dananglin created branch use-remote-action in apollo/web-crawler 2024-08-27 18:52:53 +01:00
dananglin pushed to use-remote-action at apollo/web-crawler 2024-08-27 18:52:53 +01:00
0619c950f5 ci: use remote mage-ci action
dananglin pushed to main at apollo/web-crawler 2024-08-27 17:14:17 +01:00
85717a7fac feat: use flags to configure the crawler
dananglin merged pull request apollo/web-crawler#1 2024-08-27 15:44:15 +01:00
feat: add the web crawler
dananglin pushed to main at apollo/web-crawler 2024-08-27 15:44:13 +01:00
4519de764e feat: add the web crawler
dananglin pushed to wip at apollo/web-crawler 2024-08-27 15:43:08 +01:00
4519de764e feat: add the web crawler
dananglin pushed to wip at apollo/web-crawler 2024-08-27 15:29:54 +01:00
c4651509d5 fixed test; removed duplicate workflow
dananglin pushed to wip at apollo/web-crawler 2024-08-27 15:23:55 +01:00
247a7376b6 ci: trigger workflow
dananglin created pull request apollo/web-crawler#1 2024-08-27 15:21:14 +01:00
feat: add the web crawler
dananglin pushed to wip at apollo/web-crawler 2024-08-27 15:19:36 +01:00
d4633344f7 feat: add the web crawler
dananglin pushed to wip at apollo/web-crawler 2024-08-27 13:45:36 +01:00
9efb2102d8 checkpoint: add configurable max pages and max concurrency settings
dananglin pushed to wip at apollo/web-crawler 2024-08-27 13:11:30 +01:00
a8a7bcaced fixed .gitignore; added concurrency
dananglin pushed to wip at apollo/web-crawler 2024-08-27 11:53:21 +01:00
b76aeba7b5 add LICENSE
dananglin pushed to wip at apollo/web-crawler 2024-08-27 11:48:00 +01:00
14dd76d25c checkpoint: a bit of project restructuring
dananglin pushed to wip at apollo/web-crawler 2024-08-27 07:38:47 +01:00
1d493e80c7 checkpoint: can now crawl a website