diff options
| author | Dmitry Ilvokhin <d@ilvokhin.com> | 2025-02-23 16:20:33 +0000 |
|---|---|---|
| committer | Dmitry Ilvokhin <d@ilvokhin.com> | 2025-02-25 22:53:01 +0000 |
| commit | 602dcb4ec617634d1fed182ac0309123992e43c6 (patch) | |
| tree | 15010ddf47bf45c85bf6e5dbc0093bbb78eb3a92 /TODO.txt | |
| download | flatbot-602dcb4ec617634d1fed182ac0309123992e43c6.tar.gz flatbot-602dcb4ec617634d1fed182ac0309123992e43c6.tar.bz2 flatbot-602dcb4ec617634d1fed182ac0309123992e43c6.zip | |
Implement URL fetching and page parsing
Diffstat (limited to 'TODO.txt')
| -rw-r--r-- | TODO.txt | 20 |
1 files changed, 20 insertions, 0 deletions
diff --git a/TODO.txt b/TODO.txt new file mode 100644 index 0000000..1cf6e0e --- /dev/null +++ b/TODO.txt @@ -0,0 +1,20 @@ +TODO + + +* Input is URL/URLs for rightmove search. URL/URLs are passed as positional + arguments to main binary. Same way as for curl or wget tools. +* Binary can run forever or just once (--once option). +* There is an --interval option to control fetch frequency. +* After each iteration binary will dump "seen" set as a JSON. +* Option to specify a path to seen list file. + + +GENERAL ALGORITHM + +* Fetch URL. +* Parse flats into slice of structs. +* Remove already seen flats. +* Send new flats to telegram. One message per each flat? +* Add new flats to seen list. +* Remove out of retention flats from seen list to prevent it from growing + indefinitely. |