From 602dcb4ec617634d1fed182ac0309123992e43c6 Mon Sep 17 00:00:00 2001 From: Dmitry Ilvokhin Date: Sun, 23 Feb 2025 16:20:33 +0000 Subject: Implement URL fetching and page parsing --- TODO.txt | 20 ++++++++++++++++++++ 1 file changed, 20 insertions(+) create mode 100644 TODO.txt (limited to 'TODO.txt') diff --git a/TODO.txt b/TODO.txt new file mode 100644 index 0000000..1cf6e0e --- /dev/null +++ b/TODO.txt @@ -0,0 +1,20 @@ +TODO + + +* Input is URL/URLs for rightmove search. URL/URLs are passed as positional + arguments to main binary. Same way as for curl or wget tools. +* Binary can run forever or just once (--once option). +* There is an --interval option to control fetch frequency. +* After each iteration binary will dump "seen" set as a JSON. +* Option to specify a path to seen list file. + + +GENERAL ALGORITHM + +* Fetch URL. +* Parse flats into slice of structs. +* Remove already seen flats. +* Send new flats to telegram. One message per each flat? +* Add new flats to seen list. +* Remove out of retention flats from seen list to prevent it from growing + indefinitely. -- cgit v1.2.3-70-g09d2