[webpages] Add historical extract stashing
All checks were successful
build / test (push) Successful in 1m50s
All checks were successful
build / test (push) Successful in 1m50s
This commit is contained in:
22
PROJECT.org
22
PROJECT.org
@ -88,7 +88,7 @@ fetching and simple saving.
|
||||
*** Metadata sources
|
||||
**** Scraper
|
||||
|
||||
* Backlog [1/21] :vrobbler:project:personal:
|
||||
* Backlog [2/22] :vrobbler:project:personal:
|
||||
** TODO [#C] Create small utility to clean up tracks scrobbled with wonky playback times :bug:music:scrobbles:
|
||||
:PROPERTIES:
|
||||
:ID: 702462cf-d54b-48c6-8a7c-78b8de751deb
|
||||
@ -594,6 +594,26 @@ named constants for maintainability.
|
||||
- ~vrobbler/apps/webpages/models.py~ (line 290) -- ="url"=
|
||||
- ~vrobbler/apps/scrobbles/importers/tsv.py~ (line 55) -- ="S"= completion status
|
||||
|
||||
** DONE [#B] Webpage scrobbles should diff existing webpages content :webpages:metadata:
|
||||
:PROPERTIES:
|
||||
:ID: 25576197-258f-48d6-bfe9-e4172a0a1898
|
||||
:END:
|
||||
|
||||
*** Description
|
||||
|
||||
Webpages change content between scrobbles. The current model stores the webpage content once, the
|
||||
first time it's scrobbled. When a page has been seen before, we should move the existing content
|
||||
to a new model HistoricalWebPage with the following fields:
|
||||
|
||||
webpage_id -> FK to WebPage
|
||||
date -> date from existing WebPage content
|
||||
domain -> same as existing WebPage content
|
||||
extract -> copy of existing WebPage content
|
||||
|
||||
Once the HistoricalWebPage instance is successfully created, the new extract data
|
||||
should be saved into the WebPage instance.
|
||||
|
||||
|
||||
** DONE [#B] Make ArchiveBox push asynchronous :archivebox:async:
|
||||
:PROPERTIES:
|
||||
:ID: 17c116a7-5952-db37-e56c-2987c2fc456b
|
||||
|
||||
Reference in New Issue
Block a user