secstate/vrobbler
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
a70343d6f3b636eb92c4079c4b0824467f08e73e
vrobbler/PROJECT.org
Colin Powell a70343d6f3
Some checks failed
build / test (push) Successful in 1m56s
Details
deploy / test (push) Successful in 1m58s
Details
deploy / build-and-deploy (push) Failing after 34s
Details
[release] Bump to version 41.0 
- For any scrobble detail page with notes display them better
- Imports should send notifications
- Board game imports send duplicate ntfy message
- Too many geolocation notifications go out
- Fix bug where Weigh-in imports do not set title
2026-06-04 11:22:48 -04:00

69 KiB
Raw Blame History

Vrobbler Project

We should convert this PROJECT file to put tickets in a subdirectory, tickets, with each ticket having it's own shortid_title.org

Overview

Vrobbler began humbly enough as a way to use Jellyfin's webhook to keep track of the shows and movies I was watching. More specifically, I broke my ankle a few days after Christmas in 2022 and spent the next four months very slowly recovering after surgical repair. So once I had the webhook working, and scrobbling videos, it was only a matter of time till I expaned it to mopidy to replicate LastFM. Then I added board games, books via KoReader, sports events, podcasts … it just keeps going. Vrobbler is now a sort of Frankenstein's monster of scrobbling an entire life.

I am still unconvinced I can keep this going, but being able to scrobble org tasks, Todoist tasks, web pages I've read and trails I've hiked has turned out to be sometimes cathartic and sometimes functional as I try to remember when I did a thing.

Features

Beer

Triggers

Bookmarklet
Manual

Metadata sources

Untappd

Book

Triggers

Webdav via KoReader
Manual

Metadata sources

Google Books

This is the preferred method at this time. Also, the Book model implements a `find_or_create` classmethod which is an example of an interface we can use for other data models to get metadata in a way that provides easy testing, bulk fetching and simple saving.

OpenLibrary
ComicVine

Board Game

Triggers

IMAP import
Bookmarklet
Manual

Location

Triggers

GPSLogger (Android)

Metadata sources

User input

Music

Triggers

Last.FM
Rockbox files
Mopidy
Jellyfin

Metadata sources

Musicbrainz

Podcast

Triggers

Mopidy

Metadata sources

Google Podcasts
PodcastIndex

Sport

Triggers

Bookmarklet
Manual

Metadata sources

Thes Sports DB

Task

Triggers

Todoist
Org-mode

Metadata sources

User profile

Trails

Video

Triggers

Jellyfin
Bookmarklet
Manual

Metadata sources

IMDB
Youtube

Web Page

Triggers

Bookmarklet

Metadata sources

Scraper

Chores

DONE Document various vrobbler features   chore personal project vrobbler documentation

CLOCK: [2025-07-09 Wed 09:55]–[2025-07-09 Wed 10:15] => 0:20

Backlog [0/14]   vrobbler project personal

TODO [C] Add sentiment parsing for Scrobbles with notes   vrobbler project scrobbles sentiment

TODO [C] Create small utility to clean up tracks scrobbled with wonky playback times   vrobbler personal bug music scrobbles

TODO [C] Move to using more robust mopidy-webhooks pacakge form pypi   utility improvement

Example payloads from mopidy-webhooks

Podcast playback ended 
{
    "type": "event",
    "event": "track_playback_ended",
    "data": {
        "tl_track": {
            "__model__": "TlTrack",
            "tlid": 13,
            "track": {
                "__model__": "Track",
                "uri": "file:///var/lib/mopidy/media/podcasts/The%20Prince/2022-09-28-Wolf-warriors.mp3",
                "name": "Wolf warriors",
                "artists": [
                    {
                        "__model__": "Artist",
                        "name": "The Economist"
                    }
                ],
                "album": {
                    "__model__": "Album",
                    "name": "The Prince",
                    "date": "2022"
                },
                "genre": "Blues",
                "date": "2022",
                "length": 2437778,
                "bitrate": 127988
            }
        },
        "time_position": 3290
    }
}
Podcast playback state changes 
{
    "type": "event",
    "event": "playback_state_changed",
    "data": {
        "old_state": "paused",
        "new_state": "playing"
    }
}
{
    "type": "event",
    "event": "playback_state_changed",
    "data": {
        "old_state": "stopped",
        "new_state": "playing"
    }
}
Podcast playback started 
{
    "type": "event",
    "event": "track_playback_started",
    "data": {
        "tl_track": {
            "__model__": "TlTrack",
            "tlid": 13,
            "track": {
                "__model__": "Track",
                "uri": "file:///var/lib/mopidy/media/podcasts/The%20Prince/2022-09-28-Wolf-warriors.mp3",
                "name": "Wolf warriors",
                "artists": [
                    {
                        "__model__": "Artist",
                        "name": "The Economist"
                    }
                ],
                "album": {
                    "__model__": "Album",
                    "name": "The Prince",
                    "date": "2022"
                },
                "genre": "Blues",
                "date": "2022",
                "length": 2437778,
                "bitrate": 127988
            }
        }
    }
}
Podcast playback paused 
{
    "type": "status",
    "data": {
        "state": "paused",
        "current_track": {
            "__model__": "Track",
            "uri": "file:///var/lib/mopidy/media/podcasts/The%20Prince/2022-09-28-Wolf-warriors.mp3",
            "name": "Wolf warriors",
            "artists": [
                {
                    "__model__": "Artist",
                    "name": "The Economist"
                }
            ],
            "album": {
                "__model__": "Album",
                "name": "The Prince",
                "date": "2022"
            },
            "genre": "Blues",
            "date": "2022",
            "length": 2437778,
            "bitrate": 127988
        },
        "time_position": 2350
    }
}
Track playback started 
{
    "type": "event",
    "event": "track_playback_started",
    "data": {
        "tl_track": {
            "__model__": "TlTrack",
            "tlid": 14,
            "track": {
                "__model__": "Track",
                "uri": "local:track:Various%20Artists%20-%202008%20-%20Twilight%20OST/01-muse-supermassive_black_hole.mp3",
                "name": "Supermassive Black Hole",
                "artists": [
                    {
                        "__model__": "Artist",
                        "uri": "local:artist:md5:250dd6551b66a58a6b4897aa697f200c",
                        "name": "Muse",
                        "musicbrainz_id": "9c9f1380-2516-4fc9-a3e6-f9f61941d090"
                    }
                ],
                "album": {
                    "__model__": "Album",
                    "uri": "local:album:md5:455343d54cdd89cb5a3b5ad537ea99d0",
                    "name": "Twilight: Original Motion Picture Soundtrack",
                    "artists": [
                        {
                            "__model__": "Artist",
                            "uri": "local:artist:md5:54e4db2d5624f80b0cc290346e696756",
                            "name": "Various Artists",
                            "musicbrainz_id": "89ad4ac3-39f7-470e-963a-56509c546377"
                        }
                    ],
                    "num_tracks": 12,
                    "num_discs": 1,
                    "date": "2008-11-04",
                    "musicbrainz_id": "b4889eaf-d9f4-434c-a68d-69227b12b6a4"
                },
                "composers": [
                    {
                        "__model__": "Artist",
                        "uri": "local:artist:md5:4d49cbca0b347e0a89047bb019d2779d",
                        "name": "Matt Bellamy"
                    }
                ],
                "genre": "Rock",
                "track_no": 1,
                "disc_no": 1,
                "date": "2008-11-04",
                "length": 211121,
                "musicbrainz_id": "ff1e3e1a-f6e8-4692-b426-355880383bb6",
                "last_modified": 1672712949510
            }
        }
    }
}
Track playback in progress 
{
    "type": "status",
    "data": {
        "state": "playing",
        "current_track": {
            "__model__": "Track",
            "uri": "local:track:Various%20Artists%20-%202008%20-%20Twilight%20OST/01-muse-supermassive_black_hole.mp3",
            "name": "Supermassive Black Hole",
            "artists": [
                {
                    "__model__": "Artist",
                    "uri": "local:artist:md5:250dd6551b66a58a6b4897aa697f200c",
                    "name": "Muse",
                    "musicbrainz_id": "9c9f1380-2516-4fc9-a3e6-f9f61941d090"
                }
            ],
            "album": {
                "__model__": "Album",
                "uri": "local:album:md5:455343d54cdd89cb5a3b5ad537ea99d0",
                "name": "Twilight: Original Motion Picture Soundtrack",
                "artists": [
                    {
                        "__model__": "Artist",
                        "uri": "local:artist:md5:54e4db2d5624f80b0cc290346e696756",
                        "name": "Various Artists",
                        "musicbrainz_id": "89ad4ac3-39f7-470e-963a-56509c546377"
                    }
                ],
                "num_tracks": 12,
                "num_discs": 1,
                "date": "2008-11-04",
                "musicbrainz_id": "b4889eaf-d9f4-434c-a68d-69227b12b6a4"
            },
            "composers": [
                {
                    "__model__": "Artist",
                    "uri": "local:artist:md5:4d49cbca0b347e0a89047bb019d2779d",
                    "name": "Matt Bellamy"
                }
            ],
            "genre": "Rock",
            "track_no": 1,
            "disc_no": 1,
            "date": "2008-11-04",
            "length": 211121,
            "musicbrainz_id": "ff1e3e1a-f6e8-4692-b426-355880383bb6",
            "last_modified": 1672712949510
        },
        "time_position": 17031
    }
}
Track event playback paused 
{
    "type": "event",
    "event": "track_playback_paused",
    "data": {
        "tl_track": {
            "__model__": "TlTrack",
            "tlid": 14,
            "track": {
                "__model__": "Track",
                "uri": "local:track:Various%20Artists%20-%202008%20-%20Twilight%20OST/01-muse-supermassive_black_hole.mp3",
                "name": "Supermassive Black Hole",
                "artists": [
                    {
                        "__model__": "Artist",
                        "uri": "local:artist:md5:250dd6551b66a58a6b4897aa697f200c",
                        "name": "Muse",
                        "musicbrainz_id": "9c9f1380-2516-4fc9-a3e6-f9f61941d090"
                    }
                ],
                "album": {
                    "__model__": "Album",
                    "uri": "local:album:md5:455343d54cdd89cb5a3b5ad537ea99d0",
                    "name": "Twilight: Original Motion Picture Soundtrack",
                    "artists": [
                        {
                            "__model__": "Artist",
                            "uri": "local:artist:md5:54e4db2d5624f80b0cc290346e696756",
                            "name": "Various Artists",
                            "musicbrainz_id": "89ad4ac3-39f7-470e-963a-56509c546377"
                        }
                    ],
                    "num_tracks": 12,
                    "num_discs": 1,
                    "date": "2008-11-04",
                    "musicbrainz_id": "b4889eaf-d9f4-434c-a68d-69227b12b6a4"
                },
                "composers": [
                    {
                        "__model__": "Artist",
                        "uri": "local:artist:md5:4d49cbca0b347e0a89047bb019d2779d",
                        "name": "Matt Bellamy"
                    }
                ],
                "genre": "Rock",
                "track_no": 1,
                "disc_no": 1,
                "date": "2008-11-04",
                "length": 211121,
                "musicbrainz_id": "ff1e3e1a-f6e8-4692-b426-355880383bb6",
                "last_modified": 1672712949510
            }
        },
        "time_position": 67578
    }
}

TODO [C] User should be able to enable auto trail tracking via amail reader with Garmin LiveTrack URLs   vrobbler trails project feature personal

TODO [C] Fix exporting so it works reliably   exporting project feature

Description

The existing export function is very naieve. It runs in the web process, takes too long and just dumps tracks. We should make it more robust by creating one CSV file per scrobble media type and writing them into a zip file that gets placed in the media directory:

`/media/exports/user_<user_id>/<timestamp>-export.zip`

And this should all be done in a celery task that is just kicked off by the "Export" button on the frontend

TODO [B] Add importer class for IMAP imports   vrobbler feature imap importers project personal

TODO [B] Add AllTrails as a source for Trail data   vrobbler trails feature personal project

Description

Pretty clear, I would love to make trails more useful. Historically I wasn't hiking a lot, which made the source for this a bit silly. But it's clear that AllTrails is the best source, though having TrailForks is nice to.

TODO [B] Add `garmin_activity_id` to the TrailLogData class   trails feature personal project

Description

Would be nice to have some loose connection to the actual event in my Garmin profile.

TODO [B] Fix how we show notes and descriptions from scrobbles to users   metadata notes tasks

Description

Currently the display of notes leaves something to be desired. The biggest issue is that they don't look good on mobile and are probably trying to be too cute. Rather than post-it note style, we should just put notes in a list under the description, above the Edit Log toggle, with timestamps for when they were added.

They should also probably support markdown formatting and that should be displayed in the template.

TODO [B] Add CSV endpoint for book scrobbles that LibraryThing can ingest   personal project books feature export

https://app.todoist.com/app/task/add-a-csv-endpoint-for-users-book-reads-that-library-thing-can-ingest-6X7QPMRp265xMXqg#comment-6X7QrXq6gJjMP4hg

TODO [B] Scrape ComicBookRoundUp ratings for comic book metadata   vrobbler books feature comicbook personal project

TODO [B] Find page numbers for comic books from ComicVine   vrobbler feature books personal project

TODO [B] Fix koreader scrobble imports to use DST properly   vrobbler personal bug books imports

  • Note taken on [2025-09-25 Thu 10:37] \\ This may already be fixed … need to check.
  • Note taken on [2025-02-25 12:34] \\ The page data has the canonical date something was read in it, but it seems to be an hour off. I traced this back to being off during DST, so we just need the importer to be aware of whether a user is using DST or not and roll back an hour for part of the year. Also, we'd need to adjust any old scrobbles that took place with DST off to roll them back by an hour.

Description

This is a long-standing problem when daylight saving time takes effect. Time is manually set on a KoReader device (or at least, always saved in local time). So whatever time KoReader reports, we need to know, given the date and the user profile's historic timezone, how many hours to adjust the KoReader time to get to GMT to save it in the database.

TODO [A] Orgmode tasks are not updated if in progress   tasks orgmode bug

Description

Currently if you POST to the orgmode webhook with a task that's already in progress, the request just stops there.

We should add logic where if the task is in-progress, instead of doing nothing, it checks the webhook payload against the in-progress tasks and updates the description of the scrobble.log with the incoming task description if it's different. And the same for comments. If a comment (by timestamp key) is different in the webhook than what's in the scrobble.log, update the comment in the scrobble.log

Version 41.0 [5/5]

DONE [B] For any scrobble detail page with notes display them better   templates notes scrobbles

Description

Currently notes are displayed as little post-it notes. This is cute, but not terribly useful.

We should update note rendering to be a simple newest to oldest display in a single column with the timestamp has a small header, and the content rendered as markdown with a small bar or horizontal divider marking them from the next note.

DONE [A] Imports should send notifications   feature notifications imports

Description

Currently importing board games sends out a ntfy message when a scrobble is created.

We should do the same thing for other import types; namely: gpx, ebird, and scale.

DONE [A] Board game imports send duplicate ntfy message   bug notifications boardgames

Description

When a board game scrobble is created via a bgstats import, ntfy messages are sent.

But right now they are duplicated (two are sent at the same time). Can we review the code to see why this is happening and fix it?

DONE [A] Too many geolocation notifications go out   bug notifications geolocations

Description

Currently ntfy gets overwhelemed when there's more than a hundred or so messages left in a queue on a client.

It would be nice if we could not spam ntfy, and this is especially true with Geolocations, where we really don't need to alert folks unless they have a named Geolocation (has a title). Can we adjust the ntfy sending for Geolocations to only send if the scrobbled location has a title?

DONE [C] Fix bug where Weigh-in imports do not set title   bug tasks scale

Description

Currently when we import a scale CSV row and create data, the title is left blank which makes it look funny in a list view. Let's save the weight as the title of the Weigh-in task.

Version 40.2 [1/1]

DONE [A] Try fixing deploy bugs again   tooling releases bug

Version 40.1 [2/2]

DONE [A] Releases are still broken   bug releases tooling

Description

Deploys are still broken, even with them being pulled apart and run separately.

We need to address the way the commit ends up stashed in the codebase.

DONE [C] Fix bug on chart pages where trail titles missing   bug trails charts

Description

When trails are rendered on the chart views, there are no titles, which means we don't see anything except the ranking number.

Version 40.0 [2/2]

DONE [A] Fix error in org-mode task sync   emacs orgmode tasks bug

Description 

  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/tasks/webhooks.py", line 236, in post
    emacs_scrobble_update_task(
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/scrobbles/scrobblers.py", line 844, in emacs_scrobble_update_task
    for note in emacs_notes:
TypeError: 'NoneType' object is not iterable

DONE [B] Adjust how similar artists are shown   feature templates artists music

Description

Currently we show the top 10 similar artists on the Artist detail page linked to the artist detail page on Vrobbler.

First off, this is very slow. We should look into speeding up the rendering of the similar artists widget.

Second, the artist name in the similar artist list should be a link to the Vrobbler artist detail page, but there should also be a [musicbrainz] link next to it, that links out to the musicbrainz page whether we have the artist in the Vrobbler database or not.

Version 39.3 [2/2]

DONE [A] Issue found when doing a release   bug tooling release cicd

Description 

err: ERROR: Cannot install vrobbler 0.16.1 (from /var/lib/vrobbler/dist/vrobbler-0.16.1-py3-none-any.whl) and vrobbler 38.0 (from /var/lib/vrobbler/dist/vrobbler-38.0-py3-none-any.whl) because these package versions have conflicting dependencies.
out: The conflict is caused by:
out:     The user requested vrobbler 0.16.1 (from /var/lib/vrobbler/dist/vrobbler-0.16.1-py3-none-any.whl)
out:     The user requested vrobbler 38.0 (from /var/lib/vrobbler/dist/vrobbler-38.0-py3-none-any.whl)
out: To fix this you could try to:
out: 1. loosen the range of package versions you've specified
out: 2. remove package versions to allow pip attempt to solve the dependency conflict
err: ERROR: ResolutionImpossible: for help visit https://pip.pypa.io/en/latest/topics/dependency-resolution/#dealing-with-dependency-conflicts
2026/06/01 14:15:00 Process exited with status 1
failed to remove container: Error response from daemon: removal of container 3fe0eaf032c5518aca4ab71734b52bda7c54ed406136b82136ab7155bf5ff3c1 is already in progress

DONE [A] Fix deploy actions running twice   bug tooling cicd

Description

Turns out we're now running the build-deploy action twice, once on branch push and once on tag push.

We should do builds on each push and build and deploys only when a new tag is detected.

Version 39.2 [2/2]

DONE [B] Releases do not pin commit to the repo for display   bug tooling releases

Description

Somewhere in implementing the justfile release flow, we lost the capture of the latest commit in the relesae flow so the footer now always says: vXX.x (unknown)

It should have the first bit of the commit in the parens at the end.

DONE [B] Fix the way timestamps are stored for notes on tasks   bug scrobbles tasks

Description

Turns out Todoist uses a human-readable timestamp format for comments. We should adapt that for use from org-mode as well.

Format should be: "%Y-%m-%dT%H:%M:%S.%fZ"

Version 39.1 [1/1]

DONE [A] Fix bug in tests for notes saving   bug scrobbles forms

Version 39.0 [3/3]

DONE [B] Clean up org-mode tasks metadata   bug tasks metadata

Description

Org-mode tasks have a `Description` subheader, which should populate the "Description" of a task.

The title should come from the actual TODO content, with tags coming from the tags in colons after the task. This behaviour should already work.

Next, any comments should go under a `Comments` subheader. Under these should be a list tag like:

"Note taken on [2026-05-31 Sun 20:03]"

Which declares it's a note with a timestamp like "YYYY-MM-DD d HH:MM".

When scrobbling a task from org-mode, the description should always be copied to the scrobble's log["description"].

Any comments that exist on the task when the scrobble is first created, should be ignored.

Any comments on a task that is updated (a re-POST'd while the task is in progress, should add a comment in the log["notes"], a dictionary, keyed off the timestamp the note string. If a note for that datetime already exists, the content should be replaced with the new comment.

Additionally, when a task is re-POST'd while the task is in progress, the description should also be compared, and if different, the newest description should be used.

Note, the biggest change for this flow is making sure comments that already exist are not added to any new tasks and that both comments and descriptions are added or updated if the new values are different than what is already in the currently in-progress task.

If the task is completed, don't touch it.

Comments

  • Note taken on [2026-05-31 Sun 20:03]

DONE [A] Actually push branches up and add a just command to do it   release justfile tooling

DONE [A] Try to fix deploy failing with bad release plan   release tooling pyproject

Version 38.0 [38/38]

DONE [A] Fix release flow to be easier to trigger   pyproject release tooling

Description

We should have a command like `just relesae <major|minor>` that can cut new releases on command by updating the PROJECT.org file with a release header for all DONE tasks and creating the appropriate release commits and tags based on either the new release version type.

It should also update the pyproject file.

DONE [A] Move imported retroarch lrtl files to processed/ directory on WebDAV   webdav retroarch importers

  • File: vrobbler/apps/scrobbles/importers/webdav.py (line 439)
  • Same pattern as the GPX importer: after importing a .csv file from WebDAV, move it to var/retroarch/processed/ with a timestamp appended.

DONE [A] Add listenbrainz support for similar tracks   feature music metadata

DONE [B] Consolidate albums in the same musicbrainz_releasegroup_id   music albums metadata

Description

When we look up albums, we should check if one already exists with the same musicbrainz_releasegroup_id and prefer that one, rather than creating a new album.

Also, we should create a data migration to clean up albums with matching musicbrainz_releasegroup_id fields by consolidating tracks around the first album found.

Whether the track was enriched by musicbrainz or not, the track should get tagged with `musicbrainz_enriched` or `musicbrainz_notfound`

DONE [A] Clean up metadata on music tracks   music tracks metadata musicbrainz

Description

There's a over 3K tracks without a musicbrainz_id and almost 30K without a base_run_time_seconds. We should have a clean up script that can run through the ones missing musicbrainz_ids and see about getting metadata from musicbrainz and for the 30K without base_run_time_seconds, check with their musicbrainz_ids to see if we can look up the track length, and if not, tag the track with "missing-metadata" tag.

Also, if the tracks without musicbrainz_ids actually are not in the MB database, we should tag those with "not-in-musicbrainz"

And a big part of this work will probably involve checking for "Various Artists" tracks where the track erroneously got set with a generic artist. In those cases, we should try just looking up by track title.

DONE [B] Make artists_m2m field source of artist truth for albums   music bug albums

Description

Albums have an FK for album_artist, but like artists, the M2M should be the source of truth. We should migrate all uses of album_artist to an `artist` property on the Album model and use a data migration to populate artists with the album_artist value.

DONE [A] Fix various artist album problem with Superwolves (track with multiple artists)   vrobbler project music bug artists

Description

We have an issue with tracks where there are two artists, like `Matt Sweeney & Bonnie "Prince" Billy`

I think we need to allow creating a single artist with both names, so the Artist is the full name. That said, the ampersand is usually used to split feature artsits (I think) so I'm not sure how this would work reliably.

Also, it's possible musicbrainz does not have dual artist listings. So it's possible the longer term solution is to allow multiple artists per track the way we now allow tracks to be on multiple albums. We could deprecate the Artist FK or at least make it optional, and then require a M2M between Track and Artist.

Then this one would be a Track by both `Matt Sweeney` and `Bonnie "Prince" Billy`

DONE [A] Move imported eBird CSV files to processed/ directory on WebDAV   webdav ebird importers

  • File: vrobbler/apps/scrobbles/importers/webdav.py (line 439)
  • Same pattern as the GPX importer: after importing a .csv file from WebDAV, move it to var/ebird/processed/ with a timestamp appended.

DONE [A] Move imported Board Game CSV files to processed/ directory on WebDAV   webdav boardgames importers

  • File: vrobbler/apps/scrobbles/importers/webdav.py (line 496)
  • Same pattern as the GPX importer: after importing a .csv file from WebDAV, move it to var/bgstats/processed/ with a timestamp appended.

DONE [A] Move imported Scale CSV files to processed/ directory on WebDAV   webdav scale importers

  • File: vrobbler/apps/scrobbles/importers/webdav.py (line 496)
  • Same pattern as the GPX importer: after importing a .csv file from WebDAV, move it to var/scale/processed/ with a timestamp appended.

DONE [A] Allow special parameter to re-import already processed GPX files   imports gpx

Description

Now that we stash imported GPX files in the processed/ subdirectory on import, it would be nice to have a flag like –include-processed on the webdav importer that would import files both in the root of gpx/ and also in the processed directory. This would aide testing imports in staging quickly without constantly moving files back and forth.

DONE [A] Move imported GPX files to processed/ directory on WebDAV   webdav gpx importers

  • File: vrobbler/apps/scrobbles/importers/webdav.py (line 198)
  • After importing a GPX/FIT file from WebDAV, move it to a processed/ subdirectory with a timestamp appended. This eliminates the DB lookup for already-imported filenames — any file present in the top-level directory is new. Also makes manual re-imports easy (just move a file back).

DONE [A] Add CSS Grid calendar view for scrobbles   vrobbler personal project templates feature

Description

Calendar view at scrobbles/calendar showing select media types (Tasks, Birding, Food, Trails, VideoGames, Books) in a CSS Grid month layout.

  • Emoji badges per scrobble on each day cell, hover reveals title
  • Click emoji to navigate to scrobble detail
  • Prev/Next month navigation
  • Based on the CodePen CSS Grid calendar pattern: https://codepen.io/oliviale/pen/QYqybo

DONE [C] Come up with a possible flow using WebDAV and super-productivity for tasks   personal feature project vrobbler tasks

DONE [B] Fix PuzzleLogData has no attribute form   vrobbler puzzles personal project logdata

DONE [B] Add PuzzleLogData class with with_people and completed   vrobbler feature puzzles logdata personal project

DONE Add weather lookup to the mood check-in flow   vrobbler project moods feature checkin

<2026-05-20 Wed>

DONE Add importing of openScale CSV files to Tasks   vrobbler project personal tasks openscale

DONE Add ability to track Birding sessions via BirdingLocation scrobbles   vrobbler project birds feature

DONE List only the last 20 scrobbles per category on the home page   vrobbler project scrobbles templates

DONE Fix display of notes so they look like stickies   vrobbler project personal notes scrobbles

DONE Add searching to scrobbles   vrobbler project personal search scrobbles 

DONE Fix uniqueness of imdb_id messing up youtube videos   vrobbler project bug videos

Turns out you can't make imdb_id unique by itself or you never get to create youtube videos. Rather, we should make imdb_id and youtube_id unique together so imdb_id can be empty for every youtube_id and vice versa.

DONE Fix genearting chart records   vrobbler bug personal project chartrecords

DONE [A] Save raw scrobble request data to every scrobble log   vrobbler personal feature scrobbles

The idea here is that no matter where the data comes from, we should just save it in the scrobble for posterity, so we can always in some form recover the original intent of the scrobble.

It may also allow us to clean up junk scrobbles if the data was just horribly wrong.

DONE [B] Clean up follow up notifications for if you're still scrobbling   vrobbler personal project beers boardgames notifications feature

DONE [A] Fix lookup of music tracks from Musicbrainz   vrobbler bug tracks music

Turns out we're not looking up music tracks properly, again.

DONE Check opencode about a way to present stats like movies per month   vrobbler scrobbles stats personal project

DONE Fix bug in Jellyfin audio track playback   vrobbler personal project bug music jellyfin 

ERROR    django.request:241 log_response Internal Server Error: /webhook/jellyfin/
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner
    response = get_response(request)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
    return view_func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/decorators/csrf.py", line 56, in wrapper_view
    return view_func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/generic/base.py", line 104, in view
    return self.dispatch(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/rest_framework/views.py", line 509, in dispatch
    response = self.handle_exception(exc)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/rest_framework/views.py", line 469, in handle_exception
    self.raise_uncaught_exception(exc)
  File "/usr/local/lib/python3.11/site-packages/rest_framework/views.py", line 480, in raise_uncaught_exception
    raise exc
  File "/usr/local/lib/python3.11/site-packages/rest_framework/views.py", line 506, in dispatch
    response = handler(request, *args, **kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/rest_framework/decorators.py", line 50, in handler
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/scrobbles/views.py", line 494, in jellyfin_webhook
    scrobble = jellyfin_scrobble_media(post_data, request.user.id)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/scrobbles/scrobblers.py", line 177, in jellyfin_scrobble_media
    log["album_id"] = media_obj.album_id
    ~~~^^^^^^^^^^^^
TypeError: 'tuple' object does not support item assignment

DONE [B] Auto calc duration if no playback time seconds present   vrobbler bug scrobbles personal project

DONE Fix bug in video find_or_create   vrobbler personal project bug videos

The error:

  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/scrobbles/views.py", line 493, in jellyfin_webhook
    scrobble = jellyfin_scrobble_media(post_data, request.user.id)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/scrobbles/scrobblers.py", line 149, in jellyfin_scrobble_media
    media_obj = Video.find_or_create(imdb_id)
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/videos/models.py", line 390, in find_or_create
    return cls.get_from_imdb_id(source_id, overwrite)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/videos/models.py", line 374, in get_from_imdb_id
    video.tv_series = Series.find_or_create(
                      ^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/videos/models.py", line 203, in find_or_create
    vdict, _, cover, genres = lookup_video_from_imdb(
                              ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/videos/sources/imdb.py", line 17, in lookup_video_from_imdb
    imdb_result = imdb.get_title(imdb_id)
                  ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/cinemagoerng/web.py", line 127, in get_title
    data = _scrape(spec=spec, context=context, headers=headers)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/cinemagoerng/web.py", line 120, in _scrape
    document = fetch(url, headers=request_headers)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/cinemagoerng/web.py", line 44, in fetch
    with urlopen(request) as response:
         ^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 216, in urlopen
    return opener.open(url, data, timeout)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 525, in open
    response = meth(req, response)
               ^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 634, in http_response
    response = self.parent.error(
               ^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 563, in error
    return self._call_chain(*args)
           ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 496, in _call_chain
    result = func(*args)
             ^^^^^^^^^^^
  File "/usr/local/lib/python3.11/urllib/request.py", line 643, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 500: Internal Server Error
  • Note taken on [2026-03-11 Wed 20:53] It turns out that every time a TV show was scrobbled were were hitting IMDB. Woof.

DONE Update admin page to be easier to use   vrobbler djadmin project personal

DONE Fix migrations and update repo   vrobbler scrobbles admin personal project

DONE Add recipe parsing for food lookups   vrobbler foods project feature personal

DONE [A] Videos are scrobbling duplicates again   vrobbler bug videos scrobbles

<2026-03-06 Fri>

DONE Fix board games not saving BGG id on lookup   vrobbler bug boardgames

DONE Fix board game lookup with name like Unmatched Game System   vrobbler bug boardgames

DONE [A] Fix raw text webpage title not truncating to 254 chars   vrobbler personal bug webpages

  • Note taken on [2025-09-30 Tue 09:33] This may have already been resolved … need to just confirm it.

Version 37.0 [4/4]

DONE [A] Tasks from org-mode should properly update notes and leave them out of the body   vrobbler bug tasks

DONE [A] Allow scrobbling from the Food list page's start links   vrobbler bug food scrobbling personal project

https://life.lab.unbl.ink/scrobble/e39779c8-62a5-46a6-bdef-fb7662810dc6/start/

DONE [B] Food scrobbles should inherit calories from obj if missing   vrobbler feature food personal project

DONE [A] Puzzles (and all longplays) should have a "Completed?" column on their detail page   vrobbler bug puzzles personal project

Version 36.0 [1/1]

DONE [A] Refactor how videos are scrobbled   vrobbler vidoes feature personal project

Version 35.0 [3/3]

DONE [B] Add youtube link in place of IMDB on video detail page   vrobbler feature videos personal project

DONE [B] Add missing API lookups to resolve broken scrobbles endpoint   vrobbler feature api scrobbles personal project

DONE [A] IMDB lookups are not working   vrobbler bug videos personal project

Version 34.0 [4/4]

DONE [A] Use bgg-api for BoardGameGeek lookups   vrobbler feature boardgames personal project

DONE [A] Add classmethod for metadata fetching to tracks   vrobbler feature music personal project

  • Note taken on [2025-10-29 Wed 21:44] Beyond a classmethod (which I think we have now), we need to update the flow of how we look up tracks. It's a hot mess right now where Various Artists walks over the actual artist, and we often hit MB when we don't have to.

DONE [A] Fix views for TV series where next episode is now None   vrobbler bug personal videos 

ERROR    django.request:241 log_response Internal Server Error: /series/c24100d1-da45-4abe-86bf-27cfce9b1f89/
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/django/core/handlers/exception.py", line 55, in inner
    response = get_response(request)
               ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/core/handlers/base.py", line 197, in _get_response
    response = wrapped_callback(request, *callback_args, **callback_kwargs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/generic/base.py", line 104, in view
    return self.dispatch(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/contrib/auth/mixins.py", line 73, in dispatch
    return super().dispatch(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/generic/base.py", line 143, in dispatch
    return handler(request, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/django/views/generic/detail.py", line 109, in get
    context = self.get_context_data(object=self.object)
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/vrobbler/apps/videos/views.py", line 33, in get_context_data
    context_data["next_episode_id"] = "tt" + next_episode_id
                                      ~~~~~^~~~~~~~~~~~~~~~~
TypeError: can only concatenate str (not "NoneType") to str

DONE [A] Emacs tasks are duplicating rather than updating   vrobbler bug tasks emacs personal project

  • Note taken on [2025-10-29 Wed 16:38] Turns out I was misusing `orgmode` for the source of tasks when it shoulda been `Org-mode` A good lesson in using constants for things.

Version 33.0 [3/3]

DONE [A] Fix bug where scrobble is_stale only uses seconds not total_seconds   vrobbler bug scrobbles personal project

DONE [B] Fix duplicatged Read next issue for Comic books   vrobbler bug books personal project

DONE [A] Add API authentication to BGG calls   vrobbler bug boardgames personal project

<2025-10-28 Tue>

Version 32.0 [2/2]

DONE [B] Save path to reading source on book scrobbles and show it on the detail page   vrobbler feature books personal project

DONE [B] Move comic resume URL to next page and check if it exists   vrobbler feature books personal project

Version 31.0 [3/3]

DONE [A] Stop comic book webpage scrobbles from overwriting old scrobbles   vrobbler personal bug books scrobbling

DONE [A] Add page calculation to manually scrobbled books   vrobbler personal feature books scrobbling

DONE [A] Fix bug in scrobbling comics where google fails   vrobbler personal bug books scrobbling

Version 30.0 [3/3]

DONE [A] Fix readcomicsonline browsing to update pages   vrobbler books feature comicbook personal project scrobbling

DONE [B] Redirect webpages back to the original page when starting or stopping   vrobbler project webpages bug

DONE [B] Fix ComicVine as source for comic book metadata   vrobbler books feature comicbook personal project scrobbling

Version 29.0 [1/1]

DONE HOTFIX podcast lookups, final

Version 28.0 [1/1]

DONE HOTFIX podcast lookups

Version 27.0 [3/3]

DONE [A] Fix bug where podcast scrobbling creates duplicate Podcast   project vrobbler scrobbling podcasts bug personal

Rather than pick up an existing Podcast using the podcast title in the mopidy file name, Vrobbler creates a new podcast with no enriched data. Not a big deal for my use as the volume of podcasts I listen to makes manual fixes easy. But it's annoying.

DONE [A] Allow reading comic books from readcomicsoline.ru   vrobbler books feature comicbook personal project scrobbling

  • Note taken on [2025-09-25 Thu 10:52] Things to consider are whether we scrobble the issue on one page, send it to archivebox? (yes), and how best to enrich the data

DONE [A] Add RSS feed lookups to podcasts   vrobbler personal feature podcasts

  • Note taken on [2025-10-14 Tue 10:08] Turns out the Podcast plugin for mopidy does a pretty good job of showing the latest file without having to scroll the bottom using only Muse to not parse the podcast title name. BUT, now we're getting urls like this: https://nsf.libsyn.com/rss#77e01251-cb20-4609-b577-d48e985d2e7b This is great, because there's more context there, but it has to read out of the RSS feed. We should add a check in the podcast util to sniff out the file referenced in the # in that url and populate the info from there. This should actually be much more reliable than the current state of the podcast lookup which depends on the file to be name properly.

Version 26.0 [3/3]

DONE Clean up templates for scrobble details   vrobbler personal bug templates

DONE Add named locations visited to dashboard   vrobbler personal feature locations templates

DONE Add moods to dashboard   vrobbler moods feature templates personal

Version 25.0 [3/3]

DONE Add basic food templates and fix urls   food vrobbler personal project bug urls

DONE [C] Fix how elapsed time is calculated   vrobbler personal project scrobbles bug

DONE Fix templates for videos and dashboard links   personal feature project vrobbler templates

Version 24.0 [2/2]

DONE Clean up logdata for various media   personal feature project vrobbler logdata

DONE Removed sidebar and add links to headers   personal feature templates scrobbles

Version 23.0 [3/3]

DONE Add dynamic forms for LogData classes   personal feature vrobbler project forms logdata

DONE Look in comments for a timestamp for start from BG stats if the time is missing   vrobbler feature boardgames project personal

DONE Fix long play scrobbles to provide better data   vrobbler feature scrobbles longplay personal project

Version 19.0 [1/1]

DONE Add periodic check for mood   vrobbler feature moods personal project

Version 18.7 [1/1]

DONE Use the timezone history log to fix old Scrobbles that fall into those timezone blocks   vrobbler chore scrobbles project personal

Version 18.4 [2/2]

DONE Track timezone changes for profiles   vrobbler feature profiles personal project

[2025-07-11 14:23]

DONE Only create a LastFM import if there are files to import   vrobbler feature lastfm importers project personal

  • Note taken on [2025-07-20 Sun 16:21] This thing is kicking my butt. As it stands it works, but the scrobbles are not assigned to the tracks properly.

Version 18.3 [1/1]

DONE Add timezone awarness to IMAP importer   personal project vrobbler feature importer imap timezones

Version 18 [4/4]

DONE Condense tracks of the same title by the same artist with multiple albums   vrobbler feature music project personal

DONE Import from BG stats a "learning" log field when "Learning to play" is in the comment   vrobbler feature boardgames project personal

DONE [A] Add email importer for BG stats file uploads   vrobbler feature boardgames personal project 

{
  "about": "This is a Play file that can be read by Board Game Stats. If you see this text, try to use a share, export or open-in function to open it with Board Game Stats.",
  "players": [
    {
      "uuid": "31f8b92e-11d8-4162-88b1-fd9c79eea249",
      "id": 2,
      "name": "Colin",
      "isAnonymous": false,
      "modificationDate": "2025-07-01 18:10:32",
      "metaData": "{\"isNpc\":0}"
    },
    {
      "uuid": "00074700-cf4e-4ad3-b334-d35805bb0d90",
      "id": 4,
      "name": "Asa Sewell",
      "isAnonymous": false,
      "modificationDate": "2025-07-01 18:03:37"
    }
  ],
  "locations": [
    {
      "uuid": "14f7389c-767f-4725-9b35-906c407b293c",
      "id": 3,
      "name": "Timberwyck Farm",
      "modificationDate": "2025-07-01 18:03:38"
    }
  ],
  "games": [
    {
      "uuid": "043a2851-f201-467a-a60c-0b0a7e9c33d2",
      "id": 333,
      "name": "Ghost Fightin' Treasure Hunters: Anniversary Edition",
      "modificationDate": "2025-07-02 01:37:14",
      "cooperative": true,
      "highestWins": true,
      "noPoints": false,
      "usesTeams": false,
      "urlThumb": "https://cf.geekdo-images.com/DHA-mcH3zzw_OjfDxOPj1A__thumb/img/UhaIm4KIDIiraUc44QIvSAbMUXI=/fit-in/200x150/filters:strip_icc()/pic8266874.jpg",
      "urlImage": "https://cf.geekdo-images.com/DHA-mcH3zzw_OjfDxOPj1A__original/img/2-Lb6nLePhn0I0Hh2j1pOtbO4rg=/0x0/filters:format(jpeg)/pic8266874.jpg",
      "bggName": "Ghost Fightin' Treasure Hunters: Anniversary Edition",
      "bggYear": 2024,
      "bggId": 422668,
      "designers": "Brian Yu",
      "isBaseGame": 1,
      "isExpansion": 0,
      "rating": 75,
      "minPlayerCount": 2,
      "maxPlayerCount": 5,
      "minPlayTime": 30,
      "maxPlayTime": 0,
      "minAge": 8
    }
  ],
  "plays": [
    {
      "uuid": "bae3f29e-5e1e-45d8-b409-47a665c8d5b5",
      "modificationDate": "2025-07-02 01:37:59",
      "entryDate": "2025-07-02 01:31:38",
      "playDate": "2025-07-02 01:31:38",
      "usesTeams": false,
      "durationMin": 23,
      "ignored": false,
      "manualWinner": true,
      "rounds": 3,
      "scoresheet": "{\"bggId\":244711,\"version\":1,\"langCode\":\"en\",\"scoreType\":\"bestTotalWins\",\"groups\":[{\"templateId\":\"1\",\"maxRepeat\":-1,\"repetition\":1,\"hasSubTotal\":false,\"hideSingleGroupLabel\":false,\"isExtra\":false,\"rows\":[{\"templateId\":\"vptrack\",\"label\":\"VP track\",\"repetition\":1,\"repeatable\":false,\"negative\":false,\"isExtra\":false,\"scores\":{}},{\"templateId\":\"objectives\",\"label\":\"Objectives\",\"repetition\":1,\"repeatable\":false,\"negative\":false,\"isExtra\":false,\"scores\":{}},{\"templateId\":\"mastercards\",\"label\":\"Master cards\",\"repetition\":1,\"repeatable\":false,\"negative\":false,\"isExtra\":false,\"scores\":{}}]}]}",
      "locationRefId": 3,
      "gameRefId": 333,
      "board": "",
      "scoringSetting": 4,
      "metaData": "{\"playUsedGameCopy\":2}",
      "playerScores": [
        {
          "score": "",
          "winner": true,
          "newPlayer": true,
          "startPlayer": false,
          "playerRefId": 4,
          "role": "",
          "rank": 0,
          "seatOrder": 0,
          "metaData": "{\"scoreUuid\":\"00074700-cf4e-4ad3-b334-d35805bb0d90\"}"
        },
        {
          "score": "",
          "winner": true,
          "newPlayer": true,
          "startPlayer": false,
          "playerRefId": 2,
          "role": "",
          "rank": 0,
          "seatOrder": 0,
          "metaData": "{\"scoreUuid\":\"31f8b92e-11d8-4162-88b1-fd9c79eea249\"}"
        }
      ],
      "expansionPlays": []
    }
  ],
  "userInfo": {
    "meRefId": 2
  }
}

DONE [B] Fix task app to only use one tag for the context a task was done in and allow configurable contexts by user profile   personal vrobbler feature tasks project

Version 17.0 [6/6]

DONE [A] Fix bug in new task label lookup for Emacs/Org-mode   vrobbler bug tasks

DONE [C] Replace commas in the bandcamp URL for artists with nothing   vrobbler music bug personal

  • Note taken on [2025-06-16 Mon 09:36] This firt appeared with Black Country, New Road, where the RYM slug generator leaves commas in and ends up sending you to a 404. I suspect this wont be the first tweak we'll need to this, as the RYM link creator is really just guessing based on the artist name at the path.

DONE [A] Investigate new source of video metadata   personal project video imdb

Cinemagoer broke and I probably should find a more reilable source of video data.

  • Note taken on [2025-06-13 Fri 11:19] TMDB is much more reliable, but does require an API key. That's all setup now, so hopefully this breaking IMDB crap is over.

DONE [A] IMDB video lookups are failing   personal bug video imdb

<2025-06-13 Fri>

DONE [A] Emacs is not syncing notes   personal scrobbling emacs bug

<2025-06-12 Thu 9:30>

Not sure if the problem is in my Emacs hook sending or Vrobbler itself.

  • Note taken on [2025-06-12 Thu 09:47] Adding a quick note to check on it
  • Note taken on [2025-06-12 Thu 09:50] Ah ha. All the messing about with the source field meant that I was looking for `emacs` as a source but the hook was initially setting sources to `orgmode` I think I prefer `orgmode` as the source, so updating it thusly. Fixed in `490d60cbbb1f8bf90b5fc47d8685b15bdc1d485b`

DONE [A] Show the description of a task in the string rep for a scrobble of a Task   personal project scrobbling vrobbler feature

Version 0.16.0 [19/19]

DONE [A] Jellyfin, bandcamp tracks from Mopidy create duplicate music tracks   bug scrobbling music

Effectively, any track that comes in without a MusicBrainz ID does some funky lookup where it doesn't find a track without an MB id and the track title / artist combination and creates a new track every time. This has to be cleaned up by condensing the duplicated tracks into the original proper track.

But it opens a bigger question about how much MB id should the drive the app lookup. If it can't be depended on to exist from all sources, it really can't be canonical. Instead, the combination of track title / artist is really the best we can do. Last.fm also has this problem, where it doesn't know about albums and definitely does not know or care about MB ids.

DONE Add a user profile page with ability to change settings   profiles improvement

DONE What to do with Youtube videos from LastFM and web-scrobbler   bug source lastfm

  • Note taken on [2025-04-04 Fri 10:46] Nothing. Over the last few months I built out a youtube model in videos and use a bookmarklet scrobbling pattern. Now web-scrobbler is just disabled for Youtube. May want to revisit this at some point and only scrobble tracks from Youtube, because many people use YT for music listening.

DONE [C] Consider a purge command for duplicated and stuck in-progress scrobbles   utililty improvement

CLOSED: [2023-04-06 Thu 14:09]

DONE Add a "stop_timestamp" so we don't rely on content length   improvement scrobbling

CLOSED: [2023-04-02 Sun 23:58]

Essentially, we currently have the timestamp as when the content began scrobbling and then calculate the finish time from the length of the content. This works pretty well because we know how long most things are.

But in some cases, sports events or long podcasts, we may start mid-way through an event or finish halfway through but still want to mark it as done. In these cases, knowing the finish time could be useful, especially when interfacing with other scrobblers which may have different definitions of when a scrobble finishes or started.

DONE Fix bug with Various Artist albums being labeled with first artist as album artist   scrobbling bug music

CLOSED: [2023-03-27 Mon 20:18]

CLOCK: [2023-03-26 Sun 22:01]–[2023-03-27 Mon 01:07] => 3:06

DONE Fix bug with weekly aggregator being blank on Sundays   aggregators music bug

CLOSED: [2023-03-26 Sun 13:52]

DONE Fix KoReader scrobbling to use pages rather than time of last read   scrobbling books improvement

CLOSED: [2023-03-26 Sun 13:51]

CLOCK: [2023-03-26 Sun 13:11]–[2023-03-26 Sun 13:51] => 0:40

DONE [A] Add django-storage to store files on S3   settings improvement

CLOSED: [2023-03-24 Fri 14:46]

CLOCK: [2023-03-24 Fri 10:47]–[2023-03-24 Fri 14:46] => 3:59 CLOCK: [2023-03-24 Fri 10:36]–[2023-03-24 Fri 10:40] => 0:04

DONE Fix vrobbler settings not using booleans   settings bug

CLOSED: [2023-03-24 Fri 10:45]

CLOCK: [2023-03-24 Fri 10:40]–[2023-03-24 Fri 10:46] => 0:06

DONE Update weekly live chart to be 7-day continuous rather than weekly   views bug

CLOSED: [2023-03-24 Fri 00:31] The live view will be blank every Monday, no reason to tie it to a day of the week. It should be "the last 7 days"

DONE [B] Implement a detail view for TV shows   improvement views

CLOSED: [2023-03-22 Wed 17:05]

DONE [B] Implement a detail view for Movies   improvement views

CLOSED: [2023-03-22 Wed 17:05]

DONE Add "service provider" to TV Series, and use that for source when available   bug scrobbling

CLOSED: [2023-03-22 Wed 17:04]

DONE Add view for long-play content (books, video games) to restart them   views improvement

CLOSED: [2023-03-22 Wed 17:01]

DONE Add live chart view like Maloja   improvement views

CLOSED: [2023-03-07 Tue 11:13]

DONE [C] Figure out how to add to web-scrobbler   improvement scrobbling

CLOSED: [2023-03-22 Wed 17:06]

An example: https://github.com/web-scrobbler/web-scrobbler/blob/master/src/core/background/scrobbler/maloja-scrobbler.js

This is actually going to be moot because we can import from LastFM, and web-scrobbler integrates well with LastFM. The only thing to think through here now is what to do with all the garbage web-scrobbler sometimes pushes to LastFM from Youtube (all videos get pushed, sigh).

DONE Add Amazon scraper to look up books when OL fails   books improvement

This turned out to be a non-starter … Amazon is aggressive at disallowing scraping quality. And all the OSS tools out there are stuck in an arms race trying to keep them from breaking.

That said, Google Books actually has a decent API (for now), and I've built this out using that.

DONE Fix bug in Jellyfin scrobbles that spam more scrobbles after completion   scrobbling videos bug

This was fixed a while ago, but there's a new manifested bug. Going to create a separate bug tracking ticket for that.

Version 0.11.4 [9/9]

DONE Add rudimentary video game scrobbling   improvement content videogames

CLOSED: [2023-03-07 Tue 11:11]

DONE Add ability to scrobble from KOReader statistics files   improvement books content

CLOSED: [2023-03-07 Tue 11:11]

DONE [A] Fix fetching artwork without release group   bug

CLOSED: [2023-01-29 Sun 14:27]

When we get artwork from Musicbrianz, and it's not found, we should check for release groups as well. This will stop issues with missing artwork because of obscure MB release matches.

DONE [A] Fix Jellyfin music scrobbling N+1 past 90 completion percent   bug

CLOSED: [2023-01-30 Mon 18:31]

CLOCK: [2023-01-30 Mon 18:00]–[2023-01-30 Mon 18:31] => 0:31

If we play music from Jellyfin and the track reaches 90% completion, the scrobbling goes crazy and starts creating new scrobbles with every update.

The cause is pretty simple, but the solution is hard. We want to mark a scrobble as complete for the following conditions:

  • Play stopped and percent played beyond 90%
  • Play completely finished

But if we keep listening beyond 90, we should basically ignore updates (or just update the existing scrobble)

DONE [A] Add support for Audioscrobbler tab-separated file uploads   improvement

CLOSED: [2023-02-03 Fri 16:52]

An example of the format:

,
#AUDIOSCROBBLER/1.1
#TZ/UNKNOWN
#CLIENT/Rockbox sansaclipplus $Revision$
75 Dollar Bill	I Was Real	I Was Real	4	1015	S	1740494944	64ff5f53-d187-4512-827e-7606c69e66ff
75 Dollar Bill	I Was Real	I Was Real	4	1015	S	1740494990	64ff5f53-d187-4512-827e-7606c69e66ff
311	311	Down	1	173	S	1740495003	00476c23-fd9e-464b-9b27-a62d69f3d4f4
311	311	Down	1	173	L	1740495049	00476c23-fd9e-464b-9b27-a62d69f3d4f4
311	311	Down	1	173	L	1740495113	00476c23-fd9e-464b-9b27-a62d69f3d4f4
311	311	Random	2	187	S	1740495190	530c09f3-46fe-4d90-b11f-7b63bcb4b373
311	311	Random	2	187	L	1740495194	530c09f3-46fe-4d90-b11f-7b63bcb4b373
311	311	Jackolantern’s Weather	3	204	L	1740495382	cc3b2dec-5d99-47ea-8930-20bf258be4ea
311	311	All Mixed Up	4	182	L	1740495586	980a78b5-5bdd-4f50-9e3a-e13261e2817b
311	311	Hive	5	179	L	1740495768	18f6dc98-d3a2-4f81-b967-97359d14c68c
311	311	Guns (Are for Pussies)	6	137	L	1740495948	5e97ed9f-c8cc-4282-9cbe-f8e17aee5128
311	311	Misdirected Hostility	7	179	S	1740496085	61ff2c1a-fc9c-44c3-8da1-5e50a44245af
,

DONE [B] Allow scrobbling music without MB IDs by grabbing them before scrobble   improvement

CLOSED: [2023-02-17 Fri 00:10]

This would allow a few nice flows. One, you'd be able to record the play of an entire album by just dropping the muscibrainz_id in. This could be helpful for offline listening. It would also mean bad metadata from mopidy would not break scrobbling.

DONE When updating musicbrainz IDs, clear and run fetch artwrok   improvement

CLOSED: [2023-02-17 Fri 00:11]

DONE [A] Add ability to manually scrobble albums or tracks from MB   improvement

CLOSED: [2023-03-07 Tue 11:09]

Given a UUID from musicbrainz, we should be able to scrobble an album or individual track.

DONE [C] Implement keeping track of week/month/year chart-toppers   improvement

CLOSED: [2023-03-07 Tue 11:10]

CLOCK: [2023-01-30 Mon 16:30]–[2023-01-30 Mon 18:00] => 1:30

Maloja does this cool thing where artists and tracks get recorded as the top track of a given week, month or year. They get gold, silver or bronze stars for their place in the time period.

I could see this being implemented as a separate Chart table which gets populated at the end of a time period and has a start and end date that defines a period, along with a one, two, three instance.

Of course, it could also be a data model without a table, where it runs some fun calculations, stores it's values in Redis as a long-term lookup table and just has to re-populate when the server restarts.