Felix Stupp
487b126fe1
Add aggregated extraction support
2 years ago
Felix Stupp
0d75fa72bd
Add TMDB extraction support
2 years ago
Felix Stupp
1139219e23
Add support for TVMaze extraction
2 years ago
Felix Stupp
9ffb34b972
Use ExtractedDataLight where data cannot be supplied
2 years ago
Felix Stupp
d6768135f3
MediaExtractor: Fix type hints to Generic from super class
2 years ago
Felix Stupp
9c7fd0d4cd
Extract media_extract_uri_new from media_extract_uri
2 years ago
Felix Stupp
0554dcff18
Extract collection_extract_uri_new from collection_extract_uri
2 years ago
Felix Stupp
af1c279eb3
YouTubeCollectionExtractor: Set creator if already extracted
2 years ago
Felix Stupp
9b31fb73cb
YouTubeCollectionExtractor: Set a release_date determined by first video
2 years ago
Felix Stupp
cacc6e9a05
YouTubeCollectionExtractor: Reformat code
2 years ago
Felix Stupp
4a690688f6
YouTubeCollectionExtractor: Use sorting_method to sort channel videos by date
2 years ago
Felix Stupp
8f100ad917
YouTubeCollectionExtractor: Extract description
2 years ago
Felix Stupp
7913cd3561
YouTubeCollectionExtractor: allow partial-only updates on channels
2 years ago
Felix Stupp
2dd0b575fa
TT-RSS: Set collection author & watch in order auto val
2 years ago
Felix Stupp
e4a50288d6
Enable mark_as_read for TT-RSS extractor
2 years ago
Felix Stupp
081964a336
Add many properties to MediaCollection
2 years ago
Felix Stupp
fc35a62871
Extract set_watch_in_order_auto to MediaCollection
2 years ago
Felix Stupp
97796ce499
Remove unused methods from PreferenceScore
...
- order_by_score & get_first_by_score
- easily replaceable by sorted / min calls
2 years ago
Felix Stupp
8cedaee7ba
generate_preference_score: Add static scores
...
for following properties:
- id (for consistent order)
- age
- began to watch
- count of tags
- times pinned
2 years ago
Felix Stupp
3c64bc6f66
generate_preference_score: Add auto tag for extractor
2 years ago
Felix Stupp
0e266c55b6
generate_preference_list: Use set instead of recalling object_gen
...
- removes advanced feature of listing blocked videos ahead
- was not practical for UI as videos were displayed which "require" others
- using a set to manage still to consider videos makes method way faster
2 years ago
Felix Stupp
bd77ed7fb0
generate_preference_list: Move var res_ids to appropiate section
2 years ago
Felix Stupp
0599b03daa
generate_preference_list: Separate sections of god method
2 years ago
Felix Stupp
1145a09e3e
generate_preference_list: Add "collection tags" by iter collections
...
itering collections than elements for their collections is most of the
time faster as mostly all collections are involved
2 years ago
Felix Stupp
748201ec2b
generate_preference_list: Revert Tag table auto incr value
...
- not reverted by default when ROLLBACK on MariaDB is issued
- resetting to 1 works because DB will still ensure no duplicates occure
2 years ago
Felix Stupp
7b96a6e2c6
Add MediaCollectionLink.desc_sort_key
2 years ago
Felix Stupp
0b44e77677
Reorder attributes of MediaCollection
2 years ago
Felix Stupp
7248ef96cd
entertainment_decider/models: Add return types for mypy
2 years ago
Felix Stupp
e53ffccef3
Reorder & categorize MediaElement attributes
2 years ago
Felix Stupp
9ea4a728d6
Rework Tagable implementation
...
Split into orm compatible & non-compatible methods
FIX Tagable on MediaElement
FIX Tagable MediaColl
2 years ago
Felix Stupp
c7b63dfedb
models: Fix build of custom table defs
...
- missing .items() call for "for" with dict
- missing db session on setup
2 years ago
Felix Stupp
bbaa79f20a
models:table_exists: use pony-given approach
2 years ago
Felix Stupp
51a13abb88
entertainment_decider/models: Remove TODO about static table names
2 years ago
Felix Stupp
fd7d413fe2
Add MediaElement properties detected_{creators,playlists}
2 years ago
Felix Stupp
c8d755770f
Allow PreferenceScore.adapt_score to apply only flat
2 years ago
Felix Stupp
c766ca1c58
Reformat PreferenceScore.adapt_score
2 years ago
Felix Stupp
ee9f89a87d
Tagable: Implement tag_hierachy & all_tags separately
...
Other implementation of all_tags makes it much, much faster
2 years ago
Felix Stupp
d56cf1ae94
TagTreeElement.shareScore: Filter tags for score sharing by use_for_preferences
2 years ago
Felix Stupp
760010e743
Rewrite PreferenceScore.(from|to)_base64 to method chaining
...
Solves mypy issues while looking clean
2 years ago
Felix Stupp
a039aafff2
PreferenceScore.calculate_score improved
2 years ago
Felix Stupp
cf80adda94
Declare MediaCollection.release_date nullable
2 years ago
Felix Stupp
51c1ee5c08
Add missing Optional on _load_object & use explcit is None checks
2 years ago
Felix Stupp
2214df4561
Add capability to inject episodes from collection updates
2 years ago
Felix Stupp
7c96aaa6a7
Avoid circular dependency by moving import into function
2 years ago
Felix Stupp
39b3ac278b
extractors: Add & Fix return types
...
tt_rss's _update_object_raw should have never returned a str
2 years ago
Felix Stupp
7c5d8e7748
entertainment_decider/models: Clean code for mypy
...
- add return types
- rename used TypeVar to avoid override
- adapt type of MediaCollection.creator to reflect Optionality
2 years ago
Felix Stupp
c59000847d
Decrease external cache time for ytdl to 1 day
2 years ago
Felix Stupp
94fc20cb89
Declare entertainment_decider/extractors a module
...
by creating an empty __init__.py
2 years ago
Felix Stupp
6ab8781520
Add way to inject object while extracting
...
To save extracting work, if e.g. updating a collection also receives
data about medias in it (which then do not need any more requests)
2 years ago
Felix Stupp
ae047a0c47
extractors/generic: Clean code
...
- Reformat
- Add return types
- Remove unrequired imports
2 years ago
Felix Stupp
5d68e03971
common: Add helper for string trimming
...
like defined in PEP 257
2 years ago
Felix Stupp
43e1d6902f
common: Add helper to convert date to datetime
2 years ago
Felix Stupp
ddb248ca62
common: Add type hints to call helper
2 years ago
Felix Stupp
051d4a7ccd
Added logging to suitable extractor search
2 years ago
Felix Stupp
f8b9825a2a
TtRssCollectionExtractor: Increase cache timeout to 15 minutes
2 years ago
Felix Stupp
e486dccf8e
Add capability to mark TT-RSS feed items as read
2 years ago
Felix Stupp
321847446b
Add sorting mechanism post collection update
...
e.g. sort some collections strictly on release date
(if collection author is not capable of sorting them ...)
2 years ago
Felix Stupp
f51cbc31c3
CollectionExtractor._add_episode: Only log on link change
2 years ago
Felix Stupp
a1b64d8644
extractors/collection/base: Reformat code
2 years ago
Felix Stupp
ed8fc4439e
Introduce dynamic cache calculation for YouTube collection
2 years ago
Felix Stupp
49cff6f300
uri_suitable: Explicitly check for "is not None" & use helper methods
...
- helper for convertion from boolean to SuitableLevel
2 years ago
Felix Stupp
54748a9540
_check_cache_expired modified to be able to access full object
...
for more advanced calculations about caching
2 years ago
Felix Stupp
2e97563e0e
YtdlMediaExtractor._update_object_raw: Add return type
2 years ago
Felix Stupp
bdfcd43a5f
models: Extract common Uri methods to own class
2 years ago
Felix Stupp
f282ad7ff1
Add property MediaElement.average_release_per_week{,_now}
2 years ago
Felix Stupp
9e4b2bab5e
Add property MediaElement.started
2 years ago
Felix Stupp
3f68d4c5fd
MediaThumbnail.data: Add reason for lazy setting
2 years ago
Felix Stupp
a9cae7ab1e
MediaCollection: Add indices to keep_updated, pinned, watch_in_order
...
for faster DB requests
2 years ago
Felix Stupp
abf01da286
MediaElement: Add indeces to watched & ignored & compositum of both
2 years ago
Felix Stupp
5267f98cad
Add MediaCollection.description attribute / column
2 years ago
Felix Stupp
214cfdffba
MediaCollection.add_episode: automatically mark new episodes or ignored colls as ignored
2 years ago
Felix Stupp
fac70231e8
MediaCollection.add_episde: detect change & act accordingly
...
- only apply changes if episode is new or new data is given
- flush only if changes are given
- return link only on changes / creation
2 years ago
Felix Stupp
4a0a6b918a
models.py: Reformat code
2 years ago
Felix Stupp
52a5aa29d7
models: Make table names non-hardcoded
2 years ago
Felix Stupp
66c37e72aa
models: Extract table name "element_lookup_cache" to constant
2 years ago
Felix Stupp
f810591c2c
Revert "Add ConsideredMediaGenerator"
...
This reverts commit a5844cc424
2 years ago
Felix Stupp
a5844cc424
Add ConsideredMediaGenerator
...
Developed for faster method to find considerable media
2 years ago
Felix Stupp
7e5e58c487
models.py: Reformated code
2 years ago
Felix Stupp
ef09aea0b5
MediaElement: Add index to release_date
2 years ago
Felix Stupp
e5dc2db760
MediaElement.watched: Fix column name
2 years ago
Felix Stupp
7ea87a1e0d
Use element_lookup_cache
...
- caches by what elements other elements are blocked
- resolves lookups for ordered playlists
2 years ago
Felix Stupp
05fcd9fb6a
MediaElement: add direct blockings
2 years ago
Felix Stupp
53185505b1
MediaElement.left_length: return 0 if watched
2 years ago
Felix Stupp
a923d99e82
MediaElement.can_considered: Only request data for ordered collections
2 years ago
Felix Stupp
cc8cb6b072
models: Redefine Query to be more usable for type hinting
2 years ago
Felix Stupp
85363aed4b
MediaElement.can_considered: verify video already released
2 years ago
Felix Stupp
5c97fe4b77
Implemented element_lookup_cache
...
- not used for now
2 years ago
Felix Stupp
96774bc43e
Add support for custom tables
2 years ago
Felix Stupp
2a7654bf9f
Add helper annotation for profiling functions
2 years ago
Felix Stupp
babdf8ff64
extr/media/youtube: Reraise exceptions from extraction as ExtractionErrors
2 years ago
Felix Stupp
33ac573a57
extr/media/youtube: Ignore live streams until they are available as VOD
2 years ago
Felix Stupp
922c9fd5a2
extr/media/youtube: Rename extractor to "youtube"
2 years ago
Felix Stupp
0debf4d875
extr/media/youtube: support embed & shorts video links
2 years ago
Felix Stupp
5479db90b8
extr/media/youtube: Also support youtube-nocookie links
2 years ago
Felix Stupp
35024597df
extr/media/youtube: Rewrite URI so extractor works deteministicly
2 years ago
Felix Stupp
6bb65981c9
extr/media/youtube: Explicit check for suitable URI
2 years ago
Felix Stupp
902dd1a6bf
models:MediaCollection: Add creator / created_collections relation
2 years ago
Felix Stupp
6f9adbfc25
models: Make Query Type hacky typeable
2 years ago
Felix Stupp
96e12f6fe8
extr/coll,media/youtube: Move setting URLs to media extractor
2 years ago
Felix Stupp
4e62a3fe70
extr/media/youtube: Extract description
2 years ago
