266 Commits (master)

Author SHA1 Message Date
Felix Stupp ae047a0c47
extractors/generic: Clean code
- Reformat
- Add return types
- Remove unrequired imports
2 years ago
Felix Stupp 5d68e03971
common: Add helper for string trimming
like defined in PEP 257
2 years ago
Felix Stupp 43e1d6902f
common: Add helper to convert date to datetime 2 years ago
Felix Stupp ddb248ca62
common: Add type hints to call helper 2 years ago
Felix Stupp 051d4a7ccd
Added logging to suitable extractor search 2 years ago
Felix Stupp f8b9825a2a
TtRssCollectionExtractor: Increase cache timeout to 15 minutes 2 years ago
Felix Stupp e486dccf8e
Add capability to mark TT-RSS feed items as read 2 years ago
Felix Stupp 321847446b
Add sorting mechanism post collection update
e.g. sort some collections strictly on release date
(if collection author is not capable of sorting them ...)
2 years ago
Felix Stupp f51cbc31c3
CollectionExtractor._add_episode: Only log on link change 2 years ago
Felix Stupp a1b64d8644
extractors/collection/base: Reformat code 2 years ago
Felix Stupp ed8fc4439e
Introduce dynamic cache calculation for YouTube collection 2 years ago
Felix Stupp 49cff6f300
uri_suitable: Explicitly check for "is not None" & use helper methods
- helper for convertion from boolean to SuitableLevel
2 years ago
Felix Stupp 54748a9540
_check_cache_expired modified to be able to access full object
for more advanced calculations about caching
2 years ago
Felix Stupp 2e97563e0e
YtdlMediaExtractor._update_object_raw: Add return type 2 years ago
Felix Stupp bdfcd43a5f
models: Extract common Uri methods to own class 2 years ago
Felix Stupp f282ad7ff1
Add property MediaElement.average_release_per_week{,_now} 2 years ago
Felix Stupp 9e4b2bab5e
Add property MediaElement.started 2 years ago
Felix Stupp 3f68d4c5fd
MediaThumbnail.data: Add reason for lazy setting 2 years ago
Felix Stupp a9cae7ab1e
MediaCollection: Add indices to keep_updated, pinned, watch_in_order
for faster DB requests
2 years ago
Felix Stupp abf01da286
MediaElement: Add indeces to watched & ignored & compositum of both 2 years ago
Felix Stupp 5267f98cad
Add MediaCollection.description attribute / column 2 years ago
Felix Stupp 214cfdffba
MediaCollection.add_episode: automatically mark new episodes or ignored colls as ignored 2 years ago
Felix Stupp fac70231e8
MediaCollection.add_episde: detect change & act accordingly
- only apply changes if episode is new or new data is given
- flush only if changes are given
- return link only on changes / creation
2 years ago
Felix Stupp 4a0a6b918a
models.py: Reformat code 2 years ago
Felix Stupp 52a5aa29d7
models: Make table names non-hardcoded 2 years ago
Felix Stupp 66c37e72aa
models: Extract table name "element_lookup_cache" to constant 2 years ago
Felix Stupp f810591c2c
Revert "Add ConsideredMediaGenerator"
This reverts commit a5844cc424,
because developed method was not fast enough & it was faster to use a
SQL native method developed afterwards
2 years ago
Felix Stupp a5844cc424
Add ConsideredMediaGenerator
Developed for faster method to find considerable media
2 years ago
Felix Stupp 7e5e58c487
models.py: Reformated code 2 years ago
Felix Stupp ef09aea0b5
MediaElement: Add index to release_date 2 years ago
Felix Stupp e5dc2db760
MediaElement.watched: Fix column name 2 years ago
Felix Stupp 7ea87a1e0d
Use element_lookup_cache
- caches by what elements other elements are blocked
- resolves lookups for ordered playlists
2 years ago
Felix Stupp 05fcd9fb6a
MediaElement: add direct blockings 2 years ago
Felix Stupp 53185505b1
MediaElement.left_length: return 0 if watched 2 years ago
Felix Stupp a923d99e82
MediaElement.can_considered: Only request data for ordered collections 2 years ago
Felix Stupp cc8cb6b072
models: Redefine Query to be more usable for type hinting 2 years ago
Felix Stupp 85363aed4b
MediaElement.can_considered: verify video already released 2 years ago
Felix Stupp 5c97fe4b77
Implemented element_lookup_cache
- not used for now
2 years ago
Felix Stupp 96774bc43e
Add support for custom tables 2 years ago
Felix Stupp 2a7654bf9f
Add helper annotation for profiling functions 2 years ago
Felix Stupp babdf8ff64
extr/media/youtube: Reraise exceptions from extraction as ExtractionErrors 2 years ago
Felix Stupp 33ac573a57
extr/media/youtube: Ignore live streams until they are available as VOD 2 years ago
Felix Stupp 922c9fd5a2
extr/media/youtube: Rename extractor to "youtube" 2 years ago
Felix Stupp 0debf4d875
extr/media/youtube: support embed & shorts video links 2 years ago
Felix Stupp 5479db90b8
extr/media/youtube: Also support youtube-nocookie links 2 years ago
Felix Stupp 35024597df
extr/media/youtube: Rewrite URI so extractor works deteministicly 2 years ago
Felix Stupp 6bb65981c9
extr/media/youtube: Explicit check for suitable URI 2 years ago
Felix Stupp 902dd1a6bf
models:MediaCollection: Add creator / created_collections relation 2 years ago
Felix Stupp 6f9adbfc25
models: Make Query Type hacky typeable 2 years ago
Felix Stupp 96e12f6fe8
extr/coll,media/youtube: Move setting URLs to media extractor 2 years ago
Felix Stupp 4e62a3fe70
extr/media/youtube: Extract description 2 years ago
Felix Stupp c9c60d4e2b
extr/media/ytdl: Extract description 2 years ago
Felix Stupp 2e9df67e86
models: Add optional description to MediaElement 2 years ago
Felix Stupp 683a7a2555
extr/media/ytdl: Add thumbnail of video 2 years ago
Felix Stupp cfa3012798
extr/media/ytdl: Restrict to https?:// urls 2 years ago
Felix Stupp f0af32c099
Extract media thumbnail automatically from YouTube 2 years ago
Felix Stupp dfee06106f
ent_dec/extr/med/base:MediaExtractor._get_auth_d: Fix not using TypeVar 2 years ago
Felix Stupp f236db4084
Format code
- server/entertainment_decider/common.py
- server/entertainment_decider/extractors/all/tt_rss.py
- server/entertainment_decider/extractors/all/ytdl.py
- server/entertainment_decider/extractors/collection/__init__.py
- server/entertainment_decider/extractors/collection/tt_rss.py
- server/entertainment_decider/extractors/collection/youtube.py
- server/entertainment_decider/extractors/generic.py
- server/entertainment_decider/extractors/helpers.py
- server/entertainment_decider/extractors/media/__init__.py
- server/entertainment_decider/extractors/media/base.py
- server/entertainment_decider/extractors/media/youtube.py
- server/entertainment_decider/extractors/media/ytdl.py

Applied automatically using black
2 years ago
Felix Stupp b7cbcbd540
Reformat models.py 2 years ago
Felix Stupp 44eb0850f0
Add thumbnail support to MediaElements 2 years ago
Felix Stupp bd72ad77bb
Reformat code (partially using black) 2 years ago
Felix Stupp d73cda2e5b
MediaCollection.completed: Rewrite to use orm/db mapping 3 years ago
Felix Stupp b42611f38c
MediaCollection.next_episode: Moved operation into orm/db 3 years ago
Felix Stupp 043c49c0e1
MediaCollection.__to_watch_epsiodes: Replaced watched/ignored check with skip_over 3 years ago
Felix Stupp 73a48f502c
Added PreferenceScore.get_first_by_score and used for performance 3 years ago
Felix Stupp d0c2aab529
Added youtube media extractor based on new version of youtubesearchpython 3 years ago
Felix Stupp 075b0a544c
extractors.SuitableLevel: Added methods for fancy tenary's 3 years ago
Felix Stupp 9d0fc6b08c
PreferenceScore: Add methods to pickle to/from json/base64 3 years ago
Felix Stupp 840a85c62f
MediaCollection.__to_watch_episodes: Add pony's Query as return type 3 years ago
Felix Stupp 0c205b2a43
MediaCollectionLink: Extract sort_key as replacement for natural_sort 3 years ago
Felix Stupp 20ce11b9e7
TagRootElement.share_score: Also abort if points to share are 0 3 years ago
Felix Stupp 5743b70d96
models ignored_recurive: Reworked for simplicity 3 years ago
Felix Stupp 099b3423e9
models ignored_recursive: Fix searching links for this episode 3 years ago
Felix Stupp 862cf78c74
models: Fix column name of MediaElement.ignored 3 years ago
Felix Stupp a51aa48941
extractors/collection: Extract _add_episode into base 3 years ago
Felix Stupp 629e125838
models: MediaCollection: Increase effiency of completed property 3 years ago
Felix Stupp 0c1b82a9cd
Add general overall dashboard 3 years ago
Felix Stupp 39d8c4f535
models: Add MediaCollection.pinned property 3 years ago
Felix Stupp 87b4fb03ea
models: Fix MediaElement.can_considered check for being next episode 3 years ago
Felix Stupp 5b78e8120c
add MediaCollection|MediaElement.add_single_uri and rewrite appropiate usages 3 years ago
Felix Stupp c77e0ac81e
entertainment_decider/extractors/generic: Add debug log for skipped elements due to cache timeout 3 years ago
Felix Stupp 18ec39e7b2
extractors/collection/tt_rss: Remove debug priting for labels 3 years ago
Felix Stupp b982f7b5bb
extractors/collection/tt_rss: Decrease cache timeout to 10 minutes 3 years ago
Felix Stupp c99c69b7df
extractors/collection/*: Fix check for cache timeout 3 years ago
Felix Stupp 6b45d0fbd1
extractors/{collection,media}: Add *_update method 3 years ago
Felix Stupp 4d5f5ea4d4
extractors/{collection,media}: Extract *_expect_extractor "partial" method 3 years ago
Felix Stupp bf14abc887
models: Fix MediaElement.can_considered to check if next episode link is None 3 years ago
Felix Stupp f989f75806
models: Rewrite MediaElement.ignored_recursive to use fast SQL request to count 3 years ago
Felix Stupp bf548f13ad
models: let MediaElement.left_length return 0 if video already watched 3 years ago
Felix Stupp 26ea1d6451
models: Add missing "super_tags" property to Tag 3 years ago
Felix Stupp d32e8feddd
models: Fix Tagable to correctly return TagTreeElement's and not Tags 3 years ago
Felix Stupp 37e7d602e8
models.py: Fix Tagable.assigned_tags to raise NotImplementedError 3 years ago
Felix Stupp 04d73f253d
models: Fix points on (TagRootElement|TagTreeElement).share_score to be float 3 years ago
Felix Stupp 6312143abb
Refractor/Extend tag system and add auto recommendation algorithm 3 years ago
Felix Stupp 6330443876
Allow unextracted elements and collections to exists, add/use reflecting property 3 years ago
Felix Stupp ad5a504263
extractors/collection/youtube: Normalize playlist titles as well 3 years ago
Felix Stupp 1bca3104bd
Normalize auto-generated collection titles 3 years ago
Felix Stupp d0b3795484
extractors/generic: Add Optional to load_* type hints 3 years ago
Felix Stupp b19bfbb8a4
extractors/collection: Also configure newly created collection object 3 years ago
Felix Stupp 4adb0484f3
extractors/collection: Extract method __configure_collection 3 years ago
Felix Stupp bc68e40ad7
extractors/media/base: Made 4 functions for author collections private 3 years ago
Felix Stupp 699708043c
extractors/collection/youtube: Assign better collection name for YT-channels 3 years ago
Felix Stupp aafa99cbf7
extractor/collection/{tt_rss,youtube}: Fix extracting media uri's 3 years ago
Felix Stupp 37d24b0cee
Fix searching in extractor list instead of keys 3 years ago
Felix Stupp 6f88153932
model: Added before_update handlers for auto uri linking 3 years ago
Felix Stupp 133ab9e612
models: Add headers to separate model categories 3 years ago
Felix Stupp 4c0b111620
models: Renamed _uris to uris 3 years ago
Felix Stupp bdc9cd7f5c
extractors.all.ytdl.get_playlist_info: Add required args for youtube-dl 3 years ago
Felix Stupp e41175f0fa
Extracted extractors.all.ytdl module 3 years ago
Felix Stupp 9340d4171a
Extracted extractors.all.tt_rss module 3 years ago
Felix Stupp c01d522749
extractors: Added mechanic to update last_updated date 3 years ago
Felix Stupp 86520ae30e
Added search for suitable extractor automatically 3 years ago
Felix Stupp beaf99e539
Remove extractor_cache and further usages of it 3 years ago
Felix Stupp fe183d0411
models: Remove unused extractor_cache_valid methods 3 years ago
Felix Stupp a39ad912b5
models: Renamed extractor_cache_date to last_updated for MediaCollection and MediaElement 3 years ago
Felix Stupp 83b88fb89e
Init flask / ponyorm server 3 years ago