Project

General

Profile

Bug #364

TVDB scraper stopped working

Added by dandar3 8 months ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assignee:
Category:
Scraper (Music/Video Metadata
Target version:
Start date:
04/08/2020
Due date:
% Done:

0%

Resolution:
Affected Version:

Description

TVDB scraper stopped working again.

Issue reported here:
https://www.xbmc4xbox.org.uk/forum/viewtopic.php?f=6&t=14364

I've run a quick test myself and there's two things that I found.
1) thetvdb.com will redirect the HTTP into an HTTPS
2) it fails when unpacking the zip file.

Does XBMC4Xbox support HTTPS/SSL or does it fail silently providing the scraper with an invalid ZIP file that will fail to decompress?

10:41:56 M: 32382976   DEBUG: VideoInfoScanner: Found episode match f:\tv shows\the mentalist\the.mentalist.s02e01.640x360.avi (s2e1) [[Ss]([0-9]+)[][ ._-]*[Ee]([0-9]+)([^\\/]*)$]
10:41:56 M: 32387072   DEBUG: CurlFile::Open(D00E52AC) http://www.thetvdb.com/api/1D62F2F90030C444/series/82459/all/en.zip
...
10:41:56 M: 31993856   DEBUG: advapi32.dll fake function dllCryptAcquireContext() called
10:41:56 M: 31993856   DEBUG: advapi32.dll fake function dllCryptReleaseContext() called
10:41:56 M: 31993856   DEBUG: advapi32.dll fake function dllCryptAcquireContext() called
...
10:43:21 M: 33951744   ERROR: FileZip: extended local header, not supported!
10:34:21 M: 33951744   DEBUG: scraper: GetEpisodeList returned <episodeguide></episodeguide>

History

#1

Updated by dandar3 8 months ago

The HTTPS might be the issue cause I've download the ZIP archive, uploaded into into Z: drive, navigated from XBMC4Xbox > File Manager and it was able to open it. dammit.

#2

Updated by buzz 8 months ago

Our libCurl should work ok with https but would have to debug it further. Did you try using https directly bypassing the redirect ?

#3

Updated by dandar3 8 months ago

buzz wrote:

Our libCurl should work ok with https but would have to debug it further. Did you try using https directly bypassing the redirect ?

Thanks Buzz, no I haven't, noticed accross the scraper files we were using HTTP as opposed to HTTPS and thought that might be issue. I will try the HTTPS directly and see how that goes, at least it will rule out the redirect as an issue. (Y)

#4

Updated by dandar3 8 months ago

This bugs the hell out of me. I've change the protocol from HTTP to HTTPS in tvdb.xml and it completely ignores it, it still goes HTTP and drives me nuts cause I don't know where it reads it from. I've even added some aditional log statements to prove it.

19:46:53 M: 35512320 DEBUG: CScraperParser::Load() - strXMLFile = special://xbmc/system/scrapers/video/
19:46:53 M: 35512320 DEBUG: CScraperParser::Load() - strXMLFile = special://xbmc/system/scrapers/video/tvdb.xml
19:46:53 M: 35442688 DEBUG: CFileItemList::Sort, sorting took 0 millis
19:46:53 M: 35442688 DEBUG: VideoInfoScanner: Found episode match f:\tv shows\the mentalist\the.mentalist.s02e02.640x360.avi (s2e2) [[Ss]([0-9]+)[][ ._-]*[Ee]([0-9]+)([^\\/]*)$]
19:46:53 M: 35373056 DEBUG: CScraperParser::Load() - strXMLFile = special://xbmc/system/scrapers/video/tvdb.xml
19:46:53 M: 35373056 DEBUG: CScraperUrl::Get() - scrURL.m_cache = (null)
19:46:53 M: 35373056 DEBUG: CScraperUrl::Get() - scrURL.m_url = http://www.thetvdb.com/api/1D62F2F90030C444/series/82459/all/en.zip

Definitely the right scraper file (Q:/system/scrapers/video/tvdb.xml) cause if I rename it or remove it it won't print out at all. I also renamed not only the protocol thinking there might somewhere a string conversion from one to the other, even changed the last part [language].zip and added something stupid, same thing logged and same thing I see going through the proxy.

Also if I go again to try and Refresh the same episode info in the attempt to ask me and scan again, it will come back very quickly. I have to choose another episode to see it kicking CURL and then it drives me nuts with the old URL.

Any ideas?

Also available in: Atom PDF