Q4OS Forum

Jerome

Member

Registered: 2016-02-26

Posts: 148

youtube-dl stopped working

I've been using youtube-dl successfully for some time but for a couple of days I've been getting errors when downloading from bbciplayer (anyone here from the UK?). I tried updating to the latest version but still getting the same error. Example:

youtube-dl http://www.bbc.co.uk/iplayer/episode/b0 … -episode-1
[bbc.co.uk] b08lnkvv: Downloading video page
[bbc.co.uk] b08lnkvs: Downloading media selection XML
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading MPD manifest
[bbc.co.uk] b08lnkvs: Downloading MPD manifest
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading MPD manifest
[bbc.co.uk] b08lnkvs: Downloading MPD manifest
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
[bbc.co.uk] b08lnkvs: Downloading m3u8 information
WARNING: Your copy of avconv is outdated and unable to properly mux separate video and audio files, youtube-dl will download single file media. Update avconv to version 10-0 or newer to fix this.
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 378
[download] Destination: The Graham Norton Show, Series 21 - Episode 1-b08lnkvs.mp4
[download]   9.5% of ~1.88GiB at 821.42KiB/s ETA 40:05ERROR: unable to download video data: <urlopen error [Errno 110] Connection timed out>

It has nothing to do with the avconv error which has always been there. There's another application called get-iplayer, but there's no package in Debian jessie.

Any suggestions? Thanks.

Last edited by Jerome (2017-04-09 16:57)

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

A quick google gave me this page (among others) which indicate the problem could be due to proxies or a break in network connection, if you are using a proxy or have recently changed the proxy you use that could be the issue. There were also other results in my google search that gave similar conclusion (usually proxies).

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

Hi Dai_trying,

I've never used a proxy and nothing's changed with regard to my browser between when things were working ok and now. But thanks for the suggestion.

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

I just installed and am currently downloading from http://www.bbc.co.uk/iplayer/episode/b0 … -episode-1 without issue... Are you using the latest version?

EDIT:
To install the latest version use these two commands

sudo wget https://yt-dl.org/downloads/latest/youtube-dl -O /usr/local/bin/youtube-dl
sudo chmod a+rx /usr/local/bin/youtube-dl

Last edited by Dai_trying (2017-04-09 17:39)

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

Yes, latest version. But to be sure I've just reinstalled it. Usually it starts downloading without a problem but then some % into the download it aborts with the error message. Trying to download again...

Are you getting the "Your copy of avconv is outdated..." message?

Last edited by Jerome (2017-04-09 18:49)

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

If you installed the version from repository and then install this newer version via direct download you may not be using the newer version from the command line, check the location with

which youtube-dl

and it should tell you the location, if it is not /usr/local/bin/youtube-dl then you can either remove the repo installed version or alias the command to the correct path. If you use an alias it can be saved to ~/.bashrc to make it permanent.

EDIT: Yes I get the same avconv messages.

Last edited by Dai_trying (2017-04-09 18:58)

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

This time the connection failed after 58.7% of the download:

[download]  58.7% of ~1.87GiB at 399.84KiB/s ETA 18:14ERROR: unable to download video data: <urlopen error [Errno 110] Connection timed out>

I've always installed the version from the site because the version in the repo didn't work, so that's not the problem (and there is no repo version on my system).

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

I just ran another test to make sure and this is the full terminal output:-

dai@q4scorpion23:~$ youtube-dl http://www.bbc.co.uk/iplayer/episode/b08lqbrs/hinterland-series-3-episode-1-part-1
[bbc.co.uk] b08lqbrs: Downloading video page
[bbc.co.uk] b08lq9c9: Downloading media selection XML
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading MPD manifest
[bbc.co.uk] b08lq9c9: Downloading MPD manifest
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading MPD manifest
[bbc.co.uk] b08lq9c9: Downloading MPD manifest
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
[bbc.co.uk] b08lq9c9: Downloading m3u8 information
WARNING: Your copy of avconv is outdated and unable to properly mux separate video and audio files, youtube-dl will download single file media. Update avconv to version 10-0 or newer to fix this.
[hlsnative] Downloading m3u8 manifest
[hlsnative] Total fragments: 460
[download] Destination: Hinterland, Series 3 - Episode 1 - Part 1-b08lq9c9.mp4
[download] 100% of 1.14GiB in 16:32
[ffmpeg] Fixing malformated aac bitstream in "Hinterland, Series 3 - Episode 1 - Part 1-b08lq9c9.mp4"
WARNING: Your copy of avconv is outdated, update avconv to version 10-0 or newer if you encounter any errors.

I just realised I'm running on Scorpion, I keep forgetting that I will check in a VM to see if Orion works.

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

First test in Orion VM failed but with different code and it ran really slowly, I then ran update and dist-upgrade, installed ffmpeg and tried again and everything worked as expected, and I did not get warnings about avconv this time.
Have you updated your system? and are you running kernel from backports?

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

I'm not running the kernel from backports, but the version of ffmpeg I had needed upgrading, so that may have been the problem (I did an update and dist-upgrade first).  I'll try again using the new version and get back to you. Thanks again.

Last edited by Jerome (2017-04-10 09:44)

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

No good. Only got as far as 2.8% of the download this time. Could you let me know which commands I need to install the kernel from backports?

If that doesn't work I might install Scorpion. Or is it better to wait until Debian 9 (stable) is released which hopefully will be soon?

Last edited by Jerome (2017-04-10 10:25)

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

I don't think the backport kernel will help with this, I just wondered if you were using it as I don't get the avconv warnings on my Orion installation but I get them on my Scorpion installation... That is a bit strange and it's why I thought you may be using it.

I have just running another test in Orion and it worked without issue (output below, notice no avconv warnings), the only difference I can see is I am using the default ffmpeg, can I ask what you needed the newer version for?

dai@vboxorion:~$ youtube-dl http://www.bbc.co.uk/iplayer/episode/p03lgtd7/line-of-duty-the-story-so-far-series-1-and-2#group=p00yzlr0
[bbc.co.uk] p03lgtd7: Downloading video page
[bbc.co.uk] p03n0wk2: Downloading media selection XML
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading MPD manifest
[bbc.co.uk] p03n0wk2: Downloading MPD manifest
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading MPD manifest
[bbc.co.uk] p03n0wk2: Downloading MPD manifest
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[bbc.co.uk] p03n0wk2: Downloading m3u8 information
[dashsegments] Total fragments: 190
[download] Destination: Line of Duty, The Story So Far - Series 1 and 2-p03n0wk2.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4
[download] 100% of 301.90MiB in 03:29
[dashsegments] Total fragments: 190
[download] Destination: Line of Duty, The Story So Far - Series 1 and 2-p03n0wk2.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-audio=128000.m4a
[download] 100% of 10.99MiB in 00:45
[ffmpeg] Merging formats into "Line of Duty, The Story So Far - Series 1 and 2-p03n0wk2.mp4"
Deleting original file Line of Duty, The Story So Far - Series 1 and 2-p03n0wk2.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-video=5070000.mp4 (pass -k to keep)
Deleting original file Line of Duty, The Story So Far - Series 1 and 2-p03n0wk2.fstream-uk-iptv_streaming_concrete_combined_hd_mf_limelight_uk_dash_https-audio=128000.m4a (pass -k to keep)

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

Well I was using the default ffmpeg, but thought that it might be the cause of the error (even though it's been ok up until now), which is why I decided to install the newer version.

Funny that on the Debian wiki it says ffmpeg is only available from backports? But it's installed by default with Orion (not from backports I assume).
https://wiki.debian.org/ffmpeg

Anyway, the problem may have nothing to do with ffmpeg.

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

Yes sorry my mistake, ffmpeg is not in standard repo for Orion, it is installed from backports.

Are you having any other internet connection problems?

JimW

Member

Registered: 2015-12-08

Posts: 400

Re: youtube-dl stopped working

I use youtube-dl frequently, so I thought I'd give it a try. Whoops! geolocation error! Guess I'm on the wrong side of the pond, so you will have to figure it out over there. No need to add more complications to it!

Hope you get it working!

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

@ Dai_trying,

No, I've had no other internet connection problems. The only thing I can think of which may have something to do with it is I installed the "mono-complete" package because I needed it for an application, and then I removed the application (and did a apt-get autoremove). Then the next time I tried to use youtube-dl I started getting the errors. But that may have nothing to do with it.

@ JimW,

Not sure whether it's a bbciplayer specific error. And that's a thought, maybe I should try downloading a vid from youtube, if there are no problems there it would suggest the error has something to do with bbciplayer in particular (and my system, because Dai_trying hasn't had any problems).

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

Ok, some progress. I downloaded a random vid from youtube using youtube-dl without issue. So it could be a problem specific to bbciplayer?

However, the vid was only 65 Mb so maybe the problem only occurs with larger downloads and isn't specific to iplayer. I'll try downloading a larger vid.

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

I've just downloaded a full-length movie from youtube with no problems, so it does seem as though the problem has something to do with bbciplayer.

Dai_trying

Member

From: UK

Registered: 2015-12-14

Posts: 2,989

Re: youtube-dl stopped working

I just ran another test, this time from a freshly installed Q4OS 1.8.3 iso. I did have an error after 98.7% of audio download (after video d/l 1.3Gb) and simply entered the command again and it picked up from where it left off and another minute or so I had the proper video file available. So although this is not desired performance, it can easily be continued without having to start the download all over again, which is better than what I was expecting.

btw this was an BBC-iPlayer download

Jerome

Member

Registered: 2016-02-26

Posts: 148

Re: youtube-dl stopped working

Ok thanks, I'll try doing that.