Page 1 of 3
[1.1.0RC2] Very, very slow initial connexion to Usenet serve
Posted: August 1st, 2016, 5:00 am
by EvilFlanders
Hi!
As you can see in the pastebin, it takes sab about 20 seconds to establish 30 connexions. Is that normal? I've tried Nzbvortex for a change and will not keep using it but it managed to start downloads almost immediately.
Thanks
http://pastebin.com/Ja7L0BcH
EDIT by Sander:
Code: Select all
2016-08-01 11:43:26,144::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:26,593::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:26,596::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:27,515::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
...
2016-08-01 11:43:43,245::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:43,802::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
2016-08-01 11:43:43,803::INFO::[downloader:446] [email protected]: Initiating connection
2016-08-01 11:43:44,288::INFO::[happyeyeballs:111] Quickest IP address for news-eu.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.238
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting [email protected] finished
2016-08-01 11:43:44,381::INFO::[downloader:649] Connecting [email protected] finished
2016-08-01 11:43:44,382::INFO::[downloader:649] Connecting [email protected] finished
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 7:32 am
by sander
Do you mean the first download only starts after 20 seconds? Or does the first download start after 1 second?
Anyway:
In SABnzbd: Config -> Switches -> Server load-balancing ... change to the first option "Prevent Load-balancing", and try again. Post back the result.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 8:28 am
by EvilFlanders
Thanks sander, it solved the problem.
The lag occurred on the first download after sab was disconnected from the server i.e. with 0 active connections.
With the setting you've advised, the download starts immediately after an nzb has been imported.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 9:26 am
by sander
Are you on Linux or MacOS? If so, can you do an extra test?
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 9:29 am
by EvilFlanders
Sure! I'm using MacOS v10.11.6 (15G31)
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 11:56 am
by sander
OK, great. Before the Real Test, can you do this:
In SABnzbd: Config -> Switches -> Server load-balancing ... change to the second option "Allow Load Balancing". Retest and please post the result here.
PS:
Please do this too: click on the Wrench symbol in the upper right corner, and set Logging to +Debug.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 12:29 pm
by EvilFlanders
To summarise, knowing that I press "Force disconnect" between every try:
"Prevent Load-balancing" takes less than a second to start downloading.
"Allow Load Balancing" takes 2 seconds to start downloading.
"Allow Load Balancing with optimisation for IPv6" takes from 15 to 20 seconds to start downloading.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 3:40 pm
by sander
OK, next step:
I'm assuming that on MacOS you run SABnzbd from source. If so, can you find the directory "sabnzbd" with the file "downloader.py" in it?
If so, open it for editing and find these lines:
Code: Select all
# RFC6555 / Happy Eyeballs:
ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl)
and change the second line to:
Code: Select all
# RFC6555 / Happy Eyeballs:
ip = happyeyeballs(self.host, port=self.port, ssl=self.ssl, preferipv6=False)
Save and exit and (re)start SABnzbd.
In SABnzbd, select/keep the option "Allow Load Balancing with optimisation for IPv6" and retest.
Please also post the relevant sabnzbd.log
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 1st, 2016, 5:16 pm
by EvilFlanders
Sorry I'm using the packaged app (as in
https://github.com/sabnzbd/sabnzbd/rele ... g/1.1.0RC2).
And I can't find the downloader.py file either in the package contents or on my computer. Is it different for the packaged app?
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 2nd, 2016, 2:07 am
by sander
I see. So that is not possible. Pity.
Something else to test then: did you set Logging to +Debug? And the load balancing to the third option (so: "Allow Load Balancing with optimisation for IPv6" )?
Can you then do a download again, and show the sabnzbd.log lines with happy eyeballs?
What I still don't understand: your experience seems to be that SAB only starts downloading after the last connection has been set up. I find that strange. Hopefully @shypike can say something about this.
EDIT:
PS: I now see news.newshosting.com has only IPv4 addresses and no IPv6 addresses, so IPv6 can't be a reason for what you describe. So my request for "preferIPv6 = False" would probably not have revealed something useful
Code: Select all
news.newshosting.com 563 True True
DEBUG:root:No IPv6 address found for news.newshosting.com
DEBUG:root:Input for thread is 81.171.92.238 563 True
DEBUG:root:Input for thread is 81.171.92.224 563 True
INFO:root:Quickest IP address for news.newshosting.com (port 563, ssl True, preferipv6 True) is 81.171.92.224
DEBUG:root:Happy Eyeballs lookup and port connect took 41 ms
81.171.92.224
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 2nd, 2016, 12:55 pm
by EvilFlanders
Sorry but there was lot of "Happy Eyeballs" lines and some others in between. I preffered to make whole extracts for the three alternatives if it's okay with you. Here they are:
Prevent Load Balancing:
http://pastebin.com/eeXpKBGi
Allow Load Balancing:
http://pastebin.com/W2GbCcfd
Allow Load Balancing with optimisation for IPv6:
http://pastebin.com/0w3zyb8r
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 2nd, 2016, 1:00 pm
by EvilFlanders
P.S. And, yes, there are issues with newshosting's IPv6. They have newsserver IPv6 addresses but I cannot reach them (see list
here).
Apparently, there are known issues with MacOSX and IPv6 reversing since I can't ping Google's IPv6 DNSs nor set them in my DNS settings either.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 3rd, 2016, 3:15 am
by sander
I'll investigate further this weekend.
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 19th, 2016, 8:40 pm
by mastyman
ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it
i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.
I dont have IPv6 available on my wan connection.
[1.1.0RC3] on Windows 10x64
Re: [1.1.0RC2] Very, very slow initial connexion to Usenet s
Posted: August 20th, 2016, 2:26 am
by sander
mastyman wrote:ah, i had the same problem, when i switched from supernews, to newsgroup ninja, about a week ago, it was crazy slow for the download to start on newsgroup ninja- 10-20 seconds, whereas supernews was instant for the many years i used it
i switched to "Allow Load Balancing" instead of "Allow Load Balancing with optimisation for IPv6" and now its almost INSTANT download start on newsgroup ninja.
I dont have IPv6 available on my wan connection.
[1.1.0RC3] on Windows 10x64
Mastyman, more info would be nice:
- you use news.newsgroup.ninja ?
- how many connections?
- SSL newsserver connection, or plain connection?