upload problems with freebsd

[Elspuddy]

i dont know why but my two freebsd box's can't seem to upload to the server, but my windows box's can
i thorght it was just my router haveing this problem but looks like it's not
at the mo i got them looking for et, and advice on how to solve this, thanks

[Paratima]

We seem to be having Internet difficulties. I currently am unable to ping bioinfo.mshri.on.ca, which is where all the structures go to be counted.

At some point, someone will notice, then correct, the situation. Stay cool. :cool:

[Elspuddy]

any one know wht port that df uploads on, probley its someing to do with my freebsd firewall ?

[Brian the Fist]

Everything goes to port 80 just like a web browser.

[Elspuddy]

so thats my firewall out of the question
still trying to figure out why mt 2 freebsd bpx's can;t upload, when my windows box can
:bang: :help: :swear: :notworthy

[shifted]

Originally posted by Elspuddy
so thats my firewall out of the question
still trying to figure out why mt 2 freebsd bpx's can;t upload, when my windows box can
:bang: :help: :swear: :notworthy

I'm not familiar with the firewalling on BSD boxen, but make sure to add in your rules to accept packets for localhost or 127.0.0.1. This snagged me a few times before i got it on my linux router.

[TheOtherPhil]

Originally posted by Elspuddy
so thats my firewall out of the question
still trying to figure out why mt 2 freebsd bpx's can;t upload, when my windows box can
:bang: :help: :swear: :notworthy

I have exactly the same problem on multiple Linux distros (Redhat 7, 7.1, 7.2, 8, Mandrake 8, 9, Suse 8, Gentoo) and also FreeBSD. I have never been able to fix it yet I have full internet functionalty :bang:. My Winders boxen works fine though :bang:.

I changed to a different DC project as DF was too much hassle on the *nix boxes.

[Brian the Fist]

Hi, please show me the contents of your error.log file, this should have some clue as to why you are not connecting. The most likely problem though, from past experience, could be a caching proxy between you and teh internet. Are you aware of one? If you have a port sniffer available, try sniffing traffic to port 80 at www.distributedfolding.org (in both directions) when you start up the program, until it fails the upload, and show me the ASCII dump of the packets as well. Then I can tell exactly what's wrong.

[Elspuddy]

i am not aware of a caching proxy that ntl runs,
as for a sniffer program, i dont know of any for freebsd ( any one else know of one for freebsd ??)

[TheOtherPhil]

Originally posted by Elspuddy
i am not aware of a caching proxy that ntl runs,
as for a sniffer program, i dont know of any for freebsd ( any one else know of one for freebsd ??)


That's probably our problem....ntl does use a transparent caching proxy. I find it funny that my Windows boxen work but the *nix don't. All are connected to the same internet connection via my home LAN and router.

[pmfp]

Perhaps you guys have written lousy firewalls? My boxes works perfectly.

Anyway, here are two sniffing apps:
dsniff
sniffit

Both should be available through the ports system in FreeBSD.

pmfp sends

[TheOtherPhil]

Originally posted by pmfp
Perhaps you guys have written lousy firewalls? My boxes works perfectly.




I am using a hardware firewall and it works fine with my Windows machines. I even bypassed the firewall so I know it isn't a routing or network issue on my part. It is either a proxy or client issue. It is funny that all internet access is fine on the linux boxen....browsing, email, chat and other DC clients all work great but DF refuses to send work or contact the DF servers :confused:. Anyway, I am too busy now to diagnose this problem further and I'll just run G@H for now.

[Elspuddy]

can't be a bad firewall on my freebsd router because my windows box's can see the server

[Elspuddy]

as for my error log this one is from my router

========================[ Nov 24, 2002 5:21 PM ]========================
ERROR: [000.000] {foldtrajlite.c, line 1162} Unable to check server status

========================[ Nov 24, 2002 5:22 PM ]========================
ERROR: [000.000] {foldtrajlite.c, line 1162} Unable to check server status
ERROR: [000.000] {foldtrajlite.c, line 4739} Error during upload: NO RESPONSE FROM SERVER - WILL TRY AGAIN LATER

[Elspuddy]

and this one is from my new freebsd box

========================[ Nov 24, 2002 6:26 PM ]========================
ERROR: [000.000] {foldtrajlite.c, line 1162} Unable to check server status

========================[ Nov 24, 2002 6:27 PM ]========================
ERROR: [000.000] {foldtrajlite.c, line 1162} Unable to check server status
ERROR: [000.000] {foldtrajlite.c, line 4739} Error during upload: NO RESPONSE FR
OM SERVER - WILL TRY AGAIN LATER
ERROR: [000.000] {foldtrajlite.c, line 1162} Unable to check server status

[Elspuddy]

and her is what i get when i start up df, useing systat -n



/0 /1 /2 /3 /4 /5 /6 /7 /8 /9 /10
Load Average ||||

Local Address Foreign Address Proto Recv-Q Send-Q (state)
192.168.0.242.4961 efnet.demon.co.u.ircd tcp 0 0 ESTABLISHED
192.168.0.242.4962 irc2-quakenet.bl.ircd tcp 0 0 ESTABLISHED
192.168.0.242.nfsd-sta 148-226.suscom-m.http tcp 0 0 ESTABLISHED
192.168.0.242.supfiled 206.248.62.8.http tcp 0 0 TIME_WAIT
192.168.0.242.1128 206.248.62.8.http tcp 0 0 TIME_WAIT
192.168.0.242.1129 206.248.62.8.http tcp 0 0 TIME_WAIT
192.168.0.242.1130 deep.mshri.on.ca.http tcp 0 0 TIME_WAIT
192.168.0.242.1131 206.248.62.8.http tcp 0 0 TIME_WAIT
192.168.0.242.1132 206.248.62.8.http tcp 0 14442 FIN_WAIT_1

[Brian the Fist]

Well it is contacting our server (206.248.62.8) there, but without seeing the ASCII packets I cannot tell you much else. Any good sniffer should be able to shwo you the ASCII of the packets being sent.

[Elspuddy]

o.k hows this file

[Brian the Fist]

I am not familiar with the exact output format in this file, but see how you send a GET /server.status HTTP/1.0, and then get a response from our server:

HTTP/1.0 200 OK Date: Mon, 25 Nov 2002 13:35:32 GMT Server: Apache/1
.3.23 (Unix) (Red-Hat/Linux) DAV/1.0.3 PHP/4.1.2 mod_perl/1.26 Last-
Modified: Wed, 16 Oct 2002 16:59:53 GMT Etag: "2b489-ba-3dad9b09" Ac
cept-Ranges: Bytes Content-Length: 186 Content-Type: text/plain Age
: 8879 Via: HTTP/1.0 ntl_site (Traffic-Server/3.5.7-10686 [uScHs f p
eN:t cCHi p s ])

Everything up to the 'Age : 8879 ..." is normal. However, the 'Age ..." part appears to have been added to the packer by a invisible proxy, and more importantly, the actual DATA of the packet is missing...

Try:

telnet www.distributedfolding.org 80

from the command line, then hit enter and type:

GET /server.status HTTP/1.0

and hit enter, and compare the output to the above and let me know what you see. If possible, try diabling the transparent proxy and see what happens.

[Elspuddy]

this is what i get
HTTP/1.0 200 OK
Date: Tue, 26 Nov 2002 15:11:11 GMT
Server: Apache/1.3.23 (Unix) (Red-Hat/Linux) DAV/1.0.3 PHP/
Last-Modified: Wed, 16 Oct 2002 16:59:53 GMT
Etag: "2b443-ba-3dad9b09"
Accept-Ranges: Bytes
Content-Length: 186
Content-Type: text/plain
Age: 5441
Via: HTTP/1.0 ntl_site (Traffic-Server/3.5.7-10686 [uScHs f

118 110 112 5000 118 110 112
SERVER DOWN FOR MAINTENANCE, TRY AGAIN LATER
ftp.mshri.on.ca /pub/distribfold/download/patch/
bar.csh.rit.edu /~distribfold/
bar.csh.rit.edu /~distribfold/

Connection closed by foreign host.
i have learnt that ntl dose have a transparent proxy runing

[TheOtherPhil]

Originally posted by Brian the Fist
If possible, try diabling the transparent proxy and see what happens.


There is no physical way to disable the proxy with ntl short of specifying another. Does anybody know of any free proxies to use? Is there any reason for packets to be dropped when they originate from a linux box and not from a windows box?

[Darkness Productions]

There are several (specially for *nix). You can use Squid, or TinyProxy. All of the proxy software for windows that I know of is not free.

Both Squid and TinyProxy should be pretty much standard, so there should be packages/ports for any version of *nix you're running.

[wirthi]

Originally posted by Darkness Productions
There are several (specially for *nix). You can use Squid, or TinyProxy. All of the proxy software for windows that I know of is not free.
Jana Proxy Server (http://www.janaserver.de/en/) is free, at least for private user. And it runs in windows.

[TheOtherPhil]

Thanks guys, but those personal proxies will still contact the ISP's *transparent* proxy. The transparent proxy at the ISP intercepts all requests on port 80. I found some nice info here (http://homepage.ntlworld.com/robin.d.h.walker/cmtips/trancache.html). Info on how to bypass the transparent proxy is here (http://homepage.ntlworld.com/robin.d.h.walker/cmtips/trancache.html#sidestep). Basically, you would need to specify a proxy for the DF client. As Elspuddy is in the UK, may I suggest webcache.bt.net on port 8080. I'll give this a try when I am not too busy as I am having the same issues as Elspuddy with my Linux boxen and am also using the same ISP.

[Elspuddy]

ah , bingo :|party|:
i got my freebsd box's to upload wu's :thumbs:
what i did we i edited the proxiy.cfg file to tell df what proxy to go thrue, and it started to upload
thanks for the help guys :)
:notworthy :cheers:

[Mikus]

Was running with the Linux gcc client. For the third consecutive time, there was __no__ automatic download when the project made its switch. So once again I did a manual download and install.

In the log kept by *my* proxy (which relays the data from/to the machine which actually runs the DF client), the response from the server (after my upload of the previous protein's last five filesets) looks very short -- only 80 bytes!

mikus


1039568258.560 3220 192.168.1.4 TCP_MISS/200 15303 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8
1039568262.380 3820 192.168.1.4 TCP_MISS/200 263 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8 te
1039568265.070 2690 192.168.1.4 TCP_MISS/200 15303 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8
1039568268.880 3810 192.168.1.4 TCP_MISS/200 263 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8 te
1039568271.750 2860 192.168.1.4 TCP_MISS/200 15303 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8
1039568276.100 4350 192.168.1.4 TCP_MISS/200 263 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8 te
1039568278.770 2670 192.168.1.4 TCP_MISS/200 15303 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8
1039568282.780 4010 192.168.1.4 TCP_MISS/200 263 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8 te
1039568285.610 2830 192.168.1.4 TCP_MISS/200 15303 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8
1039568289.460 3850 192.168.1.4 TCP_MISS/200 263 POST http://www.distributedfolding.org/cgi-bin/trajstore - DIRECT/206.248.62.8 te
1039568289.550 80 192.168.1.4 TCP_HIT/200 533 GET http://www.distributedfolding.org/server.status - NONE/- text/plain

p.s. There was nothing in error.log

.