Article delegate-en/1592 of [1-5169] on the server localhost:119
  upper oldest olders older1 this newer1 newers latest
search
[Top/Up] [oldest] - [Older+chunk] - [Newer+chunk] - [newest + Check]

Newsgroups: mail-lists.delegate-en

[DeleGate-En] slow NNTP connections via 2 proxies
03 Apr 2002 09:38:22 GMT Steffen Kaiser <pcmdabdyi-t7hpmu4xr5xr.ml@ml.delegate.org>


Hello,

I'm using delegate v7.9.2 on two machines with the following setup:

Proxy 1:
        $demon -P11011  \
                PERMIT=\*:\*:ux-2s03c,localhost,ux-2s02,ux-2s02a        \
                TIMEOUT=restart:1d \
                HOSTS=RRZ.Uni-Koeln.DE/news.RRZ.Uni-Koeln.DE \
                CRON="0 22 * * * -expire +3" EXPIRE=3d  \

Proxy 2:
         $demon -P119
PERMIT="*:*:10.110.1.0/24,192.168.1.0/24" \
                SERVER=nntp \
                MASTER=ux-2s02a:11011   \
                HOSTS=RRZ.Uni-Koeln.DE/news.RRZ.Uni-Koeln.DE \
                TIMEOUT=con:10,acc:10,io:300,lin:10 \
                TIMEOUT=restart:1d \
                MOUNT="= nntp://news.rrz.uni-koeln.de rw" \
                MOUNT="= news://news.openwatcom.org rw" \
                MOUNT="= nntp://localhost:8119 rw" \
                MOUNT="= nntp://news.vmware.com rw" \
                MOUNT="delegate.* nntp://www.delegate.org/mail-lists.* ro"
\
                CACHE=no        \


The setup is as follows:
+ Clients in networks 10 and 192.168.1 may access the host "Proxy 2", but
not "Proxy 1".
+ "Proxy 2" cannot make direct connections to the inet, hence, its
requests are passed to the master on "Proxy 1".
+ Because of how resources are allocated (available disk space), the
"Proxy 1" shall cache all the articles etc., but "Proxy 2" shallt not.
"Proxy 1" also shall provide a central place various proxies and gateways
are tunneled through, in order to use the cache as often as possible.
+ "localhost:8119" is a SSL gateway to another external snews service
running on "Proxy 1".

Question 1:
Is it better, e.g. because of performance or efficiency, to make the 2nd
Proxy a generalist, just forwarding the requests to "Proxy 1"?

Question 2:
There are great performance differences, e.g. last week the response time
of the delegate news proxy was below 30 seconds. Today it was over 600
seconds initially (lots of timeouts in the logfile), then about 40 through
200 seconds when switching Newsgroups.

e.g.:
04/03 11:13:35.71 [19498] 52+1/4: Switched GROUP junk [localhost:8119] [1]
04/03 11:14:31.81 [19498] 52+1/4: ## S-C 420 No current article
[junk][GROUP junk]

There is no entry between these two lines, neither any visible activity
in tcpdump.

I had a similiar, though extremly less frustrating problem some time ago,
which you identified as a non-working or very very slow news server.

Glancing at the logs:
1) I'm not aware how to identify the problematic server,
2) see log:
04/03 11:14:38.55 [11238] 8+0: getting HELP from news.openwatcom.org...
04/03 11:14:38.98 [11238] 8+0: CLOSE previous cache: private=1 TIMEOFF=0
04/03 11:14:38.98 [11238] 8+0: setLISTcache: private=1 created=1 TIMEOFF=0
04/03 11:14:38.98 [11238] 8+0: with LIST ACTIVE [wildmat] =
04/03 11:14:38.98 [11238] 8+0: checking pathhost of news.openwatcom.org in
junk...
04/03 11:14:39.14 [11238] 8+0: ## S-C 411 no such news group [][]
04/03 11:14:39.14 [11238] 8+0: checking pathhost of news.openwatcom.org in
control...
04/03 11:14:39.47 [11238] 8+0: ## S-C 421 no next article in this group
[][]
04/03 11:14:39.63 [11238] 8+0: ## S-C 502 Permission denied [][]
04/03 11:14:39.63 [11238] 8+0: getting HELP from news.rrz.uni-koeln.de...
04/03 11:14:39.69 [11238] 8+0: CLOSE previous cache: private=1 TIMEOFF=0
04/03 11:14:39.69 [11238] 8+0: setLISTcache: private=1 created=1 TIMEOFF=0
04/03 11:14:39.69 [11238] 8+0: with LIST ACTIVE [wildmat] =
04/03 11:14:39.69 [11238] 8+0: getting HELP from www.delegate.org...
04/03 11:14:40.12 [11238] 8+0: CLOSE previous cache: private=1 TIMEOFF=0
04/03 11:14:40.12 [11238] 8+0: setLISTcache: private=1 created=1 TIMEOFF=0
04/03 11:14:40.12 [11238] 8+0: with LIST ACTIVE [wildmat] =
04/03 11:14:40.12 [11238] 8+0: checking pathhost of www.delegate.org in
junk...
04/03 11:14:40.48 [11238] 8+0: ## S-C 500 What? [][]
04/03 11:14:40.48 [11238] 8+0: checking pathhost of www.delegate.org in
control...
04/03 11:14:40.84 [11238] 8+0: ## S-C 500 What? [][]

it seems that delegate is always accessing all the Newsservers regardless
if the Newsgroup is hosted there at all, for _every_ switch of a
Newsgroup.

Isn't that overkill?? Couldn't delegate, for instance, grab the active
file now and then, but keep with the information and, probably, cope with
out-of-date cached information when clashes are recognized?

Could I probably for a more up-to-date behaviour, e.g. by running a script
every hour or so to switch to certain newsgroups on a regular basis, in
order to force delegate to keep the active lists (or whatever) in sync?

Any help is welcome.

Bye,

-- 

Steffen Kaiser


  admin search upper oldest olders older1 this newer1 newers latest
[Top/Up] [oldest] - [Older+chunk] - [Newer+chunk] - [newest + Check]
@_@V