|
/
Zope
/
Apsis
/
Pound Mailing List
/
Archive
/
2009
/
2009-10
/
proxy only for wget.....
[
URL vs HeadRequire for Virtual Host? / "Eric ... ]
[
Re: [Pound Mailing List] Pound: ... ]
proxy only for wget.....
Jean-Pierre van Melis <jp(at)mirmana.com> |
2009-10-22 03:07:00 |
[ SNIP ]
|
I'm using one of my subdomains to host scripts which are supposed to be fetched
with wget. Because I publish those in fora it attracted several search-engines
and some people just want to browse them using firefox or some other
browser....
I was getting a bit annoyed by all these logentries, so I decided to add an
extra Headrequire to that service entry and it now looks like this:
HeadRequire "^Host:[\t ].*wd\.mydomain\.com$"
HeadRequire "[Ww]get"
This works!
This means everything else will go to another server which is configured for
that domain too. The problem now is these clients ask for a specific file which
is not on that server.
Is it possible to define a 2nd entry for that domain without the
Wget-requirement and do a URLrewrite and ask for /index.html whichever file
they ask?
I can then send them to a page which says: "Browsers are not Supported"
It can then be handled by the same http-server...
JP
|
|
|
Re: [Pound Mailing List] proxy only for wget.....
Dave Steinberg <dave(at)redterror.net> |
2009-10-22 16:39:21 |
[ SNIP ]
|
Jean-Pierre van Melis wrote:
> I'm using one of my subdomains to host scripts which are supposed to be
fetched with wget. Because I publish those in fora it attracted several
search-engines and some people just want to browse them using firefox or some
other browser....
> I was getting a bit annoyed by all these logentries, so I decided to add an
extra Headrequire to that service entry and it now looks like this:
>
> HeadRequire "^Host:[\t ].*wd\.mydomain\.com$"
> HeadRequire "[Ww]get"
>
> This works!
> This means everything else will go to another server which is configured for
that domain too. The problem now is these clients ask for a specific file which
is not on that server.
> Is it possible to define a 2nd entry for that domain without the
Wget-requirement and do a URLrewrite and ask for /index.html whichever file
they ask?
>
> I can then send them to a page which says: "Browsers are not Supported"
> It can then be handled by the same http-server...
Sounds like you want to use mod_rewrite or a custom 404 page on your
backend. Pound isn't looking at your docroot, so how would it know
whats there or not?
Regards,
--
Dave Steinberg
http://www.geekisp.com/
http://www.steinbergcomputing.com/
|
|
|
RE: [Pound Mailing List] proxy only for wget.....
Jean-Pierre van Melis <jp(at)mirmana.com> |
2009-10-22 17:21:00 |
[ SNIP ]
|
Yes,
Those non-wget are now going to my apache-server instead of my lighttpd-server
and if I modify that specific host I can do it there... Pound is not really the
place for it...
I'm already pleased I'm rid of those browsers and robots for which this site
was not intended. Most robots didn't respect my robots.txt although they read
the file.
Nice piece of software...
Many thanks again.
JP
-----Oorspronkelijk bericht-----
Van: Dave Steinberg [mailto:dave(at)redterror.net]
Verzonden: donderdag 22 oktober 2009 16:39
Aan: pound(at)apsis.ch
Onderwerp: Re: [Pound Mailing List] proxy only for wget.....
Jean-Pierre van Melis wrote:
> I'm using one of my subdomains to host scripts which are supposed to be
fetched with wget. Because I publish those in fora it attracted several
search-engines and some people just want to browse them using firefox or some
other browser....
> I was getting a bit annoyed by all these logentries, so I decided to add an
extra Headrequire to that service entry and it now looks like this:
>
> HeadRequire "^Host:[\t ].*wd\.mydomain\.com$"
> HeadRequire "[Ww]get"
>
> This works!
> This means everything else will go to another server which is configured for
that domain too. The problem now is these clients ask for a specific file which
is not on that server.
> Is it possible to define a 2nd entry for that domain without the
Wget-requirement and do a URLrewrite and ask for /index.html whichever file
they ask?
>
> I can then send them to a page which says: "Browsers are not Supported"
> It can then be handled by the same http-server...
Sounds like you want to use mod_rewrite or a custom 404 page on your
backend. Pound isn't looking at your docroot, so how would it know
whats there or not?
Regards,
--
Dave Steinberg
http://www.geekisp.com/
http://www.steinbergcomputing.com/
--
To unsubscribe send an email with subject unsubscribe to pound(at)apsis.ch.
Please contact roseg(at)apsis.ch for questions.
|
|
|
|