Wiki sitting behind a corporate firewall issues

classic Classic list List threaded Threaded
13 messages Options
Reply | Threaded
Open this post in threaded view
|

Wiki sitting behind a corporate firewall issues

David_S_Green
All,

 

I've noticed that some of the issues effecting my wiki seem to be
related to the fact that it sits behind a corporate firewall, and the
wiki won't pull the data from external sites (say for an RSS feed) due
to the proxy.


Is there a way for me to tell MediaWiki the proxy settings (port,
username, password) required for it to then be able to use the proxy?

 

Thanks,
Dave Green

 

 

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

Reply | Threaded
Open this post in threaded view
|

Re: Wiki sitting behind a corporate firewall issues

David_S_Green
Any ideas out there? I've tried about everything I know (heh, which
isn't much I admit).

I've even scoured the Web for articles on anything similar.

A bit more of my example below...I can put RSS feeds from our Intranet
into the GISWiki/RSS Sample page, so I know the extension is working,
but when I try to pull an external RSS feed, I get error messages.

This along with a couple of other issues leads me to believe that these
extensions aren't able to get beyond our firewall. The way we normally
get through it is by providing the proxy address and port at which point
it needs a username and password.

So, my question basically is...Is there are way in MediaWiki to provide
this data? Or is there something I need to do at the web server level
(Apache)? Either way, does anyone know how to do either of these, if it
is possible? Or am I off my rocker here, and it is actually some other
issue?

Thanks,
Dave



-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of
[hidden email]
Sent: Thursday, January 11, 2007 12:44 PM
To: [hidden email]
Subject: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

All,

 

I've noticed that some of the issues effecting my wiki seem to be
related to the fact that it sits behind a corporate firewall, and the
wiki won't pull the data from external sites (say for an RSS feed) due
to the proxy.


Is there a way for me to tell MediaWiki the proxy settings (port,
username, password) required for it to then be able to use the proxy?

 

Thanks,
Dave Green

 

 

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

Reply | Threaded
Open this post in threaded view
|

Re: Wiki sitting behind a corporate firewall issues

Brion Vibber
In reply to this post by David_S_Green
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

[hidden email] wrote:
> I've noticed that some of the issues effecting my wiki seem to be
> related to the fact that it sits behind a corporate firewall, and the
> wiki won't pull the data from external sites (say for an RSS feed) due
> to the proxy.
>
>
> Is there a way for me to tell MediaWiki the proxy settings (port,
> username, password) required for it to then be able to use the proxy?

You can't tell MediaWiki that as MediaWiki doesn't have an RSS import
feature. But you might check PHP's http client configuration (if any)
and/or the particular methods that your custom extensions use to pull data.

Use google to search for documentation? That's what I'd do.

- -- brion vibber (brion @ pobox.com / brion @ wikimedia.org)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFpqU+wRnhpk1wk44RApS5AJ4zlXb84rcNAshYgClkCmcO4JqvkwCgrcNA
kOOFC0d1DWRZYA7CU2G9244=
=P0AW
-----END PGP SIGNATURE-----

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

Reply | Threaded
Open this post in threaded view
|

Re: Wiki sitting behind a corporate firewall issues

David_S_Green
Been hammering Google a bunch for information.

Maybe if I can change a setting in PHP to look for the proxy server?

I'll keep googling, but if anyone already has experience with this, let
me know!

Thanks,
Dave

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Brion
Vibber
Sent: Thursday, January 11, 2007 3:00 PM
To: MediaWiki announcements and site admin list
Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

[hidden email] wrote:
> I've noticed that some of the issues effecting my wiki seem to be
> related to the fact that it sits behind a corporate firewall, and the
> wiki won't pull the data from external sites (say for an RSS feed) due
> to the proxy.
>
>
> Is there a way for me to tell MediaWiki the proxy settings (port,
> username, password) required for it to then be able to use the proxy?

You can't tell MediaWiki that as MediaWiki doesn't have an RSS import
feature. But you might check PHP's http client configuration (if any)
and/or the particular methods that your custom extensions use to pull
data.

Use google to search for documentation? That's what I'd do.

- -- brion vibber (brion @ pobox.com / brion @ wikimedia.org)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFFpqU+wRnhpk1wk44RApS5AJ4zlXb84rcNAshYgClkCmcO4JqvkwCgrcNA
kOOFC0d1DWRZYA7CU2G9244=
=P0AW
-----END PGP SIGNATURE-----

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

MHart
What do you mean by "getting the wiki to see an external RSS source"?

Do you mean that external RSS readers can't see your wiki's feed? MediaWiki
doesn't read external sources...  but if you want an external feed reader
(e.g. Google or Yahoo) to see your wiki, then you need an intermediate page
that can be seen outside your intranet BUT can also read your intranet.

What we did is create a PUSH script that sends the RSS text to a server that
sits in a DMZ. That server then has a URL that external feed readers can use
to retrieve that text. The server in the DMZ can't read the RSS directly
because of the DMZ - although we could certainly open the firewall to allow
it. However, we decided it was far safer to prevent a server in the DMZ from
accessing the intranet, although it is open the other way around (intranet
servers can access the DMZ server).

- MHart


_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

David_S_Green
No, it seems my problem is that our corporate proxy server isn't
honoring requests from the RSS extension (or that the extension isn't
even trying to use the proxy in the first place) when it tries to pull
in an external feed (say a CNN rss feed for example). It is fine with
any internal feeds, as it doesn't have to make a proxy request.

My question was whether there was a way that MediaWiki (or the
extenstion, etc) to use the proxy server? So is there a way to have the
RSS feed go "hey this is an external request, go through the proxy".

Dave

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of MHart
Sent: Friday, January 12, 2007 8:06 AM
To: MediaWiki announcements and site admin list
Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

What do you mean by "getting the wiki to see an external RSS source"?

Do you mean that external RSS readers can't see your wiki's feed?
MediaWiki
doesn't read external sources...  but if you want an external feed
reader
(e.g. Google or Yahoo) to see your wiki, then you need an intermediate
page
that can be seen outside your intranet BUT can also read your intranet.

What we did is create a PUSH script that sends the RSS text to a server
that
sits in a DMZ. That server then has a URL that external feed readers can
use
to retrieve that text. The server in the DMZ can't read the RSS directly

because of the DMZ - although we could certainly open the firewall to
allow
it. However, we decided it was far safer to prevent a server in the DMZ
from
accessing the intranet, although it is open the other way around
(intranet
servers can access the DMZ server).

- MHart


_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

David_S_Green
In reply to this post by David_S_Green
No, it seems my problem is that our corporate proxy server isn't
honoring requests from the RSS extension (or that the extension isn't
even trying to use the proxy in the first place) when it tries to pull
in an external feed (say a CNN rss feed for example). It is fine with
any internal feeds, as it doesn't have to make a proxy request.

 

My question was whether there was a way that MediaWiki (or the
extenstion, etc) to use the proxy server? So is there a way to have the
RSS feed go "hey this is an external request, go through the proxy".

 

Dave

 

-----Original Message-----

From: [hidden email]

[mailto:[hidden email]] On Behalf Of MHart

Sent: Friday, January 12, 2007 8:06 AM

To: MediaWiki announcements and site admin list

Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

 

What do you mean by "getting the wiki to see an external RSS source"?

 

Do you mean that external RSS readers can't see your wiki's feed?

MediaWiki

doesn't read external sources...  but if you want an external feed
reader (e.g. Google or Yahoo) to see your wiki, then you need an
intermediate page that can be seen outside your intranet BUT can also
read your intranet.

 

What we did is create a PUSH script that sends the RSS text to a server
that sits in a DMZ. That server then has a URL that external feed
readers can use to retrieve that text. The server in the DMZ can't read
the RSS directly

 

because of the DMZ - although we could certainly open the firewall to
allow it. However, we decided it was far safer to prevent a server in
the DMZ from accessing the intranet, although it is open the other way
around (intranet servers can access the DMZ server).

 

- MHart

 

 

_______________________________________________

MediaWiki-l mailing list

[hidden email]

http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

 

_______________________________________________

MediaWiki-l mailing list

[hidden email]

http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

 

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

Rob Church
On 18/01/07, [hidden email] <[hidden email]> wrote:
> My question was whether there was a way that MediaWiki (or the
> extenstion, etc) to use the proxy server? So is there a way to have the
> RSS feed go "hey this is an external request, go through the proxy".

Yes, at least assuming

* You've got the curl extension installed (it's available and simple
to install for Windows, Unix and Linux, so no real excuse)
* You're running a fairly recent version of MediaWiki
* The RSS feed uses the MediaWiki-provided methods for getting the
data, which it quite possibly doesn't

If all the above are satisfied, then setting $wgHttpProxy in
LocalSettings.php should be adequate.

Note: We don't support proxy authentication at present. This seems
like a sensible enough thing to add, and isn't exactly difficult.


Rob Church

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

David_S_Green

Ok, I've verified the curl extension is running. I am using 1.8.3
MediaWiki, and I put $wgHttpProxy = true; into my LocalSetting.php file.

This is the extension I am using:
http://meta.wikimedia.org/wiki/GISWiki/RSS

My PHP is extremely weak (I am working on learning it now), so I can't
tell if the feed supports it or not. Would appreciate any additional
guidance you can give.

Thanks!
Dave

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Rob Church
Sent: Thursday, January 18, 2007 10:07 AM
To: MediaWiki announcements and site admin list
Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

On 18/01/07, [hidden email] <[hidden email]> wrote:
> My question was whether there was a way that MediaWiki (or the
> extenstion, etc) to use the proxy server? So is there a way to have
the
> RSS feed go "hey this is an external request, go through the proxy".

Yes, at least assuming

* You've got the curl extension installed (it's available and simple
to install for Windows, Unix and Linux, so no real excuse)
* You're running a fairly recent version of MediaWiki
* The RSS feed uses the MediaWiki-provided methods for getting the
data, which it quite possibly doesn't

If all the above are satisfied, then setting $wgHttpProxy in
LocalSettings.php should be adequate.

Note: We don't support proxy authentication at present. This seems
like a sensible enough thing to add, and isn't exactly difficult.


Rob Church

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

David_S_Green
In reply to this post by Rob Church
Rob,

Thanks for getting back to me...here is what I found so far:

Ok, I've verified the curl extension is running. I am using 1.8.3
MediaWiki, and I put $wgHttpProxy = true; into my LocalSetting.php file.

This is the extension I am using:
http://meta.wikimedia.org/wiki/GISWiki/RSS

My PHP is extremely weak (I am working on learning it now), so I can't
tell if the feed supports it or not. Would appreciate any additional
guidance you can give.

Thanks!
Dave

-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Rob Church
Sent: Thursday, January 18, 2007 10:07 AM
To: MediaWiki announcements and site admin list
Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

On 18/01/07, [hidden email] <[hidden email]> wrote:
> My question was whether there was a way that MediaWiki (or the
> extenstion, etc) to use the proxy server? So is there a way to have
the
> RSS feed go "hey this is an external request, go through the proxy".

Yes, at least assuming

* You've got the curl extension installed (it's available and simple
to install for Windows, Unix and Linux, so no real excuse)
* You're running a fairly recent version of MediaWiki
* The RSS feed uses the MediaWiki-provided methods for getting the
data, which it quite possibly doesn't

If all the above are satisfied, then setting $wgHttpProxy in
LocalSettings.php should be adequate.

Note: We don't support proxy authentication at present. This seems
like a sensible enough thing to add, and isn't exactly difficult.


Rob Church

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

Rob Church
In reply to this post by David_S_Green
On 18/01/07, [hidden email] <[hidden email]> wrote:
> Ok, I've verified the curl extension is running. I am using 1.8.3
> MediaWiki, and I put $wgHttpProxy = true; into my LocalSetting.php file.

$wgHttpProxy needs to be set to the value of your proxy server.

> This is the extension I am using:
> http://meta.wikimedia.org/wiki/GISWiki/RSS

Well, that's coincidental - I was hacking up a later hacked-up copy of
that damn extension the other day in order to iron out a couple of
bugs for someone. As luck would have it, I've still got the magpie
dependency files here, so I can examine them...

Magpie's fetch_rss() function, which the extension uses to do most of
the fetching and parsing, appears to use a third-party PHP HTTP
fetching library called Snoopy. This *does* appear to support proxies,
but it seems to use curl binaries, which may or may not be available.
I can't see any straightforward way to set the proxy settings to
Snoopy via Magpie or the extension itself, so I suspect you'll have to
manually set this - it'll be in magpie/extlib/Snoopy.class.inc, near
the top of the class definition.

If this doesn't work out, then have another search around the web;
there's more than one RSS aggregator extension for MediaWiki out
there.


Rob Church

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: [Mediawiki-l] Wiki sitting behind a corporate firewall issues

David_S_Green
Rob,

Thanks for all the great info.

I've sent everything that I can find in "Snoopy.class.inc", and I fixed
$wgHttpProxy.

Still no go....it just generates this error when I preview the page
(local intranet feeds still pull fine):

Warning:  Invalid argument supplied for foreach() in
F:\WebServer\GeCWiki\extensions\rss.php on line 159
And
Warning:  Invalid argument supplied for foreach() in
F:\WebServer\GeCWiki\extensions\rss.php on line 228

I've been digging around the web with Google, but so far I'm not really
find any other decent extensions.

Dave


-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Rob Church
Sent: Friday, January 19, 2007 12:50 AM
To: MediaWiki announcements and site admin list
Subject: Re: [Mediawiki-l] Wiki sitting behind a corporate firewall
issues

On 18/01/07, [hidden email] <[hidden email]> wrote:
> Ok, I've verified the curl extension is running. I am using 1.8.3
> MediaWiki, and I put $wgHttpProxy = true; into my LocalSetting.php
file.

$wgHttpProxy needs to be set to the value of your proxy server.

> This is the extension I am using:
> http://meta.wikimedia.org/wiki/GISWiki/RSS

Well, that's coincidental - I was hacking up a later hacked-up copy of
that damn extension the other day in order to iron out a couple of
bugs for someone. As luck would have it, I've still got the magpie
dependency files here, so I can examine them...

Magpie's fetch_rss() function, which the extension uses to do most of
the fetching and parsing, appears to use a third-party PHP HTTP
fetching library called Snoopy. This *does* appear to support proxies,
but it seems to use curl binaries, which may or may not be available.
I can't see any straightforward way to set the proxy settings to
Snoopy via Magpie or the extension itself, so I suspect you'll have to
manually set this - it'll be in magpie/extlib/Snoopy.class.inc, near
the top of the class definition.

If this doesn't work out, then have another search around the web;
there's more than one RSS aggregator extension for MediaWiki out
there.


Rob Church

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l

_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l
Reply | Threaded
Open this post in threaded view
|

Re: dumpHTML.php

Alexis Moinet
In reply to this post by David_S_Green
I'm not telling that this is a better solution, I'm just suggesting a
tool that I've been using without any trouble on several occasion (never
on a whole wiki though). On the other hand, I've tried dumpHTML only
once but was not satisfied with the results.

Ken : for your skin problem, you probably should use the option "-k
yourskinname" (e.g. $ php dumpHTML.php -k monobook)

John Norvell wrote :

>>  Ken McDonald a √©crit :
>>    
>>> When trying to create a static copy of our wiki using "dumpHTL.php"
>>> (mediawiki 1.6.9), there wasn't any obvious "index.html" file created,
>>> and bringing up another page and trying to go to the "main page"
>>> wouldn't work. Also, our CSS styles (skin) were not used.
>>>
>>> Any tricks to getting this working or (perhaps) to get a more recent
>>> version of dumpHTML working?
>>>      
>> one word : HTTrack (GPL, Linux and windows) ;-)
>>    
>
> Thanks for that suggestion, which looks promising, but is there any
> possibility of more than one word, e.g., to explain why this is a better
> solution than the dumpHTML approach that most people recommend for this
> application?
_______________________________________________
MediaWiki-l mailing list
[hidden email]
http://lists.wikimedia.org/mailman/listinfo/mediawiki-l