API Help - allpages endpoint

classic Classic list List threaded Threaded
8 messages Options
Reply | Threaded
Open this post in threaded view
|

API Help - allpages endpoint

Czuma, Marek

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

bawolff
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Czuma, Marek
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Betacommand
What are you trying to do?

On Thu, Dec 20, 2018 at 10:12 AM Czuma, Marek <[hidden email]> wrote:
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Czuma, Marek
I want to fetch all pages.
The flow is:
a) I send request with apfrom = "". This is the beginning of this "chain".
b) I fetch 500 pages and apcontinue field.
c) I send request with afrom = [apcontinue from b step]
d) I repeat b and c until apcontinue == null.
That's all. If i get page with namespace, I cant go and take only from this namespace, cause I wont have next apcontinue.

On Thu, Dec 20, 2018 at 6:54 PM Betacommand <[hidden email]> wrote:
What are you trying to do?

On Thu, Dec 20, 2018 at 10:12 AM Czuma, Marek <[hidden email]> wrote:
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Betacommand
If I recall correctly by default it pulls from ns0 only. If you want a list of all pages all namespaces. The first thing is to get a list of namespaces, iterate over that and pull all pages from each namespace.

On Thu, Dec 20, 2018 at 1:44 PM Czuma, Marek <[hidden email]> wrote:
I want to fetch all pages.
The flow is:
a) I send request with apfrom = "". This is the beginning of this "chain".
b) I fetch 500 pages and apcontinue field.
c) I send request with afrom = [apcontinue from b step]
d) I repeat b and c until apcontinue == null.
That's all. If i get page with namespace, I cant go and take only from this namespace, cause I wont have next apcontinue.

On Thu, Dec 20, 2018 at 6:54 PM Betacommand <[hidden email]> wrote:
What are you trying to do?

On Thu, Dec 20, 2018 at 10:12 AM Czuma, Marek <[hidden email]> wrote:
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Czuma, Marek
Unfortunately, ns 0 has probably everything. I fetched (now) some data with 0 namespace and I can see also pages with namespaces

On Thu, Dec 20, 2018 at 7:48 PM Betacommand <[hidden email]> wrote:
If I recall correctly by default it pulls from ns0 only. If you want a list of all pages all namespaces. The first thing is to get a list of namespaces, iterate over that and pull all pages from each namespace.

On Thu, Dec 20, 2018 at 1:44 PM Czuma, Marek <[hidden email]> wrote:
I want to fetch all pages.
The flow is:
a) I send request with apfrom = "". This is the beginning of this "chain".
b) I fetch 500 pages and apcontinue field.
c) I send request with afrom = [apcontinue from b step]
d) I repeat b and c until apcontinue == null.
That's all. If i get page with namespace, I cant go and take only from this namespace, cause I wont have next apcontinue.

On Thu, Dec 20, 2018 at 6:54 PM Betacommand <[hidden email]> wrote:
What are you trying to do?

On Thu, Dec 20, 2018 at 10:12 AM Czuma, Marek <[hidden email]> wrote:
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
Reply | Threaded
Open this post in threaded view
|

Re: API Help - allpages endpoint

Betacommand
ns0 is what is the “mainspace” or pages without a namespace. By default allpages defaults to it, if you are using allpages and getting other namespaces that sounds like a bug.

On Thu, Dec 20, 2018 at 1:53 PM Czuma, Marek <[hidden email]> wrote:
Unfortunately, ns 0 has probably everything. I fetched (now) some data with 0 namespace and I can see also pages with namespaces

On Thu, Dec 20, 2018 at 7:48 PM Betacommand <[hidden email]> wrote:
If I recall correctly by default it pulls from ns0 only. If you want a list of all pages all namespaces. The first thing is to get a list of namespaces, iterate over that and pull all pages from each namespace.

On Thu, Dec 20, 2018 at 1:44 PM Czuma, Marek <[hidden email]> wrote:
I want to fetch all pages.
The flow is:
a) I send request with apfrom = "". This is the beginning of this "chain".
b) I fetch 500 pages and apcontinue field.
c) I send request with afrom = [apcontinue from b step]
d) I repeat b and c until apcontinue == null.
That's all. If i get page with namespace, I cant go and take only from this namespace, cause I wont have next apcontinue.

On Thu, Dec 20, 2018 at 6:54 PM Betacommand <[hidden email]> wrote:
What are you trying to do?

On Thu, Dec 20, 2018 at 10:12 AM Czuma, Marek <[hidden email]> wrote:
I was thinking about it. But unfortunately, it will search for only this namespace. And it wont show me next point (apcontinue)

On Thu, Dec 20, 2018 at 4:02 PM bawolff <[hidden email]> wrote:
Hi,

instead of putting a namespace prefix, you have to specify apnamespace=<namespace number> instead

So instead of apfrom=Talk:Foo you would do apfrom=Foo&apnamespace=1

--
Brian

On Thu, Dec 20, 2018 at 2:44 PM Czuma, Marek <[hidden email]> wrote:

Marek Czuma <[hidden email]>

3:36 PM (7 minutes ago)
to mediawiki-api
Good morning!
I'm despaired, cause I have some problem with wikimedia api and I really can't find answer.

I am programmer and I try to deal with allPages endpoint.
I try to fetch 500 pages, take apcontinue and once again fetch more 500 pages (from apfrom point).

Everything is ok until the moment I want to fetch something like Somenamespace:Page. I can't send request with colon inside a request. 

Response;
 "error": {
        "code": "invalidtitle",
        "info": "Bad title \"Somenamespace:Page\".",
        "*": "See http://syswiki.gene.com/syswiki/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at &lt;https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce&gt; for notice of API deprecations and breaking changes."
    }

Could you help me? I must fetch this page, but I don't know how to do it properly.
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api
_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api

_______________________________________________
Mediawiki-api mailing list
[hidden email]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-api