Gsoc 2011: Project Page Schemas
Locked
Gsoc 2011: Project Page Schemas
 
|
Hi Guys,
This is Ankit garg here. I participated in gsoc-2011, this year and successfully finished my project. I did this under the mentorship of Yaron who was really encouraging and helpful through-out. Here is a list of tasks we achieved . 1) Created a new extension, Page Schemas, that parses the defined Schemas XML structure and stores it in memory, and provides hooks for other extensions like (SMW <http://SMW.SF.to>, SF ,SD) add their own elements to the XML. Sample XML looks like --------------------------------------------------------- <PageSchema> <semanticforms_Form name="City"> </semanticforms_Form > <Template name="City"> <Field name="Population"> <Label>Pop.</Label> <semanticmediawiki_Property name="Has population"> <Type>Number</Type> </semanticmediawiki_Property> <semanticforms_FormInput> <InputType>text</InputType> <Parameter name="size">20</Parameter> <Parameter name="mandatory" /> </semanticforms_FormInput> <semanticdrilldown_Filter> <Label>Population</Label> </semanticdrilldown_Filter> </Field> ... </Template> ...</PageSchema> ---------------------------------------- 2) Added code to other extensions (Semantic MediaWiki, Semantic Forms and Semantic Drilldown) to add parsing for additional XML elements, using those hooks. 3) Added to Page Schemas a simple mechanism for displaying the XML to users in the Category page. So when user visits the category page, he sees the page Schema XML defined for that category 4) Added a special page to Semantic Schemas, "Special:GeneratePages", that lets users generate a set of wiki pages based on the XML in one page. 5) Added code to other extensions to create specific page types when " Special:GeneratePages" is called: Semantic Forms (creates templates and forms), Semantic MediaWiki (generates property pages) and Semantic Drilldown (generates filter pages). 6) Added another special page to Semantic Schemas, "Special:EditSchema", that lets users create and edit the XML using a form. 7) Page Schemas also defines two tabs, that show up on category pages, to provide this functionality: "edit schema" and "generate pages. More information can be found here. http://www.mediawiki.org/wiki/Extension:Page_Schemas -- Ankit Garg Student @ SKIT ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: Gsoc 2011: Project Page Schemas
|
Very interesting !
Congrats on completing your GSoC. @Yaron - do you see SF eventually being phased out and replaced by Semantic Schemas ? or is it way too early to worry about that ? - Laurent On Thu, Sep 1, 2011 at 12:38 PM, ankit garg <[hidden email]> wrote: > Hi Guys, > This is Ankit garg here. I participated in gsoc-2011, this year and > successfully finished my project. I did this under the mentorship of Yaron > who was really encouraging and helpful through-out. Here is a list of > tasks we achieved . > > 1) Created a new extension, Page Schemas, that parses the defined Schemas > XML structure and stores it in memory, and provides hooks for other > extensions like (SMW <http://SMW.SF.to>, SF ,SD) add their own elements > to > the XML. > Sample XML looks like > --------------------------------------------------------- > > <PageSchema> > <semanticforms_Form name="City"> > </semanticforms_Form > > <Template name="City"> > <Field name="Population"> > <Label>Pop.</Label> > <semanticmediawiki_Property name="Has population"> > <Type>Number</Type> > </semanticmediawiki_Property> > <semanticforms_FormInput> > <InputType>text</InputType> > <Parameter name="size">20</Parameter> > <Parameter name="mandatory" /> > </semanticforms_FormInput> > <semanticdrilldown_Filter> > <Label>Population</Label> > </semanticdrilldown_Filter> > </Field> > ... > </Template> > ...</PageSchema> > > > ---------------------------------------- > > 2) Added code to other extensions (Semantic MediaWiki, Semantic Forms and > Semantic Drilldown) to add parsing for additional XML elements, using those > hooks. > > 3) Added to Page Schemas a simple mechanism for displaying the XML to > users > in the Category page. So when user visits the category page, he sees the > page Schema XML defined for that category > > 4) Added a special page to Semantic Schemas, "Special:GeneratePages", that > lets users generate a set of wiki pages based on the XML in one page. > > 5) Added code to other extensions to create specific page types when " > Special:GeneratePages" is called: Semantic Forms (creates templates and > forms), Semantic MediaWiki (generates property pages) and Semantic > Drilldown > (generates filter pages). > > 6) Added another special page to Semantic Schemas, "Special:EditSchema", > that lets users create and edit the XML using a form. > > 7) Page Schemas also defines two tabs, that show up on category pages, to > provide this functionality: "edit schema" and "generate pages. > > More information can be found here. > http://www.mediawiki.org/wiki/Extension:Page_Schemas > > -- > Ankit Garg > Student @ SKIT > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > -- - Laurent Alquier http://www.linfa.net ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
[ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
Hi all, I just got SMW installed and I'm trying to interface with a CSV dataset I have on another wiki page. I'm using the fullurl parser function as recommended on the ED documentation..
The data I'm entering into my page is as follows: {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with header|data=IP Address=IP Address,Device Description=Device Description }} When I save or preview the page, I'm left with about a full page worth of PHP error spew, which looks like: Notice: Undefined offset: 1 in /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 (this message repeats many times with incrementing offset numbers) Near the end of the errors, I get: Warning: Cannot modify header information - headers already sent by (output started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in /var/www/html/w/includes/WebResponse.php on line 16 I installed using Semantic Bundle (version 2011-08-24), which uses Semantic MediaWiki 1.61. External data plugin is version 1.3.1. Any help GREATLY appreciated, thanks :) ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: Gsoc 2011: Project Page Schemas
|
In reply to this post by Laurent Alquier-2
Hi,
Thank you, Ankit, for providing this summary - and of course thank you for all your hard work on this Google Summer of Code project. Laurent - first, let me note that the extension is called Page Schemas. Before it was created, I referred to the concept as "Semantic Schemas" (and before that, "Semantic Classes"), but Page Schemas is the official name now. So, let me give my thoughts on this extension. I think that Page Schemas will eventually become a very important part of the Semantic MediaWiki "system". At its heart, Page Schemas is meant to do for data structure what Semantic Forms does for data: present a form-based interface so that users don't have to deal with syntax, and don't have to worry about piece of information goes where - and in general, make the tasks of creating and modifying the data structure as simple as possible, while still providing a lot of functionality. Semantic Forms already tries to do this to some extent with its helper forms: Special:CreateProperty, Special:CreateTemplate, Special:CreateForm, Special:CreateCategory and Special:CreateClass. And Semantic Drilldown includes Special:CreateFilter. All of these have been useful, but they have two big limitations: they can only be used to create pages, not to edit them - and the sheer number of them causes confusion and requires a lot of work. Page Schemas is meant to streamline that process, by letting you create and edit a single piece of XML, contained within a category page, that defines everything about the data schema for that category: the semantic properties, the structure of the template, the structure of the form, and the drilldown filters. Everything is integrated together - so if you decide to rename a field, for instance, you can do all the necessary renaming in one place, instead of having to modify the template page, the form page, the property page and possibly a filter page as well. And just as importantly, there's a form that lets you edit the XML, so users shouldn't ever have to touch the XML directly. Once the XML is edited, you can, as Ankit noted, use the Special:GeneratePages button to generate the true pages. Eventually, the XML could be used to dictate the data structure directly - so that, for instance, forms will no longer need to be defined via a separate page. (Templates will probably always need to be defined.) Actually, that process has already started, because, with Page Schemas installed, you no longer need to create filter pages - Semantic Drilldown can already read the XML directly to figure out what filters should exist for each category. To answer another question, though: even if forms are no longer defined via their own page, the Semantic Forms extension will still be necessary, to do the display of the forms. Page Schemas is still undergoing some changes right now - so I wouldn't recommend that anyone adopt it right away as their data structure solution. But it does indeed work already, so I encourage anyone who's curious to download it and try it out. (You also would need to have the latest SVN versions of SMW, SF and SD.) To start playing with it, just go to any category page and click on the "edit schema" tab/dropdown. My guess is that, within a few months at most, a fully-operational version will be ready - and then the plan is to add it to Semantic Bundle, Referata, etc. There's a lot of interesting things that can be done once you have a standard XML format for defining data structure - a wiki's structure could be imported to, and exported from, other formats like UML or a database schema. And you can have inheritance, letting one category's schema inherit fields from another, to eliminate redundancy (that's already supported, though not by Special:EditSchema). The potential is pretty big, and Ankit's project has provided the crucial first step. -Yaron On Thu, Sep 1, 2011 at 12:47 PM, Laurent Alquier <[hidden email]>wrote: > Very interesting ! > > Congrats on completing your GSoC. > > @Yaron - do you see SF eventually being phased out and replaced by Semantic > Schemas ? or is it way too early to worry about that ? > > - Laurent > > On Thu, Sep 1, 2011 at 12:38 PM, ankit garg <[hidden email]> > wrote: > > > Hi Guys, > > This is Ankit garg here. I participated in gsoc-2011, this year and > > successfully finished my project. I did this under the mentorship of > Yaron > > who was really encouraging and helpful through-out. Here is a list of > > tasks we achieved . > > > > 1) Created a new extension, Page Schemas, that parses the defined > Schemas > > XML structure and stores it in memory, and provides hooks for other > > extensions like (SMW <http://SMW.SF.to>, SF ,SD) add their own elements > > to > > the XML. > > Sample XML looks like > > --------------------------------------------------------- > > > > <PageSchema> > > <semanticforms_Form name="City"> > > </semanticforms_Form > > > <Template name="City"> > > <Field name="Population"> > > <Label>Pop.</Label> > > <semanticmediawiki_Property name="Has population"> > > <Type>Number</Type> > > </semanticmediawiki_Property> > > <semanticforms_FormInput> > > <InputType>text</InputType> > > <Parameter name="size">20</Parameter> > > <Parameter name="mandatory" /> > > </semanticforms_FormInput> > > <semanticdrilldown_Filter> > > <Label>Population</Label> > > </semanticdrilldown_Filter> > > </Field> > > ... > > </Template> > > ...</PageSchema> > > > > > > ---------------------------------------- > > > > 2) Added code to other extensions (Semantic MediaWiki, Semantic Forms > and > > Semantic Drilldown) to add parsing for additional XML elements, using > those > > hooks. > > > > 3) Added to Page Schemas a simple mechanism for displaying the XML to > > users > > in the Category page. So when user visits the category page, he sees the > > page Schema XML defined for that category > > > > 4) Added a special page to Semantic Schemas, "Special:GeneratePages", > that > > lets users generate a set of wiki pages based on the XML in one page. > > > > 5) Added code to other extensions to create specific page types when " > > Special:GeneratePages" is called: Semantic Forms (creates templates and > > forms), Semantic MediaWiki (generates property pages) and Semantic > > Drilldown > > (generates filter pages). > > > > 6) Added another special page to Semantic Schemas, "Special:EditSchema", > > that lets users create and edit the XML using a form. > > > > 7) Page Schemas also defines two tabs, that show up on category pages, to > > provide this functionality: "edit schema" and "generate pages. > > > > More information can be found here. > > http://www.mediawiki.org/wiki/Extension:Page_Schemas > > > > -- > > Ankit Garg > > Student @ SKIT > > > > > ------------------------------------------------------------------------------ > > Special Offer -- Download ArcSight Logger for FREE! > > Finally, a world-class log management solution at an even better > > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > > download Logger. Secure your free ArcSight Logger TODAY! > > http://p.sf.net/sfu/arcsisghtdev2dev > > _______________________________________________ > > Semediawiki-user mailing list > > [hidden email] > > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > > > > > > -- > - Laurent Alquier > http://www.linfa.net > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
In reply to this post by Parks, Michael
Hi Michael,
I just looked into this - my guess is that, in the CSV file you're accessing, the header row (the first row) has fewer values than the other rows do - is that possible? In any case, External Data shouldn't be displaying those error messages - that's a bug that will be fixed in the next version. -Yaron On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael <[hidden email]>wrote: > Hi all, I just got SMW installed and I'm trying to interface with a CSV > dataset I have on another wiki page. I'm using the fullurl parser function > as recommended on the ED documentation.. > > The data I'm entering into my page is as follows: > > {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with > header|data=IP Address=IP Address,Device Description=Device Description }} > > When I save or preview the page, I'm left with about a full page worth of > PHP error spew, which looks like: > > Notice: Undefined offset: 1 in > /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 > > (this message repeats many times with incrementing offset numbers) > > Near the end of the errors, I get: > > Warning: Cannot modify header information - headers already sent by (output > started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in > /var/www/html/w/includes/WebResponse.php on line 16 > > I installed using Semantic Bundle (version 2011-08-24), which uses Semantic > MediaWiki 1.61. External data plugin is version 1.3.1. > > Any help GREATLY appreciated, thanks :) > > > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
Yaron,
Nope, the CSV only has two columns. Interestingly enough though, if you look at the data page, the formatting is completely mangled. Looks like the newlines were stripped. Once you bring up the edit page, the proper formatting appears. ..On second thought, disregard that, since the data appears as it should when viewing the page source. The only other thing I can think of would be a large number of spaces in the description rows. I haven't thrown any extra commas in there, so other than that, I'm out of ideas :/ Thanks, Mike ________________________________ From: [hidden email] [mailto:[hidden email]] On Behalf Of Yaron Koren Sent: Thursday, September 01, 2011 10:15 PM To: Parks, Michael Cc: [hidden email] Subject: Re: [Semediawiki-user] [ED] Tons of PHP errors when doing #get_web_data with csv wiki page Hi Michael, I just looked into this - my guess is that, in the CSV file you're accessing, the header row (the first row) has fewer values than the other rows do - is that possible? In any case, External Data shouldn't be displaying those error messages - that's a bug that will be fixed in the next version. -Yaron On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael <[hidden email]<mailto:[hidden email]>> wrote: Hi all, I just got SMW installed and I'm trying to interface with a CSV dataset I have on another wiki page. I'm using the fullurl parser function as recommended on the ED documentation.. The data I'm entering into my page is as follows: {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with header|data=IP Address=IP Address,Device Description=Device Description }} When I save or preview the page, I'm left with about a full page worth of PHP error spew, which looks like: Notice: Undefined offset: 1 in /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 (this message repeats many times with incrementing offset numbers) Near the end of the errors, I get: Warning: Cannot modify header information - headers already sent by (output started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in /var/www/html/w/includes/WebResponse.php on line 16 I installed using Semantic Bundle (version 2011-08-24), which uses Semantic MediaWiki 1.61. External data plugin is version 1.3.1. Any help GREATLY appreciated, thanks :) ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email]<mailto:[hidden email]> https://lists.sourceforge.net/lists/listinfo/semediawiki-user -- WikiWorks * MediaWiki Consulting * http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
Hi Michael,
I continue to think that the issue is extra values, i.e. extra commas, in some of the rows. Could it be that one or more of the rows looks like this? ABC,123,Hello, how are you, I'm fine In that case, it gets counted as five values. The correct way to deal with commas in values in CSV is via quotes, like this: ABC,123,"Hello, how are you, I'm fine" Is that possibly the issue here? -Yaron On Fri, Sep 2, 2011 at 10:13 AM, Parks, Michael <[hidden email]>wrote: > Yaron,**** > > ** ** > > Nope, the CSV only has two columns. Interestingly enough though, if you > look at the data page, the formatting is completely mangled. Looks like the > newlines were stripped. Once you bring up the edit page, the proper > formatting appears.**** > > ** ** > > ..On second thought, disregard that, since the data appears as it should > when viewing the page source.**** > > ** ** > > The only other thing I can think of would be a large number of spaces in > the description rows. I haven’t thrown any extra commas in there, so other > than that, I’m out of ideas :/**** > > ** ** > > Thanks,**** > > Mike**** > > ** ** > ------------------------------ > > *From:* [hidden email] [mailto:[hidden email]] *On Behalf Of *Yaron > Koren > *Sent:* Thursday, September 01, 2011 10:15 PM > *To:* Parks, Michael > *Cc:* [hidden email] > *Subject:* Re: [Semediawiki-user] [ED] Tons of PHP errors when doing > #get_web_data with csv wiki page**** > > ** ** > > Hi Michael,**** > > ** ** > > I just looked into this - my guess is that, in the CSV file you're > accessing, the header row (the first row) has fewer values than the other > rows do - is that possible?**** > > ** ** > > In any case, External Data shouldn't be displaying those error messages - > that's a bug that will be fixed in the next version.**** > > ** ** > > -Yaron**** > > On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael < > [hidden email]> wrote:**** > > Hi all, I just got SMW installed and I'm trying to interface with a CSV > dataset I have on another wiki page. I'm using the fullurl parser function > as recommended on the ED documentation.. > > The data I'm entering into my page is as follows: > > {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with > header|data=IP Address=IP Address,Device Description=Device Description }} > > When I save or preview the page, I'm left with about a full page worth of > PHP error spew, which looks like: > > Notice: Undefined offset: 1 in > /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 > > (this message repeats many times with incrementing offset numbers) > > Near the end of the errors, I get: > > Warning: Cannot modify header information - headers already sent by (output > started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in > /var/www/html/w/includes/WebResponse.php on line 16 > > I installed using Semantic Bundle (version 2011-08-24), which uses Semantic > MediaWiki 1.61. External data plugin is version 1.3.1. > > Any help GREATLY appreciated, thanks :) > > > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user**** > > > > **** > > ** ** > > -- > WikiWorks · MediaWiki Consulting · http://wikiworks.com**** > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
Hey Yaron,
Nope. The first line of my csv is, verbatim: IP Address,Device Description No extra commas anywhere else in the data file either - each line only has one. Thanks, Mike ________________________________ From: [hidden email] [mailto:[hidden email]] On Behalf Of Yaron Koren Sent: Friday, September 02, 2011 10:23 AM To: Parks, Michael Cc: [hidden email] Subject: Re: [Semediawiki-user] [ED] Tons of PHP errors when doing #get_web_data with csv wiki page Hi Michael, I continue to think that the issue is extra values, i.e. extra commas, in some of the rows. Could it be that one or more of the rows looks like this? ABC,123,Hello, how are you, I'm fine In that case, it gets counted as five values. The correct way to deal with commas in values in CSV is via quotes, like this: ABC,123,"Hello, how are you, I'm fine" Is that possibly the issue here? -Yaron On Fri, Sep 2, 2011 at 10:13 AM, Parks, Michael <[hidden email]<mailto:[hidden email]>> wrote: Yaron, Nope, the CSV only has two columns. Interestingly enough though, if you look at the data page, the formatting is completely mangled. Looks like the newlines were stripped. Once you bring up the edit page, the proper formatting appears. ..On second thought, disregard that, since the data appears as it should when viewing the page source. The only other thing I can think of would be a large number of spaces in the description rows. I haven't thrown any extra commas in there, so other than that, I'm out of ideas :/ Thanks, Mike ________________________________ From: [hidden email]<mailto:[hidden email]> [mailto:[hidden email]<mailto:[hidden email]>] On Behalf Of Yaron Koren Sent: Thursday, September 01, 2011 10:15 PM To: Parks, Michael Cc: [hidden email]<mailto:[hidden email]> Subject: Re: [Semediawiki-user] [ED] Tons of PHP errors when doing #get_web_data with csv wiki page Hi Michael, I just looked into this - my guess is that, in the CSV file you're accessing, the header row (the first row) has fewer values than the other rows do - is that possible? In any case, External Data shouldn't be displaying those error messages - that's a bug that will be fixed in the next version. -Yaron On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael <[hidden email]<mailto:[hidden email]>> wrote: Hi all, I just got SMW installed and I'm trying to interface with a CSV dataset I have on another wiki page. I'm using the fullurl parser function as recommended on the ED documentation.. The data I'm entering into my page is as follows: {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with header|data=IP Address=IP Address,Device Description=Device Description }} When I save or preview the page, I'm left with about a full page worth of PHP error spew, which looks like: Notice: Undefined offset: 1 in /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 (this message repeats many times with incrementing offset numbers) Near the end of the errors, I get: Warning: Cannot modify header information - headers already sent by (output started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in /var/www/html/w/includes/WebResponse.php on line 16 I installed using Semantic Bundle (version 2011-08-24), which uses Semantic MediaWiki 1.61. External data plugin is version 1.3.1. Any help GREATLY appreciated, thanks :) ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email]<mailto:[hidden email]> https://lists.sourceforge.net/lists/listinfo/semediawiki-user -- WikiWorks * MediaWiki Consulting * http://wikiworks.com -- WikiWorks * MediaWiki Consulting * http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
In reply to this post by Yaron Koren-2
Hi again Yaron,
I think something else is afoot here. Just for the purposes of testing, I changed that source page to have this data: Test1,test2 1,1 2,2 3,3 I got the exact same results as with my actual data. I did anther test by uploading my actual .csv file to the wiki and using that as a data source (using {{filepath=ipdata.csv}} ) - this led to me not having any errors on the page, but having difficulties writing a table to display the data just a little later on the same page (though that's another problem :)) Any chance something is wonkey with my install/configuration? Thanks, Mike ________________________________ From: [hidden email] [mailto:[hidden email]] On Behalf Of Yaron Koren Sent: Friday, September 02, 2011 10:23 AM To: Parks, Michael Cc: [hidden email] Subject: Re: [Semediawiki-user] [ED] Tons of PHP errors when doing #get_web_data with csv wiki page Hi Michael, I continue to think that the issue is extra values, i.e. extra commas, in some of the rows. Could it be that one or more of the rows looks like this? ABC,123,Hello, how are you, I'm fine In that case, it gets counted as five values. The correct way to deal with commas in values in CSV is via quotes, like this: ABC,123,"Hello, how are you, I'm fine" Is that possibly the issue here? -Yaron On Fri, Sep 2, 2011 at 10:13 AM, Parks, Michael <[hidden email]<mailto:[hidden email]>> wrote: Yaron, Nope, the CSV only has two columns. Interestingly enough though, if you look at the data page, the formatting is completely mangled. Looks like the newlines were stripped. Once you bring up the edit page, the proper formatting appears. ..On second thought, disregard that, since the data appears as it should when viewing the page source. The only other thing I can think of would be a large number of spaces in the description rows. I haven't thrown any extra commas in there, so other than that, I'm out of ideas :/ Thanks, Mike ________________________________ From: [hidden email]<mailto:[hidden email]> [mailto:[hidden email]<mailto:[hidden email]>] On Behalf Of Yaron Koren Sent: Thursday, September 01, 2011 10:15 PM To: Parks, Michael Cc: [hidden email]<mailto:[hidden email]> Subject: Re: [Semediawiki-user] [ED] Tons of PHP errors when doing #get_web_data with csv wiki page Hi Michael, I just looked into this - my guess is that, in the CSV file you're accessing, the header row (the first row) has fewer values than the other rows do - is that possible? In any case, External Data shouldn't be displaying those error messages - that's a bug that will be fixed in the next version. -Yaron On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael <[hidden email]<mailto:[hidden email]>> wrote: Hi all, I just got SMW installed and I'm trying to interface with a CSV dataset I have on another wiki page. I'm using the fullurl parser function as recommended on the ED documentation.. The data I'm entering into my page is as follows: {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with header|data=IP Address=IP Address,Device Description=Device Description }} When I save or preview the page, I'm left with about a full page worth of PHP error spew, which looks like: Notice: Undefined offset: 1 in /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 (this message repeats many times with incrementing offset numbers) Near the end of the errors, I get: Warning: Cannot modify header information - headers already sent by (output started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in /var/www/html/w/includes/WebResponse.php on line 16 I installed using Semantic Bundle (version 2011-08-24), which uses Semantic MediaWiki 1.61. External data plugin is version 1.3.1. Any help GREATLY appreciated, thanks :) ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email]<mailto:[hidden email]> https://lists.sourceforge.net/lists/listinfo/semediawiki-user -- WikiWorks * MediaWiki Consulting * http://wikiworks.com -- WikiWorks * MediaWiki Consulting * http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: [ED] Tons of PHP errors when doing #get_web_data with csv wiki page
|
|
Hi Michael,
That is strange indeed! My guess is that it might be related to file encoding - that the CSV file contains some extra, hidden characters or something. I don't know, though. You could try creating that same CSV file with an editor other than the one you're using now, and see if the same errors show up. -Yaron On Fri, Sep 2, 2011 at 1:06 PM, Parks, Michael <[hidden email]>wrote: > Hi again Yaron,**** > > ** ** > > I think something else is afoot here. Just for the purposes of testing, I > changed that source page to have this data:**** > > ** ** > > Test1,test2**** > > 1,1**** > > 2,2**** > > 3,3**** > > ** ** > > I got the exact same results as with my actual data.**** > > ** ** > > I did anther test by uploading my actual .csv file to the wiki and using > that as a data source (using {{filepath=ipdata.csv}} ) – this led to me not > having any errors on the page, but having difficulties writing a table to > display the data just a little later on the same page (though that’s another > problem J)**** > > ** ** > > Any chance something is wonkey with my install/configuration?**** > > ** ** > > Thanks,**** > > Mike**** > > ** ** > ------------------------------ > > *From:* [hidden email] [mailto:[hidden email]] *On Behalf Of *Yaron > Koren > > *Sent:* Friday, September 02, 2011 10:23 AM > *To:* Parks, Michael > *Cc:* [hidden email] > *Subject:* Re: [Semediawiki-user] [ED] Tons of PHP errors when doing > #get_web_data with csv wiki page > **** > > ** ** > > Hi Michael,**** > > ** ** > > I continue to think that the issue is extra values, i.e. extra commas, in > some of the rows. Could it be that one or more of the rows looks like this? > **** > > ** ** > > ABC,123,Hello, how are you, I'm fine**** > > ** ** > > In that case, it gets counted as five values. The correct way to deal with > commas in values in CSV is via quotes, like this:**** > > ** ** > > ABC,123,"Hello, how are you, I'm fine"**** > > ** ** > > Is that possibly the issue here?**** > > ** ** > > -Yaron**** > > On Fri, Sep 2, 2011 at 10:13 AM, Parks, Michael < > [hidden email]> wrote:**** > > Yaron,**** > > **** > > Nope, the CSV only has two columns. Interestingly enough though, if you > look at the data page, the formatting is completely mangled. Looks like the > newlines were stripped. Once you bring up the edit page, the proper > formatting appears.**** > > **** > > ..On second thought, disregard that, since the data appears as it should > when viewing the page source.**** > > **** > > The only other thing I can think of would be a large number of spaces in > the description rows. I haven’t thrown any extra commas in there, so other > than that, I’m out of ideas :/**** > > **** > > Thanks,**** > > Mike**** > > **** > ------------------------------ > > *From:* [hidden email] [mailto:[hidden email]] *On Behalf Of *Yaron > Koren > *Sent:* Thursday, September 01, 2011 10:15 PM > *To:* Parks, Michael > *Cc:* [hidden email] > *Subject:* Re: [Semediawiki-user] [ED] Tons of PHP errors when doing > #get_web_data with csv wiki page**** > > **** > > Hi Michael,**** > > **** > > I just looked into this - my guess is that, in the CSV file you're > accessing, the header row (the first row) has fewer values than the other > rows do - is that possible?**** > > **** > > In any case, External Data shouldn't be displaying those error messages - > that's a bug that will be fixed in the next version.**** > > **** > > -Yaron**** > > On Thu, Sep 1, 2011 at 12:57 PM, Parks, Michael < > [hidden email]> wrote:**** > > Hi all, I just got SMW installed and I'm trying to interface with a CSV > dataset I have on another wiki page. I'm using the fullurl parser function > as recommended on the ED documentation.. > > The data I'm entering into my page is as follows: > > {{#get_web_data: url={{fullurl:1.2.3.4-data|action=raw}}|format=CSV with > header|data=IP Address=IP Address,Device Description=Device Description }} > > When I save or preview the page, I'm left with about a full page worth of > PHP error spew, which looks like: > > Notice: Undefined offset: 1 in > /var/www/html/w/extensions/ExternalData/ED_Utils.php on line 331 > > (this message repeats many times with incrementing offset numbers) > > Near the end of the errors, I get: > > Warning: Cannot modify header information - headers already sent by (output > started at /var/www/html/w/extensions/ExternalData/ED_Utils.php:331) in > /var/www/html/w/includes/WebResponse.php on line 16 > > I installed using Semantic Bundle (version 2011-08-24), which uses Semantic > MediaWiki 1.61. External data plugin is version 1.3.1. > > Any help GREATLY appreciated, thanks :) > > > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user**** > > > > **** > > **** > > -- > WikiWorks · MediaWiki Consulting · http://wikiworks.com**** > > > > **** > > ** ** > > -- > WikiWorks · MediaWiki Consulting · http://wikiworks.com**** > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: Gsoc 2011: Project Page Schemas
|
In reply to this post by ankit garg-2
Looks great!
Could I use this to query for the set of properties used by a class? Or is such a query made unnecessary by the display of XML on Category pages? Cheers, Dan. On 1 September 2011 17:38, ankit garg <[hidden email]> wrote: > Hi Guys, > This is Ankit garg here. I participated in gsoc-2011, this year and > successfully finished my project. I did this under the mentorship of Yaron > who was really encouraging and helpful through-out. Here is a list of > tasks we achieved . > > 1) Created a new extension, Page Schemas, that parses the defined Schemas > XML structure and stores it in memory, and provides hooks for other > extensions like (SMW <http://SMW.SF.to>, SF ,SD) add their own elements to > the XML. > Sample XML looks like > --------------------------------------------------------- > > <PageSchema> > <semanticforms_Form name="City"> > </semanticforms_Form > > <Template name="City"> > <Field name="Population"> > <Label>Pop.</Label> > <semanticmediawiki_Property name="Has population"> > <Type>Number</Type> > </semanticmediawiki_Property> > <semanticforms_FormInput> > <InputType>text</InputType> > <Parameter name="size">20</Parameter> > <Parameter name="mandatory" /> > </semanticforms_FormInput> > <semanticdrilldown_Filter> > <Label>Population</Label> > </semanticdrilldown_Filter> > </Field> > ... > </Template> > ...</PageSchema> > > > ---------------------------------------- > > 2) Added code to other extensions (Semantic MediaWiki, Semantic Forms and > Semantic Drilldown) to add parsing for additional XML elements, using those > hooks. > > 3) Added to Page Schemas a simple mechanism for displaying the XML to users > in the Category page. So when user visits the category page, he sees the > page Schema XML defined for that category > > 4) Added a special page to Semantic Schemas, "Special:GeneratePages", that > lets users generate a set of wiki pages based on the XML in one page. > > 5) Added code to other extensions to create specific page types when " > Special:GeneratePages" is called: Semantic Forms (creates templates and > forms), Semantic MediaWiki (generates property pages) and Semantic Drilldown > (generates filter pages). > > 6) Added another special page to Semantic Schemas, "Special:EditSchema", > that lets users create and edit the XML using a form. > > 7) Page Schemas also defines two tabs, that show up on category pages, to > provide this functionality: "edit schema" and "generate pages. > > More information can be found here. > http://www.mediawiki.org/wiki/Extension:Page_Schemas > > -- > Ankit Garg > Student @ SKIT > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > ------------------------------------------------------------------------------ Special Offer -- Download ArcSight Logger for FREE! Finally, a world-class log management solution at an even better price-free! And you'll get a free "Love Thy Logs" t-shirt when you download Logger. Secure your free ArcSight Logger TODAY! http://p.sf.net/sfu/arcsisghtdev2dev _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
Re: Gsoc 2011: Project Page Schemas
|
|
Hi Dan,
Page Schemas doesn't store any of the data structure via SMW, so no, you couldn't query on that sort of thing. But yes, you would be able to view all of it in one place on the category page. -Yaron On Tue, Sep 6, 2011 at 11:38 AM, Dan Bolser <[hidden email]> wrote: > Looks great! > > Could I use this to query for the set of properties used by a class? > Or is such a query made unnecessary by the display of XML on Category > pages? > > > Cheers, > Dan. > > On 1 September 2011 17:38, ankit garg <[hidden email]> wrote: > > Hi Guys, > > This is Ankit garg here. I participated in gsoc-2011, this year and > > successfully finished my project. I did this under the mentorship of > Yaron > > who was really encouraging and helpful through-out. Here is a list of > > tasks we achieved . > > > > 1) Created a new extension, Page Schemas, that parses the defined > Schemas > > XML structure and stores it in memory, and provides hooks for other > > extensions like (SMW <http://SMW.SF.to>, SF ,SD) add their own elements > to > > the XML. > > Sample XML looks like > > --------------------------------------------------------- > > > > <PageSchema> > > <semanticforms_Form name="City"> > > </semanticforms_Form > > > <Template name="City"> > > <Field name="Population"> > > <Label>Pop.</Label> > > <semanticmediawiki_Property name="Has population"> > > <Type>Number</Type> > > </semanticmediawiki_Property> > > <semanticforms_FormInput> > > <InputType>text</InputType> > > <Parameter name="size">20</Parameter> > > <Parameter name="mandatory" /> > > </semanticforms_FormInput> > > <semanticdrilldown_Filter> > > <Label>Population</Label> > > </semanticdrilldown_Filter> > > </Field> > > ... > > </Template> > > ...</PageSchema> > > > > > > ---------------------------------------- > > > > 2) Added code to other extensions (Semantic MediaWiki, Semantic Forms > and > > Semantic Drilldown) to add parsing for additional XML elements, using > those > > hooks. > > > > 3) Added to Page Schemas a simple mechanism for displaying the XML to > users > > in the Category page. So when user visits the category page, he sees the > > page Schema XML defined for that category > > > > 4) Added a special page to Semantic Schemas, "Special:GeneratePages", > that > > lets users generate a set of wiki pages based on the XML in one page. > > > > 5) Added code to other extensions to create specific page types when " > > Special:GeneratePages" is called: Semantic Forms (creates templates and > > forms), Semantic MediaWiki (generates property pages) and Semantic > Drilldown > > (generates filter pages). > > > > 6) Added another special page to Semantic Schemas, "Special:EditSchema", > > that lets users create and edit the XML using a form. > > > > 7) Page Schemas also defines two tabs, that show up on category pages, to > > provide this functionality: "edit schema" and "generate pages. > > > > More information can be found here. > > http://www.mediawiki.org/wiki/Extension:Page_Schemas > > > > -- > > Ankit Garg > > Student @ SKIT > > > ------------------------------------------------------------------------------ > > Special Offer -- Download ArcSight Logger for FREE! > > Finally, a world-class log management solution at an even better > > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > > download Logger. Secure your free ArcSight Logger TODAY! > > http://p.sf.net/sfu/arcsisghtdev2dev > > _______________________________________________ > > Semediawiki-user mailing list > > [hidden email] > > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > > > > > ------------------------------------------------------------------------------ > Special Offer -- Download ArcSight Logger for FREE! > Finally, a world-class log management solution at an even better > price-free! And you'll get a free "Love Thy Logs" t-shirt when you > download Logger. Secure your free ArcSight Logger TODAY! > http://p.sf.net/sfu/arcsisghtdev2dev > _______________________________________________ > Semediawiki-user mailing list > [hidden email] > https://lists.sourceforge.net/lists/listinfo/semediawiki-user > -- WikiWorks · MediaWiki Consulting · http://wikiworks.com ------------------------------------------------------------------------------ Malware Security Report: Protecting Your Business, Customers, and the Bottom Line. Protect your business and customers by understanding the threat from malware and how it can impact your online business. http://www.accelacomm.com/jaw/sfnl/114/51427462/ _______________________________________________ Semediawiki-user mailing list [hidden email] https://lists.sourceforge.net/lists/listinfo/semediawiki-user |
|
In reply to this post by Yaron Koren-2
It sounds very promising. You mentioned that it's still undergoing changes - could you give an example of what remains to be done with it? Will Ankit Garg be continuing to work on it, or has it been completely handed over?
|
|
|
In reply to this post by Yaron Koren-2
It sounds very promising. You mentioned that it's still undergoing changes - could you give an example of what remains to be done with it? Will Ankit Garg be continuing to work on it, or has it been completely handed over?
|
«
Return to Semantic Mediawiki - User
|
1 view|%1 views
Loading...
| Powered by Nabble | Edit this page |