Wikipedia
Wikipedia is a multilingual, web-based, free content encyclopedia project. Wikipedia is written collaboratively by volunteers; the vast majority of its articles can be edited by anyone with access to the Internet. Wikipedia's name is a portmanteau of the words wiki (a type of collaborative website) and encyclopedia. Its main servers are in Tampa, Florida, with additional servers in Amsterdam and Seoul. Wikipedia's English edition was launched on January 15, 2001, as a complement to Nupedia, an expert-written and now defunct encyclopedia. The project is currently operated by the Wikimedia Foundation, a non-profit organization created by Jimmy Wales, who claims to be the sole founder of Wikipedia. This is disputed by Larry Sanger, who also claims to be a founder of Wikipedia. Wikipedia has approximately 7.5 million articles in 253 languages. [1]
Contents
API
- Wikipedia API: http://en.wikipedia.org/w/api.php[2]
- Wikipedia API -- Main page: http://www.mediawiki.org/wiki/API[3][4]
Revisions (shown as wikitext, which needs to be rendered to HTML)[5][6][7][8][9][10][11]
The following is a sample Wikipedia API call to see recent revisions of the "New York Yankees" article (HTML version of XML):
http://en.wikipedia.org/w/api.php?action=query&prop=revisions&titles=New_York_Yankees&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent
The same as XML:
http://en.wikipedia.org/w/api.php?action=query&prop=revisions&titles=New_York_Yankees&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&format=xml
The same as JSON:
http://en.wikipedia.org/w/api.php?action=query&prop=revisions&titles=New_York_Yankees&rvprop=timestamp%7Cuser%7Ccomment%7Ccontent&format=json
Articles (by title)
http://en.wikipedia.org/w/api.php?action=query&titles=India
Link to Article (by pageid <==> curid)
http://en.wikipedia.org/wiki/?curid=14533
owl:sameAs
http://en.wikipedia.org/wiki/India
Parse/Render Article
http://en.wikipedia.org/w/api.php?action=parse&page=India
Articles (return all articles with the specified text in their body)
http://en.wikipedia.org/w/api.php?action=query&list=search&srwhat=text&srsearch=Meaning
External Links (return all external links at the bottom of the wiki article):
http://en.wikipedia.org/w/api.php?action=query&titles=India&prop=extlinks
Images (return all media - including mostly images but also audio/video files uploaded to wikipedia, in a given alphabetic range):
http://en.wikipedia.org/w/api.php?action=query&list=allimages&aifrom=India&aito=Indian
Info Blocks
http://en.wikipedia.org/w/api.php?action=query&titles=India&prop=info
Templates (side-box templates, for example for the country "India")
http://en.wikipedia.org/w/api.php?action=expandtemplates&text=Template:India
- BCmoney Wikipedia: http://bcmoney-mobiletv.com/widgets/wikipedia/[12]
- Using the Wikipedia API – Live Demo with Source Code: http://www.labnol.org/internet/tools/using-wikipedia-api-demo-source-code-example/3076/
- Query Wikipedia’s API using AJAX (XMLHttpRequest): http://stackoverflow.com/questions/2374377/query-wikipedias-api-using-ajax-xmlhttprequest
Export
You can also use the XML Export feature to export wiki-formatted, but non-rendered (i.e. data directly from "edit" view, not "html" article view). This works for any wikimedia distribution (unless that feature is deactivated). You can access the export data for any article using the following format:
http://en.wikipedia.org/wiki/Special:Export/<article_title>
EXAMPLE:
http://en.wikipedia.org/wiki/Special:Export/International_University_of_Japan
- Wikimedia - export schema: http://www.mediawiki.org/xml/export-0.4/
- Wikimedia - Export - XML Schema: http://www.mediawiki.org/xml/export-0.4.xsd
GeoCodes
- WikiLocation - Geolocation API for Wikipedia: http://wikilocation.org/ (pull geocode data out of Wikipedia articles)
Wikia
Wikia is a user-generated approach to improving Search Results, following the successful model of a user-generated encyclopedia from Wikipedia. It is founded by the non-profit WikiMedia corporation, and was likewise the brainchild of Wikipedia's/WikiMedia founder Jimmy Wales.
- Jimmy Wales - The New Wikia Search API “Is Like Facebook Apps For Search Results.”: http://www.techcrunch.com/2008/10/07/jimmy-wales-the-new-wikia-search-api-is-like-facebook-apps-for-search-results/
Tools
- Magnus' magic MediaWiki-to-XML-to-stuff converter: http://toolserver.org/~magnus/wiki2xml/w2x.php
- Wikipedia - Relation Visualizer: http://dev.sigwp.org/WikiVisSL.Web/Visualizer.aspx
- Anti-Spam, wiki spam killing script: http://www.mediawiki.org/wiki/Anti-spam_features#Spam_cleanup_script
Resources
- Parameters to Wikipedia's "index.php": http://www.mediawiki.org/wiki/Manual:Parameters_to_index.php
- WikiSlurp: http://thecodetrain.co.uk/code/wikislurp/ (run your own Wikipedia grabber web service)
- jWiki: https://github.com/fastily/jwiki (library for effortlessly interacting with Wikipedia/MediaWiki)
- "wiki-java" -- MediaWiki bot framework in Java: https://github.com/mer-c/wiki-java
- Java Wiki Bot Framework: https://github.com/eldur/jwbf (library to maintain Wikis like Wikipedia based on MediaWiki)
- AJAX Wikipedia app (using Google Custom Search): http://chir.ag/wiki/
- JavaScript Creole 1.0 Wiki Markup Parser: http://www.ivan.fomichev.name/2008/04/javascript-creole-10-wiki-markup-parser.html
- "Locking Down" MediaWiki: http://forums.whirlpool.net.au/archive/537933
- Parsing Wikipedia's WikiText format: http://www.mediawiki.org/wiki/API:Parsing_wikitext
- Wikipedia's Top External Sources: http://www.makeuseof.com/tech-fun/wikipedias-top-sources-infographics/ (INFOGRAPHIC)
Tutorials
- Call Wikipedia API using jQuery: http://labs.steren.fr/2010/11/18/call-wikipedia-api-using-jquery/
- Getting DBPedia Infobox categories: http://stackoverflow.com/questions/5364851/getting-dbpedia-infobox-categories
- PHP bot to get wikipedia definitions: http://www.barattalo.it/2010/08/29/php-bot-to-get-wikipedia-definitions/
- Wikipedia API - grab 'Background Inforamtion' Table?: http://stackoverflow.com/questions/5909384/wikipedia-api-grab-background-inforamtion-table
- Getting the infobox section of wikipedia: http://stackoverflow.com/questions/3312346/getting-the-infobox-section-of-wikipedia
- PHP connecting to MediaWiki API and retrieve data: http://stackoverflow.com/questions/1897511/php-connecting-to-mediawiki-api-and-retrieve-data/1897606#1897606
- Hook into Wikipedia using Java and the MediaWiki API - : www.integratingstuff.com/2012/04/06/hook-into-wikipedia-using-java-and-the-mediawiki-api/[19]
- Java XML parser for the Wikpiedia API data using a "StAX" parser: https://github.com/martinffx/wikipedia-data-parser
External Links
- wikipedia: Wikipedia:Creating a bot
- wikipedia: Wikipedia:Database download
- Top 10 Ways to Search Wikipedia: http://www.readwriteweb.com/archives/top_10_ways_to_search_wikipedia.php
- Wikipedia:Creating a bot: http://en.wikipedia.org/wiki/Wikipedia:Creating_a_bot#APIs_for_bots
- Wikipedia API (SVN): http://svn.wikimedia.org/viewvc/mediawiki/trunk/phase3/includes/api/
- Wikipedia - SQL Table Structure: http://svn.wikimedia.org/viewvc/mediawiki/trunk/phase3/maintenance/tables.sql?view=markup
- Is there a Wikipedia API?: http://stackoverflow.com/questions/627594/is-there-a-wikipedia-api
- How to use wikipedia api if it exists?: http://stackoverflow.com/questions/964454/how-to-use-wikipedia-api-if-it-exists
- Scraping and Parsing a Wikipedia Page: http://stackoverflow.com/questions/1633296/scraping-and-parsing-a-wikipedia-page
- Extract paragraphs from Wikipedia API using PHP cURL: http://stackoverflow.com/questions/2879973/extract-paragraphs-from-wikipedia-api-using-php-curl
- Is there a Wikipedia API?: http://stackoverflow.com/questions/627594/is-there-a-wikipedia-api
- Wikimedia Foundation Raises $25M In Donations Over 9 Days: http://techcrunch.com/2012/12/27/wikimedia-foundation-raises-25m-in-donations-over-9-days/
- What are the ten most cited sources on Wikipedia? Let’s ask the data: https://medium.com/freely-sharing-the-sum-of-all-knowledge/what-are-the-ten-most-cited-sources-on-wikipedia-lets-ask-the-data-34071478785a
- Will Everipedia Bring Respectability Back to the World of Online Encyclopedias?: https://hackernoon.com/everipedia-brings-respectability-back-to-the-world-of-digital-encyclopedias-80cd6da95cdb
- Wikipedia Wants Tech To Pay Up For Content: https://www.mediapost.com/publications/article/361574/wikipedia-wants-tech-to-pay-up-for-content.html
References
- ↑ Wikipedia entry on Freebase: http://www.freebase.com/view/guid/9202a8c04000641f8000000000c01eaf
- ↑ Wikipedia API (Programmable Web entry): http://www.programmableweb.com/api/wikipedia
- ↑ Wikipedia Labs - Ontology (BETA): http://wikipedia-lab.org/
- ↑ Wikipedia Labs - Web Service WSDL (BETA): http://dev.wikipedia-lab.org/WikipediaOntologyAPIv3/Service.asmx?WSDL
- ↑ MediaWiki API - Parsing wikitext: http://www.mediawiki.org/wiki/API%3aParsing_wikitext#parse
- ↑ Wiki Text Plugin for jQuery: http://www.kajabity.com/jquery-wikitext/usage.html
- ↑ Wiky.js - a simple Javascript library to convert Wiki MarkUp language to HTML: https://github.com/tanin47/wiky.js
- ↑ JavaScript Creole 1.0 Wiki Markup Parser: http://www.ivan.fomichev.name/2008/04/javascript-creole-10-wiki-markup-parser.html
- ↑ PHP Parse text with Wiki syntax into an XML document: http://www.phpclasses.org/package/6124-PHP-Parse-text-with-Wiki-syntax-into-a-XML-document.html
- ↑ Java GWT wikipedia API: http://code.google.com/p/gwtwiki/
- ↑ Ruby - Wikitext::Parser: http://wikitext.rubyforge.org/classes/Wikitext/Parser.html
- ↑ Build your own dynamic Wikipedia Search widget (using JavaScript only): http://kentbrewster.com/wiki-widget/
- ↑ Hook into Wikipedia information using PHP and the MediaWiki API: http://www.ibm.com/developerworks/web/library/x-phpwikipedia/
- ↑ jwpl - Java Wikipedia Library: http://code.google.com/p/jwpl/
- ↑ Ruby Wrapper for Wikipedia API: https://github.com/schleyfox/wikipedia-api
- ↑ Quering Wikipedia structured data with SPARQL in .NET: http://www.kozlenko.info/blog/2010/07/20/executing-sparql-query-on-wikipedia-in-net/
- ↑ Wikipedia Articles Title Autocomplete (faster version of Autocomplete API only): http://www.infochimps.com/datasets/wikipedia-articles-title-autocomplete
- ↑ Wikipedia Articles Abstract Search (summarized version of full API): http://www.infochimps.com/datasets/wikipedia-articles-abstract-search
- ↑ Bliki lib for Wikipedia in Java: https://bitbucket.org/axelclk/info.bliki.wiki/wiki/Home