{"id":644,"date":"2009-09-16T23:07:00","date_gmt":"2009-09-17T06:07:00","guid":{"rendered":"https:\/\/dubinko.info\/blog\/?p=644"},"modified":"2009-09-16T23:07:01","modified_gmt":"2009-09-17T06:07:01","slug":"billion-triples-challenge","status":"publish","type":"post","link":"https:\/\/dubinko.info\/blog\/2009\/09\/billion-triples-challenge\/","title":{"rendered":"Billion triples challenge"},"content":{"rendered":"

I had been asking around earlier for large RDF datasets. Here’s one<\/a>. Looks like a great contest to build an app around this, but unfortunately, the deadline looks like it’s soonish (1 Oct).<\/p>\n

What is it?<\/p>\n

The major part of the dataset was crawled during February\/March 2009 based on datasets provided by Falcon-S, Sindice, Swoogle, SWSE, and Watson using the MultiCrawler\/SWSE framework. To ensure wide coverage, we also included a (bounded) breadth-first crawl of depth 50 starting from http:\/\/www.w3.org\/People\/Berners-Lee\/card.<\/p>\n

The downloaded content was parsed using the Redland toolkit<\/a> with rdfxml, rss-tag-soup, rdfa parsers. We rewrote blank node identifiers to include the data source in order to provide unique blank nodes for each data source, and appended the data source to the output file. The data is encoded in NQuads format<\/a> and split into chunks of 10m statements each.<\/p><\/blockquote>\n

The page includes some fairly detailed statistics on the data breakdown. Cool. -m<\/p>\n","protected":false},"excerpt":{"rendered":"

I had been asking around earlier for large RDF datasets. Here’s one. Looks like a great contest to build an app around this, but unfortunately, the deadline looks like it’s soonish (1 Oct). What is it? The major part of the dataset was crawled during February\/March 2009 based on datasets provided by Falcon-S, Sindice, Swoogle,…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[23,41],"tags":[430,181,855,854,853,106],"class_list":["post-644","post","type-post","status-publish","format-standard","hentry","category-announcement","category-metadata","tag-data","tag-rdf","tag-redland","tag-scale","tag-semanticweb","tag-semweb"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t