{"id":402,"date":"2008-12-09T13:29:03","date_gmt":"2008-12-09T20:29:03","guid":{"rendered":"https:\/\/dubinko.info\/blog\/?p=402"},"modified":"2008-12-09T14:59:32","modified_gmt":"2008-12-09T21:59:32","slug":"xml-2008-liveblog-automating-content-analysis-with-trang-and-simple-xslt-scripts","status":"publish","type":"post","link":"https:\/\/dubinko.info\/blog\/2008\/12\/xml-2008-liveblog-automating-content-analysis-with-trang-and-simple-xslt-scripts\/","title":{"rendered":"XML 2008 liveblog: Automating Content Analysis with Trang and Simple XSLT Scripts"},"content":{"rendered":"

Bob DuCharme, Innodata Isogen<\/p>\n

Content analysis: why? You’ve “inherited” content. Need to save time or effort.<\/p>\n

Handy tool 1: “sort”. As in the Unix command line tool. (Even Windows)<\/p>\n

Handy tool 2: “uniq -c”\u00c2\u00a0 (flag -c means include counts)<\/p>\n

Elsevier contest: interface for reading journals. Download a bunch of articles, and see what’s all in there.<\/p>\n

Handy tool 3: Trang<\/a>. Schema language converter. But can infer a schema from one or more input documents. Concat all sample documents under one root, and infer–this gives a list of all doctypes in use.<\/p>\n

trang article.dtd article.rng<\/code>
\ntrang issueContents.xml issueContents.rng<\/code>
\nsaxon article.rng compareElsRNG.xsl | sort > compareElsRNG.out<\/code><\/p>\n

compareElsRNG.xsl has text mode output, ignores input text nodes, and checks whether the RNG has references to each element, outputing “Yes: elementname” or “No: elemenname”. (which gets sorted in step 3)<\/p>\n

Helps ferret out places where the schema says 40 different child elements are possible but in practice only 4 are used.<\/p>\n

Handy tool 4: James Clark’s sx, converts SGML to XML.<\/p>\n

Another stylesheet counts elements producing a histogram. [Ed. I would do this in XQuery in CQ<\/a>.] Again, can help prioritize parts of the XML to use first. Similar logic for parent\/child counts; where @id gets used; find all values for a particular attribute.<\/p>\n

Another stylesheet goes through multiple converted-to-rng schemas, looking for common substructure. Lists generated this way can be pulled into a stylesheet.<\/p>\n

Analyze a SGML DTD? dtd2html -> tidy -> XSLT. Clients like reports (especially spreadsheets). The is more like lego bricks.<\/p>\n

-m<\/p>\n","protected":false},"excerpt":{"rendered":"

Bob DuCharme, Innodata Isogen Content analysis: why? You’ve “inherited” content. Need to save time or effort. Handy tool 1: “sort”. As in the Unix command line tool. (Even Windows) Handy tool 2: “uniq -c”\u00c2\u00a0 (flag -c means include counts) Elsevier contest: interface for reading journals. Download a bunch of articles, and see what’s all in…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[28,3,9,4],"tags":[555,541,556,558,557,534],"class_list":["post-402","post","type-post","status-publish","format-standard","hentry","category-everythingismiscellaneous","category-patternalia","category-standards","category-xml","tag-analysis","tag-content","tag-sort","tag-trang","tag-uniq","tag-xml2008"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t