{"id":402,"date":"2008-12-09T13:29:03","date_gmt":"2008-12-09T20:29:03","guid":{"rendered":"https:\/\/dubinko.info\/blog\/?p=402"},"modified":"2008-12-09T14:59:32","modified_gmt":"2008-12-09T21:59:32","slug":"xml-2008-liveblog-automating-content-analysis-with-trang-and-simple-xslt-scripts","status":"publish","type":"post","link":"https:\/\/dubinko.info\/blog\/2008\/12\/xml-2008-liveblog-automating-content-analysis-with-trang-and-simple-xslt-scripts\/","title":{"rendered":"XML 2008 liveblog: Automating Content Analysis with Trang and Simple XSLT Scripts"},"content":{"rendered":"

Bob DuCharme, Innodata Isogen<\/p>\n

Content analysis: why? You’ve “inherited” content. Need to save time or effort.<\/p>\n

Handy tool 1: “sort”. As in the Unix command line tool. (Even Windows)<\/p>\n

Handy tool 2: “uniq -c”\u00c2\u00a0 (flag -c means include counts)<\/p>\n

Elsevier contest: interface for reading journals. Download a bunch of articles, and see what’s all in there.<\/p>\n

Handy tool 3: Trang<\/a>. Schema language converter. But can infer a schema from one or more input documents. Concat all sample documents under one root, and infer–this gives a list of all doctypes in use.<\/p>\n

trang article.dtd article.rng<\/code>
\ntrang issueContents.xml issueContents.rng<\/code>
\nsaxon article.rng compareElsRNG.xsl | sort > compareElsRNG.out<\/code><\/p>\n

compareElsRNG.xsl has text mode output, ignores input text nodes, and checks whether the RNG has references to each element, outputing “Yes: elementname” or “No: elemenname”. (which gets sorted in step 3)<\/p>\n

Helps ferret out places where the schema says 40 different child elements are possible but in practice only 4 are used.<\/p>\n

Handy tool 4: James Clark’s sx, converts SGML to XML.<\/p>\n

Another stylesheet counts elements producing a histogram. [Ed. I would do this in XQuery in CQ<\/a>.] Again, can help prioritize parts of the XML to use first. Similar logic for parent\/child counts; where @id gets used; find all values for a particular attribute.<\/p>\n

Another stylesheet goes through multiple converted-to-rng schemas, looking for common substructure. Lists generated this way can be pulled into a stylesheet.<\/p>\n

Analyze a SGML DTD? dtd2html -> tidy -> XSLT. Clients like reports (especially spreadsheets). The is more like lego bricks.<\/p>\n

-m<\/p>\n","protected":false},"excerpt":{"rendered":"

Bob DuCharme, Innodata Isogen Content analysis: why? You’ve “inherited” content. Need to save time or effort. Handy tool 1: “sort”. As in the Unix command line tool. (Even Windows) Handy tool 2: “uniq -c”\u00c2\u00a0 (flag -c means include counts) Elsevier contest: interface for reading journals. Download a bunch of articles, and see what’s all in…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[28,3,9,4],"tags":[555,541,556,558,557,534],"class_list":["post-402","post","type-post","status-publish","format-standard","hentry","category-everythingismiscellaneous","category-patternalia","category-standards","category-xml","tag-analysis","tag-content","tag-sort","tag-trang","tag-uniq","tag-xml2008"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p8eo8l-6u","_links":{"self":[{"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/posts\/402","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/comments?post=402"}],"version-history":[{"count":0,"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/posts\/402\/revisions"}],"wp:attachment":[{"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/media?parent=402"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/categories?post=402"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dubinko.info\/blog\/wp-json\/wp\/v2\/tags?post=402"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}