A special case: TEI data

Removing project-authored text: 

<figDesc>A portrait of a woman</figDesc>

Removing speaker labels: 

  <sp who="#ign">
    <speaker>Lady Ignorant</speaker>
    <p>Lord Husband! I can never have your company, for you are at all times writing,
    or reading, or turning your Globes, or peaking through your Perspective Glasse,
    or repeating Verses, or speaking Speaches to yourself.
    </p>
  </sp>

Advanced tokenization: 

  <p>I was just returning from our <placeName>New London</placeName> summer
  home where I had seen the most marvelous performance of the 
  new <orgName><placeName>London</placeName> Symphony Orchestra</orgName> traveling 
  production of <title><persName>Peter</persName> and the Wolf</title>.
  </p>

Processes for Data Preparation and Model Training slide 09 of 14
© 2007 Syd Bauman, Julia Flanders, and the Women Writers Project This TEI-encoded XML file is available under the terms of the Creative Commons Attribution-ShareAlike 3.0 (Unported) license.