Preparing documents for analysis is a much bigger problem than is generally appreciated

Even structured data like email is often delivered on paper. Robust analysis . Journalists routinely deal with unbelievably dirty documents. OCR error confounds classic algorithms. Shorthand and jargon break dictionaries and parsers. Quantitative summaries . Journalists have long produced stories by counting the number of documents of a certain type.
_

Mable:
I'm 15 and me and my boyfriend had sex (with a condom) for the first time 4 or 5 days ago.
(30 November 2016)

Chanel:
How can I get her to prove she's real?
(30 November 2016)

Chanel:
How can she prove my head wrong.
(30 November 2016)

Chanel:
My head says she fake, but my lonely heart says she's real.
(30 November 2016)

Chanel:
She wants money for her papers, but hasn't proved she's real.
(30 November 2016)

Chanel:
So I met this girl online from Ghana.
(30 November 2016)

Heidy:
Is my girlfriend faking her attraction to me?
(30 November 2016)

Heidy:
Are my worries warranted or am i just being paranoid.
(30 November 2016)

Heidy:
I don t doubt her love at all but i doubt her attraction to me and feel like shes only in the relationship for the emotional security.
(30 November 2016)

Heidy:
Its the complete opposite with me however.
(30 November 2016)

_

Karoline:
Plus she blindly listens to whatever is told to her and she is very lazy.
(22 December 2016)

Karoline:
She's the brightest of her siblings, but she's wasting her potential by getting distracted with her boyfriend, her grades are terrible, and she has no ambition.
(22 December 2016)

Karoline:
So I am worried about my younger cousin.
(22 December 2016)

Lettie:
Can a person forget someone whom you love the most and who loves you the most?
(22 December 2016)

Lettie:
Now, I just can not stop thinking about the moments which I had with him and crying.Please help me to stop THINKING ABOUT HIM and LOVING HIM.
(22 December 2016)

Lettie:
He also asked me to not leave him bur after haring the reason he let me to break up with him.
(22 December 2016)

Lettie:
Our personality, interest and everything matches perfectly.
(22 December 2016)

Lettie:
I am regretting a lot that I should have left in June instead of waiting till December because it would not be hard and hurtful like this.
(22 December 2016)

Lettie:
But I feel like I really can not forget him.
(22 December 2016)

Lettie:
I blocked him on phone and on fb too.
(22 December 2016)