Natural Language Processing

Python Programs


Extraction

This program is an example of feature extraction with text. It predicts whether a text message is SPAM or a legitimate text message.

Click here for code


Lemmatization

This program looks at surrounding text to determine a given word's part of speech. It considers a language's full vocabulary to apply a morphological analysis to words.

Click here for code


Matcher

This program is an example of rule based matching. It demonstrates how you can find words and phrases inside text.

Click here for code


Movie

Text classifcation project - We'll be able to tell whether a movie review is positive or negative based off the texts.

Click here for code


NER

Named-entity recognition(NER) locates and classifes named entity mentions in unstructured text into pre-defined categories such as the person names, organizations, locations, etc.

Click here for code


Classifier Projects

Simple language processing examples that shows classification techniques with the naive Bayes algorithm.

PDF of movie classifier

PDF of gender classifier


Parts of Speech

The example below shows how spacy can note the difference in present and past tense based on the context of the sentence.

Click here for code


Spacy

Spacy intro - introduction to Spacy along with a visualization.

Click here for code


Stemming

This is an example of Porter's Alogrithm and Snowball-both stemming tools created by Martin Porter.

Click here for code


Stop Words

This is an example of stop words used in Spacy.

Click here for code