Open Source Text Processing Project: Stanford Temporal Tagger

Stanford Temporal Tagger Project Website: http://nlp.stanford.edu/software/sutime.html Github Link: None Description SUTime is a library for recognizing and normalizing time expressions. That is, it will convert next wednesday at 3pm to something like 2016-02-17T15:00 (depending on the assumed current reference time). … Continue reading

Open Source Text Processing Project: Stanford Open Information Extraction

Stanford Open Information Extraction Project Website: http://nlp.stanford.edu/software/openie.shtml Github Link: None Description Open information extraction (open IE) refers to the extraction of structured relation triples from plain text, such that the schema for these relations does not need to be specified … Continue reading

Open Source Text Processing Project: Stanford Tokenizer

Stanford Tokenizer Project Website: http://nlp.stanford.edu/software/tokenizer.shtml Github Link: None Description A tokenizer divides text into a sequence of tokens, which roughly correspond to “words”. We provide a class suitable for tokenization of English, called PTBTokenizer. It was initially designed to largely … Continue reading

Open Source Text Processing Project: Stanford Classifer

Stanford Classifer Project Website: http://nlp.stanford.edu/software/classifier.shtml Github Link: None Description A classifier is a machine learning tool that will take data items and place them into one of k classes. A probabilistic classifier, like this one, can also give a probability … Continue reading

Open Source Text Processing Project: Stanford Word Segmenter

Stanford Word Segmenter Project Website: http://nlp.stanford.edu/software/segmenter.shtml Github Link: None Description Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, tokenization usually involves punctuation splitting and separation of some affixes like possessives. Other languages require … Continue reading

Open Source Text Processing Project: The Stanford Parser (A statistical parser)

The Stanford Parser: A statistical parser Project Website: http://nlp.stanford.edu/software/lex-parser.shtml Github Link: None Description A natural language parser is a program that works out the grammatical structure of sentences, for instance, which groups of words go together (as “phrases”) and which … Continue reading

Open Source Text Processing Project: Stanford Named Entity Recognizer (NER)

Stanford Named Entity Recognizer (NER) Project Website: http://nlp.stanford.edu/software/CRF-NER.shtml Github Link: None Description Stanford NER is a Java implementation of a Named Entity Recognizer. Named Entity Recognition (NER) labels sequences of words in a text which are the names of things, … Continue reading

Open Source Text Processing Project: Stanford Log-linear Part-Of-Speech Tagger

Stanford Log-linear Part-Of-Speech Tagger Project Website: http://nlp.stanford.edu/software/tagger.shtml Github Link: None Description A Part-Of-Speech Tagger (POS Tagger) is a piece of software that reads text in some language and assigns parts of speech to each word (and other token), such as … Continue reading

Open Source Text Processing Project: Stanford CoreNLP

Stanford CoreNLP – a suite of core NLP tools Project Website: http://stanfordnlp.github.io/CoreNLP/ Github Link: https://github.com/stanfordnlp/CoreNLP Description Stanford CoreNLP provides a set of natural language analysis tools. It can give the base forms of words, their parts of speech, whether they … Continue reading

Text Processing Book: Foundations of Statistical Natural Language Processing, 1st Edition

Foundations of Statistical Natural Language Processing Description Statistical approaches to processing natural language text have become dominant in recent years. This foundational text is the first comprehensive introduction to statistical natural language processing (NLP) to appear. The book contains all … Continue reading