Open Source Text Processing Project: THUTag

THUTag: A Package of Keyphrase Extraction and Social Tag Suggetion Project Website: None Github Link: https://github.com/YeDeming/THUTag/ Description Part I : THUTag Contents Part II : How To Compile THUTag Part III : How To Run Cross-validation of THUTag Part IV … Continue reading

Open Source Text Processing Project: langid

langid.py: Stand-alone language identification system Project Website: None Github Link: https://github.com/saffsd/langid.py Description langid.py is a standalone Language Identification (LangID) tool. The design principles are as follows: Fast Pre-trained over a large number of languages (currently 97) Not sensitive to domain-specific … Continue reading

Open Source Text Processing Project: LingPipe

LingPipe Project Website: http://alias-i.com/lingpipe/ Github Link: None Description LingPipe is tool kit for processing text using computational linguistics. LingPipe is used to do tasks like: Find the names of people, organizations or locations in news Automatically classify Twitter search results … Continue reading

Open Source Text Processing Project: OpenNLP

Apache OpenNLP Project Website: https://opennlp.apache.org/ Github Link: None Description The Apache OpenNLP library is a machine learning based toolkit for the processing of natural language text. It supports the most common NLP tasks, such as tokenization, sentence segmentation, part-of-speech tagging, … Continue reading

Open Source Text Processing Project: GATE

GATE: a full-lifecycle open source solution for text processing Project Website: https://gate.ac.uk/ Github Link: None Description GATE is… open source software capable of solving almost any text processing problem a mature and extensive community of developers, users, educators, students and … Continue reading

Open Source Text Processing Project: ClearNLP

ClearNLP:Software and resources for natural language processing Project Website: http://www.clearnlp.com Github Link: https://github.com/clir/clearnlp Description The ClearNLP project provides software and resources for natural language processing. The project started at the Center for Computational Language and EducAtion Research, and is currently … Continue reading

Open Source Text Processing Project: Stanford Open Information Extraction

Stanford Open Information Extraction Project Website: http://nlp.stanford.edu/software/openie.shtml Github Link: None Description Open information extraction (open IE) refers to the extraction of structured relation triples from plain text, such that the schema for these relations does not need to be specified … Continue reading

Open Source Text Processing Project: Stanford Tokenizer

Stanford Tokenizer Project Website: http://nlp.stanford.edu/software/tokenizer.shtml Github Link: None Description A tokenizer divides text into a sequence of tokens, which roughly correspond to “words”. We provide a class suitable for tokenization of English, called PTBTokenizer. It was initially designed to largely … Continue reading

Open Source Text Processing Project: Stanford Classifer

Stanford Classifer Project Website: http://nlp.stanford.edu/software/classifier.shtml Github Link: None Description A classifier is a machine learning tool that will take data items and place them into one of k classes. A probabilistic classifier, like this one, can also give a probability … Continue reading

Open Source Text Processing Project: Stanford Word Segmenter

Stanford Word Segmenter Project Website: http://nlp.stanford.edu/software/segmenter.shtml Github Link: None Description Tokenization of raw text is a standard pre-processing step for many NLP tasks. For English, tokenization usually involves punctuation splitting and separation of some affixes like possessives. Other languages require … Continue reading