Tag

• MOCHA-TIMIT

  Offsite — About Authors: Alan Wrench, Queen Margaret University College. Funded by: Engineering and Physical Sciences Research Council. When created: November 1999. Purpose: Phonetically balanced dataset for training an automatic speech recognition system Openness Availability: English speakers available here free for non-commercial use and may be distributed on CDROM for a ...

• ualberta dependency based thesaurus and word count data

  Offsite —

• Freebase Wikipedia Extraction (WEX)

  Offsite —

• Natural Language Processing

  Offsite — The goal of the Natural Language Processing (NLP) group is to design and build software that will analyze, understand, and generate languages that humans use naturally, so that eventually you will be able to address your computer as though you were addressing another person.

• AG's corpus of news articles

  Offsite —

• Biomedical Text corpora and related data collection resources.

  Offsite —

• Data Mining: Text Mining, Visualization and Social Media: TailRank, Spinn3r, TechMeme and TechCrunch

  Offsite —

• The arXiv on your harddrive

  Offsite —

• Splog Blog Dataset

  Offsite —

• Home Page for 20 Newsgroups Data Set

  Offsite —

• Statistical NLP / corpus-based computational linguistics resources

  Offsite —

• Word List - 250,000+ Hyphenated, Capitalized and Compound English words

  Free Download — A common word list with over 250,000 entries of hyphenated, capitalized and compound English words. The download consists of entries containing more than one word, as well as capitalized words and acronyms. Phrases are considered “common” if they or variations of them occur in a standard dictionary or thesaurus. This word list is available in a simple, ...

• The New York Times Annotated Corpus

  Offsite — From [website](http://ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2008T19): The New York Times Annotated Corpus contains over 1.8 million articles written and published by the New York Times between January 1, 1987 and June 19, 2007 with article metadata provided by the New York Times Newsroom, the New York Times Indexing Service and the online production staff ...

• Linguistic Data Consortium (LDC) - Collection of Linguistic Corpora and Datasets

  Offsite — The Linguistic Data Consortium is an open consortium of universities, companies and government research laboratories. It creates, collects and distributes speech and text databases, lexicons, and other resources for research and development purposes. The University of Pennsylvania is the LDC’s host institution. The LDC was founded in 1992 with a grant from the Advanced ...

• Word List - 1000 Most Frequent Words from an Internet Corpus

  Free Download — This file consists of the 1,000 most frequently used English words as used on the Internet computer network in 1992.

• TREC-9 Filtering Track Collections - MEDLINE Extract with Relevance Measures

  Offsite — The OHSUMED test collection is a set of 348,566 references from MEDLINE, the on-line medical information database, consisting of titles and/or abstracts from 270 medical journals over a five-year period (1987-1991). The available fields are title, abstract, MeSH indexing terms, author, source, and publication type. License The National Library of Medicine has agreed to ...

• Word List - 350,000+ Simple English Words (with some Definitions, Excel format)

  Free Download — Over 354,000 single words, excluding proper names, acronyms, or compound words and phrases. Some, but not all of the words have definitions. This list does not exclude archaic words or significant variant spellings.

• Word List - 1,000 Most Frequently Used English Words by Frequency (with Definitions, Excel format)

  Free Download — This file consists of the 1,000 most frequently used English words from a wide variety of common texts listed in decreasing order of frequency

• 20 Newsgroups Dataset (De-Duped Version)

  Free Download — The 20 Newsgroups data set is a collection of approximately 20,000 newsgroup documents, partitioned (nearly) evenly across 20 different newsgroups. It is speculated that it was originally collected by Ken Lang, probably for his Newsweeder: Learning to filter netnews paper, though he does not explicitly mention this collection. The 20 Newsgroups collection has become a ...

• Westbury Lab Usenet Corpus: 28M postings from 47000+ newsgroups 2005-2009

  Offsite — A USENET corpus (2005-2009) This corpus is a collection of public USENET postings. This corpus was collected between Oct 2005 and Jan 2010, and covers 47860 English language, non-binary-file news groups. Despite our best effots, this corpus includes a very small number of non-English words, non-words, and spelling errors. The corpus is untagged, raw text. It may be ...