gov.sandia.cognition.text.token.package-info Maven / Gradle / Ivy
/*
* File: package-info.java
* Authors: Justin Basilico
* Company: Sandia National Laboratories
* Project: Cognitive Foundry
*
* Copyright April 21, 2010, Sandia Corporation.
* Under the terms of Contract DE-AC04-94AL85000, there is a non-exclusive
* license for use of this work by or on behalf of the U.S. Government. Export
* of this program may require a license from the United States Government.
* See CopyrightHistory.txt for complete details.
*
*/
/**
* Provides text tokenization algorithms. Tokenization takes raw text and
* turns it into an initial set of terms.
*
* @author Justin Basilico
* @since 3.0
*/
@gov.sandia.cognition.annotation.Documentation
package gov.sandia.cognition.text.token;