• Home
• org.apache.lucene
• lucene-analyzers-common
• 4.9.0
• source code
• package.html

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

org.apache.lucene.analysis.cjk.package.html Maven / Gradle / Ivy

Analyzer for Chinese, Japanese, and Korean, which indexes bigrams. 
This analyzer generates bigram terms, which are overlapping groups of two adjacent Han, Hiragana, Katakana, or Hangul characters.

Three analyzers are provided for Chinese, each of which treats Chinese text in a different way.

	
ChineseAnalyzer (in the analyzers/cn package): Index unigrams (individual Chinese characters) as a token.
	
CJKAnalyzer (in this package): Index bigrams (overlapping groups of two adjacent Chinese characters) as tokens.
	
SmartChineseAnalyzer (in the analyzers/smartcn package): Index words (attempt to segment Chinese text into words) as tokens.


Example phrase： "我是中国人"

	
ChineseAnalyzer: 我－是－中－国－人
	
CJKAnalyzer: 我是－是中－中国－国人
	
SmartChineseAnalyzer: 我－是－中国－人