org.apache.lucene.analysis.cn.smart.hhmm
public class SegTokenFilter extends java.lang.Object
Filters a SegToken
by converting full-width latin to half-width, then lowercasing latin.
Additionally, all punctuation is converted into Utility.COMMON_DELIMITER
WARNING: The status of the analyzers/smartcn analysis.cn.smart package is experimental. The APIs and file formats introduced here might change in the future and will not be supported anymore in such a case.
Constructor and Description |
---|
SegTokenFilter() |
Copyright © 2000-2014 Apache Software Foundation. All Rights Reserved.