• Home
• org.scalanlp
• epic_2.10
• 0.3.1
• source code
• RegexSentenceSegmenter.scala

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

epic.preprocess.RegexSentenceSegmenter.scala Maven / Gradle / Ivy

package epic.preprocess

import epic.slab._
import epic.trees.Span

/**
 * A simple regex sentence segmenter.
 */
object RegexSentenceSegmenter extends SentenceSegmenter {

  def apply[In](slab: StringSlab[In]) =
    // the [Sentence] is required because of https://issues.scala-lang.org/browse/SI-7647
    slab.++[Sentence]("[^\\s.!?]+([^.!?]+[.!?]|\\z)".r.findAllMatchIn(slab.content).map(m => Span(m.start, m.end) -> Sentence()))
}