• Home
• com.johnsnowlabs.nlp
• spark-nlp_2.11
• 1.5.1
• source code
• SimpleTokenizer.scala

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

com.johnsnowlabs.nlp.annotators.assertion.logreg.SimpleTokenizer.scala Maven / Gradle / Ivy

package com.johnsnowlabs.nlp.annotators.assertion.logreg

/**
  * Created by jose on 18/12/17.
  */
class SimpleTokenizer extends Tokenizer {
  /* Tokenize a sentence splitting on spaces */
  def tokenize(sent: String) : Array[String] = sent.split(" ").map(_.trim).filter(_ != "")
}