• Home
• com.johnsnowlabs.nlp
• spark-nlp-gpu_2.11
• 2.0.8
• source code
• TokenizedSentence.scala

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

com.johnsnowlabs.nlp.annotators.common.TokenizedSentence.scala Maven / Gradle / Ivy

package com.johnsnowlabs.nlp.annotators.common

/**
  * Created by Saif Addin on 6/18/2017.
  */

/** Internal structure for a sentence that is split into tokens */
case class TokenizedSentence(indexedTokens: Array[IndexedToken], sentenceIndex: Int) {
  lazy val tokens = indexedTokens.map(t => t.token)

  def condense = tokens.mkString(" ")
}