com.kotlinnlp.neuraltokenizer.utils.Abbreviations.kt Maven / Gradle / Ivy
Go to download
Show more of this group Show more artifacts with this name
Show all versions of neuraltokenizer Show documentation
Show all versions of neuraltokenizer Show documentation
NeuralTokenizer is a very simple to use text tokenizer which uses neural networks from the SimpleDNN library.
/* Copyright 2016-present The KotlinNLP Authors. All Rights Reserved.
*
* This Source Code Form is subject to the terms of the Mozilla Public
* License, v. 2.0. If a copy of the MPL was not distributed with this
* file, you can obtain one at http://mozilla.org/MPL/2.0/.
* ------------------------------------------------------------------*/
package com.kotlinnlp.neuraltokenizer.utils
import java.nio.file.Paths
/**
* A set of common abbreviations per language iso-code.
*/
internal val abbreviations = mapOf(
"it" to AbbreviationsContainer(Paths.get("/", "abbreviations", "it.txt").toString()),
"en" to AbbreviationsContainer(Paths.get("/", "abbreviations", "en.txt").toString())
)