All Downloads are FREE. Search and download functionalities are using the official Maven repository.
  • Log In
  • Register
    • Search JAR files by class name

    Download tokenizers JAR 0.22.1 with all dependencies


    Deep Java Library (DJL) NLP utilities for Huggingface tokenizers

    Files of the artifact tokenizers version 0.22.1 from the group ai.djl.huggingface.

    Test

    Download tokenizers (0.22.1)
    Artifact tokenizers
    Group ai.djl.huggingface
    Version 0.22.1
    Last update 17. April 2023
    Organization not specified
    URL http://www.djl.ai/extensions/tokenizers
    License The Apache License, Version 2.0
    Dependencies amount 1
    Dependencies api,
    There are maybe transitive dependencies!
    There is a newer version: 0.31.1
    Show newest version
    Show more of this group  Show more artifacts with this name
    Show all versions of tokenizers Show documentation

    Please rate this JAR file. Is it a good library?

    0 downloads

    Source code of tokenizers version 0.22.1

    META-INF
    META-INF.META-INF.MANIFEST.MF
    META-INF.services
    META-INF.services.META-INF.services.ai.djl.repository.zoo.ZooProvider
    ai.djl.huggingface.tokenizers
    ai.djl.huggingface.tokenizers.ai.djl.huggingface.tokenizers.Encoding
    ai.djl.huggingface.tokenizers.ai.djl.huggingface.tokenizers.HuggingFaceTokenizer
    ai.djl.huggingface.tokenizers.jni
    ai.djl.huggingface.tokenizers.jni.ai.djl.huggingface.tokenizers.jni.CharSpan
    ai.djl.huggingface.tokenizers.jni.ai.djl.huggingface.tokenizers.jni.LibUtils
    ai.djl.huggingface.tokenizers.jni.ai.djl.huggingface.tokenizers.jni.TokenizersLibrary
    ai.djl.huggingface.tokenizers.jni.ai.djl.huggingface.tokenizers.jni.package-info
    ai.djl.huggingface.tokenizers
    ai.djl.huggingface.tokenizers.ai.djl.huggingface.tokenizers.package-info
    ai.djl.huggingface.translator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.FillMaskBatchTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.FillMaskTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.FillMaskTranslatorFactory
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.PretrainedConfig
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.QuestionAnsweringBatchTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.QuestionAnsweringTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.QuestionAnsweringTranslatorFactory
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextClassificationBatchTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextClassificationTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextClassificationTranslatorFactory
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextEmbeddingBatchTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextEmbeddingTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TextEmbeddingTranslatorFactory
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TokenClassificationBatchTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TokenClassificationTranslator
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.TokenClassificationTranslatorFactory
    ai.djl.huggingface.translator.ai.djl.huggingface.translator.package-info
    ai.djl.huggingface.zoo
    ai.djl.huggingface.zoo.ai.djl.huggingface.zoo.HfModelZoo
    ai.djl.huggingface.zoo.ai.djl.huggingface.zoo.HfZooProvider
    ai.djl.huggingface.zoo.ai.djl.huggingface.zoo.package-info




    © 2015 - 2025 Weber Informatics LLC | Privacy Policy