• Home
• org.apache.nifi
• nifi-snowflake-processors
• 2.1.0
• source code
• additionalDetails.md

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

docs.org.apache.nifi.processors.snowflake.StartSnowflakeIngest.additionalDetails.md Maven / Gradle / Ivy

# StartSnowflakeIngest

### Description

The StartSnowflakeIngest processor triggers a Snowflake pipe ingestion for a staged file. Please note, that the pipe has
to be created in your Snowflake account manually. The processor requires an upstream connection that provides the path
of the file to be ingested in the stage through the "snowflake.staged.file.path" attribute. This attribute is
automatically filled in by the PutSnowflakeInternalStage processor when using an internal stage. In case a pipe copies
data from an external stage, the attribute shall be manually provided (e.g. with an UpdateAttribute processor). **NOTE:
Since Snowflake pipes ingest files asynchronously, this processor transfers FlowFiles to the "success" relationship when
they're marked for ingestion. In order to wait for the actual result of the ingestion, the processor may be connected to
a downstream GetSnowflakeIngestStatus processor.**

#### Example flow for internal stage

GetFile -> PutSnowflakeInternalStage -> StartSnowflakeIngest -> GetSnowflakeIngestStatus

#### Example flow for external stage

ListS3 -> UpdateAttribute (add the "snowflake.staged.file.path" attribute) -> StartSnowflakeIngest ->
GetSnowflakeIngestStatus