• Home
• com.linkedin.gobblin
• gobblin-example
• 0.7.0
• source code

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

gobblin.gobblin-example.0.7.0.source-code.hive-avro-to-orc.pull Maven / Gradle / Ivy

# ====================================================================
# Job configurations (can be changed)
# ====================================================================

job.name=GobblinHiveAvroToOrcConversion
job.description=Test job to convert Avro Hive table to Orc

## Change this to the db you want to use
hive.dataset.database=default

## default is all tables. Change this to the table you want to use
hive.dataset.table.pattern=t3*_avro

hive.dataset.hive.metastore.uri=thrift://localhost:9083
hiveserver.connection.string=jdbc:hive2://localhost:10000

type=hadoopJava
job.class=gobblin.azkaban.AzkabanJobLauncher
job.lock.enabled=false

data.publisher.type=gobblin.data.management.convert.HiveConvertPublisher
source.class=gobblin.data.management.convert.HiveSource
writer.builder.class=gobblin.data.management.convert.HiveQueryWriterBuilder
converter.classes=gobblin.data.management.convert.HiveAvroToOrcConverter

task.maxretries=0
workunit.retry.enabled=false