• Home
• com.spotify.data.spydra
• spydra
• 0.3.25
• source code

×

Project download

Many resources are needed to download a project. Please understand that we have to compensate our server costs. Thank you in advance.
Project price only 1 $

You can buy this project and download/modify it how often you want.

ata.spydra.spydra.0.3.25.source-code.dataproc_defaults.json Maven / Gradle / Ivy

{
  "cluster_type": "dataproc",
  "region": "global",
  "history_timeout": 60,
  "cluster": {
    "options": {
      "scopes": "cloud-platform",
      "max-idle": "30m",
      "initialization-actions": "${versioned-init-action-uri}/autoscaler.sh",
      "properties": "mapred:mapreduce.jobhistory.done-dir=gs://${LOG_BUCKET}/history/${CLIENT_ID}/done,mapred:mapreduce.jobhistory.intermediate-done-dir=gs://${LOG_BUCKET}/history/${CLIENT_ID}/${UUID}/done_intermediate,mapred:mapreduce.jobhistory.move.interval-ms=1000,mapred:mapreduce.output.fileoutputformat.compress=true,mapred:mapreduce.map.output.compress=true,mapred:mapreduce.output.fileoutputformat.compress.type=BLOCK,core:fs.gs.parent.timestamp.update.substrings.includes=gs://${LOG_BUCKET}/history,yarn:yarn.log-aggregation-enable=true,yarn:yarn.nodemanager.remote-app-log-dir=gs://${LOG_BUCKET}/logs/${CLIENT_ID},yarn:yarn.log-aggregation.retain-seconds=-1,core:fs.gs.implicit.dir.repair.enable=false"
    }
  },
  "submit": {
    "options": {
    }
  }
}