com.amazonaws.services.elasticmapreduce.AmazonElasticMapReduceAsync Maven / Gradle / Ivy
Show all versions of aws-java-sdk-emr Show documentation
/*
* Copyright 2011-2016 Amazon.com, Inc. or its affiliates. All Rights Reserved.
*
* Licensed under the Apache License, Version 2.0 (the "License"). You may not
* use this file except in compliance with the License. A copy of the License is
* located at
*
* http://aws.amazon.com/apache2.0
*
* or in the "license" file accompanying this file. This file is distributed on
* an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
* express or implied. See the License for the specific language governing
* permissions and limitations under the License.
*/
package com.amazonaws.services.elasticmapreduce;
import com.amazonaws.services.elasticmapreduce.model.*;
/**
* Interface for accessing Amazon EMR asynchronously. Each asynchronous method
* will return a Java Future object representing the asynchronous operation;
* overloads which accept an {@code AsyncHandler} can be used to receive
* notification when an asynchronous operation completes.
*
*
* Amazon Elastic MapReduce (Amazon EMR) is a web service that makes it easy to
* process large amounts of data efficiently. Amazon EMR uses Hadoop processing
* combined with several AWS products to do tasks such as web indexing, data
* mining, log file analysis, machine learning, scientific simulation, and data
* warehousing.
*
*/
public interface AmazonElasticMapReduceAsync extends AmazonElasticMapReduce {
/**
*
* AddInstanceGroups adds an instance group to a running cluster.
*
*
* @param addInstanceGroupsRequest
* Input to an AddInstanceGroups call.
* @return A Java Future containing the result of the AddInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.AddInstanceGroups
*/
java.util.concurrent.Future addInstanceGroupsAsync(
AddInstanceGroupsRequest addInstanceGroupsRequest);
/**
*
* AddInstanceGroups adds an instance group to a running cluster.
*
*
* @param addInstanceGroupsRequest
* Input to an AddInstanceGroups call.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the AddInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.AddInstanceGroups
*/
java.util.concurrent.Future addInstanceGroupsAsync(
AddInstanceGroupsRequest addInstanceGroupsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* AddJobFlowSteps adds new steps to a running job flow. A maximum of 256
* steps are allowed in each job flow.
*
*
* If your job flow is long-running (such as a Hive data warehouse) or
* complex, you may require more than 256 steps to process your data. You
* can bypass the 256-step limitation in various ways, including using the
* SSH shell to connect to the master node and submitting queries directly
* to the software running on the master node, such as Hive and Hadoop. For
* more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* A step specifies the location of a JAR file stored either on the master
* node of the job flow or in Amazon S3. Each step is performed by the main
* function of the main class of the JAR file. The main class can be
* specified either in the manifest of the JAR or by using the MainFunction
* parameter of the step.
*
*
* Elastic MapReduce executes each step in the order listed. For a step to
* be considered complete, the main function must exit with a zero exit code
* and all Hadoop jobs started while the step was running must have
* completed and run successfully.
*
*
* You can only add steps to a job flow that is in one of the following
* states: STARTING, BOOTSTRAPPING, RUNNING, or WAITING.
*
*
* @param addJobFlowStepsRequest
* The input argument to the AddJobFlowSteps operation.
* @return A Java Future containing the result of the AddJobFlowSteps
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.AddJobFlowSteps
*/
java.util.concurrent.Future addJobFlowStepsAsync(
AddJobFlowStepsRequest addJobFlowStepsRequest);
/**
*
* AddJobFlowSteps adds new steps to a running job flow. A maximum of 256
* steps are allowed in each job flow.
*
*
* If your job flow is long-running (such as a Hive data warehouse) or
* complex, you may require more than 256 steps to process your data. You
* can bypass the 256-step limitation in various ways, including using the
* SSH shell to connect to the master node and submitting queries directly
* to the software running on the master node, such as Hive and Hadoop. For
* more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* A step specifies the location of a JAR file stored either on the master
* node of the job flow or in Amazon S3. Each step is performed by the main
* function of the main class of the JAR file. The main class can be
* specified either in the manifest of the JAR or by using the MainFunction
* parameter of the step.
*
*
* Elastic MapReduce executes each step in the order listed. For a step to
* be considered complete, the main function must exit with a zero exit code
* and all Hadoop jobs started while the step was running must have
* completed and run successfully.
*
*
* You can only add steps to a job flow that is in one of the following
* states: STARTING, BOOTSTRAPPING, RUNNING, or WAITING.
*
*
* @param addJobFlowStepsRequest
* The input argument to the AddJobFlowSteps operation.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the AddJobFlowSteps
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.AddJobFlowSteps
*/
java.util.concurrent.Future addJobFlowStepsAsync(
AddJobFlowStepsRequest addJobFlowStepsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Adds tags to an Amazon EMR resource. Tags make it easier to associate
* clusters in various ways, such as grouping clusters to track your Amazon
* EMR resource allocation costs. For more information, see Tagging Amazon EMR Resources.
*
*
* @param addTagsRequest
* This input identifies a cluster and a list of tags to attach.
* @return A Java Future containing the result of the AddTags operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.AddTags
*/
java.util.concurrent.Future addTagsAsync(
AddTagsRequest addTagsRequest);
/**
*
* Adds tags to an Amazon EMR resource. Tags make it easier to associate
* clusters in various ways, such as grouping clusters to track your Amazon
* EMR resource allocation costs. For more information, see Tagging Amazon EMR Resources.
*
*
* @param addTagsRequest
* This input identifies a cluster and a list of tags to attach.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the AddTags operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.AddTags
*/
java.util.concurrent.Future addTagsAsync(
AddTagsRequest addTagsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides cluster-level details including status, hardware and software
* configuration, VPC settings, and so on. For information about the cluster
* steps, see ListSteps.
*
*
* @param describeClusterRequest
* This input determines which cluster to describe.
* @return A Java Future containing the result of the DescribeCluster
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.DescribeCluster
*/
java.util.concurrent.Future describeClusterAsync(
DescribeClusterRequest describeClusterRequest);
/**
*
* Provides cluster-level details including status, hardware and software
* configuration, VPC settings, and so on. For information about the cluster
* steps, see ListSteps.
*
*
* @param describeClusterRequest
* This input determines which cluster to describe.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the DescribeCluster
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.DescribeCluster
*/
java.util.concurrent.Future describeClusterAsync(
DescribeClusterRequest describeClusterRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* This API is deprecated and will eventually be removed. We recommend you
* use ListClusters, DescribeCluster, ListSteps,
* ListInstanceGroups and ListBootstrapActions instead.
*
*
* DescribeJobFlows returns a list of job flows that match all of the
* supplied parameters. The parameters can include a list of job flow IDs,
* job flow states, and restrictions on job flow creation date and time.
*
*
* Regardless of supplied parameters, only job flows created within the last
* two months are returned.
*
*
* If no parameters are supplied, then job flows matching either of the
* following criteria are returned:
*
*
* -
*
* Job flows created and completed in the last two weeks
*
*
* -
*
* Job flows created within the last two months that are in one of the
* following states: RUNNING, WAITING,
* SHUTTING_DOWN, STARTING
*
*
*
*
* Amazon Elastic MapReduce can return a maximum of 512 job flow
* descriptions.
*
*
* @param describeJobFlowsRequest
* The input for the DescribeJobFlows operation.
* @return A Java Future containing the result of the DescribeJobFlows
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.DescribeJobFlows
*/
@Deprecated
java.util.concurrent.Future describeJobFlowsAsync(
DescribeJobFlowsRequest describeJobFlowsRequest);
/**
*
* This API is deprecated and will eventually be removed. We recommend you
* use ListClusters, DescribeCluster, ListSteps,
* ListInstanceGroups and ListBootstrapActions instead.
*
*
* DescribeJobFlows returns a list of job flows that match all of the
* supplied parameters. The parameters can include a list of job flow IDs,
* job flow states, and restrictions on job flow creation date and time.
*
*
* Regardless of supplied parameters, only job flows created within the last
* two months are returned.
*
*
* If no parameters are supplied, then job flows matching either of the
* following criteria are returned:
*
*
* -
*
* Job flows created and completed in the last two weeks
*
*
* -
*
* Job flows created within the last two months that are in one of the
* following states: RUNNING, WAITING,
* SHUTTING_DOWN, STARTING
*
*
*
*
* Amazon Elastic MapReduce can return a maximum of 512 job flow
* descriptions.
*
*
* @param describeJobFlowsRequest
* The input for the DescribeJobFlows operation.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the DescribeJobFlows
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.DescribeJobFlows
*/
@Deprecated
java.util.concurrent.Future describeJobFlowsAsync(
DescribeJobFlowsRequest describeJobFlowsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
* Simplified method form for invoking the DescribeJobFlows operation.
*
* @see #describeJobFlowsAsync(DescribeJobFlowsRequest)
*/
@Deprecated
java.util.concurrent.Future describeJobFlowsAsync();
/**
* Simplified method form for invoking the DescribeJobFlows operation with
* an AsyncHandler.
*
* @see #describeJobFlowsAsync(DescribeJobFlowsRequest,
* com.amazonaws.handlers.AsyncHandler)
*/
java.util.concurrent.Future describeJobFlowsAsync(
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides more detail about the cluster step.
*
*
* @param describeStepRequest
* This input determines which step to describe.
* @return A Java Future containing the result of the DescribeStep operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.DescribeStep
*/
java.util.concurrent.Future describeStepAsync(
DescribeStepRequest describeStepRequest);
/**
*
* Provides more detail about the cluster step.
*
*
* @param describeStepRequest
* This input determines which step to describe.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the DescribeStep operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.DescribeStep
*/
java.util.concurrent.Future describeStepAsync(
DescribeStepRequest describeStepRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides information about the bootstrap actions associated with a
* cluster.
*
*
* @param listBootstrapActionsRequest
* This input determines which bootstrap actions to retrieve.
* @return A Java Future containing the result of the ListBootstrapActions
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.ListBootstrapActions
*/
java.util.concurrent.Future listBootstrapActionsAsync(
ListBootstrapActionsRequest listBootstrapActionsRequest);
/**
*
* Provides information about the bootstrap actions associated with a
* cluster.
*
*
* @param listBootstrapActionsRequest
* This input determines which bootstrap actions to retrieve.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ListBootstrapActions
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ListBootstrapActions
*/
java.util.concurrent.Future listBootstrapActionsAsync(
ListBootstrapActionsRequest listBootstrapActionsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides the status of all clusters visible to this AWS account. Allows
* you to filter the list of clusters based on certain criteria; for
* example, filtering by cluster creation date and time or by status. This
* call returns a maximum of 50 clusters per call, but returns a marker to
* track the paging of the cluster list across multiple ListClusters calls.
*
*
* @param listClustersRequest
* This input determines how the ListClusters action filters the list
* of clusters that it returns.
* @return A Java Future containing the result of the ListClusters operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.ListClusters
*/
java.util.concurrent.Future listClustersAsync(
ListClustersRequest listClustersRequest);
/**
*
* Provides the status of all clusters visible to this AWS account. Allows
* you to filter the list of clusters based on certain criteria; for
* example, filtering by cluster creation date and time or by status. This
* call returns a maximum of 50 clusters per call, but returns a marker to
* track the paging of the cluster list across multiple ListClusters calls.
*
*
* @param listClustersRequest
* This input determines how the ListClusters action filters the list
* of clusters that it returns.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ListClusters operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ListClusters
*/
java.util.concurrent.Future listClustersAsync(
ListClustersRequest listClustersRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
* Simplified method form for invoking the ListClusters operation.
*
* @see #listClustersAsync(ListClustersRequest)
*/
java.util.concurrent.Future listClustersAsync();
/**
* Simplified method form for invoking the ListClusters operation with an
* AsyncHandler.
*
* @see #listClustersAsync(ListClustersRequest,
* com.amazonaws.handlers.AsyncHandler)
*/
java.util.concurrent.Future listClustersAsync(
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides all available details about the instance groups in a cluster.
*
*
* @param listInstanceGroupsRequest
* This input determines which instance groups to retrieve.
* @return A Java Future containing the result of the ListInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.ListInstanceGroups
*/
java.util.concurrent.Future listInstanceGroupsAsync(
ListInstanceGroupsRequest listInstanceGroupsRequest);
/**
*
* Provides all available details about the instance groups in a cluster.
*
*
* @param listInstanceGroupsRequest
* This input determines which instance groups to retrieve.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ListInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ListInstanceGroups
*/
java.util.concurrent.Future listInstanceGroupsAsync(
ListInstanceGroupsRequest listInstanceGroupsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides information about the cluster instances that Amazon EMR
* provisions on behalf of a user when it creates the cluster. For example,
* this operation indicates when the EC2 instances reach the Ready state,
* when instances become available to Amazon EMR to use for jobs, and the IP
* addresses for cluster instances, etc.
*
*
* @param listInstancesRequest
* This input determines which instances to list.
* @return A Java Future containing the result of the ListInstances
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.ListInstances
*/
java.util.concurrent.Future listInstancesAsync(
ListInstancesRequest listInstancesRequest);
/**
*
* Provides information about the cluster instances that Amazon EMR
* provisions on behalf of a user when it creates the cluster. For example,
* this operation indicates when the EC2 instances reach the Ready state,
* when instances become available to Amazon EMR to use for jobs, and the IP
* addresses for cluster instances, etc.
*
*
* @param listInstancesRequest
* This input determines which instances to list.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ListInstances
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ListInstances
*/
java.util.concurrent.Future listInstancesAsync(
ListInstancesRequest listInstancesRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Provides a list of steps for the cluster.
*
*
* @param listStepsRequest
* This input determines which steps to list.
* @return A Java Future containing the result of the ListSteps operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.ListSteps
*/
java.util.concurrent.Future listStepsAsync(
ListStepsRequest listStepsRequest);
/**
*
* Provides a list of steps for the cluster.
*
*
* @param listStepsRequest
* This input determines which steps to list.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ListSteps operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ListSteps
*/
java.util.concurrent.Future listStepsAsync(
ListStepsRequest listStepsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* ModifyInstanceGroups modifies the number of nodes and configuration
* settings of an instance group. The input parameters include the new
* target instance count for the group and the instance group ID. The call
* will either succeed or fail atomically.
*
*
* @param modifyInstanceGroupsRequest
* Change the size of some instance groups.
* @return A Java Future containing the result of the ModifyInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.ModifyInstanceGroups
*/
java.util.concurrent.Future modifyInstanceGroupsAsync(
ModifyInstanceGroupsRequest modifyInstanceGroupsRequest);
/**
*
* ModifyInstanceGroups modifies the number of nodes and configuration
* settings of an instance group. The input parameters include the new
* target instance count for the group and the instance group ID. The call
* will either succeed or fail atomically.
*
*
* @param modifyInstanceGroupsRequest
* Change the size of some instance groups.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the ModifyInstanceGroups
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.ModifyInstanceGroups
*/
java.util.concurrent.Future modifyInstanceGroupsAsync(
ModifyInstanceGroupsRequest modifyInstanceGroupsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
* Simplified method form for invoking the ModifyInstanceGroups operation.
*
* @see #modifyInstanceGroupsAsync(ModifyInstanceGroupsRequest)
*/
java.util.concurrent.Future modifyInstanceGroupsAsync();
/**
* Simplified method form for invoking the ModifyInstanceGroups operation
* with an AsyncHandler.
*
* @see #modifyInstanceGroupsAsync(ModifyInstanceGroupsRequest,
* com.amazonaws.handlers.AsyncHandler)
*/
java.util.concurrent.Future modifyInstanceGroupsAsync(
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Removes tags from an Amazon EMR resource. Tags make it easier to
* associate clusters in various ways, such as grouping clusters to track
* your Amazon EMR resource allocation costs. For more information, see Tagging Amazon EMR Resources.
*
*
* The following example removes the stack tag with value Prod from a
* cluster:
*
*
* @param removeTagsRequest
* This input identifies a cluster and a list of tags to remove.
* @return A Java Future containing the result of the RemoveTags operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.RemoveTags
*/
java.util.concurrent.Future removeTagsAsync(
RemoveTagsRequest removeTagsRequest);
/**
*
* Removes tags from an Amazon EMR resource. Tags make it easier to
* associate clusters in various ways, such as grouping clusters to track
* your Amazon EMR resource allocation costs. For more information, see Tagging Amazon EMR Resources.
*
*
* The following example removes the stack tag with value Prod from a
* cluster:
*
*
* @param removeTagsRequest
* This input identifies a cluster and a list of tags to remove.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the RemoveTags operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.RemoveTags
*/
java.util.concurrent.Future removeTagsAsync(
RemoveTagsRequest removeTagsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* RunJobFlow creates and starts running a new job flow. The job flow will
* run the steps specified. Once the job flow completes, the cluster is
* stopped and the HDFS partition is lost. To prevent loss of data,
* configure the last step of the job flow to store results in Amazon S3. If
* the JobFlowInstancesConfig
* KeepJobFlowAliveWhenNoSteps parameter is set to
* TRUE, the job flow will transition to the WAITING state
* rather than shutting down once the steps have completed.
*
*
* For additional protection, you can set the JobFlowInstancesConfig
* TerminationProtected parameter to TRUE to lock
* the job flow and prevent it from being terminated by API call, user
* intervention, or in the event of a job flow error.
*
*
* A maximum of 256 steps are allowed in each job flow.
*
*
* If your job flow is long-running (such as a Hive data warehouse) or
* complex, you may require more than 256 steps to process your data. You
* can bypass the 256-step limitation in various ways, including using the
* SSH shell to connect to the master node and submitting queries directly
* to the software running on the master node, such as Hive and Hadoop. For
* more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* For long running job flows, we recommend that you periodically store your
* results.
*
*
* @param runJobFlowRequest
* Input to the RunJobFlow operation.
* @return A Java Future containing the result of the RunJobFlow operation
* returned by the service.
* @sample AmazonElasticMapReduceAsync.RunJobFlow
*/
java.util.concurrent.Future runJobFlowAsync(
RunJobFlowRequest runJobFlowRequest);
/**
*
* RunJobFlow creates and starts running a new job flow. The job flow will
* run the steps specified. Once the job flow completes, the cluster is
* stopped and the HDFS partition is lost. To prevent loss of data,
* configure the last step of the job flow to store results in Amazon S3. If
* the JobFlowInstancesConfig
* KeepJobFlowAliveWhenNoSteps parameter is set to
* TRUE, the job flow will transition to the WAITING state
* rather than shutting down once the steps have completed.
*
*
* For additional protection, you can set the JobFlowInstancesConfig
* TerminationProtected parameter to TRUE to lock
* the job flow and prevent it from being terminated by API call, user
* intervention, or in the event of a job flow error.
*
*
* A maximum of 256 steps are allowed in each job flow.
*
*
* If your job flow is long-running (such as a Hive data warehouse) or
* complex, you may require more than 256 steps to process your data. You
* can bypass the 256-step limitation in various ways, including using the
* SSH shell to connect to the master node and submitting queries directly
* to the software running on the master node, such as Hive and Hadoop. For
* more information on how to do this, go to Add More than 256 Steps to a Job Flow in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* For long running job flows, we recommend that you periodically store your
* results.
*
*
* @param runJobFlowRequest
* Input to the RunJobFlow operation.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the RunJobFlow operation
* returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.RunJobFlow
*/
java.util.concurrent.Future runJobFlowAsync(
RunJobFlowRequest runJobFlowRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* SetTerminationProtection locks a job flow so the Amazon EC2 instances in
* the cluster cannot be terminated by user intervention, an API call, or in
* the event of a job-flow error. The cluster still terminates upon
* successful completion of the job flow. Calling SetTerminationProtection
* on a job flow is analogous to calling the Amazon EC2
* DisableAPITermination API on all of the EC2 instances in a cluster.
*
*
* SetTerminationProtection is used to prevent accidental termination of a
* job flow and to ensure that in the event of an error, the instances will
* persist so you can recover any data stored in their ephemeral instance
* storage.
*
*
* To terminate a job flow that has been locked by setting
* SetTerminationProtection to true, you must first unlock the
* job flow by a subsequent call to SetTerminationProtection in which you
* set the value to false.
*
*
* For more information, go to Protecting a Job Flow from Termination in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* @param setTerminationProtectionRequest
* The input argument to the TerminationProtection operation.
* @return A Java Future containing the result of the
* SetTerminationProtection operation returned by the service.
* @sample AmazonElasticMapReduceAsync.SetTerminationProtection
*/
java.util.concurrent.Future setTerminationProtectionAsync(
SetTerminationProtectionRequest setTerminationProtectionRequest);
/**
*
* SetTerminationProtection locks a job flow so the Amazon EC2 instances in
* the cluster cannot be terminated by user intervention, an API call, or in
* the event of a job-flow error. The cluster still terminates upon
* successful completion of the job flow. Calling SetTerminationProtection
* on a job flow is analogous to calling the Amazon EC2
* DisableAPITermination API on all of the EC2 instances in a cluster.
*
*
* SetTerminationProtection is used to prevent accidental termination of a
* job flow and to ensure that in the event of an error, the instances will
* persist so you can recover any data stored in their ephemeral instance
* storage.
*
*
* To terminate a job flow that has been locked by setting
* SetTerminationProtection to true, you must first unlock the
* job flow by a subsequent call to SetTerminationProtection in which you
* set the value to false.
*
*
* For more information, go to Protecting a Job Flow from Termination in the Amazon Elastic
* MapReduce Developer's Guide.
*
*
* @param setTerminationProtectionRequest
* The input argument to the TerminationProtection operation.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the
* SetTerminationProtection operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.SetTerminationProtection
*/
java.util.concurrent.Future setTerminationProtectionAsync(
SetTerminationProtectionRequest setTerminationProtectionRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* Sets whether all AWS Identity and Access Management (IAM) users under
* your account can access the specified job flows. This action works on
* running job flows. You can also set the visibility of a job flow when you
* launch it using the VisibleToAllUsers parameter of
* RunJobFlow. The SetVisibleToAllUsers action can be called only by
* an IAM user who created the job flow or the AWS account that owns the job
* flow.
*
*
* @param setVisibleToAllUsersRequest
* The input to the SetVisibleToAllUsers action.
* @return A Java Future containing the result of the SetVisibleToAllUsers
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.SetVisibleToAllUsers
*/
java.util.concurrent.Future setVisibleToAllUsersAsync(
SetVisibleToAllUsersRequest setVisibleToAllUsersRequest);
/**
*
* Sets whether all AWS Identity and Access Management (IAM) users under
* your account can access the specified job flows. This action works on
* running job flows. You can also set the visibility of a job flow when you
* launch it using the VisibleToAllUsers parameter of
* RunJobFlow. The SetVisibleToAllUsers action can be called only by
* an IAM user who created the job flow or the AWS account that owns the job
* flow.
*
*
* @param setVisibleToAllUsersRequest
* The input to the SetVisibleToAllUsers action.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the SetVisibleToAllUsers
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.SetVisibleToAllUsers
*/
java.util.concurrent.Future setVisibleToAllUsersAsync(
SetVisibleToAllUsersRequest setVisibleToAllUsersRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
/**
*
* TerminateJobFlows shuts a list of job flows down. When a job flow is shut
* down, any step not yet completed is canceled and the EC2 instances on
* which the job flow is running are stopped. Any log files not already
* saved are uploaded to Amazon S3 if a LogUri was specified when the job
* flow was created.
*
*
* The maximum number of JobFlows allowed is 10. The call to
* TerminateJobFlows is asynchronous. Depending on the configuration of the
* job flow, it may take up to 5-20 minutes for the job flow to completely
* terminate and release allocated resources, such as Amazon EC2 instances.
*
*
* @param terminateJobFlowsRequest
* Input to the TerminateJobFlows operation.
* @return A Java Future containing the result of the TerminateJobFlows
* operation returned by the service.
* @sample AmazonElasticMapReduceAsync.TerminateJobFlows
*/
java.util.concurrent.Future terminateJobFlowsAsync(
TerminateJobFlowsRequest terminateJobFlowsRequest);
/**
*
* TerminateJobFlows shuts a list of job flows down. When a job flow is shut
* down, any step not yet completed is canceled and the EC2 instances on
* which the job flow is running are stopped. Any log files not already
* saved are uploaded to Amazon S3 if a LogUri was specified when the job
* flow was created.
*
*
* The maximum number of JobFlows allowed is 10. The call to
* TerminateJobFlows is asynchronous. Depending on the configuration of the
* job flow, it may take up to 5-20 minutes for the job flow to completely
* terminate and release allocated resources, such as Amazon EC2 instances.
*
*
* @param terminateJobFlowsRequest
* Input to the TerminateJobFlows operation.
* @param asyncHandler
* Asynchronous callback handler for events in the lifecycle of the
* request. Users can provide an implementation of the callback
* methods in this interface to receive notification of successful or
* unsuccessful completion of the operation.
* @return A Java Future containing the result of the TerminateJobFlows
* operation returned by the service.
* @sample AmazonElasticMapReduceAsyncHandler.TerminateJobFlows
*/
java.util.concurrent.Future terminateJobFlowsAsync(
TerminateJobFlowsRequest terminateJobFlowsRequest,
com.amazonaws.handlers.AsyncHandler asyncHandler);
}