All command working with hadoop and hive on AWS?

Required :

  • Create new job on EMR ( return job id on command line ).

  • Add file jar to S3butket by command line.

  • Add job flow by job-id.

  • Run with debug and increase 4GB heap size of JVM.

  • Choose AMI version and config increase 2GB heap size of JVM.

  • Use bootstrap for running command before job run.

  • Create hive job on AWS.

  • Follow job with ssh.

  • Command line of hive with input and output script path.


Leave a Reply

Your email address will not be published. Required fields are marked *