ssh - How to check hive query running on amazon EMR or EC2 after getting disconnected from client -
i have been facing problem several times. ssh amazon ec2
or emr
machine using command line , run hive
query in interactive mode. shows gradual progress of mapper , reducer phase. but, let's network problem disconnected ec2
or emr
machine. now, hive
query still running? if, yes can check progress report see on hive console again?
so, 3 things can do:
use web interface. amazon gives access detailed here
run query in screen , if disconnected, reconnect , reattach previous session. can point logging happen file instead of stdout can reopen when log on machine
run query using nohup it's not attached session , keep running on own after kicked off. again, pipe logging file rather stdout , check file or tail once log on.
Comments
Post a Comment