SQOOP
IMPORT:
sqoop import --connect jdbc:netezza://host/dbname --username yourusername --password=yourpassword --query "SELECT * FROM tableA where \$CONDITIONS and columnA >= '2012-08-01'" --direct --fields-terminated-by '\t' --split-by columnB--num-mappers 1 --target-dir /user/tsusanto/input_data/20120803 --compression-codec org.apache.hadoop.io.compress.GzipCodec
DELETE. You can also delete records using sqoop:
sqoop eval --connect jdbc:netezza://host/dbname --username yourusername --password=yourpassword# -e "delete from yourtable where columnA= 926"
Hadoop FS SHELL
write a value to a file in HDFS:
echo 'test123' | hadoop fs -put - yourfilepath
display a few rows of your data file stored in hadoop file system
hadoop fs -text /user/tsusanto/yourdatafolder/part* | less
to search a text string
hadoop fs -text /user/tsusanto/yourdatafolder/part* | grep -P '\byoursearchstring\b'
move a file from hadoop file system to your local current folder
hadoop fs -get /user/tsusanto/jobs/yourfolder/workflow.xml .
delete a file from hadoop file system. You must delete the file before you can push a new file to the same location, file must not exists
hadoop fs -rm -r /user/tsusanto/jobs/yourfolder/workflow.xml
move a file to the hadoop file system from your current folder
hadoop fs -put workflow.xml /user/tsusanto/jobs/yourfolder/
Gentle tutorials on hadoop. I got therefore province necessary information and marvelous writing skills therefore I bookmarked your fabulous science system to travel finding out nice article writing skills.
ReplyDeleteHadoop Training in hyderabad
Uniqe informative article and of course True words, thanks for sharing. Today I see myself proud to be a hadoop professional with strong dedication and will power by blasting the obstacles. Thanks to hadoop training institute in adyar
ReplyDeletevery nice !!! i have to learning a lot of information for this sites.Thanks for sharing this valuable information to our vision.
ReplyDeleteAWS Training in chennai | AWS Training chennai | AWS course in chennai
Using big data analytics may give the companies many fruitful results, the findings can be implemented in their business decisions so as to minimize their risk and to cut the costs.
ReplyDeletehadoop training in chennai|big data training|big data training in chennai