hadoop - Sqoop import as ORC ERROR java.io.IOException: HCat exited with status 1 -

-

i trying import table netezza db using sqoop hcatlog ( see below) in orc format suggested here

sqoop command:

sqoop import -m 1 --connect <jdbc_url> --driver <database_driver> --connection-manager org.apache.sqoop.manager.genericjdbcmanager --username <db_username> --password <db_password> --table <table_name> --hcatalog-home /usr/hdp/current/hive-webhcat --hcatalog-database <hcat_db> --hcatalog-table < table_name > --create-hcatalog-table --hcatalog-storage-stanza 'stored orc tblproperties ("orc.compress"="snappy")';

however , failed following exception. after spending few hours , have no clue why failing. / lead appreciated.

16/04/21 19:51:22 error tool.importtool: encountered ioexception running import job: java.io.ioexception: hcat exited status 1     @ org.apache.sqoop.mapreduce.hcat.sqoophcatutilities.executeexternalhcatprogram(sqoophcatutilities.java:1148)     @ org.apache.sqoop.mapreduce.hcat.sqoophcatutilities.launchhcatcli(sqoophcatutilities.java:1097)     @ org.apache.sqoop.mapreduce.hcat.sqoophcatutilities.createhcattable(sqoophcatutilities.java:644)     @ org.apache.sqoop.mapreduce.hcat.sqoophcatutilities.configurehcat(sqoophcatutilities.java:340)     @ org.apache.sqoop.mapreduce.hcat.sqoophcatutilities.configureimportoutputformat(sqoophcatutilities.java:802)     @ org.apache.sqoop.mapreduce.importjobbase.configureoutputformat(importjobbase.java:98)     @ org.apache.sqoop.mapreduce.importjobbase.runimport(importjobbase.java:259)     @ org.apache.sqoop.manager.sqlmanager.importtable(sqlmanager.java:673)     @ org.apache.sqoop.tool.importtool.importtable(importtool.java:497)     @ org.apache.sqoop.tool.importtool.run(importtool.java:605)     @ org.apache.sqoop.sqoop.run(sqoop.java:148)     @ org.apache.hadoop.util.toolrunner.run(toolrunner.java:76)     @ org.apache.sqoop.sqoop.runsqoop(sqoop.java:184)     @ org.apache.sqoop.sqoop.runtool(sqoop.java:226)     @ org.apache.sqoop.sqoop.runtool(sqoop.java:235)     @ org.apache.sqoop.sqoop.main(sqoop.java:244)

update: can see empty table created though source table has 200k records. suggestion fix issue ?


Comments

Post a Comment

Popular posts from this blog

html - Styling progress bar with inline style -

-
i trying set progress bar color red using inline style. need in way because have access <body> part of document. style need apply: progress { color: red } progress::-moz-progress-bar { background: red;} progress::-webkit-progress-value { background: red; } progress[aria-valuenow]:before { background: red; } i tried <progress style="background: red;"> incorrect effect, progress bar color turns blue red background. guide right direction desired style? thank in advance. here live example: https://jsfiddle.net/z36d3f6l/
Read more

java - Oracle Sql developer error: could not install some modules -

-
i have downloaded fresh copy of sqldeveloper ( sqldeveloper-4.1.3.20.78-no-jre ) oracle website. when unzip , lauch gui, keep getting following error message: warning - not install modules: dynamic module config - no module providing capability org.netbeans.netbinox found. my system: windows 7 32 bit hp probook. jdk 1.6 , 1.7, 1.8 available in java/jdk subdirectory. netbeans 8.0.2 installed finally got way out after dirty hours. extracted sqldeveloper zip in nested directory. i.e: e://a/b/c/sqldeveloper. starting sqldeveloper gui above directory threw erros. solution: go in c:\users**username**\appdata\roaming : delete sql developer , sqldeveloper folders extract sql developer zip in new non nested directory. i.e: e:// start , should work now reference: https://community.oracle.com/thread/3870680?start=0&tstart=0
Read more

How to use autoclose brackets in Jupyter notebook? -

-
this may sound silly question, how make use of autoclose brackets in jupyter notebook? example, when type print( jupyter notebook auto-closes brakets print() and places cursor inside. type argument, say print(1 + 1) now cursor between second 1 , right bracket ) . key navigate right of ) ? of course can press end or → or ) achieve this, not seem save time, purpose of brackets autoclose suppose? thanks in advance.
Read more