Skip to main content

webhdfs copy rejected data as table getting error

  • December 20, 2014
  • 4 replies
  • 23 views

kannan_1
Forum|alt.badge.img+1
Hi ,

Could some one please provide the necessary steps to set up a rejected data table for a COPY using WEBHDFS, and the rejected table should recide in a non-default location.

Thanks,
Kannan

4 replies

id10t
Forum|alt.badge.img
  • Participating Frequently
  • December 21, 2014
Hi!

Kannan Kalimuthu:
  • HP Accredited Technical Professional
  • Cloudera certified Administrator/Developer for Apache Hadoop.
With these skills I was hoping that you will clarify it to us :(

kannan_1
Forum|alt.badge.img+1
  • Author
  • Participating Frequently
  • December 22, 2014
@ id10t ..... I guess you have a different kannan mentioned here .... :-) .. i am kannan nagaraj

Prasanta_Pal
Forum|alt.badge.img
  • Participating Frequently
  • December 23, 2014
What syntax you are using for COPY from HDFS and write the reject data to a table?

are you using
=> COPY <table_name> SOURCE-> Hdfs(url=....) rejected data as table <table_name>_rejects;
Did you check if the data is also written in the below folder?
<path>node000x_data/RejectionTableData
Are you able to see the rejected data in the files as per the below?

http://my.vertica.com/docs/7.1.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/HDFSConnector/Loadi...

Viewing Rejected Rows and Exceptions COPY statements that use the HP Vertica Connector for HDFS use the same method for recording rejections and exceptions as other COPY statements. Rejected rows and exceptions are saved to log files. These log files are stored by default in the CopyErrorLogs subdirectory in the database's catalog directory.









id10t
Forum|alt.badge.img
  • Participating Frequently
  • December 23, 2014
@kannan

Im apologize for mistake. What do you want? Im an idiot :)