Skip to main content

CREATE LOCATION 'hdfs: ' error, due to Vertica calling curl without the server name

  • March 30, 2018
  • 1 reply
  • 4 views

guy_einav

Hi,
Vertica 9.
Unable to create location on HDFS.

Leading hint : Vertica is calling "curl" without the server name
http: "http://50070/webhdfs/v1"

Any leads will be great.
thank you,
Guy.

  • my command and full error.
    dbaadmin=> CREATE LOCATION 'hdfs:///dbadmin' SHARED USAGE 'data' LABEL 'coldstorage';
    ERROR 5796: Could not create directory [hdfs:///dbadmin/v_vmart_node0001/]: [http://50070/webhdfs/v1/dbadmin/v_vmart_node0001/?user.name=dbaadmin&op=GETFILESTATUS]: Curl Error: Couldn't connect to server
    Error Details:
    HINT: Please make sure that the directories in the path have sufficient permissions for the vertica process and if the directory denoted by the path exists make sure it is an empty directory

1 reply

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • March 30, 2018

I think this may be a permission error:

ERROR 5796: Could not create directory

See "Requirements for HDFS Storage Locations" doc:
https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/StorageLocations/StorageLocationForHDFSRequirements.htm

In particular:

If your HDFS cluster is unsecured, you have a Hadoop user whose username matches the name of the Vertica database administrator (usually named dbadmin). This Hadoop user must have read and write access to the HDFS directory where you want Vertica to store its data.