I have a customer who doesn't want to create storage locations and was used to loading CSV using STDIN. They want to load Parquet files and tried piping to STDIN and COPY LOCAL but both of these fail. Is there a supported way to read Parquet files from local in a manner similar to CSV? E.g. examples from 9.0.1-7:
[mapr@SE-POC-MapR-1 tpcds-hdinsight]$ cat /mapr/SE-POC-MapR-cluster.vertica.com/user/hive/warehouse/tpcds_parquet.db/inventory/inv_date_sk\=2451984/000008_0 | vsql -w changeme -c "COPY mapr_inventory FROM STDIN PARQUET;"
ERROR 6764: Error opening file [] for read: No such file or directory
[mapr@SE-POC-MapR-1 tpcds-hdinsight]$ vsql -w changeme -c "COPY mapr_inventory FROM LOCAL '/mapr/SE-POC-MapR-cluster.vertica.com/user/hive/warehouse/tpcds_parquet.db/inventory/inv_date_sk\=2451984/000008_0' PARQUET;"
ERROR 8060: Cannot COPY "parquet" from the client using the keyword LOCAL
ERROR 8060: Cannot COPY "parquet" from the client using the keyword LOCAL
+2
+2Hi,
According to the docs:
COPY LOCAL does not support reading ORC or Parquet files; use ON NODE instead.
Also, I do not think you can cat a Parquet file. They are not ASCII.
[dbadmin@s18384357 ~]$ file 20180213151559309-dm51_product.parquet 20180213151559309-dm51_product.parquet: Par archive data [dbadmin@s18384357 ~]$ file ascii_test.csv ascii_test.csv: data
+2OK, I understand now: Parquet reader is implemented on server, not on client. I will pass that on to the customer.
Sign up
Already have an account? Login
Welcome to the Rocket Forum!
Please log in or register:
Employee Login | Registration Member Login | RegistrationEnter your E-mail address. We'll send you an e-mail with instructions to reset your password.
77 4th Avenue
Waltham, MA 02451 USA
