Skip to main content

External table data access to ORC/Parquet data in MapR.

  • February 26, 2018
  • 2 replies
  • 13 views

Kaito
Forum|alt.badge.img+2
  • Participating Frequently

Can Vertica access data in ORC/Parquet format at MapR using our External table function?

2 replies

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • February 26, 2018

Sure.

See:
https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/IntegratingHPVerticaWithMapR.html

Specifically:

You can read data from MapR through an NFS mount point. After you mount the MapR file system as an NFS mount point, you can use CREATE EXTERNAL TABLE AS COPY or COPY to access the data as if it were on the local file system. For ORC or Parquet data, see also Reading Hadoop Columnar File Formats. This option provides the best performance for reading data.


Kaito
Forum|alt.badge.img+2
  • Author
  • Participating Frequently
  • March 28, 2018

Hi Jim,

Thank you for following this up. Really appreciated.
Should we use MapR POSIX Clients for parallel access to speed up data loading from MapR to Vertica?

https://maprdocs.mapr.com/home/AdvancedInstallation/SettingUptheClient-POSIX-Clients.html

Thanks,