Skip to main content

External table data access to ORC/Parquet data in MapR.

  • Feb 26, 2018 1:44 AM UTC
  • 2 replies
  • 23 views

Kaito
Forum|alt.badge.img+2
  • Participating Frequently

Can Vertica access data in ORC/Parquet format at MapR using our External table function?

2 replies

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • Feb 26, 2018 9:31 PM UTC

Sure.

See:
https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/IntegratingHPVerticaWithMapR.html

Specifically:

You can read data from MapR through an NFS mount point. After you mount the MapR file system as an NFS mount point, you can use CREATE EXTERNAL TABLE AS COPY or COPY to access the data as if it were on the local file system. For ORC or Parquet data, see also Reading Hadoop Columnar File Formats. This option provides the best performance for reading data.


Kaito
Forum|alt.badge.img+2
  • Author
  • Participating Frequently
  • Mar 28, 2018 6:59 AM UTC

Hi Jim,

Thank you for following this up. Really appreciated.
Should we use MapR POSIX Clients for parallel access to speed up data loading from MapR to Vertica?

https://maprdocs.mapr.com/home/AdvancedInstallation/SettingUptheClient-POSIX-Clients.html

Thanks,