Skip to main content

Need to Merge Avro Files using java application

  • November 9, 2017
  • 1 reply
  • 6 views

kosmik5

Hi,
I am having multiple avro files under a directory which reside on hadoop environment, I need to merge all these files and make it as a single avro file.
example

/abc->
x.avro
y.avro } => a.avro
z.avro

The file a.avro will contain contents of all x,y,z files, where x,y,z files having same schema. I need to create a java application. Any help appreciated.
Thanks.
Hari

1 reply

Jim_Knicely
Forum|alt.badge.img+2
  • Participating Frequently
  • November 13, 2017

I think this is more of an Hadoop question than a Vertica question ;)

Maybe this link can help you?
http://hadooptutorial.info/merging-small-files-into-avro-file/