Skip to main content
Question

column mapping after data with scheduler

  • October 9, 2019
  • 3 replies
  • 20 views

shrek

have data in kafka topic and able to fetch it with scheduler but later want to put data in a table with different column names. how to do this with scheduler?

3 replies

SruthiA
Forum|alt.badge.img+1
  • Participating Frequently
  • October 9, 2019

please use the instructions from the following link. It has an example regarding sample target table web_hits

https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/KafkaIntegrationGuide/Using_Kafka_with_Vertica.htm


shrek
  • Author
  • New Participant
  • October 9, 2019
I have set up a scheduler and it is working fine with the table having same column names as in source table( and the column names in the data in kafka topic). The thing is, the actual aim is to put the kafka data ( from one table) to another table having different column names. How to tell scheduler( which is fetching data from kafka) to map columns. Can i even do it with scheduler? What are the other options?

SruthiA
Forum|alt.badge.img+1
  • Participating Frequently
  • October 9, 2019

You can achieve what you want using flex tables I guess.
1) load data into flex table using scheduler
2) create your destination table with desired columns and copy the data to your destination table using the steps in the below link
https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/FlexTables/InsertingDataIntoFlexTables.htm?tocpath=Using Flex Tables|_____5