Skip to main content

Drop partition Problem

  • February 5, 2014
  • 8 replies
  • 38 views

bhanu_kishore
Forum|alt.badge.img
I have a daily partitioned table which is having  1 month data (30 partitions). 

Now i want to drop and insert again 2 different days data of the month. I followed below steps.

1. Drop day 1 partition 
2. Insert data for Day1 
3. Drop day2 partition  
4. Insert Day2 data
while performing 3rd step i got below error.
java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress
I thought while performing 3rd step , some data is been shifted from WOS to ROS for day1 .
How to solve above problem ...
Thanks in advance

8 replies

Suhrid_R__Ghosh
Forum|alt.badge.img+1
  • Participating Frequently
  • February 5, 2014
HI,
I have been facing the same daily partitioning issue.

I have created a table X with daily partition which contains one month data ( 1st Jan 2013 to 31st jan 2013).
I have a talend job which does the following steps:

1. I receive 1st Jan 2013 data i drop the partition in table X for 20130101.
2. Insert 1st Jan 2013 data in table X.
3. I receive 2nd Jan 2013 data i drop the partition in table X for 20130102.
4. Insert 2nd Jan 2013 data in table X.

When i perform the step 3 i get the error stated above by bhanu

java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress

Please help to resolve the same.

Some quick questions.

1. Is it a good practice to create daily partition on a single table containing 1-2 years data ?
2. Will there be any performance difference with daily partition and how frequently we can drop this daily partition , in my case it can drop in every 2-5 seconds ?

Thanks,
Suhrid R. Ghosh


Nimmi_gupta
Forum|alt.badge.img
  • Participating Frequently
  • February 5, 2014

The error message is indicating that there is an existing tuple mover
operation (moveout) running. When you drop a partition, we check if
there is any data in WOS for that table. To ensure all data that belongs
to the partition is included, the drop_partition runs a moveout
operation. Since only one moveout can be run at a time, the new moveout
request will fail, causing the drop_partition to fail. You will need to
wait for the first moveout on that projection to finish before dropping.

Suhrid_R__Ghosh
Forum|alt.badge.img+1
  • Participating Frequently
  • February 5, 2014
HI Nimmi,


Thanks for replying.
How can i check whether first move out has been completed successfully so that i can run drop_partition command.


Thanks,
Suhrid R. Ghosh

bhanu_kishore
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • February 6, 2014
Thanks Nimmi,
          Is there any way to wait for moveout operation to complete before running drop partition command for second day.

Nimmi_gupta
Forum|alt.badge.img
  • Participating Frequently
  • February 6, 2014
How to check moveout operation has been done? Yes you can check this by querying to system table. Select * from system; and look for column wos_row_count. If this column value is zero that means moveout process is done.


bhanu_kishore
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • February 6, 2014
Thank You very much Nimmi :)

Suhrid_R__Ghosh
Forum|alt.badge.img+1
  • Participating Frequently
  • February 6, 2014
Hi Nimmi ,

Thanks for your suggestion will try this method . :)

Thanks,
Suhrid R. Ghosh

bhanu_kishore
Forum|alt.badge.img
  • Author
  • Participating Frequently
  • March 25, 2014
Hi Nimmi,

    when i drop partition in table X .. it will do moveout only for table X or for all tables.