Refreshing Dev environment with production data

We regularly do this with EclipseIDE. We have two ways of doing it. First, by creating a installation script to copy the data, dictionaries, VOC items, and whatever else from production to development. Secondly, we use COPY/PASTE in EclipseIDE to copy the data and dictionaries by hand. Since UOJ uses Data Set technology, the copy is several times faster than using the COPY command from TCL/ECL.

Leaving aside the compliance issues with identifiable personal data (GDPR particularly you might wa nt to take a look at ZFS and Zpools.

Regards

JJ

We refresh on a daily basis using fpsync (Unidata on Linux platform). We copy the entire application and data. It is automated, which then runs a data masking process on the non-prod environment once the copy is done. We copy about 300-400GB of data in about 25-30 mins.

(UV on AIX)  We created a script that copies in the backup image from the Production system and does a restore of the data files.  As someone previously mentioned, we copy off VOC and DICT files (anything that might be in-flight for development) prior to doing the restore, and then overlays them back in afterwards.

Our “data” files are in a separate account, so that makes it a little easier to isolate out just the DATA files.

Doug,

Appreciate you taking the time.  Taking your response under advisement.

Sincerly,

~Doc

WOW!  My introduction to ZFS. Incredibly powerful.  Thanks for the timely response John!

~Doc

Thank you kindly Rashid.  We are Universe 14.1 on Windows.  Are you copying program source code to your dev environment?

Thanks for the reply Brian.  We are UV 14.1 on Windows.  So you are performing a restore of your production backup image to your dev system?

Hi Doc, we copying only data. We have our data in a separate filesystem. We have multiple non-prod environments and can also copy the source code if needed.