Rocket U2 | UniVerse & UniData

 View Only
Expand all | Collapse all

Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

  • 1.  Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    PARTNER
    Posted 05-09-2024 11:30

    Blinks. Our product uses the Universe database with Pick Flavored account running on various Windows OS platforms. What, if anything, can be done to reduce the number of file  blinks that we are seeing? Three causes that we've identified so far are: Power failure, No more disk space, Anti-virus. 

    Are any UV versions (or Windows versions) more susceptible than others to Blinks?

    Thanks in advance for your inputs.



    ------------------------------
    Gil Steidle
    DEV
    DDI System Inc
    brick NJ US
    ------------------------------


  • 2.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-10-2024 10:39
    Hi Gil!

    Without asking for a bit more detail, here are some really quick off-the-cuff suggestions - none of which are specific to the multi-value world:
    Power Failures - Any system running a database should be running on a UPS of one sort or another (generator would be even better). Some UPS models can even be configured to send a signal to the server to initiate a clean shutdown if the power is out for an extended period and their batteries start running low.
    Running out of disk space - if this is a gradual growth, the systems should be initially spec'd with more disk (not "just enough" for the install) and scheduled tasks should be set up to monitor disk usage. If this is a sudden, unexpected growth (like a runaway process of some sort), do what you can to eliminate those (based on what may have happened in the past) and again, put some monitors in place.
    Anti-virus - any anti-virus/anti-malware that scans a database server should be configured to ignore the files/folders known to be database files.

    Hope that helps some.

    Brian




  • 3.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    PARTNER
    Posted 05-10-2024 22:05

    What are the other common causes of blinks and how can we minimize the risks? Will poorly sized files increase the chances of getting a blink on the file?



    ------------------------------
    Gil Steidle
    DEV
    DDI System Inc
    brick NJ US
    ------------------------------



  • 4.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    ROCKETEER
    Posted 05-11-2024 07:40

    With some of the items already mentioned, a poorly sized file can be a contributing factor. For example, if the file is heavily into overflow groups, a record update can involve writing multiple groups in the overflow chain. The number of overflow buffers that need to be updated can increase the chance that an interrupted write operation will result in an issue with the overflow buffer pointers. 



    ------------------------------
    Neil Morris
    Universe Advanced Technical Support
    Rocket Software
    ------------------------------



  • 5.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-12-2024 10:14
    Edited by John Jenkins 05-12-2024 10:16

    Gil,

    Adding to Brian's execellent post on using a UPS, please opt for an 'online' UPS.

    • An 'online' UPS is always supplying power to the system and incoming electrical power goes to the UPS, not directly to the protected system. The advantage is that if and when main power glitches or fails there is no switchover to battery which can itself cause a dip as the switchover takes place..They should also protect against overvoltages, brownouts and spikes.

    • A final word on the UPS - get a good well-known brand name and track record - do not skimp. They are very specifically intended for mission-critical systems.

    Regards

    JJ



    ------------------------------
    John Jenkins
    Thame, Oxfordshire
    ------------------------------



  • 6.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-13-2024 12:25

    This is correct.  We here have a task in our Universe scheduler, that every week tells us how much disk space has been used and left.  And emails that to the sysadmin.



    ------------------------------
    Will Johnson
    Systems Analyst
    Rocket Forum Shared Account
    ------------------------------



  • 7.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    PARTNER
    Posted 05-16-2024 12:42

    What is a reliable method to identify files with blinks proactively? Will a simple SELECT or COUNT be effective? I'm thinking to make a scheduled job to check our files for corruption.



    ------------------------------
    Gil Steidle
    DEV
    DDI System Inc
    brick NJ US
    ------------------------------



  • 8.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    ROCKETEER
    Posted 05-16-2024 16:56

    If you want to check for file corruption on a proactive basis, using the 'fixtool' command might be best approach. 



    ------------------------------
    Neil Morris
    Universe Advanced Technical Support
    Rocket Software
    ------------------------------



  • 9.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-17-2024 13:59

    If you wish to use the SELECT or COUNT approach, include a WITH clause that will not select any records. Example: WITH PositiveNumericField < 0.

    This ensures the record is read, including any oversize record blocks. Otherwise, this just reads the primary group chain record blocks and ID. 

    The most robust approach would use fixtool.



    ------------------------------
    Mark A Baldridge
    Principal Consultant
    Thought Mirror
    Nacogdoches, Texas United States
    ------------------------------



  • 10.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    PARTNER
    Posted 05-20-2024 09:16

    LIST with DET.SUP also works.



    ------------------------------
    Tyrel Marak
    Technical Support Manager
    Aptron Corporation
    Florham Park NJ US
    ------------------------------



  • 11.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-21-2024 12:44

    Hi Gil,

    For us badly sized files has always been the biggest culprit for UniVerse file corruption, that and dynamic files which seem to be susceptible to corruption following system failures.

    We have developed our own daily FILE.STAT suite that performs the FILE.STAT on each file on a daily basis overnight, we log and report any Blink errors identified, but with the robustness of UNIX system nowadays we rarely see them. We maintain a history of each file so that we can try to predict forward growth of each file a have the ability to automatically resize files or manually manage the process.

    Saying that, there is the Rocket provided ACCOUNT.FILE.STATS which logs each time it's run to a file called STAT.FILE with an internal date/time stamp ID, examining the last run for each file would identify both if the FILE.STAT failed (Blink error) by checking the FILE.STAT attributes (they will not be populated) and as a bonus this also enables you to check that your files are sized correctly so you can remediate as appropriate.

    Sample table below below shows the omission of the number of Records (Items) within the file, the first two entries were whilst a Blink error existed on a test file.

    SORT STAT.FILE BY @ID FILENAME.LONG FILETYPE FILEMOD FILESEP FILESIZE RECORDS 17:37:06  21-05-24  PAGE 1
    ID..................... File Name..................... Type Mod..... Sep File....... Record.
                                                                             Size....... Count..

    20596*59877*0012        DUFF                             18      101   2      104448
    20596*60074*0012        DUFF                             18      101   2      104448
    20596*60200*0012        DUFF                             18      101   2      104448     415
    20596*60361*0012        DUFF                             18      101   2      104448     414
    20596*60489*0012        DUFF                             18      101   2      104448     414
    20596*60881*0012        DUFF                             18      101   2     7135232   58913
    20596*61027*0012        DUFF                             18      101   2     7135232   58913
    20596*63155*0012        DUFF                             18      101   2      104448       0

    Regards

    MArk 



    ------------------------------
    Mark Copp
    Infrastructure Design
    Travis Perkins Trading Company Ltd
    Northampton GB
    ------------------------------



  • 12.  RE: Are there any Best Practices to prevent/reduce the occurance of UV file Blinks

    Posted 05-21-2024 13:48

    As you observe, this is the occurrence of a system failure. UniVerse will NOT break files just by using them. There are no holes in the locking mechanism. If files break, there is an underlying cause which you can address. 

    Both the overflow chain of group blocks holding record headers, and the linkage of oversize record blocks can be corrupted. The exposure time of active updates differ for each linkage structure related to system crashes, and a disk full condition will coincide when the file is extended for overflow. Oversize record handling - records that do not fit in a group including the record header and ID (and the LARGE.RECORD factor in dynamic files) - is different. UniVerse frees the original disk blocks for the oversize record, then allocates the oversize group blocks it needs for the updated or new record, then writes the data. If the write fails because it cannot allocate enough blocks for the new record, the write will fail (without corruption), however it will fail after it has removed the original oversize record.



    ------------------------------
    Mark A Baldridge
    Principal Consultant
    Thought Mirror
    Nacogdoches, Texas United States
    ------------------------------