scan for NUL character in XML file

Hi, I am facing an issue with generated xml file. Sometimes randomly it contains NUL character instead of valid data. I would like to scan the file to confirm whether the file is correct (without the NUL) or corrupted (with NUL). But I don't know how to handle it in Uniface.  

When I do fileload/raw of the file above and filedump/raw then in the new file I see something like this ! instead of NUL. 

Does anyone have a clue how to recognize the NUL character in the XML? I would like to avoid to use fileload/filedump because of performance reasons.

Hi, I am facing an issue with generated xml file. Sometimes randomly it contains NUL character instead of valid data. I would like to scan the file to confirm whether the file is correct (without the NUL) or corrupted (with NUL). But I don't know how to handle it in Uniface.  

When I do fileload/raw of the file above and filedump/raw then in the new file I see something like this ! instead of NUL. 

Does anyone have a clue how to recognize the NUL character in the XML? I would like to avoid to use fileload/filedump because of performance reasons.

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi Jozef,

IMHO the first choice is to ask to your XML provider to clean up the file at the origin; if this option it is not available for whatever reason you should clean it by yourself before loading it.

There are tons of HTML/XHTML/XML utilities available to clean it up: the one I use and like the most is "tidy". This "grandaddy of all HTML tools" implements a lot of different options: try to start it up with "tidy --help" to read its long long list. You can find sources HERE while latest official compiled binaries can be downloaded HERE. I am actually using version 5.7.17 downloaded somewhere either 32bit and 64bit but I do not remember the original page, sorry. Latest version available as sources is 5.7.28.
I am using it as an external command (it's quite fast!); for performance reason I would prefer to have a signature directly using libtidy but up to now I never really had the opportunity to implement it.

Hope it helps.

Regards,
Gianni

Hi, I am facing an issue with generated xml file. Sometimes randomly it contains NUL character instead of valid data. I would like to scan the file to confirm whether the file is correct (without the NUL) or corrupted (with NUL). But I don't know how to handle it in Uniface.  

When I do fileload/raw of the file above and filedump/raw then in the new file I see something like this ! instead of NUL. 

Does anyone have a clue how to recognize the NUL character in the XML? I would like to avoid to use fileload/filedump because of performance reasons.

Hi Jozef,

my doubts about $replace() were definitively wrong...

I have created a simple button having into <DETAIL> the following code:

variables
    string    cCR
    string    vTextIni, vTextFin
    raw        vRaw, vRawClean, vMultiZeroBin, vSingleZeroBin
endvariables
; Initialize few variables...
cCR = "%%^"
vTextIni = $concat("It's a long way to Tipperary,", cCR, "It's a long way to go.", cCR, $concat("It's a long way to Tipperary", cCR, "To the sweetest girl I know!", cCR))
vTextFin = $concat("Goodbye Piccadilly,", cCR, "Farewell Leicester Square!", cCR, $concat("It's a long long way to Tipperary,", cCR, "But my heart's right there.", cCR))
vMultiZeroBin = $decode("HEX", "000000000000000000000000")
; Build a RAW string simulating what Josef has loaded as XML
vRaw = $concat(vTextIni, vMultiZeroBin, vMultiZeroBin, cCR, vTextFin)
; Dump it to disk to be read later on with Notepad++
filedump/raw vRaw, "myFileRaw.txt"
; ========== =========== =========== =========== =========== ===========
; Initialize single binary zero
vSingleZeroBin = $decode("HEX", "00")
; Replace binary zero in the raw string
vRawClean = $replace(vRaw, 1, vSingleZeroBin, "", -1)
; Dump the result to disk to be read with Notepad++
filedump/raw vRawClean, "myFileRawClean.txt"
; Let's clean empty lines too...
vRawClean = $replace(vRawClean, 1, $concat(cCR, cCR), cCR, -1)
filedump/raw vRawClean, "myFileRawNoEmptyLines.txt"
; ========== =========== =========== =========== =========== ===========
message/info "Done!"

After executing open into Notepad++ the three files dumped to disks.

...et voilà!

Regards,
Gianni