Open-source Languages & Tools for z/OS

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Hello Andy,
We can't replicate your issue. It seems that the file you are trying to unpack with unzip was created by another program, not 7zip. Could you clarify that?

------------------------------
Tatiana Balaburkina
Rocket Software
------------------------------

Original Message:
Sent: 01-13-2021 08:39
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Hi Tatiana, 

I will ask how the file was created. I have run zipinfo on the sample I was provided, and this adds more confusion (to me):

End-of-central-directory record:
--------------------------------

Zip archive file size: 6618 (000019DAh)
Actual end-cent-dir record offset: 6596 (000019C4h)
Expected end-cent-dir record offset: 6596 (000019C4h)
(based on the length of the central directory and its expected offset)

This zipfile constitutes the sole disk of a single-part archive; its
central directory contains 1 entry.
The central directory is 124 (0000007Ch) bytes long,
and its (expected) offset in bytes from the beginning of the zipfile
is 6472 (00001948h).


Central directory entry #1:
---------------------------

20210112001503.dat

offset of local header from start of archive: 0 (00000000h) bytes
file system or operating system of origin: MS-DOS, OS/2 or NT FAT
version of encoding software: 6.3
minimum file system compatibility required: MS-DOS, OS/2 or NT FAT
minimum software version required to extract: 4.6
compression method: bzipped
file security status: not encrypted
extended local header: no
file last modified on (DOS date/time): 2021 Jan 12 01:17:08
32-bit CRC value (hex): 980e43aa
compressed size: 6400 bytes
uncompressed size: 75697 bytes
length of filename: 42 characters
length of extra field: 36 bytes
length of file comment: 0 characters
disk number on which file begins: disk 1
apparent file type: binary
non-MSDOS external file attributes: 000000 hex
MS-DOS file attributes (20 hex): arc

The central-directory extra field contains:
- A subfield with ID 0x000a (PKWARE Win32) and 32 data bytes. The first
20 are: 00 00 00 00 01 00 18 00 97 4c 32 a5 80 e8 d6 01 97 4c 32 a5.

The "bzipped" compression method led me to wonder if bzip2 would help, but that just reports 'not a bzip2 file'.

Thanks for looking into this.

Andy.

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Original Message:
Sent: 01-14-2021 12:37
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hello Andy,
We can't replicate your issue. It seems that the file you are trying to unpack with unzip was created by another program, not 7zip. Could you clarify that?

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-13-2021 08:39
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Hi Andy,
We recently moved to a new delivery and installation model. Now all the ported tools should be installed via package manager Conda. Please, take a look at these posts on our forum:
Introducing z/OS conda for download and deployment of z/OS open source products
How to install z/OS Miniconda - the first step in using Open Source on z

The build of unzip you are currently using was compiled without bzip2 support, which means that archives compressed with bzip2 method can't be decompressed using this build. It is not a bug, just a compilation setting.
We have a build of unzip with bzip2 support, which can unpack such archives. This build is available at our private secure conda server. To get access to this server you need support contract for "Rocket Open AppDev for Z". Other customers can install packages from our public channel. Our policy is to update the public channel after a six month delay, which means that the unzip with bzip2 support will be available there in June.
I will contact Rocket management if we can make an exception for you and copy the build which you need to the public channel now.

------------------------------
Tatiana Balaburkina
Rocket Software
------------------------------

Original Message:
Sent: 01-15-2021 03:54
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Tatiana, 

I will ask how the file was created. I have run zipinfo on the sample I was provided, and this adds more confusion (to me):

End-of-central-directory record:
--------------------------------

Zip archive file size: 6618 (000019DAh)
Actual end-cent-dir record offset: 6596 (000019C4h)
Expected end-cent-dir record offset: 6596 (000019C4h)
(based on the length of the central directory and its expected offset)

This zipfile constitutes the sole disk of a single-part archive; its
central directory contains 1 entry.
The central directory is 124 (0000007Ch) bytes long,
and its (expected) offset in bytes from the beginning of the zipfile
is 6472 (00001948h).


Central directory entry #1:
---------------------------

20210112001503.dat

offset of local header from start of archive: 0 (00000000h) bytes
file system or operating system of origin: MS-DOS, OS/2 or NT FAT
version of encoding software: 6.3
minimum file system compatibility required: MS-DOS, OS/2 or NT FAT
minimum software version required to extract: 4.6
compression method: bzipped
file security status: not encrypted
extended local header: no
file last modified on (DOS date/time): 2021 Jan 12 01:17:08
32-bit CRC value (hex): 980e43aa
compressed size: 6400 bytes
uncompressed size: 75697 bytes
length of filename: 42 characters
length of extra field: 36 bytes
length of file comment: 0 characters
disk number on which file begins: disk 1
apparent file type: binary
non-MSDOS external file attributes: 000000 hex
MS-DOS file attributes (20 hex): arc

The central-directory extra field contains:
- A subfield with ID 0x000a (PKWARE Win32) and 32 data bytes. The first
20 are: 00 00 00 00 01 00 18 00 97 4c 32 a5 80 e8 d6 01 97 4c 32 a5.

The "bzipped" compression method led me to wonder if bzip2 would help, but that just reports 'not a bzip2 file'.

Thanks for looking into this.

Andy.

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group

Original Message:
Sent: 01-14-2021 12:37
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hello Andy,
We can't replicate your issue. It seems that the file you are trying to unpack with unzip was created by another program, not 7zip. Could you clarify that?

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-13-2021 08:39
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Hi Tatiana, 

Many thanks for that - that's really helpful. I'll keep my fingers crossed we can get an early version :-)

I have looked at the conda install methods, and it seems more akin to the standard Linux-type packaging approach; I'm familiar (from a user point of view) with that, so I would expect we'd want to use that if this were to go ahead. I've been following Lionel's discussion on making it work for a 'install once, roll out everywhere' approach, because that's what we'll need to do. 

Thanks again, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Original Message:
Sent: 01-15-2021 12:32
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Andy,
We recently moved to a new delivery and installation model. Now all the ported tools should be installed via package manager Conda. Please, take a look at these posts on our forum:
Introducing z/OS conda for download and deployment of z/OS open source products
How to install z/OS Miniconda - the first step in using Open Source on z

The build of unzip you are currently using was compiled without bzip2 support, which means that archives compressed with bzip2 method can't be decompressed using this build. It is not a bug, just a compilation setting.
We have a build of unzip with bzip2 support, which can unpack such archives. This build is available at our private secure conda server. To get access to this server you need support contract for "Rocket Open AppDev for Z". Other customers can install packages from our public channel. Our policy is to update the public channel after a six month delay, which means that the unzip with bzip2 support will be available there in June.
I will contact Rocket management if we can make an exception for you and copy the build which you need to the public channel now.

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-15-2021 03:54
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Tatiana, 

I will ask how the file was created. I have run zipinfo on the sample I was provided, and this adds more confusion (to me):

End-of-central-directory record:
--------------------------------

Zip archive file size: 6618 (000019DAh)
Actual end-cent-dir record offset: 6596 (000019C4h)
Expected end-cent-dir record offset: 6596 (000019C4h)
(based on the length of the central directory and its expected offset)

This zipfile constitutes the sole disk of a single-part archive; its
central directory contains 1 entry.
The central directory is 124 (0000007Ch) bytes long,
and its (expected) offset in bytes from the beginning of the zipfile
is 6472 (00001948h).


Central directory entry #1:
---------------------------

20210112001503.dat

offset of local header from start of archive: 0 (00000000h) bytes
file system or operating system of origin: MS-DOS, OS/2 or NT FAT
version of encoding software: 6.3
minimum file system compatibility required: MS-DOS, OS/2 or NT FAT
minimum software version required to extract: 4.6
compression method: bzipped
file security status: not encrypted
extended local header: no
file last modified on (DOS date/time): 2021 Jan 12 01:17:08
32-bit CRC value (hex): 980e43aa
compressed size: 6400 bytes
uncompressed size: 75697 bytes
length of filename: 42 characters
length of extra field: 36 bytes
length of file comment: 0 characters
disk number on which file begins: disk 1
apparent file type: binary
non-MSDOS external file attributes: 000000 hex
MS-DOS file attributes (20 hex): arc

The central-directory extra field contains:
- A subfield with ID 0x000a (PKWARE Win32) and 32 data bytes. The first
20 are: 00 00 00 00 01 00 18 00 97 4c 32 a5 80 e8 d6 01 97 4c 32 a5.

The "bzipped" compression method led me to wonder if bzip2 would help, but that just reports 'not a bzip2 file'.

Thanks for looking into this.

Andy.

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group

Original Message:
Sent: 01-14-2021 12:37
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hello Andy,
We can't replicate your issue. It seems that the file you are trying to unpack with unzip was created by another program, not 7zip. Could you clarify that?

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-13-2021 08:39
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------

Hi Andy,
unzip-6.0-13.tar.bz2 is available at our public channel: https://anaconda.org/zoss-appdev/unzip/files. You have to install it using Miniconda. Let me know if you need any further assistance.

------------------------------
Tatiana Balaburkina
Rocket Software
------------------------------

Original Message:
Sent: 01-15-2021 13:37
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Tatiana, 

Many thanks for that - that's really helpful. I'll keep my fingers crossed we can get an early version :-)

I have looked at the conda install methods, and it seems more akin to the standard Linux-type packaging approach; I'm familiar (from a user point of view) with that, so I would expect we'd want to use that if this were to go ahead. I've been following Lionel's discussion on making it work for a 'install once, roll out everywhere' approach, because that's what we'll need to do. 

Thanks again, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group

Original Message:
Sent: 01-15-2021 12:32
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Andy,
We recently moved to a new delivery and installation model. Now all the ported tools should be installed via package manager Conda. Please, take a look at these posts on our forum:
Introducing z/OS conda for download and deployment of z/OS open source products
How to install z/OS Miniconda - the first step in using Open Source on z

The build of unzip you are currently using was compiled without bzip2 support, which means that archives compressed with bzip2 method can't be decompressed using this build. It is not a bug, just a compilation setting.
We have a build of unzip with bzip2 support, which can unpack such archives. This build is available at our private secure conda server. To get access to this server you need support contract for "Rocket Open AppDev for Z". Other customers can install packages from our public channel. Our policy is to update the public channel after a six month delay, which means that the unzip with bzip2 support will be available there in June.
I will contact Rocket management if we can make an exception for you and copy the build which you need to the public channel now.

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-15-2021 03:54
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hi Tatiana, 

I will ask how the file was created. I have run zipinfo on the sample I was provided, and this adds more confusion (to me):

End-of-central-directory record:
--------------------------------

Zip archive file size: 6618 (000019DAh)
Actual end-cent-dir record offset: 6596 (000019C4h)
Expected end-cent-dir record offset: 6596 (000019C4h)
(based on the length of the central directory and its expected offset)

This zipfile constitutes the sole disk of a single-part archive; its
central directory contains 1 entry.
The central directory is 124 (0000007Ch) bytes long,
and its (expected) offset in bytes from the beginning of the zipfile
is 6472 (00001948h).


Central directory entry #1:
---------------------------

20210112001503.dat

offset of local header from start of archive: 0 (00000000h) bytes
file system or operating system of origin: MS-DOS, OS/2 or NT FAT
version of encoding software: 6.3
minimum file system compatibility required: MS-DOS, OS/2 or NT FAT
minimum software version required to extract: 4.6
compression method: bzipped
file security status: not encrypted
extended local header: no
file last modified on (DOS date/time): 2021 Jan 12 01:17:08
32-bit CRC value (hex): 980e43aa
compressed size: 6400 bytes
uncompressed size: 75697 bytes
length of filename: 42 characters
length of extra field: 36 bytes
length of file comment: 0 characters
disk number on which file begins: disk 1
apparent file type: binary
non-MSDOS external file attributes: 000000 hex
MS-DOS file attributes (20 hex): arc

The central-directory extra field contains:
- A subfield with ID 0x000a (PKWARE Win32) and 32 data bytes. The first
20 are: 00 00 00 00 01 00 18 00 97 4c 32 a5 80 e8 d6 01 97 4c 32 a5.

The "bzipped" compression method led me to wonder if bzip2 would help, but that just reports 'not a bzip2 file'.

Thanks for looking into this.

Andy.

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group

Original Message:
Sent: 01-14-2021 12:37
From: Tatiana Balaburkina
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Hello Andy,
We can't replicate your issue. It seems that the file you are trying to unpack with unzip was created by another program, not 7zip. Could you clarify that?

------------------------------
Tatiana Balaburkina
Rocket Software

Original Message:
Sent: 01-13-2021 08:39
From: Andy Styles
Subject: unzip error - need PK compat. v4.6 (can do v2.1)

Following on from my question around 7zip archive formats, I've downloaded and tried unzip on a sample file I've been provided with. The file ends with .zip, so I figured I'd give it a go.

Unfortunately, I get the message:

skipping: 20201211001505.dat  need PK compat. v4.6 (can do v2.1)

Is telling me that the archive is in a format that's not supported? 

From what I can see unzip -v gives:

UnZip special compilation options:
COPYRIGHT_CLEAN (PKZIP 0.9x unreducing method not supported)
SET_DIR_ATTRIB
SYMLINKS (symbolic links supported, if RTL and file system permit)
TIMESTAMP
UNIXBACKUP
USE_EF_UT_TIME
USE_UNSHRINK (PKZIP/Zip 1.x unshrinking method supported)
USE_DEFLATE64 (PKZIP 4.x Deflate64(tm) supported)
VMS_TEXT_CONV
PASSWD_FROM_STDIN
[decryption, version 2.11 of 05 Jan 2007]

Or am I confusing myself with unrelated version numbers?

Thanks, 

Andy

------------------------------
Andy Styles
z/Series System Programmer
Lloyds Banking Group
------------------------------