Skip to main content
Question

Please ask development to support all unsupported datatypes in Export To Parquet

  • November 3, 2024
  • 4 replies
  • 6 views

scherepanov
Forum|alt.badge.img+1

Hi,

[/data/jenkins/workspace/RE-ReleaseBuilds/RE-Miner/server/udx/supported/ParquetExport/ParquetExport.cpp:1709], error code: 0, message: ERROR: Decimal type with precision 47 (> 38) is not supported

To work around, I need to find columns in table with unsupported datatypes, and instead of SELECT *, write list of table columns, and use to_char for columns with unsupported datatype.

Can you ask development team for a new feature, to support all unsupported types in Export To Parquet.

If Export To Parquet encounter unsupported datatype, use string field in Parquet, and convert Vertica column to string, using default conversion to_char.

Development can add parameter (something like we_love_our_users_and_we_will_convert_unsupported_datatypes_to_string, default False).

Thank you
Sergey

4 replies

SruthiA
Forum|alt.badge.img+1
  • Participating Frequently
  • November 4, 2024

I have created a request with engineering VER-97735


SruthiA
Forum|alt.badge.img+1
  • Participating Frequently
  • November 4, 2024

@scherepanov : What is your vertica version? precision has been increased to 138 in 24.4

https://docs.vertica.com/24.4.x/en/sql-reference/statements/copy/parsers/parquet/


scherepanov
Forum|alt.badge.img+1
  • Author
  • Participating Frequently
  • November 5, 2024

I am on 24.3-1.
That is a good news, looking to upgrade to 24.4.


SruthiA
Forum|alt.badge.img+1
  • Participating Frequently
  • November 5, 2024

Sure.. Please upgrade and let us know if you face any issues.