Error importing an Avro file into a Flex table

This is actually a server-side error in the Avro parser. I've seen this happen when the Avro file contains decimals with precision > 38. Is this the case?
If you can open a support case, please do that and submit the schema and sample data if possible.

So this error is to do with decimals but on a precision much lower than that. Having done some binary searching, the following works:

{ "name": "price", "type": { "type": "bytes", "logicalType": "decimal", "precision": 18, "scale": 9 } }

but this doesn't:

{ "name": "price", "type": { "type": "bytes", "logicalType": "decimal", "precision": 20, "scale": 10 } }

I assume this is unexpected/bug? I can provide code and sample files - how do I raise a support case?

Thanks,
Robert

Please submit a request via https://sld.microfocus.com/
Contact your sales team for assistance if required.

What version of Vertica are you testing with? Are you using a generic flex table or a hybrid one (with some "real" columns) ?

The error seems to be raised when mapping the parsed value (price) to its target column.

Could you run a test with a real table with just one column price defined with proper expected precisions and scales?

We've actually raised a support request for this, but if anyone is interested: Vertica Analytic Database v11.1.1 and it's a newly created flex table with no other columns defined.

Basically if you generate binary avro data using this schema:

[ { "namespace": "com.test", "type": "record", "name": "Test", "doc": "Record documentation", "fields": [ { "name": "name", "type": "string", "doc": "A simple doc" }, { "name": "price", "type": { "type": "bytes", "logicalType": "decimal", "precision": 20, "scale": 10 } } ] } ]

you can see the error in the console if you import like this:

create flex table Schemaname.test(); COPY Schemaname.test FROM LOCAL 'c:/temp/fails.avro' PARSER public.FAvroParser() REJECTED DATA AS TABLE "Schemaname.test_rejects";

However if you use this precision and scale instead it works:

"precision": 18, "scale": 9