Rocket® Vertica

Hi all, The link below explains what the batching factor is. Does anyone know how to get/set this batching factor (query) ? https://www.vertica.com/blog/write-optimized-storage-wos-deprecation-what-you-need-to-know/ What is Batching Factor? Batching factor is a synthetic measure described as the number of commits divided by the number of files >written to disk. It is used to describe the effectiveness of the WOS. We analyzed data loads across 4 million distinct tables across 500 customer accounts. Thanks ! BR, Koumaran

@skeswani, @cdaly1970Migrating Your Vertica Cluster to the Cloud

Hello, Could you please help me? I have vertica's scheduler, it reads data from apache kafka's topic. Sometimes the scheduler stops working because there was not enough memory and I see in log error: Insufficient resources to execute plan on pool mypool [Timedout waiting for resource request: Request exceeds limits: Memory(KB) Exceeded: Requested = 30333842, Free = 22275670 (Limit = 52609512, Used = 30333842) (queueing threshold)] I added physical memory (from 64 Gb till 96 Gb) but I have same error. I think that new memory has not been added to the scheduler' pool (I see in error's log that it is still free about 22 GB as it was before I increased the memory). How can I use all memory for the pool? Restarting scheduler and host doesn't help. That is log after adding memory:ERROR: Insufficient resources to execute plan on pool mypool [Timedout waiting for resource request: Request exceeds limits: Memory(KB) Exceeded: Requested = 30333842, Free = 22275670 (Limit = 52609512, Used = 303

Hello I got a very strange error. The point is that I need to create a flex table as administrator and then use the compute_flextable_keys_and_build_view () function. This only works well when I do the procedure as an administrator. When I try to do this from the user, I get a SQL Error [3989] [42501]: [Vertica] [VJDBC] (3989) ERROR: Must be owner of relation FLEX_DATA_view. The problem is that I give all the rights to the schema to the user, but they do not appear in the view. You can reproduce this error the following way: dbadmin: 1. CREATE SCHEMA MY_SC DEFAULT INCLUDE SCHEMA PRIVILEGES; 2. create user test identified by 'passwd'; 3. GRANT CREATE, SELECT, INSERT, UPDATE, TRUNCATE, DELETE, REFERENCES, USAGE ON SCHEMA MY_SC TO test; 4. create flex table MY_SC.FLEX_DATA(); user test: 1. select compute_flextable_keys_and_build_view('MY_SC.FLEX_DATA'); And here i get error(( How can you solve this?

We’re planning to set up production clusters using Vertica Eon on MinIO. After reading Vertica Document about Number of Shards which has the recommended shard count and initial node count base on the working data size as the below table. And currently we have 260TB Vertica license which is bigger than “Extra large” Cluster Type (Up to 192TB) in Vertica document a bit. and we have new 80 servers plus 26 older servers. And we need to use some of them for MinIO cluster also. And at least we should have 3 sub-clusters (Ingest + Query + Query). So, could you give us a suggestion about number of shard and number of Vertica node? We also found that in Vertica 10.x.x, Vertica already implemented elastic crunch scaling (ECS) for query performance scaling. New 80 servers: Model: ProLiant DL360 Gen10 CPU: Intel xeon gold 6240 @ 2.60ghz RAM: 768GB Disk: 7680GB SSD x 2 (RAID 1) Network: 50G

Hi Team, When we are inserting data into Vertica table getting below error. Insert Query: insert into xyz.vertica_table (select 9999999999, 'tbl_order_address_20200930.dat', crm_order_id, xyz.secureprotect('UniCode',legl_hous_numb), xyz.secureprotect('UniCode',legl_room), xyz.secureprotect('UniCode',legl_moo), xyz.secureprotect('UniCode',legl_vill), xyz.secureprotect('UniCode',legl_soi), xyz.secureprotect('UniCode',legl_road), legl_sub_dist, legl_dist, legl_prvn_code, legl_cnty_code, legl_pscd_code, legl_pscd_seqn, xyz.secureprotect('UniCode',mail_hous_numb), xyz.secureprotect('UniCode',mail_room), xyz.secureprotect('UniCode',mail_moo), xyz.secureprotect('UniCode',mail_vill), xyz.secureprotect('UniCode',mail_soi), xyz.secureprotect('UniCode',mail_road), mail_sub_dist, mail_disc, mail_prvn_code, mail_cnty_code, mail_pscd_code, mail_pscd_seqn, xyz.secureprotect('AlphaNumeric',home_numb), xyz.secureprotect('AlphaNumeric',offi_numb), xyz.secureprotect('AlphaNumeric',home_fax), xyz.secur

We met the following error when using Kafka scheduler in Vertica 9.3.1-12 : message: Rolling back MB: [Vertica]VJDBC ERROR: Error calling process() in User Function UDFilter at [/data/qb_workspaces/jenkins2/ReleaseBuilds/Grader/REL-9_3_1-x_grader/build/udx/supported/StreamHelpers/StreamFilters.cpp:50], error code: 0, message: User code caused Vertica to throw exception "VIAssert(input.offset == input.size) failed" java.sql.SQLNonTransientException: [Vertica]VJDBC ERROR: Error calling process() in User Function UDFilter at [/data/qb_workspaces/jenkins2/ReleaseBuilds/Grader/REL-9_3_1-x_grader/build/udx/supported/StreamHelpers/StreamFilters.cpp:50], error code: 0, message: User code caused Vertica to throw exception "VIAssert(input.offset == input.size) failed" at com.vertica.util.ServerErrorData.buildException(Unknown Source) at com.vertica.dataengine.VResultSet.fetchChunk(Unknown Source) at com.vertica.dataengine.VResultSet.initialize(Unknown Source) at com.vertica.dataengine.VQueryE

Hello, We are using vertica-9.3.1 and EON Mode. smartech=> SELECT * FROM mlai_test.sinarsmt_final_results_200611_200829 where uid=384; uid D3_decay_month D1_decay_week deliveryNoFilter deliveryFilter appActModel sessionModel_activity sessionModel_duration nd_wd_pred nd_we_pred wd1_wd_pred wd1_we_pred md1_wd_pred md1_we_pred m2d1_wd_pred m2d1_we_pred wd3_wd_pred wd3_we_pred md3_wd_pred md3_we_pred m2d3_wd_pred m2d3_we_pred prp_wd_pred prp_we_pred D3_decay_month2 D3_decay_week D1_decay_month D1_decay_month2 -----+----------------+---------------+------------------+----------------+-------------+-----------------------+-----------------------+------------+------------+-------------+-------------+-------------+-------------+--------------+--------------+-------------+-------------+-------------+-------------+--------------+--------------+-------------+-------------+-----------------+---------------+----------------+----------------- 384 15 15 15 9 15 15 12 15 15 15 15 15 15 15 15 15

Hi, Is it possible to have entire db encrypted ? or a table? What I read regards only a specific column (varchar). Is there any documentation regarding this? Thank you!

Hi team, Does anyone have a query that can identify duplicate projections in a database? (same columns, order by encoding and segmentation)? Thanks

Hi. Sorry for the rudimentary question. A user-defined function created by the DB administrator is passed to the What do I need for general users to use it? Anyway "alter function myfunction () owner to user;" It's now available in, but I don't think it's a fundamental solution. Thank you for your reply.

Hi! I am the owner of a small store here in our town. I have the opportunity to expand, but I'm a little afraid of all the data chaos that comes with it. I should have gotten my data in order a few years ago, but instead I use different databases with a little bit of stuff in them. Terrible ... An acquaintance of mine told me that it should be possible to connect databases in the sales department with Aiven. Have any of you ever worked with Aiven and can give me feedback on this?

Are there any plans to update to 10.0.x ?

Is vertica 9.2 ,9.3 10.x supported on redhat 7.8 ?

I'm trying to run Database Designer using the Design Type incremental for a particular query. The query runs in vsql without error but since its too slow, I tried using the database designer on the same query. But when I proceed with it, I get an error: Designer did not run successfully Unknown error while running Database Designer. Err: ERROR: Could not validate schema search path: my schema name Design process may still be executing in the background. Press to return to the Administration Tools menu. I checked Search_path and it has my schema listed but I still get this error. What could I be missing here?

My query has the many 'OR' clause cause of this clause the query speed is so low.. is it possible optimization?? SELECT a.image_link , a.product_id , b.title , b.mall_name , b.brand , b.category_name1 , b.category_name2 , b.category_name3 , b.category_name4 FROM ( SELECT product_id, image_link, image_status FROM newbiz_product_dev.products_image ORDER BY product_id )a LEFT OUTER JOIN ( SELECT product_id , title , mall_name , brand , category_name1 , category_name2 , category_name3 , category_name4 FROM newbiz_product_dev.products ORDER BY product_id )b ON a.product_id = b.product_id WHERE a.image_status = 'SUCCESS' AND ( b.title LIKE '%' || 'test' || '%' OR b.mall_name LIKE '%' || 'test' || '%' OR b.brand LIKE '%' || 'test' || '%' OR b.category_name1 ILIKE '%' || 'test' || '%' OR b.category_name2 ILIKE '%' || 'test' ||

Hello, I try change column encoding, but it doesn't work as expected. My test: I have table : openx=> select export_objects('','test.test1'); export_objects ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ CREATE TABLE test.test1 ( language_id int ); CREATE PROJECTION test.test1 /*+createtype(P)*/ ( language_id ) AS SELECT test1.language_id FROM test.test1 ORDER BY test1.language_id SEGMENTED BY hash(test1.language_id) ALL NODES KSAFE 1; Check size SELECT projection_name, column_name, encodings, compressions, ROUND(SUM(used_bytes)/(1024^2),1)::FLOAT AS size_Mb FROM column_storage WHERE

Is it possible to get a recommended DDL by submitting query transaction_id?

How to create super projection with out insert operation when i create table??

Hello, I have 4 big table a, b, c, d. each table have about 300 million data. I wanna inner join a, b, c, d. but, when i was using this query, the cpu usage is top in the system.. Even this query is intended to be used on a web page as a paging query, so it should appear within at least 10 seconds. Is this possible?

can we upgrade directly from vertica 9.2 to 10.x by doing something like /opt/vertica/sbin/update_vertica --rpm /home/dbadmin/vertica-10.0.x.x86_64.RHEL6.rpm or do we have to upgrade 9.2>9.3>10.x Is vertica 10 available on rhel 8 (including Management console) .

I am loading data from a CSV file into Vertica database using Alteryx designer and after loading few thousands of records the Alteryx job fails with the following error. Error: Output Data (7): DataWrap2ODBC::SendBatch: server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request. Insert into "Schema"."table"("column1", "column2", ....... "column") Values (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?) I have used different Vertica ODBC drivers and issue is the same. I compared all the settings with my colleague who was able to run the job successfully and there is no difference. We have created support request for Alteryx team thinking that it might be an issue with the tool but they confirmed it's not the issue with Alteryx. Vertica Admins are not seeing any drop down of nodes on Vertica server. Even Vertica documentation d

CREATE FUNCTION replaceSpChar (x VARCHAR) RETURN VARCHAR AS BEGIN RETURN REGEXP_REPLACE (x, '[.,;‘`:/*() ?/"&%$!+={}<>]', '') end END ERROR 4856: Syntax error at or near "end" at character 128 This manual select works-> select REGEXP_REPLACE ('?' , '[.,;‘`:/*() ?/"&%$!+={}<>]', '')

Is there any upcoming planned Vertica EON version going to be available for Azure

How to check which query is cause of cpu overflow??