Skip to main content
Question

How can i extend the query timeout properties??

  • July 21, 2021
  • 3 replies
  • 6 views

HyeontaeJu
Forum|alt.badge.img+2

i use the kafkaexport query in the java programming. As the sended data is Big, KafkaExport funtion's execute time is too long..

beacuase of long time of function execute the vertica jdbc show this error message

Cause: java.sql.SQLNonTransientException: [Vertica]VJDBC ERROR: Error calling processPartition() in User Function KafkaExport at [src/KafkaExport.cpp:351], error code: 0, message: Exception while processing partition row: [413324] : [Fatal kafka error: kafka:9092/1001: 5 request(s) timed out: disconnect]
at org.apache.ibatis.exceptions.ExceptionFactory.wrapException(ExceptionFactory.java:30)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:149)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:140)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectOne(DefaultSqlSession.java:76)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.mybatis.spring.SqlSessionTemplate$SqlSessionInterceptor.invoke(SqlSessionTemplate.java:426)
at com.sun.proxy.$Proxy59.selectOne(Unknown Source)
at org.mybatis.spring.SqlSessionTemplate.selectOne(SqlSessionTemplate.java:159)
at org.apache.ibatis.binding.MapperMethod.execute(MapperMethod.java:87)
at org.apache.ibatis.binding.MapperProxy.invoke(MapperProxy.java:93)
at com.sun.proxy.$Proxy76.kafkaExportTotalProducts(Unknown Source)
at

(......)
com.wmp.ep.index.manager.config.db.MybatisPrintSqlInterceptor.intercept(MybatisPrintSqlInterceptor.java:47)
at org.apache.ibatis.plugin.Plugin.invoke(Plugin.java:61)
at com.sun.proxy.$Proxy98.query(Unknown Source)
at org.apache.ibatis.session.defaults.DefaultSqlSession.selectList(DefaultSqlSession.java:147)
... 60 common frames omitted
Caused by: com.vertica.support.exceptions.NonTransientException: [Vertica]VJDBC ERROR: Error calling processPartition() in User Function KafkaExport at [src/KafkaExport.cpp:351], error code: 0, message: Exception while processing partition row: [413324] : [Fatal kafka error: kafka:9092/1001: 5 request(s) timed out: disconnect]
... 86 common frames omitted

How can i extend the query timeout ??

3 replies

SergeB
Forum|alt.badge.img
  • Participating Frequently
  • July 21, 2021

Hello, does vertica.log contain more details about the error?


HyeontaeJu
Forum|alt.badge.img+2
  • Author
  • Participating Frequently
  • July 21, 2021

@SergeB Yes, contain more error. but as the log is so long, I can't write the whole log.
Can you share your email?? i wanna send to you the log message


SergeB
Forum|alt.badge.img
  • Participating Frequently
  • July 21, 2021

Best would be to open a support case. The timeout message seems to come from the Kafka Connection. This could be due to your network or kafka broker settings but there are a number of knobs you could play with from the producer side (KafkaExport). see KafkaExport parameter [,kafka_conf='kafka_configuration_setting']) and the Vertica Producer settings in this documentation section: https://www.vertica.com/docs/10.1.x/HTML/Content/Authoring/KafkaIntegrationGuide/ConfiguringKafkaForVertica.htm