Skip to main content
Question

SSL Configuration for Kafka Producer

  • October 26, 2020
  • 2 replies
  • 10 views

girzibupse

Hello
I've configured SSL for broker (named kafka1) and producer based on following link: https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/KafkaIntegrationGuide/TLS-SSL/KafkaTLS-SSLExamplePart3ConfigureKafka.htm).

unlike the broker, the producer hasn't been configured successfully in producer.properties file. Because, there is Kerberos authentication service with following configuration and I can't set security.protocol = SSL as mentioned in above link:

security.protocol=SASL_PLAINTEXT
sasl.mechanism=GSSAPI
sasl.kerberos.service.name=kafka

in order to produce data to kafka this command is used: kafka-console-producer.sh --broker-list kafka1.sgi.ir:9093 --topic test1kafka1 --producer.config /home/pskafka/kafka_2.12-2.4.0/config/producer.properties. But, due to lack of SSL value in security.protocol parameter, errors are generated.

Finally, The question that I have is how can set ssl in producer.properties configuration file?
An image of producer.properties configuration file has been attached.

2 replies

SergeB
Forum|alt.badge.img
  • Participating Frequently
  • October 28, 2020

Can you share the version of Vertica you're using? Support for SASL+SSL was added in 9.3.1. However, the only sasl.mechanism supported is PLAIN. There are also some limitations with KafkaExport.
https://www.vertica.com/docs/10.0.x/HTML/Content/Authoring/KafkaIntegrationGuide/AuthenticatingWithKafkaUsingSASL.htm


JosephWatt
  • New Participant
  • December 9, 2020

Change location props.put (SslConfigs.SSL_KEYSTORE_LOCATION_CONFIG, "/var/private/ssl/kafka.client.keystore.jks");
Now it should work.
writemyessay.onl