Is there a way to run the Vertica CE docker image as a Pod in k8s?

Hi Anna,

I would like to understand your use case in K8s a little better. Could you also provide the sample yaml file you are using to achieve this? The way we have built the Vertica-K8s Image to be able to run in K8s is little different than the One-node Docker Image. For example, in K8s, we only support EON mode based cluster that uses local PVs for temp/catalog storage and an Obj store as data storage. Whereas, the one node CE uses Docker-volumes/bind-mounts for local temp/catalog and data storage. So two options, off the top of my head are: 1) Use the new Vertica-operator https://github.com/vertica/vertica-kubernetes (It is pretty simple and quick to setup) or 2) You could try to use the vertica-K8s image that the operator uses and try to launch the same way. But for this you will have to make sure you have right PVCs (or storage class) in your manifest and load the required data afterwards. Disclaimer for 2) though -- it is not a supported config and untested.

Thanks,
Naren

Hi Naren,

Thanks for getting back to me! I really just want to run the Vertica docker image as a one node thing with no PVC, as basic as possible (so that it can be set up and torn down repeatedly and easily). The only requirements I have are 1. it initializes correctly and 2. it can respond to pings on port 5433. I guess if there's a way for this deployment to spin up the container just like how docker-compose would, that would be perfect for me.

This is the yaml I'm using:

apiVersion: apps/v1
kind: Deployment
metadata:
  labels:
    module: test-vertica
    service: test-vertica
  name: test-vertica
  namespace: default
spec:
  progressDeadlineSeconds: 600
  replicas: 1
  revisionHistoryLimit: 3
  selector:
    matchLabels:
      service: test-vertica
  strategy:
    rollingUpdate:
      maxSurge: 1
      maxUnavailable: 1
    type: RollingUpdate
  template:
    metadata:
      labels:
        module: test-vertica
        service: test-vertica
    spec:
      containers:
      - env:
        - name: POD_HOST_IP
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: status.hostIP
        - name: POD_IP
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: status.podIP
        - name: POD_NAME
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: metadata.name
        - name: POD_NAMESPACE
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: metadata.namespace
        - name: POD_NODE_NAME
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: spec.nodeName
        - name: POD_SERVICE_ACCOUNT
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: spec.serviceAccountName
        - name: POD_UID
          valueFrom:
            fieldRef:
              apiVersion: v1
              fieldPath: metadata.uid
        image: vertica/vertica-ce:11.0.0-0
        imagePullPolicy: IfNotPresent
        name: test-vertica
        ports:
        - containerPort: 5433
          name: http
          protocol: TCP
        resources:
          limits:
            cpu: "1"
            memory: 512Mi
          requests:
            cpu: 10m
            memory: 90Mi
        securityContext:
          allowPrivilegeEscalation: true
          privileged: true
        terminationMessagePath: /dev/termination-log
        terminationMessagePolicy: File
      dnsPolicy: ClusterFirst
      restartPolicy: Always
      schedulerName: default-scheduler
      securityContext: {}
      terminationGracePeriodSeconds: 5

@annayan1 If you are looking for a single node, then I think single node vertica docker community edition can help you. Could you please take a look at the below link

https://hub.docker.com/r/vertica/vertica-ce

Hi @SruthiA, thanks, but I'm already using that image (as you can see in the k8s deployment yaml I pasted). And even though that image works in docker-compose out of the box, in k8s it gives me the error I pasted in my original post

@annayan1 Vertica is meant to be a stateful pod when you deploy it in K8s since it is a database and not a stateless application. docker-compose uses docker-volumes underneath, typically /var/lib/docker/volumes//_data . So, I believe you will require to set up a pvc/pv or assign a storage class to use for the deployment. You can do this by defining the _volumes_ in your deployment spec and then referencing that_ volumeMounts_ inside the container. This is where Vertica pod will attempt to persist the data/catalog. You can use local-path/local-volume provisioner as a simple way of achieving this.

@annayan1 : I used the yaml file you provided and was able to create deployment on k8's. I am login to the VMart database successfully.

Events:
Type Reason Age From Message
---- ------ ---- ---- -------
Normal Scheduled 22m default-scheduler Successfully assigned default/test-vertica-7647c565b4-4jj6b to sruthk82
Normal Pulling 21m kubelet Pulling image "vertica/vertica-ce:11.0.0-0"
Normal Pulled 10m kubelet Successfully pulled image "vertica/vertica-ce:11.0.0-0" in 11m28.06215534s
Normal Created 10m kubelet Created container test-vertica
Normal Started 10m kubelet Started container test-vertica
[dbadmin@sruthk81 ~]$

kubectl get po |grep test
test-vertica-7647c565b4-4jj6b 1/1 Running 0 23m
[dbadmin@sruthk81 ~]$

[dbadmin@test-vertica-7647c565b4-4jj6b ~]$ admintools -t list_allnodes
Node | Host | State | Version | DB
------------------+-----------+-------+------------------+-------
v_vmart_node0001 | 127.0.0.1 | UP | vertica-11.0.0.0 | VMart

[dbadmin@test-vertica-7647c565b4-4jj6b ~]$
Welcome to vsql, the Vertica Analytic Database interactive terminal.

Type: \h or \? for help with vsql commands
\g or terminate with semicolon to execute query
\q to quit

dbadmin@test-vertica-7647c565b4-4jj6b()=> select version();

version

Vertica Analytic Database v11.0.0-0
(1 row)

wow @SruthiA , thanks for trying that. But I'm still getting the same error - both at the end of the docker_entrypoint.sh run and also when I try to run vsql inside the container, I get:

vsql: could not connect to server: Cannot assign requested address
    Is the server running on host "???" and accepting
    TCP/IP connections on port 5433?

Did you just copy-paste my yaml into a file and ran kubectl create -f? Which k8s cluster are you trying this on? I've tried it on both AKS and EKS and neither works.

@annayan1 : I used the same yaml file you provided. Please find it below. I used kubectl deploy -f forumdocker.yaml .

I created k8's cluster locally using open source kubernetes.

https://kubernetes.io/docs/setup/production-environment/tools/kubeadm/

[dbadmin@sruthk81 ~]$ cat forumdocker.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
labels:
module: test-vertica
service: test-vertica
name: test-vertica
namespace: default
spec:
progressDeadlineSeconds: 600
replicas: 1
revisionHistoryLimit: 3
selector:
matchLabels:
service: test-vertica
strategy:
rollingUpdate:
maxSurge: 1
maxUnavailable: 1
type: RollingUpdate
template:
metadata:
labels:
module: test-vertica
service: test-vertica
spec:
containers:
- env:
- name: POD_HOST_IP
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: status.hostIP
- name: POD_IP
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: status.podIP
- name: POD_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.name
- name: POD_NAMESPACE
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.namespace
- name: POD_NODE_NAME
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.nodeName
- name: POD_SERVICE_ACCOUNT
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: spec.serviceAccountName
- name: POD_UID
valueFrom:
fieldRef:
apiVersion: v1
fieldPath: metadata.uid
image: vertica/vertica-ce:11.0.0-0
imagePullPolicy: IfNotPresent
name: test-vertica
ports:
- containerPort: 5433
name: http
protocol: TCP
resources:
limits:
cpu: "1"
memory: 512Mi
requests:
cpu: 10m
memory: 90Mi
securityContext:
allowPrivilegeEscalation: true
privileged: true
terminationMessagePath: /dev/termination-log
terminationMessagePolicy: File
dnsPolicy: ClusterFirst
restartPolicy: Always
schedulerName: default-scheduler
securityContext: {}
terminationGracePeriodSeconds: 5

@SruthiA : interesting, when I try this locally I get the same errors. There must be some default settings different in our setups. But what could it be...

@annayan1 : As @nprabhu2195 mentioned, you might be missing some settings or configuration. Please open a support case as it might require webex.

update: turns out this is a resource issue! Looks like the vertica ce container needs 2g memory to start because it has some hefty sample data sets.