Support deploying Manager to multiple namespace in K8s

Description

Objective: I want to deploy multiple xap clusters on Kubernetes using Kubernetes operators. I want the xap cluster to be segregated by namespace. How can this be done? Here are the steps I tried. Please advise.

UseCase-1:

Steps:
1. minikube start
2. kubectl create namespace demo1
3. kubectl create namespace demo2
4. helm install ie-mgr1 gigaspaces/insightedge-manager --version=15.8.0 --namespace demo1
5. helm install ie-mgr2 gigaspaces/insightedge-manager --version=15.8.0 --namespace demo2

Output/Issue:
When execute step#5 it prints following error

Error: rendered manifests contain a resource that already exists. Unable to continue with install: CustomResourceDefinition "pus.gigaspaces.com" in namespace "" exists and cannot be imported into the current release: invalid ownership metadata; annotation validation error: key "meta.helm.sh/release-name" must equal "demo2": current value is "demo1"; annotation validation error: key "meta.helm.sh/release-namespace" must equal "demo2": current value is "demo1"

UseCase-2:

Install CRD only for first time and then after only install operator for second namespace

Steps:
1. minikube start
2. kubectl create namespace demo1
3. kubectl create namespace demo2
4. helm install ie-mgr1 gigaspaces/insightedge-manager --version=15.8.0 --namespace demo1
5. disable CRD creation by setting flag false for next manager deployment
6. helm install ie-mgr2 gigaspaces/insightedge-manager --version=15.8.0 --namespace demo2 [Without CRD deployment]

Output/Issue:
Both managers successfully deployed in their respective namespace.
The Issue is when I deploy space from manager1 then it will deploy the same space to manager2 also.
This is very strange behavior.

Expected:
Both manager deployments should work independently.

Fixed

Assignee

Meshi Ruff

Reporter

Nihar Kapadia

Labels

None

Priority

Medium

SalesForce Case ID

None

Fix versions

Commitment Version/s

None

Due date

None

Product

InsightEdge

Edition

Enterprise

Platform

All