Installation guide for IBM Connections Component Pack 6.0.0.6

1. Component Pack 6.0.0.6 Installation Guide
Martti Garden – IBM
Roberto Boccadoro – ELD Engineering

2. Note:this document details atest installation. For productioninstallations refer to
the Knowledge Base
We will installonthree servers:
ComponentPackMaster:soc.yourserver.com
ComponentPackGenericWorkerOM+Customizer:soc1.yourserver.com
ComponentPackES WorkerElasticsearch:soc2.yourserver.com
The Connectionsserveriscon.yourserver.com
Preparing the system:
openfirewall portoneachmachine
firewall-cmd --zone=public --add-port=6443/tcp --permanent
firewall-cmd --zone=public --add-port=10250/tcp --permanent
firewall-cmd --zone=public --add-port=10251/tcp --permanent
firewall-cmd --zone=public --add-port=10252/tcp --permanent
firewall-cmd --zone=public --add-port=80/tcp --permanent
firewall-cmd --zone=public --add-port=443/tcp --permanent
firewall-cmd --zone=public --add-port=5000/tcp --permanent
firewall-cmd --zone=public --add-port=30001/tcp --permanent
firewall-cmd --zone=public --add-port=30099/tcp --permanent
firewall-cmd --zone=public --add-port=31100/tcp --permanent
firewall-cmd --zone=public --add-port=32721/tcp --permanent
firewall-cmd --zone=public --add-port=32200/tcp --permanent
firewall-cmd --zone=public --add-port=27017/tcp --permanent
firewall-cmd --zone=public --add-port=30484/tcp --permanent
firewall-cmd --zone=public --add-port=32333/tcp --permanent
firewall-cmd –reload

3. Installing pre-requisites
Installing Docker17.03. (on each server)
yum-config-manager --add-repo
https://download.docker.com/linux/centos/docker-ce.repo
yum-config-manager --disable docker*
yum-config-manager --enable docker-ce-stable
yum install -y --setopt=obsoletes=0 docker-ce-17.03*
yum makecache fast
sudo systemctl start docker
sudo systemctl enable docker.service
yum-config-manager --disable docker*
ConfigureDockerwith the devicemapperstoragedriver(loop-lvm)(on each server)
sudo systemctl stop docker
vi /etc/docker/daemon.json
add:
{
"storage-driver": "devicemapper"
}
save & exit
sudo systemctl start docker
CheckDevice Mapperisrunningby:
docker info
Disable swaponeachserver
swapoff -a
vi /etc/fstab
commentoutfollowingline:
/dev/mapper/cl-swap swap swap defaults 0 0
save and exit
if changeswere made infstabrun the following command:
mount -a
Installkubeadm, kubelet, and kubectl(on each server)
vi /etc/yum.repos.d/kubernetes.repo
add

4. [kubernetes]
name=Kubernetes
baseurl=https://packages.cloud.google.com/yum/repos/kubernetes-el7-x86_64
enabled=1
gpgcheck=1
repo_gpgcheck=1
gpgkey=https://packages.cloud.google.com/yum/doc/yum-key.gpg
https://packages.cloud.google.com/yum/doc/rpm-package-key.gpg
save and close
The setenforce 0command disablesSELinuxtoallow containerstoaccessthe hostfile system(requiredby
podnetworks,forexample).
setenforce 0
yum install -y kubelet-1.11.1* kubeadm-1.11.1* kubectl-1.11.1*
systemctl enable kubelet && systemctl start kubelet
Ensure that the packagesdo not upgrade toa laterversionbyrunningthe followingcommandtodisable
the kubernetesyumrepo:
yum-config-manager --disable kubernetes*
#Some userson RHEL/CentOS7 have reportedissueswithtrafficbeingroutedincorrectlydue toiptables
beingbypassed.To avoidthisproblem, runthe followingcommandstoensure thatnet.bridge.bridge-nf-
call-iptablesissetto1 in yoursysctl config:
vi /etc/sysctl.d/k8s.conf
add
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
save and close
sysctl –system
Initializing Master(on Master)
UsingCalicoas pod networkaddon
kubeadm init --kubernetes-version=v1.11.1 --pod-network-
cidr=192.168.0.0/16
ATTENTION:Copyout kubeadmjoincommand - will be neededlater!
(kubeadmjoinIP_ADDR:6443--tokeneuh9gv.a3hjyafpplr88t8q --discovery-token-ca-cert-hash
sha256:4ea5cda8d56a8907644965e6bc8a4e41ebb4028eaa9c8bb5c92357003fab6f71)
mkdir -p $HOME/.kube

5. sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config
Install apod networkadd-on(here Calico)sothatyour podscan communicate witheachother.
kubectl apply -f https://docs.projectcalico.org/v3.1/getting-
started/kubernetes/installation/hosted/rbac-kdd.yaml
kubectl apply -f https://docs.projectcalico.org/v3.1/getting-
started/kubernetes/installation/hosted/kubernetes-datastore/calico-
networking/1.7/calico.yaml
Join Workers(on WorkerNodes)
Run the commandyou copiedonbothWorkers
kubeadm join IP_ADDR:6443 --token euh9gv.a3hjyafpplr88t8q --discovery-
token-ca-cert-hash
sha256:4ea5cda8d56a8907644965e6bc8a4e41ebb4028eaa9c8bb5c92357003fab6f71
checksuccesson masterwith:
kubectl get nodes
copy the Master configurationtothe Workernodes
mkdir-p$HOME/.kube
scp root@IP_ADDR:$HOME/.kube/config$HOME/.kube
sudochown$(id -u):$(id -g) $HOME/.kube/config
InstallHelm (on Master)
wget https://storage.googleapis.com/kubernetes-helm/helm-v2.11.0-linux-
amd64.tar.gz
tar -zxvf helm-v2.11.0-linux-amd64.tar.gz
sudo mv linux-amd64/helm /usr/local/bin/helm
helm init
kubectl create clusterrolebinding add-on-cluster-admin --
clusterrole=cluster-admin --serviceaccount=kube-system:default
sudo rm -f helm-v2.11.0-linux-amd64.tar.gz
Testenvironment(everypodshouldbe running):
kubectl get pods -n kube-system
CreateConnectionsNamespace(on Master)
kubectl create namespace connections
InstallDockerRegistry (on Master)
Create directories:
mkdir /docker-registry
mkdir /docker-registry/{auth,certs,registry}
Create passwordfile:

6. docker run --entrypoint htpasswd registry:2 -Bbn admin mypassword >
/docker-registry/auth/htpasswd
Create self signedcerts:
openssl req -newkey rsa:4096 -nodes -sha256 -keyout key.pem -x509 -days
3650 -out cert.pem
Copycert and keyto dockerdirectory:
cp key.pem cert.pem /docker-registry/certs
Create directoriesonall machinesincluster:
mkdir /etc/docker/certs.d
mkdir /etc/docker/certs.d/soc.yourserver.com:5000/
Copycert to dockerdir:
cp cert.pem /etc/docker/certs.d/soc.yourserver.com:5000/ca.crt
SCPthe cert fromthe dockerregistrymachine toall othermachinesinthe kubernetescluster:
scp cert.pem
soc1.yourserver.com:/etc/docker/certs.d/soc.yourserver.com:5000/ca.crt
scp cert.pem
soc2.yourserver.com:/etc/docker/certs.d/soc.yourserver.com:5000/ca.crt
Create registry:
docker run -d -p 5000:5000 --restart=always --name registry -v /docker-
registry/auth:/auth -v /docker-registry/certs:/certs -v /docker-
registry/registry:/var/lib/registry -e "REGISTRY_AUTH=htpasswd" -e
"REGISTRY_AUTH_HTPASSWD_REALM=Registry Realm" -e
"REGISTRY_AUTH_HTPASSWD_PATH=/auth/htpasswd" -e
"REGISTRY_HTTP_TLS_CERTIFICATE=/certs/cert.pem" -e
"REGISTRY_HTTP_TLS_KEY=/certs/key.pem" registry:2
Verify:
docker login -u admin -p mypassword soc.yourserver.com:5000
create image pull secret
kubectl create secret docker-registry myregkey -n connections --docker-
server=soc.yourserver.com:5000 --docker-username=admin --docker-
password=mypassword
Createpersistantvolumes(on Master/NFS Server)
Note:this is validfor PoCinstallationsand not for production.In production, it isbest practice to have
the NFSshare on a storage serverthat is not part of the Kubernetescluster,but for a proof of concept,
non-HA deployment,itisacceptable to host the NFSshare on your Kubernetesmaster.
sudo mkdir -p /pv-connections/esdata-{0,1,2}
sudo mkdir -p /pv-connections/esbackup
sudo mkdir -p /pv-connections/customizations

7. sudo mkdir -p /pv-connections/mongo-node-{0,1,2}/data/db
sudo mkdir -p /pv-connections/solr-data-solr-{0,1,2}
sudo mkdir -p /pv-connections/zookeeper-data-zookeeper-{0,1,2}
sudo chmod -R 777 /pv-connections
unzip -p hybridcloud_20180925-031433.zip
microservices_connections/hybridcloud/support/nfsSetup.sh > nfsSetup.sh
unzip -p hybridcloud_20180925-031433.zip
microservices_connections/hybridcloud/support/volumes.sh > volumes.sh
If you needonlyafewcomponentschange the volumes.txtin
extractedFolder/microservices_connections/hybridcloud/support
cd /root/cp6006/microservices_connections/hybridcloud/support/
sudo bash nfsSetup.sh
to checkcreatedsharesrun
sudo cat /etc/exports
Install persistentvolumesusingHelm
helm install --name=connections-volumes
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/connections
-persistent-storage-nfs-0.1.0.tgz --set nfs.server=IP_ADDR
extractedFolder/microservices_connections/hybridcloud/helmbuilds/connecti
ons-persistent---set
solr.enabled=false,zk.enabled=false,mongo.enabled=false,customizer.en
abled=false,nfs.server=IP_ADDR
Labeling and tainting workernodesforElasticsearch (on Master)
Get listof available nodes
kubectl get nodes
run commandwithnode name added
kubectl label nodes soc2.yourserver.com type=infrastructure --overwrite
kubectl taint nodes soc2.yourserver.com
dedicated=infrastructure:NoSchedule –overwrite
Pushing theimagesto theDockerregistry (on Master)
cd /root/cp6006/microservices_connections/hybridcloud/support
./setupImages.sh -dr soc.yourserver.com:5000 -u admin -p mypassword -st
customizer,elasticsearch,orientme
Bootstrapping theKubernetescluster(on Master)
BootstrappingaKubernetesclusterperformsthe followingtasks:vValidatesthe Kubernetesconfiguration
/ Createsthe requiredKubernetessecrets/Createsthe requiredIBMConnectionscertificates/Configures
Redisforuse by the OrientMe component

8. /root/cp6006/microservices_connections/hybridcloud/helmbuilds/bootstrap-
0.1.0-20180924-133245.tgz --set
image.repository="soc.yourserver.com:5000/connections",env.set_ic_admin_u
ser=wasadmin,env.set_ic_admin_password=YOUR_PASSWORD,env.set_ic_internal=
con.yourserver.com,env.set_master_ip=IP_ADDR,env.set_elasticsearch_ca_pas
sword=mypassword,env.set_elasticsearch_key_password=mypassword,env.set_re
dis_secret=mypassword,env.set_search_secret=mypassword,env.set_solr_secre
t=mypassword
Checksuccess(Shouldshow"Complete")
kubectl get pods -n connections -a | grep bootstrap
RestartCommonand NewsapplicationonConnectionsServer

9. Installing the Component Pack
Installing theComponentPack'sconnections-env(on master)
helm install --name=connections-env
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/connections
-env-0.1.40-20180919-173326.tgz --set
createSecret=false,ic.host=con.yourserver.com,ic.internal=con.yourserver.
com
verifywith(shouldshowdeployed):
helm list
Installing theComponentPack'sinfrastructure(on master)
helm install --name=infrastructure
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/infrastruct
ure-0.1.0-20180925-030258.tgz --set
global.onPrem=true,global.image.repository=soc.yourserver.com:5000/connec
tions,mongodb.createSecret=false,appregistry-
service.deploymentType=hybrid_cloud
verifywith(shouldshowdeployed):
helm list
and (cantake upto 10 minutesforall podstocome up):
kubectl get pods -n connections
Installing theComponentPack'sOrientMe(on master)
helm install --name=orientme
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/orientme-
0.1.0-20180925-030334.tgz --set
global.onPrem=true,global.image.repository=soc.yourserver.com:5000/connec
tions,orient-web-client.service.nodePort=30001,itm-
services.service.nodePort=31100,mail-
service.service.nodePort=32721,community-
suggestions.service.nodePort=32200
verifywith(shouldshowdeployed):
helm list
and (cantake upto 10 minutesforall podstocome up):
kubectl get pods -n connections
Installing theComponentPack'sElasticSearch (on master)
helm install --name=elasticsearch
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/elasticsear
ch-0.1.0-20180921-115419.tgz --set
image.repository=soc.yourserver.com:5000/connections,nodeAffinityRequired
=true
verifywith(shouldshowdeployed):
helm list
and (cantake upto 10 minutesforall podstocome up):

10. kubectl get pods -n connections
Installing theComponentPack'sCustomizer(on master)
helm install --name=mw-proxy
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/mw-proxy-
0.1.0-20180924-103122.tgz --set
image.repository=soc.yourserver.com:5000/connections,deploymentType=hybri
d_cloud
verifywith(shouldshowdeployed):
helm list
and (cantake upto 10 minutesforall podstocome up):
kubectl get pods -n connections
Installing theDasboardsforformonitoring and logging (on master)
mkdir /opt/kubernetes-dashboard
create keys
openssl req -nodes -new -x509 -keyout /opt/kubernetes-
dashboard/dashboard.key -out /opt/kubernetes-dashboard/dashboard.crt -
subj "/CN=dashboard"
kubectl create secret generic kubernetes-dashboard-certs --from-
file=/opt/kubernetes-dashboard -n kube-system
kubectl apply -f
https://raw.githubusercontent.com/kubernetes/dashboard/master/src/deploy/
recommended/kubernetes-dashboard.yaml
kubectl apply -f
/root/cp6006/microservices_connections/hybridcloud/support/dashboard-
admin.yaml
kubectl patch svc kubernetes-dashboard -n kube-system -p
'{"spec":{"type": "NodePort"}}'
kubectl create -f
https://raw.githubusercontent.com/kubernetes/heapster/master/deploy/kube-
config/influxdb/grafana.yaml
kubectl create -f
https://raw.githubusercontent.com/kubernetes/heapster/master/deploy/kube-
config/influxdb/heapster.yaml
kubectl create -f
https://raw.githubusercontent.com/kubernetes/heapster/master/deploy/kube-
config/influxdb/influxdb.yaml
kubectl create -f
https://raw.githubusercontent.com/kubernetes/heapster/master/deploy/kube-
config/rbac/heapster-rbac.yaml
nohup kubectl proxy --address=159.8.241.236 -p 443 --accept-hosts='^*$' &

11. Verifywith
http://IP_ADDR:443/api/v1/namespaces/kube-
system/services/https:kubernetes-dashboard:/proxy/
Installing theComponentPack'sSanity Dashboard (on master)
helm install --name=sanity
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/sanity-
0.1.8-20180924-121014.tgz --set
image.repository=soc.yourserver.com:5000/connections
Get the applicationURLby runningthese commands:
export NODE_PORT=$(kubectl get --namespace connections -o
jsonpath="{.spec.ports[0].nodePort}" services sanity)
export NODE_IP=$(kubectl get nodes --namespace connections -o
jsonpath="{.items[0].status.addresses[0].address}")
echo http://$NODE_IP:$NODE_PORT
helm install --name=sanity-watcher
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/sanity-
watcher-0.1.0-20180830-052154.tgz --set
image.repository=soc.yourserver.com:5000/connections
Installing theComponentPack'sElasticStack (on master)
helm install --name=elasticstack
/root/cp6006/microservices_connections/hybridcloud/helmbuilds/elasticstac
k-0.1.0-20180925-030346.tgz --set
global.onPrem=true,global.image.repository=soc.yourserver.com:5000/connec
tions
Accessingthe KibanaDashboard
Opena browserandnavigate to
https://soc.yourserver.com:32333
FirstTime Setup: Enter ‘comppackk8s-*’asthe index name orpatternand click‘Create’