Setup Docker slaves for Jenkins




Jenkins is the one of the primary CI tool used in industry. Jenkins provide on cross planform support and have master-slave configuration. Your slave could be any operating system. Recently docker is becoming very popular for replacement of virtualisation up to some extend.

Today I will detail out the steps needed to make dynamically slave provision via docker images.

Setting up Host for Docker
  • You need to have your base machine either VM or hypervisor etc and need to install with all prerequisite. Lets install docker now.
curl -sSL https://get.docker.com/ | sh
  • Once docker is installed, you need to perform some configuration Like
    • Add the jenkins user to docker group, so that jenkins user should be able to run docker command with proper permission and access.
sudo usermod -aG docker jenkins
·       Now, we need to configure the docker host so that jenkins can connect to the  docker host and to access it to launch the docker container. You can select any port you want (make sure it is not conflicting with any other application).

vi /etc/default/docker
Add following value in DOCKER_OPTS

-H tcp://0.0.0.0:6789

Your complete entry of might look like this (you may have some more info for your docker registry depending upon your requirement).

DOCKER_OPTS="--ipv6=false -H tcp://0.0.0.0:6789 -H unix:///var/run/docker.sock



Now, restart the docker by "service docker restart" to load above configuration.

Docker Image (Dockerfile).
Now you need to create your Dockerfile to create image of your docker slave.
Here is my basic docker file, Your file may be little different than this.

FROM evarga/jenkins-slave
#Getting image from evarga repo

ENV DEBIAN_FRONTEND noninteractive

RUN apt-get update -qq && apt-get install -qqy \
    apt-transport-https \
    ca-certificates \
    curl \
    lxc \
    iptables && \
    rm -rf /var/lib/apt/lists/*

RUN echo deb https://apt.dockerproject.org/repo ubuntu-trusty main > /etc/apt/sources.list.d/docker.list && \
    apt-key adv --keyserver hkp://p80.pool.sks-keyservers.net:80 --recv-keys 58118E89F3A912897C070ADBF76221572C52609D

ENV DOCKER_VERSION 1.8.1-0~trusty

# Install Docker from Docker Inc. repositories.
RUN apt-get update && apt-get install -y docker-engine=$DOCKER_VERSION && rm -rf /var/lib/apt/lists/*

ADD wrapdocker /usr/local/bin/wrapdocker
RUN chmod +x /usr/local/bin/wrapdocker
VOLUME /var/lib/docker

RUN apt-get update && apt-get install -y software-properties-common python-software-properties && add-apt-repository ppa:webupd8team/java && apt-get update 

RUN echo oracle-java8-installer shared/accepted-oracle-license-v1-1 select true | /usr/bin/debconf-set-selections
RUN apt-get install -y oracle-java8-installer  oracle-java8-set-default
RUN echo 'JAVA_HOME=/usr/lib/jvm/java-8-oracle' >> /etc/environment

# Make sure that the "jenkins" user from evarga's image is part of the "docker"
RUN usermod -a -G docker jenkins
#You can have your own user and add it here, change the permission as above

#Just to make sure we have password less access from VM to docker

RUN echo "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDT4/OlCjMDacPyYvJfnBQhIRg4ldRZ7fxB7Eoa7sJgKQnV/qP2Gg29tPUb3g1k/xWmOoTOBi6XWMAaFACtYEy0vfMRkRhfEMpzmx0hSfi2jkssKJvei50wCe04t5KqY7xxgnMbRqf+XOnnQRjbwLFM9r1wgk4wR7HeE+D25hS19O7pKxAr8ByCmF3UQ4/zdvsA/gDky31E+mU01bGKgiNSBTZbXM1g48TnkvZuS/sN0uxznucx7Y61TeLz4r/nZiK18f0BNDj3AXTZQBgbwvYP0hYmf1/9ajl03fn4orjChHk58dcR8oA5VzV4rCVeu2VLEXjnoTYfuQhiD jenkins@7213637c0b2c" >> /home/jenkins/.ssh/authorized_keys

#making sure, it has sudo access (if you want)
RUN echo "jenkins  ALL=(ALL) NOPASSWD:ALL" >> /etc/sudoers

#RUN mkdir /home/releasebot/

# place the jenkins slave startup script into the container

ADD slave-startup.sh /

# Expose the standard SSH port
EXPOSE 22

CMD ["/slave-startup.sh"]


Docker file is pretty must very clear and straight forward. Only tips
·       You can add other tools installation as part of default docker image.
·       slave-startup.sh is added which can be used to start ssh demon and wrapdocker like below
#!/bin/bash
# start the docker daemon
/usr/local/bin/wrapdocker &
# start the ssh daemon
/usr/sbin/sshd -D

 Go ahead build the image and upload it to your private repository or any where you want to. 

Jenkins Configuration


Lets look at jenkins configuration
  • Please install the following docker plugin in your jenkins.

https://wiki.jenkins-ci.org/display/JENKINS/Docker+Plugin
  • Once you install the plugin, you will befollowing option under configuration page.
You will see Docker option in cloud like this


Select the docker and fill the detail 



Here are the detail
  1. Name - > You can give any name for your cloud.
  2. Docker URL -> this is the URL of your Host where you have configured the Docker as mentioned in 1st section .
  3. Docker Image -> This is the connection URL and name of your docker image which you have created in 2nd section. If you are using private registry, You will need to take care of URL and image name.
  4. Volumes -> You can skip this part, But as complete setup i feel its needed, This section will tell you what directories to be mounted inside docker from host. This is important to keep configuration in centralise place so that docker can use them, Like .m2 folder and configurations.
Test the configuration using "Test Connection" button.
Remaining documentation can be found on jenkins plugin wiki page, https://wiki.jenkins-ci.org/display/JENKINS/Docker+Plugin 

Comments

Post a Comment

Popular posts from this blog

Colour formatting - Jenkins Console

Image
Jenkins is the main CI tool used in Software industry. This is the backbone tool for all CI and CD implementation, Build - release and deployment methods. With the help of 100s of plugin available around the jenkins, We can achieve so much of automation around build process including build/deployment pipeline, notification, analysis, pre and post build action etc. Jenkins has tremendous power to perform great amount of work around the core build process. Many time we write script in pre and post build action to perform many tasks which is becoming very command and necessary for automation. But the main limitation in running shell script is that it's very difficult to make it more human readable for errors and make it fancy. Today i am going to cover some steps to make the output of shell script colour formatted. Jenkins Configuration Steps First install following jenkins plugin https://wiki.jenkins-ci.org/display/JENKINS/AnsiColor+Plugin Go to jenkins configurati
Read more

Manage Docker images on local disk

Docker is very powerful containerization technique, and it is becoming famous in short time. People are adapting and containerizing their applications for deployment. Soon container become very heavy and consume too much of disk space, If you do not delete old images and layers you may soon run out of disk space. Here i am trying to cover the ways to regain the disk space consumed by docker images. Moving docker filesystem to bigger mount point. Usually docker keeps all temporary files related to image building and layers at /var/lib/docker This path is local to the system usually at root partition "/" . You can mount a bigger disk space and move the content of /var/lib/docker to the new mount location and make sym link.  This way even docker images occupy space, will not affect  your system as it will be using some other mount location. Remove Old docker images Here are few ways to remove old and unused docker images Removing stopped contai
Read more

How to migrate Parent pom from maven to gradle

Convert Maven parent/super pom to Gradle init file When you think of moving to gradle for some reason from maven, You need to take care of lot of stuff around it, You can find lot of tools and help to convert maven pom.xml to gradle build.gradle But one of the most important task as an engineer or architect would be to convert your super pom (or parent pom) in to gradle init scripts. Gradle init script provides same functionality as Maven super/parent pom. The basic difference is that you can call init script Run time As many as of them This gives us flexibility to change the init script on run time but doubt of not tracking the changes.
Read more