Setup Flyway,Postgres in Jenkins using Docker

  • Recently I was trying to setup Flyway on Jenkins for my db in Postgres.
  • The required files can be found here
  • The basic files you will need will be 
    • The configuration file in conf folder
    • The sql files in the sql folder
    • The pipeline file "jenkinsfile-2"
  • Here is the sample configuration file
    •  flyway.url= jdbc:postgresql://localhost:5432/flyway  
 flyway.user = postgres  
 flyway.password = postgres  
 flyway.schemas= flyway  
 flyway.locations=filesystem:../sql  
 flyway.driver=org.postgresql.Driver
  • Create DB Credentials in Jenkins with ID  "db-creds"
    • We are using this in our sample you may change it but be sure to change it in jenkins pipeline file too.
  • Here is the sample jenkins pipeline file
  • My postgres is installed on localhost so I am using "--network=host" in my docker command for example
    •  docker run --rm --network=host -v /var/lib/jenkins/workspace/flyway/jenkins_flyway/sql:/flyway/sql -v /var/lib/jenkins/workspace/flyway/jenkins_flyway/conf:/flyway/conf flyway/flyway:8.5.1 -user=postgres -password=postgres migrate
    • If your postgres is running from a docker container you may not use this.
    • Also if you have mapped 5432 in PostgreSQL to 5432 on the host then you should use this.
  • Issues Faced
    • The first Issue I faced was ERROR: No database found to handle "jdbc:postgresql://localhost:5432/mydb"
      • To rectify this make sure you have written the configuration file exactly as above. I was using values in quotes.
    • The second Issue I faced was Connection to localhost:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.
      • To rectify this I modified following properties in my postgresql.conf file
        • listen_addresses = '*'
      • And added following line in my postgres pg_hba.conf file
        • host    all             all             192.168.1.0/24          md5
    • Jenkins is not able to access Docker
      • Add Jenkins user to docker group using following command
        • sudo usermod -a -G docker jenkins
    • Permission issues
      • sudo usermod -a -G usergroup jenkins
        • add jenkins to your usergroup so that it can access your workspace
      • sudo usermod -a -G usergroup docker
        • add docker to your usergroup so that you can execute docker without sudo permission from jenkins.

Comments

Post a Comment

Popular posts from this blog

Docker

  What are the various commands of docker file? From It defines which image to download and start from. Entry point Specifies the starting of expression to use when starting your container. CMD Command specifies the whole command to run. ADD When we want to add some files ADD statement is used. Add new files from system to the file system of image, example local files: ADD run.sh/ run.sh Tar Archieves : ADD project tar. COPY Copy the current directory contains into a container at current directory. Copy Between different environments Dev/Stage/Prod etc. What is bind mount? They will rely on host machine operating system and directory structure. A route from host computer must be supplied. What is docker persistent volume? Docker volumes provide persistent storage.Docker manages data separately.This can be shared with multiple containers separately.CLI can access docker volume. What is docker Prune command? Docker prune command Is used to Remove all containers, network images, et ce...
Read more

Jenkins

In How many ways can we launch an agent in Jenkins? Launch agent by connecting it to master. Agent Connects to master Launch agent via SSH Controller initiates the connection to the SSH. How do we login into AWS? How do we pass and login AWS in Jenkins pipelines or Jenkins file? We can use assume role and get credentials. We can use AWS plug-in to configure cloud. In the cloud, we can provide our AWS access key or secret key. We can add our EC2 End point, region, et cetera Now in Jenkins credential provider, we can give our username and provide key credentials. This will give us a credential ID. We can use this credential ID in Jenkins pipelines. Can we write git clone in pipeline? No, we can use checkout instead. What is the difference between scripted and declarative pipeline? Declarative pipelines uses declarative model and scripted uses imperative model.Declarative breaks the stages into multiple steps.Scripted Does not require this. Scripted pipelines permit developer to inject a ...
Read more