Setup Devops in AWS

  • To set up and environment in CICD in In AWS, we require Following components
    • Application load balancer(ALB)
      • We create Different of ALB’s for frontend and backend Services.
    • For all the services(ECS) and ALB, we have only one security group.
  • Developers push their code on Code repository Like GitHub.
  • Each micro service has a docker file In its root directory, which is used to create a customised image Of that micro service Which is deployable and executable in All docker supported Environments.
  • We create a package, build an image using AWS code build Which reads instruction form a file In root directory Called as buildspec.yml.
  • We deploy image in ECS clusters using Pipeline.
  • We can define the CFT file of our ECS clusters, target service and cloud watch log groups.
    • We have details about the container, the taskdefinition, file, and details about services.
    • Under the ECS cluster, we have services under the services we have tasks.
      • The task is the image, deployed and container running the same.
    • Under the resources section, we have all the details related to the resources discussed above.
  • We require CFT’s For following other components which can be stored in S3 and letter, their path can be provided during resource formation from cloud formation.
    • Application load balancer
    • Pipeline of each service
    • The service which we have under ECS cluster.
  • When a developer pushes the code to GitHub The code build gets triggered Automatically and code Pipeline will then deploy that into ECS cluster.
    • Code build, pushes the image built to Jfrog repository.
    • Code pipeline Will take latest changes from jfrog repository And will deploy to ECS clusters.
  • Under the ECS clusters, we have services under the services we have tasks.
  • We need to create images for each environment.
  • We define Jfrog image location in service CFT
  • We have a CFT for code build, where we provide information like VPC configuration, subnets, And the environment like Linux, Windows, JVM, et cetera.
    • Source will have source of our code.
    • Trigger will have information regarding How build will trigger I.e. Which event like, push or pull request merged Et cetera.
    • Pattern will have information like on which branch when the code is deployed, the build should run.
  • We can define a separate file for CFT template parameters, which may change on basis of an environment or build.
  • In buildspec.yml We define values like variables, secrets Manager Variables, different phases etc.
    • We build the image.
    • We tag the image.
    • We push to Jfrog repository.
  • We should give port details of service to security group else we will get Unhealthy target.
  • In our load balancer, we should define rules that properly map context, Path and their forwarding to targets.
  • Tasks to be performed while creating devops from scratch.
    • Create multiple EC2 Instances based upon requirements from the application team.
    • Creation of IAM roles, policies, user groups, and cross account set up.
    • Creation of S3 buckets, policies for the application teams
    • Enable infrastructure creation using cloud formation templates.
  • AWS components AND methods mostly used
    • EC2, IAM, S3, code build, code commit, code deploy,code Pipeline, Cloud trail, cloud watch, ECS, ELB, AUTO SCALING, CLOUD FORMATION.
    • Kubernetes, Cluster creation, Master and worker nodes setup, replication enabling

Comments

Post a Comment

Popular posts from this blog

Setup Flyway,Postgres in Jenkins using Docker

Recently I was trying to setup Flyway on Jenkins for my db in Postgres. The required files can be found here https://github.com/gauravmatta/devops/tree/main/jenkins_flyway The basic files you will need will be  The configuration file in conf folder The sql files in the sql folder The pipeline file "jenkinsfile-2" Here is the sample configuration file flyway.url= jdbc:postgresql://localhost:5432/flyway flyway.user = postgres flyway.password = postgres flyway.schemas= flyway flyway.locations=filesystem:../sql flyway.driver=org.postgresql.Driver Create DB Credentials in Jenkins with ID  "db-creds" We are using this in our sample you may change it but be sure to change it in jenkins pipeline file too. Here is the sample jenkins pipeline file https://github.com/gauravmatta/devops/blob/main/jenkins_flyway/jenkinsfile-2 My postgres is installed on localhost so I am using "--network=host" in my docker command for example docker run --rm --networ...
Read more

Docker

  What are the various commands of docker file? From It defines which image to download and start from. Entry point Specifies the starting of expression to use when starting your container. CMD Command specifies the whole command to run. ADD When we want to add some files ADD statement is used. Add new files from system to the file system of image, example local files: ADD run.sh/ run.sh Tar Archieves : ADD project tar. COPY Copy the current directory contains into a container at current directory. Copy Between different environments Dev/Stage/Prod etc. What is bind mount? They will rely on host machine operating system and directory structure. A route from host computer must be supplied. What is docker persistent volume? Docker volumes provide persistent storage.Docker manages data separately.This can be shared with multiple containers separately.CLI can access docker volume. What is docker Prune command? Docker prune command Is used to Remove all containers, network images, et ce...
Read more

Jenkins

In How many ways can we launch an agent in Jenkins? Launch agent by connecting it to master. Agent Connects to master Launch agent via SSH Controller initiates the connection to the SSH. How do we login into AWS? How do we pass and login AWS in Jenkins pipelines or Jenkins file? We can use assume role and get credentials. We can use AWS plug-in to configure cloud. In the cloud, we can provide our AWS access key or secret key. We can add our EC2 End point, region, et cetera Now in Jenkins credential provider, we can give our username and provide key credentials. This will give us a credential ID. We can use this credential ID in Jenkins pipelines. Can we write git clone in pipeline? No, we can use checkout instead. What is the difference between scripted and declarative pipeline? Declarative pipelines uses declarative model and scripted uses imperative model.Declarative breaks the stages into multiple steps.Scripted Does not require this. Scripted pipelines permit developer to inject a ...
Read more