A migration to Github as your SCM for use with cdk-devsecops-cicd-pipeline

Sep 27, 2024 aws cdk python pipeline
Share on:

Moving from AWS CodeCommit to GitHub: A Seamless Integration for the AWS Sample -> DevSecOps Pipeline

As of June 6th, 2024 AWS CodeCommit was sunset. This left a lot of organizations and builders scrambling a bit to move their source control management provider to a new provider in relative short terms. AWS has provided guidance via a set of blog posts on moving your SCM: https://aws.amazon.com/blogs/devops/how-to-migrate-your-aws-codecommit-repository-to-another-git-provider/

In this post, we’ll walk through changing an existing pipeline to GitHub. This change integrates into your (new) development workflow but may simplify your repository management by leveraging GitHub’s widely adopted interface and collaboration tools. We’ll lose features like AWS IAM (Identity and Access Management) features, so if those are levied for provisioning your access to an existing AWS CodeCommit repository.. please be mindful of that.

The repository/example we’re working with

In this case, it is the cdk-devsecops-cicd-pipeline which is available here within the aws-samples repository: https://github.com/aws-samples/cdk-devsecops-cicd-pipeline

Key Changes to support Github (a new SCM)

1. Refactoring Repository Source

Prerequisites

  1. Add a Github connection via AWS CodeStar: https://docs.aws.amazon.com/codepipeline/latest/userguide/connections-github.html
  2. Reference the ARN of the connection below, in the constants.py file

Reference the pipeline.py file (commit shown below) along with the constants.py file (also shown below), to see the pipeline is modified to use GitHub as the source repository instead of AWS CodeCommit. This was done by switching from the code_commit source to GitHub’s connection via AWS CodeStar Connections.

pipeline.py constants.py

Before - pipeline.py:

1        repository = codecommit.Repository.from_repository_name(self, 'CodeCommitRepo', constants.CODECOMMIT_REPOSITORY_NAME)
2        source = pipelines.CodePipelineSource.code_commit(repository, branch='main')

After - pipeline.py:

1        #repository = codecommit.Repository.from_repository_name(self, 'CodeCommitRepo', constants.CODECOMMIT_REPOSITORY_NAME)
2        source = pipelines.CodePipelineSource.connection(
3            repo_string=constants.EXT_REPOSITORY_NAME,
4            branch=constants.EXT_REPOSITORY_BRANCH_NAME,
5            connection_arn=constants.EXT_REPOSITORY_CONNECTION_ARN,
6        )

We also need to specify the new variables, and be sure to comment out the previous CODECOMMIT_REPOSITORY_NAME:

Before: constants.py:

1        CODECOMMIT_REPOSITORY_NAME = "cdk-devsecops-cicd-pipeline"

After: constants.py:

1        # CODECOMMIT_REPOSITORY_NAME = "cdk-devsecops-cicd-pipeline"
2        EXT_REPOSITORY_NAME = "githubusername/example"
3        EXT_REPOSITORY_BRANCH_NAME = "main"
4        EXT_REPOSITORY_CONNECTION_ARN = ("arn:aws:codestar-connections:REGION:ACCT:connection/EXAMPLE")

In addition to this, we’ve bumped this repository to a new AWS-CDK version!

2. Upgrade to AWS CDK v2.160.0

We upgraded the AWS CDK version from 2.50.0 to 2.160.0, ensuring compatibility with the latest features and patches.

Before:

1"aws-cdk": "2.50.0"

After:

1"aws-cdk": "2.160.0"

This upgrade helps improve performance, adds new constructs, and keeps the pipeline up to date with the latest improvements.

3. Python Version Upgrade

We also updated the Python version from 3.7 to 3.11, ensuring better performance and security as well as access to the latest language features.

Before:

1CDK_APP_PYTHON_VERSION = "3.7"

After:

1CDK_APP_PYTHON_VERSION = "3.11"

Final Thoughts

Migrating the DevSecOps pipeline from AWS CodeCommit to GitHub was a necessary change, as AWS CodeCommit is now end of life. This provided an on-ramp via an aws-sample to utilize another supported SCM along with bumping the Python/AWS CDK version to support the latest features and runtime.