Migrate from travis to github actions

[akhilerm]

Currently all the openebs repositories use a combination of travis and github actions to build/test/push the container images. Eventually we need to move all the repositories from using travis to github actions.

operations that are done in travis:

• integration tests (using minikube)
• downstream repo tagging

Issues faced with github actions currently:

• not able to run minikube easily in github actions
• downstream repo release script need to be changed to github actions from travis.

[kmova]

Till we full setup integration tests with the github actions, we will continue to make use of travis.

To avoid travis and github actions conflicting with each other in pushing the images, here is a checklist for enabling multi-arch builds for an image.

• Make sure the travis images are built and pushed with arch suffix
• For the release tagged images, push the latest tag of amd64 build into quay.io
• Setup credentials on github actions to push multi-arch images to docker hub

[shubham14bajpai]

If we add arch suffix to the images which didn't have the earlier, this will require an upgrade for old pools and volumes which have deployments with older images.

[akhilerm]

@shubham14bajpai Can you link to the issues and PRs that you have created as part of the migration from travis to github actions?

[shubham14bajpai]

Issues and PRs for github actions
cstor-operators: openebs-archive/cstor-operators#223
cstor-csi: openebs-archive/cstor-csi#140
jiva-operators: openebs-archive/jiva-operator#28
upgrade: openebs-archive/upgrade#90

[akhilerm]

Dynamic Local PV: openebs/dynamic-localpv-provisioner#32. This PR also removes travis from the repository

[shubham14bajpai]

Zfs localpv openebs/zfs-localpv#293

[shubham14bajpai]

velero-plugin: openebs/velero-plugin#149

[akhilerm]

cstor: mayadata-io/cstor#330, The PR migrates tests and also handles downstream release tagging

[akhilerm]

libcstor: openebs-archive/libcstor#86

[shubham14bajpai]

Findings: Unlike travis which takes master as the current branch on PRs github actions use a specific branch called merge while executing the workflows

  Run make all.amd64 || exit 1;
  make all.amd64 || exit 1;
  shell: /bin/bash -e {0}
  env:
    MINIKUBE_HOME: /home/runner/work/_temp
    TAG: ci
    BRANCH: merge
--> cspc-operator image <--openebs/cspc-operator-amd64:ci
----------------------------
Building for merge-dev VERSION
==> Removing old directory...
==> Building cspc-operator using go version go1.15.8 linux/amd64... 

[shubham14bajpai]

We can use the github.base_ref to set tags the images as the version depends on the branch names in different branches.
ref: https://docs.github.com/en/actions/reference/context-and-expression-syntax-for-github-actions#github-context

[akhilerm]

The integration tests in github actions will use a separate build from the same source. This is because the build and test runs in separate jobs and we need to find a reliable way to transfer multiarch images from one job to another. Once this method for transferring artifacts is fixed, the following is the flow that we expect to achieve

Job 1,2,3... (The jobs where multiplatform images are built)

1. Build images
2. Push to local regsitry

Job X (integration tests)

1. Run minikube
2. Fetch images from local registry
3. Run integration tests using images from local registry
4. If test passes , push the images to dockerhub , quay etc.

[shubham14bajpai]

With github action moving to ubuntu 20.04 the iscsi_tcp modules are not loaded by default. We need to load the modules manually via modprobe to run the volumes.

[akhilerm]

Integration tests for all components has been now migrated to github actions.
List of repositories and associated PRs in which migration changes are added:

• cstor-operators: chore(actions): move travis tests to github actions openebs-archive/cstor-operators#223
• cstor-csi: chore(actions): move travis tests to github action openebs-archive/cstor-csi#140
• jiva-operators: chore(build): merge jiva-csi and jiva-operator repos openebs-archive/jiva-operator#28
• upgrade: Move e2e tests to github actions openebs-archive/upgrade#90
• node-disk-manager : feat(integration-test): migrate integration tests to github actions openebs-archive/node-disk-manager#548
• LVM Local PV: feat(action): migrating to github action from travis lvm-localpv#27
• Dynamic Local PV: chore(build): add support to push images to multiple registries dynamic-localpv-provisioner#32
• Zfs localpv chore(actions): move bdd tests to github actions zfs-localpv#293
• cstor: chore(build): migrate build from travis to github actions mayadata-io/cstor#330
• velero-plugin: chore(actions): move travis tests to github action velero-plugin#149
• libcstor: chore(workflow): migrate tests to github actions openebs-archive/libcstor#86