Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Align from last SingleStore's deployment-docker updates #14

Open
wants to merge 291 commits into
base: master
Choose a base branch
from

Conversation

guyhaim1983
Copy link

No description provided.

Cheng Chen and others added 30 commits November 29, 2022 03:08
Summary: Bump SERVER_VERSION to 7.8.19-4263b2d130

Test Plan: n/a

Reviewers: adam, ymolinar, dcohen, tgummalla, adepompa, eli, rodrigo, mgiannakopoulos

Reviewed By: rodrigo

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60123
Summary: n/a

Test Plan: n/a

Reviewers: lneves, fmagalhaes

Reviewed By: fmagalhaes

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60127
Summary:
Update Toolbox version to 1.14.2

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua, mshcherbina-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60130
Summary: n/a

Test Plan: n/a

Reviewers: lneves, davidgomes

Reviewed By: davidgomes

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60243
Test Plan: N/A

Reviewers: adam

Reviewed By: adam

Subscribers: eli, mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60253
Summary:
Update version to 1.14.3

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: mshcherbina-ua, pmishchenko-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60293
Summary:
Update packages to fix vulnerabilities

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua, mshcherbina-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

JIRA Issues: PLAT-6412

Differential Revision: https://grizzly.internal.memcompute.com/D60390
Summary:
Incremental Toolbox version update

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua, mshcherbina-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60377
Summary:
Also adds 7.8 as a target now that latest is 8.0. Copied from: https://grizzly.internal.memcompute.com/D55998

**Design doc/spec**:
**Docs impact**: none

Test Plan: n/a

Reviewers: adam, adepompa, ymolinar, dcohen, davidgomes, fmagalhaes, eli

Reviewed By: adam

Subscribers: jmonteiro, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60403
Summary: n/a

Test Plan: n/a

Reviewers: davidgomes

Reviewed By: davidgomes

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60440
Summary: Updated Makefile for 7.8.20.

Test Plan: n/a

Reviewers: adam, ymolinar, dcohen, tgummalla, adepompa, eli, rodrigo, mgiannakopoulos

Reviewed By: adam, mgiannakopoulos

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60521
Summary: As title.

Test Plan: N/A

Reviewers: adam, ymolinar, dcohen, adepompa, eli, rodrigo, mgiannakopoulos

Reviewed By: adam, mgiannakopoulos

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60551
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli

Reviewed By: mgiannakopoulos

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60565
Summary:
We missed doing this.  Alex did part of it when adding 8.0 here (https://grizzly.internal.memcompute.com/D60403), but forgot the .yml file change so we can't relase 7.8 node images.
When we released 7.8.20 we didn't add it either (https://grizzly.internal.memcompute.com/D60521) so we don't have a 7.8.20 node imaged published right now.

I'm following the wiki on adding this (it said to do the same thing as this diff): https://grizzly.internal.memcompute.com/D50082 which add 7.3.

I'm not 100% sure how to kick off circle again for 7.8 so we can release it.

**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: davidgomes, mgiannakopoulos, ymolinar, asteere

Reviewed By: davidgomes

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60566
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, adam

Reviewed By: adam

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60610
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, rodrigo

Reviewed By: mgiannakopoulos, ymolinar

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60632
Summary:
Update libraries to fix vulnerabilities

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

JIRA Issues: PLAT-6432

Differential Revision: https://grizzly.internal.memcompute.com/D60708
Summary:
**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes

Reviewed By: mgiannakopoulos

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60715
Summary:
**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: N/A

Reviewers: davidgomes

Reviewed By: davidgomes

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60746
Summary: Updated Makefile for new release

Test Plan: N/A

Reviewers: ymolinar, davidgomes, eli, rodrigo

Reviewed By: ymolinar

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60795
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, rodrigo

Reviewed By: mgiannakopoulos, ymolinar

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60810
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, rodrigo

Reviewed By: rodrigo

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60873
Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, rodrigo, adam

Reviewed By: adam

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60874
Summary:
Incremental verson update

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua, mshcherbina-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60872
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: none

Reviewers: mgiannakopoulos, ymolinar, davidgomes, eli, rodrigo

Reviewed By: mgiannakopoulos, davidgomes

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60980
… be built

Summary: Installing the jq package with the package manager

Test Plan: Tested on local-dev with debian 11

Reviewers: mduarte, pmagalhaes

Reviewed By: mduarte, pmagalhaes

Subscribers: noprysk-ua, vtkachuk-ua, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D60944
Summary:

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:
Test Plan:

Reviewers:

CC:

Jira issues:
This reverts commit 3177a54.
Mariia Shcherbina and others added 30 commits June 20, 2024 17:17
Summary: Update setting the java_pipelines_java11_path to point to the jre-11 path that we obtain from `update-alternatives` call the same way as we do for the java21 in a49c2e9

Test Plan:
1. `make build-dynamic-node` succeded, ran the image with 8.5 release
```
✓ Updated node config file for node with node ID A2244C12789F212D1269AEBBD1DF894567327436
memsqlctl will perform the following actions:
  · Update configuration setting on node with node ID A2244C12789F212D1269AEBBD1DF894567327436 on port 3306
    - Update node config file with setting java_pipelines_java11_path=/usr/lib/jvm/java-11-openjdk-11.0.23.0.9-3.el8.x86_64/bin/java

Would you like to continue? [Y/n]:
Automatically selected yes, non-interactive mode enabled
```
2. `make build-node`, verified the java11 path is set correctly

Reviewers: mlepekh-ua

Reviewed By: mlepekh-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68533
Summary: release 8.5.25 on deployment-docker

Test Plan: n/a

Reviewers: tvale

Reviewed By: tvale

Subscribers: eli, mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68643
Summary:
Release 8.1.47-2b9ce46bee and 8.7.3-fc40be0818 on deployment-docker

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: n/a

Reviewers: eli, ggudaru

Reviewed By: eli

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68717
Summary:
Update Toolbox version to 1.17.13

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: amakarovych-ua

Reviewed By: amakarovych-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68734
Summary: Add Java 21 to the CIAB docker image and automatically set the fulltext configuration variables with its path.

Test Plan:
Built and manually ran CIAB image.  Did some manual sanity testing using fulltext.

Also, `make test-ciab`.

Reviewers: eli, fmagalhaes, pmagalhaes

Reviewed By: pmagalhaes

Subscribers: engineering-list

JIRA Issues: DB-70913

Differential Revision: https://grizzly.internal.memcompute.com/D68750
Test Plan: verify by the reviewer

Reviewers: adrian, szupo

Reviewed By: szupo

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68770
Summary:
In commit eb4aeda, the 8.5 backports were set up with
`JRE_PACKAGES=java-1.8.0-openjdk` as a result java11 was not installed and
`java_pipelines_java11_path` will not be set
this diff sets the JRE packages for 8.5 to java-11-openjdk and also sets
JRE_PACKAGES="java-11-openjdk java-21-openjdk" for build-node-custom and build-node-cloud

Test Plan:
ci
https://app.circleci.com/pipelines/github/memsql/deployment-docker/752/workflows/feb877b5-a6a8-4684-a2b2-21a2a2474fe6

Reviewers: pvetere, mshcherbina-ua, chunwu

Reviewed By: pvetere

Subscribers: engineering-list

JIRA Issues: ECS-981

Differential Revision: https://grizzly.internal.memcompute.com/D68788
Test Plan: verify by reviewer

Reviewers: adrian, szupo, dhuang

Reviewed By: dhuang

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68793
Test Plan: verify by reviewer

Reviewers: dhuang

Reviewed By: dhuang

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68795
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: None

Reviewers: tavanesov-ua, jsherwood

Reviewed By: jsherwood

Subscribers: mduarte, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68846
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: None

Reviewers: jsherwood

Reviewed By: jsherwood

Subscribers: mduarte, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68856
Summary:
**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: None.

Reviewers: jsherwood

Reviewed By: jsherwood

Subscribers: mduarte, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68866
Summary:
Update Toolbox version to 1.17.14

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: circleCI

Reviewers: mshcherbina-ua, pmishchenko-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68882
Summary:
**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: None.

Reviewers: lzhang, eli, klung, szupo

Reviewed By: szupo

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D68966
Summary:
**Design doc/spec**:
**Docs impact**: none

Test Plan: None.

Reviewers: lzhang, eli, szupo, klung

Reviewed By: szupo

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69005
Test Plan: None.

Reviewers: lzhang

Reviewed By: lzhang

Subscribers: ggudaru, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69042
Test Plan: None.

Reviewers: lzhang

Reviewed By: lzhang

Subscribers: ggudaru, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69044
Test Plan: verify the release version by reviewer.

Reviewers: eli, habbasi, apipko-ua

Reviewed By: habbasi

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69090
Test Plan: inspected by the reviewers

Reviewers: habbasi, eli

Reviewed By: habbasi

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69107
Test Plan: visual inspection

Reviewers: cchen, jsherwood

Reviewed By: cchen

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69203
Summary: Just released a new 8.5 + 8.7

Test Plan: visual inspection

Reviewers: klung

Reviewed By: klung

Subscribers: eli, mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69322
Summary:
Updated Toolbox version in the deployment docker
Removed backup scripts from the tools image

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: circleCI

Reviewers: mshcherbina-ua, pmishchenko-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

JIRA Issues: PLAT-7162

Differential Revision: https://grizzly.internal.memcompute.com/D69411
Summary: Just released a new 8.1 + 8.7

Test Plan: visual inspection

Reviewers: klung, rodrigo, habbasi

Reviewed By: klung, habbasi

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69438
Summary: This diff updates the engine versions in `deployment-docker` for the new releases 8.7.12 and 8.0.34.

Test Plan: n/a

Reviewers: tavanesov-ua, xlin, eli

Subscribers: mojdeh, engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69475
Summary:
To run report script the `tools` container neede to have `aws` tool. The tool was removed from the image with the last Toolbox release. This fix adds it back.

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: pmishchenko-ua, mshcherbina-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69521
Summary:
Building and publishing node images is now integrated into freya. More details here https://memsql.atlassian.net/wiki/spaces/CLOUDINFRA/pages/3205103641/From+Deployment-Docker+to+Freya.

Deleting node-related logic as a part of transitioning to /memsql.

The only remaining logic is:
- releasing tools
- deprecated cluster-in-a-box

https://docs.google.com/document/d/139A3n_f8eu4DdgfqKjSN6hKxDdQ_vqvpCpTyQDEejB0/edit

https://app.circleci.com/pipelines/github/memsql/deployment-docker/773/workflows/f95716d3-b058-4f7b-bd18-5fd2123ec432

Test Plan: The remaining make commands worked.

Reviewers: fmagalhaes, mduarte

Reviewed By: fmagalhaes, mduarte

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69218
Summary:
Incremental version updates

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: mshcherbina-ua, pmishchenko-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69619
Summary:
**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: mshcherbina-ua

Reviewed By: mshcherbina-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69863
Summary:
Update workflow image, removed iab target

**Design doc/spec**:
**Docs impact**: none
**Preliminary Reviewer(s)**:
**Final Reviewer**:

Test Plan: CircleCI

Reviewers: mshcherbina-ua, pmishchenko-ua

Reviewed By: pmishchenko-ua

Subscribers: engineering-list

Differential Revision: https://grizzly.internal.memcompute.com/D69887
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.