Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RANGER-3801: Add support for Ozone in docker #377

Merged
merged 5 commits into from
Sep 11, 2024

Conversation

kumaab
Copy link
Contributor

@kumaab kumaab commented Aug 25, 2024

What changes were proposed in this pull request?

  • Adds support for ozone services in ranger docker environment with ranger-plugin enabled for OzoneManager (OM) container.
  • A minimal setup for Ozone requires 1 OM, 1 SCM and 1 DataNode (see docker-compose.ranger-ozone.yml)
  • Updates the README for docker based setup to include Ozone.
  • Re-factor of download-archives.sh to allow specific downloads.
  • Creation of ozone service during ranger-admin startup.

How was this patch tested?

  • Verified setup_ozone
  • Verified containers come up with docker-compose -f docker-compose.ranger.yml -f docker-compose.ranger-postgres.yml -f docker-compose.ranger-ozone.yml up -d
  • Verified Ozone plugin installation in om container
  • Verified restart of om container, plugin installation is skipped!
  • Audits are flowing to Solr
  • Verified allow policy on a volume works for trino user.
  • Verified allow policy works for om user.
  • Verified deny works for root user.
Screenshot 2024-08-25 at 4 24 27 PM

@kumaab kumaab self-assigned this Aug 25, 2024
@kumaab kumaab force-pushed the RANGER-3801 branch 3 times, most recently from 22e78f5 to 0c239a9 Compare August 30, 2024 18:23
Copy link

@smengcl smengcl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kumaab ! lgtm (non-binding)


RUN useradd -g hadoop -ms /bin/bash ozone
RUN mkdir -p -m 755 /var/log/ozone
RUN chown om:om -R /var/log/ozone
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't the username be ozone, instead of om - refer to #26 above?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removed this, currently the process runs as root, will follow-up on this in another jira to run OzoneManager as hadoop.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

dev-support/ranger-docker/README.md Outdated Show resolved Hide resolved
dev-support/ranger-docker/README.md Show resolved Hide resolved
dev-support/ranger-docker/download-archives.sh Outdated Show resolved Hide resolved
@kumaab kumaab merged commit f49413f into apache:master Sep 11, 2024
3 checks passed
@kumaab kumaab deleted the RANGER-3801 branch September 11, 2024 06:07
mneethiraj pushed a commit that referenced this pull request Sep 20, 2024
Includes following changes:
- Add support for Ozone in docker with ranger-ozone plugin enabled
- Docker CI updated to include ozone containers
- download-archives.sh updated to allow download of specific service tarballs
- Updated docker README

(cherry picked from commit f49413f)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants