Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

make s3 aiori that uses the official s3 c api #442

Open
glennklockwood opened this issue Nov 3, 2022 · 6 comments
Open

make s3 aiori that uses the official s3 c api #442

glennklockwood opened this issue Nov 3, 2022 · 6 comments

Comments

@glennklockwood
Copy link
Contributor

It looks like both our S3 backends use libraries that are no longer being maintained. Fortunately, AWS now has an "official" C API: https://github.com/awslabs/aws-c-s3

For sustainability, we should probably migrate to that and retire out the other two flavors of S3 support at some point.

@JulianKunkel
Copy link
Collaborator

Sounds great, indeed! Will work on it in time.

@JulianKunkel
Copy link
Collaborator

The library dependencies are an absolute atrocity.

@glennklockwood
Copy link
Contributor Author

That's too bad. Should we close this or leave it on the backlog?

@JulianKunkel
Copy link
Collaborator

I actually started to work on it: aws-s3-branch
At least the script to compile the dependencies somehow works.
The status of the branch is:

  1. Script to compile the s3 depencency
  2. Integration of the new module into the compilation cycle
  3. Tested initialization - found a bug in AWS-S3 which is resolved

I would be, of course, happy if someone had time to proceed - I will try to do it in Q1, as S3 is very important to me.

@matthewcurry
Copy link

I am currently very interested in this feature, and may pick up the work on it myself if nobody else is pursuing it. @JulianKunkel , I assume your branch is the place to start?

@JulianKunkel
Copy link
Collaborator

@matthewcurry that sounds great, I didn't have the need to proceed in Q1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants