Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DuckDB integration does not use published wheel on Astro runtime #1961

Open
jeremybeard opened this issue Jun 8, 2023 · 0 comments
Open

Comments

@jeremybeard
Copy link

Describe the bug
When building an Astro runtime image with the Astro SDK DuckDB submodule the published DuckDB wheel is not used and instead it is compiled locally, which takes many minutes and also requires installing the gcc compiler on the image.

Version

  • Astro SDK: 1.6.1
  • Astro runtime: 8.4.0
  • OS: macOS

To Reproduce
Steps to reproduce the behavior:

  1. Create a new Astro CLI project with astro dev init
  2. Modify requirements.txt to have the line astro-sdk-python[duckdb]==1.6.1
  3. Modify packages.txt to have the line g++ (gcc is required to build the wheel)
  4. Start the Airflow instance with astro dev start
  5. See that it takes ~5 minutes to build the DuckDB wheel

Expected behavior
The published DuckDB wheels to be used instead of building it locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant