-
Notifications
You must be signed in to change notification settings - Fork 122
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
try different dependencies in attempt to resolve conflicts
Signed-off-by: Maroun Touma <touma@us.ibm.com>
- Loading branch information
Showing
12 changed files
with
81 additions
and
53 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
32 changes: 32 additions & 0 deletions
32
transforms/packaging/python/requirements.transforms.python.txt
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,32 @@ | ||
data-prep-toolkit>=0.2.1.dev3 | ||
bs4==0.0.2 | ||
#docling 1.9.0 depends on docling-parse<2.0.0 and >=1.1.3 | ||
#pdf2parquet depends on docling-parse==1.0.0 | ||
#docling 1.8.5 depends on docling-parse<2.0.0 and >=1.1.3 | ||
docling-parse>=1.0.0, | ||
# language/doc_chunk has conflict dependencies with pdf2parquet that need to be resolved | ||
# doc_chunk depends on docling>=1.8.2,<2.0.0 | ||
# pdf2parquet depends on docling==1.7.0 | ||
#docling==1.7.0, | ||
docling>=1.8.2,<2.0.0, | ||
llama-index-core>=0.11.1,<0.12.0, | ||
docling-core>=1.1.2,<2.0.0, | ||
quackling==0.1.1, | ||
# quackling will pull | ||
# docling>=1.8.2,<2.0.0 | ||
# llama-index-core<0.12.0,>=0.11.1 | ||
# docling-core<2.0.0,>=1.1.2 | ||
filetype >=1.2.0, <2.0.0 | ||
duckdb==0.10.1 | ||
fasttext==0.9.2 | ||
huggingface-hub >= 0.21.4, <1.0.0 | ||
langcodes==3.3.0 | ||
mmh3==4.1.0 | ||
numpy==1.26.4 | ||
pandas | ||
parameterized | ||
scancode-toolkit==32.1.0 ; platform_system != 'Darwin' | ||
sentence-transformers==3.0.1 | ||
transformers==4.38.2 | ||
xxhash==3.4.1 | ||
|
This file was deleted.
Oops, something went wrong.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,25 @@ | ||
data-prep-toolkit-ray>=0.2.1.dev3 | ||
data_prep_toolkit_transforms>=0.2.1.dev3 | ||
scancode-toolkit==32.1.0 ; platform_system != 'Darwin' | ||
parameterized | ||
tqdm==4.66.3 | ||
mmh3==4.1.0 | ||
xxhash==3.4.1 | ||
tqdm==4.66.3 | ||
#The conflict is caused by: | ||
# ray fdedup depends on scipy==1.12.0 | ||
# docling 1.7.0 depends on scipy<2.0.0 and >=1.14.1 | ||
scipy>=1.12.0 | ||
networkx==3.3 | ||
colorlog==6.8.2 | ||
func-timeout==4.3.5 | ||
pandas==2.2.2 | ||
emerge-viz==2.0.0 | ||
|
||
#Note: | ||
# when installing data-processing-library-ray, get the following | ||
# ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. | ||
# deepsearch-toolkit 1.0.0 requires platformdirs<4.0.0,>=3.5.1, but you have platformdirs 4.3.2 which is incompatible. | ||
|
||
|
||
|
This file was deleted.
Oops, something went wrong.