updating RAG example to use IBM granite model

[sujee]

Why are these changes needed?

Updating RAG example to use IBM Granite 3.0 model

Related issue number (if any).

[shahrokhDaijavad]

@sujee I am getting an error while running the ray version of the Notebook (rag_1A_dpk_process_ray.ipynb) about not finding pdf2parquet_transform_ray. I had no problem with the Python version of this notebook. Here is the error:

ModuleNotFoundError Traceback (most recent call last)
File :13

ModuleNotFoundError: No module named 'pdf2parquet_transform_ray'

[shahrokhDaijavad]

@sujee One more thing: In rag_1D_query_replicate.ipynb file, in "Step-6: Initialize LLM", please add the choice of IBM Granite as one of the models in the comments (I know that you are picking the Granite model for the actual execution).

[sujee]

@sujee I am getting an error while running the ray version of the Notebook (rag_1A_dpk_process_ray.ipynb) about not finding pdf2parquet_transform_ray. I had no problem with the Python version of this notebook. Here is the error:

ModuleNotFoundError Traceback (most recent call last) File :13

ModuleNotFoundError: No module named 'pdf2parquet_transform_ray'

If you have created a custom kernel when you setup the python env, like this

python -m ipykernel install --user --name=data-prep-kit --display-name "dataprepkit"

Choose this kernel in jupyter when running this notebook. See if it fixes the error.

[shahrokhDaijavad]

@sujee Thanks for the suggestion. I was using a conda env. So, I removed that env and created and activated a new env. That fixed the problem! In any case, since I have now tested successfully by going all the way through the rag_1D notebook by starting from either Python or Ray versions, I am ready to approve this, after you make the "one more thing" change above. Thanks.

[shahrokhDaijavad]

LGTM. Thanks, @sujee