DIH in solrcloud(Apache Solr Operator) mode with Solr 8.11.2

[iampranabroy]

Is there any documentation on DIH in SolrCloud mode for version > 8.11.0

Is data-import-handler-8.10.0.jar the only lib we need to include in solrconfig.xml? I don't see any data-import-handler-extras jar

We are trying to use DIH with SolrCloud(Apache Solr Operator) on EKS.

[iampranabroy]

Hello, @rohitbemax @rmuir @jdyer1 @uschindler @markrmiller - Would you have any pointers on this? thanks in advance

[odiloRugamba]

Hello @iampranabroy did you figure this out?

[iampranabroy]

Hey @odiloRugamba - We used the default bundled DIH with solr image and used it like below in the solrconfig.xml file.

<lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-dataimporthandler-.*\.jar" />

But the documentation on DIH use with SolrCloud mode would definitely help.

[mHz28]

Hey @odiloRugamba - We used the default bundled DIH with solr image and used it like below in the solrconfig.xml file.

<lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-dataimporthandler-.*\.jar" />

But the documentation on DIH use with SolrCloud mode would definitely help.

I've used this when I attempted to use DIH on SolrCloud: https://solr.apache.org/guide/8_11/package-manager.html

However, when I made a mistake, need to change package repo uri, replace packages, etc I have not figured how to do it other than rebuilding the servers...

[ghost]

@iampranabroy did you manage to fix this problem? I'm trying to do the same but not successfull so far. I get The following errors:
Always:
ERROR: Full Import failed

WARN: Could not read DIH properties from /configs/<COLLECTION_NAME>/dataimport.properties : class org.apache.zookeeper.KeeperException$NoNodeException

Sometimes:
JdbcDataSource was not closed prior to finalize(),​ indicates a bug -- POSSIBLE RESOURCE LEAK!!!

In our old setup, which is Solr 8.11.2 in normal mode, a separate sqljdbc.jar is used, however I don't know why and if this also should be used in Cloud mode.

[iampranabroy]

Hey @ilivss - As mentioned we have used the default DIH provided till version 8.xx

<lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-dataimporthandler-.*\.jar" />

For your problem, it looks more like an issue with the config. Can you check if the config is loaded and when you create the collection, you are using that config to create the collection? When DIH runs for the first time, if all properties/configs are correct, it should create dataimport.properties file.

Also, can you check if you are able to load your custom sqldriver. jar from the solrconfig.xml properties file?
Example: If you sqldriver.jar is in tmp/solr/lib path by using.

<lib dir="/tmp/solr/lib/" regex="sqldriver.jar" />

[ghost]

I read your comment too late unfortunately. for the time being I just deployed Solr 8.11.2 standalone mode in a normal Azure VM. Anyway thanks for your help! @iampranabroy

[mkhludnev]

can we close this issue?