Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

es-import-bulk says complete, but 0 object count in AWS ES #26

Open
dimisjim opened this issue Feb 20, 2019 · 1 comment
Open

es-import-bulk says complete, but 0 object count in AWS ES #26

dimisjim opened this issue Feb 20, 2019 · 1 comment

Comments

@dimisjim
Copy link

Hey there,

I am trying to use these tools, as they are much faster than elasticdump (thanks a lot for that!!), but I am having this weird issue:
It seems that I can import the mappings correctly:
es-import-mappings --url <MyESDomain>/ --file index_mappings.json

Creating Indexes (if needed):
[index="userupdates_v1"] - creating
[index="users_v1"] - creating
Creating mappings:
[index="userupdates_v1", prop="userupdate"]
[index="users_v1", prop="user"]
Done!

Which I can only verify by viewing them in the AWS console

Next, I am importing the userupdates_v1 index, by:
$ es-import-bulk --url <MyESDomain>/ --file index_userupdates.json

Pre-Processing file of size: 9.18 MB
Starting bulk imports with batches of 20000 lines.
Processing line 70240 of 70240 [====================] 100% 16.0s
Complete!

But by going again to the console, the count is still 0
image

(I have also tried with /userupdates_v1 suffix on the ES domain, but still getting the same result)

Biggest issue here is that there is no verbose or debugging mode for the es-import-bulk tool, so there's no way of knowing what's the issue.

@dimisjim
Copy link
Author

It was eventually due to a type mismatch issue in the indices. This should be outputted as an error.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant