Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Add fail processor documentation #5980

Merged
merged 19 commits into from
May 22, 2024
Merged

[DOC] Add fail processor documentation #5980

merged 19 commits into from
May 22, 2024

Conversation

vagimeli
Copy link
Collaborator

Description

Closes the content gap

Issues Resolved

##4647

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli vagimeli added Needs SME Waiting on input from subject matter expert Content gap labels Dec 22, 2023
@vagimeli vagimeli self-assigned this Dec 22, 2023
@vagimeli
Copy link
Collaborator Author

@hdhalter We need a dev to take the first pass at drafting this content. I can support them in refining the content and getting it through the documentation process. The ingest processor template is provided with this PR, so it should help the dev get started. Thanks!

@vagimeli
Copy link
Collaborator Author

vagimeli commented Jan 31, 2024

@gaobinlong Would you have availability to help close the content gap on this PR? We don't have a set deadline, so at your availability is okay. The same process you've followed for the copy processor can be followed here. Thank you.

@gaobinlong
Copy link
Contributor

@gaobinlong Would you have availability to help close the content gap on this PR? We don't have a set deadline, so at your availability is okay. The same process you've followed for the copy processor can be followed here. Thank you.

OK, glad to do that, I'll open a PR for this issue.

@vagimeli
Copy link
Collaborator Author

vagimeli commented Feb 6, 2024

@gaobinlong Would you have availability to help close the content gap on this PR? We don't have a set deadline, so at your availability is okay. The same process you've followed for the copy processor can be followed here. Thank you.

OK, glad to do that, I'll open a PR for this issue.

Thanks @gaobinlong. Please tag me in the PR when it's ready for doc review.

@vagimeli vagimeli marked this pull request as draft February 15, 2024 21:20
@vagimeli vagimeli marked this pull request as ready for review February 26, 2024 22:12
@vagimeli
Copy link
Collaborator Author

@gaobinlong This template for the fail ingest processor is ready for you to add code examples at your availability. Thank you, Melissa

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli
Copy link
Collaborator Author

@gaobinlong Will you review this PR for technical accuracy? I added examples and new content. Thank you!

_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli vagimeli requested a review from epugh as a code owner April 16, 2024 21:48
@vagimeli
Copy link
Collaborator Author

@gaobinlong Thank you for your review and the code examples. I made your changes. Once. you approve, I'll send for editorial review and then merge the PR.

Copy link
Contributor

@gaobinlong gaobinlong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall looks good to me, some minor changes need to be done.

_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
@vagimeli vagimeli added 3 - Tech review PR: Tech review in progress and removed Needs SME Waiting on input from subject matter expert labels May 2, 2024
Copy link
Collaborator

@Naarcha-AWS Naarcha-AWS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few suggestions, otherwise LGTM.

_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
vagimeli and others added 2 commits May 22, 2024 09:45
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli vagimeli added backport 2.14 PR: Backport label for 2.14 5 - Editorial review PR: Editorial review in progress and removed 3 - Tech review PR: Tech review in progress labels May 22, 2024
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@vagimeli Just a few comments/changes. Thanks!

_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved
_ingest-pipelines/processors/fail.md Outdated Show resolved Hide resolved

### Step 4 (Optional): Retrieve the document

Since the log event was not indexed due to the pipeline failure, attempting to retrieve it will result in a document not found error.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should "document not found" be specially formatted as the name of the error?

vagimeli and others added 5 commits May 22, 2024 10:03
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
@vagimeli vagimeli removed the 5 - Editorial review PR: Editorial review in progress label May 22, 2024
@vagimeli vagimeli merged commit 05710d0 into main May 22, 2024
6 checks passed
@vagimeli vagimeli deleted the fail-processor branch May 22, 2024 18:20
opensearch-trigger-bot bot pushed a commit that referenced this pull request May 22, 2024
* Add fail processor documentation

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update fail.md

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Address tech review feedback and add SME's code examples

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Address tech review comments

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update _ingest-pipelines/processors/fail.md

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

* Update fail.md

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>

---------

Signed-off-by: Melissa Vagi <vagimeli@amazon.com>
Co-authored-by: Naarcha-AWS <97990722+Naarcha-AWS@users.noreply.github.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
(cherry picked from commit 05710d0)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport 2.14 PR: Backport label for 2.14 Content gap
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants