Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Prepper 2.10.0 release blog #3381

Merged

Conversation

dlvenable
Copy link
Member

@dlvenable dlvenable commented Oct 11, 2024

Description

This PR adds the release blog post for Data Prepper 2.10. This post was written by @dlvenable and @sb2k16 who will create a separate PR with his profile.

We can start the review while we wait on us getting the profile for @sb2k16 and our Thank You text updated.

Tasks for our team before merging:

Issues Resolved

Resolves #3371

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the BSD-3-Clause License.

Co-authored-by: Souvik Bose <souvbose@amazon.com>
Signed-off-by: David Venable <dlv@amazon.com>
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dlvenable Initial editorial review complete. Please see my comments and changes and tag me for approval once addressed. Thanks!

_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
_posts/2024-10-15-Announcing-Data-Prepper-2.10.0.md Outdated Show resolved Hide resolved
- releases
excerpt: Data Prepper 2.10.0 offers an OpenSearch _bulk API and reads from Amazon Kinesis
meta_keywords: Data Prepper, _bulk, Amazon Kinesis Data Streams, OTel Logs, OTLP JSON
meta_description: Data Prepper 2.10.0 offers a source that simulates the OpenSearch _bulk API and another source for reading from Amazon Kinesis Data Streams.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated meta:

meta_keywords: Data Prepper, OpenSearch bulk API, Kinesis data streams, Kafka, SASL/SCRAM authentication, streaming data ingestion

meta_description: Data Prepper 2.10.0 adds OpenSearch API and Kinesis Data Streams sources for seamless ingestion, plus Kafka SASL/SCRAM support and OpenTelemetry log parsing.

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: David Venable <dlv@amazon.com>
@dlvenable dlvenable force-pushed the data-prepper-2.10-release-blog branch from 2a44566 to 98fe5b7 Compare October 15, 2024 14:33
Signed-off-by: David Venable <dlv@amazon.com>
@dlvenable
Copy link
Member Author

@natebower , I made all the changes. I will be pushing the Thank You text soon as well.

Also, my co-author has a PR for a profile that we will need merged. #3386

{ "title": "Rush", "year": 2013 }
```

This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` with a document source of `{ "title": "Rush", "year": 2013 }`.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` with a document source of `{ "title": "Rush", "year": 2013 }`.
This request will be ingested into OpenSearch, and a new document will be created under the index `movies` with the document ID `tt1979320` and the document source `{ "title": "Rush", "year": 2013 }`.

Signed-off-by: David Venable <dlv@amazon.com>
natebower
natebower previously approved these changes Oct 15, 2024
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @dlvenable! LGTM with the minor edits to lines 24 and 73.

Cc: @pajuric

## OpenSearch API source

Many existing OpenSearch clients that perform ingestion directly to OpenSearch can now send that data to Data Prepper first.
With this, you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
With this, you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API.
This means that you can use Data Prepper's buffering and rich processor set before sending data to OpenSearch without having to change clients that are using the OpenSearch `_bulk` API.

Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: David Venable <dlv@amazon.com>
Co-authored-by: Nathan Bower <nbower@amazon.com>
Signed-off-by: David Venable <dlv@amazon.com>
@dlvenable
Copy link
Member Author

@natebower , I made both of your last two suggestions.

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@pajuric
Copy link

pajuric commented Oct 15, 2024

@nateynateynate @krisfreedain - Blog is ready to go live! Let's get it posted.

@pajuric
Copy link

pajuric commented Oct 16, 2024

@nateynateynate @kolchfa-aws - are you able to help with pushing this live. It never pushed out yesterday.

Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kolchfa-aws kolchfa-aws merged commit 25a06f6 into opensearch-project:main Oct 16, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new blog New blog post
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

[BLOG] Data Prepper 2.10 release blog post
5 participants