Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

grpc: factor out schema related functionality from bigquery to common #338

Open
wants to merge 17 commits into
base: main
Choose a base branch
from
Open

grpc: factor out schema related functionality from bigquery to common #338

wants to merge 17 commits into from

Commits on Oct 12, 2024

  1. logthrdest: fix leaking worker_partition_key template 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    2d1db77 View commit details
    Browse the repository at this point in the history

  2. grpc/metrics: fix leaking stats cluster key 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    695ef4a View commit details
    Browse the repository at this point in the history

  3. grpc: add missing worker super deinit() 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    61d2134 View commit details
    Browse the repository at this point in the history

  4. grpc/loki: flush on worker-partition-key change 

    Out intention is to batch messages that correspond
to the same label set. If between two messages the
label set changes, but they arrive to the same
worker, we should flush the previous batch.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    e246b5f View commit details
    Browse the repository at this point in the history

  5. grpc: add worker_partition_key related functions to base class 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    fc7423d View commit details
    Browse the repository at this point in the history

  6. grpc: factor out loki::Label class as grpc::NameValueTemplatePair 

    Will be useful for templated headers as well.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    ce6b2d9 View commit details
    Browse the repository at this point in the history

  7. grpc/bigquery: use NameValueTemplatePair in Field 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    9dff07f View commit details
    Browse the repository at this point in the history

  8. grpc: support template_options for all destinations 

    This will be needed for the dynamic headers.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    090118e View commit details
    Browse the repository at this point in the history

  9. grpc: add support for templated header() values 

    It must be enabled in the derived class, and
prepare_context_dynamic() must be used if so.

This is not part of this commit, enabling it will be
done in subsequent commits.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    1237e18 View commit details
    Browse the repository at this point in the history

  10. grpc/otel: support dynamic headers 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    885051d View commit details
    Browse the repository at this point in the history

  11. grpc/loki: support dynamic headers 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    96ec7a2 View commit details
    Browse the repository at this point in the history

  12. grpc: use local subchannel pool 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    c26fddc View commit details
    Browse the repository at this point in the history

  13. news: add entry for axoflow#334 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    a12a4a8 View commit details
    Browse the repository at this point in the history

  14. grpc: add boilerplate for common Schema class 

    Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    e3e6c83 View commit details
    Browse the repository at this point in the history

  15. grpc: move NameValueTemplatePair to common/schema 

    It will be needed there as well.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    0c71f64 View commit details
    Browse the repository at this point in the history

  16. grpc: rename grpc_dest_option to grpc_dest_general option 

    We are planning to introduce an opt-in grpc_dest_schema_option
nonterminal.

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    a15a2e0 View commit details
    Browse the repository at this point in the history

  17. grpc/schema: factor out schema related logic from bigquery 

    In order to opt-in for schema support, a derived
class must:

 * include grpc_dest_schema_option in the grammar
 * implement the string -> descriptor type mapping
 * store and init a Schema instance in the driver
 * implement the get_schema() method to return
   the stored Schema instance

The derived class can interface with the Schema
by these functions:
  * init()
  * empty()
  * format()
  * get_schema_descriptor()

Signed-off-by: Attila Szakacs <attila.szakacs@axoflow.com>
    @alltilla
    alltilla committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    c421450 View commit details
    Browse the repository at this point in the history