Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add indexes to structLogs objects #285

Open
maledorak opened this issue Oct 19, 2023 · 0 comments
Open

Add indexes to structLogs objects #285

maledorak opened this issue Oct 19, 2023 · 0 comments
Labels

Comments

@maledorak
Copy link
Member

maledorak commented Oct 19, 2023

To improve performance, we need to add indexes in structLogs objects on backend side (currently we are adding them on frontend during loading structLogs in analyzer saga)

In file: packages/transaction-trace-provider/src/sqsConsumer.ts function: processTx
We need to have add map which add index for every structLog object in array traceResult.structLogs

In file: packages/frontend/src/store/analyzer/analyzer.providers.ts class TransactionTraceFetcher function getStructLog Remove map for adding index to structLogs

Add TRawTransactionTraceResult as a type for updated traceResult object

Main issue - you have to update every single json file stored in:

  • transaction-trace-storage-prod.rumblefish.dev/trace/*
  • transaction-trace-storage-stage.rumblefish.dev/trace/*

Because there will be already traceResoults stored in files without index.
You need to update it (around 200 files on prd) or delete it all (it may be costly, because lambdas need to reprocess them all, but it will be with indexes)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant