Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Limit Requests to Prevent 429 from Google #17

Open
threeal opened this issue Jul 18, 2023 · 0 comments
Open

Limit Requests to Prevent 429 from Google #17

threeal opened this issue Jul 18, 2023 · 0 comments

Comments

@threeal
Copy link
Owner

threeal commented Jul 18, 2023

This issue addresses the need to limit Google search requests to avoid encountering HTTP 429 errors. The following changes will be implemented to achieve this:

  • Modify the code to make requests sequentially, ensuring that one request is made after another.
  • Introduce a random delay between requests to avoid overwhelming the Google search service.
  • Add a --rapid option that allows making requests in parallel without any delay between them.

These changes aim to prevent HTTP 429 errors, which occur when there are too many requests made to Google within a short period. By implementing these modifications, we can ensure a more reliable and sustainable interaction with the Google search service, mitigating the risk of encountering rate-limiting issues.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Todo
Development

No branches or pull requests

1 participant