Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(scrapers.update_from_text): new command #4520

Open
wants to merge 8 commits into
base: main
Choose a base branch
from

Commits on Oct 1, 2024

  1. feat(scrapers.update_from_text): new command

    Helps solve: freelawproject/juriscraper#858
    
    - New command to re-run Site.extract_from_text over downloaded opinions
    - Able to filter by Docket.court_id ,  OpinionCluster.date_filed, OpinionCluster.precedential_status
    - Updates tasks.update_from_document_text to return information for logging purposes
    - Updates test_opinion_scraper to get a Site.extract_from_text method
    grossir committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    d871b4a View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    f516f13 View commit details
    Browse the repository at this point in the history

Commits on Oct 3, 2024

  1. Configuration menu
    Copy the full SHA
    79c8c0a View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. Configuration menu
    Copy the full SHA
    143e6de View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    5adce99 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    3bc0f8e View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Configuration menu
    Copy the full SHA
    5baa691 View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. feat(scrapers.update_from_text): refactor from code review

    - validate citation objects from `Site.extract_from_text`. Add tests for this
    - abstract --courts required argument for scrapers into ScraperCommand class
    also, made it more flexible
    - refactor cl_scrape_opinions; cl_scrape_oral_arguments to account for this
    - delete cl.scrapers.utils.extract_recap_documents which was generating a
    circular import. This function was not used anywhere
    grossir committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    6a1fadb View commit details
    Browse the repository at this point in the history