Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[PECO-1803] Splitting the PySql connector into the core and the non core part #417

Merged
merged 54 commits into from
Sep 24, 2024
Merged

[PECO-1803] Splitting the PySql connector into the core and the non core part #417

merged 54 commits into from
Sep 24, 2024

Commits on Jul 24, 2024

  1. Implemented ColumnQueue to test the fetchall without pyarrow 

    Removed token

removed token
    @jprakash-db
    jprakash-db committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    335fc0c View commit details
    Browse the repository at this point in the history

  2. order of fields in row corrected

    @shivam2680
    shivam2680 committed Jul 24, 2024
    Configuration menu
    Copy the full SHA
    ad2b014 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Changed the folder structure and tested the basic setup to work

    @jprakash-db
    jprakash-db committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    882e080 View commit details
    Browse the repository at this point in the history

  2. Refractored the code to make connector to work

    @jprakash-db
    jprakash-db committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    98c4cd6 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. Basic Setup of connector, core and sqlalchemy is working

    @jprakash-db
    jprakash-db committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    25a006d View commit details
    Browse the repository at this point in the history

  2. Basic integration of core, connect and sqlalchemy is working

    @jprakash-db
    jprakash-db committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    1cfaae2 View commit details
    Browse the repository at this point in the history

  3. Setup working dynamic change from ColumnQueue to ArrowQueue

    @jprakash-db
    jprakash-db committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    c576110 View commit details
    Browse the repository at this point in the history

Commits on Aug 8, 2024

  1. Refractored the test code and moved to respective folders

    @jprakash-db
    jprakash-db committed Aug 8, 2024
    Configuration menu
    Copy the full SHA
    0ddca9d View commit details
    Browse the repository at this point in the history

Commits on Aug 20, 2024

  1. Added the unit test for column_queue 

    Fixed __version__

Fix
    @jprakash-db
    jprakash-db committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    786dc1e View commit details
    Browse the repository at this point in the history

  2. venv_main added to git ignore

    @jprakash-db
    jprakash-db committed Aug 20, 2024
    Configuration menu
    Copy the full SHA
    c91d43d View commit details
    Browse the repository at this point in the history

Commits on Aug 21, 2024

  1. Added code for merging columnar table

    @jprakash-db
    jprakash-db committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    b67b739 View commit details
    Browse the repository at this point in the history

  2. Merging code for columnar

    @jprakash-db
    jprakash-db committed Aug 21, 2024
    Configuration menu
    Copy the full SHA
    32e3dcd View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2024

  1. Fixed the retry_close sesssion test issue with logging

    @jprakash-db
    jprakash-db committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    d062887 View commit details
    Browse the repository at this point in the history

  2. Fixed the databricks_sqlalchemy tests and introduced pytest.ini for t… 

    …he sqla_testing
    @jprakash-db
    jprakash-db committed Aug 22, 2024
    Configuration menu
    Copy the full SHA
    9908976 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2024

  1. Added pyarrow_test mark on pytest

    @jprakash-db
    jprakash-db committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    af0cd4f View commit details
    Browse the repository at this point in the history

  2. Fixed databricks.sqlalchemy to databricks_sqlalchemy imports

    @jprakash-db
    jprakash-db committed Aug 25, 2024
    Configuration menu
    Copy the full SHA
    a07c232 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Added poetry.lock

    @jprakash-db
    jprakash-db committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    f0c8e7a View commit details
    Browse the repository at this point in the history

  2. Added dist folder

    @jprakash-db
    jprakash-db committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    46ae0f7 View commit details
    Browse the repository at this point in the history

  3. Changed the pyproject.toml

    @jprakash-db
    jprakash-db committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    8c5e7dd View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. Minor Fix

    @jprakash-db
    jprakash-db committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    24730dd View commit details
    Browse the repository at this point in the history

Commits on Aug 30, 2024

  1. Added the pyarrow skip tag on unit tests and tested their working

    @jprakash-db
    jprakash-db committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    61de281 View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2024

  1. Fixed the Decimal and timestamp conversion issue in non arrow pipeline

    @jprakash-db
    jprakash-db committed Sep 1, 2024
    Configuration menu
    Copy the full SHA
    bad7c0b View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. Removed not required files and reformatted

    @jprakash-db
    jprakash-db committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    520d2c8 View commit details
    Browse the repository at this point in the history

  2. Fixed test_retry error

    @jprakash-db
    jprakash-db committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    051bdce View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. Changed the folder structure to src / databricks

    @jprakash-db
    jprakash-db committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    4d64034 View commit details
    Browse the repository at this point in the history

  2. Removed the columnar non arrow flow to another PR

    @jprakash-db
    jprakash-db committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    93848d7 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Moved the README to the root

    @jprakash-db
    jprakash-db committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    f37f42c View commit details
    Browse the repository at this point in the history

  2. removed columnQueue instance

    @jprakash-db
    jprakash-db committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    0e4b599 View commit details
    Browse the repository at this point in the history

  3. Revmoved databricks_sqlalchemy dependency in core

    @jprakash-db
    jprakash-db committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    8199832 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Changed the pysql_supports_arrow predicate, introduced changes in the… 

    … pyproject.toml
    @jprakash-db
    jprakash-db committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    613e7dc View commit details
    Browse the repository at this point in the history

  2. Ran the black formatter with the original version

    @jprakash-db
    jprakash-db committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    c4a2e08 View commit details
    Browse the repository at this point in the history

  3. Extra .py removed from all the __init__.py files names

    @jprakash-db
    jprakash-db committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6f10ec6 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Undo formatting check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2115db1 View commit details
    Browse the repository at this point in the history

  2. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    36c0f95 View commit details
    Browse the repository at this point in the history

  3. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    15d5047 View commit details
    Browse the repository at this point in the history

  4. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    8415230 View commit details
    Browse the repository at this point in the history

  5. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    15df683 View commit details
    Browse the repository at this point in the history

  6. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    b4c3029 View commit details
    Browse the repository at this point in the history

  7. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    bc758d8 View commit details
    Browse the repository at this point in the history

  8. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    31da868 View commit details
    Browse the repository at this point in the history

  9. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    f79fc69 View commit details
    Browse the repository at this point in the history

  10. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    d121fed View commit details
    Browse the repository at this point in the history

  11. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6e393b0 View commit details
    Browse the repository at this point in the history

  12. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    2383caf View commit details
    Browse the repository at this point in the history

  13. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    dd4c487 View commit details
    Browse the repository at this point in the history

  14. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    6be085c View commit details
    Browse the repository at this point in the history

  15. Check

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    e7cf5c3 View commit details
    Browse the repository at this point in the history

  16. BIG UPDATE

    @jprakash-db
    jprakash-db committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    b6a5668 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Refeactor code

    @jprakash-db
    jprakash-db committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    4496a04 View commit details
    Browse the repository at this point in the history

  2. Refractor

    @jprakash-db
    jprakash-db committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    726b8ed View commit details
    Browse the repository at this point in the history

  3. Fixed versioning

    @jprakash-db
    jprakash-db committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    66bfa6d View commit details
    Browse the repository at this point in the history

  4. Minor refractoring

    @jprakash-db
    jprakash-db committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    2c1cfbd View commit details
    Browse the repository at this point in the history

  5. Minor refractoring

    @jprakash-db
    jprakash-db committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    ae20a65 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Merged databricks:PECO-1803/connector-split into jprakash-db/PECO-1803

    @jprakash-db
    jprakash-db committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f056c80 View commit details
    Browse the repository at this point in the history