Skip to content

[MCC-1476014] Python Lib-Create Fetch_data() function#27

Merged
butsyk-mdsol merged 8 commits into
mainfrom
feat/MCC-1476014-fetch-data
May 12, 2026
Merged

[MCC-1476014] Python Lib-Create Fetch_data() function#27
butsyk-mdsol merged 8 commits into
mainfrom
feat/MCC-1476014-fetch-data

Conversation

@afieraru-mdsol

@afieraru-mdsol afieraru-mdsol commented May 11, 2026

Copy link
Copy Markdown
Contributor

feature/bug/enhance/refactor/tech_debt/hotfix

Adds a new end-to-end fetch_data() API to the Python DataConnect client/service stack, enabling retrieval of dataset data via the transport layer and returning results as a pandas.DataFrame. This extends the transport contract with a do_get() operation and introduces a transport-level DataTable DTO for Arrow IPC bytes.

Changes:

  • Add DataTable DTO plus new Transport.do_get() abstract method and Arrow Flight implementation.
  • Add service/client fetch_data() method and Arrow IPC → pandas.DataFrame mapper.
  • Move pandas into main Poetry dependencies.

Changes Summary

  • Create fetch_data() function
Screenshot 2026-05-11 at 15 31 28

Copilot AI review requested due to automatic review settings May 11, 2026 12:56
@afieraru-mdsol
afieraru-mdsol marked this pull request as draft May 11, 2026 12:56

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a new end-to-end fetch_data() API to the Python DataConnect client/service stack, enabling retrieval of dataset data via the transport layer and returning results as a pandas.DataFrame. This extends the transport contract with a do_get() operation and introduces a transport-level DataTable DTO for Arrow IPC bytes.

Changes:

  • Add DataTable DTO plus new Transport.do_get() abstract method and Arrow Flight implementation.
  • Add service/client fetch_data() method and Arrow IPC → pandas.DataFrame mapper.
  • Move pandas into main Poetry dependencies.

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 12 comments.

Show a summary per file
File Description
pyproject.toml Adds pandas as a core dependency (requires lockfile update).
dataconnect/transport/models.py Introduces DataTable DTO to carry Arrow IPC bytes.
dataconnect/transport/base.py Extends the transport interface with do_get().
dataconnect/transport/arrow_flight/transport.py Implements do_get() and Arrow Table → IPC serialization.
dataconnect/service/mappers.py Adds DataTablepandas.DataFrame conversion.
dataconnect/service/default.py Implements fetch_data() in the default service.
dataconnect/service/base.py Adds fetch_data() to the service interface.
dataconnect/client.py Exposes fetch_data() on the public client API.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread pyproject.toml
Comment thread dataconnect/transport/arrow_flight/transport.py Outdated
Comment thread dataconnect/transport/arrow_flight/transport.py Outdated
Comment thread dataconnect/service/default.py
Comment thread dataconnect/service/default.py
Comment thread dataconnect/service/mappers.py Outdated
Comment thread dataconnect/service/base.py Outdated
Comment thread dataconnect/client.py Outdated
Comment thread dataconnect/transport/base.py Outdated
Comment thread dataconnect/service/mappers.py
Comment thread dataconnect/service/default.py
Comment thread dataconnect/service/default.py
@butsyk-mdsol
butsyk-mdsol marked this pull request as ready for review May 12, 2026 10:58
@butsyk-mdsol
butsyk-mdsol merged commit 24acfbc into main May 12, 2026
3 checks passed
@butsyk-mdsol
butsyk-mdsol deleted the feat/MCC-1476014-fetch-data branch May 12, 2026 10:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants