Skip to content

Missing Ground Truth Tables and Starmie Result Discrepancies #13

Description

@MyriadVerse

Hi, I’m experiencing a couple of issues with your project, and I would appreciate your guidance to help clarify these points.

  1. Ground Truth Tables Missing:
    We have observed that the four operations—opendata union, opendata join, webtable union, and webtable join—are showing a significant number of ground truth tables that are not found in either the candidate tables or the query tables. The proportion of missing ground truth tables ranges from approximately 1% to 7%.

  2. Reproduction of Starmie Results:
    We are experiencing considerable differences between our results and those presented in the Starmie paper. To better understand these discrepancies, could you please provide the specific parameters used when running query.py? Additionally, we would like to confirm whether all query tables were included in the data lake during your Starmie runs, as many ground truth tables appear to be located in the query tables rather than in the data lake.

Thank you for your assistance in addressing these issues.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions