Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

doc: Add documentation+FAQs for Parquet DataSource#153

Merged
kevinbheda merged 17 commits intoraystack:dagger-parquet-file-processingraystack/dagger:dagger-parquet-file-processingfrom
Meghajit:feat/issue#109-add-parquet-source-documentationMeghajit/dagger:feat/issue#109-add-parquet-source-documentationCopy head branch name to clipboard
Jun 6, 2022
Merged

doc: Add documentation+FAQs for Parquet DataSource#153
kevinbheda merged 17 commits intoraystack:dagger-parquet-file-processingraystack/dagger:dagger-parquet-file-processingfrom
Meghajit:feat/issue#109-add-parquet-source-documentationMeghajit/dagger:feat/issue#109-add-parquet-source-documentationCopy head branch name to clipboard

Conversation

@Meghajit
Copy link
Member

PR for #109

@Meghajit Meghajit self-assigned this May 23, 2022
@Meghajit Meghajit linked an issue May 23, 2022 that may be closed by this pull request
@Meghajit Meghajit marked this pull request as ready for review May 30, 2022 11:10
@Meghajit
Copy link
Member Author

Added the configurations + some common gotchas for setting up configurations. Also, some FAQs and how to create the stream config for parquet. I haven’t touched the diagrams yet, as they will require some effort to be redrawn since the original resources are missing. However, have changed the description in relevent places.

Copy link
Contributor

@kevinbheda kevinbheda Jun 6, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

small typo here, I believe we meant date partitioned here.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed via commit 31f5ec3

…' into feat/issue#109-add-parquet-source-documentation
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Kafka is unbounded and parquet is bounded data source. Fixing this as well

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

good catch

Copy link
Member Author

@Meghajit Meghajit Jun 6, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed via commit 91a73a5

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member Author

@Meghajit Meghajit Jun 6, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed via commit 91a73a5

@kevinbheda kevinbheda merged commit d97e37e into raystack:dagger-parquet-file-processing Jun 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

doc: Add documentation+FAQs for Parquet DataSource

2 participants

Comments

Close sidebar
Morty Proxy This is a proxified and sanitized view of the page, visit original site.