Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Appearance settings

Windoze/211 maven submission#334

Merged
windoze merged 4 commits into
mainfeathr-ai/feathr:mainfrom
windoze/211-maven-submissionfeathr-ai/feathr:windoze/211-maven-submissionCopy head branch name to clipboard
Jun 13, 2022
Merged

Windoze/211 maven submission#334
windoze merged 4 commits into
mainfeathr-ai/feathr:mainfrom
windoze/211-maven-submissionfeathr-ai/feathr:windoze/211-maven-submissionCopy head branch name to clipboard

Conversation

@windoze
Copy link
Copy Markdown
Member

@windoze windoze commented Jun 9, 2022

#211 Fix, enable submitting Feathr JAR from Maven.

Comment thread feathr_project/feathr/spark_provider/_databricks_submission.py Outdated
Comment thread feathr_project/feathr/spark_provider/_synapse_submission.py
@xiaoyongzhu
Copy link
Copy Markdown
Member

Overall look good to me. Seems like the test failure is irrelevant.

@xiaoyongzhu xiaoyongzhu linked an issue Jun 9, 2022 that may be closed by this pull request
@xiaoyongzhu
Copy link
Copy Markdown
Member

Can we also add a bit test case to cover this?

@windoze windoze added the safe to test Tag to execute build pipeline for a PR from forked repo label Jun 10, 2022
@xiaoyongzhu
Copy link
Copy Markdown
Member

Pasting some background info for this PR:

Since Feathr is on Maven now (https://search.maven.org/artifact/com.linkedin.feathr/feathr_2.12), we should consider using Maven as the source to submit Spark jobs,rather than using the public wasb path, since it's a bit hard to maintain and doesn't distribute well (like don't have mirrors etc., and will be slow).

@jainr
Copy link
Copy Markdown
Collaborator

jainr commented Jun 13, 2022

+1 to adding tests to cover this. Looks good to me.

@windoze
Copy link
Copy Markdown
Member Author

windoze commented Jun 13, 2022

E2E test was added in the latest commit.

@windoze windoze merged commit 7f105d5 into main Jun 13, 2022
@windoze windoze deleted the windoze/211-maven-submission branch June 13, 2022 14:33
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
bozhonghu pushed a commit that referenced this pull request Jun 15, 2022
* main:
  Fixing purview test issues and improve performance (#350)
  [feathr] Add product_recommendation advanced sample (#348)
  obejectId query cmd update (#360)
  add license, release, docs, python api ref badges with shields img (#357)
  quick fix the 404 not found in read me link (#355)
  Python SQL Registry (#311)
  enable JWT token param in frontend API calls (#337)
  Optimize environment variable behavior (#333)
  Adding better warning message to let user know that config file is missing and they need to set env parameters. (#347)
  Feature Monitoring (#330)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Fix Synapse quickstart link (#346)
  Show feature details when click feature in lineage graph (#339)
  Update pull_request_push_test.yml
  Update UI README for how to create overrides for local development (#335)
  Update databricks quick start experience (#217)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

safe to test Tag to execute build pipeline for a PR from forked repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Consider using Maven based spark job submission

3 participants

Morty Proxy This is a proxified and sanitized view of the page, visit original site.