Skip to content

Remove type HiveWriter #1421

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

wangkuiyi
Copy link
Collaborator

@wangkuiyi wangkuiyi commented Dec 14, 2019

Fix #1352.

After the merge of this PR, we can go further to refactorize unit tests, like #1422

Copy link
Collaborator

@Yancey0623 Yancey0623 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@@ -79,7 +77,7 @@ func uploadCSVFile(csv *os.File, db *sql.DB, hivePath, table, user, passwd strin
}
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add defer removeHDFSDir(w.hdfsPath(), hdfsEnv) at L67 to fix #1345 , maybe we can mrege this PR and I can do that in the next PR.

@wangkuiyi wangkuiyi merged commit f20a297 into sql-machine-learning:develop Dec 16, 2019
@wangkuiyi wangkuiyi deleted the sqlfs_remove_hive_writer branch December 16, 2019 01:43
@Yancey0623 Yancey0623 mentioned this pull request Dec 16, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

sqlfs/writer.go and sqlfs/hive_writer.go
2 participants