Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hadoop to SQLite #217

Open
NateDogDotNet opened this issue Oct 7, 2024 · 0 comments
Open

Hadoop to SQLite #217

NateDogDotNet opened this issue Oct 7, 2024 · 0 comments

Comments

@NateDogDotNet
Copy link

I am trying to use the iceberg-catalog-migrator-cli to move a Hadoop catalog to an SQLite catalog, but I cannot figure out what I am doing wrong.

I first created an empty db:

sqlite3 testSQLliteIcebergCatalog.db

Command:

java -jar iceberg-catalog-migrator-cli-0.3.0.jar register --source-catalog-type HADOOP --source-catalog-properties warehouse="G:/Shared drives/_Data/Lake/Iceberg",type=hadoop --target-catalog-type JDBC --target-catalog-properties warehouse="G:/Shared drives/_Data/Lake/Iceberg",uri=jdbc:sqlite:testSQLliteIcebergCatalog.db,name=csa

Response:

WARN - User has not specified the table identifiers. Will be selecting all the tables from all the namespaces from the source catalog.

INFO - Configured source catalog: SOURCE_CATALOG_HADOOP

ERROR - Error during CLI execution: Failed to connect: jdbc:sqlite:testSQLliteIcebergCatalog2.db. Please check \catalog_migration.log file for more info.``

Log entry:

2024-09-19 12:21:14,331 [main] INFO org.apache.iceberg.CatalogUtil - Loading custom FileIO implementation: org.apache.iceberg.hadoop.HadoopFileIO

I am in a Windows environment and developing everything locally.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant