Conduit connector for Google-Drive.
The Google Drive connector is one of Conduit's plugins. It provides a destination connector for writing records into a specified Google Drive folder.
The Google Drive Destination Connector connects to a Google Drive account using a service account's credentials and uploads incoming records as files into a configured folder.
Note: The destination connector only supports the create and snapshot operations. It does not support the delete or update operations.
This connector uses a Google service account for authentication. Ensure that the service account has write access to the target Drive folder by either:
- Sharing the folder directly with the service account email, or
- Using domain-wide delegation (if operating within a Google Workspace organization)"
version: 2.2
pipelines:
- id: example
status: running
connectors:
- id: example
plugin: "google-drive"
settings:
# The URL to the X.509 certificate for the service account, used to
# verify its identity.
# Type: string
# Required: yes
drive.clientCertUrl: ""
# The email address of the service account (e.g.
# [email protected]).
# Type: string
# Required: yes
drive.clientEmail: ""
# The OAuth2 client ID associated with the service account.
# Type: string
# Required: yes
drive.clientId: ""
# The private key (PEM-encoded) used to sign service account requests.
# Type: string
# Required: yes
drive.privateKey: ""
# The ID of the private key used to authenticate the service account.
# Type: string
# Required: yes
drive.privateKeyId: ""
# The Google Cloud project ID associated with the service account.
# Type: string
# Required: yes
drive.projectId: ""
# The ID of the Google Drive folder where records will be uploaded.
# This can be found in the folder's URL:
# https://drive.google.com/drive/folders/<folderId>
# Type: string
# Required: yes
folderId: ""
# Maximum delay before an incomplete batch is written to the
# destination.
# Type: duration
# Required: no
sdk.batch.delay: "0"
# Maximum size of batch before it gets written to the destination.
# Type: int
# Required: no
sdk.batch.size: "0"
# Allow bursts of at most X records (0 or less means that bursts are
# not limited). Only takes effect if a rate limit per second is set.
# Note that if `sdk.batch.size` is bigger than `sdk.rate.burst`, the
# effective batch size will be equal to `sdk.rate.burst`.
# Type: int
# Required: no
sdk.rate.burst: "0"
# Maximum number of records written per second (0 means no rate
# limit).
# Type: float
# Required: no
sdk.rate.perSecond: "0"
# The format of the output record. See the Conduit documentation for a
# full list of supported formats
# (https://conduit.io/docs/using/connectors/configuration-parameters/output-format).
# Type: string
# Required: no
sdk.record.format: "opencdc/json"
# Options to configure the chosen output record format. Options are
# normally key=value pairs separated with comma (e.g.
# opt1=val2,opt2=val2), except for the `template` record format, where
# options are a Go template.
# Type: string
# Required: no
sdk.record.format.options: ""
# Whether to extract and decode the record key with a schema.
# Type: bool
# Required: no
sdk.schema.extract.key.enabled: "true"
# Whether to extract and decode the record payload with a schema.
# Type: bool
# Required: no
sdk.schema.extract.payload.enabled: "true"- To install the required tools, run
make install-tools. - To generate code (mocks, re-generate
connector.yaml, update the README, etc.), runmake generate.
Run make build to build the connector.