Optional ReadonlyaccountAccount ID of the Glue Data Catalog whose metadata is referenced in lineage events (sets spark.glue.accountId).
Must be a 12-digit AWS account ID. Defaults to the deploying account. This is the Data Catalog account and is
independent of the account that owns the DataZone domain (the domain is assumed to be in the deploying account).
ReadonlydomainAmazon DataZone (SageMaker Unified Studio) domain ID that will receive the lineage events, e.g. dzd_xxxxxxxxx.
Mirrors the domainIdentifier pattern documented for the DataZone PostLineageEvent API, which this feature
drives: either separator (- or _), mixed case, and at most 36 characters after the separator. The charset
admits no whitespace, which is relied upon when interpolating this value into the space-separated Spark --conf
string and into the domain ARN below.
ReadonlyenabledWhether to emit lineage events to Amazon DataZone. When false, no lineage configuration is injected.
Optional ReadonlymanageWhether the module attaches a managed policy granting datazone:PostLineageEvent (scoped to the domain ARN) to
the job execution role. Defaults to true. Set to false when the execution role is externally managed and you will
grant the permission yourself.
Configuration for emitting OpenLineage events from a Glue Spark job to an Amazon DataZone (SageMaker Unified Studio) domain. Mirrors the "Generate lineage events" option in the AWS Glue console: when enabled, the module injects the OpenLineage Spark listener configuration into the job's
--confargument so runs publish lineage to the specified DataZone domain.Use cases: Automated data lineage capture; DataZone/SageMaker governance; Impact analysis
AWS: AWS Glue Spark OpenLineage integration with the Amazon DataZone
PostLineageEventAPIValidation: Requires Glue version 5.0 or higher (enforced at synth time). When enabled, the module attaches a managed policy granting
datazone:PostLineageEventon the target domain to the job execution role, unlessmanageExecutionRolePolicyis set to false.