MDAA TS Docs
    Preparing search index...

    Interface S3SettingsProperty

    Provides information that defines an Amazon S3 endpoint. Modified from the equivalent L1 Construct to prevent use of plaintext credentials and enforce use of KMS encryption. This information includes the output format of records applied to the endpoint and details of transaction and control table data information. For more information about the available settings, see Extra connection attributes when using Amazon S3 as a source for AWS DMS and Extra connection attributes when using Amazon S3 as a target for AWS DMS in the AWS Database Migration Service User Guide .

    See: http://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/aws-properties-dms-endpoint-s3settings.html

    interface S3SettingsProperty {
        addColumnName?: boolean;
        bucketFolder?: string;
        bucketName: string;
        cannedAclForObjects?: string;
        cdcInsertsAndUpdates?: boolean;
        cdcInsertsOnly?: boolean;
        cdcMaxBatchInterval?: number;
        cdcMinFileSize?: number;
        cdcPath?: string;
        compressionType?: string;
        csvDelimiter?: string;
        csvNoSupValue?: string;
        csvNullValue?: string;
        csvRowDelimiter?: string;
        dataFormat?: string;
        dataPageSize?: number;
        datePartitionDelimiter?: string;
        datePartitionEnabled?: boolean;
        datePartitionSequence?: string;
        datePartitionTimezone?: string;
        dictPageSizeLimit?: number;
        enableStatistics?: boolean;
        encodingType?: string;
        externalTableDefinition?: string;
        ignoreHeaderRows?: number;
        includeOpForFullLoad?: boolean;
        maxFileSize?: number;
        parquetTimestampInMillisecond?: boolean;
        parquetVersion?: string;
        preserveTransactions?: boolean;
        rfc4180?: boolean;
        rowGroupLength?: number;
        serverSideEncryptionKmsKeyId: string;
        serviceAccessRoleArn?: string;
        timestampColumnName?: string;
        useCsvNoSupValue?: boolean;
        useTaskStartTimeForFullLoadTimestamp?: boolean;
    }
    Index

    Properties

    addColumnName? bucketFolder? bucketName cannedAclForObjects? cdcInsertsAndUpdates? cdcInsertsOnly? cdcMaxBatchInterval? cdcMinFileSize? cdcPath? compressionType? csvDelimiter? csvNoSupValue? csvNullValue? csvRowDelimiter? dataFormat? dataPageSize? datePartitionDelimiter? datePartitionEnabled? datePartitionSequence? datePartitionTimezone? dictPageSizeLimit? enableStatistics? encodingType? externalTableDefinition? ignoreHeaderRows? includeOpForFullLoad? maxFileSize? parquetTimestampInMillisecond? parquetVersion? preserveTransactions? rfc4180? rowGroupLength? serverSideEncryptionKmsKeyId serviceAccessRoleArn? timestampColumnName? useCsvNoSupValue? useTaskStartTimeForFullLoadTimestamp?

    Properties

    addColumnName?: boolean

    Flag to add column name information to CSV output files for S3 data lake integration

    bucketFolder?: string

    S3 bucket folder name for organizing migrated data with hierarchical structure

    bucketName: string

    S3 bucket name for DMS data migration destination in data lake architecture

    cannedAclForObjects?: string

    Predefined access control list (ACL) for S3 objects created during data migration

    cdcInsertsAndUpdates?: boolean

    Flag to enable CDC INSERT and UPDATE operations capture to S3 files for change tracking

    cdcInsertsOnly?: boolean

    Flag to enable CDC INSERT-only operations capture to S3 files for insert-focused change tracking

    cdcMaxBatchInterval?: number

    Maximum batch interval in seconds for CDC file output to S3 for time-based file creation

    cdcMinFileSize?: number

    Minimum file size in kilobytes for CDC file output to S3 for size-based file creation

    cdcPath?: string

    CDC folder path specification for change data capture file organization in S3

    compressionType?: string

    Compression type for S3 target files to optimize storage and transfer performance

    csvDelimiter?: string

    Column delimiter for CSV file format in S3 data lake integration

    csvNoSupValue?: string

    String value for columns not included in supplemental log during CDC CSV operations

    csvNullValue?: string

    Null value representation for CSV files in S3 data lake operations

    csvRowDelimiter?: string

    Row delimiter for CSV files in S3 data lake integration

    dataFormat?: string

    Data format specification for S3 output files in data lake architecture

    dataPageSize?: number

    Data page size in bytes for Parquet file format optimization

    datePartitionDelimiter?: string

    Date partition delimiter for S3 folder partitioning organization

    datePartitionEnabled?: boolean

    Flag to enable date-based folder partitioning for S3 bucket organization

    datePartitionSequence?: string

    Date format sequence for folder partitioning organization in S3 data lake

    datePartitionTimezone?: string

    Time zone specification for date partition folder creation and CDC file naming

    dictPageSizeLimit?: number

    Maximum dictionary page size limit for Parquet column encoding optimization

    enableStatistics?: boolean

    Flag to enable statistics collection for Parquet pages and row groups for query optimization

    encodingType?: string

    Encoding type specification for Parquet file compression and storage optimization

    externalTableDefinition?: string

    External table definition for S3 source configuration in data lake integration

    ignoreHeaderRows?: number

    Number of header rows to ignore in CSV files for S3 source processing

    includeOpForFullLoad?: boolean

    Flag to include INSERT operation indicators in full load CSV output for consistency with CDC operations

    maxFileSize?: number

    Maximum CSV file size in KB for S3 target during full load migration operations

    parquetTimestampInMillisecond?: boolean

    Flag to set TIMESTAMP column precision to milliseconds in Parquet files for Athena and Glue compatibility

    parquetVersion?: string

    Apache Parquet format version specification for S3 data lake columnar storage

    preserveTransactions?: boolean

    Flag to preserve transaction order for CDC loads in S3 target for data consistency

    rfc4180?: boolean

    Flag to enable RFC 4180 compliance for CSV quotation mark handling in S3 operations

    rowGroupLength?: number

    Number of rows in Parquet row group for read/write performance optimization

    serverSideEncryptionKmsKeyId: string

    KMS key ID for server-side encryption when using SSE_KMS encryption mode for S3 data lake security

    serviceAccessRoleArn?: string

    IAM role ARN for DMS service access to S3 bucket operations for data lake integration

    timestampColumnName?: string

    Timestamp column name for adding migration timing information to S3 data lake files

    useCsvNoSupValue?: boolean

    Flag to use CsvNoSupValue for columns not in supplemental log during CDC CSV operations

    useTaskStartTimeForFullLoadTimestamp?: boolean

    Flag to use task start time for full load timestamp column instead of data arrival time

    Settings

    Member Visibility

    On This Page

    Properties