GoogleApi.StorageTransfer.V1.Model.ObjectConditions (google_api_storage_transfer v0.26.4) View Source
Conditions that determine which objects will be transferred. Applies only to Cloud Data Sources such as S3, Azure, and Cloud Storage. The "last modification time" refers to the time of the last change to the object's content or metadata — specifically, this is the updated
property of Cloud Storage objects, the LastModified
field of S3 objects, and the Last-Modified
header of Azure blobs.
Attributes
-
excludePrefixes
(type:list(String.t)
, default:nil
) - If you specifyexclude_prefixes
, Storage Transfer Service uses the items in theexclude_prefixes
array to determine which objects to exclude from a transfer. Objects must not start with one of the matchingexclude_prefixes
for inclusion in a transfer. The following are requirements ofexclude_prefixes
: Each exclude-prefix can contain any sequence of Unicode characters, to a max length of 1024 bytes when UTF8-encoded, and must not contain Carriage Return or Line Feed characters. Wildcard matching and regular expression matching are not supported. Each exclude-prefix must omit the leading slash. For example, to exclude the objects3://my-aws-bucket/logs/y=2015/requests.gz
, specify the exclude-prefix aslogs/y=2015/requests.gz
. None of the exclude-prefix values can be empty, if specified. Each exclude-prefix must exclude a distinct portion of the object namespace. No exclude-prefix may be a prefix of another exclude-prefix. * If include_prefixes is specified, then each exclude-prefix must start with the value of a path explicitly included byinclude_prefixes
. The max size ofexclude_prefixes
is 1000. For more information, see Filtering objects from transfers. -
includePrefixes
(type:list(String.t)
, default:nil
) - If you specifyinclude_prefixes
, Storage Transfer Service uses the items in theinclude_prefixes
array to determine which objects to include in a transfer. Objects must start with one of the matchinginclude_prefixes
for inclusion in the transfer. If exclude_prefixes is specified, objects must not start with any of theexclude_prefixes
specified for inclusion in the transfer. The following are requirements ofinclude_prefixes
: Each include-prefix can contain any sequence of Unicode characters, to a max length of 1024 bytes when UTF8-encoded, and must not contain Carriage Return or Line Feed characters. Wildcard matching and regular expression matching are not supported. Each include-prefix must omit the leading slash. For example, to include the objects3://my-aws-bucket/logs/y=2015/requests.gz
, specify the include-prefix aslogs/y=2015/requests.gz
. None of the include-prefix values can be empty, if specified. Each include-prefix must include a distinct portion of the object namespace. No include-prefix may be a prefix of another include-prefix. The max size ofinclude_prefixes
is 1000. For more information, see Filtering objects from transfers. -
lastModifiedBefore
(type:DateTime.t
, default:nil
) - If specified, only objects with a "last modification time" before this timestamp and objects that don't have a "last modification time" will be transferred. -
lastModifiedSince
(type:DateTime.t
, default:nil
) - If specified, only objects with a "last modification time" on or after this timestamp and objects that don't have a "last modification time" are transferred. Thelast_modified_since
andlast_modified_before
fields can be used together for chunked data processing. For example, consider a script that processes each day's worth of data at a time. For that you'd set each of the fields as follows:last_modified_since
to the start of the daylast_modified_before
to the end of the day -
maxTimeElapsedSinceLastModification
(type:String.t
, default:nil
) - If specified, only objects with a "last modification time" on or afterNOW
-max_time_elapsed_since_last_modification
and objects that don't have a "last modification time" are transferred. For each TransferOperation started by this TransferJob,NOW
refers to the start_time of theTransferOperation
. -
minTimeElapsedSinceLastModification
(type:String.t
, default:nil
) - If specified, only objects with a "last modification time" beforeNOW
-min_time_elapsed_since_last_modification
and objects that don't have a "last modification time" are transferred. For each TransferOperation started by this TransferJob,NOW
refers to the start_time of theTransferOperation
.
Link to this section Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Link to this section Types
Specs
t() :: %GoogleApi.StorageTransfer.V1.Model.ObjectConditions{ excludePrefixes: [String.t()] | nil, includePrefixes: [String.t()] | nil, lastModifiedBefore: DateTime.t() | nil, lastModifiedSince: DateTime.t() | nil, maxTimeElapsedSinceLastModification: String.t() | nil, minTimeElapsedSinceLastModification: String.t() | nil }
Link to this section Functions
Specs
Unwrap a decoded JSON object into its complex fields.