1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519
|
// Code generated by smithy-go-codegen DO NOT EDIT.
package dynamodb
import (
"context"
"fmt"
awsmiddleware "github.com/aws/aws-sdk-go-v2/aws/middleware"
"github.com/aws/aws-sdk-go-v2/aws/signer/v4"
"github.com/aws/aws-sdk-go-v2/service/dynamodb/types"
internalEndpointDiscovery "github.com/aws/aws-sdk-go-v2/service/internal/endpoint-discovery"
"github.com/aws/smithy-go/middleware"
smithyhttp "github.com/aws/smithy-go/transport/http"
)
// The Scan operation returns one or more items and item attributes by accessing
// every item in a table or a secondary index. To have DynamoDB return fewer items,
// you can provide a FilterExpression operation. If the total size of scanned
// items exceeds the maximum dataset size limit of 1 MB, the scan completes and
// results are returned to the user. The LastEvaluatedKey value is also returned
// and the requestor can use the LastEvaluatedKey to continue the scan in a
// subsequent operation. Each scan response also includes number of items that were
// scanned (ScannedCount) as part of the request. If using a FilterExpression , a
// scan result can result in no items meeting the criteria and the Count will
// result in zero. If you did not use a FilterExpression in the scan request, then
// Count is the same as ScannedCount . Count and ScannedCount only return the
// count of items specific to a single scan request and, unless the table is less
// than 1MB, do not represent the total number of items in the table. A single Scan
// operation first reads up to the maximum number of items set (if using the Limit
// parameter) or a maximum of 1 MB of data and then applies any filtering to the
// results if a FilterExpression is provided. If LastEvaluatedKey is present in
// the response, pagination is required to complete the full table scan. For more
// information, see Paginating the Results (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Scan.html#Scan.Pagination)
// in the Amazon DynamoDB Developer Guide. Scan operations proceed sequentially;
// however, for faster performance on a large table or secondary index,
// applications can request a parallel Scan operation by providing the Segment and
// TotalSegments parameters. For more information, see Parallel Scan (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Scan.html#Scan.ParallelScan)
// in the Amazon DynamoDB Developer Guide. By default, a Scan uses eventually
// consistent reads when accessing the items in a table. Therefore, the results
// from an eventually consistent Scan may not include the latest item changes at
// the time the scan iterates through each item in the table. If you require a
// strongly consistent read of each item as the scan iterates through the items in
// the table, you can set the ConsistentRead parameter to true. Strong consistency
// only relates to the consistency of the read at the item level. DynamoDB does not
// provide snapshot isolation for a scan operation when the ConsistentRead
// parameter is set to true. Thus, a DynamoDB scan operation does not guarantee
// that all reads in a scan see a consistent snapshot of the table when the scan
// operation was requested.
func (c *Client) Scan(ctx context.Context, params *ScanInput, optFns ...func(*Options)) (*ScanOutput, error) {
if params == nil {
params = &ScanInput{}
}
result, metadata, err := c.invokeOperation(ctx, "Scan", params, optFns, c.addOperationScanMiddlewares)
if err != nil {
return nil, err
}
out := result.(*ScanOutput)
out.ResultMetadata = metadata
return out, nil
}
// Represents the input of a Scan operation.
type ScanInput struct {
// The name of the table containing the requested items; or, if you provide
// IndexName , the name of the table to which that index belongs.
//
// This member is required.
TableName *string
// This is a legacy parameter. Use ProjectionExpression instead. For more
// information, see AttributesToGet (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/LegacyConditionalParameters.AttributesToGet.html)
// in the Amazon DynamoDB Developer Guide.
AttributesToGet []string
// This is a legacy parameter. Use FilterExpression instead. For more information,
// see ConditionalOperator (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/LegacyConditionalParameters.ConditionalOperator.html)
// in the Amazon DynamoDB Developer Guide.
ConditionalOperator types.ConditionalOperator
// A Boolean value that determines the read consistency model during the scan:
// - If ConsistentRead is false , then the data returned from Scan might not
// contain the results from other recently completed write operations ( PutItem ,
// UpdateItem , or DeleteItem ).
// - If ConsistentRead is true , then all of the write operations that completed
// before the Scan began are guaranteed to be contained in the Scan response.
// The default setting for ConsistentRead is false . The ConsistentRead parameter
// is not supported on global secondary indexes. If you scan a global secondary
// index with ConsistentRead set to true, you will receive a ValidationException .
ConsistentRead *bool
// The primary key of the first item that this operation will evaluate. Use the
// value that was returned for LastEvaluatedKey in the previous operation. The
// data type for ExclusiveStartKey must be String, Number or Binary. No set data
// types are allowed. In a parallel scan, a Scan request that includes
// ExclusiveStartKey must specify the same segment whose previous Scan returned
// the corresponding value of LastEvaluatedKey .
ExclusiveStartKey map[string]types.AttributeValue
// One or more substitution tokens for attribute names in an expression. The
// following are some use cases for using ExpressionAttributeNames :
// - To access an attribute whose name conflicts with a DynamoDB reserved word.
// - To create a placeholder for repeating occurrences of an attribute name in
// an expression.
// - To prevent special characters in an attribute name from being
// misinterpreted in an expression.
// Use the # character in an expression to dereference an attribute name. For
// example, consider the following attribute name:
// - Percentile
// The name of this attribute conflicts with a reserved word, so it cannot be used
// directly in an expression. (For the complete list of reserved words, see
// Reserved Words (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ReservedWords.html)
// in the Amazon DynamoDB Developer Guide). To work around this, you could specify
// the following for ExpressionAttributeNames :
// - {"#P":"Percentile"}
// You could then use this substitution in an expression, as in this example:
// - #P = :val
// Tokens that begin with the : character are expression attribute values, which
// are placeholders for the actual value at runtime. For more information on
// expression attribute names, see Specifying Item Attributes (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Expressions.AccessingItemAttributes.html)
// in the Amazon DynamoDB Developer Guide.
ExpressionAttributeNames map[string]string
// One or more values that can be substituted in an expression. Use the : (colon)
// character in an expression to dereference an attribute value. For example,
// suppose that you wanted to check whether the value of the ProductStatus
// attribute was one of the following: Available | Backordered | Discontinued You
// would first need to specify ExpressionAttributeValues as follows: {
// ":avail":{"S":"Available"}, ":back":{"S":"Backordered"},
// ":disc":{"S":"Discontinued"} } You could then use these values in an expression,
// such as this: ProductStatus IN (:avail, :back, :disc) For more information on
// expression attribute values, see Condition Expressions (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Expressions.SpecifyingConditions.html)
// in the Amazon DynamoDB Developer Guide.
ExpressionAttributeValues map[string]types.AttributeValue
// A string that contains conditions that DynamoDB applies after the Scan
// operation, but before the data is returned to you. Items that do not satisfy the
// FilterExpression criteria are not returned. A FilterExpression is applied after
// the items have already been read; the process of filtering does not consume any
// additional read capacity units. For more information, see Filter Expressions (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Scan.html#Scan.FilterExpression)
// in the Amazon DynamoDB Developer Guide.
FilterExpression *string
// The name of a secondary index to scan. This index can be any local secondary
// index or global secondary index. Note that if you use the IndexName parameter,
// you must also provide TableName .
IndexName *string
// The maximum number of items to evaluate (not necessarily the number of matching
// items). If DynamoDB processes the number of items up to the limit while
// processing the results, it stops the operation and returns the matching values
// up to that point, and a key in LastEvaluatedKey to apply in a subsequent
// operation, so that you can pick up where you left off. Also, if the processed
// dataset size exceeds 1 MB before DynamoDB reaches this limit, it stops the
// operation and returns the matching values up to the limit, and a key in
// LastEvaluatedKey to apply in a subsequent operation to continue the operation.
// For more information, see Working with Queries (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/QueryAndScan.html)
// in the Amazon DynamoDB Developer Guide.
Limit *int32
// A string that identifies one or more attributes to retrieve from the specified
// table or index. These attributes can include scalars, sets, or elements of a
// JSON document. The attributes in the expression must be separated by commas. If
// no attribute names are specified, then all attributes will be returned. If any
// of the requested attributes are not found, they will not appear in the result.
// For more information, see Specifying Item Attributes (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Expressions.AccessingItemAttributes.html)
// in the Amazon DynamoDB Developer Guide.
ProjectionExpression *string
// Determines the level of detail about either provisioned or on-demand throughput
// consumption that is returned in the response:
// - INDEXES - The response includes the aggregate ConsumedCapacity for the
// operation, together with ConsumedCapacity for each table and secondary index
// that was accessed. Note that some operations, such as GetItem and BatchGetItem
// , do not access any indexes at all. In these cases, specifying INDEXES will
// only return ConsumedCapacity information for table(s).
// - TOTAL - The response includes only the aggregate ConsumedCapacity for the
// operation.
// - NONE - No ConsumedCapacity details are included in the response.
ReturnConsumedCapacity types.ReturnConsumedCapacity
// This is a legacy parameter. Use FilterExpression instead. For more information,
// see ScanFilter (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/LegacyConditionalParameters.ScanFilter.html)
// in the Amazon DynamoDB Developer Guide.
ScanFilter map[string]types.Condition
// For a parallel Scan request, Segment identifies an individual segment to be
// scanned by an application worker. Segment IDs are zero-based, so the first
// segment is always 0. For example, if you want to use four application threads to
// scan a table or an index, then the first thread specifies a Segment value of 0,
// the second thread specifies 1, and so on. The value of LastEvaluatedKey
// returned from a parallel Scan request must be used as ExclusiveStartKey with
// the same segment ID in a subsequent Scan operation. The value for Segment must
// be greater than or equal to 0, and less than the value provided for
// TotalSegments . If you provide Segment , you must also provide TotalSegments .
Segment *int32
// The attributes to be returned in the result. You can retrieve all item
// attributes, specific item attributes, the count of matching items, or in the
// case of an index, some or all of the attributes projected into the index.
// - ALL_ATTRIBUTES - Returns all of the item attributes from the specified table
// or index. If you query a local secondary index, then for each matching item in
// the index, DynamoDB fetches the entire item from the parent table. If the index
// is configured to project all item attributes, then all of the data can be
// obtained from the local secondary index, and no fetching is required.
// - ALL_PROJECTED_ATTRIBUTES - Allowed only when querying an index. Retrieves
// all attributes that have been projected into the index. If the index is
// configured to project all attributes, this return value is equivalent to
// specifying ALL_ATTRIBUTES .
// - COUNT - Returns the number of matching items, rather than the matching items
// themselves. Note that this uses the same quantity of read capacity units as
// getting the items, and is subject to the same item size calculations.
// - SPECIFIC_ATTRIBUTES - Returns only the attributes listed in
// ProjectionExpression . This return value is equivalent to specifying
// ProjectionExpression without specifying any value for Select . If you query or
// scan a local secondary index and request only attributes that are projected into
// that index, the operation reads only the index and not the table. If any of the
// requested attributes are not projected into the local secondary index, DynamoDB
// fetches each of these attributes from the parent table. This extra fetching
// incurs additional throughput cost and latency. If you query or scan a global
// secondary index, you can only request attributes that are projected into the
// index. Global secondary index queries cannot fetch attributes from the parent
// table.
// If neither Select nor ProjectionExpression are specified, DynamoDB defaults to
// ALL_ATTRIBUTES when accessing a table, and ALL_PROJECTED_ATTRIBUTES when
// accessing an index. You cannot use both Select and ProjectionExpression
// together in a single request, unless the value for Select is SPECIFIC_ATTRIBUTES
// . (This usage is equivalent to specifying ProjectionExpression without any
// value for Select .) If you use the ProjectionExpression parameter, then the
// value for Select can only be SPECIFIC_ATTRIBUTES . Any other value for Select
// will return an error.
Select types.Select
// For a parallel Scan request, TotalSegments represents the total number of
// segments into which the Scan operation will be divided. The value of
// TotalSegments corresponds to the number of application workers that will perform
// the parallel scan. For example, if you want to use four application threads to
// scan a table or an index, specify a TotalSegments value of 4. The value for
// TotalSegments must be greater than or equal to 1, and less than or equal to
// 1000000. If you specify a TotalSegments value of 1, the Scan operation will be
// sequential rather than parallel. If you specify TotalSegments , you must also
// specify Segment .
TotalSegments *int32
noSmithyDocumentSerde
}
// Represents the output of a Scan operation.
type ScanOutput struct {
// The capacity units consumed by the Scan operation. The data returned includes
// the total provisioned throughput consumed, along with statistics for the table
// and any indexes involved in the operation. ConsumedCapacity is only returned if
// the ReturnConsumedCapacity parameter was specified. For more information, see
// Provisioned Throughput (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/ProvisionedThroughput.html#ItemSizeCalculations.Reads)
// in the Amazon DynamoDB Developer Guide.
ConsumedCapacity *types.ConsumedCapacity
// The number of items in the response. If you set ScanFilter in the request, then
// Count is the number of items returned after the filter was applied, and
// ScannedCount is the number of matching items before the filter was applied. If
// you did not use a filter in the request, then Count is the same as ScannedCount .
Count int32
// An array of item attributes that match the scan criteria. Each element in this
// array consists of an attribute name and the value for that attribute.
Items []map[string]types.AttributeValue
// The primary key of the item where the operation stopped, inclusive of the
// previous result set. Use this value to start a new operation, excluding this
// value in the new request. If LastEvaluatedKey is empty, then the "last page" of
// results has been processed and there is no more data to be retrieved. If
// LastEvaluatedKey is not empty, it does not necessarily mean that there is more
// data in the result set. The only way to know when you have reached the end of
// the result set is when LastEvaluatedKey is empty.
LastEvaluatedKey map[string]types.AttributeValue
// The number of items evaluated, before any ScanFilter is applied. A high
// ScannedCount value with few, or no, Count results indicates an inefficient Scan
// operation. For more information, see Count and ScannedCount (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/QueryAndScan.html#Count)
// in the Amazon DynamoDB Developer Guide. If you did not use a filter in the
// request, then ScannedCount is the same as Count .
ScannedCount int32
// Metadata pertaining to the operation's result.
ResultMetadata middleware.Metadata
noSmithyDocumentSerde
}
func (c *Client) addOperationScanMiddlewares(stack *middleware.Stack, options Options) (err error) {
if err := stack.Serialize.Add(&setOperationInputMiddleware{}, middleware.After); err != nil {
return err
}
err = stack.Serialize.Add(&awsAwsjson10_serializeOpScan{}, middleware.After)
if err != nil {
return err
}
err = stack.Deserialize.Add(&awsAwsjson10_deserializeOpScan{}, middleware.After)
if err != nil {
return err
}
if err := addProtocolFinalizerMiddlewares(stack, options, "Scan"); err != nil {
return fmt.Errorf("add protocol finalizers: %v", err)
}
if err = addlegacyEndpointContextSetter(stack, options); err != nil {
return err
}
if err = addSetLoggerMiddleware(stack, options); err != nil {
return err
}
if err = awsmiddleware.AddClientRequestIDMiddleware(stack); err != nil {
return err
}
if err = smithyhttp.AddComputeContentLengthMiddleware(stack); err != nil {
return err
}
if err = addResolveEndpointMiddleware(stack, options); err != nil {
return err
}
if err = v4.AddComputePayloadSHA256Middleware(stack); err != nil {
return err
}
if err = addRetryMiddlewares(stack, options); err != nil {
return err
}
if err = awsmiddleware.AddRawResponseToMetadata(stack); err != nil {
return err
}
if err = awsmiddleware.AddRecordResponseTiming(stack); err != nil {
return err
}
if err = addClientUserAgent(stack, options); err != nil {
return err
}
if err = smithyhttp.AddErrorCloseResponseBodyMiddleware(stack); err != nil {
return err
}
if err = smithyhttp.AddCloseResponseBodyMiddleware(stack); err != nil {
return err
}
if err = addOpScanDiscoverEndpointMiddleware(stack, options, c); err != nil {
return err
}
if err = addSetLegacyContextSigningOptionsMiddleware(stack); err != nil {
return err
}
if err = addOpScanValidationMiddleware(stack); err != nil {
return err
}
if err = stack.Initialize.Add(newServiceMetadataMiddleware_opScan(options.Region), middleware.Before); err != nil {
return err
}
if err = awsmiddleware.AddRecursionDetection(stack); err != nil {
return err
}
if err = addRequestIDRetrieverMiddleware(stack); err != nil {
return err
}
if err = addResponseErrorMiddleware(stack); err != nil {
return err
}
if err = addValidateResponseChecksum(stack, options); err != nil {
return err
}
if err = addAcceptEncodingGzip(stack, options); err != nil {
return err
}
if err = addRequestResponseLogging(stack, options); err != nil {
return err
}
if err = addDisableHTTPSMiddleware(stack, options); err != nil {
return err
}
return nil
}
func addOpScanDiscoverEndpointMiddleware(stack *middleware.Stack, o Options, c *Client) error {
return stack.Finalize.Insert(&internalEndpointDiscovery.DiscoverEndpoint{
Options: []func(*internalEndpointDiscovery.DiscoverEndpointOptions){
func(opt *internalEndpointDiscovery.DiscoverEndpointOptions) {
opt.DisableHTTPS = o.EndpointOptions.DisableHTTPS
opt.Logger = o.Logger
},
},
DiscoverOperation: c.fetchOpScanDiscoverEndpoint,
EndpointDiscoveryEnableState: o.EndpointDiscovery.EnableEndpointDiscovery,
EndpointDiscoveryRequired: false,
Region: o.Region,
}, "ResolveEndpointV2", middleware.After)
}
func (c *Client) fetchOpScanDiscoverEndpoint(ctx context.Context, region string, optFns ...func(*internalEndpointDiscovery.DiscoverEndpointOptions)) (internalEndpointDiscovery.WeightedAddress, error) {
input := getOperationInput(ctx)
in, ok := input.(*ScanInput)
if !ok {
return internalEndpointDiscovery.WeightedAddress{}, fmt.Errorf("unknown input type %T", input)
}
_ = in
identifierMap := make(map[string]string, 0)
identifierMap["sdk#Region"] = region
key := fmt.Sprintf("DynamoDB.%v", identifierMap)
if v, ok := c.endpointCache.Get(key); ok {
return v, nil
}
discoveryOperationInput := &DescribeEndpointsInput{}
opt := internalEndpointDiscovery.DiscoverEndpointOptions{}
for _, fn := range optFns {
fn(&opt)
}
go c.handleEndpointDiscoveryFromService(ctx, discoveryOperationInput, region, key, opt)
return internalEndpointDiscovery.WeightedAddress{}, nil
}
// ScanAPIClient is a client that implements the Scan operation.
type ScanAPIClient interface {
Scan(context.Context, *ScanInput, ...func(*Options)) (*ScanOutput, error)
}
var _ ScanAPIClient = (*Client)(nil)
// ScanPaginatorOptions is the paginator options for Scan
type ScanPaginatorOptions struct {
// The maximum number of items to evaluate (not necessarily the number of matching
// items). If DynamoDB processes the number of items up to the limit while
// processing the results, it stops the operation and returns the matching values
// up to that point, and a key in LastEvaluatedKey to apply in a subsequent
// operation, so that you can pick up where you left off. Also, if the processed
// dataset size exceeds 1 MB before DynamoDB reaches this limit, it stops the
// operation and returns the matching values up to the limit, and a key in
// LastEvaluatedKey to apply in a subsequent operation to continue the operation.
// For more information, see Working with Queries (https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/QueryAndScan.html)
// in the Amazon DynamoDB Developer Guide.
Limit int32
}
// ScanPaginator is a paginator for Scan
type ScanPaginator struct {
options ScanPaginatorOptions
client ScanAPIClient
params *ScanInput
nextToken map[string]types.AttributeValue
firstPage bool
}
// NewScanPaginator returns a new ScanPaginator
func NewScanPaginator(client ScanAPIClient, params *ScanInput, optFns ...func(*ScanPaginatorOptions)) *ScanPaginator {
if params == nil {
params = &ScanInput{}
}
options := ScanPaginatorOptions{}
if params.Limit != nil {
options.Limit = *params.Limit
}
for _, fn := range optFns {
fn(&options)
}
return &ScanPaginator{
options: options,
client: client,
params: params,
firstPage: true,
nextToken: params.ExclusiveStartKey,
}
}
// HasMorePages returns a boolean indicating whether more pages are available
func (p *ScanPaginator) HasMorePages() bool {
return p.firstPage || p.nextToken != nil
}
// NextPage retrieves the next Scan page.
func (p *ScanPaginator) NextPage(ctx context.Context, optFns ...func(*Options)) (*ScanOutput, error) {
if !p.HasMorePages() {
return nil, fmt.Errorf("no more pages available")
}
params := *p.params
params.ExclusiveStartKey = p.nextToken
var limit *int32
if p.options.Limit > 0 {
limit = &p.options.Limit
}
params.Limit = limit
result, err := p.client.Scan(ctx, ¶ms, optFns...)
if err != nil {
return nil, err
}
p.firstPage = false
prevToken := p.nextToken
p.nextToken = result.LastEvaluatedKey
_ = prevToken
return result, nil
}
func newServiceMetadataMiddleware_opScan(region string) *awsmiddleware.RegisterServiceMetadata {
return &awsmiddleware.RegisterServiceMetadata{
Region: region,
ServiceID: ServiceID,
OperationName: "Scan",
}
}
|