By using AWS re:Post, you agree to the Terms of Use

Questions tagged with AWS DataSync

Sort by most recent

Browse through the questions and answers listed below or filter and sort to narrow down your results.

1
answers
0
votes
32
views
asked 7 days ago

AWS Datasync when executing a task and not finding changes to make, counts and charges Requests on an S3 Bucket when performing a verified on the directory / where N files are located ?????

Dear, a task was created in Datasync which transferred 8 files within a directory and subdirectories. My query is when reviewing the logs of the Datasync task, I observe that different requests are generated (created, transferred, verified). When executing a new Datasync task where no transfer was made because no new changes were detected, but when reviewing the task log again, I observed that the request was made on the root (verified directory /). My question is, when Datasync does not find a change to make, it makes N requests on the total number of files and directories that are already updated. Example: if I have 15,000 files updated on a bucket, and when executing a task again that does not make changes, will AWS still charge me and count for listing all the files that have already been transferred? I attach images where I only have 22 objects including directories, files and subdirectories, where 43 tasks were executed, of which 40 did not transfer files (only verified directory /), which, checking my cost manager, made about 1840 Requests (Put, Copy ,Post or List Request) to Amazon S3 ![![![Enter image description here](/media/postImages/original/IMr18LLdAzQ029NZYHaYyj6w) Enter image description here](/media/postImages/original/IM6a6FqBFvR3y9M2cc_47f3g) Enter image description here](/media/postImages/original/IM5rh_GTLaQaq5fKUyCZolkA)
1
answers
0
votes
37
views
asked a month ago

Amplify datastore stopped to sync

I am using the aws-amplify API to manipulate the datastore. Everything was going fine and all queries were running successfully until it stopped to work suddenly. In my case i am building an NPM package to wrap aws-amplify functionality with node and typescript. And another developer is using the package to build a native app with react-native. So when i implement new functions i test it locally with ts-node, something like DataStore.query or DataStore.Save ...etc, and the other developer is testing with expo after install the last package release i have done. Once we had a problem saying: ``` [WARN] 04:14.549 DataStore, Object { "cause": Object { "error": Object { "errors": Array [ Object { "message": "Connection failed: {\"errors\":{\"errorType\":\"MaxSubscriptionsReachedError\",\"message\":\"Max number of 100 subscriptions reached\"}}", }, ], }, ``` When it's happened, I tried to run queries locally and it work good with a warning: ``` [WARN] 33:35.743 DataStore - Realtime disabled when in a server-side environment ``` So we thought it is cache problem or something. But now nothing works at all in the dataStore. If i am trying to run code locally with ts-node, the console freeze and never comeback. For example if i do: `await DataStore.query(AccountDetails, "a6603b3e-4ae1-4f6c-9360-bd82fe01dd0d")` the console will freeze with the warning message: ![Enter image description here](https://repost.aws/media/postImages/original/IMdp4AdBO9SAuBC8xX8R_rtg) We tried to fix appSync and subscriptions but it is not working at all. Cognito user pool works good, S3 also good, only datastore is sad :( ``` // How we configure amplify this.awsExports = Amplify.configure({ ...awsConfig }); // How we import Datastore import {DataStore} from "@aws-amplify/datastore"; // Our dependencies "dependencies": { "@aws-amplify/core": "^4.6.0", "@aws-amplify/datastore": "^3.12.4", "@react-native-async-storage/async-storage": "^1.17.4", "@react-native-community/netinfo": "^8.3.0", "@types/amplify": "^1.1.25", "algoliasearch": "^4.14.1", "aws-amplify": "^4.3.29", "aws-amplify-react-native": "^6.0.5", "aws-sdk": "^2.1142.0", "aws-sdk-mock": "^5.7.0", "eslint-plugin-jsdoc": "^39.2.9", "mustache": "^4.2.0" } ``` Please any one can help?
0
answers
0
votes
56
views
asked 2 months ago