SageMaker Feature Store pricing
SageMaker Feature Store is full of questions for me, ever since I started working with it.
The thing which is absolutely not clear for me is about integration with Athena/Glue. Since there is no built-in option in FeatureStore to, for instance, get all records, or get records by criteria, I have to use AthenaQuery branched off the FeatureGroup for that purpose.
In case if I do something like
feature_group = FeatureGroup(name='<...>', sagemaker_session=sagemaker_session)
query = feature_group.athena_query()
query.run('SELECT * FROM <whatever> LIMIT 1000', output_location='s3://...')
query.wait()
query.as_dataframe()
Will I also be charged for querying Athena? What's about Hive? If yes, then what's the purpose of using FeatureStore? It's API is too poor for implementing continuous training, - I'm instead forced to use at least Athena, and, therefore, pay for the extra service besides I already pay for FeatureStore.
Hi there,
To answer your question, yes you will be charged for using Athena to query Feature Store. There won't be charges for using feature_group.as_hive_ddl()
since it's DDL.
Feature Store is a fully managed, purpose-built repository for ML features and while Athena is one way to query Feature Store, you can also get records from Feature Store using the Feature Store Runtime. This does not incur costs for an extra service.
Relevant questions
SageMaker Feature Store pricing
asked 2 months agoHow can we store feature transforms in a feature store?
Accepted Answerasked a month agoAamazon SageMaker feature store throughput and latency
asked 5 months agoFeature names Mapping in Sagemaker
asked 14 days agoSageMaker AutoPilot Regions
Accepted Answerasked 2 years ago[Feature Request] Serverless Inference with VPC Config
asked 4 months agoAuto rollback with Guardrails if model accuracy is not good
asked 4 months agosagemaker online and offline store question
asked 4 months agoTrain machine learning model using reserved instance
Accepted Answerasked 4 months agoHow do I check my current SageMaker service quotas?
Accepted Answerasked 4 months ago
So, when I'm planning cost efforts in AWS Calculator, after calculating SageMaker Feature Store, should I also add Athena as a separate service, or it's already included in the Feature Store cost estimate?