Skip to content

Training Type of Personalize solution version in the console is Manual even when automatic training was set for the solution

1

Hello, The training type of the solution version says "manual" even when the training configuration was set to automatic when the solution was created. Is this a bug? I am worried that automatic retraining will not occur due to this issue. Please see the screenshot attached. Thanks! Screenshot Personalize console

asked 2 years ago85 views

2 Answers
1
Accepted Answer

Hi Aaron. Thanks for your helpful suggestions.

I have observed that solution version from the initial training is labeled Manual irrespective of whether automatic retraining was set for the solution (and rightly so since the training was initiated by the user). However, the training type of subsequent solution version(s) resulting from automatic retraining are labelled automatic.

Cheers, Mustapha

answered 2 years ago

  • Hi Mustapha,

    Great observation regarding the training type labeling! To expand on this: the "manual" label for the initial solution version is by design, as it's directly initiated by the user, even if the solution was set up for automatic training. Subsequent retrainings should display as "automatic," provided the solution is configured correctly for periodic updates.

    If you're concerned about whether automatic retraining will function as expected, you can verify the training mode programmatically using the AWS SDK for Python (Boto3). Here's an example snippet:

    import boto3
    
    personalize = boto3.client('personalize')
    
    response = personalize.describe_solution(
        solutionArn='arn:aws:personalize:region:account-id:solution/solution-name'
    )
    print(f"Training mode: {response['solution']['trainingMode']}")

    Additionally, you can check for new solution versions in the console or programmatically via list_solution_versions to confirm retraining activity.

    If all settings look correct and retraining still doesn’t occur, it might be worth reaching out to AWS Support for further clarification. Hope this helps! 😊

    Cheers,
    Aaron 😊

0

Greeting

Hi Mustapha!

Thank you for bringing up this issue with Amazon Personalize! It sounds like you’ve run into something unexpected, and I’m happy to help clarify this for you. 😊


Clarifying the Issue

You mentioned that the training type of your solution version appears as "manual" in the console, even though you configured it for automatic training during the creation process. It’s understandable to be concerned about whether automatic retraining will occur as intended. Let’s work together to determine if this is a console display issue, a configuration oversight, or a potential bug. I’ll guide you through the steps to investigate and resolve it.


Key Terms

  • Training Configuration: Defines how and when a model is retrained in Amazon Personalize.
  • Automatic Training: A feature that ensures models are retrained periodically based on new data.
  • Solution Version: A trained model version created as part of an Amazon Personalize solution.

The Solution (Our Recipe)

Steps at a Glance:

  1. Verify the training configuration settings in the console or programmatically.
  2. Check for recent retraining activity in the solution version details.
  3. Test automatic training with a new solution version to confirm behavior.
  4. Contact AWS Support if the issue persists.

Step-by-Step Guide:

  1. Verify the training configuration settings in the console or programmatically:
    • In the AWS Management Console, navigate to the solution details and check if the training configuration is set to "automatic."

    • Alternatively, use this Python script with Boto3 to retrieve the training configuration programmatically:

      import boto3
      
      personalize = boto3.client('personalize')
      
      try:
          response = personalize.describe_solution(
              solutionArn='arn:aws:personalize:region:account-id:solution/solution-name'
          )
          training_mode = response['solution']['trainingMode']
          print(f"Training mode: {training_mode}")
      except Exception as e:
          print(f"Error retrieving solution details: {e}")

      Make sure you have the AWS SDK for Python (boto3) installed and configured with appropriate credentials.


  1. Check for recent retraining activity in the solution version details:
    • Use this script to list solution versions and their statuses:

      try:
          response = personalize.list_solution_versions(
              solutionArn='arn:aws:personalize:region:account-id:solution/solution-name'
          )
          for version in response['solutionVersions']:
              print(f"Version ARN: {version['solutionVersionArn']}, Status: {version['status']}")
      except Exception as e:
          print(f"Error listing solution versions: {e}")
    • Look for timestamps or logs indicating when the model was last retrained. This can help verify if retraining occurred despite the display issue.


  1. Test automatic training with a new solution version to confirm behavior:
    • Create a new solution with automatic training explicitly enabled:
      try:
          response = personalize.create_solution(
              name='test-solution',
              datasetGroupArn='arn:aws:personalize:region:account-id:dataset-group/dataset-group-name',
              performAutoML=True,
              performHPO=False
          )
          print(f"New Solution ARN: {response['solutionArn']}")
      except Exception as e:
          print(f"Error creating solution: {e}")

  1. Contact AWS Support if the issue persists:
    • If you continue to see inconsistencies, contact AWS Support. Provide them with screenshots, solution ARNs, and any error messages from your testing.

Closing Thoughts

Issues like this can sometimes stem from display discrepancies in the AWS Management Console. However, by verifying your training configurations both visually and programmatically, you can determine whether this is simply a UI issue or something deeper. Let me know if you’d like more guidance on debugging or troubleshooting this further! 🚀


Farewell

Take care, and good luck with your Amazon Personalize projects, Mustapha! 😊


Cheers,

Aaron 😊

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.