Amazon Personalize- Exploration weight impact on recommendations

0

According to the documentation, with exploration weight as '0', there should be no exploration and the items returned should be based on relevance. With our testing we don't have the items returned completely based on relevance, it still returns popular items which the user has not interacted with at all. Our dataset has 50 users (with 100 interactions each) and also some 17 anonymous interactions (with no user_id and only session_id).

Is this an issue with the dataset somehow?

This is our user-item interaction schema example:

	"type": "record",
	"name": "Interactions",
	"namespace": "com.amazonaws.personalize.schema",
	"fields": [
		{
			"name": "USER_ID",
			"type": "string"
		},
		{
			"name": "ITEM_ID",
			"type": "string"
		},
		{
			"name": "EVENT_TYPE",
			"type": "string"
		},
		{
			"name": "DEVICE_TYPE",
			"type": "string"
		},
		{
			"name": "LOCATION",
			"type": "string"
		},
		{
			"name": "SESSION_ID",
			"type": [
				"null",
				"string"
			]
		},
		{
			"name": "TIMESTAMP",
			"type": "long"
		}
	]
}
  • 5K interactions for 50 users is an extremely small dataset. How many distinct items are in the dataset? What is the distribution of interaction counts across those items? What are the offline metrics from the model?

asked 2 years ago382 views
1 Answer
0

Hi there,

I believe there is always some innate error in the relevance but in this blog post are some ways to improve the relevance by leveraging contextual information.

Hope this helps make the recommendations more accurate and here is an additional resource to help you think about how you'd define/determine relevance.

Regards NN

answered 2 years ago

You are not logged in. Log in to post an answer.

A good answer clearly answers the question and provides constructive feedback and encourages professional growth in the question asker.

Guidelines for Answering Questions