How to increase the Speed of a Deep Racer Car in Virtual Race(Time Trial)?

0

Hello there Deepracers!(#aws-deepracer) I'm hoping you could offer some suggestions or guidance on my reward function. I'm seeking assistance and suggestions regarding my reward function. I've experimented with various approaches to create a reward function that handles the track better. I've developed two different approaches where the reward function performs admirably, allowing the agent to successfully complete the race without any resets or going off-track. However, I've encountered a challenge: the agent's speed is too slow. Despite conducting multiple tests, such as offering rewards relative to motivating the agent to reach its maximum speed, hard-coding speed values, and introducing conditions to monitor and manipulate speed, I haven't seen any improvement in the agent's speed. I'm open to any suggestions or advice you may have for me. Any tips or solutions you can share with me would be greatly appreciated!

gefragt vor einem Jahr1705 Aufrufe
2 Antworten
0

Please specify if you are in the deepracer league or deepracer student league. It would fundementally change our answer to you. What a lot of people do not grasp is speed is a fixed value from your action space. People will see the video and think they can reward above max speed. The other issue is reward = speed or reward = speed + some other reward behavior are bad reward function.

Without going into the math these reward function will prompt the car to go slower because highest overall reward is achieved. Ultimately the cars goal is to get the highest reward. This means analyzing your reward function is vital to understand if you shaped your reward correctly. Lower steps will be faster laps.

Jerec
beantwortet vor einem Jahr
  • Thank you for your response. I am a participant in the Deepracer student league. Currently, I am utilizing the relative speed and reward features in one of my models, also another one with the step functionality with a maximum of 300 steps. However, I am curious to know if there are alternative options for achieving maximum speed if we do not use the speed parameter in this way. Can you suggest any other approaches?

Du bist nicht angemeldet. Anmelden um eine Antwort zu veröffentlichen.

Eine gute Antwort beantwortet die Frage klar, gibt konstruktives Feedback und fördert die berufliche Weiterentwicklung des Fragenstellers.

Richtlinien für die Beantwortung von Fragen