How to increase the Speed of a Deep Racer Car in Virtual Race(Time Trial)?

0

Hello there Deepracers!(#aws-deepracer) I'm hoping you could offer some suggestions or guidance on my reward function. I'm seeking assistance and suggestions regarding my reward function. I've experimented with various approaches to create a reward function that handles the track better. I've developed two different approaches where the reward function performs admirably, allowing the agent to successfully complete the race without any resets or going off-track. However, I've encountered a challenge: the agent's speed is too slow. Despite conducting multiple tests, such as offering rewards relative to motivating the agent to reach its maximum speed, hard-coding speed values, and introducing conditions to monitor and manipulate speed, I haven't seen any improvement in the agent's speed. I'm open to any suggestions or advice you may have for me. Any tips or solutions you can share with me would be greatly appreciated!

질문됨 일 년 전1723회 조회
2개 답변
0

Please specify if you are in the deepracer league or deepracer student league. It would fundementally change our answer to you. What a lot of people do not grasp is speed is a fixed value from your action space. People will see the video and think they can reward above max speed. The other issue is reward = speed or reward = speed + some other reward behavior are bad reward function.

Without going into the math these reward function will prompt the car to go slower because highest overall reward is achieved. Ultimately the cars goal is to get the highest reward. This means analyzing your reward function is vital to understand if you shaped your reward correctly. Lower steps will be faster laps.

Jerec
답변함 일 년 전
  • Thank you for your response. I am a participant in the Deepracer student league. Currently, I am utilizing the relative speed and reward features in one of my models, also another one with the step functionality with a maximum of 300 steps. However, I am curious to know if there are alternative options for achieving maximum speed if we do not use the speed parameter in this way. Can you suggest any other approaches?

로그인하지 않았습니다. 로그인해야 답변을 게시할 수 있습니다.

좋은 답변은 질문에 명확하게 답하고 건설적인 피드백을 제공하며 질문자의 전문적인 성장을 장려합니다.

질문 답변하기에 대한 가이드라인

관련 콘텐츠