What is good Action Space and Hyperparameter for Kumo Torakku track?

0

I've created a model for Kumo Torakku track and got 26 seconds lap time.
Actually the model was cloned from others. (Straight Track -> Oval Track -> London Loop).

Repetition of training does not reduce lap time.

I used hyperparameter as default and changed the Maximum speed to 5 in Action Space.
(Others are as default. Steering 30, Steering angle granularity 5, Speed granularity 2)

Since I'm familiar with coding, I tried multiple things with reward_function.
i.e. distance from center, all wheels on track, steering threshold, speed penalty etc.

As I said, there is no improvement at all with this configuration for Kumo Torakku.

So I will create new Model.

Anybody recommend any Action Space configuration for Kumo Torakku to get better results please?

Maximum steering angle :
Steering angle granualrity :
Maximum speed :
Speed granuality :

I have read documents for Hyperparameters but no idea what those are. ;(

Anybody can recommend good Hyperparameters configuration for Kumo Torakku please?

已提問 5 年前檢視次數 1091 次
8 個答案
0

Hi Changsoo

Hyperparameters directly impact how the model is updated, they control the settings of the optimization algorithm that is used to "solve" for the model that gives the maximum expected cumulative return. Changing hyperparameters can improve the convergence of the model, or worsen it. For example, if you increase the learning rate, the weights in your neural network will update with larger increments. The model may improve (train) faster but the risk is that you miss the optimal solution, or the model never converges as updates are too large. Finding good hyperparameters often required trying a number of different combinations and then evaluating the performance of the model vs time spent training or some other metric. For example, I am busy training a 3m/s model (with 2 speed granularity) using a learning race of 0.001 and a low number of epochs. I can see during training at around 90 minutes my model is starting to do a lap now and then. If the learning rate was smaller, it would probably take longer for my model to complete a lap.

Note that at 3m/s my model will not be as fast as a converged 5m/s (or faster) model, but those will take a long time to converge. We increased the training speed in the console to a max of 8 m/s. Training at speeds faster than 8m/s tends to send the model spinning off the track.

Kind regards
De Clercq

已回答 5 年前
0

Hi Changsoo

I did the following tests overnight to show impact of hyperparameters

Trained 4 models on the Kumo Torakku training, each for 180 minutes, using my own reward function that does some center line following, scales reward for driving fast etc.
I alternated

Model 1: 3 m/s 2 speed granularity with learning rate = 0.001 and epochs = 3
Model 2: 3 m/s 2 speed granularity with default hyperparameters

Model 3: 5 m/s 2 speed granularity with learning rate = 0.001 and epochs = 3
Model 4: 5 m/s 2 speed granularity with default hyperparameters

Doing 5 lap evaluation on Kumo Torakku training, showing lap completion percentages

Model 1: 100% 100% 100% 100% 100%
Model 2: 46% 67% 61% 100% 62%

Model 3: 70% 58% 100% 100% 100%
Model 4: 63% 88% 100% 36% 27%

This shows you the impact of playing with the hyperparameters.

Kind regards
De Clercq

已回答 5 年前
0

Thanks a lot.
It has been a great help.

已回答 5 年前
0

I copied all these waypoints out from the kumo log if it helps anyone.
https://gist.github.com/joezen777/98daa6496acf6a6df3269f253f9388f9

已回答 5 年前
0

Hi

To get the waypoints you can download the track's .npy file and use the code in the log-analysis workbook to extract them

Log-analysis is here
https://github.com/aws-samples/aws-deepracer-workshops/tree/master/log-analysis

Track npys are here
https://github.com/aws-samples/aws-deepracer-workshops/tree/master/log-analysis/tracks

See breadcentric's blog on how to use log-analysis (link is in the Pit Stop page)
https://aws.amazon.com/deepracer/racing-tips/

Kind regards
De Clercq

已回答 5 年前
0

Hi @DeClercq-AWS,

I'm using your script, but i have a couple of questions:

1- Are Yaw and Steering on Degrees or Radians? It seems to be in Radians.
2- How can we include other parameters?
3- It seems Track Width is not returning the right value. How can we confirm?
4- Is Progress defined from 0-1 or 0-100? It seems it's based on 0-1, but the documentation says 0-100.

Thanks,
cladeira

Edited by: cladeira on Jun 23, 2019 2:06 PM

已回答 5 年前
0

Hi,

The progress in the docs says its a float between 0-100? Or is it 0-1? :)

Regards.
JJ

已回答 5 年前
0

Progress is a float 0-100.

Lyndon

已回答 5 年前

您尚未登入。 登入 去張貼答案。

一個好的回答可以清楚地回答問題並提供建設性的意見回饋,同時有助於提問者的專業成長。

回答問題指南