ECS scale in on task exit

The container I'm using with ECS is a GPU accelerated instance, and it is very costly. So, I want the EC2 instance to be immediately destroyed on task exit. However, even when using an auto scaling group, I cannot get it to scale in. Can you provide instructions on how to setup a cluster to respond to task exit?