The issue was in my Terraform VPC configuration: I missed the enable_nat_gateway = true . Thus EC2 instance was not able to even update OS packages. The "Instance log files" on the AWS Autoscaler page pointed me to that issue.
SSH connection is not required, yep.