How to choose between backend and infra?

As a software engineer when and how do you understand what specialisation to go for. As a back end engineer most of us have faced a decision point on whether to take the business domain route or the infrastructure route as a Backend software engineer. How do you figure that out?

Any personal stories are welcome. Please share some tips and experiences