Don't do CSPO, or any other certification for that matter. Yes, switching to consumer internet companies is going to be difficult from where you are currently, unless you join a startup in that space.
Banks are usually dead ends for PM work. Try companies where your domain expertise will be valuable + more product focus. Have you tried BharatPe or Neobanking startups? I think there are still companies that want to hire PM with experience with lending.
Joining a startup is always an option. The entry barrier is low, you get loads of learning , you will likely oversee multiple functions at a grassroot level. Smart and speedy execution is key. Strategy is virtually non-existent early stage.