More non-bank lenders are vying for opportunities alongside established players, putting pressure on margins and pushing investors to diversify