There is now confirmation that the Lucia case on the constitutionality of Administrative Law Judges (ALJs), as presently appointed, will be heard by the Supreme Court in April of this year. There's an accelerated briefing schedule.
I don't think the Supreme Court should find ALJs unconstitutional. I don't think they will. If they do find ALJs unconstitutional, they may find some way to exclude Social Security ALJs although I don't know how. If you're off on the sort of excursion into pure logic, possibly tinged by a strong desire to prevent regulation of businesses, that leads you to find that ALJs are unconstitutional in other agencies, I don't see how you'd be concerned about the practical consequences for Social Security. Exempting Social Security removes the pure logic part and makes the desire to hinder regulation of businesses obvious. The pretense that your actions were dictated by the Constitution would be hard to maintain.