Oct 19, 2009

A Contradiction Left Unresolved?

Here are a quotes from two different Subcommittees of Social Security's Occupational Information Development Advisory Panel (emphasis added):
The Physical Demands Subcommittee strongly believes that data collection for the physical demands of work cannot be done by self-report. [See below. Another Subcommittee wants to give self-reporting a try.] There are numerous studies that demonstrate that self-reported physical demands are neither reliable nor valid ... (Physical Demands Subcommittee report, pages 34-35 of pdf)

Recommendation: The SSA should train existing Experts [Are we talking about Vocational Experts who testify at ALJ hearings or state agency vocational specialists or both?] in the new OIS [Occupational Information System] and use them as a source to provide job level data for the pilot study. The SSA should also provide job incumbents with the opportunity to provide job level data in the pilot study and compare the quality of results from the two sources. (Work Taxonomy and Classification Subcommittee report, page 282 of PDF )
The references are to the PDF of the entire Panel report. It looks to me as if there is a serious contradiction about a key matter. I do not see that this contradiction was ever resolved by the entire Panel.

I do not understand why the idea of surveying workers about their job duties should even come up. If you spend any time interviewing people about their job duties you quickly discover that when you ask people detailed questions you get confused answers that run along the lines of "I never weighed what I was lifting" and "I never timed how long I was on my feet" and "I never measured how far I had to walk." When pressed, people just give wild guesses. Surveying workers about their job duties may sound plausible, but it would yield only confusing, inconsistent, meaningless data.

2 comments:

Anonymous said...

but doesn't relying on the current vocational experts run the very real risk of giving credibility to their hocus pocus?

Anonymous said...

I think hocus pocus is a very appropriate term to describe the lunacy that sometimes spills from their mouths. I don't know how they can testify with a straight face sometimes. SSA really needs to reevaluate the DOT so that VEs can't use "surveillance system monitor" all the time, but they also need to make sure they don't completely overhaul the vocational aspects of their adjudication and make it impossible to rule out all SGA.