Applying Computerized Adaptive Testing to the Social Security Adm Disability Evaluation Process

The Rehabilitation Medicine Department in the Clinical Research Center at the National Institutes of Health (NIH-RMD) in Bethesda, Maryland has agreed to assist the Social Security Administration (SSA) to explore innovative methods for augmenting the disability evaluation process. This requires assessment of individuals functional abilities across a variety of domains (such as movement and physical activities, basic and instrumental activities of daily living, and applied cognition) in relationship to functional demands in the workplace and features of the workplace, home, and community environments. Rapid assessment methods are needed that are compatible with SSA processes and will yield easily interpretable results that can be efficiently and meaningfully integrated to provide accurate and uniform information about an individuals ability to engage in substantial gainful employment. To meet this objective, NIH-RMD seeks a contractor who will evaluate the feasibility of integrating into the SSA data collection and disability evaluation process, a promising new testing method that has the potential to precisely measure outcomes across the full continuum of human functioning using Computer Adaptive Testing (CAT) coupled with Item Response Theory (IRT). CAT represents a simple form of artificial intelligence software requiring computer technology for administration. The demonstrated advantages of the CAT instruments compared to more traditional testing methods are: reduced respondent burden, increased score precision, elimination of ceiling and floor effects, client-specific confidence intervals, monitoring of data quality in real time, and lower data collection costs. Because functional outcomes have been shown to have a clear hierarchical structure, gains in precision and efficiency of score estimation are superior to traditional fixed forms of functional assessment, thus transforming the ways in which outcomes can be monitored. NIH-RMD has proposed application of CAT methods to the determination of key domains useful to the SSA disability determination and claims decision-making processes. There is substantial additional work to be done before the full potential of IRT-CAT can be realized in this environment. These efforts will include a thorough evaluation of the feasibility of implementing CAT tools in the SSA environment, further development of existing CAT instruments, and development of new CAT instruments to assess critical aspects important the disability evaluation process such as job related functional requirements and the workplace environment. In addition, cut-points will need to be established along each disability domain scale, as measured by CAT, to facilitate interpretation of levels of disability. Evidence of prior CAT tool development and the adaption of CAT instrumentation will be needed to support the assessment of CAT tool application to critical aspects of the disability evaluation process, including job related functional requirements and the workplace environment. A contractor with substantial expertise in developing innovative ways to apply computerized adaptive testing methods and item response theory to evaluate the functional abilities of adults in relationship to performance requirements for substantial gainful employment is needed to assist in this work. If CAT methods are determined to be feasible during the base period of performance, then further development and evaluation of CAT assessment tools will occur in option years 1-2. CAT tools should be compatible with the stepwise nature of the SSA disability evaluation process. CAT tools should yield easily interpretable results that can be efficiently and meaningfully integrated to provide accurate, uniform, and rapid information about an individuals potential to engage in substantial gainful employment. CAT development will take place at the contractors location, but the contractor will need to work closely with NIH-RMD and SSA staff via teleconferencing, electronic correspondence, and occasional face-to-face meetings at NIH and/or SSA to ensure that project objectives are met. NIH-RMD hopes to build on existing electronic CAT tools that have been developed to date and are relevant to this project that quantify key domains including movement and physical activities, basic and instrumental activities of daily living, and applied cognition. This contract will have a base period of performance of twelve months, with two unilateral twelve-month option periods available for exercise by the Government. A fixed price type contract is contemplated. This electronicsolicitation is being issued with an issue date of January 21, 2009, with proposals due by February 19, 2009. No paper copies will be available. Offerors are responsible for downloading their own copy of this solicitation and for routinely checking this site for any possible amendments that may be issued by the Government. This acquisition has been designated as full and open competition under the North American Industry Classification System (NAICS) code 541512, Size Standard - $21.0 million dollars. This advertisement does not commit the Government to award a contract. For any questions, please contact Mrs. Ann Argaman at (301) 594-5919.