array(41) {
["project_title"]=>
string(120) "Applications of Item Response Theory to Clinical ADHD Research: Analysis of the Psychometric Properties of the ADHDRS-IV"
["project_narrative_summary"]=>
string(660) "Rating scales serve as a necessary tool for clinicians who wish to determine presence and severity of ADHD symptoms. Therefore, accurate measurement of symptomatology is essential. Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure baseline clinical symptoms of ADHD. This study aims to evaluate the psychometric properties of the ADHDRS-IV in a large, combined baseline sample of children and adolescents using IRT. The results are predicted to identify a more concise and presumably more sensitive change index which could have research and clinical value both in diagnosis and in treatment assessment."
["project_learn_source"]=>
string(0) ""
["project_learn_source_exp"]=>
string(0) ""
["project_key_personnel"]=>
bool(false)
["project_ext_grants"]=>
array(2) {
["value"]=>
string(68) "No external grants or funds are being used to support this research."
["label"]=>
string(68) "No external grants or funds are being used to support this research."
}
["project_funding_source"]=>
string(0) ""
["project_assoc_trials"]=>
array(1) {
[0]=>
object(WP_Post)#3887 (24) {
["ID"]=>
int(1222)
["post_author"]=>
string(4) "1363"
["post_date"]=>
string(19) "2014-10-20 14:15:00"
["post_date_gmt"]=>
string(19) "2014-10-20 14:15:00"
["post_content"]=>
string(0) ""
["post_title"]=>
string(223) "NCT00866996 - A Multi-center Randomized Parallel Group Study Evaluating Treatment Outcomes of Concerta (Extended Release Methylphenidate) and Strattera (Atomoxetine) in Children With Attention-deficit/Hyperactivity Disorder"
["post_excerpt"]=>
string(0) ""
["post_status"]=>
string(7) "publish"
["comment_status"]=>
string(4) "open"
["ping_status"]=>
string(4) "open"
["post_password"]=>
string(0) ""
["post_name"]=>
string(194) "nct00866996-a-multi-center-randomized-parallel-group-study-evaluating-treatment-outcomes-of-concerta-extended-release-methylphenidate-and-strattera-atomoxetine-in-children-with-attention-deficit"
["to_ping"]=>
string(0) ""
["pinged"]=>
string(0) ""
["post_modified"]=>
string(19) "2023-02-06 13:14:42"
["post_modified_gmt"]=>
string(19) "2023-02-06 13:14:42"
["post_content_filtered"]=>
string(0) ""
["post_parent"]=>
int(0)
["guid"]=>
string(243) "https://dev-yoda.pantheonsite.io/clinical-trial/nct00866996-a-multi-center-randomized-parallel-group-study-evaluating-treatment-outcomes-of-concerta-extended-release-methylphenidate-and-strattera-atomoxetine-in-children-with-attention-deficit/"
["menu_order"]=>
int(0)
["post_type"]=>
string(14) "clinical_trial"
["post_mime_type"]=>
string(0) ""
["comment_count"]=>
string(1) "0"
["filter"]=>
string(3) "raw"
}
}
["project_date_type"]=>
string(91) "Individual Participant-Level Data, which includes Full CSR and all supporting documentation"
["property_scientific_abstract"]=>
string(1365) "Background: Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure and evaluate baseline clinical symptoms of ADHD.
Objective: This study aims to evaluate the psychometric properties of the ADHDRS-IV and to determine if these estimates differ by age or gender in a large, combined baseline sample of children and adolescents using IRT.
Study Design: This study will employ a cross-sectional, pooled, multi-level analysis of baseline ADHDRS-IV items. Data will be pooled from a number of investigators in order to create a large sample of participants for the proposed analysis.
Participants: Participants include all children ages 6 to 17 who were rated using the ADHDRS-IV by a trained clinician.
Main Outcome: IRT item parameter estimates of the ADHDRS-IV will be the main outcomes of the study. Estimates will better inform our understanding of symptoms of ADHD and their respective utility in diagnosis.
Measure(s): The ADHDRS-IV will be evaluated in this study. Characteristics of the scale will be compared on key demographic variables including age and gender.
Statistical Analysis: Item response theory will be used to model the psychometric properties of the ADHDRS-IV. A multilevel item factor model will allow the investigator to model the nested nature of the data."
["project_brief_bg"]=>
string(2829) "Attention-deficit/hyperactivity disorder (ADHD) is an externalizing behavioral disorder that affects between 5 and 10 percent of youth (Polanczyk, Silva de Lima, Biederman, & Rohde, 2007). A number of rating scales exist for the purpose of measuring symptoms of ADHD for children and adolescents including the CPRS (Conners, Sitarenios, Parker, & Epstein, 1998), SNAP-IV (Swanson, 1992), and the ADHDRS-IV (DuPaul, Anastopoulos, Power, Reid, Ikeda, & McGoey, 1998). Rating scales serve as a necessary tool for clinicians who wish to determine presence and severity of ADHD symptoms, in addition to monitoring response to treatment (Conners, 1997). Because the best method for detecting the effectiveness of a treatment is through perceived changes in symptoms, accurate measurement of symptomatology is essential. However, as advances in quantitative methodology have improved measurement in domains such as physical functioning, emotional distress, and pain, clinical research in ADHD has lagged behind.
Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure baseline clinical symptoms of ADHD and treatment response. Successful IRT modeling of rating scales by the Patient-Reported Outcomes Measurement Information System (PROMIS) Cooperative Group and NIH has led to the development of reliable short forms that can be compared on the same scale to longer established measures of a number of constructs. PROMIS investigators now boast the efficiency, flexibility and precision of items that can be combined in a number of ways to measure constructs of interest (Cella et al., 2010). To maximize the potential of IRT application in ADHD measurement, we must also capitalize on the increasing availability of data previously collected by investigators and companies that have a stake in the advancement of research and treatment.
However, latent variable models such as IRT with many model parameters require big samples for stable and precise estimation. The last few years are making it increasingly possible to take advantage of the availability of data. Now, many samples exist and can be combined to both improve our measurement and understanding of symptoms and to identify targeted treatment approaches.
This study will use IRT to evaluate the psychometric properties of the ADHDRS-IV in a large, combined baseline sample of children and adolescents. The results of this IRT analysis are predicted to identify a more concise and presumably more sensitive change index which could have research and clinical value in diagnosis and treatment assessment. In addition, greater measurement precision may lead to a reduction in the number of patients required to find significant effect in a clinical trial while holding constant statistical power."
["project_specific_aims"]=>
string(702) "Psychometric properties of the ADHDRS-IV collected at intake will be evaluated using IRT. More specifically, this study aims to (1) use IRT to confirm the pre-treatment multidimensional structure of the 18 ADHDRS-IV items in children and adolescents (2) evaluate the item parameters of the IRT model including discrimination, thresholds, and the unique information provided by items at intake to determine the unique contribution of each item to the construct of ADHD as a whole (3) determine if a short form for ADHD may be developed through closer examination of IRT item parameter estimates and (4) determine if gender or age effect IRT item parameters, which would inform our understanding of ADHD."
["project_study_design"]=>
string(0) ""
["project_study_design_exp"]=>
string(0) ""
["project_purposes"]=>
array(2) {
[0]=>
array(2) {
["value"]=>
string(36) "Participant-level data meta-analysis"
["label"]=>
string(36) "Participant-level data meta-analysis"
}
[1]=>
array(2) {
["value"]=>
string(69) "Meta-analysis using data from the YODA Project and other data sources"
["label"]=>
string(69) "Meta-analysis using data from the YODA Project and other data sources"
}
}
["project_purposes_exp"]=>
string(0) ""
["project_software_used"]=>
string(0) ""
["project_software_used_exp"]=>
string(0) ""
["project_research_methods"]=>
string(1183) "A baseline sample of children and adolescents who were rated using the ADHDRS-IV are needed to estimate the IRT model. It is important that this sample reflects the population of interest, in this case youth who may possess symptoms of ADHD. We want a high degree of precision in our estimates of this clinically more severe sample. For this reason, baseline demographic and ADHDRS-IV data is requested from Janssen study NCT00866996, titled ?A Multi-center Randomized Parallel Group Study Evaluating Treatment Outcomes of Concerta (Extended Release Methylphenidate) and Strattera (Atomoxetine) in Children with Attention-deficit/Hyperactivity Disorder.?
Baseline samples have also been requested from studies listed on Clinical Study Data Request (clinicalstudydatarequest.com) and Shire Pharmaceuticals. A very large sample is required to produce stable model parameter estimates in IRT for the ADHDRS-IV and therefore these baseline samples will be combined for analysis. Screening or baseline item-level ADHDRS-IV data for all 6 to 17 year-old study participants will be used. There are no other inclusion/exclusion criteria for participants to be included in the analysis."
["project_main_outcome_measure"]=>
string(264) "The ADHDRS-IV will be used as the main outcome measure for this study. The IRT model will include all items of the ADHDRS-IV, and parameter estimates will be generated for each item. Primarily the specific item parameter estimates will be evaluated and discussed."
["project_main_predictor_indep"]=>
string(779) "In the primary model, there will be no independent variables as the purpose is to fit the general IRT model. However, during sub-group analysis, age and gender will serve as grouping variables in separate models. Children ages 7 to 11 will be grouped and children ages 12 to 17 will be grouped. A decision regarding how to group by age was made based on literature presented regarding the statistically significant increase in inattention symptoms for children over the age of 11 (Bussing et al., 2008) and the general decrease in symptoms of hyperactivity/impulsivity as children age (Lahey, Pelham, Loney, Lee, & Willcutt, 2005), in the late pre-pubertal period of development. Gender will be evaluated as any differences in item parameter estimates between males and females."
["project_other_variables_interest"]=>
string(541) "The requested studies were all multi-site trials and data was collected across the U.S. The varying prevalence and treatment rates across the U.S. (CDC, 2010) support the need to model the baseline data within a multilevel framework to account for site differences of ADHDRS-IV baseline ratings. A multilevel item factor model will allow the investigator to model the nested nature of the data, where study participants (level-1 units) were nested within sites (level-2 units). Therefore, site will be used as another variable of interest."
["project_stat_analysis_plan"]=>
string(1700) "Item response theory will be used to model the psychometric properties of the ADHDRS-IV including item discrimination, thresholds, and the unique information about the latent trait of ADHD provided by the 18 items. Specifically, a graded response, unidimensional model (Samejima, 1969; Embretson & Reise, 2000) for symptoms of inattention and hyperactivity/impulsivity will be modeled separately as supported by literature. A multilevel item factor model will allow the investigator to model the nested nature of the data.
Models will likely be estimated in flexMIRT (Cai, 2013) using maximum marginal likelihood via the Bock-Aitkin EM algorithm (Bock & Aitkin, 1981), which will also handle missing data. The use of flexMIRT is necessary due to the complexity of the IRT model (e.g. multiple group, multilevel). Several indices of model fit will be reported to assess the fit of the model. Due the possibility of many response patterns (4^9) and a sparse contingency table, the M2 statistic will be reported (Cai & Hansen, 2013). Root mean square error of approximation (RMSEA; Steiger & Lind, 1980) will also be reported in addition to marginal fit (chi-square) and LD (chi-square) statistics for further evaluation and discussion of model fit.
Sub-group differences across gender and age will be explored using differential item functioning using a multi-step Wald chi-square procedure (Woods, Cai, & Wang, 2013; Langer, 2008; Cai et al., 2011). In addition, DIF may also be computed within and between sites for the ADHDRS-IV items. To control the inflated error rate caused by multiple DIF comparisons, the false discovery rate procedure (Benjamini & Hochberg, 1995) will be us"
["project_timeline"]=>
string(387) "The project will start as soon as data, or decisions regarding data, have been received. Analyses will be completed within three months following receipt of data. The dissertation will be drafted by the end of the 2015 calendar year, and available on ProQuest in the first few months of 2016. A manuscript will then be drafted by March of 2016 and submitted for publication by June 2016."
["project_dissemination_plan"]=>
string(286) "The purpose of these analyses is primarily for dissertation research which will be completed by March of 2016. Publication of results will occur by June 2016, and will be submitted to journals such as Psychological Medicine, Journal of Attention Disorders, and Psychological Assessment."
["project_bibliography"]=>
string(3822) "Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289?300.
Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443?459.
Bussing, R., Fernandez, M., Harwood, M., Hou, W., Garvan, C. W., Eyberg, S. M., & Swanson, J. M. (2008). Parent and teacher SNAP-IV ratings of attention deficit hyperactivity disorder symptoms psychometric properties and normative ratings from a school district sample. Assessment, 15(3), 317-328.
Cai, L. (2013). flexMIRT R version 2: Flexible multilevel multidimensional item analysis and test scoring [Computer software]. Chapel Hill, NC: Vector Psychometric Group.
Cai, L., & Hansen, M. (2013). Limited information goodness of fit testing of hierarchical item factor models. British Journal of Mathematical and Statistical Psychology, 66(2), 245-276.
Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO: Flexible, multidimensional, multiple
categorical IRT modeling [Computer software]. Lincolnwood, IL: Scientific Software
International.
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., … & Group, P. C. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005?2008. Journal of clinical epidemiology, 63(11), 1179-1194.
Centers for Disease Control and Prevention. (2015). Attention-deficit/hyperactivity disorder (ADHD). Retrieved from http://www.cdc.gov/ncbddd/adhd/data.html.
Conners, C. K. (1997). Rating scales in attention-deficit/hyperactivity disorder: use in assessment and treatment monitoring. The Journal of clinical psychiatry, 59(Suppl 7), 24-30.
Conners, C. K., Sitarenious, G., Parker, J. D., & Epstein, J. N. (1998). The revised Conners? Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26(4), 257-268.
DuPaul, G. J., Anastopoulos, A. D., Power, T. J., Reid, R., Ikeda, M. J., & McGoey, K. E. (1998). Parent ratings of Attention-Deficit/Hyperactivity Disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20(1), 83-102.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates Inc.; Mahwah, NJ.
Lahey, B. B., Pelham, W. E., Loney, J., Lee, S. S., & Willcutt, E. (2005). Instability of the DSM-IV subtypes of ADHD from preschool through elementary school. Archives of General Psychiatry, 62(8), 896-902.
Langer, M. (2008). A reexamination of Lord?s Wald test for differential item functioning using item response theory and modern error estimation (Unpublished doctoral dissertation).
Polanczyk, G., Silva de Lima, M., Horta B. L., Biederman, J., & Rohde, L. A. (2007). The worldwide prevalence of ADHD: a systemic review and metaregression analysis. American Journal of Psychiatry, 164(4), 942-948.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph, No. 17.
Steiger, J. H. & Lind, J. C. (1980). Statistically Based Tests for the Number of Common Factors. Paper presented at the annual meeting of the Psychometric Society, May, Iowa City, IA.
Woods, C. M., Cai, L., & Wang, M. (2013). The Langer-Improved Wald test for DIF testing with multiple groups: evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532-547.
"
["project_suppl_material"]=>
bool(false)
["project_coi"]=>
array(4) {
[0]=>
array(1) {
["file_coi"]=>
array(21) {
["ID"]=>
int(9790)
["id"]=>
int(9790)
["title"]=>
string(58) "yoda_project_coi_form_for_data_requestors_2015_-_li-signed"
["filename"]=>
string(62) "yoda_project_coi_form_for_data_requestors_2015_-_li-signed.pdf"
["filesize"]=>
int(1106614)
["url"]=>
string(111) "https://yoda.yale.edu/wp-content/uploads/2018/01/yoda_project_coi_form_for_data_requestors_2015_-_li-signed.pdf"
["link"]=>
string(104) "https://yoda.yale.edu/data-request/2015-0539/yoda_project_coi_form_for_data_requestors_2015_-_li-signed/"
["alt"]=>
string(0) ""
["author"]=>
string(4) "1363"
["description"]=>
string(0) ""
["caption"]=>
string(0) ""
["name"]=>
string(58) "yoda_project_coi_form_for_data_requestors_2015_-_li-signed"
["status"]=>
string(7) "inherit"
["uploaded_to"]=>
int(3772)
["date"]=>
string(19) "2023-07-31 15:58:10"
["modified"]=>
string(19) "2023-08-01 01:13:29"
["menu_order"]=>
int(0)
["mime_type"]=>
string(15) "application/pdf"
["type"]=>
string(11) "application"
["subtype"]=>
string(3) "pdf"
["icon"]=>
string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png"
}
}
[1]=>
array(1) {
["file_coi"]=>
array(21) {
["ID"]=>
int(9788)
["id"]=>
int(9788)
["title"]=>
string(53) "yoda_project_coi_form_for_data_requestors_2015_-_alex"
["filename"]=>
string(57) "yoda_project_coi_form_for_data_requestors_2015_-_alex.pdf"
["filesize"]=>
int(106131)
["url"]=>
string(106) "https://yoda.yale.edu/wp-content/uploads/2018/05/yoda_project_coi_form_for_data_requestors_2015_-_alex.pdf"
["link"]=>
string(99) "https://yoda.yale.edu/data-request/2015-0539/yoda_project_coi_form_for_data_requestors_2015_-_alex/"
["alt"]=>
string(0) ""
["author"]=>
string(4) "1363"
["description"]=>
string(0) ""
["caption"]=>
string(0) ""
["name"]=>
string(53) "yoda_project_coi_form_for_data_requestors_2015_-_alex"
["status"]=>
string(7) "inherit"
["uploaded_to"]=>
int(3772)
["date"]=>
string(19) "2023-07-31 15:58:05"
["modified"]=>
string(19) "2023-08-01 01:13:29"
["menu_order"]=>
int(0)
["mime_type"]=>
string(15) "application/pdf"
["type"]=>
string(11) "application"
["subtype"]=>
string(3) "pdf"
["icon"]=>
string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png"
}
}
[2]=>
array(1) {
["file_coi"]=>
array(21) {
["ID"]=>
int(9789)
["id"]=>
int(9789)
["title"]=>
string(52) "yoda_project_coi_form_for_data_requestors_2015_-_jtm"
["filename"]=>
string(56) "yoda_project_coi_form_for_data_requestors_2015_-_jtm.pdf"
["filesize"]=>
int(1053918)
["url"]=>
string(105) "https://yoda.yale.edu/wp-content/uploads/2018/04/yoda_project_coi_form_for_data_requestors_2015_-_jtm.pdf"
["link"]=>
string(98) "https://yoda.yale.edu/data-request/2015-0539/yoda_project_coi_form_for_data_requestors_2015_-_jtm/"
["alt"]=>
string(0) ""
["author"]=>
string(4) "1363"
["description"]=>
string(0) ""
["caption"]=>
string(0) ""
["name"]=>
string(52) "yoda_project_coi_form_for_data_requestors_2015_-_jtm"
["status"]=>
string(7) "inherit"
["uploaded_to"]=>
int(3772)
["date"]=>
string(19) "2023-07-31 15:58:07"
["modified"]=>
string(19) "2023-08-01 01:13:29"
["menu_order"]=>
int(0)
["mime_type"]=>
string(15) "application/pdf"
["type"]=>
string(11) "application"
["subtype"]=>
string(3) "pdf"
["icon"]=>
string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png"
}
}
[3]=>
array(1) {
["file_coi"]=>
array(21) {
["ID"]=>
int(9809)
["id"]=>
int(9809)
["title"]=>
string(53) "yoda_project_coi_form_for_data_requestors_2015-connie"
["filename"]=>
string(57) "yoda_project_coi_form_for_data_requestors_2015-connie.pdf"
["filesize"]=>
int(759774)
["url"]=>
string(106) "https://yoda.yale.edu/wp-content/uploads/2016/05/yoda_project_coi_form_for_data_requestors_2015-connie.pdf"
["link"]=>
string(99) "https://yoda.yale.edu/data-request/2015-0539/yoda_project_coi_form_for_data_requestors_2015-connie/"
["alt"]=>
string(0) ""
["author"]=>
string(4) "1363"
["description"]=>
string(0) ""
["caption"]=>
string(0) ""
["name"]=>
string(53) "yoda_project_coi_form_for_data_requestors_2015-connie"
["status"]=>
string(7) "inherit"
["uploaded_to"]=>
int(3772)
["date"]=>
string(19) "2023-07-31 15:58:54"
["modified"]=>
string(19) "2023-08-01 01:13:29"
["menu_order"]=>
int(0)
["mime_type"]=>
string(15) "application/pdf"
["type"]=>
string(11) "application"
["subtype"]=>
string(3) "pdf"
["icon"]=>
string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png"
}
}
}
["data_use_agreement_training"]=>
bool(true)
["certification"]=>
bool(true)
["project_send_email_updates"]=>
bool(true)
["project_status"]=>
string(16) "withdrawn_closed"
["project_publ_available"]=>
bool(true)
["project_year_access"]=>
string(0) ""
["project_rep_publ"]=>
array(1) {
[0]=>
array(1) {
["publication_link"]=>
array(3) {
["title"]=>
string(98) "*Request originally approved but subsequently withdrawn: data could not be downloaded as requested"
["url"]=>
string(98) "*Request originally approved but subsequently withdrawn: data could not be downloaded as requested"
["target"]=>
string(6) "_blank"
}
}
}
["project_assoc_data"]=>
array(0) {
}
["project_due_dil_assessment"]=>
bool(false)
["project_title_link"]=>
bool(false)
["project_review_link"]=>
bool(false)
["project_highlight_button"]=>
string(0) ""
["search_order"]=>
string(5) "-6590"
}
data partner
array(1) {
[0]=>
string(15) "johnson-johnson"
}
pi country
array(1) {
[0]=>
string(13) "United States"
}
pi affil
array(1) {
[0]=>
string(8) "Academia"
}
products
array(1) {
[0]=>
string(8) "concerta"
}
num of trials
array(1) {
[0]=>
string(1) "1"
}
res
array(1) {
[0]=>
string(1) "3"
}
Research Proposal
Project Title:
Applications of Item Response Theory to Clinical ADHD Research: Analysis of the Psychometric Properties of the ADHDRS-IV
Scientific Abstract:
Background: Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure and evaluate baseline clinical symptoms of ADHD.
Objective: This study aims to evaluate the psychometric properties of the ADHDRS-IV and to determine if these estimates differ by age or gender in a large, combined baseline sample of children and adolescents using IRT.
Study Design: This study will employ a cross-sectional, pooled, multi-level analysis of baseline ADHDRS-IV items. Data will be pooled from a number of investigators in order to create a large sample of participants for the proposed analysis.
Participants: Participants include all children ages 6 to 17 who were rated using the ADHDRS-IV by a trained clinician.
Main Outcome: IRT item parameter estimates of the ADHDRS-IV will be the main outcomes of the study. Estimates will better inform our understanding of symptoms of ADHD and their respective utility in diagnosis.
Measure(s): The ADHDRS-IV will be evaluated in this study. Characteristics of the scale will be compared on key demographic variables including age and gender.
Statistical Analysis: Item response theory will be used to model the psychometric properties of the ADHDRS-IV. A multilevel item factor model will allow the investigator to model the nested nature of the data.
Brief Project Background and Statement of Project Significance:
Attention-deficit/hyperactivity disorder (ADHD) is an externalizing behavioral disorder that affects between 5 and 10 percent of youth (Polanczyk, Silva de Lima, Biederman, & Rohde, 2007). A number of rating scales exist for the purpose of measuring symptoms of ADHD for children and adolescents including the CPRS (Conners, Sitarenios, Parker, & Epstein, 1998), SNAP-IV (Swanson, 1992), and the ADHDRS-IV (DuPaul, Anastopoulos, Power, Reid, Ikeda, & McGoey, 1998). Rating scales serve as a necessary tool for clinicians who wish to determine presence and severity of ADHD symptoms, in addition to monitoring response to treatment (Conners, 1997). Because the best method for detecting the effectiveness of a treatment is through perceived changes in symptoms, accurate measurement of symptomatology is essential. However, as advances in quantitative methodology have improved measurement in domains such as physical functioning, emotional distress, and pain, clinical research in ADHD has lagged behind.
Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure baseline clinical symptoms of ADHD and treatment response. Successful IRT modeling of rating scales by the Patient-Reported Outcomes Measurement Information System (PROMIS) Cooperative Group and NIH has led to the development of reliable short forms that can be compared on the same scale to longer established measures of a number of constructs. PROMIS investigators now boast the efficiency, flexibility and precision of items that can be combined in a number of ways to measure constructs of interest (Cella et al., 2010). To maximize the potential of IRT application in ADHD measurement, we must also capitalize on the increasing availability of data previously collected by investigators and companies that have a stake in the advancement of research and treatment.
However, latent variable models such as IRT with many model parameters require big samples for stable and precise estimation. The last few years are making it increasingly possible to take advantage of the availability of data. Now, many samples exist and can be combined to both improve our measurement and understanding of symptoms and to identify targeted treatment approaches.
This study will use IRT to evaluate the psychometric properties of the ADHDRS-IV in a large, combined baseline sample of children and adolescents. The results of this IRT analysis are predicted to identify a more concise and presumably more sensitive change index which could have research and clinical value in diagnosis and treatment assessment. In addition, greater measurement precision may lead to a reduction in the number of patients required to find significant effect in a clinical trial while holding constant statistical power.
Specific Aims of the Project:
Psychometric properties of the ADHDRS-IV collected at intake will be evaluated using IRT. More specifically, this study aims to (1) use IRT to confirm the pre-treatment multidimensional structure of the 18 ADHDRS-IV items in children and adolescents (2) evaluate the item parameters of the IRT model including discrimination, thresholds, and the unique information provided by items at intake to determine the unique contribution of each item to the construct of ADHD as a whole (3) determine if a short form for ADHD may be developed through closer examination of IRT item parameter estimates and (4) determine if gender or age effect IRT item parameters, which would inform our understanding of ADHD.
Study Design:
What is the purpose of the analysis being proposed? Please select all that apply.:
Participant-level data meta-analysis
Meta-analysis using data from the YODA Project and other data sources
Software Used:
Data Source and Inclusion/Exclusion Criteria to be used to define the patient sample for your study:
A baseline sample of children and adolescents who were rated using the ADHDRS-IV are needed to estimate the IRT model. It is important that this sample reflects the population of interest, in this case youth who may possess symptoms of ADHD. We want a high degree of precision in our estimates of this clinically more severe sample. For this reason, baseline demographic and ADHDRS-IV data is requested from Janssen study NCT00866996, titled ?A Multi-center Randomized Parallel Group Study Evaluating Treatment Outcomes of Concerta (Extended Release Methylphenidate) and Strattera (Atomoxetine) in Children with Attention-deficit/Hyperactivity Disorder.?
Baseline samples have also been requested from studies listed on Clinical Study Data Request (clinicalstudydatarequest.com) and Shire Pharmaceuticals. A very large sample is required to produce stable model parameter estimates in IRT for the ADHDRS-IV and therefore these baseline samples will be combined for analysis. Screening or baseline item-level ADHDRS-IV data for all 6 to 17 year-old study participants will be used. There are no other inclusion/exclusion criteria for participants to be included in the analysis.
Primary and Secondary Outcome Measure(s) and how they will be categorized/defined for your study:
The ADHDRS-IV will be used as the main outcome measure for this study. The IRT model will include all items of the ADHDRS-IV, and parameter estimates will be generated for each item. Primarily the specific item parameter estimates will be evaluated and discussed.
Main Predictor/Independent Variable and how it will be categorized/defined for your study:
In the primary model, there will be no independent variables as the purpose is to fit the general IRT model. However, during sub-group analysis, age and gender will serve as grouping variables in separate models. Children ages 7 to 11 will be grouped and children ages 12 to 17 will be grouped. A decision regarding how to group by age was made based on literature presented regarding the statistically significant increase in inattention symptoms for children over the age of 11 (Bussing et al., 2008) and the general decrease in symptoms of hyperactivity/impulsivity as children age (Lahey, Pelham, Loney, Lee, & Willcutt, 2005), in the late pre-pubertal period of development. Gender will be evaluated as any differences in item parameter estimates between males and females.
Other Variables of Interest that will be used in your analysis and how they will be categorized/defined for your study:
The requested studies were all multi-site trials and data was collected across the U.S. The varying prevalence and treatment rates across the U.S. (CDC, 2010) support the need to model the baseline data within a multilevel framework to account for site differences of ADHDRS-IV baseline ratings. A multilevel item factor model will allow the investigator to model the nested nature of the data, where study participants (level-1 units) were nested within sites (level-2 units). Therefore, site will be used as another variable of interest.
Statistical Analysis Plan:
Item response theory will be used to model the psychometric properties of the ADHDRS-IV including item discrimination, thresholds, and the unique information about the latent trait of ADHD provided by the 18 items. Specifically, a graded response, unidimensional model (Samejima, 1969; Embretson & Reise, 2000) for symptoms of inattention and hyperactivity/impulsivity will be modeled separately as supported by literature. A multilevel item factor model will allow the investigator to model the nested nature of the data.
Models will likely be estimated in flexMIRT (Cai, 2013) using maximum marginal likelihood via the Bock-Aitkin EM algorithm (Bock & Aitkin, 1981), which will also handle missing data. The use of flexMIRT is necessary due to the complexity of the IRT model (e.g. multiple group, multilevel). Several indices of model fit will be reported to assess the fit of the model. Due the possibility of many response patterns (4^9) and a sparse contingency table, the M2 statistic will be reported (Cai & Hansen, 2013). Root mean square error of approximation (RMSEA; Steiger & Lind, 1980) will also be reported in addition to marginal fit (chi-square) and LD (chi-square) statistics for further evaluation and discussion of model fit.
Sub-group differences across gender and age will be explored using differential item functioning using a multi-step Wald chi-square procedure (Woods, Cai, & Wang, 2013; Langer, 2008; Cai et al., 2011). In addition, DIF may also be computed within and between sites for the ADHDRS-IV items. To control the inflated error rate caused by multiple DIF comparisons, the false discovery rate procedure (Benjamini & Hochberg, 1995) will be us
Narrative Summary:
Rating scales serve as a necessary tool for clinicians who wish to determine presence and severity of ADHD symptoms. Therefore, accurate measurement of symptomatology is essential. Item response theory (IRT), a latent variable model, presents an opportunity to improve the way we measure baseline clinical symptoms of ADHD. This study aims to evaluate the psychometric properties of the ADHDRS-IV in a large, combined baseline sample of children and adolescents using IRT. The results are predicted to identify a more concise and presumably more sensitive change index which could have research and clinical value both in diagnosis and in treatment assessment.
Project Timeline:
The project will start as soon as data, or decisions regarding data, have been received. Analyses will be completed within three months following receipt of data. The dissertation will be drafted by the end of the 2015 calendar year, and available on ProQuest in the first few months of 2016. A manuscript will then be drafted by March of 2016 and submitted for publication by June 2016.
Dissemination Plan:
The purpose of these analyses is primarily for dissertation research which will be completed by March of 2016. Publication of results will occur by June 2016, and will be submitted to journals such as Psychological Medicine, Journal of Attention Disorders, and Psychological Assessment.
Bibliography:
Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57(1), 289?300.
Bock, R. D., & Aitkin, M. (1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443?459.
Bussing, R., Fernandez, M., Harwood, M., Hou, W., Garvan, C. W., Eyberg, S. M., & Swanson, J. M. (2008). Parent and teacher SNAP-IV ratings of attention deficit hyperactivity disorder symptoms psychometric properties and normative ratings from a school district sample. Assessment, 15(3), 317-328.
Cai, L. (2013). flexMIRT R version 2: Flexible multilevel multidimensional item analysis and test scoring [Computer software]. Chapel Hill, NC: Vector Psychometric Group.
Cai, L., & Hansen, M. (2013). Limited information goodness of fit testing of hierarchical item factor models. British Journal of Mathematical and Statistical Psychology, 66(2), 245-276.
Cai, L., Thissen, D., & du Toit, S. H. C. (2011). IRTPRO: Flexible, multidimensional, multiple
categorical IRT modeling [Computer software]. Lincolnwood, IL: Scientific Software
International.
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., … & Group, P. C. (2010). The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005?2008. Journal of clinical epidemiology, 63(11), 1179-1194.
Centers for Disease Control and Prevention. (2015). Attention-deficit/hyperactivity disorder (ADHD). Retrieved from http://www.cdc.gov/ncbddd/adhd/data.html.
Conners, C. K. (1997). Rating scales in attention-deficit/hyperactivity disorder: use in assessment and treatment monitoring. The Journal of clinical psychiatry, 59(Suppl 7), 24-30.
Conners, C. K., Sitarenious, G., Parker, J. D., & Epstein, J. N. (1998). The revised Conners? Parent Rating Scale (CPRS-R): factor structure, reliability, and criterion validity. Journal of Abnormal Child Psychology, 26(4), 257-268.
DuPaul, G. J., Anastopoulos, A. D., Power, T. J., Reid, R., Ikeda, M. J., & McGoey, K. E. (1998). Parent ratings of Attention-Deficit/Hyperactivity Disorder symptoms: Factor structure and normative data. Journal of Psychopathology and Behavioral Assessment, 20(1), 83-102.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Lawrence Erlbaum Associates Inc.; Mahwah, NJ.
Lahey, B. B., Pelham, W. E., Loney, J., Lee, S. S., & Willcutt, E. (2005). Instability of the DSM-IV subtypes of ADHD from preschool through elementary school. Archives of General Psychiatry, 62(8), 896-902.
Langer, M. (2008). A reexamination of Lord?s Wald test for differential item functioning using item response theory and modern error estimation (Unpublished doctoral dissertation).
Polanczyk, G., Silva de Lima, M., Horta B. L., Biederman, J., & Rohde, L. A. (2007). The worldwide prevalence of ADHD: a systemic review and metaregression analysis. American Journal of Psychiatry, 164(4), 942-948.
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monograph, No. 17.
Steiger, J. H. & Lind, J. C. (1980). Statistically Based Tests for the Number of Common Factors. Paper presented at the annual meeting of the Psychometric Society, May, Iowa City, IA.
Woods, C. M., Cai, L., & Wang, M. (2013). The Langer-Improved Wald test for DIF testing with multiple groups: evaluation and comparison to two-group IRT. Educational and Psychological Measurement, 73(3), 532-547.