array(41) {
  ["project_title"]=>
  string(115) "Evaluation of debiased machine learning methods to estimate the average treatment effect  in observational studies."
  ["project_narrative_summary"]=>
  string(670) "The growing amount of data accumulated in the hospital EHR systems as well as in the past clinical trials represent a unique asset that can help to improve clinical decisions and to optimize drug development.  Treatment effect estimation is one of the questions that can be addressed using various types of real world data, it remains, however, a challenging task due to biases induced by confounding factors as well as model regularization techniques when we use classical estimators.   In this study, we intend to evaluate recently developed approaches in the econometrics literature based on Neyman orthogonal score functions using ML predictive  [Chernozhukov 2017]."
  ["project_learn_source"]=>
  string(10) "web_search"
  ["project_learn_source_exp"]=>
  string(0) ""
  ["project_key_personnel"]=>
  array(2) {
    [0]=>
    array(6) {
      ["p_pers_f_name"]=>
      string(4) "Paul"
      ["p_pers_l_name"]=>
      string(10) "Trichelair"
      ["p_pers_degree"]=>
      string(13) "Master degree"
      ["p_pers_pr_affil"]=>
      string(5) "Owkin"
      ["p_pers_scop_id"]=>
      string(0) ""
      ["requires_data_access"]=>
      string(0) ""
    }
    [1]=>
    array(6) {
      ["p_pers_f_name"]=>
      string(7) "Nicolas"
      ["p_pers_l_name"]=>
      string(7) "Loiseau"
      ["p_pers_degree"]=>
      string(6) "Master"
      ["p_pers_pr_affil"]=>
      string(5) "Owkin"
      ["p_pers_scop_id"]=>
      string(0) ""
      ["requires_data_access"]=>
      string(0) ""
    }
  }
  ["project_ext_grants"]=>
  array(2) {
    ["value"]=>
    string(68) "No external grants or funds are being used to support this research."
    ["label"]=>
    string(68) "No external grants or funds are being used to support this research."
  }
  ["project_funding_source"]=>
  string(61) "financial support for the proposed research provided by Owkin"
  ["project_assoc_trials"]=>
  array(9) {
    [0]=>
    object(WP_Post)#4680 (24) {
      ["ID"]=>
      int(1259)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2014-10-20 16:13:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:13:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(300) "NCT01106625 - A Randomized, Double-Blind, Placebo-Controlled, 3-Arm, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Pioglitazone Therapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(190) "nct01106625-a-randomized-double-blind-placebo-controlled-3-arm-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-of-subjects"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-02-06 13:15:31"
      ["post_modified_gmt"]=>
      string(19) "2023-02-06 13:15:31"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(239) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01106625-a-randomized-double-blind-placebo-controlled-3-arm-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-of-subjects/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [1]=>
    object(WP_Post)#4679 (24) {
      ["ID"]=>
      int(1265)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2014-10-20 16:16:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:16:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(284) "NCT01081834 - A Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin as Monotherapy in the Treatment of Subjects With Type 2 Diabetes Mellitus Inadequately Controlled With Diet and Exercise"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(192) "nct01081834-a-randomized-double-blind-placebo-controlled-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-as-monotherapy-in-the-treatment-of-s"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-02-06 13:15:39"
      ["post_modified_gmt"]=>
      string(19) "2023-02-06 13:15:39"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(241) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01081834-a-randomized-double-blind-placebo-controlled-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-as-monotherapy-in-the-treatment-of-s/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [2]=>
    object(WP_Post)#4678 (24) {
      ["ID"]=>
      int(1268)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2014-10-20 16:17:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:17:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(298) "NCT01106677 - A Randomized, Double-Blind, Placebo and Active-Controlled, 4-Arm, Parallel Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin Monotherapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(191) "nct01106677-a-randomized-double-blind-placebo-and-active-controlled-4-arm-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-o"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2024-04-08 12:21:26"
      ["post_modified_gmt"]=>
      string(19) "2024-04-08 16:21:26"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(240) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01106677-a-randomized-double-blind-placebo-and-active-controlled-4-arm-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-o/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [3]=>
    object(WP_Post)#4677 (24) {
      ["ID"]=>
      int(1271)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2014-10-20 16:18:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:18:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(302) "NCT00968812 - A Randomized, Double-Blind, 3-Arm Parallel-Group, 2-Year (104-Week), Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of JNJ-28431754 Compared With Glimepiride in the Treatment of Subjects With Type 2 Diabetes Mellitus Not Optimally Controlled on Metformin Monotherapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(190) "nct00968812-a-randomized-double-blind-3-arm-parallel-group-2-year-104-week-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-jnj-28431754-compared-with-glimepiride-in-the"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2024-04-12 13:32:01"
      ["post_modified_gmt"]=>
      string(19) "2024-04-12 17:32:01"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(239) "https://dev-yoda.pantheonsite.io/clinical-trial/nct00968812-a-randomized-double-blind-3-arm-parallel-group-2-year-104-week-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-jnj-28431754-compared-with-glimepiride-in-the/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [4]=>
    object(WP_Post)#4676 (24) {
      ["ID"]=>
      int(1274)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2014-10-20 16:20:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:20:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(302) "NCT01106651 - A Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin Compared With Placebo in the Treatment of Older Subjects With Type 2 Diabetes Mellitus Inadequately Controlled on Glucose Lowering Therapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(192) "nct01106651-a-randomized-double-blind-placebo-controlled-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-compared-with-placebo-in-the-treatme"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-02-06 13:15:52"
      ["post_modified_gmt"]=>
      string(19) "2023-02-06 13:15:52"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(241) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01106651-a-randomized-double-blind-placebo-controlled-parallel-group-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-compared-with-placebo-in-the-treatme/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [5]=>
    object(WP_Post)#4675 (24) {
      ["ID"]=>
      int(1280)
      ["post_author"]=>
      string(3) "190"
      ["post_date"]=>
      string(19) "2014-10-20 16:22:00"
      ["post_date_gmt"]=>
      string(19) "2014-10-20 16:22:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(296) "NCT01137812 - A Randomized, Double-Blind, Active-Controlled, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin Versus Sitagliptin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Sulphonylurea Therapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(6) "closed"
      ["ping_status"]=>
      string(6) "closed"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(192) "nct01137812-a-randomized-double-blind-active-controlled-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-versus-sitagliptin-in-the-treatment-of-subjects-with"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-05-18 17:48:22"
      ["post_modified_gmt"]=>
      string(19) "2023-05-18 17:48:22"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(241) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01137812-a-randomized-double-blind-active-controlled-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-versus-sitagliptin-in-the-treatment-of-subjects-with/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [6]=>
    object(WP_Post)#4674 (24) {
      ["ID"]=>
      int(1640)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2017-10-26 16:22:00"
      ["post_date_gmt"]=>
      string(19) "2017-10-26 16:22:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(308) "NCT02025907 - A Randomized, Double-blind, Placebo Controlled, 2-arm, Parallel-group, 26-week, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Sitagliptin Therapy"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(189) "nct02025907-a-randomized-double-blind-placebo-controlled-2-arm-parallel-group-26-week-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-of"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-02-06 13:24:44"
      ["post_modified_gmt"]=>
      string(19) "2023-02-06 13:24:44"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(238) "https://dev-yoda.pantheonsite.io/clinical-trial/nct02025907-a-randomized-double-blind-placebo-controlled-2-arm-parallel-group-26-week-multicenter-study-to-evaluate-the-efficacy-safety-and-tolerability-of-canagliflozin-in-the-treatment-of/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [7]=>
    object(WP_Post)#4672 (24) {
      ["ID"]=>
      int(1806)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2023-08-05 04:45:19"
      ["post_date_gmt"]=>
      string(19) "2023-08-05 04:45:19"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(195) "NCT01032629 - A Randomized, Multicenter, Double-Blind, Parallel, Placebo-Controlled Study of the Effects of JNJ-28431754 on Cardiovascular Outcomes in Adult Subjects With Type 2 Diabetes Mellitus"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(189) "nct01032629-a-randomized-multicenter-double-blind-parallel-placebo-controlled-study-of-the-effects-of-jnj-28431754-on-cardiovascular-outcomes-in-adult-subjects-with-type-2-diabetes-mellitus"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-09-11 15:43:36"
      ["post_modified_gmt"]=>
      string(19) "2023-09-11 19:43:36"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(238) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01032629-a-randomized-multicenter-double-blind-parallel-placebo-controlled-study-of-the-effects-of-jnj-28431754-on-cardiovascular-outcomes-in-adult-subjects-with-type-2-diabetes-mellitus/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
    [8]=>
    object(WP_Post)#4673 (24) {
      ["ID"]=>
      int(1808)
      ["post_author"]=>
      string(4) "1363"
      ["post_date"]=>
      string(19) "2019-08-12 15:10:00"
      ["post_date_gmt"]=>
      string(19) "2019-08-12 15:10:00"
      ["post_content"]=>
      string(0) ""
      ["post_title"]=>
      string(188) "NCT01989754 - A Randomized, Multicenter, Double-Blind, Parallel, Placebo-Controlled Study of the Effects of Canagliflozin on Renal Endpoints in Adult Subjects With Type 2 Diabetes Mellitus"
      ["post_excerpt"]=>
      string(0) ""
      ["post_status"]=>
      string(7) "publish"
      ["comment_status"]=>
      string(4) "open"
      ["ping_status"]=>
      string(4) "open"
      ["post_password"]=>
      string(0) ""
      ["post_name"]=>
      string(182) "nct01989754-a-randomized-multicenter-double-blind-parallel-placebo-controlled-study-of-the-effects-of-canagliflozin-on-renal-endpoints-in-adult-subjects-with-type-2-diabetes-mellitus"
      ["to_ping"]=>
      string(0) ""
      ["pinged"]=>
      string(0) ""
      ["post_modified"]=>
      string(19) "2023-09-11 15:45:40"
      ["post_modified_gmt"]=>
      string(19) "2023-09-11 19:45:40"
      ["post_content_filtered"]=>
      string(0) ""
      ["post_parent"]=>
      int(0)
      ["guid"]=>
      string(231) "https://dev-yoda.pantheonsite.io/clinical-trial/nct01989754-a-randomized-multicenter-double-blind-parallel-placebo-controlled-study-of-the-effects-of-canagliflozin-on-renal-endpoints-in-adult-subjects-with-type-2-diabetes-mellitus/"
      ["menu_order"]=>
      int(0)
      ["post_type"]=>
      string(14) "clinical_trial"
      ["post_mime_type"]=>
      string(0) ""
      ["comment_count"]=>
      string(1) "0"
      ["filter"]=>
      string(3) "raw"
    }
  }
  ["project_date_type"]=>
  string(91) "Individual Participant-Level Data, which includes Full CSR and all supporting documentation"
  ["property_scientific_abstract"]=>
  string(1662) "Background :
Machine learning [ML] methods can fit a wide class of functions and offers the possibility to work with high dimensional covariates. Recent approaches [Chernozhukov 2017] introduce asymptotically unbiased estimators relying on ML to model both the treatment and the outcome.
Objective :
Study the robustness of treatment effect [TE] estimators based on ML models and compare them to traditional estimators [Austin 2015, Glynn 2010].
Study Design :
A pool of clinical trials that share a common treatment (Canagliflozin) for one of the arm is used to compare the different estimators.
Participants :
We use the following trials including at least an arm treated by the Canagliflozin :
NCT00968812 NCT01032629 NCT01081834 NCT01106625 NCT01106651 NCT01106677 NCT01137812 NCT01989754 NCT02025907
Main Outcome Measure:
The study focus on TE on the change of HbA1C from baseline to week 26.
Statistical Analysis:
We compute in each setting the estimation, the related standard error and confidence intervals:
Assessing a treatment effect of zero between the Cana. arm of one trial and the Cana. arms of the remaining trials.
Given a Cana. arm, we add an artificial positive treatment $tau$ to each patient outcome. We then assess a treatment effect of $tau$ between the artificially modified Cana. arm and the remaining Cana. arms.
Given a trial, we replace the Cana. arm by the pool of Cana. arm from the remaining trials. The confidence intervals obtained using the different estimators is then compared to the CI obtained using OLS and the two arms of the random" ["project_brief_bg"]=> string(1066) "There is a growing interest in complementing a single arm with historical data. Recently Amgen obtained breakthrough therapy designation from FDA, and conditional marketing authorization from EMA for Blincyto (blinatumomab) for the treatment of a rare form of leukemia using a pooled database of historical controls. The additional analysis requested by the EMA was performed using propensity score matching. Beyond approvals, regulatory agencies encouraged exploring the use of synthetic control arms. A white paper [DFH18] written by Medidata and FDA scientists was presented in a Friends of Cancer Research meeting in December 2018. This paper focused on the use of propensity score matching to reproduce the control arm. If estimators of treatment effect with machine learning are already used in econometrics [Chernozhukov 2017], this is not yet the case in healthcare. This kind of estimators could be used to get insight from observational data or inform better decision making in drug development by augmenting a single arm phase 2 with historical control." ["project_specific_aims"]=> string(349) "The objective of the project is to assess the performance of recently developed machine learning methods for treatment effect estimation [Chernozhukov 2017] and compare it to classical methods to estimate treatment effect in observational studies: propensity score matching, propensity score adjustment methods [Austin 2015, Robins 1995, Hahn 1998]." ["project_study_design"]=> string(0) "" ["project_study_design_exp"]=> string(0) "" ["project_purposes"]=> array(4) { [0]=> array(2) { ["value"]=> string(37) "Develop or refine statistical methods" ["label"]=> string(37) "Develop or refine statistical methods" } [1]=> array(2) { ["value"]=> string(34) "Research on clinical trial methods" ["label"]=> string(34) "Research on clinical trial methods" } [2]=> array(2) { ["value"]=> string(28) "Research on comparison group" ["label"]=> string(28) "Research on comparison group" } [3]=> array(2) { ["value"]=> string(50) "Research on clinical prediction or risk prediction" ["label"]=> string(50) "Research on clinical prediction or risk prediction" } } ["project_purposes_exp"]=> string(0) "" ["project_software_used"]=> array(2) { ["value"]=> string(1) "R" ["label"]=> string(1) "R" } ["project_software_used_exp"]=> string(0) "" ["project_research_methods"]=> string(276) "Every patient participating to the pool of trials is a potential source of information. As the methods require training ML models, the more patients available, the better. We selected trials with non disjointed inclusion/exclusion criteria to ensure the positivity assumption." ["project_main_outcome_measure"]=> string(96) "HAb1c change from baseline to week 26, which is a shared outcome across the prespecified trials." ["project_main_predictor_indep"]=> string(208) "There is not one main predictor variable for the proposed study. Outcome and treatment models will be trained using machine learning on baseline characteristics that are shared among the clinical trials used." ["project_other_variables_interest"]=> string(191) "Baseline demographic and biologic variables will be used to train outcome and treatment models. Using those models, we will benchmark the different estimators of the average treatment effect." ["project_stat_analysis_plan"]=> string(1875) "A pool of clinical trials that share a common treatment (Canagliflozin) for one of the arm will be used to compare the different estimators. The outcome of interest to compute the treatment effect will be the change of HbA1C from baseline.
The evaluation of the estimators will be done in three stages:
* Experiment 1: Assessing a treatment effect of zero between the Canagliflozin arm of one trial and the Canagliflozin arms of the remaining trials.
* Experiment 2: Given a Canagliflozin arm, we add an artificial positive treatment $tau$ to each patient outcome. We then assess a treatment effect of $tau$ between the artificially modified Canagliflozin arm and the remaining Canagliflozin arms.
* Experiment 3: Given a trial, we replace the Canagliflozin arm by the pool of Canagliflozin arm from the remaining trials. The confidence intervals obtained using the different estimators is then compared to the confidence interval originally obtained using OLS and the two arms of the trials.
We will use the following trials including at least an arm treated by the Canagliflozin :
NCT00968812, NCT01032629, NCT01081834, NCT01106625, NCT01106651, NCT01106677, NCT01137812, NCT01989754, NCT02025907.
The study includes a comparison of the following estimators:
* Propensity score matching with treatment model trained using logistic regression and logit propensity score [Imai 2014];
* Inverse probability weighting with the treatment model trained using logistic regression and logit propensity score [Imai 2014];
* Double Machine Learning methods with sample-splitting and cross-fitting procedure [Chernozhukov 2017]. This method requires both outcome and treatment models. We will explore different methods for both models: random forest, gradient boosting models, SVM, logistic regression and linear regression." ["project_timeline"]=> string(123) "Project start date: January 1, 2020
Analysis completion: April 1, 2020
Manuscript draft completion: May 1, 2020" ["project_dissemination_plan"]=> string(160) "We plan on submitting this research as a research article in one of the following journal ?Statistics in Medicine? or ?Statistical Methods in Medical Research?." ["project_bibliography"]=> string(1348) "

Chernozhukov, Victor, Denis Chetverikov, Mert Demirer, Esther Duflo, Christian Hansen, and Whitney Newey. 2017. “Double/Debiased/Neyman Machine Learning of Treatment Effects.” *American Economic Review* 107(5): 261–65. https://doi.org/10.1257/aer.p20171038>.
Austin, Peter C., and Elizabeth A. Stuart. 2015. “Moving Towards Best Practice When Using Inverse Probability of Treatment Weighting (IPTW) Using the Propensity Score to Estimate Causal Treatment Effects in Observational Studies.” *Statistics in Medicine* 34 (28): 3661–79. https://doi.org/10.1002/sim.6607>
Glynn, Adam N., and Kevin M. Quinn. 2010. “An Introduction to the Augmented Inverse Propensity Weighted Estimator.” *Political Analysis* 18 (1): 36–56. https://doi.org/10.1093/pan/mpp036>.
Robins, J. and A. Rotnitzky (1995). Semi-parametric efficiency in multivariate regression models with
missing data. Journal of the American Statistical Association 90, 122?29.
Hahn, J. (1998). On the role of the propensity score in efficient semi-parametric estimation of average
treatment effects. Econometrica 66, 315?31.
Imai, K. and Ratkovic, M. (2014). Covariate balancing propensity score. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76(1):243{263.

" ["project_suppl_material"]=> bool(false) ["project_coi"]=> array(4) { [0]=> array(1) { ["file_coi"]=> array(21) { ["ID"]=> int(9362) ["id"]=> int(9362) ["title"]=> string(12) "numerisation" ["filename"]=> string(16) "numerisation.pdf" ["filesize"]=> int(1686910) ["url"]=> string(65) "https://yoda.yale.edu/wp-content/uploads/2017/09/numerisation.pdf" ["link"]=> string(58) "https://yoda.yale.edu/data-request/2019-4077/numerisation/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(12) "numerisation" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-07-31 15:38:42" ["modified"]=> string(19) "2023-08-01 01:05:53" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } } [1]=> array(1) { ["file_coi"]=> array(21) { ["ID"]=> int(9704) ["id"]=> int(9704) ["title"]=> string(14) "yoda_coi_tp_v2" ["filename"]=> string(18) "yoda_coi_tp_v2.pdf" ["filesize"]=> int(339125) ["url"]=> string(67) "https://yoda.yale.edu/wp-content/uploads/2020/08/yoda_coi_tp_v2.pdf" ["link"]=> string(60) "https://yoda.yale.edu/data-request/2019-4077/yoda_coi_tp_v2/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(14) "yoda_coi_tp_v2" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-07-31 15:54:28" ["modified"]=> string(19) "2023-08-01 01:05:53" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } } [2]=> array(1) { ["file_coi"]=> array(21) { ["ID"]=> int(9684) ["id"]=> int(9684) ["title"]=> string(14) "yoda_coi_mz_v2" ["filename"]=> string(18) "yoda_coi_mz_v2.pdf" ["filesize"]=> int(685304) ["url"]=> string(67) "https://yoda.yale.edu/wp-content/uploads/2016/05/yoda_coi_mz_v2.pdf" ["link"]=> string(60) "https://yoda.yale.edu/data-request/2019-4077/yoda_coi_mz_v2/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(14) "yoda_coi_mz_v2" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-07-31 15:53:36" ["modified"]=> string(19) "2023-08-01 01:05:53" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } } [3]=> array(1) { ["file_coi"]=> array(21) { ["ID"]=> int(9691) ["id"]=> int(9691) ["title"]=> string(14) "yoda_coi_nl_v2" ["filename"]=> string(18) "yoda_coi_nl_v2.pdf" ["filesize"]=> int(143227) ["url"]=> string(67) "https://yoda.yale.edu/wp-content/uploads/2014/12/yoda_coi_nl_v2.pdf" ["link"]=> string(60) "https://yoda.yale.edu/data-request/2019-4077/yoda_coi_nl_v2/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(14) "yoda_coi_nl_v2" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-07-31 15:53:55" ["modified"]=> string(19) "2023-08-01 01:05:53" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } } } ["data_use_agreement_training"]=> bool(true) ["certification"]=> bool(true) ["project_send_email_updates"]=> bool(true) ["project_status"]=> string(9) "published" ["project_publ_available"]=> bool(true) ["project_year_access"]=> string(4) "2020" ["project_rep_publ"]=> array(1) { [0]=> array(1) { ["publication_link"]=> array(3) { ["title"]=> string(37) "BMC Medical Research Methodology 2022" ["url"]=> string(86) "https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-022-01799-z#citeas" ["target"]=> string(6) "_blank" } } } ["project_assoc_data"]=> array(0) { } ["project_due_dil_assessment"]=> bool(false) ["project_title_link"]=> array(21) { ["ID"]=> int(10961) ["id"]=> int(10961) ["title"]=> string(42) "yoda_project_protocol_2019-4077_-_19-12-18" ["filename"]=> string(46) "yoda_project_protocol_2019-4077_-_19-12-18.pdf" ["filesize"]=> int(26221) ["url"]=> string(95) "https://yoda.yale.edu/wp-content/uploads/2023/08/yoda_project_protocol_2019-4077_-_19-12-18.pdf" ["link"]=> string(88) "https://yoda.yale.edu/data-request/2019-4077/yoda_project_protocol_2019-4077_-_19-12-18/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(42) "yoda_project_protocol_2019-4077_-_19-12-18" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-08-09 17:19:00" ["modified"]=> string(19) "2023-08-09 19:18:52" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } ["project_review_link"]=> array(21) { ["ID"]=> int(10693) ["id"]=> int(10693) ["title"]=> string(36) "yoda_project_review_-_2019-4077_site" ["filename"]=> string(40) "yoda_project_review_-_2019-4077_site.pdf" ["filesize"]=> int(1313744) ["url"]=> string(89) "https://yoda.yale.edu/wp-content/uploads/2023/08/yoda_project_review_-_2019-4077_site.pdf" ["link"]=> string(82) "https://yoda.yale.edu/data-request/2019-4077/yoda_project_review_-_2019-4077_site/" ["alt"]=> string(0) "" ["author"]=> string(4) "1363" ["description"]=> string(0) "" ["caption"]=> string(0) "" ["name"]=> string(36) "yoda_project_review_-_2019-4077_site" ["status"]=> string(7) "inherit" ["uploaded_to"]=> int(4819) ["date"]=> string(19) "2023-08-09 17:07:56" ["modified"]=> string(19) "2023-08-09 19:18:52" ["menu_order"]=> int(0) ["mime_type"]=> string(15) "application/pdf" ["type"]=> string(11) "application" ["subtype"]=> string(3) "pdf" ["icon"]=> string(62) "https://yoda.yale.edu/wp/wp-includes/images/media/document.png" } ["project_highlight_button"]=> array(3) { ["title"]=> string(22) "Publication Available!" ["url"]=> string(86) "https://bmcmedresmethodol.biomedcentral.com/articles/10.1186/s12874-022-01799-z#citeas" ["target"]=> string(6) "_blank" } ["search_order"]=> string(5) "-7080" } data partner
array(1) { [0]=> string(15) "johnson-johnson" }

pi country
array(1) { [0]=> string(6) "France" }

pi affil
array(1) { [0]=> string(8) "Industry" }

products
array(1) { [0]=> string(8) "invokana" }

num of trials
array(1) { [0]=> string(1) "9" }

res
array(1) { [0]=> string(1) "3" }

2019-4077

General Information

How did you learn about the YODA Project?: Internet Search

Conflict of Interest

Request Clinical Trials

Associated Trial(s):
  1. NCT01106625 - A Randomized, Double-Blind, Placebo-Controlled, 3-Arm, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Pioglitazone Therapy
  2. NCT01081834 - A Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin as Monotherapy in the Treatment of Subjects With Type 2 Diabetes Mellitus Inadequately Controlled With Diet and Exercise
  3. NCT01106677 - A Randomized, Double-Blind, Placebo and Active-Controlled, 4-Arm, Parallel Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin Monotherapy
  4. NCT00968812 - A Randomized, Double-Blind, 3-Arm Parallel-Group, 2-Year (104-Week), Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of JNJ-28431754 Compared With Glimepiride in the Treatment of Subjects With Type 2 Diabetes Mellitus Not Optimally Controlled on Metformin Monotherapy
  5. NCT01106651 - A Randomized, Double-Blind, Placebo-Controlled, Parallel-Group, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin Compared With Placebo in the Treatment of Older Subjects With Type 2 Diabetes Mellitus Inadequately Controlled on Glucose Lowering Therapy
  6. NCT01137812 - A Randomized, Double-Blind, Active-Controlled, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin Versus Sitagliptin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Sulphonylurea Therapy
  7. NCT02025907 - A Randomized, Double-blind, Placebo Controlled, 2-arm, Parallel-group, 26-week, Multicenter Study to Evaluate the Efficacy, Safety, and Tolerability of Canagliflozin in the Treatment of Subjects With Type 2 Diabetes Mellitus With Inadequate Glycemic Control on Metformin and Sitagliptin Therapy
  8. NCT01032629 - A Randomized, Multicenter, Double-Blind, Parallel, Placebo-Controlled Study of the Effects of JNJ-28431754 on Cardiovascular Outcomes in Adult Subjects With Type 2 Diabetes Mellitus
  9. NCT01989754 - A Randomized, Multicenter, Double-Blind, Parallel, Placebo-Controlled Study of the Effects of Canagliflozin on Renal Endpoints in Adult Subjects With Type 2 Diabetes Mellitus
What type of data are you looking for?:

Request Clinical Trials

Data Request Status

Status: Published

Research Proposal

Project Title: Evaluation of debiased machine learning methods to estimate the average treatment effect in observational studies.

Scientific Abstract: Background :
Machine learning [ML] methods can fit a wide class of functions and offers the possibility to work with high dimensional covariates. Recent approaches [Chernozhukov 2017] introduce asymptotically unbiased estimators relying on ML to model both the treatment and the outcome.
Objective :
Study the robustness of treatment effect [TE] estimators based on ML models and compare them to traditional estimators [Austin 2015, Glynn 2010].
Study Design :
A pool of clinical trials that share a common treatment (Canagliflozin) for one of the arm is used to compare the different estimators.
Participants :
We use the following trials including at least an arm treated by the Canagliflozin :
NCT00968812 NCT01032629 NCT01081834 NCT01106625 NCT01106651 NCT01106677 NCT01137812 NCT01989754 NCT02025907
Main Outcome Measure:
The study focus on TE on the change of HbA1C from baseline to week 26.
Statistical Analysis:
We compute in each setting the estimation, the related standard error and confidence intervals:
Assessing a treatment effect of zero between the Cana. arm of one trial and the Cana. arms of the remaining trials.
Given a Cana. arm, we add an artificial positive treatment $tau$ to each patient outcome. We then assess a treatment effect of $tau$ between the artificially modified Cana. arm and the remaining Cana. arms.
Given a trial, we replace the Cana. arm by the pool of Cana. arm from the remaining trials. The confidence intervals obtained using the different estimators is then compared to the CI obtained using OLS and the two arms of the random

Brief Project Background and Statement of Project Significance: There is a growing interest in complementing a single arm with historical data. Recently Amgen obtained breakthrough therapy designation from FDA, and conditional marketing authorization from EMA for Blincyto (blinatumomab) for the treatment of a rare form of leukemia using a pooled database of historical controls. The additional analysis requested by the EMA was performed using propensity score matching. Beyond approvals, regulatory agencies encouraged exploring the use of synthetic control arms. A white paper [DFH18] written by Medidata and FDA scientists was presented in a Friends of Cancer Research meeting in December 2018. This paper focused on the use of propensity score matching to reproduce the control arm. If estimators of treatment effect with machine learning are already used in econometrics [Chernozhukov 2017], this is not yet the case in healthcare. This kind of estimators could be used to get insight from observational data or inform better decision making in drug development by augmenting a single arm phase 2 with historical control.

Specific Aims of the Project: The objective of the project is to assess the performance of recently developed machine learning methods for treatment effect estimation [Chernozhukov 2017] and compare it to classical methods to estimate treatment effect in observational studies: propensity score matching, propensity score adjustment methods [Austin 2015, Robins 1995, Hahn 1998].

Study Design:

What is the purpose of the analysis being proposed? Please select all that apply.: Develop or refine statistical methods Research on clinical trial methods Research on comparison group Research on clinical prediction or risk prediction

Software Used: R

Data Source and Inclusion/Exclusion Criteria to be used to define the patient sample for your study: Every patient participating to the pool of trials is a potential source of information. As the methods require training ML models, the more patients available, the better. We selected trials with non disjointed inclusion/exclusion criteria to ensure the positivity assumption.

Primary and Secondary Outcome Measure(s) and how they will be categorized/defined for your study: HAb1c change from baseline to week 26, which is a shared outcome across the prespecified trials.

Main Predictor/Independent Variable and how it will be categorized/defined for your study: There is not one main predictor variable for the proposed study. Outcome and treatment models will be trained using machine learning on baseline characteristics that are shared among the clinical trials used.

Other Variables of Interest that will be used in your analysis and how they will be categorized/defined for your study: Baseline demographic and biologic variables will be used to train outcome and treatment models. Using those models, we will benchmark the different estimators of the average treatment effect.

Statistical Analysis Plan: A pool of clinical trials that share a common treatment (Canagliflozin) for one of the arm will be used to compare the different estimators. The outcome of interest to compute the treatment effect will be the change of HbA1C from baseline.
The evaluation of the estimators will be done in three stages:
* Experiment 1: Assessing a treatment effect of zero between the Canagliflozin arm of one trial and the Canagliflozin arms of the remaining trials.
* Experiment 2: Given a Canagliflozin arm, we add an artificial positive treatment $tau$ to each patient outcome. We then assess a treatment effect of $tau$ between the artificially modified Canagliflozin arm and the remaining Canagliflozin arms.
* Experiment 3: Given a trial, we replace the Canagliflozin arm by the pool of Canagliflozin arm from the remaining trials. The confidence intervals obtained using the different estimators is then compared to the confidence interval originally obtained using OLS and the two arms of the trials.
We will use the following trials including at least an arm treated by the Canagliflozin :
NCT00968812, NCT01032629, NCT01081834, NCT01106625, NCT01106651, NCT01106677, NCT01137812, NCT01989754, NCT02025907.
The study includes a comparison of the following estimators:
* Propensity score matching with treatment model trained using logistic regression and logit propensity score [Imai 2014];
* Inverse probability weighting with the treatment model trained using logistic regression and logit propensity score [Imai 2014];
* Double Machine Learning methods with sample-splitting and cross-fitting procedure [Chernozhukov 2017]. This method requires both outcome and treatment models. We will explore different methods for both models: random forest, gradient boosting models, SVM, logistic regression and linear regression.

Narrative Summary: The growing amount of data accumulated in the hospital EHR systems as well as in the past clinical trials represent a unique asset that can help to improve clinical decisions and to optimize drug development. Treatment effect estimation is one of the questions that can be addressed using various types of real world data, it remains, however, a challenging task due to biases induced by confounding factors as well as model regularization techniques when we use classical estimators. In this study, we intend to evaluate recently developed approaches in the econometrics literature based on Neyman orthogonal score functions using ML predictive [Chernozhukov 2017].

Project Timeline: Project start date: January 1, 2020
Analysis completion: April 1, 2020
Manuscript draft completion: May 1, 2020

Dissemination Plan: We plan on submitting this research as a research article in one of the following journal ?Statistics in Medicine? or ?Statistical Methods in Medical Research?.

Bibliography:

Chernozhukov, Victor, Denis Chetverikov, Mert Demirer, Esther Duflo, Christian Hansen, and Whitney Newey. 2017. “Double/Debiased/Neyman Machine Learning of Treatment Effects.” *American Economic Review* 107(5): 261–65. https://doi.org/10.1257/aer.p20171038>.
Austin, Peter C., and Elizabeth A. Stuart. 2015. “Moving Towards Best Practice When Using Inverse Probability of Treatment Weighting (IPTW) Using the Propensity Score to Estimate Causal Treatment Effects in Observational Studies.” *Statistics in Medicine* 34 (28): 3661–79. https://doi.org/10.1002/sim.6607>
Glynn, Adam N., and Kevin M. Quinn. 2010. “An Introduction to the Augmented Inverse Propensity Weighted Estimator.” *Political Analysis* 18 (1): 36–56. https://doi.org/10.1093/pan/mpp036>.
Robins, J. and A. Rotnitzky (1995). Semi-parametric efficiency in multivariate regression models with
missing data. Journal of the American Statistical Association 90, 122?29.
Hahn, J. (1998). On the role of the propensity score in efficient semi-parametric estimation of average
treatment effects. Econometrica 66, 315?31.
Imai, K. and Ratkovic, M. (2014). Covariate balancing propensity score. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 76(1):243{263.