1 00:00:05,800 --> 00:00:10,280 I'D LIKE TO WELCOME YOU TO THIS 2 00:00:10,280 --> 00:00:13,400 WORKSHOP WHICH WE'RE LOOKING 3 00:00:13,400 --> 00:00:14,880 FORWARD TO BE REALLY EXCITING 4 00:00:14,880 --> 00:00:18,760 AND GREAT THINGS WILL HAPPEN. 5 00:00:18,760 --> 00:00:20,520 AND THIS WORKSHOP WOULDN'T HAVE 6 00:00:20,520 --> 00:00:22,920 HAPPENED WITHOUT THE SUPPORT OF 7 00:00:22,920 --> 00:00:26,640 OUR LEADER, WALTER KOROSHETZ WHO 8 00:00:26,640 --> 00:00:28,520 HAS BEEN VERY EXCITED ABOUT 9 00:00:28,520 --> 00:00:29,640 TRYING TO DO SOMETHING ABOUT 10 00:00:29,640 --> 00:00:30,800 CHANGING THE CULTURE OF SCIENCE 11 00:00:30,800 --> 00:00:33,200 FOR QUITE SOME TIME. 12 00:00:33,200 --> 00:00:37,040 AND I'LL INVITE HIM TO SAY SOME 13 00:00:37,040 --> 00:00:45,360 OPENWORDS. 14 00:00:45,360 --> 00:00:47,720 >> THANKS, FOLKS. 15 00:00:47,720 --> 00:00:51,600 THANK YOU, VERY MUCH STEVE AND 16 00:00:51,600 --> 00:00:56,720 VERONIQUE FOR CHAIRING THIS VERY 17 00:00:56,720 --> 00:00:58,480 IMPORTANT SESSION AND THANKS TO 18 00:00:58,480 --> 00:01:01,000 DEVAN AND THE TEAM FOR WORKING 19 00:01:01,000 --> 00:01:05,000 THROUGH COVID OF UP THE UPS AND 20 00:01:05,000 --> 00:01:06,000 DOWNS AND THE THUNDERSTORMS AT 21 00:01:06,000 --> 00:01:10,200 THE AIRPORT YESTERDAY TRYING TO 22 00:01:10,200 --> 00:01:12,480 GET PEOPLE HERE. 23 00:01:12,480 --> 00:01:15,680 I CAN'T OVER ESTIMATE HOW 24 00:01:15,680 --> 00:01:17,200 IMPORTANT THIS CONFERENCE IS I 25 00:01:17,200 --> 00:01:18,760 WANT TO STEP BACK AND TALK TO 26 00:01:18,760 --> 00:01:20,440 YOU FROM THE NIH STANDPOINT. 27 00:01:20,440 --> 00:01:23,840 WE'RE A GRANTING AGENCY. 28 00:01:23,840 --> 00:01:26,920 WE'RE NOT REALLY EMPLOYEEING 29 00:01:26,920 --> 00:01:28,720 SCIENTISTS, WE'RE GIVING GRANTS 30 00:01:28,720 --> 00:01:30,400 OUT AND THESE GRANTS ARE FOR 31 00:01:30,400 --> 00:01:32,120 PEOPLE WHO DO WORK TO TURN IN A 32 00:01:32,120 --> 00:01:32,480 PRODUCT. 33 00:01:32,480 --> 00:01:34,680 THE PRODUCT IS NOT JUST THE 34 00:01:34,680 --> 00:01:36,280 RESULT IT'S THE WAY SCIENCE IS 35 00:01:36,280 --> 00:01:39,960 DONE IT'S THE FOUNDATION FOR 36 00:01:39,960 --> 00:01:42,400 SCIENCE IN THE U.S. 37 00:01:42,400 --> 00:01:44,400 BUT WHAT IS IT THAT WE ARE 38 00:01:44,400 --> 00:01:45,320 PAYING FOR? 39 00:01:45,320 --> 00:01:49,720 IF YOU HAVE TO TALK TO CONGRESS 40 00:01:49,720 --> 00:01:53,480 AND SAY IR PUTTING $41 BILLION 41 00:01:53,480 --> 00:01:55,560 INTO NIH BECAUSE YOU ARE 42 00:01:55,560 --> 00:01:56,480 GETTING, WHAT? 43 00:01:56,480 --> 00:01:58,320 YOU'RE GETTING EXCELLENT 44 00:01:58,320 --> 00:01:58,520 SCIENCE. 45 00:01:58,520 --> 00:02:00,160 THAT'S WHAT WE TELL CONGRESS AND 46 00:02:00,160 --> 00:02:02,760 THE TAXPAYERS WHO ARE PAYING THE 47 00:02:02,760 --> 00:02:04,880 TAXES AND PUTTING THE MONEY UP 48 00:02:04,880 --> 00:02:07,080 THAT COMES INTO NIH. 49 00:02:07,080 --> 00:02:08,680 WHAT DOES EXCELLENT SCIENCE 50 00:02:08,680 --> 00:02:09,040 MEAN? 51 00:02:09,040 --> 00:02:13,040 I THINK YOU'LL BE DISCUSSING 52 00:02:13,040 --> 00:02:17,120 THAT VARIOUS VARIANTS OF THAT 53 00:02:17,120 --> 00:02:19,440 TERM, "EXCELLENT SCIENCE." 54 00:02:19,440 --> 00:02:22,880 BUT I THINK IF YOU BOIL IT DOWN, 55 00:02:22,880 --> 00:02:23,760 JUST FROM MY POINT OF VIEW, IT'S 56 00:02:23,760 --> 00:02:25,080 SOMETHING YOU CAN TRUST. 57 00:02:25,080 --> 00:02:30,000 IT'S TRUSTWORTHY RESULTS. 58 00:02:30,000 --> 00:02:33,520 THAT'S REALLY IMPORTANT BECAUSE 59 00:02:33,520 --> 00:02:35,400 THAT'S THE BASIS OF SCIENCE 60 00:02:35,400 --> 00:02:38,760 MOVING FORWARD THAT WE CAN TRUST 61 00:02:38,760 --> 00:02:41,160 WHAT SOMEONE HAS PUBLISHED OR 62 00:02:41,160 --> 00:02:41,640 POST. 63 00:02:41,640 --> 00:02:47,080 IF THAT TRUST IS DIMINISHED AND 64 00:02:47,080 --> 00:02:51,280 IF THAT TRUST IS DIMINISHED THE 65 00:02:51,280 --> 00:02:53,840 TAXPAYER SAYS RIGHTLY WHY AM I 66 00:02:53,840 --> 00:02:55,360 GIVING MONEY TO SCIENCE 67 00:02:55,360 --> 00:02:57,680 RESEARCHERS IF I CAN'T TRUST THE 68 00:02:57,680 --> 00:02:57,880 RESULTS. 69 00:02:57,880 --> 00:03:00,600 IF THAT GETS TO CONGRESS YOU CAN 70 00:03:00,600 --> 00:03:04,120 BET OUR BUDGET AND SCIENCE IN 71 00:03:04,120 --> 00:03:06,760 THE U.S. WOULD BE IN CRITICAL 72 00:03:06,760 --> 00:03:08,520 STATES VERY QUICKLY. 73 00:03:08,520 --> 00:03:09,840 SO I THINK THAT'S WHAT I'D ASK 74 00:03:09,840 --> 00:03:11,760 YOU TO THINK ABOUT TODAY IN THE 75 00:03:11,760 --> 00:03:15,880 BIG PICTURE. 76 00:03:15,880 --> 00:03:19,800 HOW DO WE HELP SCIENCE PRODUCE 77 00:03:19,800 --> 00:03:21,800 WHAT WE CAN REALLY TRUST. 78 00:03:21,800 --> 00:03:23,400 THERE'S LOTS OF PIECES TO THIS 79 00:03:23,400 --> 00:03:25,000 BUT I WOULD SAY A PIECE THAT 80 00:03:25,000 --> 00:03:27,560 WE'RE GOING TO BE TALKING ABOUT 81 00:03:27,560 --> 00:03:30,160 MOST DURING THE SESSIONS IS HOW 82 00:03:30,160 --> 00:03:32,600 IS THE SCIENCE EXECUTED 83 00:03:32,600 --> 00:03:35,560 ACCORDING TO THE BEST POSSIBLE 84 00:03:35,560 --> 00:03:36,040 PRACTICES? 85 00:03:36,040 --> 00:03:39,480 SO IF YOU PUT A RESULT OUT AND 86 00:03:39,480 --> 00:03:41,520 IT'S WRONG BUT YOU DID 87 00:03:41,520 --> 00:03:45,040 EVERYTHING YOU COULD AT THAT 88 00:03:45,040 --> 00:03:49,560 TIME IN HISTORY TO EXAMINE IT 89 00:03:49,560 --> 00:03:51,000 AND IT LOOKED LIKE ALL RIGHT AND 90 00:03:51,000 --> 00:03:52,680 TURNS OUT WRONG, THAT'S FINE. 91 00:03:52,680 --> 00:03:55,520 DID IT ACCORDING TO BEST 92 00:03:55,520 --> 00:03:57,200 PRACTICES BUT WHAT DOES IT MEAN 93 00:03:57,200 --> 00:03:59,320 TO HAVE BEST PRACTICES IN 94 00:03:59,320 --> 00:03:59,560 SCIENCE? 95 00:03:59,560 --> 00:04:04,200 WHO DETERMINES WHAT THE BEST 96 00:04:04,200 --> 00:04:04,680 PRACTICES ARE? 97 00:04:04,680 --> 00:04:08,280 THE GOVERNMENT AND LIKELY THE 98 00:04:08,280 --> 00:04:08,680 INSTITUTIONS? 99 00:04:08,680 --> 00:04:09,720 I DON'T THINK SO. 100 00:04:09,720 --> 00:04:12,480 WHEN I STARTED OUT IN AN AREA OF 101 00:04:12,480 --> 00:04:16,160 SCIENCE IT WAS A SMALL AREA. 102 00:04:16,160 --> 00:04:16,720 THE BEST PRACTICES WERE 103 00:04:16,720 --> 00:04:23,880 REINFORCED BY A SCIENTIST'S 104 00:04:23,880 --> 00:04:25,600 REPUTATION AND YOU WENT INTO A 105 00:04:25,600 --> 00:04:26,480 CONFERENCE WITH 50 PEOPLE 106 00:04:26,480 --> 00:04:27,800 EVERYBODY KNEW THE REPUTATION OF 107 00:04:27,800 --> 00:04:28,120 EVERY SCIENTIST IN THE ROOM AND 108 00:04:28,120 --> 00:04:30,040 THEY KNEW WHO THEY WOULD TRUST 109 00:04:30,040 --> 00:04:31,320 AND WHO THEY COULDN'T TRUST. 110 00:04:31,320 --> 00:04:33,320 THAT'S THE WAY IT WAS IN THE 111 00:04:33,320 --> 00:04:34,480 '70s. 112 00:04:34,480 --> 00:04:36,640 NOW, THAT'S NOT TRUE ANYMORE. 113 00:04:36,640 --> 00:04:39,040 SCIENCE IS TOO BIG. 114 00:04:39,040 --> 00:04:41,920 THE REPUTATIONS DON'T EXPAND OUT 115 00:04:41,920 --> 00:04:43,040 BUT IN YOUR UNIVERSITY AND I CAN 116 00:04:43,040 --> 00:04:44,560 TELL YOU FROM MY UNIVERSITY 117 00:04:44,560 --> 00:04:47,880 TIME, WE KNEW WHO THE SLOPPY 118 00:04:47,880 --> 00:04:49,720 SCIENTISTS WERE AND WE KNEW WHO 119 00:04:49,720 --> 00:04:51,640 THE RIGOROUS SCIENTISTS WERE BUT 120 00:04:51,640 --> 00:04:54,080 NO ONE ELSE KNEW OUTSIDE OUR 121 00:04:54,080 --> 00:04:54,400 UNIVERSITY. 122 00:04:54,400 --> 00:04:57,160 SO THE REPUTATION SIDE OF THINGS 123 00:04:57,160 --> 00:04:58,840 THAT WERE DRIVING TRUSTWORTHY 124 00:04:58,840 --> 00:05:01,480 SCIENCE HAS BEEN DIMINISHED AS 125 00:05:01,480 --> 00:05:02,840 WE EXPANDED SCIENCE. 126 00:05:02,840 --> 00:05:06,880 SO WHAT'S THERE TO TAKE ITS 127 00:05:06,880 --> 00:05:07,080 PLACE? 128 00:05:07,080 --> 00:05:08,920 THINK WE'RE IN A VOID AND WHAT 129 00:05:08,920 --> 00:05:10,160 WE'RE ASKING YOU TO THINK ABOUT. 130 00:05:10,160 --> 00:05:14,200 HOW DO WE FILL THAT VOID TO 131 00:05:14,200 --> 00:05:16,560 ESTABLISH BEST PRACTICES 132 00:05:16,560 --> 00:05:19,600 THROUGHOUT OUR RESEARCH FIELD SO 133 00:05:19,600 --> 00:05:22,840 THAT OUR WORK CAN BE CONCEIVED 134 00:05:22,840 --> 00:05:25,000 AS TRUSTWORTHY? 135 00:05:25,000 --> 00:05:30,840 NOT JUST BY THE PUBLIC BUT BY 136 00:05:30,840 --> 00:05:32,640 THE SCIENTISTS AS WELL. 137 00:05:32,640 --> 00:05:34,240 THE DANGER OF SCIENCE GOING 138 00:05:34,240 --> 00:05:36,480 FORWARD THAT IS NOT TRUSTWORTHY 139 00:05:36,480 --> 00:05:37,720 HAS EFFECTS EVEN ON THE SCIENCE 140 00:05:37,720 --> 00:05:38,000 COMMUNITY. 141 00:05:38,000 --> 00:05:39,760 YOUNG PEOPLE DO NOT WANT TO BE 142 00:05:39,760 --> 00:05:43,000 PART OF SOMETHING THEY CAN'T 143 00:05:43,000 --> 00:05:43,440 TRUST. 144 00:05:43,440 --> 00:05:44,480 SO THEY'RE IN THE LAB AND THEY 145 00:05:44,480 --> 00:05:47,800 KNOW WHAT'S GOING ON AND UNLESS 146 00:05:47,800 --> 00:05:50,520 THE WORK IS BEING PERFORMED AT 147 00:05:50,520 --> 00:05:52,600 THE HIGHEST LEVEL OF QUALITY, 148 00:05:52,600 --> 00:05:53,760 THEY'RE GOING TO BE TURNED AWAY 149 00:05:53,760 --> 00:06:00,400 FROM SCIENCE AS WELL. 150 00:06:00,400 --> 00:06:04,240 IT'S NOT JUST THE TAXPAYERS AND 151 00:06:04,240 --> 00:06:08,680 CONGRESS BUT IF WE DON'T SEE 152 00:06:08,680 --> 00:06:12,000 WHAT WE DO AS TRUSTWORTHY WE 153 00:06:12,000 --> 00:06:14,120 CAN'T EXPECT CONGRESS OR THE 154 00:06:14,120 --> 00:06:16,040 PUBLIC TO THINK SO. 155 00:06:16,040 --> 00:06:18,120 IF WE DON'T FILL THAT VOID, WHAT 156 00:06:18,120 --> 00:06:18,360 HAPPENS? 157 00:06:18,360 --> 00:06:22,560 WE ALL KNOW THERE ARE INCREDIBLE 158 00:06:22,560 --> 00:06:24,160 INCENTIVES TO MOVE SCIENCE 159 00:06:24,160 --> 00:06:25,680 FORWARD TO MAKE IT LOOK GOOD 160 00:06:25,680 --> 00:06:29,520 THOUGH IT MAY NOT BE CORRECT. 161 00:06:29,520 --> 00:06:31,040 THOSE ARE HOW DO YOU GET GRANT 162 00:06:31,040 --> 00:06:32,280 MONEY AND YOU HAVE TO CONVINCE 163 00:06:32,280 --> 00:06:34,440 PEOPLE AND THERE ARE SOME PEOPLE 164 00:06:34,440 --> 00:06:35,960 REALLY GOOD AT WRITING GRANTS 165 00:06:35,960 --> 00:06:38,440 AND I'M NOT CONVINCED EVERY ONE 166 00:06:38,440 --> 00:06:40,120 OF THEM IS A RIGOROUS SCIENTIST 167 00:06:40,120 --> 00:06:40,920 BUT THEY'LL GET THEIR GRANTS 168 00:06:40,920 --> 00:06:43,120 BECAUSE THEY CAN WORK THE 169 00:06:43,120 --> 00:06:44,280 SYSTEM. 170 00:06:44,280 --> 00:06:54,240 I DON'T HAVE A WAY, DR. KRETSKY 171 00:06:54,240 --> 00:06:55,800 SAID YOU HAVE TO STOP FUNDING 172 00:06:55,800 --> 00:06:58,520 THE CROOKS AND A SAID HOW DO YOU 173 00:06:58,520 --> 00:07:02,200 I KNOW WHO THE CROOKS ARE AND HE 174 00:07:02,200 --> 00:07:03,240 SAID YOU KNOW THEM AND I SAID 175 00:07:03,240 --> 00:07:04,960 NOT ALL OF THEM. 176 00:07:04,960 --> 00:07:08,480 WE NEED A BETTER SYSTEM THAN 177 00:07:08,480 --> 00:07:11,120 WHAT WE HAVE NOW BECAUSE 178 00:07:11,120 --> 00:07:12,440 FOLLOWING THE PREVAILING 179 00:07:12,440 --> 00:07:17,440 NARRATIVE ARE THE INCENTIVES 180 00:07:17,440 --> 00:07:21,280 PUSHING SCIENCE IN SOMEWHAT 181 00:07:21,280 --> 00:07:22,160 PERVERSE DIRECTIONS AND THIS 182 00:07:22,160 --> 00:07:23,240 WILL LEAD TO FAILURE. 183 00:07:23,240 --> 00:07:26,120 I CAN TELL YOU I WAS IN THE 184 00:07:26,120 --> 00:07:29,600 STROKE FIELD IN THE LATE '90s, 185 00:07:29,600 --> 00:07:30,880 EVERYONE IN THE STOKE FIELD WAS 186 00:07:30,880 --> 00:07:34,880 TOTALLY CONVINCED WE COULD GIVE 187 00:07:34,880 --> 00:07:37,920 A NEUROPROTECTIVE AGENT TO A 188 00:07:37,920 --> 00:07:39,880 STROKE PATIENT AND PREVENT THEIR 189 00:07:39,880 --> 00:07:41,080 STROKE FROM GETTING WORSE. 190 00:07:41,080 --> 00:07:43,400 THAT'S BECAUSE ALL THE ANIMAL 191 00:07:43,400 --> 00:07:44,240 EXPERIMENTS SHOWED AND THAT 192 00:07:44,240 --> 00:07:45,840 EXPERIMENT INS CULTURE I WORKED 193 00:07:45,840 --> 00:07:46,840 ON THAT LOOKED LIKE THAT WOULD 194 00:07:46,840 --> 00:07:47,440 BE TRUE. 195 00:07:47,440 --> 00:07:51,560 THE WHOLE THING WAS A SHAM. 196 00:07:51,560 --> 00:07:54,480 IT DIDN'T TURN OUT -- INDUSTRY 197 00:07:54,480 --> 00:07:56,840 CAME IN WITH WILL YONZ OF 198 00:07:56,840 --> 00:07:58,920 DOLLARS TO FUND STROKE STUDIES 199 00:07:58,920 --> 00:08:02,360 AND DEVELOP NEUROPROTECTIVE 200 00:08:02,360 --> 00:08:05,240 AGENTS AND THEY ALL FAILED. 201 00:08:05,240 --> 00:08:06,560 THE GROUP SEEING THE FAILURE 202 00:08:06,560 --> 00:08:10,240 WENT BACK AND STARTED THIS 203 00:08:10,240 --> 00:08:10,640 ORGANIZATION. 204 00:08:10,640 --> 00:08:15,080 IT'S STILL RUNNING NOW CALLED 205 00:08:15,080 --> 00:08:18,640 THE STARE COMMITTEE AND THEY 206 00:08:18,640 --> 00:08:20,320 ESTABLISHED RIGOROUS PRACTICES 207 00:08:20,320 --> 00:08:22,600 FOR STROKE, NEUROPROTECTIVE 208 00:08:22,600 --> 00:08:23,240 RESEARCH. 209 00:08:23,240 --> 00:08:25,920 A WHOLE LIST OF THINGS THEY 210 00:08:25,920 --> 00:08:28,360 ASKED FOR TO BE DONE BEFORE 211 00:08:28,360 --> 00:08:28,960 INDUSTRY GETS INVOLVED AND 212 00:08:28,960 --> 00:08:30,360 BRINGS SOMETHING TO PATIENTS. 213 00:08:30,360 --> 00:08:31,720 IT WAS BORN OUT OF FAILURE. 214 00:08:31,720 --> 00:08:34,000 LOTS OF THINGS YOU TALK ABOUT 215 00:08:34,000 --> 00:08:35,160 NOW ARE BASICALLY A LOT OF 216 00:08:35,160 --> 00:08:37,400 THINGS THAT CAME OUT OF THAT 217 00:08:37,400 --> 00:08:42,360 STROKE FIELD IN THE LATE '90s, 218 00:08:42,360 --> 00:08:45,360 EARLY 2000s BUT THE DAMAGE DONE 219 00:08:45,360 --> 00:08:46,440 IS UNBELIEVABLE. 220 00:08:46,440 --> 00:08:48,920 RIGHT KNOW STROKE IS THE THIRD 221 00:08:48,920 --> 00:08:50,280 LEADING CAUSE OF DEATH IN THE 222 00:08:50,280 --> 00:08:52,600 UNITED STATES AND THERE'S NO 223 00:08:52,600 --> 00:08:55,600 PHARMACEUTICAL COMPANY IN THE 224 00:08:55,600 --> 00:08:56,840 U.S., EUROPE, MAJOR 225 00:08:56,840 --> 00:08:57,360 PHARMACEUTICAL COMPANY 226 00:08:57,360 --> 00:08:58,080 INTERESTED IN DEVELOPING ANY 227 00:08:58,080 --> 00:08:59,880 TREATMENT FOR STROKE. 228 00:08:59,880 --> 00:09:05,880 THAT'S NOW 22 YEARS AFTER. 229 00:09:05,880 --> 00:09:08,400 THE PENALTY YOU PAY FOR GOING 230 00:09:08,400 --> 00:09:10,880 DOWN THIS PATH OF LESS RIGOROUS 231 00:09:10,880 --> 00:09:14,400 OR NON-RIGOROUS RESEARCH IS 232 00:09:14,400 --> 00:09:17,520 REALLY QUITE EXTREME AND SO 233 00:09:17,520 --> 00:09:18,160 WE'RE TALKING TO YOU TODAY 234 00:09:18,160 --> 00:09:23,600 BECAUSE WE WANT YOU TO FILL THIS 235 00:09:23,600 --> 00:09:25,360 VOID TO HELP PEOPLE AROUND THE 236 00:09:25,360 --> 00:09:27,520 COUNTRY AND WORLD TO BUILD TRUST 237 00:09:27,520 --> 00:09:28,880 IN THE SCIENCE WE DO. 238 00:09:28,880 --> 00:09:30,880 THE PENALTIES ARE HUGE IF WE 239 00:09:30,880 --> 00:09:32,360 DON'T MEET THIS CHALLENGE. 240 00:09:32,360 --> 00:09:34,880 IF WE DO MEET THIS CHALLENGE 241 00:09:34,880 --> 00:09:40,880 THEN I THINK SCIENCE WILL 242 00:09:40,880 --> 00:09:42,560 CLEARLY ADVANCE AT A MORE RAPID 243 00:09:42,560 --> 00:09:44,360 PACE AND NINDS IS REALLY 244 00:09:44,360 --> 00:09:48,480 COMMITTED AND SO WE STARTED THIS 245 00:09:48,480 --> 00:09:54,840 OFFICE FOR RESEARCH QUALITY WITH 246 00:09:54,840 --> 00:10:00,440 CHEY AND DEVAN AND WE'LL HAVE 247 00:10:00,440 --> 00:10:11,000 CENTER TO VALIDATE MATERIALS BUT 248 00:10:11,680 --> 00:10:13,840 THIS CAN'T BE DONE BY A 249 00:10:13,840 --> 00:10:15,120 GOVERNMENT OFFICE IT REQUIRES 250 00:10:15,120 --> 00:10:16,360 THE PEOPLE IN THE TRENCHES TO 251 00:10:16,360 --> 00:10:18,000 PICK UP THE TORCH AND CHANGE THE 252 00:10:18,000 --> 00:10:20,040 SYSTEM FOR THE BETTER. 253 00:10:20,040 --> 00:10:22,600 AND IT'S NOT EASY BECAUSE THE 254 00:10:22,600 --> 00:10:23,440 DISINCENTIVES ARE PRETTY STRONG 255 00:10:23,440 --> 00:10:26,840 THAT WE MENTIONED AND YOU'LL BE 256 00:10:26,840 --> 00:10:28,200 TALKING ABOUT THEM BUT I THINK 257 00:10:28,200 --> 00:10:30,440 PEOPLE WANT TO DO THE RIGHT 258 00:10:30,440 --> 00:10:32,080 THING AND SO IN THE END I THINK 259 00:10:32,080 --> 00:10:34,640 PEOPLE WILL DO THE RIGHT THING. 260 00:10:34,640 --> 00:10:37,760 WE JUST HAVE TO KEEPER SIFTING 261 00:10:37,760 --> 00:10:39,400 AND HELPING DEVELOP BEST 262 00:10:39,400 --> 00:10:40,960 PRACTICES, GET THEM OUT THERE. 263 00:10:40,960 --> 00:10:44,080 WHEN PEOPLE DON'T FOLLOW BEST 264 00:10:44,080 --> 00:10:45,480 PRACTICES, THERE WILL BE A 265 00:10:45,480 --> 00:10:49,240 PENALTY AND THEY WILL SEE THAT 266 00:10:49,240 --> 00:10:51,840 IT'S NOT ADVANTAGEOUS TO THEM AT 267 00:10:51,840 --> 00:10:53,120 LEAST IN THE LONG RUN. 268 00:10:53,120 --> 00:10:56,480 I'M VERY HOPEFUL THAT THIS KIND 269 00:10:56,480 --> 00:11:00,000 OF ACTIVITY WILL SUCCEED AND I'M 270 00:11:00,000 --> 00:11:01,120 REALLY -- A LOT OF GRATITUDE TO 271 00:11:01,120 --> 00:11:03,560 THE PEOPLE HERE BECAUSE I THINK 272 00:11:03,560 --> 00:11:06,840 YOU'RE GOING TO HOPEFULLY BE THE 273 00:11:06,840 --> 00:11:10,400 ONES WHO LEAVE THIS MEETING WITH 274 00:11:10,400 --> 00:11:13,520 THE AMMUNITION, THE IDEAS AND 275 00:11:13,520 --> 00:11:14,640 COMMUNITY SUPPORT AMONG 276 00:11:14,640 --> 00:11:16,880 YOURSELVES TO MAKE THIS HAPPEN 277 00:11:16,880 --> 00:11:18,800 IN YOUR INSTITUTIONS AND 278 00:11:18,800 --> 00:11:23,120 CERTAINLY AT NINDS WE'RE LEER -- 279 00:11:23,120 --> 00:11:23,760 HERE TO BACK YOU. 280 00:11:23,760 --> 00:11:26,600 THANK YOU AGAIN FOR COMING AGAIN 281 00:11:26,600 --> 00:11:28,880 AND THANK YOU STEVE AND LOOK 282 00:11:28,880 --> 00:11:39,320 FORWARD TO A GOOD MEETING. 283 00:11:42,960 --> 00:11:46,120 >> I FORGOT TO REMIND EVERYONE 284 00:11:46,120 --> 00:11:47,440 WE'RE REQUIRED TO REMAIN WITH 285 00:11:47,440 --> 00:11:49,160 SIX FEET OF DISTANCING AND WEAR 286 00:11:49,160 --> 00:11:51,680 MASKS THE ENTIRE TIME. 287 00:11:51,680 --> 00:11:56,160 THAT'S THE CHANGE IN THE LEVEL 288 00:11:56,160 --> 00:11:57,640 OF COVID IN THE AREA SO PLEASE 289 00:11:57,640 --> 00:11:58,920 TRY TO MAINTAIN DISTANCE. 290 00:11:58,920 --> 00:12:09,360 THANKS A LOT. 291 00:12:09,360 --> 00:12:10,240 >> GOOD MORNING. 292 00:12:10,240 --> 00:12:15,040 THAT'S SUPPOSED TO WAKE YOU UP. 293 00:12:15,040 --> 00:12:17,880 BETWEEN THE RISING LOCAL COVID 294 00:12:17,880 --> 00:12:20,120 RATES AND THE DROPPING 295 00:12:20,120 --> 00:12:24,280 BAROMETERS WHICH CANCELED A FEW 296 00:12:24,280 --> 00:12:25,320 FLIGHTS LATE LAST NIGHT I CAN'T 297 00:12:25,320 --> 00:12:28,000 TELL YOU WHAT A RELIEF IT IS TO 298 00:12:28,000 --> 00:12:29,560 SEE YOU ALL HERE AT LEAST THOSE 299 00:12:29,560 --> 00:12:31,000 WHO MADE IT. 300 00:12:31,000 --> 00:12:33,760 I'M STEVE GOODMAN A PROFESSOR AT 301 00:12:33,760 --> 00:12:35,680 STANFORD OF EPIDEMIOLOGY AND 302 00:12:35,680 --> 00:12:44,200 MEDICINE AND CO-CHAIRING THIS 303 00:12:44,200 --> 00:12:47,240 AND WITH OUR CO-CONSPIRATORS 304 00:12:47,240 --> 00:12:48,640 FROM THE OFFICE OF RESEARCH 305 00:12:48,640 --> 00:12:50,080 QUALITY AND DEVAN CRAWFORD, I 306 00:12:50,080 --> 00:12:54,520 WANT TO BOTH WELCOME YOU AND 307 00:12:54,520 --> 00:12:56,200 PROFOUNDLY THANK YOU FOR 308 00:12:56,200 --> 00:12:59,480 DEVOTING SERIOUS TRAVEL AND TWO 309 00:12:59,480 --> 00:13:00,960 IN-PERSON DAYS FOR THIS MEETING 310 00:13:00,960 --> 00:13:02,800 AND FOR SOME MY BE THE FIRST 311 00:13:02,800 --> 00:13:03,480 SCIENTIFIC MEETING YOU'VE BEEN 312 00:13:03,480 --> 00:13:05,760 TO IN A WHILE. 313 00:13:05,760 --> 00:13:07,720 WE TRIED VERY HARD TO DESIGN IT 314 00:13:07,720 --> 00:13:10,800 IN A WAY TO MAKE IT WORTH YOUR 315 00:13:10,800 --> 00:13:11,200 WHILE. 316 00:13:11,200 --> 00:13:13,520 I'LL EXPLAIN WHY. 317 00:13:13,520 --> 00:13:15,640 I'VE BEEN INVOLVED WITH MANY 318 00:13:15,640 --> 00:13:16,960 RESEARCH REFORM EFFORTS OVER THE 319 00:13:16,960 --> 00:13:22,040 LAST 30 YEARS INCLUDING AT THE 320 00:13:22,040 --> 00:13:23,560 CREATION OF THE CARBON 321 00:13:23,560 --> 00:13:24,240 COLLABORATION WHICH MEANS I HAVE 322 00:13:24,240 --> 00:13:27,760 TO BE CARBON DATED IT'S THE 323 00:13:27,760 --> 00:13:28,840 FIRST WITH THIS EXPLICIT FOCUS 324 00:13:28,840 --> 00:13:30,000 WHICH IS HOW TO CHANGE THE 325 00:13:30,000 --> 00:13:32,240 RESEARCH INSTITUTIONS WHERE MANY 326 00:13:32,240 --> 00:13:34,640 OF US LIVE NOT JUST HOW WE DO 327 00:13:34,640 --> 00:13:35,080 OUR SCIENCE. 328 00:13:35,080 --> 00:13:37,000 ON A PERSONAL LEVEL THIS ALIGNS 329 00:13:37,000 --> 00:13:38,840 WITH MY OWN EVOLUTION. 330 00:13:38,840 --> 00:13:40,800 I'VE BEEN WRITING AND LECTURING 331 00:13:40,800 --> 00:13:44,800 FOR DECADES HOW TO DO BIOMEDICAL 332 00:13:44,800 --> 00:13:46,240 RESEARCH DIFFERENTLY AND I 333 00:13:46,240 --> 00:13:49,960 DECIDED I WANTED TO TRY AND MAKE 334 00:13:49,960 --> 00:13:51,800 THAT HAPPEN WHERE I LIVE AND 335 00:13:51,800 --> 00:13:53,520 HAVE AN ANSWER TO THE QUESTION, 336 00:13:53,520 --> 00:13:55,440 OH, WHAT'S HAPPENING AT STANFORD 337 00:13:55,440 --> 00:13:57,520 AND I'D HAVE TO SAY, ARE YOU 338 00:13:57,520 --> 00:13:59,840 DOING THAT AND I'D HAVE TO SAY 339 00:13:59,840 --> 00:14:01,120 NOT MUCH. 340 00:14:01,120 --> 00:14:02,920 WE CREATE THE STANFORD PROGRAM 341 00:14:02,920 --> 00:14:05,520 ON RESEARCH RIGOR AND 342 00:14:05,520 --> 00:14:07,480 RESPONSIBILITY, SORRY, 343 00:14:07,480 --> 00:14:08,960 REPRODUCIBILITY. 344 00:14:08,960 --> 00:14:11,280 IT'S PARTLY FUNDED THROUGH THE 345 00:14:11,280 --> 00:14:12,440 STANFORD CTSA. 346 00:14:12,440 --> 00:14:16,200 THAT'S AN IDEA FOR THOSE AT CTSA 347 00:14:16,200 --> 00:14:16,560 INSTITUTIONS. 348 00:14:16,560 --> 00:14:18,040 IT'S ATTEMPTING TO DO MANY OF 349 00:14:18,040 --> 00:14:19,720 THE THINGS SEVERAL OTHER 350 00:14:19,720 --> 00:14:21,600 ENTITIES AND MORE IN EUROPE ARE 351 00:14:21,600 --> 00:14:24,400 ALREADY DOING OR TRYING TO DO. 352 00:14:24,400 --> 00:14:25,880 MANY REPRESENTATIVES OF THOSE 353 00:14:25,880 --> 00:14:27,720 GROUPS ARE HERE AND I'M EAGER TO 354 00:14:27,720 --> 00:14:28,960 LEARN FROM THEM AND OTHERS WHO 355 00:14:28,960 --> 00:14:31,120 ARE STRUGGLING WITH THE SAME 356 00:14:31,120 --> 00:14:32,680 ISSUES WE ARE WITH SOME WE 357 00:14:32,680 --> 00:14:36,120 HAVEN'T YET ENCOUNTERED AND 358 00:14:36,120 --> 00:14:38,160 LEARNING FROM THOSE WAY AHEAD OF 359 00:14:38,160 --> 00:14:38,360 US. 360 00:14:38,360 --> 00:14:40,520 THIS MEETING IS STRUCTURED IN A 361 00:14:40,520 --> 00:14:42,240 WAY SO EACH CAN MAKE A 362 00:14:42,240 --> 00:14:42,560 DIFFERENCE. 363 00:14:42,560 --> 00:14:44,840 THERE'S NO PASSIVE ATTENDEES 364 00:14:44,840 --> 00:14:45,200 HERE. 365 00:14:45,200 --> 00:14:46,520 THOUGH HALF OF YOU ARE NAMED ON 366 00:14:46,520 --> 00:14:49,760 THE AGENDA, EACH OF YOU WAS 367 00:14:49,760 --> 00:14:51,920 INVITED FOR A REASON. 368 00:14:51,920 --> 00:14:54,400 WE DEVOTED MORE THAN HALF THE 369 00:14:54,400 --> 00:14:56,200 WORKSHOP TO HEAR YOU FROM AND 370 00:14:56,200 --> 00:14:58,640 TIME FOR NETWORKING. 371 00:14:58,640 --> 00:15:00,360 WE CONSIDER YOU ALL SPEAKERS 372 00:15:00,360 --> 00:15:02,120 YOU'LL SEE HOW IN A MINUTE. 373 00:15:02,120 --> 00:15:03,480 FIRST I'D LIKE TO ENCOURAGE YOU 374 00:15:03,480 --> 00:15:08,400 TO LOOK AROUND THE AUDIENCE AT 375 00:15:08,400 --> 00:15:09,320 THE ATTENDEE LIST. 376 00:15:09,320 --> 00:15:10,760 MY GUESS IS FOR THOSE WHO SPENT 377 00:15:10,760 --> 00:15:13,840 TIME IN REFORM AND METASCIENCE 378 00:15:13,840 --> 00:15:14,960 MEETINGS THERE'LL BE QUITE A FEW 379 00:15:14,960 --> 00:15:16,800 FOLKS YOU DON'T KNOW BY DESIGN. 380 00:15:16,800 --> 00:15:18,160 MANY ARE DOING TRANSFORMATIVE 381 00:15:18,160 --> 00:15:20,560 WORK IN THEIR OWN DISCIPLINES OR 382 00:15:20,560 --> 00:15:23,800 HOMES BUT NOT IN OTHERS SO THEY 383 00:15:23,800 --> 00:15:28,720 DON'T ATTEND THE COLLECTIVE 384 00:15:28,720 --> 00:15:29,000 MEETINGS. 385 00:15:29,000 --> 00:15:30,640 EACH OF THEM AND YOU IS A 386 00:15:30,640 --> 00:15:32,800 CHAMPION FOR GOOD SCIENCE AND 387 00:15:32,800 --> 00:15:33,920 HENCE THE WORD IN THE CONFERENCE 388 00:15:33,920 --> 00:15:34,240 TITLE. 389 00:15:34,240 --> 00:15:37,080 MAUI NOT SEE YOURSELF AS A 390 00:15:37,080 --> 00:15:37,320 CHAMPION. 391 00:15:37,320 --> 00:15:40,160 IT'S JUST WHAT YOU DO. 392 00:15:40,160 --> 00:15:44,560 AND WHAT YOU'RE DRIVEN TO DO. 393 00:15:44,560 --> 00:15:47,800 YOU EACH COME FROM A WIDE ARRAY 394 00:15:47,800 --> 00:15:49,160 OF DISCIPLINES AND HAVE AN 395 00:15:49,160 --> 00:15:50,120 OPPORTUNITY TO TEACH OTHERS. 396 00:15:50,120 --> 00:15:54,440 I ENCOURAGE YOU TO IDENTIFY YOUR 397 00:15:54,440 --> 00:16:03,360 DISCIPLINARY OR METH OMETHODOLO 398 00:16:03,360 --> 00:16:03,560 HOME. 399 00:16:03,560 --> 00:16:05,240 SCIENCE REFORM MEETINGS I 400 00:16:05,240 --> 00:16:07,360 OBSERVED MANY PEOPLE USE THE 401 00:16:07,360 --> 00:16:09,440 WORD SCIENCE QUITE GENERICALLY 402 00:16:09,440 --> 00:16:11,400 THOUGH THE PROBLEMS AND 403 00:16:11,400 --> 00:16:12,480 SOLUTIONS IN THEIR OWN FIELD 404 00:16:12,480 --> 00:16:17,800 DON'T NECESSARILY APPLY TO ALL. 405 00:16:17,800 --> 00:16:20,000 ACKNOWLEDGING SCIENTIFIC 406 00:16:20,000 --> 00:16:22,200 DIVERSITY BECOMES IMPORTANT 407 00:16:22,200 --> 00:16:25,400 WHERE THE EXPERIMENTAL 408 00:16:25,400 --> 00:16:27,120 METHODOLOGY AND NORMS ARE 409 00:16:27,120 --> 00:16:28,640 DIFFERENT FIELD FROM FIELD SO I 410 00:16:28,640 --> 00:16:31,480 THINK WE'LL LEARN THE MOST TO 411 00:16:31,480 --> 00:16:32,800 EXPLAIN WHAT SCIENTIFIC CULTURES 412 00:16:32,800 --> 00:16:35,000 WE KNOW BEST AND A SIGN OF 413 00:16:35,000 --> 00:16:36,760 RESPECT FOR OTHERS. 414 00:16:36,760 --> 00:16:38,640 LET'S TALK ABOUT THE CONFERENCE 415 00:16:38,640 --> 00:16:40,840 THEME AND THAT THEME IN A SINGLE 416 00:16:40,840 --> 00:16:43,640 WORD THERE'S A LOT OF WORDS OUT 417 00:16:43,640 --> 00:16:46,240 THERE IS CHANGE AND CHANGE AND 418 00:16:46,240 --> 00:16:47,680 COMPLEX SYSTEMS IS NOT SOMETHING 419 00:16:47,680 --> 00:16:49,240 THAT HAPPENS EASILY OR NATURALLY 420 00:16:49,240 --> 00:16:51,120 AND SMART PEOPLE WHO STUDY 421 00:16:51,120 --> 00:16:53,440 ORGANIZATION HAVE A VARIETY OF 422 00:16:53,440 --> 00:16:55,960 THEORIES ABOUT HOW TO AFFECT 423 00:16:55,960 --> 00:16:56,160 CHANGE. 424 00:16:56,160 --> 00:16:58,080 WE'VE CHOSEN ONE POPULARIZED 425 00:16:58,080 --> 00:17:03,360 VERSION TO STRUCTURE THE MEETING 426 00:17:03,360 --> 00:17:05,280 DESCRIBED IN A BOOK, SWITCH, HOW 427 00:17:05,280 --> 00:17:06,520 TO CHANGE THINGS WHEN CHANGE IS 428 00:17:06,520 --> 00:17:10,840 HARD AND THIS IS AN AREA WHERE 429 00:17:10,840 --> 00:17:19,440 CHANGE IS VERY HARD. 430 00:17:19,440 --> 00:17:21,240 IT KEEPS TELLING KNOW CONNECT TO 431 00:17:21,240 --> 00:17:22,320 THE NETWORK. 432 00:17:22,320 --> 00:17:23,720 THE FIRST FRAME IN THE SESSION 433 00:17:23,720 --> 00:17:26,000 IS HOW TO MOTIVATE OTHERS TO 434 00:17:26,000 --> 00:17:27,120 ACKNOWLEDGE THE PROBLEM AND THAT 435 00:17:27,120 --> 00:17:28,640 SOMETHING NEEDS TO BE DONE AND 436 00:17:28,640 --> 00:17:30,680 EVEN BETTER TO JOIN YOU. 437 00:17:30,680 --> 00:17:34,840 IN OUR CASE IN ACADEMIC RESEARCH 438 00:17:34,840 --> 00:17:36,280 THOSE PEOPLE ARE INSTITUTIONAL 439 00:17:36,280 --> 00:17:37,600 LEADERS, FACULTY, STAFF, 440 00:17:37,600 --> 00:17:40,840 STUDENTS AND MEMBERS OF 441 00:17:40,840 --> 00:17:41,120 COMMUNITY. 442 00:17:41,120 --> 00:17:42,080 THE SECOND SESSION IS HOW TO 443 00:17:42,080 --> 00:17:45,960 TEACH PEOPLE THE THINGS THEY 444 00:17:45,960 --> 00:17:47,600 NEED TO KNOW ALONG WITH THEIR 445 00:17:47,600 --> 00:17:48,280 DESIRED BEHAVIORS TO CHANGE HOW 446 00:17:48,280 --> 00:17:48,920 SCIENCE IS DONE. 447 00:17:48,920 --> 00:17:50,800 THE THIRD IS HOW TO REMOVE THE 448 00:17:50,800 --> 00:17:52,600 BARRIERS TO THAT CHANGE OR TO 449 00:17:52,600 --> 00:17:54,280 MAKE IT EASIER THROUGH TOOL 450 00:17:54,280 --> 00:17:56,720 CREATION, NORMING OF THE RIGHT 451 00:17:56,720 --> 00:17:58,320 BEHAVIORS AND INCENTIVES 452 00:17:58,320 --> 00:18:00,320 REMOVING NEGATIVE ONES AND 453 00:18:00,320 --> 00:18:01,120 CREATING POSITIVE ONES. 454 00:18:01,120 --> 00:18:02,360 THE FINAL MEETING SESSION WHICH 455 00:18:02,360 --> 00:18:04,320 IS ACTUALLY NOT FORMALLY PART OF 456 00:18:04,320 --> 00:18:06,760 THEIR FRAMEWORK IS HOW OTHER 457 00:18:06,760 --> 00:18:09,040 COMPONENTS OF THE SCIENTIFIC ECO 458 00:18:09,040 --> 00:18:10,560 SYSTEM WHICH INCLUDES OTHER 459 00:18:10,560 --> 00:18:13,720 INSTITUTIONS, FUNDERS, 460 00:18:13,720 --> 00:18:16,120 REGULATORS, GOVERNMENT, JOURNALS 461 00:18:16,120 --> 00:18:17,040 AND PROFESSIONAL SOCIETIES AND 462 00:18:17,040 --> 00:18:20,120 THE NON-PROFIT OR FOR-PROFIT 463 00:18:20,120 --> 00:18:22,520 PRIVATE SECTOR CAN WORK TOGETHER 464 00:18:22,520 --> 00:18:29,320 TO FACILITATE CHANGE. 465 00:18:29,320 --> 00:18:30,960 THIS CHANGE FRAMEWORK IS NOT THE 466 00:18:30,960 --> 00:18:33,280 ONLY ONE NOR WILL I IT CAPTURE 467 00:18:33,280 --> 00:18:35,000 EVERY ELEMENT IN THE FIRST TWO 468 00:18:35,000 --> 00:18:35,240 DAYS. 469 00:18:35,240 --> 00:18:38,200 THE FIRST SPEAKER, DAMON CENTOLA 470 00:18:38,200 --> 00:18:40,600 HAS A NEWER BOOK CALLED CHANGE, 471 00:18:40,600 --> 00:18:43,880 HOW TO MAKE BIG THINGS HAPPEN. 472 00:18:43,880 --> 00:18:49,240 HE HAS A SOMEWHAT DIFFERENT 473 00:18:49,240 --> 00:18:50,600 THEORETICAL APPROACH FOR 474 00:18:50,600 --> 00:18:51,640 PROGRAMMATIC PURPOSE TO BREAK 475 00:18:51,640 --> 00:18:54,520 DOWN THE COMPLEX TASK WE HAVE 476 00:18:54,520 --> 00:18:55,240 BEFORE US INTO DISCREET 477 00:18:55,240 --> 00:18:57,760 PERFORMANCE AND HAVE A PLACE TO 478 00:18:57,760 --> 00:18:59,720 PARK VARIOUS ISSUES OTHERWISE 479 00:18:59,720 --> 00:19:01,840 AND EVERYONE HERE HAS SEEN THIS, 480 00:19:01,840 --> 00:19:03,520 THERE'S A TENDENCY TO TALK ABOUT 481 00:19:03,520 --> 00:19:07,880 ALL ASPECTS OF THE PROBLEM AT 482 00:19:07,880 --> 00:19:09,920 ONCE WHICH IS BOTH OVERWHELMING 483 00:19:09,920 --> 00:19:11,360 AND SELF-DEFEATING BECAUSE WE 484 00:19:11,360 --> 00:19:13,120 CAN'T SOLVE IT AS A WHOLE UNTIL 485 00:19:13,120 --> 00:19:14,360 WE BREAK IT DOWN AND HAVE THE 486 00:19:14,360 --> 00:19:15,280 SAME CONVERSATION IN EVERY 487 00:19:15,280 --> 00:19:19,680 SESSION, WE GET MORE AND MORE 488 00:19:19,680 --> 00:19:21,880 TIRED, LITTLE PROGRESS IS MADE 489 00:19:21,880 --> 00:19:24,640 EXCEPT FOR A RESOLUTION TO HAVE 490 00:19:24,640 --> 00:19:26,760 ANOTHER MEETING BECAUSE IT S SO 491 00:19:26,760 --> 00:19:27,160 LITTLE. 492 00:19:27,160 --> 00:19:29,480 WE PROVIDED CERTAIN PLACES TO 493 00:19:29,480 --> 00:19:31,480 HAVE CONVERSATIONS TO HOPEFULLY 494 00:19:31,480 --> 00:19:33,200 HAVE PROGRESS ON EACH AND THE 495 00:19:33,200 --> 00:19:36,400 MODERATORS WILL BE ON ALERT TO 496 00:19:36,400 --> 00:19:38,120 DEFER OR DEPART OTHER TOPICS TO 497 00:19:38,120 --> 00:19:40,680 OTHER SECTIONS TO BE MORE FULLY 498 00:19:40,680 --> 00:19:41,080 DISCUSSED. 499 00:19:41,080 --> 00:19:50,880 PLEASE BE RESPECTFUL OF THAT. 500 00:19:50,880 --> 00:19:53,720 IF IT'S A TOPIC THAT DOESN'T FIT 501 00:19:53,720 --> 00:19:55,320 IN YOUR FRAME WORK WE'LL TAKE 502 00:19:55,320 --> 00:19:58,640 MOTE AND THE MODERATOR CAN USE 503 00:19:58,640 --> 00:20:01,720 THEIR DISCRETION TO MODERATE IT. 504 00:20:01,720 --> 00:20:04,600 THE STRUCTURE OF THE THEME. 505 00:20:04,600 --> 00:20:07,520 EACH SPEAKER WILL GIVE 10 TO 15 506 00:20:07,520 --> 00:20:11,920 MINUTE PRESENTATIONS AND HAVE 507 00:20:11,920 --> 00:20:13,240 EVERYONE A SPEAKER. 508 00:20:13,240 --> 00:20:15,920 ONE IS A PLENARY CONVERSATION 509 00:20:15,920 --> 00:20:19,360 WITH A FULL HOUR DEVOTED TO IT 510 00:20:19,360 --> 00:20:21,080 AS MUCH AS THE SESSION ITSELF 511 00:20:21,080 --> 00:20:22,960 AND USE IT ON MOTIVATION AND 512 00:20:22,960 --> 00:20:24,440 WORKING TOGETHER THE FIRST AND 513 00:20:24,440 --> 00:20:24,800 LAST SESSION. 514 00:20:24,800 --> 00:20:27,360 THE TWO MIDDLE SESSIONS WE'LL 515 00:20:27,360 --> 00:20:29,440 USE A VERSION OF THE WORLD CAFE 516 00:20:29,440 --> 00:20:31,080 METHOD WHICH GETS EVERYBODY'S 517 00:20:31,080 --> 00:20:34,520 INPUT ON CRITICAL SUBTOPICS AND 518 00:20:34,520 --> 00:20:36,120 FOR EACH WORLD CAFE SESSION WE 519 00:20:36,120 --> 00:20:46,520 HAVE A TOPIC IN THE AGENDA AND 520 00:20:46,520 --> 00:20:48,840 IT WILL ROTATE AND THEY'LL BRAIN 521 00:20:48,840 --> 00:20:50,160 STORM SOLUTIONS TO THE THEME AND 522 00:20:50,160 --> 00:20:52,080 WRITE THEM ON STICKY NOTES ON A 523 00:20:52,080 --> 00:20:54,040 BOARD AND ORGANIZED BY A 524 00:20:54,040 --> 00:20:54,360 MODERATOR. 525 00:20:54,360 --> 00:20:55,920 THE SECOND GROUP WILL HEAR WHAT 526 00:20:55,920 --> 00:20:59,880 THE FIRST GROUP DID THROUGH THE 527 00:20:59,880 --> 00:21:01,160 MODERATOR AND THEN BUILD ON WHAT 528 00:21:01,160 --> 00:21:02,600 THE FIRST GROUP DID. 529 00:21:02,600 --> 00:21:04,440 THE THIRD GROUP WILL ORGANIZE 530 00:21:04,440 --> 00:21:06,240 AND PRIORITIZE SUGGESTIONS OF 531 00:21:06,240 --> 00:21:10,280 THE PREVIOUS GROUP ADDING 532 00:21:10,280 --> 00:21:10,880 ANYTHING THEY THINK WAS MISSED. 533 00:21:10,880 --> 00:21:12,000 WE'LL TAKE A PICTURE OF THOSE 534 00:21:12,000 --> 00:21:13,400 BOARDS AND WHEN IT'S ALL OVER 535 00:21:13,400 --> 00:21:14,520 AND WRITE THEM UP. 536 00:21:14,520 --> 00:21:15,840 THIS GIVES EACH OF YOU A CHANCE 537 00:21:15,840 --> 00:21:19,000 TO WEIGH IN ON MULTIPLE TOPICS 538 00:21:19,000 --> 00:21:21,320 IN THE SMALL GROUPS TO HAVE YOUR 539 00:21:21,320 --> 00:21:24,240 SAY BECAUSE THEY ARE SMALL, 540 00:21:24,240 --> 00:21:26,800 EXTRACT YOUR COLLECTIVE WISDOM 541 00:21:26,800 --> 00:21:28,280 ELIMINATES THE NEEDS FOR 542 00:21:28,280 --> 00:21:29,120 REPORT-OUTS COLLECTIVELY WHICH 543 00:21:29,120 --> 00:21:31,280 ARE ALWAYS A BEAR AND NOT SURE 544 00:21:31,280 --> 00:21:32,320 WE GET A LOT OUT OF THOSE. 545 00:21:32,320 --> 00:21:35,680 BEFORE I FINISH, A FEW WORDS ON 546 00:21:35,680 --> 00:21:37,440 TERMINOLOGY BECAUSE WE HAVE A 547 00:21:37,440 --> 00:21:40,240 FRIGHTENING ARRAY OF OUR WORDS 548 00:21:40,240 --> 00:21:43,160 THAT WE'LL BE USING, RIGOR, 549 00:21:43,160 --> 00:21:44,480 REPRODUCIBILITY AND 550 00:21:44,480 --> 00:21:47,080 REPEATABILITY, I CAN GO ON. 551 00:21:47,080 --> 00:21:50,520 BUT THIS MEETING WILL TILT 552 00:21:50,520 --> 00:21:54,000 TOWARDS THE RIGOR SIDE WHICH A 553 00:21:54,000 --> 00:22:02,560 LITTLE LESS ON THE REPRODU 554 00:22:02,560 --> 00:22:06,800 REPRODUCIBILITY SIDE AND THE 555 00:22:06,800 --> 00:22:10,560 LATTER APPLIES TO ALL SCIENCE 556 00:22:10,560 --> 00:22:12,240 BUT THE REQUIREMENTS OF RIGOR 557 00:22:12,240 --> 00:22:16,040 ARE MORE DISCIPLINE SPECIFIC I 558 00:22:16,040 --> 00:22:22,240 WOULD SAY THAN OPEN SCIENCE AND 559 00:22:22,240 --> 00:22:25,320 CAN BE A HARDER SIDE SO IT'S 560 00:22:25,320 --> 00:22:29,400 UNCLEAR WHAT RIGOR AS WE MEAN IT 561 00:22:29,400 --> 00:22:30,840 MEANS TO MANY COLLEAGUES OAR 562 00:22:30,840 --> 00:22:33,960 WHAT RIGOR REFORM DOES UNLESS 563 00:22:33,960 --> 00:22:35,760 THE TRAINING WE TALK ABOUT 564 00:22:35,760 --> 00:22:36,520 DIFFERS FROM WHAT'S ALREADY 565 00:22:36,520 --> 00:22:37,200 OFFERED. 566 00:22:37,200 --> 00:22:43,720 THIS IS A TRICKY PROBLEM 567 00:22:43,720 --> 00:22:45,840 POLITICALLY AND SCIENTIFICALLY. 568 00:22:45,840 --> 00:22:50,280 THE NIA DOESN'T HELP TOO MUCH IN 569 00:22:50,280 --> 00:22:54,000 DEFINE RIGOR BECAUSE THEY USE 570 00:22:54,000 --> 00:22:56,240 RIGOR TWICE IN THE DEFINITION OF 571 00:22:56,240 --> 00:22:56,640 RIGOR. 572 00:22:56,640 --> 00:22:58,520 I'M SYMPATHETIC IT'S LIKE TRYING 573 00:22:58,520 --> 00:23:01,280 TO DEFINE CAUSE WITHOUT THE WORD 574 00:23:01,280 --> 00:23:01,640 CAUSE. 575 00:23:01,640 --> 00:23:03,920 I'LL OFFER A CONCEPTUAL 576 00:23:03,920 --> 00:23:05,480 DEFINITION HERE WHICH IS THAT 577 00:23:05,480 --> 00:23:07,480 IT'S ABOUT GETTING THE 578 00:23:07,480 --> 00:23:08,440 UNCERTAINTY RIGHT. 579 00:23:08,440 --> 00:23:12,560 IT HAS TWO PARTS. 580 00:23:12,560 --> 00:23:16,920 I WOULD SUGGEST A RIGOROUS IS 581 00:23:16,920 --> 00:23:24,120 WHERE WE LOOK AT THE EPIDEMIC 582 00:23:24,120 --> 00:23:25,360 UNCERTAINTY AND MINIMIZED IT 583 00:23:25,360 --> 00:23:26,480 USING WHAT WE CALL BEST 584 00:23:26,480 --> 00:23:28,640 PRACTICES AND WHAT REMAINS IS 585 00:23:28,640 --> 00:23:30,880 PROPERLY REFLECTS IN THE 586 00:23:30,880 --> 00:23:33,400 KNOWLEDGE CLAIM. 587 00:23:33,400 --> 00:23:38,560 THE FIT BETWEEN THE METHODOLOGY 588 00:23:38,560 --> 00:23:41,320 AND STOCHASTIC AND GETTING THE 589 00:23:41,320 --> 00:23:43,200 DESIGN AND SCRUPULOUS 590 00:23:43,200 --> 00:23:44,480 MEASUREMENT TO ALL THE SOURCES 591 00:23:44,480 --> 00:23:46,000 OF VARIATION INCLUDING THE 592 00:23:46,000 --> 00:23:47,640 SOURCES HARD TO QUANTIFY LIKE 593 00:23:47,640 --> 00:23:48,760 MODEL CHOICE. 594 00:23:48,760 --> 00:23:52,480 SO A NON-RIGOROUS STUDY IS WHERE 595 00:23:52,480 --> 00:23:54,040 THE INVESTIGATORS CLAIM MORE 596 00:23:54,040 --> 00:23:55,400 CERTAINTY THAN DESERVED. 597 00:23:55,400 --> 00:23:58,280 PARTICULARLY IF THAT INFLATED 598 00:23:58,280 --> 00:24:00,600 UNCERTAINTY IS DUE TO NEGLECT OF 599 00:24:00,600 --> 00:24:02,480 BASIC PRINCIPLES OF SIGN, 600 00:24:02,480 --> 00:24:04,440 ANALYSIS OR INFERENCE. 601 00:24:04,440 --> 00:24:05,920 IT'S PARTICULARLY IMPORTANT IN A 602 00:24:05,920 --> 00:24:08,400 MEETING LIKE THIS TO NOT HAVE A 603 00:24:08,400 --> 00:24:09,720 MORE NORMATIVE DEFINITION OF 604 00:24:09,720 --> 00:24:11,280 RIGOR BECAUSE THE DESIGN AND 605 00:24:11,280 --> 00:24:13,080 DATA SOURCES AND METHODS AND 606 00:24:13,080 --> 00:24:15,880 STANDARDS OF PROOF VARY SO 607 00:24:15,880 --> 00:24:17,800 WIDELY ACROSS FIELD AND IF WE 608 00:24:17,800 --> 00:24:19,320 START ARGUING ABOUT THE 609 00:24:19,320 --> 00:24:21,160 DEFINITION OF RIGOR IN A 610 00:24:21,160 --> 00:24:23,840 NORMATIVE SENSE IT CAN SLIDE 611 00:24:23,840 --> 00:24:28,160 INTO UNHELPFUL IMPLICATIONS FOR 612 00:24:28,160 --> 00:24:30,400 EXAMPLE ONE CAN'T USE 613 00:24:30,400 --> 00:24:31,160 RANDOMIZATION OR THE OTHER 614 00:24:31,160 --> 00:24:32,880 DOESN'T UNDERSTAND MECHANISMS 615 00:24:32,880 --> 00:24:37,480 AND ISN'T DETERMINISTIC. 616 00:24:37,480 --> 00:24:39,120 EVERYBODY HERE IS DOING THE BEST 617 00:24:39,120 --> 00:24:42,560 THEY CAN WITH THE RESOURCES THEY 618 00:24:42,560 --> 00:24:42,800 HAVE. 619 00:24:42,800 --> 00:24:44,840 REPRODUCIBILITY HAS MANY 620 00:24:44,840 --> 00:24:46,880 MEANINGS WHICH DIFFER ACROSS 621 00:24:46,880 --> 00:24:47,160 CULTURES. 622 00:24:47,160 --> 00:24:48,760 IT CAN MEAN COMPLETE AND 623 00:24:48,760 --> 00:24:50,400 TRANSPARENT REPORTING AND 624 00:24:50,400 --> 00:24:52,000 METHODOLOGY AND RESULTS. 625 00:24:52,000 --> 00:24:56,080 IT CAN MEAN A SIMILAR RESULT 626 00:24:56,080 --> 00:24:57,760 UPON REANALYSIS OR SIMILAR 627 00:24:57,760 --> 00:25:01,040 RESULT IN A REPEATED EXPERIMENT. 628 00:25:01,040 --> 00:25:02,240 I'M NOT GOING TO PIN US DOWN TO 629 00:25:02,240 --> 00:25:05,160 ONE BUT ASK IF YOU USE THAT WORD 630 00:25:05,160 --> 00:25:08,080 BE CLEAR WHAT YOU MEAN. 631 00:25:08,080 --> 00:25:09,520 WE CAN'T ASSUME UNIVERSALS IN A 632 00:25:09,520 --> 00:25:10,920 MEETING LIKE THIS. 633 00:25:10,920 --> 00:25:12,280 SO WHAT'S OUR GOAL? 634 00:25:12,280 --> 00:25:13,920 WELL, IT'S TO PROVIDE IDEAS AND 635 00:25:13,920 --> 00:25:15,480 SUPPORT TO THOSE TRYING TO 636 00:25:15,480 --> 00:25:17,280 STRENGTHEN THE SCIENCE IN THEIR 637 00:25:17,280 --> 00:25:18,280 INSTITUTIONS AND DISCIPLINES. 638 00:25:18,280 --> 00:25:21,120 WE'LL DO THAT THROUGH THE NEXT 639 00:25:21,120 --> 00:25:21,680 TWO DAYS OF CONVERSATIONS 640 00:25:21,680 --> 00:25:23,800 SHARING THE PRODUCTS OF THIS 641 00:25:23,800 --> 00:25:26,400 MEETING AND POTENTIALLY CREATING 642 00:25:26,400 --> 00:25:28,280 AN ONGOING INFRASTRUCTURE SO 643 00:25:28,280 --> 00:25:29,680 THIS CAN CONTINUE GOING FORWARD 644 00:25:29,680 --> 00:25:31,160 WHETHER THIS IS THE FIRST 645 00:25:31,160 --> 00:25:33,160 MEETING OR FIRST ANNUAL MEETING 646 00:25:33,160 --> 00:25:36,520 I'M NOT SURE, WE'LL SEE. 647 00:25:36,520 --> 00:25:40,520 IF WE HAVE A SECOND I'M GOING TO 648 00:25:40,520 --> 00:25:45,280 SUGGEST ADJUSTING THE TITLE. 649 00:25:45,280 --> 00:25:46,520 A LITTLE CLUTCHY BUT IT CAPTURES 650 00:25:46,520 --> 00:25:47,760 THE ESSENCE OF WHAT WE'RE TRYING 651 00:25:47,760 --> 00:25:49,720 TO DO. 652 00:25:49,720 --> 00:25:51,440 WHAT IT MEANS CAN BE DECIDED BY 653 00:25:51,440 --> 00:25:52,760 ALL OF US RECOGNIZING THE TIME 654 00:25:52,760 --> 00:25:54,360 COURSE OF THESE MEETINGS WILL BE 655 00:25:54,360 --> 00:25:54,760 LONG. 656 00:25:54,760 --> 00:25:57,120 IT WON'T HAPPEN IN THE NEXT YEAR 657 00:25:57,120 --> 00:26:00,160 TWO YEARS IF WE UNDERSTAND THIS 658 00:26:00,160 --> 00:26:02,000 IS AN EVOLUTION I THINK WE'LL 659 00:26:02,000 --> 00:26:03,520 PUT THE RIGHT THINGS IN PLACE. 660 00:26:03,520 --> 00:26:07,960 THANK YOU AGAIN FOR TRUSTING US 661 00:26:07,960 --> 00:26:08,840 ENOUGH TO MAKE THIS TREK AND 662 00:26:08,840 --> 00:26:10,440 SPEND THE TWO DAYS HERE AND I 663 00:26:10,440 --> 00:26:14,400 HOPE THE TRUST IS VINDICATED BY 664 00:26:14,400 --> 00:26:20,480 THE END OF TOMORROW. 665 00:26:20,480 --> 00:26:26,760 I'LL PASS THE BATON TO DAVID 666 00:26:26,760 --> 00:26:29,160 CENTOLA AT THE UNIVERSITY OF 667 00:26:29,160 --> 00:26:30,120 PENNSYLVANIA WHERE HE'S THE 668 00:26:30,120 --> 00:26:32,560 LEADER OF THE NETWORKS DYNAMICS 669 00:26:32,560 --> 00:26:35,040 GROUP AND WON A WIDE ARRAY OF 670 00:26:35,040 --> 00:26:37,640 NICE RECOGNITIONS AND PRIZES 671 00:26:37,640 --> 00:26:39,240 INCLUDING MY FAVORITE, A PRIZE I 672 00:26:39,240 --> 00:26:41,720 DIDN'T KNOW EXISTED UNTIL I SAW 673 00:26:41,720 --> 00:26:44,840 HE WON IT THE GOODMAN AWARD IN 674 00:26:44,840 --> 00:26:45,080 SOCIOLOGY. 675 00:26:45,080 --> 00:26:45,880 NOW I HAVE TO LEARN A LITTLE BIT 676 00:26:45,880 --> 00:26:50,120 ABOUT SOCIOLOGY. 677 00:26:50,120 --> 00:26:51,360 I ASSUME PROFESSOR GOODMAN KNEW 678 00:26:51,360 --> 00:26:53,640 SOMETHING ABOUT THE FIELD. 679 00:26:53,640 --> 00:26:55,560 HE'S CONSULTED FOR A WIDE 680 00:26:55,560 --> 00:26:57,280 VARIETY OF COMPANIES OR ENTITIES 681 00:26:57,280 --> 00:26:59,600 WE INTERACT WITH EVERY DAY AND 682 00:26:59,600 --> 00:27:02,360 MY PARTICULAR FAVORITES ARE BEN 683 00:27:02,360 --> 00:27:06,400 AND JERRY'S AND BNBA. 684 00:27:06,400 --> 00:27:09,760 I WON'T BORE YOU BY TALKING 685 00:27:09,760 --> 00:27:10,840 ABOUT THE WARRIORS AND THEIR 686 00:27:10,840 --> 00:27:11,960 GAME LAST NIGHT. 687 00:27:11,960 --> 00:27:14,800 HE ALSO WRITTEN HOW BEHAVIOR 688 00:27:14,800 --> 00:27:18,200 SPREAD, THE SCIENCE OF COMPLEX 689 00:27:18,200 --> 00:27:20,600 CONTAGIONS WRITTEN BEFORE COVID. 690 00:27:20,600 --> 00:27:21,680 SO HE'LL GIVE US A BRIEF TASTE 691 00:27:21,680 --> 00:27:24,120 OF THIS WORK TO HELP US DO OURS 692 00:27:24,120 --> 00:27:26,680 BETTER AND MAYBE HE'LL ENTICE 693 00:27:26,680 --> 00:27:28,480 SOME OF TO YOU SEND ROYALTIES 694 00:27:28,480 --> 00:27:32,360 HIS WAY WHEN HE'S DONE. 695 00:27:32,360 --> 00:27:33,480 THANK YOU VERY MUCH AND I'LL 696 00:27:33,480 --> 00:27:35,960 HAND IT OVER TO YOU, DAMON. 697 00:27:35,960 --> 00:27:37,160 >>THANKS VERY MUCH AND I 698 00:27:37,160 --> 00:27:37,800 APPRECIATE THE OPPORTUNITY TO 699 00:27:37,800 --> 00:27:40,160 SHARE SOME OF THIS WORK WITHHE 700 00:27:40,160 --> 00:27:40,760 GROUP HERE. 701 00:27:40,760 --> 00:27:43,240 I'M GOING TALK ABOUT IDEAS FROM 702 00:27:43,240 --> 00:27:45,240 MY RECENT BOOK, CHANGE, 703 00:27:45,240 --> 00:27:47,400 PARTICULARLY HOW IT'S RELEVANT 704 00:27:47,400 --> 00:27:48,640 TO CHANGES IN SCIENTIFIC 705 00:27:48,640 --> 00:27:49,000 PRACTICES. 706 00:27:49,000 --> 00:27:50,000 WHEN WE LOOK AT INDIVIDUALS 707 00:27:50,000 --> 00:27:52,080 TRYING TO MAKE A BEHAVIOR CHANGE 708 00:27:52,080 --> 00:27:54,440 WE TEND TO THINK HOW EACH 709 00:27:54,440 --> 00:27:56,680 INDIVIDUAL WOULD ACT TO MEASURE 710 00:27:56,680 --> 00:28:01,800 LIKE THE DETAILS, THE F MRI AND 711 00:28:01,800 --> 00:28:03,520 COMPLETE PHYSIOLOGY OF THE FISH 712 00:28:03,520 --> 00:28:06,520 BUT WHEN YOU PUT 10,000 OF THEM 713 00:28:06,520 --> 00:28:08,640 TOGETHER ANTICIPATE HOW THEY'LL 714 00:28:08,640 --> 00:28:09,520 BEHAVE COLLECTIVELY AND THE 715 00:28:09,520 --> 00:28:10,560 ANSWER IS NO AND TO UNDERSTAND 716 00:28:10,560 --> 00:28:12,320 THE COLLECTIVE BEHAVIOR OF A 717 00:28:12,320 --> 00:28:14,360 COMPLEX SET OF ORGANISMS YOU 718 00:28:14,360 --> 00:28:15,400 NEED TO UNDERSTAND THE 719 00:28:15,400 --> 00:28:17,680 COLLECTIVE AS A WHOLE AND HOW 720 00:28:17,680 --> 00:28:20,800 THEY INTERACT TO PREDICT THE 721 00:28:20,800 --> 00:28:22,640 COMPLEX, BEAUTIFUL AND OFTEN 722 00:28:22,640 --> 00:28:24,320 ADAPTIVE BEHAVIORS AND SAME WITH 723 00:28:24,320 --> 00:28:24,680 PEOPLE. 724 00:28:24,680 --> 00:28:27,240 INDIVIDUAL PSYCHOLOGY IT DOESN'T 725 00:28:27,240 --> 00:28:31,280 TELL US A LOT HOW SOCIAL NORMS 726 00:28:31,280 --> 00:28:33,400 TAKE HOLD A LARGE POPULATION NOR 727 00:28:33,400 --> 00:28:38,400 HOW TO SHIFT THE NORMS AND WE 728 00:28:38,400 --> 00:28:40,360 LOOK AT SCIENTIFIC PRACTICES AND 729 00:28:40,360 --> 00:28:44,160 NOT JUST A BELIEF IN RIGOR BUT 730 00:28:44,160 --> 00:28:45,560 DAILY ROUTINES OF RIGOR THAT 731 00:28:45,560 --> 00:28:47,680 TAKE HOLD WITHIN THE ACADEMIC 732 00:28:47,680 --> 00:28:48,760 CENTERS AND UNIVERSITIES. 733 00:28:48,760 --> 00:28:51,080 BASICALLY WE TALK ABOUT THESE 734 00:28:51,080 --> 00:28:53,920 KINDS OF LARGE-SCALE CHANGES IN 735 00:28:53,920 --> 00:28:56,040 BEHAVIOR IN GENERAL IN 736 00:28:56,040 --> 00:28:57,480 ORGANIZATIONS AND SOCIETY IS 737 00:28:57,480 --> 00:28:58,720 TYPICALLY THROUGH SOME KIND OF 738 00:28:58,720 --> 00:28:59,720 SOCIAL NETWORK. 739 00:28:59,720 --> 00:29:00,680 WE SAY MAYBE THERE ARE DIFFERENT 740 00:29:00,680 --> 00:29:03,240 TYPES OF PEOPLE IN THE NETWORK 741 00:29:03,240 --> 00:29:05,280 SOME IN THE CENTER MASSIVELY 742 00:29:05,280 --> 00:29:07,400 CONNECTED AND THEN SOME IN THE 743 00:29:07,400 --> 00:29:08,760 PERIPHERY MORE MODESTLY 744 00:29:08,760 --> 00:29:10,160 CONNECTED AND IT'S NOT JUST THE 745 00:29:10,160 --> 00:29:11,840 NUMBER OF CONNECTIONS THEY HAVE 746 00:29:11,840 --> 00:29:14,000 BUT THEY TEND TO HAVE 747 00:29:14,000 --> 00:29:16,800 CONNECTIONS SHOOTING OUT IN ALL 748 00:29:16,800 --> 00:29:20,160 DIRECTIONS FROM THE CENTER WE 749 00:29:20,160 --> 00:29:24,800 CALL WEAK TIES AND ON THE 750 00:29:24,800 --> 00:29:26,360 PERIPHERY HAVE TIES AND IT 751 00:29:26,360 --> 00:29:28,800 ALTERS HOW THEIR POSITION IN THE 752 00:29:28,800 --> 00:29:30,080 NETWORK AFFECTS THEIR CAPACITY 753 00:29:30,080 --> 00:29:31,840 TO INFLUENCE THE REST OF THE 754 00:29:31,840 --> 00:29:32,120 POPULATION. 755 00:29:32,120 --> 00:29:34,440 SO ONE OF THE CLASSIC IDEAS I 756 00:29:34,440 --> 00:29:36,880 HAVE OF CHANGE AND ONE I'LL 757 00:29:36,880 --> 00:29:38,680 DISABUSE YOU OF TODAY IS WHEN WE 758 00:29:38,680 --> 00:29:41,960 LOOK AT CHANGE PROCESSES WE TEND 759 00:29:41,960 --> 00:29:43,800 TO IMAGINE SOME HIGHLY CONNECTED 760 00:29:43,800 --> 00:29:47,720 IN A SENSIBLE CENTER OF THE 761 00:29:47,720 --> 00:29:48,720 NETWORK, ADOPTION INNOVATION 762 00:29:48,720 --> 00:29:52,760 TAKES UP THE BANNER OF THE NEW 763 00:29:52,760 --> 00:29:55,160 IDEA FOR INSTITUTIONAL CHANGE 764 00:29:55,160 --> 00:29:56,800 AND SPREADS THAT AROUND AND 765 00:29:56,800 --> 00:29:59,080 PEOPLE BECOME MEMBERS OF THE 766 00:29:59,080 --> 00:30:00,800 BANDWAGON AND SO ON AND SO FORTH 767 00:30:00,800 --> 00:30:08,720 AND SEE THIS CASCADING CHANGE IN 768 00:30:08,720 --> 00:30:11,360 IDEAS AND PRACTICES IS A POPULAR 769 00:30:11,360 --> 00:30:13,880 MOTION OF CHANGE FROM THE 1940s. 770 00:30:13,880 --> 00:30:15,000 WHAT'S INTERESTING TODAY IS WE 771 00:30:15,000 --> 00:30:16,720 HAVE DATA. 772 00:30:16,720 --> 00:30:20,280 WE HAVE DATA FROM ORGANIZATIONAL 773 00:30:20,280 --> 00:30:22,280 CHANGE AND DATA IN CHANGES IN 774 00:30:22,280 --> 00:30:23,000 SCIENTIFIC PRACTICES. 775 00:30:23,000 --> 00:30:25,040 WHATE TEND TO SEE IS WHEN 776 00:30:25,040 --> 00:30:26,840 CHANGE TAKES HOLD, INTERESTINGLY 777 00:30:26,840 --> 00:30:28,920 IT TENDS TO TAKE HOLD OUT IN THE 778 00:30:28,920 --> 00:30:32,000 PERIPHERY OF THE NETWORK AND 779 00:30:32,000 --> 00:30:36,360 WHEN IT SPREAD IT STARS STARTS A 780 00:30:36,360 --> 00:30:39,440 CASCADE TO PERCOLATE AROUND THE 781 00:30:39,440 --> 00:30:42,920 NETWORK AND DOESN'T GET TO THOSE 782 00:30:42,920 --> 00:30:44,640 IN THE CENTER WHICH IS 783 00:30:44,640 --> 00:30:46,440 INTERESTING SCIENTIFICALLY 784 00:30:46,440 --> 00:30:48,480 BECAUSE IT FRAMES A CLEAR PUZZLE 785 00:30:48,480 --> 00:30:52,520 WHERE OUR BEST THEORIES SAY 786 00:30:52,520 --> 00:30:54,560 CHANGE, INNOVATION AND DIFFUSION 787 00:30:54,560 --> 00:30:57,600 AND SCIENTIFIC PRACTICES SPREAD 788 00:30:57,600 --> 00:31:04,080 FROM THE INSIDE-OUT AND THE DATA 789 00:31:04,080 --> 00:31:05,840 SHOWS IT GOES FROM THE PERIPHERY 790 00:31:05,840 --> 00:31:07,320 TOWARDS THE CENTER. 791 00:31:07,320 --> 00:31:11,720 WHAT'S GOING ON IS A SENTIMENTAL 792 00:31:11,720 --> 00:31:14,040 DISCONNECT BETWEEN OUR 793 00:31:14,040 --> 00:31:15,360 INTUITIONS AND WHEN THE DATA 794 00:31:15,360 --> 00:31:16,880 SAYS IS HAPPENING. 795 00:31:16,880 --> 00:31:18,160 INTUITION IS THE NETWORKS WE'RE 796 00:31:18,160 --> 00:31:21,160 SHOWN AND THE ONE ON THE LEFT 797 00:31:21,160 --> 00:31:23,440 LOOKS FAST. 798 00:31:23,440 --> 00:31:24,040 EVERYTHING SEEMS LIKE IT WILL 799 00:31:24,040 --> 00:31:25,480 ACCELERATE A CHANGE AND THE 800 00:31:25,480 --> 00:31:26,720 PERSON IN THE CENTER HAS LOTS OF 801 00:31:26,720 --> 00:31:28,600 TIES AND THEY'RE RADIATING OUT 802 00:31:28,600 --> 00:31:32,600 IN DIFFERENT DIRECTIONS. 803 00:31:32,600 --> 00:31:35,640 AND THERE'S CERTAIN KINDS OF 804 00:31:35,640 --> 00:31:36,640 CONTAGIONS LIKE COVID-19 805 00:31:36,640 --> 00:31:38,160 EFFECTIVE FOR DIFFUSION. 806 00:31:38,160 --> 00:31:39,920 WE'RE LOOKING AT THE BEHAVIOR 807 00:31:39,920 --> 00:31:40,640 CHANGE THAT REQUIRES SWITCHING 808 00:31:40,640 --> 00:31:44,640 FROM ONE KIND OF BEHAVIOR THAT 809 00:31:44,640 --> 00:31:46,440 YOU UNDERSTAND IS FAMILIAR TO 810 00:31:46,440 --> 00:31:48,200 NEW BEHAVIOR THAT REQUIRES 811 00:31:48,200 --> 00:31:50,600 PUTTING AT RISK YOUR COMPETENCY 812 00:31:50,600 --> 00:31:52,480 OR HOW YOU ENGAGE EVERY DAY. 813 00:31:52,480 --> 00:31:56,320 A DIFFERENT NETWORK WILL BE 814 00:31:56,320 --> 00:31:57,240 IMPORTANT TO GETTING THOSE 815 00:31:57,240 --> 00:31:59,680 CHANGES OFF THE GROUND. 816 00:31:59,680 --> 00:32:01,320 THE NETWORK ON THE RIGHT IS 817 00:32:01,320 --> 00:32:02,840 BETTER SUITED FOR ACCELERATING 818 00:32:02,840 --> 00:32:04,360 CHANGE WHEN IT COMES TO 819 00:32:04,360 --> 00:32:05,840 SCIENTIFIC PRACTICES. 820 00:32:05,840 --> 00:32:08,240 SO IT'S WORTHWHILE ASKING WHY 821 00:32:08,240 --> 00:32:10,320 ARE INTUITIONS WRONG? 822 00:32:10,320 --> 00:32:12,600 IF WE HAVE THEM WE SHOULD HAVE 823 00:32:12,600 --> 00:32:16,640 THEM FOR A REASON. 824 00:32:16,640 --> 00:32:21,640 WE'RE USING OUR INTUITION SAYING 825 00:32:21,640 --> 00:32:24,480 IF SOMEONE HAS A VIRAL INFECTION 826 00:32:24,480 --> 00:32:26,720 OR COVID-19 THEN THE MORE PEOPLE 827 00:32:26,720 --> 00:32:29,480 THEY COME INTO CONTACT WITH THE 828 00:32:29,480 --> 00:32:30,560 MORE LIKELY THEY'LL GET COVID-19 829 00:32:30,560 --> 00:32:32,360 AND SO ON AND SO FORTH. 830 00:32:32,360 --> 00:32:34,480 BASICALLY THE IDEA OF SUPER 831 00:32:34,480 --> 00:32:37,080 SPREADER SOMEONE HIGHLY 832 00:32:37,080 --> 00:32:38,840 CONNECTED IS THE LINCHPIN IN 833 00:32:38,840 --> 00:32:40,560 THINKING HOW ACADEMICS TAKE 834 00:32:40,560 --> 00:32:40,880 HOLD. 835 00:32:40,880 --> 00:32:43,240 WHEN WE MOVE TO SOCIAL THINKING 836 00:32:43,240 --> 00:32:45,360 WHERE IT'S NOT JUST A MATTER OF 837 00:32:45,360 --> 00:32:48,240 MERE EXPOSURE TRANSLATING TO 838 00:32:48,240 --> 00:32:49,120 TRANSMISSION BUT RATHER THAT 839 00:32:49,120 --> 00:32:50,840 PEOPLE HAVE A SOCIAL CONTEXT. 840 00:32:50,840 --> 00:32:54,200 THEY LOOK AT PEERS ADOPTING AND 841 00:32:54,200 --> 00:32:57,280 THAT FEEDBACK HAS A COMPLEX 842 00:32:57,280 --> 00:32:58,520 INTERACTION TO IT. 843 00:32:58,520 --> 00:32:59,640 ALL OF A SUDDEN THE STRUCTURE OF 844 00:32:59,640 --> 00:33:00,520 THE NEIGHBORHOOD PEOPLE 845 00:33:00,520 --> 00:33:02,880 INTERACTING AND THE WAYS IN 846 00:33:02,880 --> 00:33:04,320 WHICH THE NEIGHBORHOODS INTERACT 847 00:33:04,320 --> 00:33:07,120 PLAY AN ENORMOUS ROLE IN THE WAY 848 00:33:07,120 --> 00:33:10,080 BEHAVIOR SPREAD THAT DOESN'T 849 00:33:10,080 --> 00:33:14,120 SHOW UP FOR EPIDEMIOLOGICAL 850 00:33:14,120 --> 00:33:14,440 SPREAD. 851 00:33:14,440 --> 00:33:21,760 WE'RE THINKING ABOUT THE V 852 00:33:21,760 --> 00:33:24,600 VIRALITY AND SIMPLE CONTAGIONS 853 00:33:24,600 --> 00:33:27,120 LIKE THE SPREAD OF INFLAMMATION 854 00:33:27,120 --> 00:33:28,320 AND DISEASE AND COMPLEX SPREAD 855 00:33:28,320 --> 00:33:30,600 LIKE BEHAVIORS AND PRACTICES 856 00:33:30,600 --> 00:33:32,360 WHICH REQUIRE US TO SWITCH FROM 857 00:33:32,360 --> 00:33:34,760 SOMETHING WE'RE DOING NOW TO 858 00:33:34,760 --> 00:33:35,960 SOMETHING NEW. 859 00:33:35,960 --> 00:33:40,600 THIS BRINGS TO THE FOREGROUND 860 00:33:40,600 --> 00:33:42,320 SEVERAL DIFFUSION I'LL TALK 861 00:33:42,320 --> 00:33:47,160 ABOUT BRIEFLY AND IMPLICATIONS 862 00:33:47,160 --> 00:33:50,840 TO COME FROM THIS WITH 863 00:33:50,840 --> 00:33:52,000 METHODOLOGIC TIPPING POINTS IN 864 00:33:52,000 --> 00:33:53,600 OUR SCIENTIFIC COMMUNITIES AND A 865 00:33:53,600 --> 00:34:00,200 NICE THING THAT COMES OUT FROM 866 00:34:00,200 --> 00:34:01,880 THIS IS THE BEHAVIOR OF 867 00:34:01,880 --> 00:34:04,600 ECONOMICS TURN AND THE SCIENCE 868 00:34:04,600 --> 00:34:07,160 IS PUSHING AWAY FROM RATIONAL 869 00:34:07,160 --> 00:34:09,440 CHOICE TOWARDS COGNITIVE MODEL 870 00:34:09,440 --> 00:34:10,720 OF BEHAVIOR AND STILL 871 00:34:10,720 --> 00:34:11,400 INDIVIDUALISTIC AND SAYING THERE 872 00:34:11,400 --> 00:34:14,120 ARE THINGS YOU CAN DO AND THE 873 00:34:14,120 --> 00:34:16,160 RATIONALE CHOICE MODEL IS GIVEN 874 00:34:16,160 --> 00:34:18,800 INFORMATION AND ANOTHER IS 875 00:34:18,800 --> 00:34:21,720 GIVING STIMULI SAYING THINGS YOU 876 00:34:21,720 --> 00:34:22,720 CAN DO INDIVIDUALLY TO CHANGE 877 00:34:22,720 --> 00:34:25,200 THAT AND I WANT TO TAKE YOU AWAY 878 00:34:25,200 --> 00:34:28,000 FROM THAT THAT RATIONALE CHOICE 879 00:34:28,000 --> 00:34:29,320 ASSUMING INDIVIDUALS ACT ALONE. 880 00:34:29,320 --> 00:34:32,440 FUNDAMENTALLY WE'RE LOOKING AT 881 00:34:32,440 --> 00:34:33,080 LARGE-SCALE PRACTICE AS NORMS 882 00:34:33,080 --> 00:34:35,800 AND THE QUESTION IS HOW DO WE 883 00:34:35,800 --> 00:34:36,720 SHIFT NORMS OF THE POPULATION 884 00:34:36,720 --> 00:34:38,680 AND NOT JUST ADDRESS THEM ONE 885 00:34:38,680 --> 00:34:43,200 INDIVIDUAL AT A TIME? 886 00:34:43,200 --> 00:34:43,920 TALKING ABOUT INFLUENCERS AND 887 00:34:43,920 --> 00:34:46,280 LAND WITH HOW TO BUILD A 888 00:34:46,280 --> 00:34:47,720 CONTAGION INFRASTRUCTURE AND 889 00:34:47,720 --> 00:34:48,960 WHAT THIS MEANS FOR TIPPING 890 00:34:48,960 --> 00:34:49,360 POINTS. 891 00:34:49,360 --> 00:34:53,280 I'LL TALK ABOUT CONTAGIOUS NESS. 892 00:34:53,280 --> 00:34:56,120 THAT'S A HUGE PART IN THINKING 893 00:34:56,120 --> 00:34:58,400 HOW PRACTICES TAKE HOLD AND 894 00:34:58,400 --> 00:34:59,120 SPREAD. 895 00:34:59,120 --> 00:35:01,600 WHAT'S THE DIFFERENCE BETWEEN 896 00:35:01,600 --> 00:35:03,120 SPREADING SOMETHING LIKE NEW 897 00:35:03,120 --> 00:35:04,280 SCIENTIFIC PRACTICE AND 898 00:35:04,280 --> 00:35:07,960 BEHAVIORAL ROUTINE VERSUS SIMPLY 899 00:35:07,960 --> 00:35:08,880 SPREADING INFORMATION ABOUT IT? 900 00:35:08,880 --> 00:35:13,320 SO IT COMES DOWN TO THE CLASSIC 901 00:35:13,320 --> 00:35:16,000 IDEA OF HOW A VIRUS SPREAD. 902 00:35:16,000 --> 00:35:20,160 FOR A SIMPLE CONTAGION SOMEONE 903 00:35:20,160 --> 00:35:21,560 IS MORE ACTIVATED IN THE 904 00:35:21,560 --> 00:35:21,920 NEIGHBORHOOD. 905 00:35:21,920 --> 00:35:24,600 THAT PERSON COMES INTO CONTACT 906 00:35:24,600 --> 00:35:26,520 WITH THE PERSON IN THE MIDDLE 907 00:35:26,520 --> 00:35:28,520 AND THAT PERSON GETS IT. 908 00:35:28,520 --> 00:35:30,280 AND THAT PERSON CAN THEN TURN 909 00:35:30,280 --> 00:35:31,400 AROUND AND TELL EVERYBODY ELSE. 910 00:35:31,400 --> 00:35:34,320 YOU HAVE WHAT WE THINK OF AS THE 911 00:35:34,320 --> 00:35:38,080 CLASSIC KIND OF NETWORK 912 00:35:38,080 --> 00:35:38,480 DIFFUSION PROCESS. 913 00:35:38,480 --> 00:35:42,800 THIS PROCESS DESCRIBES 914 00:35:42,800 --> 00:35:44,640 EVERYTHING FROM THE SPREAD OF 915 00:35:44,640 --> 00:35:45,920 COVID-19 AND OTHERS AND THERE'S 916 00:35:45,920 --> 00:35:48,000 SEVERAL ASSUMPTIONS BUILT IN. 917 00:35:48,000 --> 00:35:57,320 ONE IS EVERY CONTACT IS 918 00:35:57,320 --> 00:35:58,240 POTENTIAL TRANSMISSION AND 919 00:35:58,240 --> 00:36:03,120 WHATEVER SPREADING IS EASY AND 920 00:36:03,120 --> 00:36:03,400 FAMILIAR. 921 00:36:03,400 --> 00:36:05,080 AND WHAT'S DIFFERENT ABOUT 922 00:36:05,080 --> 00:36:07,600 SPREADING THE SCIENTIFIC 923 00:36:07,600 --> 00:36:08,600 PATHOGENS HERE AGAIN YOU HAVE 924 00:36:08,600 --> 00:36:09,520 SOMEONE IN A NEIGHBORHOOD AND 925 00:36:09,520 --> 00:36:12,280 TRYING TO TALK TO THEM ABOUT A 926 00:36:12,280 --> 00:36:13,920 NEW SCIENTIFIC PRACTICE THE 927 00:36:13,920 --> 00:36:15,040 PERSON IN THE MIDDLE ALSO SEES 928 00:36:15,040 --> 00:36:17,680 EVERYONE ELSE THEY'RE CONNECTED 929 00:36:17,680 --> 00:36:18,920 TO SHOWN IN GRAY FOR THE SPREAD 930 00:36:18,920 --> 00:36:21,720 OF A NEW PIECE OF INFORMATION OR 931 00:36:21,720 --> 00:36:24,360 SPREAD OF A VIRUS BUT 932 00:36:24,360 --> 00:36:25,960 NON-ADOPTERS ARE IRRELEVANT 933 00:36:25,960 --> 00:36:27,600 BECAUSE IT'S A NOVEL THING 934 00:36:27,600 --> 00:36:29,560 ENTERING THE COMMUNITY. 935 00:36:29,560 --> 00:36:30,760 FOR A NEW PRACTICE THAT 936 00:36:30,760 --> 00:36:31,720 REQUIRING CHANGING YOUR BEHAVIOR 937 00:36:31,720 --> 00:36:33,800 THE PERSON IN THE CENTER HAS TO 938 00:36:33,800 --> 00:36:35,600 LOOK AT EVERYONE ELSE THEY KNOW 939 00:36:35,600 --> 00:36:37,000 AND SAY IF THEY'RE STILL 940 00:36:37,000 --> 00:36:40,440 EXHIBITING THE SAME BEHAVIOR AND 941 00:36:40,440 --> 00:36:43,600 PRACTICES, THIS ONE PERSON IS 942 00:36:43,600 --> 00:36:44,840 ACTUALLY ILLEGITIMATE AND GOING 943 00:36:44,840 --> 00:36:47,040 AGAINST THE NORMS OF COMMUNITY. 944 00:36:47,040 --> 00:36:49,160 MAYBE IT TAKES A SECOND PERSON 945 00:36:49,160 --> 00:36:53,520 TO SHOW UP AND THE WEIGHTED 946 00:36:53,520 --> 00:36:55,480 EVIDENCE IN THEIR COMMUNITY ARE 947 00:36:55,480 --> 00:37:00,480 WHAT THE NON-ADOPTERS AND THEY 948 00:37:00,480 --> 00:37:01,760 DON'T HAVE TO ANYTHING EXCEPT 949 00:37:01,760 --> 00:37:04,800 NOT ADOPT AND RISK THE NEW IDEA 950 00:37:04,800 --> 00:37:08,440 AND INNOVATION AND THE THIRD 951 00:37:08,440 --> 00:37:13,800 PERSON ADOPTS IT MAY SHIFT THE 952 00:37:13,800 --> 00:37:14,080 COMMUNITY. 953 00:37:14,080 --> 00:37:15,480 THIS IS TRUE WHENEVER INNOVATION 954 00:37:15,480 --> 00:37:17,440 OR NEW PRACTICE OR IDEA 955 00:37:17,440 --> 00:37:19,080 ENCOUNTERS RESISTANCE AND 956 00:37:19,080 --> 00:37:22,400 NOTHING ENCOUNTERS MORE 957 00:37:22,400 --> 00:37:23,840 RESISTANCE THAN A CHANGE 958 00:37:23,840 --> 00:37:26,840 CAMPAIGN THAT TRIES TO SHIFT OUT 959 00:37:26,840 --> 00:37:29,440 OUT OF A BEHAVIORAL ROUTINE WE 960 00:37:29,440 --> 00:37:32,120 FEEL COMFORTABLE AND MAKES US 961 00:37:32,120 --> 00:37:37,560 FEEL CONFIDENT AND REINFORCES 962 00:37:37,560 --> 00:37:40,480 AND THAT REQUIRES MULTIPLE 963 00:37:40,480 --> 00:37:40,760 CONTACTS. 964 00:37:40,760 --> 00:37:44,480 NOT JUST MULTIPLE CONTACTS BUT 965 00:37:44,480 --> 00:37:46,800 WE NEED IT FOR PEOPLE WHO ARE 966 00:37:46,800 --> 00:37:49,240 ADOPTERS TO OUTWEIGH THE 967 00:37:49,240 --> 00:37:50,080 INFLUENCES FROM THAT. 968 00:37:50,080 --> 00:37:55,520 THIS IS RESISTANCE TO SOMETHING 969 00:37:55,520 --> 00:37:57,600 WE DON'T KNOW HOW TO DO AND 970 00:37:57,600 --> 00:37:58,720 THAT'S TRUE FOR ANYTHING 971 00:37:58,720 --> 00:38:01,680 DIFFICULT AND FAMILIAR AND 972 00:38:01,680 --> 00:38:01,920 COSTLY. 973 00:38:01,920 --> 00:38:03,920 THIS RAISES SEVERAL RISKS. 974 00:38:03,920 --> 00:38:07,120 THE MYTH OF VIRALITY THAT 975 00:38:07,120 --> 00:38:08,480 EVERYTHING SPREAD LIKE A VIRUS 976 00:38:08,480 --> 00:38:11,800 IS NOT TRUE FOR COMPLEX C 977 00:38:11,800 --> 00:38:14,960 CONTAGIONS AND IF YOU MAKE IT 978 00:38:14,960 --> 00:38:16,480 MORE FUN AND SELLABLE EVERYONE 979 00:38:16,480 --> 00:38:17,320 WILL WANT IT. 980 00:38:17,320 --> 00:38:20,480 THAT'S BUILT ON THE LOGIC OF 981 00:38:20,480 --> 00:38:23,440 VIRUSES AND INFECTIOUSNESS BUT 982 00:38:23,440 --> 00:38:26,120 DOESN'T WORK FOR BEHAVIORS THAT 983 00:38:26,120 --> 00:38:29,480 REQUIRE A SOCIAL LEGITIMACY AND 984 00:38:29,480 --> 00:38:33,720 THE LOGIC OF INFLUENCERS WHICH 985 00:38:33,720 --> 00:38:34,440 IS CREATING TREMENDOUS EXPOSURE 986 00:38:34,440 --> 00:38:37,320 FOR SOMETHING IT WILL SPREAD. 987 00:38:37,320 --> 00:38:41,760 I'LL GLANCE OVER THE SECOND TWO. 988 00:38:41,760 --> 00:38:44,000 I LIKE TO LOOK AT THIS EXAMPLE 989 00:38:44,000 --> 00:38:45,200 BECAUSE IT GROUNDS WHAT I'M 990 00:38:45,200 --> 00:38:47,560 TALKING ABOUT IN A CONCRETE WAY. 991 00:38:47,560 --> 00:38:55,760 IN THE 1960s THERE WAS A MASSIVE 992 00:38:55,760 --> 00:38:58,000 DEMOGRAPHIC TRANSITION TOWARDS 993 00:38:58,000 --> 00:39:00,200 MODERNIZATION IN SOUTH KOREA, 994 00:39:00,200 --> 00:39:02,320 INDONESIA AND PAKISTAN AND OTHER 995 00:39:02,320 --> 00:39:04,360 COUNTRIES WITHIN A PERIOD OF 10 996 00:39:04,360 --> 00:39:10,280 YEARS HAD INCREASED FOOD SUPPLY. 997 00:39:10,280 --> 00:39:14,280 THEY HAD VACCINATION INCREASED, 998 00:39:14,280 --> 00:39:16,960 SANITATION AND WATER SUPPLY AND 999 00:39:16,960 --> 00:39:18,360 RADICALLY LOWERED INFANT 1000 00:39:18,360 --> 00:39:18,600 MORTALITY. 1001 00:39:18,600 --> 00:39:20,760 IN THESE CULTURES IT WAS NORMAL 1002 00:39:20,760 --> 00:39:23,720 FOR PEOPLE TO HAVE FIVE TO SIX 1003 00:39:23,720 --> 00:39:27,360 CHILDREN PER FAMILY AND THAT WAS 1004 00:39:27,360 --> 00:39:30,240 A STATUS SYMBOL SHOWING YOU WERE 1005 00:39:30,240 --> 00:39:33,600 DOING A GOOD JOB AS PARENTS AND 1006 00:39:33,600 --> 00:39:35,120 ALL OF A SUDDEN WHEN HAVE YOU 1007 00:39:35,120 --> 00:39:36,680 MODERN ADVANCES ENTERING, THEN 1008 00:39:36,680 --> 00:39:38,720 HAVING FIVE TO SIX CHILDREN 1009 00:39:38,720 --> 00:39:40,160 GENERATION AFTER GENERATION THE 1010 00:39:40,160 --> 00:39:42,640 MATH KICKS IN FAST IS EXTREMELY 1011 00:39:42,640 --> 00:39:43,120 DANGEROUS. 1012 00:39:43,120 --> 00:39:47,040 THE U.S. AND GREAT BRITAIN FROM 1013 00:39:47,040 --> 00:39:54,680 THE 1890s HAD A LONG TIME TO 1014 00:39:54,680 --> 00:39:57,360 ADJUST THE CULTURE OF FAMILY 1015 00:39:57,360 --> 00:40:02,840 PLANNING LITHE BIRTH -- LIKE 1016 00:40:02,840 --> 00:40:03,320 BIRTH CONTROL. 1017 00:40:03,320 --> 00:40:05,600 IN THESE CASES THE COUNTRIES HAD 1018 00:40:05,600 --> 00:40:07,480 TO ADAPT WITHIN A DECADE WHICH 1019 00:40:07,480 --> 00:40:09,240 IS TOO SHORT A TIME TO CHANGE 1020 00:40:09,240 --> 00:40:11,040 THE NATIONWIDE CULTURE AND HAD 1021 00:40:11,040 --> 00:40:14,800 MASS CAMPAIGNS TO SHIFT THE 1022 00:40:14,800 --> 00:40:17,920 FAMILY CULTURE ACROSS THE 1023 00:40:17,920 --> 00:40:18,120 NATION. 1024 00:40:18,120 --> 00:40:20,520 ALMOST EVERY NATION FAILED, 1025 00:40:20,520 --> 00:40:23,160 PAKISTAN AND KOREA SUCCEEDED IN 1026 00:40:23,160 --> 00:40:26,360 CHANGING THE ENTIRE COUNTRY'S 1027 00:40:26,360 --> 00:40:28,200 ACTIVITY TO CONTRACEPTION WITHIN 1028 00:40:28,200 --> 00:40:31,720 ONLY 20 YEARS -- SHIFTING AN 1029 00:40:31,720 --> 00:40:33,800 ENTIRE NATION'S CULTURE IN 20 1030 00:40:33,800 --> 00:40:35,120 YEARS IS AN INCREDIBLE 1031 00:40:35,120 --> 00:40:35,440 ACHIEVEMENT. 1032 00:40:35,440 --> 00:40:37,880 WHAT THEY DID THAT WAS UNIQUE 1033 00:40:37,880 --> 00:40:39,560 WAS THEY USED SOCIAL NETWORKS IN 1034 00:40:39,560 --> 00:40:42,120 THE VILLAGE COMMUNITIES INSTEAD 1035 00:40:42,120 --> 00:40:44,480 OF OPPOSITION POINTS THEY USED 1036 00:40:44,480 --> 00:40:47,320 THEM AS THE ENTRY POINTS. 1037 00:40:47,320 --> 00:40:49,400 THERE WERE THREE KINDS OF 1038 00:40:49,400 --> 00:40:51,320 VILLAGES THEY DISCOVERED. 1039 00:40:51,320 --> 00:40:54,120 SOME HAD BROKERAGE STRUCTURES 1040 00:40:54,120 --> 00:40:56,520 SMALL COMMUNITIES CONNECTED BY 1041 00:40:56,520 --> 00:40:59,440 WEAK TIES TO OTHER GROUPS AND WE 1042 00:40:59,440 --> 00:41:01,400 FIND ESSENTIALLY YOU WOULD GET 1043 00:41:01,400 --> 00:41:03,280 SPREADING WITHIN ONE OF THEIR 1044 00:41:03,280 --> 00:41:04,840 CLUSTERS AND EVERYONE WOULD 1045 00:41:04,840 --> 00:41:14,240 CONVERGE ON THE CONTRACEPTION 1046 00:41:14,240 --> 00:41:15,600 AND FOUND IN URBAN COMMUNITIES 1047 00:41:15,600 --> 00:41:17,120 THEY COULDN'T GET THE PEOPLE 1048 00:41:17,120 --> 00:41:21,160 THEY ADOPTED ADDS CHANGE AGENTS 1049 00:41:21,160 --> 00:41:22,600 TO HAVE ANY EFFECT ON ANYBODY 1050 00:41:22,600 --> 00:41:24,360 ELSE BECAUSE THEY WERE TOO 1051 00:41:24,360 --> 00:41:24,800 WIDELY DISTRIBUTED. 1052 00:41:24,800 --> 00:41:28,480 BY CONTRAST THEY FOUND THE 1053 00:41:28,480 --> 00:41:30,400 SCRIMMAGES WERE CHARACTERIZED 1054 00:41:30,400 --> 00:41:32,280 AND SMALL COMMUNITY CLUSTERS AND 1055 00:41:32,280 --> 00:41:34,360 THEY HAD MULTIPLE OVERLAPPING 1056 00:41:34,360 --> 00:41:35,960 TIES TO NEARBY COMMUNITIES WE'RE 1057 00:41:35,960 --> 00:41:37,720 ABLE TO GENERATE A CHANGE 1058 00:41:37,720 --> 00:41:39,280 PROCESS IN WHICH EACH CLUSTER 1059 00:41:39,280 --> 00:41:41,760 WOULD ADOPT CONTRACEPTION AND 1060 00:41:41,760 --> 00:41:46,040 SPILL OVER TO A NEARBY CLUSTER 1061 00:41:46,040 --> 00:41:48,840 AND UNTIL YOU GET ENTIRE 1062 00:41:48,840 --> 00:41:50,240 ADOPTION WITHIN VILLAGES. 1063 00:41:50,240 --> 00:41:53,920 THIS DIDN'T SPREAD IN A VIRAL 1064 00:41:53,920 --> 00:41:56,840 WAY OR EVERYWHERE AT ONCE LIKE 1065 00:41:56,840 --> 00:41:58,800 COVID-19 JUMPING ACROSS 1066 00:41:58,800 --> 00:41:59,720 AIRPLANES. 1067 00:41:59,720 --> 00:42:01,440 IT SPREAD IN THIS SPECIFIC 1068 00:42:01,440 --> 00:42:05,400 ALMOST SLOW LOCAL REGIONAL 1069 00:42:05,400 --> 00:42:07,160 FASHION AND CREATED 1070 00:42:07,160 --> 00:42:08,000 REINFORCEMENT AND THEN SPILLED 1071 00:42:08,000 --> 00:42:09,800 OVER TO A NEARBY GROUP. 1072 00:42:09,800 --> 00:42:12,000 AND WHAT'S GOING ON HERE WE CAN 1073 00:42:12,000 --> 00:42:13,960 THINK ABOUT THIS NOT JUST IN THE 1074 00:42:13,960 --> 00:42:16,000 CONTEXT OF COMMUNITIES IN 1075 00:42:16,000 --> 00:42:17,120 GENERAL BUT WITHIN ORGANIZATIONS 1076 00:42:17,120 --> 00:42:19,920 ONE OF THE CLASSIC WAYS OF 1077 00:42:19,920 --> 00:42:20,800 THINKING ABOUT SPREADING SCIENCE 1078 00:42:20,800 --> 00:42:23,280 IN THEIR PRACTICES IS TO SAY YOU 1079 00:42:23,280 --> 00:42:24,120 HAVE DIFFERENT SCIENTIFIC GROUPS 1080 00:42:24,120 --> 00:42:26,120 AND COMMUNITIES SILOED. 1081 00:42:26,120 --> 00:42:28,480 IF YOU CAN HAVE SOMEONE WHO ACTS 1082 00:42:28,480 --> 00:42:31,560 AS A BROKER YOU CAN CREATE TIES 1083 00:42:31,560 --> 00:42:35,120 TO LIKE ELIZABETH IN GROUP B AND 1084 00:42:35,120 --> 00:42:36,920 ANOTHER TO GROUP C AND SPREAD IT 1085 00:42:36,920 --> 00:42:38,560 FROM GROUP TO GROUP. 1086 00:42:38,560 --> 00:42:41,200 THE THING TO KNOW IS IT'S TRUE 1087 00:42:41,200 --> 00:42:42,840 PEOPLE LIKE ROBERT HAVE BEEN 1088 00:42:42,840 --> 00:42:43,800 HERALD THE IN THE COMMUNITY 1089 00:42:43,800 --> 00:42:47,320 SINCE THE 1990s AS THE LINCHPIN 1090 00:42:47,320 --> 00:42:49,200 FOR GETTING NEW SCIENTIFIC 1091 00:42:49,200 --> 00:42:50,480 PRACTICES ADOPTED AND 1092 00:42:50,480 --> 00:42:51,560 ORGANIZATIONAL CHANGE TO 1093 00:42:51,560 --> 00:42:52,040 SUCCEED. 1094 00:42:52,040 --> 00:42:56,080 THE THING IS ALL THEY'RE TALKING 1095 00:42:56,080 --> 00:42:58,080 ABOUT IN THE CHANGES IS SPREAD 1096 00:42:58,080 --> 00:43:01,880 NOT ACTUAL ADOPTION. 1097 00:43:01,880 --> 00:43:05,320 ROBERTS TIE IS A WEAK TIE, ONE 1098 00:43:05,320 --> 00:43:07,040 SINGLE LINK AND HE CAN SPREAD 1099 00:43:07,040 --> 00:43:07,920 INFORMATION TO ELIZABETH BUT HER 1100 00:43:07,920 --> 00:43:09,560 GROUP AND THE WAY THEY DO THINGS 1101 00:43:09,560 --> 00:43:11,440 AND ROUTINES AND PRACTICES 1102 00:43:11,440 --> 00:43:13,360 AREN'T GOING TO BE INFLUENCED BY 1103 00:43:13,360 --> 00:43:14,400 ONE PERSON SAYING EVERYONE 1104 00:43:14,400 --> 00:43:15,680 SHOULD CHANGE THEIR PRACTICES TO 1105 00:43:15,680 --> 00:43:19,200 DO THIS NEW THING. 1106 00:43:19,200 --> 00:43:24,080 IN FACT THEY'LL RECOGNIZE AS 1107 00:43:24,080 --> 00:43:25,880 ROBERT GAINED STATUS AND 1108 00:43:25,880 --> 00:43:28,680 PRESTIGE AS THE BROKER AND WILL 1109 00:43:28,680 --> 00:43:29,280 CONVINCE PEOPLE. 1110 00:43:29,280 --> 00:43:31,800 IT'S NOT THAT ROBERT'S 1111 00:43:31,800 --> 00:43:36,480 UNTRUSTWORTHY AS A PERSON BUT 1112 00:43:36,480 --> 00:43:40,480 HIS ADVANTAGE COMES FROM 1113 00:43:40,480 --> 00:43:42,040 SPREADING THIS AND THERE'S 1114 00:43:42,040 --> 00:43:43,360 SCEPTICISM FROM WHICH HIS IDEAS 1115 00:43:43,360 --> 00:43:44,800 ARE GREETED. 1116 00:43:44,800 --> 00:43:48,600 THE NETWORK STRUCTURE CHANGES 1117 00:43:48,600 --> 00:43:52,800 WITH NOT JUST ONE LINK OR NARROW 1118 00:43:52,800 --> 00:43:57,240 BRIDGE BUT INTERACTING TIES AND 1119 00:43:57,240 --> 00:43:58,800 A WIDE BRIDGE IS A TECHNICAL 1120 00:43:58,800 --> 00:44:00,280 CONCEPT AND THERE'S A SERIES OF 1121 00:44:00,280 --> 00:44:02,080 PAPERS AND IN THE BOOK AND WHAT 1122 00:44:02,080 --> 00:44:05,840 IT BASICALLY MEANS IS THERE'S 1123 00:44:05,840 --> 00:44:10,240 MULTIPLE INTERACTING TIES FROM 1124 00:44:10,240 --> 00:44:11,800 MEMBERS OF GROUP A AND THEY CAN 1125 00:44:11,800 --> 00:44:13,960 LOOK AND SEE HOW OTHER MEMBERS 1126 00:44:13,960 --> 00:44:15,240 OF GROUP B ARE USING INNOVATION 1127 00:44:15,240 --> 00:44:18,240 AND HOW IT WORKS FOR THEM AND 1128 00:44:18,240 --> 00:44:26,120 AFFECTS THS THEIR DAILY PRACTIC 1129 00:44:26,120 --> 00:44:27,480 AND COMMUNICATE HOW TO INTEGRATE 1130 00:44:27,480 --> 00:44:28,000 IT. 1131 00:44:28,000 --> 00:44:31,120 THE STRUCTURE OF WIDE BRIDGES 1132 00:44:31,120 --> 00:44:32,600 WITHIN AN ORGANIZATION IS THE 1133 00:44:32,600 --> 00:44:34,160 KEY INFRASTRUCTURAL ELEMENT THAT 1134 00:44:34,160 --> 00:44:36,400 ALLOWS A NEW SET OF SCIENTIFIC 1135 00:44:36,400 --> 00:44:37,720 PRACTICES TO SPREAD FROM ONE 1136 00:44:37,720 --> 00:44:38,360 GROUP TO ANOTHER. 1137 00:44:38,360 --> 00:44:39,480 WHAT'S INTERESTING IS ONCE YOU 1138 00:44:39,480 --> 00:44:42,400 HAVE THIS KIND OF STRUCTURE, IT 1139 00:44:42,400 --> 00:44:44,240 CREATES KIND OF AN ADOPTIVE 1140 00:44:44,240 --> 00:44:45,760 INFRASTRUCTURE SO IT'S NOTE JUST 1141 00:44:45,760 --> 00:44:47,080 SPREADING ONE INNOVATION OR 1142 00:44:47,080 --> 00:44:48,520 ANOTHER BUT CREATES THE CAPACITY 1143 00:44:48,520 --> 00:44:50,200 FOR LOTS OF DIFFERENT 1144 00:44:50,200 --> 00:44:51,440 INNOVATIONS TO SPREAD AND IN THE 1145 00:44:51,440 --> 00:44:52,960 BOOK I TALK ABOUT A LOT OF 1146 00:44:52,960 --> 00:44:56,520 DIFFERENT EXAMPLES BUT ONE MORE 1147 00:44:56,520 --> 00:44:59,000 STRIKING AND A CASE WE'RE 1148 00:44:59,000 --> 00:45:01,440 DISCUSSING IS THE HUMAN GENOME 1149 00:45:01,440 --> 00:45:01,680 PROJECT. 1150 00:45:01,680 --> 00:45:03,520 YOU HAVE DOZENS OF DIFFERENT 1151 00:45:03,520 --> 00:45:06,320 LABS AND CENTERS AROUND THE 1152 00:45:06,320 --> 00:45:07,840 WORLD ALL OF WHOM WERE COMPETE 1153 00:45:07,840 --> 00:45:11,560 FORG A NOBEL PRIZE EACH YEAR AND 1154 00:45:11,560 --> 00:45:12,960 TRYING TO COORDINATE ON METHODS 1155 00:45:12,960 --> 00:45:14,880 AND PROTOCOLS FOR DOING THEIR 1156 00:45:14,880 --> 00:45:16,720 WORK ON THE GENE SEQUENCING. 1157 00:45:16,720 --> 00:45:17,920 THEY WERE ALL USING DIFFERENT 1158 00:45:17,920 --> 00:45:22,800 PRACTICES AND PROTOCOLS AND HAD 1159 00:45:22,800 --> 00:45:24,760 DIFFERENT I.P. STANDARDS AND HAD 1160 00:45:24,760 --> 00:45:31,600 TO FIGURE OUT HOW EACH GROUPS 1161 00:45:31,600 --> 00:45:33,160 PART COULD BE SHARED AND 1162 00:45:33,160 --> 00:45:38,560 REPLICABLE AND SHARE IT WITH 1163 00:45:38,560 --> 00:45:44,040 ANOTHER GROUP AND ONE OF THE 1164 00:45:44,040 --> 00:45:45,680 VERY SMART THINGS PEOPLE DID 1165 00:45:45,680 --> 00:45:48,200 WITH THE HUMAN GENOME PROJECT 1166 00:45:48,200 --> 00:45:53,680 INSTEAD OF SETTING IT UP AS A 1167 00:45:53,680 --> 00:45:56,840 TOP-DOWN ORGANIZATION LIKE THE 1168 00:45:56,840 --> 00:46:01,600 DIFFERENT CENTERS HAD WIDE 1169 00:46:01,600 --> 00:46:03,320 BRIDGES AND GROUPS SHOWED THEY'D 1170 00:46:03,320 --> 00:46:04,640 EXCHANGE EXCURSIONS AND THEN 1171 00:46:04,640 --> 00:46:06,240 MEET WITH THE GROUPS FROM THE 1172 00:46:06,240 --> 00:46:08,280 OTHER LAB AND DO DAILY TOURS AND 1173 00:46:08,280 --> 00:46:11,240 SEE HOW THEY WORKED AS A TEAM 1174 00:46:11,240 --> 00:46:12,760 AND THEIR PROTOCOLS FUNCTIONED 1175 00:46:12,760 --> 00:46:14,720 AND BRING THAT BACK HOME. 1176 00:46:14,720 --> 00:46:18,560 IT TURNED OUT THE SAME LOGIC WAS 1177 00:46:18,560 --> 00:46:22,080 VALID FOR THE FIELD OF NETWORK 1178 00:46:22,080 --> 00:46:22,720 SCIENCE. 1179 00:46:22,720 --> 00:46:24,320 THERE ARE OTHER CASES 1180 00:46:24,320 --> 00:46:26,720 INTERESTING LIKE THE SOFTWARE 1181 00:46:26,720 --> 00:46:28,160 INITIATIVE AND BLACK LIVES 1182 00:46:28,160 --> 00:46:30,560 MATTER BUT THE NETWORK 1183 00:46:30,560 --> 00:46:31,160 INFRASTRUCTURE PROVIDES A 1184 00:46:31,160 --> 00:46:35,240 GENERAL MODEL FOR THINKING HOW 1185 00:46:35,240 --> 00:46:37,200 ORGANIZATIONS THAT WOULDN'T BE 1186 00:46:37,200 --> 00:46:39,840 CONNECTED CAN CREATE THE 1187 00:46:39,840 --> 00:46:40,840 INTERCONNECTIONS IN A WAY THAT'S 1188 00:46:40,840 --> 00:46:42,960 FUNCTIONAL FOR ADOPTING NEW 1189 00:46:42,960 --> 00:46:44,440 TECHNIQUES AND PRACTICES. 1190 00:46:44,440 --> 00:46:45,640 SO ONE OF THE THINGS WE CAN 1191 00:46:45,640 --> 00:46:47,640 THINK ABOUT ONCE WE SEE THIS IS 1192 00:46:47,640 --> 00:46:51,520 WE CAN IMAGINE TWO ORGANIZATIONS 1193 00:46:51,520 --> 00:46:52,880 OR TWO SCIENTIFIC ECOLOGIES 1194 00:46:52,880 --> 00:46:55,920 WHERE THEY BOTH HAVE THE SAME 1195 00:46:55,920 --> 00:46:56,200 STRUCTURE. 1196 00:46:56,200 --> 00:46:58,040 YOU CAN SAY THAT'S GREAT AND 1197 00:46:58,040 --> 00:46:58,920 THAT'S WHERE WE'LL SUCCESS. 1198 00:46:58,920 --> 00:47:00,120 IT'S NOT JUST THE INFRASTRUCTURE 1199 00:47:00,120 --> 00:47:03,440 ALONE BUT HOW THE INFRASTRUCTURE 1200 00:47:03,440 --> 00:47:04,760 IS TARGETED. 1201 00:47:04,760 --> 00:47:06,000 WHAT ARE OUR ENTRY POINTS INTO 1202 00:47:06,000 --> 00:47:08,320 THE ORGANIZATION TO GENERATE THE 1203 00:47:08,320 --> 00:47:12,680 MOST IMPACT FOR SOCIAL CHANGE. 1204 00:47:12,680 --> 00:47:14,920 WELL, WE CAN SEE HERE FOR A 1205 00:47:14,920 --> 00:47:16,920 STRATEGY LIKE WHERE DO WE PLACE 1206 00:47:16,920 --> 00:47:20,280 OUR CHANGE AGENTS? 1207 00:47:20,280 --> 00:47:21,320 THE STRATEGIES TO PLACE THE 1208 00:47:21,320 --> 00:47:25,080 CHANGE AGENTS AS WIDELY 1209 00:47:25,080 --> 00:47:27,760 DISPERSED THE LOGIC IS VIRAL 1210 00:47:27,760 --> 00:47:28,160 LOGIC. 1211 00:47:28,160 --> 00:47:32,720 IF THEY'RE SURROUNDED BY LOTS OF 1212 00:47:32,720 --> 00:47:33,920 SUSCEPTIBLE PEOPLE THEY WANT 1213 00:47:33,920 --> 00:47:35,280 THEM DISPERSED AS MUCH AS 1214 00:47:35,280 --> 00:47:38,120 POSSIBLE TO SPREAD YOUR IDEA. 1215 00:47:38,120 --> 00:47:39,800 THAT'S TRUE IF WHAT YOU'RE 1216 00:47:39,800 --> 00:47:41,880 SPREADING SAY VIRAL CONTAGION 1217 00:47:41,880 --> 00:47:44,840 BUT YOU CAN GET A STRONG BACK 1218 00:47:44,840 --> 00:47:46,000 FIRE EFFECT. 1219 00:47:46,000 --> 00:47:48,440 ESSENTIALLY EVERYONE WHO IS A 1220 00:47:48,440 --> 00:47:49,960 CHANGE AGENT BECAUSE THEY'RE 1221 00:47:49,960 --> 00:47:52,080 SURROUNDED BY PEOPLE IS ALSO 1222 00:47:52,080 --> 00:47:53,840 SURROUNDED BY A SEA OF 1223 00:47:53,840 --> 00:47:54,440 COUNTERING INFLUENCES. 1224 00:47:54,440 --> 00:47:55,760 PEOPLE PUSHING BACK AGAINST 1225 00:47:55,760 --> 00:47:56,480 THEM. 1226 00:47:56,480 --> 00:48:00,440 NOT ONLY ARE THEY INEFFECTIVE AT 1227 00:48:00,440 --> 00:48:02,120 CONVINCING PEOPLE THEMSELVES BUT 1228 00:48:02,120 --> 00:48:04,880 IN SHORT ORDER THEY'LL BEGIN TO 1229 00:48:04,880 --> 00:48:06,680 EXHIBIT HIGH LEVELS OF 1230 00:48:06,680 --> 00:48:08,120 RECIDIVISM BACK TO OLD BEHAVIOR 1231 00:48:08,120 --> 00:48:09,080 BECAUSE EVERYONE ELSE AROUND 1232 00:48:09,080 --> 00:48:12,480 THEM IS DOING IT AND ALTERNATIVE 1233 00:48:12,480 --> 00:48:13,920 STRATEGIES IS TO TAKE THE SAME 1234 00:48:13,920 --> 00:48:15,440 NUMBER OF CHANGES AND FROM THE 1235 00:48:15,440 --> 00:48:16,640 COST PERSPECTIVE IT'S THE SAME 1236 00:48:16,640 --> 00:48:17,800 CAMPAIGN BUT INSTEAD OF 1237 00:48:17,800 --> 00:48:19,040 DISTRIBUTING THEM ALL OVER THE 1238 00:48:19,040 --> 00:48:21,400 NETWORKS YOU GROUPED THEM IN ONE 1239 00:48:21,400 --> 00:48:22,080 CLUSTER. 1240 00:48:22,080 --> 00:48:24,960 THIS SEEMS COUNTERINTUITIVE FROM 1241 00:48:24,960 --> 00:48:26,840 MY CAMPAIGN AND HAVING 1242 00:48:26,840 --> 00:48:29,520 TELEMARKETERS TELL EACH OTHER 1243 00:48:29,520 --> 00:48:32,480 WHY WOULD YOU CONNECT YOUR 1244 00:48:32,480 --> 00:48:34,200 CHANGE AGENTS? 1245 00:48:34,200 --> 00:48:37,120 YOU CAN REINFORCE THIS PRACTICE 1246 00:48:37,120 --> 00:48:39,400 AND THESE ARE THE STANDARDS OF 1247 00:48:39,400 --> 00:48:40,800 RIGOR AND THE RIGHT ONES TO 1248 00:48:40,800 --> 00:48:41,840 ADOPT AND CAN CONVINCE PEOPLE IN 1249 00:48:41,840 --> 00:48:45,200 THEIR CLUSTER AND THAT CAN SPILL 1250 00:48:45,200 --> 00:48:46,760 OVER TO PEOPLE IN NEARBY 1251 00:48:46,760 --> 00:48:48,960 CLUSTERS AND WIDE BRIDGES CARRY 1252 00:48:48,960 --> 00:48:52,240 THIS INNOVATION FROM CLUSTER TO 1253 00:48:52,240 --> 00:48:52,760 CLUS 1254 00:48:52,760 --> 00:48:53,000 CLUSTER. 1255 00:48:53,000 --> 00:48:55,000 WHAT IS SPREADING IS A REAL 1256 00:48:55,000 --> 00:48:56,440 CHANGE IN BEHAVIOR AND SOCIAL 1257 00:48:56,440 --> 00:48:58,840 NORMS WHICH HAS A CHARACTERISTIC 1258 00:48:58,840 --> 00:48:59,360 TO IT. 1259 00:48:59,360 --> 00:49:01,560 I'LL QUICKLY WRAP UP WITH A 1260 00:49:01,560 --> 00:49:03,640 COUPLE NOTES WITH THE 1261 00:49:03,640 --> 00:49:03,920 INFLUENCER. 1262 00:49:03,920 --> 00:49:06,280 WE LOOK BACK AT THE NETWORK 1263 00:49:06,280 --> 00:49:12,960 STRUCTURE AND SAY SOME PEOPLE IN 1264 00:49:12,960 --> 00:49:13,920 CENTER ARE INFLUENTIAL WHY DON'T 1265 00:49:13,920 --> 00:49:16,000 WE GET THOSE AND WHEN WE 1266 00:49:16,000 --> 00:49:19,080 DISCOVER AN IDEA THEY CAN SPREAD 1267 00:49:19,080 --> 00:49:20,760 IT TO LOTS OF PEOPLE. 1268 00:49:20,760 --> 00:49:23,520 IT'S WHERE THE IDEA OF A SUPER 1269 00:49:23,520 --> 00:49:26,800 SPREADER COMES FROM. 1270 00:49:26,800 --> 00:49:28,720 THE PROBLEM COMES WITH THE 1271 00:49:28,720 --> 00:49:30,160 COMBUST CONTAGION EVERY TIE YOU 1272 00:49:30,160 --> 00:49:33,280 HAVE TO A NON-ADOPTER ISN'T JUST 1273 00:49:33,280 --> 00:49:36,240 AN OUTGOING TIDE BUT INCOMING 1274 00:49:36,240 --> 00:49:39,880 TIDE FROM PEOPLE MAINTAINING AN 1275 00:49:39,880 --> 00:49:40,560 EXISTING SOCIAL NORM. 1276 00:49:40,560 --> 00:49:42,920 THE MORE CONNECTED SOMEONE IS 1277 00:49:42,920 --> 00:49:45,840 THE MORE THE INFLUENCES THEY 1278 00:49:45,840 --> 00:49:47,040 ENCOUNTER WHEN THINKING OF 1279 00:49:47,040 --> 00:49:48,400 ADOPTING SOMETHING NO ONE ELSE 1280 00:49:48,400 --> 00:49:50,440 IS USING EXCEPT FOR ONE PERSON 1281 00:49:50,440 --> 00:49:51,560 IN THE PERIPHERY. 1282 00:49:51,560 --> 00:49:54,360 THE REASON WHY THE PEOPLE MOST 1283 00:49:54,360 --> 00:49:55,600 HIGHLY CONNECTED OR RELUCTANT 1284 00:49:55,600 --> 00:49:57,480 EARLY ON TO SHIFT THEIR 1285 00:49:57,480 --> 00:50:00,480 STANDARDS OF PRACTICE IN A WAY 1286 00:50:00,480 --> 00:50:02,840 PUBLIC BECAUSE YOU HAVE PEOPLE 1287 00:50:02,840 --> 00:50:04,840 PRIMARILY RESISTING WHEREAS ON 1288 00:50:04,840 --> 00:50:06,400 THE RIGHT SIDE IT ONLY TAKES A 1289 00:50:06,400 --> 00:50:08,480 SMALL NUMBER OF ACTORS TO 1290 00:50:08,480 --> 00:50:09,840 GENERATE THE CRITICAL PASS OF 1291 00:50:09,840 --> 00:50:11,560 INTEREST FOR PEOPLE IN THAT 1292 00:50:11,560 --> 00:50:13,040 NETWORK AND THAT CAN SPREAD AND 1293 00:50:13,040 --> 00:50:14,880 CASCADE IN THE WAYS I SHOWED 1294 00:50:14,880 --> 00:50:15,040 YOU. 1295 00:50:15,040 --> 00:50:18,800 THIS IS WELL KNOWN. 1296 00:50:18,800 --> 00:50:20,880 FOR DIFFICULT OR ORGANIZATIONAL 1297 00:50:20,880 --> 00:50:21,920 CHANGES THAT REQUIRE SHIFTING 1298 00:50:21,920 --> 00:50:24,280 BEHAVIORS FROM ONE NORM TO 1299 00:50:24,280 --> 00:50:28,080 ANOTHER NORM THAT THE KIND OF 1300 00:50:28,080 --> 00:50:30,160 EDGE ACTORS PRO ACTORS TEND TO 1301 00:50:30,160 --> 00:50:31,880 BE BETTER SUITED TO INITIATE 1302 00:50:31,880 --> 00:50:35,000 THAT KIND OF CHANGE SINCE 1970 1303 00:50:35,000 --> 00:50:36,480 AND IN THE LAST DECADE WE HAD 1304 00:50:36,480 --> 00:50:39,400 GOOD DATA ON HOW WE CHANGE 1305 00:50:39,400 --> 00:50:42,760 SPREAD AND CONSISTENTLY FIND THE 1306 00:50:42,760 --> 00:50:44,320 HIGHLY CONNECTED INFLUENCERS 1307 00:50:44,320 --> 00:50:46,880 TEND TO BE THE LAST ADOPTERS NOT 1308 00:50:46,880 --> 00:50:47,440 THE FIRST. 1309 00:50:47,440 --> 00:50:49,680 WHAT THIS MEANS FOR TARGETING 1310 00:50:49,680 --> 00:50:52,520 NETWORKS THERE'S MORE TO SAY 1311 00:50:52,520 --> 00:50:53,600 ABOUT TIPPING POINTS BUT FOR NOW 1312 00:50:53,600 --> 00:50:56,080 THE BEST WAY TO TALK ABOUT THIS 1313 00:50:56,080 --> 00:50:59,520 IS BY SAYING IF WE HAVE A LARGE 1314 00:50:59,520 --> 00:51:00,440 CONNECTED SCIENTIFIC COMMUNITY 1315 00:51:00,440 --> 00:51:02,040 WOULDN'T OUR BEST STRATEGY FOR 1316 00:51:02,040 --> 00:51:05,040 INITIATING A CHANGE IN PRACTICES 1317 00:51:05,040 --> 00:51:06,520 JUST BE TO FIND THE SOCIAL STAR 1318 00:51:06,520 --> 00:51:08,400 AND ACTIVATE THEM? 1319 00:51:08,400 --> 00:51:10,840 LIKE THEY MAY BE RELUCTANT 1320 00:51:10,840 --> 00:51:12,480 INITIALLY BUT IF WE CAN 1321 00:51:12,480 --> 00:51:15,680 INCENTIVIZE THEM OR COERCE THEM 1322 00:51:15,680 --> 00:51:22,160 WE SHOULD BE GET CASCADING. 1323 00:51:22,160 --> 00:51:23,280 THERE'S A REAL DANGER AND THIS 1324 00:51:23,280 --> 00:51:25,800 IS ONE OF THE REASONS WHY I 1325 00:51:25,800 --> 00:51:27,520 WROTE THE BOOK IS BECAUSE A LOT 1326 00:51:27,520 --> 00:51:30,560 OF PEOPLE THINK THE KITCHEN 1327 00:51:30,560 --> 00:51:35,840 THINK APPROACH CAN'T DO HARM. 1328 00:51:35,840 --> 00:51:37,600 THERE MAY BE A DIFFERENCE BUT 1329 00:51:37,600 --> 00:51:41,200 SINCE WE HAVE TECHNOLOGY AND 1330 00:51:41,200 --> 00:51:43,160 MARKETING KNOW-HOW BUILD AROUND 1331 00:51:43,160 --> 00:51:49,200 CON TAKE -- CONTAGIONS AND IF 1332 00:51:49,200 --> 00:51:51,200 YOU TAKE SOCIAL NORMS HEAD ON 1333 00:51:51,200 --> 00:51:53,080 AND TREAT THEM LIKE A VIRUS, 1334 00:51:53,080 --> 00:51:56,040 THEY ACTUALLY CREATING A VERY 1335 00:51:56,040 --> 00:51:57,600 STRONG BACKFIRE AGAINST 1336 00:51:57,600 --> 00:51:59,840 INITIATIVE WHICH WILL SALT THE 1337 00:51:59,840 --> 00:52:02,560 EARTH FOR FUTURE ATTEMPTS TO 1338 00:52:02,560 --> 00:52:03,720 ADVANCE YOUR INITIATIVE. 1339 00:52:03,720 --> 00:52:07,080 SO A GREAT EXAMPLE IS SOMETHING 1340 00:52:07,080 --> 00:52:08,800 LIKE GOOGLE GLASS WHERE MOST OF 1341 00:52:08,800 --> 00:52:12,800 US REMEMBER AND IT WAS A STICKY 1342 00:52:12,800 --> 00:52:14,480 PRODUCT AND IT IS STILL BECAUSE 1343 00:52:14,480 --> 00:52:19,120 WE STILL TALK ABOUT IT THEY GOT 1344 00:52:19,120 --> 00:52:21,600 ELITES AND INFLUENCERS AND GOT 1345 00:52:21,600 --> 00:52:25,160 THEM TO BUY THESE SUNGLASSES AS 1346 00:52:25,160 --> 00:52:26,880 A SIGN OF THEIR SOPHISTICATION 1347 00:52:26,880 --> 00:52:30,360 AND THE IDEA WAS HIGH STATUS 1348 00:52:30,360 --> 00:52:32,480 PEOPLE WOULD WEAR THE GLASSES 1349 00:52:32,480 --> 00:52:35,040 YOU COULD USE TO SURF THE WEB 1350 00:52:35,040 --> 00:52:37,280 WHILE TALKING TO SOMEONE OR USE 1351 00:52:37,280 --> 00:52:38,960 TO SURVEY THE LANDSCAPE AND 1352 00:52:38,960 --> 00:52:42,960 RECORD IT WHILE TALKING. 1353 00:52:42,960 --> 00:52:47,160 WHAT THEY DIDN'T EXPECT IS WHILE 1354 00:52:47,160 --> 00:52:50,600 THE BEHAVIOR OF THE ELITE WHICH 1355 00:52:50,600 --> 00:52:56,400 WAS SUPPOSED TO CREATE 1356 00:52:56,400 --> 00:52:59,120 ASPIRATIONAL HEIGHTS AND THERE 1357 00:52:59,120 --> 00:53:01,920 WAS A NORM SURFING THE WEB WHILE 1358 00:53:01,920 --> 00:53:06,520 TALKING IS SOMEONE IS RUDE AND 1359 00:53:06,520 --> 00:53:12,760 RECORDING THE LANDSCAPING IS A 1360 00:53:12,760 --> 00:53:18,320 VIOLATION OF SOCIAL NORMS AND IT 1361 00:53:18,320 --> 00:53:21,120 BECAME SEEN AS WHAT ARE 1362 00:53:21,120 --> 00:53:21,400 GLASS-HOLES. 1363 00:53:21,400 --> 00:53:24,040 ON THE OTHER SIDE OF A SOCIAL 1364 00:53:24,040 --> 00:53:26,840 DIVIDE AND IT KIND OF TO SOME 1365 00:53:26,840 --> 00:53:28,440 EXTENT CREATED A CULTURE WAR 1366 00:53:28,440 --> 00:53:31,680 WITHIN THE COMMUNITY WHERE 1367 00:53:31,680 --> 00:53:34,640 BASICALLY SHOPS AND RESTAURANTS 1368 00:53:34,640 --> 00:53:37,560 PUT UP SIGNS GLASS-HOLES NOT 1369 00:53:37,560 --> 00:53:39,480 ALLOWED IN. 1370 00:53:39,480 --> 00:53:42,120 THAT'S A STRONG SOCIAL REACTION. 1371 00:53:42,120 --> 00:53:43,960 COMPLETELY UNANTICIPATED BY THE 1372 00:53:43,960 --> 00:53:46,360 COMPANY BUT HAD TWO DOWN SIDES. 1373 00:53:46,360 --> 00:53:50,600 ONE IS THE PRODUCT LINE WAS 1374 00:53:50,600 --> 00:53:54,400 ESSENTIALLY SHUT DOWN BUT THE 1375 00:53:54,400 --> 00:53:55,800 COMPANY THOUGHT LESS OF GOOGLE 1376 00:53:55,800 --> 00:54:01,840 BECAUSE THEY TRIED TO PROMOTE SO 1377 00:54:01,840 --> 00:54:08,080 AGGRESSIVELY A TECHNOLOGY 1378 00:54:08,080 --> 00:54:08,720 AGAINST SOCIAL CULTURE AND THEY 1379 00:54:08,720 --> 00:54:10,680 TRIED TO FLOOD THE MARKET AND 1380 00:54:10,680 --> 00:54:13,440 GOOGLE SAW THE VAST MAJORITY OF 1381 00:54:13,440 --> 00:54:15,800 PEOPLE THEY KNEW KNEW ABOUT 1382 00:54:15,800 --> 00:54:18,040 GOOGLE PLUS AND THERE WAS 1383 00:54:18,040 --> 00:54:19,960 MASSIVE AWARENESS BUT WEREN'T 1384 00:54:19,960 --> 00:54:21,160 USING IT AND PEOPLE STARTED 1385 00:54:21,160 --> 00:54:26,000 EXPLAINING TO THEMSELVES WHY 1386 00:54:26,000 --> 00:54:28,720 THEY'RE NOT USING IT. 1387 00:54:28,720 --> 00:54:32,440 THEY CREATED AN INADVERTENT WORD 1388 00:54:32,440 --> 00:54:34,920 OF MOUTH BUZZ. 1389 00:54:34,920 --> 00:54:38,280 THERE'S DANGER IN USING THE 1390 00:54:38,280 --> 00:54:38,920 VIERING VIRAL STRATEGIES BECAUSE 1391 00:54:38,920 --> 00:54:41,360 YOU CAN GENERATE BACKFIRE 1392 00:54:41,360 --> 00:54:41,720 EFFECTS. 1393 00:54:41,720 --> 00:54:43,240 THIS MEANS THAT IF YOU'RE IN 1394 00:54:43,240 --> 00:54:47,200 THIS STRUCTURE WHERE A NORMS OR 1395 00:54:47,200 --> 00:54:48,840 PRACTICES IN PLACE AND JUST 1396 00:54:48,840 --> 00:54:51,400 GETTING AN INFLUENCER TO ADOPT 1397 00:54:51,400 --> 00:54:54,680 IT WON'T JUST WORK AND EVERYONE 1398 00:54:54,680 --> 00:54:55,960 THEY'RE CONNECTED TO FACES THOSE 1399 00:54:55,960 --> 00:55:00,480 FORMS AND IT'S HARD TO GET A 1400 00:55:00,480 --> 00:55:01,360 CASCADE GOING. 1401 00:55:01,360 --> 00:55:02,600 THIS THESE ARE INTERESTING 1402 00:55:02,600 --> 00:55:04,080 RESULTS AND IF YOU CAN TARGET 1403 00:55:04,080 --> 00:55:06,760 OTHER PARTS OF THE SOCIAL 1404 00:55:06,760 --> 00:55:09,480 NETWORKS I REFER TO AS THE 1405 00:55:09,480 --> 00:55:13,240 COMPLEX CENTER IN THE CLASSIC 1406 00:55:13,240 --> 00:55:14,920 VISUALIZATION LAYOUT WITH 1407 00:55:14,920 --> 00:55:16,120 LOCATIONS WITH MANY WIDE BRIDGES 1408 00:55:16,120 --> 00:55:19,520 THAT ARE WELL POSITIONED TO 1409 00:55:19,520 --> 00:55:21,280 SPREAD SOCIAL NORMS THESE ARE 1410 00:55:21,280 --> 00:55:22,920 NOT GOOD FOR SPREADING SIMPLE 1411 00:55:22,920 --> 00:55:26,160 CONTAGIONS LIKE DISEASES BUT 1412 00:55:26,160 --> 00:55:27,880 GOOD FOR GENERATING SOCIAL 1413 00:55:27,880 --> 00:55:28,120 SUPPORT. 1414 00:55:28,120 --> 00:55:30,280 YOU CAN SEE HOW EFFECTIVE THEY 1415 00:55:30,280 --> 00:55:30,920 ARE. 1416 00:55:30,920 --> 00:55:32,440 WHAT HAPPENS IS YOU GET SOCIAL 1417 00:55:32,440 --> 00:55:37,840 REINFORCE MANY FOR THE NORMATIVE 1418 00:55:37,840 --> 00:55:39,640 CHANGE AND IT DOESN'T JUMP RIGHT 1419 00:55:39,640 --> 00:55:41,240 TO THE CENTER AND TAKE OVER THE 1420 00:55:41,240 --> 00:55:43,680 NETWORK AND SPREAD LIKE A VIRUS. 1421 00:55:43,680 --> 00:55:45,800 IT BUILDS A CRITICAL MASS AND 1422 00:55:45,800 --> 00:55:48,120 ONCE THE CRITICAL MASS IS 1423 00:55:48,120 --> 00:55:49,680 REACHED IT REACHES TO THE 1424 00:55:49,680 --> 00:55:51,680 NETWORK AND INITIATES CHANGE. 1425 00:55:51,680 --> 00:55:53,920 IT'S A DIFFERENT SPREADING 1426 00:55:53,920 --> 00:55:57,440 PATTERN BUT THE PATTERN THAT 1427 00:55:57,440 --> 00:56:02,080 EXPLAINS HOW SOCIAL NORMS AND 1428 00:56:02,080 --> 00:56:03,480 COMMUNITY PRACTICES CHANGE. 1429 00:56:03,480 --> 00:56:04,960 I'LL LEAVE YOU WITH A COUPLE 1430 00:56:04,960 --> 00:56:07,320 POINTS FOR THINKING ABOUT THE 1431 00:56:07,320 --> 00:56:08,920 IDEAS FOR THE REST OF THE 1432 00:56:08,920 --> 00:56:09,160 MEETING. 1433 00:56:09,160 --> 00:56:11,640 ONE IS THAT SOCIAL REINFORCEMENT 1434 00:56:11,640 --> 00:56:13,120 IS KEY. 1435 00:56:13,120 --> 00:56:15,160 WHEN YOU'RE CHANGING SCIENTIFIC 1436 00:56:15,160 --> 00:56:16,440 OR SOCIAL PRACTICES WHAT YOUR 1437 00:56:16,440 --> 00:56:20,400 FOCUSSED ON IS THE QUESTION OF 1438 00:56:20,400 --> 00:56:21,520 LEGITIMACY AND CREDIBILITY AND 1439 00:56:21,520 --> 00:56:23,320 WIDE BRIDGES FROM ONE GROUP TO 1440 00:56:23,320 --> 00:56:27,600 ANOTHER GROUP ARE ESSENTIAL FOR 1441 00:56:27,600 --> 00:56:30,040 SPREADING THE COMMITMENT ACROSS 1442 00:56:30,040 --> 00:56:32,480 THE GROUPS IS KEY FOR LARGE 1443 00:56:32,480 --> 00:56:34,680 SCALE CHANGE YOU'LL HAVE TO 1444 00:56:34,680 --> 00:56:36,000 EXPAND GROUPS AND THINK WHERE 1445 00:56:36,000 --> 00:56:37,080 THE BRIDGING INFRASTRUCTURE WILL 1446 00:56:37,080 --> 00:56:40,320 ALLOW TO YOU SPREAD THE 1447 00:56:40,320 --> 00:56:42,560 INNOVATION WITH REINFORCEMENT SO 1448 00:56:42,560 --> 00:56:45,480 THE LEGITIMACY CAN BE SHIFTED BY 1449 00:56:45,480 --> 00:56:47,240 THE BRIDGE AND THE REINFORCING 1450 00:56:47,240 --> 00:56:48,240 TIES ACROSS IT. 1451 00:56:48,240 --> 00:56:50,440 THE SECOND IS RELEVANCE. 1452 00:56:50,440 --> 00:56:52,360 OBVIOUSLY, IF PEERS PERCEIVE 1453 00:56:52,360 --> 00:56:54,320 DISTANCE OR SOCIAL OPPOSITION 1454 00:56:54,320 --> 00:56:56,720 THEN THOSE CONNECTIONS AREN'T 1455 00:56:56,720 --> 00:56:58,520 GOING TO BE AS MEANINGFUL. 1456 00:56:58,520 --> 00:57:00,160 WE SAW THIS WITH FACE MASKS. 1457 00:57:00,160 --> 00:57:02,360 IT'S CLEAR THE ADOPTION OF FACE 1458 00:57:02,360 --> 00:57:03,760 MASKS SPREAD IN A DIFFERENT WAY 1459 00:57:03,760 --> 00:57:06,000 THAN THE ADOPTION OF COVID-19. 1460 00:57:06,000 --> 00:57:16,200 COVID-19 WAS NOT AT ALL AFFECTS 1461 00:57:16,200 --> 00:57:20,040 AND THERE'S SOMETHING DIFFERENT 1462 00:57:20,480 --> 00:57:20,560 . 1463 00:57:20,560 --> 00:57:25,000 WHAT WE THINK ABOUT IN HOW WE DO 1464 00:57:25,000 --> 00:57:30,360 OUR SUPPORT FOR VACCINATION AND 1465 00:57:30,360 --> 00:57:33,920 FACE MASKS AND GENERATE 1466 00:57:33,920 --> 00:57:37,760 REINFORCE 1467 00:57:37,760 --> 00:57:38,080 REINFORCEMENT. 1468 00:57:38,080 --> 00:57:43,320 IT'S IMPORTANT SIMILARITIES AND 1469 00:57:43,320 --> 00:57:44,240 THERE ARE CASES WHERE DIVERSITYT 1470 00:57:44,240 --> 00:57:46,200 THAT'S DIFFERENCE BETWEEN 1471 00:57:46,200 --> 00:57:50,080 PEOPLE IS ALSO VERY EFFECTIVE IN 1472 00:57:50,080 --> 00:57:51,600 CREATING RELEVANCE AND WHEN WE 1473 00:57:51,600 --> 00:57:52,840 LOOK AT THE CHANGES AND 1474 00:57:52,840 --> 00:57:56,240 PRACTICES WE'RE NOT LOOKING AT 1475 00:57:56,240 --> 00:57:57,400 THE SPREAD OF INFLAMMATION. 1476 00:57:57,400 --> 00:57:58,480 IT'S NOT JUST TELLING PEOPLE 1477 00:57:58,480 --> 00:58:00,280 THIS IS WHAT YOU SHOULD DO OR IS 1478 00:58:00,280 --> 00:58:00,880 AVAILABLE. 1479 00:58:00,880 --> 00:58:03,000 THAT OFTEN BOUNCES OFF THE FACT 1480 00:58:03,000 --> 00:58:06,720 PEOPLE HAVE EXISTING PRACTICES 1481 00:58:06,720 --> 00:58:10,560 AND FALLS ON DEAF EARS AND 1482 00:58:10,560 --> 00:58:13,200 THERE'S FRUSTRATION ABOUT 1483 00:58:13,200 --> 00:58:14,840 CLIMATE CHANGE BECAUSE IT'S THE 1484 00:58:14,840 --> 00:58:17,600 RELEVANT PEER NETWORK AND NORMS 1485 00:58:17,600 --> 00:58:19,800 DOING THE WORK. 1486 00:58:19,800 --> 00:58:21,320 IN ORDER TO THINK ABOUT THE 1487 00:58:21,320 --> 00:58:22,600 CHANGE AND ALTER SCIENTIFIC 1488 00:58:22,600 --> 00:58:25,400 RIGOR AND ACCEPTANCE ON NEW 1489 00:58:25,400 --> 00:58:26,160 PRACTICES ENFORCING THE 1490 00:58:26,160 --> 00:58:27,520 STANDARDS OF RIGOR IT'S ABOUT 1491 00:58:27,520 --> 00:58:29,440 SHIFTING THE NORMS OF DAILY 1492 00:58:29,440 --> 00:58:30,880 PRACTICE FOR THE COMMUNITIES. 1493 00:58:30,880 --> 00:58:34,720 SO I CAN TALK MORE ABOUT THIS 1494 00:58:34,720 --> 00:58:38,000 AND DISCUSS CHANGE FOR THE 1495 00:58:38,000 --> 00:58:40,400 IMPLICATIONS FOR TIPPING POINTS. 1496 00:58:40,400 --> 00:58:48,400 THE WEB ADDRESS INCLUDES MY 1497 00:58:48,400 --> 00:58:52,400 RESEARCH AND THANK YOU VERY 1498 00:58:52,400 --> 00:59:02,520 MUCH. 1499 00:59:02,880 --> 00:59:09,000 >> THAT WAS FANTASTIC. 1500 00:59:09,000 --> 00:59:10,640 IT MAKES ME LOOK AT WHAT I'M 1501 00:59:10,640 --> 00:59:16,800 DOING AND PLAN TO DO AND THE 1502 00:59:16,800 --> 00:59:20,280 THINGS OTHERS HAVE SAID AND 1503 00:59:20,280 --> 00:59:21,960 WHERE THEY'VE SUCCEEDED AND 1504 00:59:21,960 --> 00:59:23,600 INTERESTED TO HEAR IN THE 1505 00:59:23,600 --> 00:59:25,600 DISCUSSIONS HOW IT AFFECTS HOW 1506 00:59:25,600 --> 00:59:26,400 WE MIGHT THINK. 1507 00:59:26,400 --> 00:59:31,440 OUR THIRD SESSION IS FOCUSSED ON 1508 00:59:31,440 --> 00:59:34,080 NORMS AND BOW -- BEHAVIORS AND 1509 00:59:34,080 --> 00:59:36,920 MOTIVATION WILL RELATE TO WHAT 1510 00:59:36,920 --> 00:59:38,480 YOU TALKED ABOUT. 1511 00:59:38,480 --> 00:59:40,240 DAMON SAID HE'LL BE LISTENING IN 1512 00:59:40,240 --> 00:59:44,520 AND MAYBE REFLECT ON ABOUT WHAT 1513 00:59:44,520 --> 00:59:48,040 HE'S HEARD IN THE SPEAKERS AND 1514 00:59:48,040 --> 00:59:50,000 ENSUING DISCUSSION BEFORE THE 1515 00:59:50,000 --> 00:59:50,240 BREAK. 1516 00:59:50,240 --> 00:59:52,240 HE'LL STILL BE LISTENING AND BE 1517 00:59:52,240 --> 00:59:53,920 ABLE TO SHARE WISDOM. 1518 00:59:53,920 --> 00:59:56,400 THANK YOU FOR THAT, DAMON AND 1519 00:59:56,400 --> 00:59:58,240 I'M SURE YOU'LL BE GETTING 1520 00:59:58,240 --> 01:00:00,080 SEVERAL DIMES OF ROYALTIES FROM 1521 01:00:00,080 --> 01:00:00,680 THAT TALK. 1522 01:00:00,680 --> 01:00:03,320 THIS IS NOT SOMETHING WE 1523 01:00:03,320 --> 01:00:06,720 NORMALLY HEAR IN THESE MEETINGS 1524 01:00:06,720 --> 01:00:07,880 FROM PROFESSIONAL SOCIOLOGISTS 1525 01:00:07,880 --> 01:00:08,600 WHO STUDY THIS. 1526 01:00:08,600 --> 01:00:10,840 I WANT TO INVITE THE FIRST 1527 01:00:10,840 --> 01:00:12,440 MODERATOR AND THREE SPEAKERS FOR 1528 01:00:12,440 --> 01:00:13,960 THE NEXT SESSION. 1529 01:00:13,960 --> 01:00:15,720 IT'S DAVID ELLISON. 1530 01:00:15,720 --> 01:00:17,240 HE'S A DEAN OF THE INDIANA 1531 01:00:17,240 --> 01:00:21,720 SCHOOL OF PUBLIC HEALTH A 1532 01:00:21,720 --> 01:00:23,400 STATISTICIAN ACTIVE IN THE 1533 01:00:23,400 --> 01:00:28,760 NATIONAL ACADEMIES ON ISSUES OF 1534 01:00:28,760 --> 01:00:30,160 RESEARCH, REPRODUCIBILITY AND 1535 01:00:30,160 --> 01:00:31,240 RIGOR AND WILL BE MODERATING THE 1536 01:00:31,240 --> 01:00:36,640 SESSION AND THE THREE SPEAKERS 1537 01:00:36,640 --> 01:00:42,680 WHO HE'LL INTRODUCE ARE MALCOLM 1538 01:00:42,680 --> 01:00:50,880 MACLEOD AND ANNA HATCH AND APRIL 1539 01:00:50,880 --> 01:00:51,240 CLYBURNE-SHERIN. 1540 01:00:51,240 --> 01:00:53,320 WE'RE A LITTLE BEHIND ON TIME 1541 01:00:53,320 --> 01:00:56,480 BUT BETWEEN THE BREAK AND LUNCH 1542 01:00:56,480 --> 01:00:57,080 WE'LL BE ABLE TO RECLAIM A 1543 01:00:57,080 --> 01:00:58,440 LITTLE BIT SO WE MAY HAVE A 1544 01:00:58,440 --> 01:01:00,240 SHORTER BREAK AND LUNCH BUT 1545 01:01:00,240 --> 01:01:10,640 WE'LL PLAY IT BY EAR. 1546 01:01:22,680 --> 01:01:24,320 >> THANK YOU STEVE AND NINDS AND 1547 01:01:24,320 --> 01:01:32,320 FOR INVITING ME HERE TO BE WITH 1548 01:01:32,320 --> 01:01:33,280 YOU. 1549 01:01:33,280 --> 01:01:36,080 I'M ALSO DEEPLY HONORED TO 1550 01:01:36,080 --> 01:01:37,400 INTRODUCE OUR SPEAKERS TODAY WHY 1551 01:01:37,400 --> 01:01:40,240 I'LL THEN MODERATE AFTER THE 1552 01:01:40,240 --> 01:01:40,920 BREAK. 1553 01:01:40,920 --> 01:01:42,200 I'LL KEEP MY INTRODUCTIONS 1554 01:01:42,200 --> 01:01:42,440 CHEAP. 1555 01:01:42,440 --> 01:01:43,280 YOU HEARD THEIR NAMES. 1556 01:01:43,280 --> 01:01:45,600 YOU SEE THEIR NAMES BEFORE YOU. 1557 01:01:45,600 --> 01:01:47,640 I'M GOING JUMP RIGHT IN SO WE 1558 01:01:47,640 --> 01:01:50,800 HAVE THE MAXIMUM TIME FOR 1559 01:01:50,800 --> 01:01:58,560 SPEAKERS TO REWARD US WITH THEIR 1560 01:01:58,560 --> 01:02:00,920 ACUITY AND I'LL BE LONG-WINDED 1561 01:02:00,920 --> 01:02:01,120 LATER. 1562 01:02:01,120 --> 01:02:04,360 THE FIRST SPEAKER IS APRIL 1563 01:02:04,360 --> 01:02:05,160 CLYBURNE-SHERIN FROM 1564 01:02:05,160 --> 01:02:08,480 REPRODUCIBILITY FROM EVERYONE. 1565 01:02:08,480 --> 01:02:17,240 WELCOME. 1566 01:02:17,240 --> 01:02:27,720 >> SO THANKS SO MUCH, DAVID. 1567 01:02:41,320 --> 01:02:42,600 I'M EXCITED TO BE HERE. 1568 01:02:42,600 --> 01:02:44,800 THIS IS MY FIRST TALK IN A FEW 1569 01:02:44,800 --> 01:02:46,440 YEARS WITHOUT MY DOG SITTING ON 1570 01:02:46,440 --> 01:02:48,080 MY LAP SO IT'S A LITTLE BIT OF A 1571 01:02:48,080 --> 01:02:50,120 MILESTONE FOR ME AND I'M GLAD 1572 01:02:50,120 --> 01:02:54,600 IT'S HERE WITH ALL OF YOU 1573 01:02:54,600 --> 01:02:55,560 BECAUSE IT'S SOMETHING I'VE 1574 01:02:55,560 --> 01:02:56,640 WORKING ON. 1575 01:02:56,640 --> 01:02:58,920 I'M THE EXECUTIVE DIRECTOR OF A 1576 01:02:58,920 --> 01:03:03,680 GROUP CALLED REPRODUCIBILITY FOR 1577 01:03:03,680 --> 01:03:04,000 EVERYONE. 1578 01:03:04,000 --> 01:03:08,920 AND SO WHAT WE ARE IS AN 1579 01:03:08,920 --> 01:03:09,600 EDUCATIONAL PROJECT. 1580 01:03:09,600 --> 01:03:13,560 WE'RE COMMUNITY LED AND WE FOCUS 1581 01:03:13,560 --> 01:03:16,320 ON REACHING RESEARCHERS AT 1582 01:03:16,320 --> 01:03:18,080 SCALE, REACHING RESEARCHERS 1583 01:03:18,080 --> 01:03:23,000 WHERE THEY'RE AT AND TRYING TO 1584 01:03:23,000 --> 01:03:24,320 INCREASE THE DISCOVERY OF TOOLS 1585 01:03:24,320 --> 01:03:25,840 AND METHODS. 1586 01:03:25,840 --> 01:03:28,040 TO SPEAK TO CONNECT ON WHAT WE 1587 01:03:28,040 --> 01:03:30,240 TALKED ABOUT AND WHAT I SEE OUR 1588 01:03:30,240 --> 01:03:31,720 PROJECT DOING IS FOCUSSING ON 1589 01:03:31,720 --> 01:03:34,160 THE PEER-TO-PEER TYPE OF 1590 01:03:34,160 --> 01:03:36,680 KNOWLEDGE SHARING TRYING TO FILL 1591 01:03:36,680 --> 01:03:40,040 SOME GAPS IN RESEARCHER TRAINING 1592 01:03:40,040 --> 01:03:42,920 AND ALLOWING RESEARCHERS TO HAVE 1593 01:03:42,920 --> 01:03:44,800 A PLATFORM TO SHARE THOSE THINGS 1594 01:03:44,800 --> 01:03:49,760 THAT WORKED FOR THEM TO IMPROVE 1595 01:03:49,760 --> 01:03:51,400 ORGANIZATION, DOCUMENTATION, 1596 01:03:51,400 --> 01:03:52,280 OPTIMIZATION AND DISSEMINATION 1597 01:03:52,280 --> 01:03:53,960 OF THEIR WORK. 1598 01:03:53,960 --> 01:03:56,160 IT'S RESEARCHERS TEACHING 1599 01:03:56,160 --> 01:03:57,640 RESEARCHERS WITHIN THEIR OWN 1600 01:03:57,640 --> 01:03:58,880 DISCIPLINES. 1601 01:03:58,880 --> 01:04:01,160 SO WE ARE VOLUNTEER RUN. 1602 01:04:01,160 --> 01:04:04,280 WE'VE RUN MANY WORKSHOPS ALL 1603 01:04:04,280 --> 01:04:07,000 OVER THE WORLD TO LARGE LARGE 1604 01:04:07,000 --> 01:04:09,720 GROUPS OF SCIENTISTS. 1605 01:04:09,720 --> 01:04:14,360 WE'RE OFTEN TIMES DOING THIS AT 1606 01:04:14,360 --> 01:04:15,200 CONFERENCES SO WE'RE MEETING 1607 01:04:15,200 --> 01:04:19,880 FOLKS WHEN THEY ALREADY ALLOTTED 1608 01:04:19,880 --> 01:04:21,480 TIME TO LEARN AND THEY MAY HAVE 1609 01:04:21,480 --> 01:04:23,480 TIME TO COME AND DROP IN ON 1610 01:04:23,480 --> 01:04:26,800 SOMETHING THEY ARE NOT ACTUALLY 1611 01:04:26,800 --> 01:04:28,440 THAT KNOWLEDGEABLE ABOUT YET. 1612 01:04:28,440 --> 01:04:30,440 THE THEME FOR THIS SECTION IS 1613 01:04:30,440 --> 01:04:32,280 MOTIVATION. 1614 01:04:32,280 --> 01:04:34,680 I'M NOT GOING TO TALK ABOUT THE 1615 01:04:34,680 --> 01:04:36,840 COMMUNITY ITSELF I'LL TALK ABOUT 1616 01:04:36,840 --> 01:04:38,040 THE MOTIVATIONAL SIDE AND WHAT 1617 01:04:38,040 --> 01:04:39,480 WE LEARNED ON DOING THE WORK THE 1618 01:04:39,480 --> 01:04:40,160 LAST FEW YEARS. 1619 01:04:40,160 --> 01:04:43,520 THE FIRST SECTION ON WHAT 1620 01:04:43,520 --> 01:04:44,840 MOTIVATED IS IN THE SLIDE DECK 1621 01:04:44,840 --> 01:04:47,520 AND YOU CAN READ THROUGH OUR 1622 01:04:47,520 --> 01:04:50,720 ORIGIN STORY AND YOU CAN TALK TO 1623 01:04:50,720 --> 01:04:52,600 ME ABOUT IT LATER BUT I'LL SKIP 1624 01:04:52,600 --> 01:04:54,640 IT FOR THE SAKE OF TIME AND I'LL 1625 01:04:54,640 --> 01:04:56,720 TALK ABOUT WHAT MOTIVATES 1626 01:04:56,720 --> 01:04:57,480 RESEARCHERS TO ATTEND THE 1627 01:04:57,480 --> 01:04:59,160 TRAINING BASED ON THE SURVEY 1628 01:04:59,160 --> 01:05:00,600 RESULTS AND CONVERSATIONS WE HAD 1629 01:05:00,600 --> 01:05:01,640 IN OUR COMMUNITY. 1630 01:05:01,640 --> 01:05:04,240 THE WAYS IN WHICH INTRODUCTORY 1631 01:05:04,240 --> 01:05:06,400 TRAINING MOTIVATES CHANGES IN 1632 01:05:06,400 --> 01:05:08,280 BEHAVIOR AS WELL AS WHAT 1633 01:05:08,280 --> 01:05:12,840 MOTIVATES SCIENTIST TO GO FROM 1634 01:05:12,840 --> 01:05:14,360 DECIDING TO BECOME A PARTICIPANT 1635 01:05:14,360 --> 01:05:16,960 TO A TRAINER WHICH IS WHAT WE'RE 1636 01:05:16,960 --> 01:05:18,640 TRYING DO AND COMMONLY WHAT 1637 01:05:18,640 --> 01:05:26,360 E OF OUR WORK SHOPS.E ATTENDS 1638 01:05:26,360 --> 01:05:28,240 SO THIS IN SUMMARY FROM DOING 1639 01:05:28,240 --> 01:05:32,440 MANY WORKSHOPS WE SAW A GAP WE 1640 01:05:32,440 --> 01:05:33,800 WERE LEAVING RESEARCHERS BEHIND. 1641 01:05:33,800 --> 01:05:37,120 THERE WAS A LOT PEOPLE EXCITED 1642 01:05:37,120 --> 01:05:39,760 BUT A SMALL GROUP COMING AND 1643 01:05:39,760 --> 01:05:41,040 DEDICATED THREE, FOUR HOURS 1644 01:05:41,040 --> 01:05:42,640 EVERY DAY TO LEARN NEW 1645 01:05:42,640 --> 01:05:42,880 PRACTICES. 1646 01:05:42,880 --> 01:05:45,760 AND MOST RESEARCHERS WERE NOT 1647 01:05:45,760 --> 01:05:48,000 COMING TO THESE LONGER FORMAT 1648 01:05:48,000 --> 01:05:50,520 WORK SHOPS. 1649 01:05:50,520 --> 01:05:55,120 WHAT WE FOCUS ON IS CHANGING THE 1650 01:05:55,120 --> 01:05:56,880 INTRODUCTORY REPRODUCIBILITY 1651 01:05:56,880 --> 01:05:58,880 WORKSHOP FOR RESEARCHERS AND 1652 01:05:58,880 --> 01:06:00,120 AIMING AT FUNNELING PEOPLE IN A 1653 01:06:00,120 --> 01:06:01,360 SHORT PERIOD OF TIME TO THE 1654 01:06:01,360 --> 01:06:03,520 OTHER AMAZING PROJECTS GOING ON. 1655 01:06:03,520 --> 01:06:06,120 MANY ARE RUNNING THE OTHER 1656 01:06:06,120 --> 01:06:07,600 PROJECTS WE POINT FOLKS TO 1657 01:06:07,600 --> 01:06:09,400 WITHIN OUR WORKSHOPS. 1658 01:06:09,400 --> 01:06:11,560 WE PLAN TO BE THE FIRST TOUCH 1659 01:06:11,560 --> 01:06:13,760 FOR FOLKS THAT DON'T EVEN KNOW 1660 01:06:13,760 --> 01:06:17,040 WHAT REPRODUCIBILITY MEANS AND 1661 01:06:17,040 --> 01:06:19,600 MAYBE THEY DON'T CARE AT ALL. 1662 01:06:19,600 --> 01:06:21,480 WE'RE THERE TO FILL GAPS IN 1663 01:06:21,480 --> 01:06:22,640 TRAINING AND GIVE THEM THE 1664 01:06:22,640 --> 01:06:25,480 THINGS THEY NEED TO START A 1665 01:06:25,480 --> 01:06:26,880 JOURNEY OF LIFE-LONG JOURNEY. 1666 01:06:26,880 --> 01:06:29,560 WE FOCUS ON INTRODUCTIONS TO 1667 01:06:29,560 --> 01:06:33,800 REACH MORE PEOPLE AND FIT IT IN 1668 01:06:33,800 --> 01:06:34,560 THEIR SCHEDULE. 1669 01:06:34,560 --> 01:06:39,640 30 TO 90 MINUTES IS A USUAL 1670 01:06:39,640 --> 01:06:40,200 WORKS 1671 01:06:40,200 --> 01:06:40,440 WORKSHOP. 1672 01:06:40,440 --> 01:06:45,400 WE'RE TARGETING CONFERENCES 1673 01:06:45,400 --> 01:06:48,000 BECAUSE THAT'S WHERE WE GET 1674 01:06:48,000 --> 01:06:50,160 TOOLS AND METHODS AND SOMETIMES 1675 01:06:50,160 --> 01:06:53,040 WE HAVE 300 RESEARCHERS AT A 1676 01:06:53,040 --> 01:06:54,080 TIME. 1677 01:06:54,080 --> 01:06:56,560 WE ALSO END UP WITH MORE DIVERSE 1678 01:06:56,560 --> 01:06:58,640 GROUP OF CAREER LEVELS IN THOSE 1679 01:06:58,640 --> 01:07:00,720 WORK SHOPS THAN WE DID WHEN WE 1680 01:07:00,720 --> 01:07:02,960 WOULD RUN THE WORKSHOPS ON 1681 01:07:02,960 --> 01:07:03,960 CAMPUS. 1682 01:07:03,960 --> 01:07:05,960 WE HAD SOME OF THE MORE SENIOR 1683 01:07:05,960 --> 01:07:08,360 RESEARCHERS IN THE ROOM AND MORE 1684 01:07:08,360 --> 01:07:09,840 P.I.s RATHER THAN BEING EARLY 1685 01:07:09,840 --> 01:07:10,800 CAREER RESEARCHERS AND STUDENTS. 1686 01:07:10,800 --> 01:07:15,760 SO IN TERMS OF WHAT MOTIVATES 1687 01:07:15,760 --> 01:07:19,440 SCIENTISTS TO ATTEND THESE 1688 01:07:19,440 --> 01:07:21,520 TRAININGS IS FROM OUR SURVEY 1689 01:07:21,520 --> 01:07:22,840 OVER THE LAST COUPLE YEARS. 1690 01:07:22,840 --> 01:07:25,440 THIS IS WHEN WE'RE DOING THE 1691 01:07:25,440 --> 01:07:25,680 VIRTUAL. 1692 01:07:25,680 --> 01:07:28,000 MOST PEOPLE ARE COMING BECAUSE 1693 01:07:28,000 --> 01:07:30,720 THIS IS SOMETHING THEY HAVE 1694 01:07:30,720 --> 01:07:31,000 EXPERIENCED. 1695 01:07:31,000 --> 01:07:35,280 82% OF THE PARTICIPANTS HAVE 1696 01:07:35,280 --> 01:07:37,720 TALKED ABOUT STRUGGLING WITH 1697 01:07:37,720 --> 01:07:39,200 REPRODUCING RESULTS. 1698 01:07:39,200 --> 01:07:41,640 72% TALK ABOUT HOW THEY'VE HAD A 1699 01:07:41,640 --> 01:07:43,200 HARD TIME REPRODUCING THE 1700 01:07:43,200 --> 01:07:44,800 RESULTS OF SOMEONE ELSE AND THAT 1701 01:07:44,800 --> 01:07:48,400 COULD BE A PUBLISHED PAPER OR 1702 01:07:48,400 --> 01:07:52,000 COLLEAGUE IN THEIR LAB AND HALF 1703 01:07:52,000 --> 01:07:52,920 REPORT STRUGGLING WITH 1704 01:07:52,920 --> 01:07:54,280 REPRODUCING THEIR OWN RESULTS. 1705 01:07:54,280 --> 01:07:55,800 THIS IS THE THING WE FOCUS ON IN 1706 01:07:55,800 --> 01:07:56,720 THE WORKSHOP. 1707 01:07:56,720 --> 01:07:59,360 WE SAY THE OVERLAP BETWEEN THOSE 1708 01:07:59,360 --> 01:08:02,840 THINGS YOU CAN DO TO IMPROVE 1709 01:08:02,840 --> 01:08:06,120 YOUR LIFE TO REDUCE THE PAIN AND 1710 01:08:06,120 --> 01:08:08,560 FRUSTRATION YOU FEEL WHEN YOU 1711 01:08:08,560 --> 01:08:10,200 CAN'T FIND THE MOST RECENT FILE 1712 01:08:10,200 --> 01:08:12,960 AND SOMEONE WALKED AWAY WITH 1713 01:08:12,960 --> 01:08:13,760 YOUR DATA. 1714 01:08:13,760 --> 01:08:17,440 THAT OVERLAPS SIGNIFICANTLY WITH 1715 01:08:17,440 --> 01:08:20,560 THE STEP TO REPRODUCE IN YOUR 1716 01:08:20,560 --> 01:08:20,840 DISCIPLINE. 1717 01:08:20,840 --> 01:08:24,560 WE FOCUS ON PUSHING PEOPLE 1718 01:08:24,560 --> 01:08:26,480 TOWARDS THOSE TOOLS AND TRICKS 1719 01:08:26,480 --> 01:08:31,840 THAT WILL BENEFIT THEM 1720 01:08:31,840 --> 01:08:33,200 PERSONALLY IN THE SHORT TERM. 1721 01:08:33,200 --> 01:08:35,680 SO IN OUR SURVEYS WE ASK AND 1722 01:08:35,680 --> 01:08:38,320 INVITE THE PARTICIPANTS TO SHARE 1723 01:08:38,320 --> 01:08:40,640 PERSONAL EXPERIENCES WITH 1724 01:08:40,640 --> 01:08:42,000 REPRODUCIBLE ISSUE. 1725 01:08:42,000 --> 01:08:43,640 OBVIOUSLY, YOU WILL NOT BE ABLE 1726 01:08:43,640 --> 01:08:45,200 TO READ THIS BUT WHAT WE SEE 1727 01:08:45,200 --> 01:08:47,120 OVER AND OVER AGAIN IS PEOPLE 1728 01:08:47,120 --> 01:08:49,720 BEING FRUSTRATED WITH NOT BEING 1729 01:08:49,720 --> 01:08:53,680 ABLE TO REPRODUCE WORK AFTER 1730 01:08:53,680 --> 01:08:54,280 MANY ATTEMPTS. 1731 01:08:54,280 --> 01:08:55,440 LOSING TIME MONTHS, SOMETIMES 1732 01:08:55,440 --> 01:08:59,480 PEOPLE SAY A YEAR OF THEIR Ph.D. 1733 01:08:59,480 --> 01:09:01,080 BEING TOLD THEY SHOULD DO THIS 1734 01:09:01,080 --> 01:09:02,760 METHOD AND THE METHOD DOESN'T 1735 01:09:02,760 --> 01:09:04,240 WORK AND DOESN'T WORK AND 1736 01:09:04,240 --> 01:09:09,760 SOMEONE ELSE TRIES IT AND IT 1737 01:09:09,760 --> 01:09:11,560 DOESN'T WORK. 1738 01:09:11,560 --> 01:09:14,280 AND WE'RE LEARNING THE HARD WAY 1739 01:09:14,280 --> 01:09:19,880 YOU DIDN'T DOCUMENT IT PROPERLY 1740 01:09:19,880 --> 01:09:23,080 AND HAVE TO DO SOME WORK AND 1741 01:09:23,080 --> 01:09:24,040 MISSING INFORMATION. 1742 01:09:24,040 --> 01:09:25,160 THERE'S NOT ENOUGH INFORMATION 1743 01:09:25,160 --> 01:09:27,280 IN THE METHOD SECTION THEY HAVE 1744 01:09:27,280 --> 01:09:32,240 TO CONTACT YOU HAVE TO CONTACT 1745 01:09:32,240 --> 01:09:33,640 THE RESEARCH TO FIND OUT MORE 1746 01:09:33,640 --> 01:09:35,600 AND SOMETIMES THEY'RE COMING 1747 01:09:35,600 --> 01:09:36,560 FRUSTRATED AND SOMETIMES THEY'RE 1748 01:09:36,560 --> 01:09:37,840 COMING WITH A SOLUTION. 1749 01:09:37,840 --> 01:09:39,480 WE LIKE TO MAKE SURE PEOPLE KNOW 1750 01:09:39,480 --> 01:09:41,720 FROM THE BEGINNING WE WANT THEM 1751 01:09:41,720 --> 01:09:47,360 TO COME, TAKE WHAT THEY LEARNED 1752 01:09:47,360 --> 01:09:50,560 THAT HARD KNOWLEDGE OF A YEAR OF 1753 01:09:50,560 --> 01:09:51,880 SOMETHING NOT WORKING WHAT 1754 01:09:51,880 --> 01:09:53,360 HELPED THEM OVERCOME AND THEY 1755 01:09:53,360 --> 01:09:55,920 CAN INCLUDE THAT IN A FUTURE 1756 01:09:55,920 --> 01:09:58,240 VERSION OF THE WORKSHOP. 1757 01:09:58,240 --> 01:10:02,640 SO TO REITERATE, THEIR COMMUNELY 1758 01:10:02,640 --> 01:10:04,880 LED AND CURATED AND THE 1759 01:10:04,880 --> 01:10:06,520 MATERIALS ARE OPEN AND USABLE 1760 01:10:06,520 --> 01:10:09,840 AND ADAPTABLE AND VERSION JABL 1761 01:10:09,840 --> 01:10:11,040 AND RESEARCHERS MAKE THEM THEIR 1762 01:10:11,040 --> 01:10:13,320 OWN SO NO TWO WORK SHOPS ARE 1763 01:10:13,320 --> 01:10:14,400 EXACTLY THE SAME AND IF YOU'RE 1764 01:10:14,400 --> 01:10:15,880 INTERESTED IN TAKING A LOOK AND 1765 01:10:15,880 --> 01:10:17,640 SEEING SOME OF OUR CONTENT IT'S 1766 01:10:17,640 --> 01:10:18,000 HERE. 1767 01:10:18,000 --> 01:10:20,120 THESE ARE SOME TOPICS WE COVER, 1768 01:10:20,120 --> 01:10:22,520 DATA MANAGEMENT IS A COMMON ONE 1769 01:10:22,520 --> 01:10:26,360 AND THERE'S STUFF IN THERE YOU'D 1770 01:10:26,360 --> 01:10:28,480 EXPECT EVERYBODY TO HAVE LEARNED 1771 01:10:28,480 --> 01:10:30,480 IN THEIR CORE RESEARCH TRAINING 1772 01:10:30,480 --> 01:10:31,600 BUT WE'VE BEEN SURPRISED OVER 1773 01:10:31,600 --> 01:10:33,880 AND OVER AGAIN HOW THE BASICS 1774 01:10:33,880 --> 01:10:35,480 HOW TO ORGANIZE MATERIALS AND 1775 01:10:35,480 --> 01:10:36,680 NAME YOUR FILES IS SOMETHING A 1776 01:10:36,680 --> 01:10:38,240 LOT OF PEOPLE ARE NOT ACTUALLY 1777 01:10:38,240 --> 01:10:42,800 EVER BEING TAUGHT HOW TO DO 1778 01:10:42,800 --> 01:10:43,400 PROPERLY. 1779 01:10:43,400 --> 01:10:45,880 FINALLY, THIS TRAINING IS 1780 01:10:45,880 --> 01:10:48,280 MOTIVATING NEW BEHAVIOR IN OUR 1781 01:10:48,280 --> 01:10:50,480 PARTICIPANTS. 1782 01:10:50,480 --> 01:10:53,200 86% IN OUR POST-WORKSHOP SURVEY 1783 01:10:53,200 --> 01:10:56,160 REPORTED THEY LEARNED SOMETHING 1784 01:10:56,160 --> 01:10:57,560 THEY'LL USE IN THEIR RESEARCH. 1785 01:10:57,560 --> 01:10:59,760 I THINK A TAKEAWAY FOR EVERYONE 1786 01:10:59,760 --> 01:11:01,360 HERE IS THIS IS JUST 1787 01:11:01,360 --> 01:11:03,320 PEER-TO-PEER LEARNING, THIS IS 1788 01:11:03,320 --> 01:11:03,880 GRASSROOTS TRAINING. 1789 01:11:03,880 --> 01:11:06,640 IT'S NOT SOPHISTICATED 1790 01:11:06,640 --> 01:11:09,520 CURRICULUM BUT ALREADY GOING A 1791 01:11:09,520 --> 01:11:10,840 LONG WAY TO REACH EIGHT OF 1792 01:11:10,840 --> 01:11:11,040 FOLKS. 1793 01:11:11,040 --> 01:11:12,640 IT WOULDN'T TAKE EVERYBODY ALL 1794 01:11:12,640 --> 01:11:16,280 THE WAY BUT IT GETS PEOPLE 1795 01:11:16,280 --> 01:11:16,640 STARTED. 1796 01:11:16,640 --> 01:11:20,600 SO WILL WE DID A CAMPAIGN 1797 01:11:20,600 --> 01:11:21,680 RECENTLY GETTING OUR 1798 01:11:21,680 --> 01:11:22,880 PARTICIPANTS TO SHARE WHAT THEY 1799 01:11:22,880 --> 01:11:24,560 LEARNED IN A WORKSHOP. 1800 01:11:24,560 --> 01:11:26,320 THIS IS AN EXAMPLE OF SOMEONE 1801 01:11:26,320 --> 01:11:28,600 TALKING ABOUT HOW THEY DIDN'T 1802 01:11:28,600 --> 01:11:31,160 KNOW ABOUT PROTOCOL SHARING AND 1803 01:11:31,160 --> 01:11:33,080 REPOSITORY AND THAT WOULD HAVE 1804 01:11:33,080 --> 01:11:35,440 SAVED THEM SIX MONTHS IN THEIR 1805 01:11:35,440 --> 01:11:35,760 PH.D. 1806 01:11:35,760 --> 01:11:37,800 AND THIS RESEARCHER THEN BECAME 1807 01:11:37,800 --> 01:11:39,320 AN INSTRUCTOR. 1808 01:11:39,320 --> 01:11:41,000 THIS IS ANOTHER RESEARCHER WHO 1809 01:11:41,000 --> 01:11:43,400 LEARNED ABOUT ELECTRONIC LAB 1810 01:11:43,400 --> 01:11:45,560 NOTE BOOKS WHO IMPLEMENTED THAT 1811 01:11:45,560 --> 01:11:47,840 FOR THEIR RESEARCH IN THE FUTURE 1812 01:11:47,840 --> 01:11:49,160 AND THEIR RESEARCHER ALSO BECAME 1813 01:11:49,160 --> 01:11:51,880 AN INSTRUCTOR AND AGAIN THE 1814 01:11:51,880 --> 01:11:54,160 IMPORTANCE OF RE-AGENT 1815 01:11:54,160 --> 01:11:59,880 REPOSITORIES WAS A NEW CONCEPT 1816 01:11:59,880 --> 01:12:02,720 FOR THEM AND THEY SAID HOW MUCH 1817 01:12:02,720 --> 01:12:03,960 NICER IT WOULD HAVE BEEN AND 1818 01:12:03,960 --> 01:12:06,360 THIS RESEARCHER ALSO BECAME AN 1819 01:12:06,360 --> 01:12:08,440 INSTRUCTOR AND PROTOCOL 1820 01:12:08,440 --> 01:12:09,360 REPOSITORIES ARE SOMETHING THAT 1821 01:12:09,360 --> 01:12:10,640 ALSO MANY PEOPLE LEARN ABOUT FOR 1822 01:12:10,640 --> 01:12:17,640 THE FIRST TIME IN A WORKSHOP. 1823 01:12:17,640 --> 01:12:21,120 FINALLY, THE OTHER MOTIVATION WE 1824 01:12:21,120 --> 01:12:22,800 SEE WHEN WE TALK ABOUT 1825 01:12:22,800 --> 01:12:23,760 RESEARCHERS TO DO THIS WORK AND 1826 01:12:23,760 --> 01:12:25,640 LABOR IS TO THINK ABOUT WHAT 1827 01:12:25,640 --> 01:12:27,320 MOTIVATES THEM TO KEEP DOING IT 1828 01:12:27,320 --> 01:12:32,080 AND WHAT DEMOTIVATES THEM. 1829 01:12:32,080 --> 01:12:35,360 SO BURN OUT WILL DEFINITELY 1830 01:12:35,360 --> 01:12:38,320 CAUSE PEOPLE TO LEAVE A 1831 01:12:38,320 --> 01:12:40,560 COMMUNITY. 1832 01:12:40,560 --> 01:12:44,880 EXCLUSIONS AND NOT BEING 1833 01:12:44,880 --> 01:12:46,200 DELIBERATE IN PEOPLE'S NEEDS AND 1834 01:12:46,200 --> 01:12:48,560 INCLUSION AND BELONGING. 1835 01:12:48,560 --> 01:12:50,120 WE HAVE A PROGRAM OF DIVERSITY 1836 01:12:50,120 --> 01:12:51,640 STIPENDS AND IF YOU WANT TO 1837 01:12:51,640 --> 01:12:53,360 LEARN MORE ABOUT THAT REACH OUT 1838 01:12:53,360 --> 01:12:55,280 AND WE'LL TALK TO YOU ABOUT IT. 1839 01:12:55,280 --> 01:12:58,440 IN SUMMARY, SCIENTIST SEEKING 1840 01:12:58,440 --> 01:12:59,080 REPRODUCIBILITY TRAINING BECAUSE 1841 01:12:59,080 --> 01:13:01,280 THEY'RE MOTIVATED BY THEIR OWN 1842 01:13:01,280 --> 01:13:07,880 CHALLENGES IN RESULTS. 1843 01:13:07,880 --> 01:13:10,320 THEY'RE INTERESTED IN TOOLS AND 1844 01:13:10,320 --> 01:13:15,560 METHODS AND SHORT DURATION 1845 01:13:15,560 --> 01:13:19,880 TRAININGS CAN MOTIVATE SCIEN 1846 01:13:19,880 --> 01:13:22,480 SCIENTISTS TO TRY MORE THINGS 1847 01:13:22,480 --> 01:13:26,440 AND HAVE TO AVOID BURNOUT AND 1848 01:13:26,440 --> 01:13:36,920 INCLUDE THE WHOLE COMMUNITY. 1849 01:13:40,120 --> 01:13:40,840 >> THANK YOU. 1850 01:13:40,840 --> 01:13:42,720 THAT WAS TERRIFIC. 1851 01:13:42,720 --> 01:13:47,240 THE NEXT SPEAKER IS ANNA HATCH 1852 01:13:47,240 --> 01:13:49,160 AND WE'RE PICKING UP TIME AND 1853 01:13:49,160 --> 01:13:55,080 WE'LL HAVE OUR QUESTIONS IN THE 1854 01:13:55,080 --> 01:13:55,720 PLENARY DISCUSSION AFTER ALL THE 1855 01:13:55,720 --> 01:14:05,880 SPEAKERS. 1856 01:14:14,400 --> 01:14:16,800 >> THANK YOU FOR THE KIND 1857 01:14:16,800 --> 01:14:21,760 INVITATION AND THE PROGRAM 1858 01:14:21,760 --> 01:14:24,080 DIRECTOR FOR RESEARCH ASSESSMENT 1859 01:14:24,080 --> 01:14:30,600 IT'S A LONG NAME SO WE CALL IT 1860 01:14:30,600 --> 01:14:34,000 DORA FOR SHORT AND WE FOCUS ON 1861 01:14:34,000 --> 01:14:34,800 RESEARCH ASSESSMENT. 1862 01:14:34,800 --> 01:14:36,720 THAT'S THE LENS WITH WHICH I'M 1863 01:14:36,720 --> 01:14:38,480 GOING TO TAKE MY DISCUSSION 1864 01:14:38,480 --> 01:14:39,480 TODAY BECAUSE THAT'S MOST OF 1865 01:14:39,480 --> 01:14:43,680 WHAT I'M FAMILIAR WITH THE 1866 01:14:43,680 --> 01:14:44,960 REWARD AND RECOGNITION SYSTEM. 1867 01:14:44,960 --> 01:14:46,960 TO SITUATE THIS TALK WHAT I WANT 1868 01:14:46,960 --> 01:14:51,320 TO DO IS TO FIRST ACKNOWLEDGE 1869 01:14:51,320 --> 01:14:54,200 THE EXISTING TENSION BETWEEN THE 1870 01:14:54,200 --> 01:14:56,520 REWARD AND THE SYSTEM AND 1871 01:14:56,520 --> 01:14:59,600 ACADEMIA RIGHT NOW THAT PUSHES 1872 01:14:59,600 --> 01:15:04,000 INSTITUTIONS TOWARDS PRESTIGE 1873 01:15:04,000 --> 01:15:05,640 AND RECOGNITION THINK UNIVERSITY 1874 01:15:05,640 --> 01:15:10,040 RANKING AND IMPACT FACTOR AND 1875 01:15:10,040 --> 01:15:14,320 HOW THAT'S INTENTION OR CAUSES 1876 01:15:14,320 --> 01:15:15,720 ATTENTION WITH PROMOTING 1877 01:15:15,720 --> 01:15:18,200 RESEARCH RIGOR AND INSTILLING 1878 01:15:18,200 --> 01:15:19,600 TRUST AND CONFIDENCE IN FINDINGS 1879 01:15:19,600 --> 01:15:25,000 OF OUR RESEARCH STUDY. 1880 01:15:25,000 --> 01:15:27,960 AND THAT BEGS THE NEXT QUESTION 1881 01:15:27,960 --> 01:15:30,760 HOW WE THEN SHIFT WHAT IS 1882 01:15:30,760 --> 01:15:34,000 VISIBLE IN ACADEMIA TO PROMOTE 1883 01:15:34,000 --> 01:15:38,120 RESEARCH RIGOR AND HOW DO 1884 01:15:38,120 --> 01:15:39,240 MOTIVATIONS INFLUENCE THIS AND 1885 01:15:39,240 --> 01:15:42,440 WE WERE TOLD TO REFLECT ON OUR 1886 01:15:42,440 --> 01:15:43,160 PERSONAL EXPERIENCES. 1887 01:15:43,160 --> 01:15:45,720 DORA IS A NON-PROFIT 1888 01:15:45,720 --> 01:15:46,600 INTERNATIONAL INITIATIVE TO 1889 01:15:46,600 --> 01:15:48,280 IMPROVE THE WAY RESEARCH IS 1890 01:15:48,280 --> 01:15:49,320 ASSESSED FOR DECISIONS THAT 1891 01:15:49,320 --> 01:15:53,280 AFFECT ACADEMIC CAREERS AND ALSO 1892 01:15:53,280 --> 01:15:54,880 GRANTS EVALUATION. 1893 01:15:54,880 --> 01:15:57,120 IN DOING THIS WE WORK WITH A LOT 1894 01:15:57,120 --> 01:15:59,520 OF ACADEMIC STAKEHOLDERS. 1895 01:15:59,520 --> 01:16:00,400 RESEARCH INSTITUTIONS AND 1896 01:16:00,400 --> 01:16:04,800 RESEARCH FUNDERS AND RESEARCHERS 1897 01:16:04,800 --> 01:16:05,760 THEMSELVES, PUBLISHERS AND SO 1898 01:16:05,760 --> 01:16:07,120 TODAY I'LL BE SHARING SOME 1899 01:16:07,120 --> 01:16:09,600 LEARNINGS I'VE PICKED UP FROM 1900 01:16:09,600 --> 01:16:11,800 INTERACTING WITH ALL THE 1901 01:16:11,800 --> 01:16:15,040 DIFFERENT STAKEHOLDER GROUPS. 1902 01:16:15,040 --> 01:16:19,560 SO FIRST OFF I THINK WHAT MAKES 1903 01:16:19,560 --> 01:16:20,240 ASSESSMENT PERFORM DIFFICULT TO 1904 01:16:20,240 --> 01:16:24,960 SOLVE AND BRINGING THIS BACK TO 1905 01:16:24,960 --> 01:16:27,000 MOTIVATIONS, THE SYSTEM'S 1906 01:16:27,000 --> 01:16:28,440 CHALLENGE THAT INVOLVE MULTIPLE 1907 01:16:28,440 --> 01:16:28,760 STAKEHOLDERS. 1908 01:16:28,760 --> 01:16:33,680 MANY OF THEM ARE THE ONES THAT I 1909 01:16:33,680 --> 01:16:34,720 JUST LISTED. 1910 01:16:34,720 --> 01:16:40,000 BUT THE TRICKY PART HERE IS THAT 1911 01:16:40,000 --> 01:16:42,280 EACH STAKEHOLDER HAS DIFFERENT 1912 01:16:42,280 --> 01:16:43,800 MOTIVATIONS AND SOMETIMES 1913 01:16:43,800 --> 01:16:46,400 THEY'RE CONFLICTING WHICH IS WHY 1914 01:16:46,400 --> 01:16:50,360 YOU'RE NOT GOING TO SEE SINGLE 1915 01:16:50,360 --> 01:16:51,720 INTERVENTIONS REALLY BE 1916 01:16:51,720 --> 01:16:53,520 EFFECTIVE FORM OF CULTURE CHANGE 1917 01:16:53,520 --> 01:16:56,360 BECAUSE INSTEAD IT RELIES ON 1918 01:16:56,360 --> 01:16:59,040 CHANGING UNDERLYING CULTURE AND 1919 01:16:59,040 --> 01:17:00,240 CONDITIONS AND INFRASTRUCTURE 1920 01:17:00,240 --> 01:17:01,040 AND REALLY REQUIRES A 1921 01:17:01,040 --> 01:17:06,760 COLLABORATIVE APPROACH. 1922 01:17:06,760 --> 01:17:09,760 SO I'M NOT GOING TO DWELL ON 1923 01:17:09,760 --> 01:17:11,800 THIS POINT BECAUSE IT DOES TIE 1924 01:17:11,800 --> 01:17:14,400 INTO MOTIVATIONS THOUGH NOT 1925 01:17:14,400 --> 01:17:15,800 DIRECTLY BUT WHEN TRYING TO 1926 01:17:15,800 --> 01:17:19,440 UNDERSTAND MOTIVATIONS IT'S ALSO 1927 01:17:19,440 --> 01:17:23,000 REALLY IMPORTANT TO EXAMINE THE 1928 01:17:23,000 --> 01:17:23,400 POWER DYNAMICS. 1929 01:17:23,400 --> 01:17:25,360 WHO HAS POWER WITHIN THE SYSTEM 1930 01:17:25,360 --> 01:17:27,800 AND WHO DOESN'T HAVE POWER 1931 01:17:27,800 --> 01:17:29,160 WITHIN THE SYSTEM AND HOW MIGHT 1932 01:17:29,160 --> 01:17:33,120 THAT BE PREVENTING CHANGE FROM 1933 01:17:33,120 --> 01:17:34,600 GOING FORWARD. 1934 01:17:34,600 --> 01:17:36,520 SO THIS IS ONE OF THE FIRST 1935 01:17:36,520 --> 01:17:38,360 STEPS WE TRY TO TAKE WHEN 1936 01:17:38,360 --> 01:17:41,640 THINKING ABOUT CREATING CHANGE. 1937 01:17:41,640 --> 01:17:42,800 SO NOW MORE TOWARDS THE MEAT OF 1938 01:17:42,800 --> 01:17:46,200 THE TALK WHICH IS WHAT INSPIRES 1939 01:17:46,200 --> 01:17:49,320 ORGANIZATIONS TO ACT ON 1940 01:17:49,320 --> 01:17:51,000 ASSESSMENT REFORM? 1941 01:17:51,000 --> 01:17:54,240 SO DORA STARTED OUT AS A 1942 01:17:54,240 --> 01:17:56,360 DECLARATION IN 2013 FOR 1943 01:17:56,360 --> 01:17:59,240 ORGANIZATIONS AND INDIVIDUALS 1944 01:17:59,240 --> 01:18:02,360 CONSIGN TO COMMIT TO PROMOTING 1945 01:18:02,360 --> 01:18:04,000 RESPONSIBLE RESEARCH ASSESSMENT. 1946 01:18:04,000 --> 01:18:07,440 I WAS HIRED IN 2017 AND THIS IS 1947 01:18:07,440 --> 01:18:12,200 A TIPPING POINT IN DORA WHERE WE 1948 01:18:12,200 --> 01:18:17,360 WENT FROM A DECLARATION TO 1949 01:18:17,360 --> 01:18:19,400 PROMOTING RESPONSIBLE RESEARCH 1950 01:18:19,400 --> 01:18:20,720 ASSESSMENT AND THAT WAS DONE 1951 01:18:20,720 --> 01:18:25,840 AFTER THE DECLARATION GATHERED A 1952 01:18:25,840 --> 01:18:28,440 LOT OF ATTENTION AND FAMOUS FOR 1953 01:18:28,440 --> 01:18:31,760 CALLING OUT A TOOL FOR RESEARCH 1954 01:18:31,760 --> 01:18:35,880 ASSESSMENT AND THERE WERE 1955 01:18:35,880 --> 01:18:36,960 SIGNATURES IT WASN'T LEADING TO 1956 01:18:36,960 --> 01:18:38,880 THE WIDESPREAD CHANGE THE 1957 01:18:38,880 --> 01:18:40,360 AUTHORS HOPED TO SEE. 1958 01:18:40,360 --> 01:18:43,200 THIS SWITCH WAS IN PART TO START 1959 01:18:43,200 --> 01:18:45,760 TO CHIP AWAY AT BUILDING THE 1960 01:18:45,760 --> 01:18:46,360 CULTURE OF RESPONSIVE RESEARCH 1961 01:18:46,360 --> 01:18:50,760 ASSESSMENT. 1962 01:18:50,760 --> 01:18:53,840 SO THE THREE BIG THINGS THAT I 1963 01:18:53,840 --> 01:18:55,360 LEARNED SINCE BEING WITH DORA 1964 01:18:55,360 --> 01:18:58,480 SINCE 2017 WAS THE IMPORTANCE OF 1965 01:18:58,480 --> 01:19:02,080 FACILITATING KNOWLEDGE SHARING 1966 01:19:02,080 --> 01:19:02,560 WITHIN THE COMMUNITY. 1967 01:19:02,560 --> 01:19:05,640 SO DIFFERENT WAYS WE DO THIS IS 1968 01:19:05,640 --> 01:19:07,760 PRIMARILY THROUGH THE WEBSITE 1969 01:19:07,760 --> 01:19:10,120 WHICH ACTS AS A HUB OF 1970 01:19:10,120 --> 01:19:10,440 INFORMATION. 1971 01:19:10,440 --> 01:19:11,760 WE HAVE OUR RESOURCE LABORATORY 1972 01:19:11,760 --> 01:19:14,760 AND HAVE A COLLECTION OF CASE 1973 01:19:14,760 --> 01:19:16,040 STUDIES I'LL DIVE INTO AND OUR 1974 01:19:16,040 --> 01:19:20,400 CASE STUDY REPOSITORY IS A 1975 01:19:20,400 --> 01:19:21,160 COLLABORATION WITH THE 1976 01:19:21,160 --> 01:19:24,360 UNIVERSITY ASSOCIATION AND SPARK 1977 01:19:24,360 --> 01:19:26,760 EUROPE AND WHEN WE CREATED THIS 1978 01:19:26,760 --> 01:19:30,400 THE MAIN IDEA WAS WE KNEW GOOD 1979 01:19:30,400 --> 01:19:32,040 PRACTICE EXISTED. 1980 01:19:32,040 --> 01:19:34,640 WE DIDN'T KNOW HOW IT CAME TO 1981 01:19:34,640 --> 01:19:34,880 BE. 1982 01:19:34,880 --> 01:19:37,680 SO THIS WAS REALLY TO 1983 01:19:37,680 --> 01:19:40,960 INTERROGATE KEY ASPECTS OF 1984 01:19:40,960 --> 01:19:41,480 INSTITUTIONAL CHANGE. 1985 01:19:41,480 --> 01:19:43,680 ONE OF THOSE BEING MOTIVATIONS 1986 01:19:43,680 --> 01:19:47,600 SO WHAT IS CAUSING INSTITUTIONS 1987 01:19:47,600 --> 01:19:49,520 TO ACT ON RESPONSIBLE RESEARCH 1988 01:19:49,520 --> 01:19:49,800 ASSESSMENT? 1989 01:19:49,800 --> 01:19:52,200 I'LL WALK THROUGH A COUPLE OF 1990 01:19:52,200 --> 01:19:56,920 EXAMPLES FROM THE MOTIVATION 1991 01:19:56,920 --> 01:19:57,480 SECTION. 1992 01:19:57,480 --> 01:20:01,520 SO EMBL OVER IN EUROPE, ONE 1993 01:20:01,520 --> 01:20:03,120 THING THAT PROMPTED THE RESEARCH 1994 01:20:03,120 --> 01:20:08,320 ASSESSMENT REFORM HAPPENING AT 1995 01:20:08,320 --> 01:20:10,640 THEIR INSTITUTION WAS A GROWING 1996 01:20:10,640 --> 01:20:12,760 RECOGNITION TO FULFILL THEIR 1997 01:20:12,760 --> 01:20:15,480 MISSION THEY NEEDED TO FOCUS ON 1998 01:20:15,480 --> 01:20:18,960 TRAINING AND LOOKING AT THAT IN 1999 01:20:18,960 --> 01:20:19,560 ASSESSMENT. 2000 01:20:19,560 --> 01:20:20,360 THEY RECOGNIZED THAT THEIR 2001 01:20:20,360 --> 01:20:22,240 MISSION WAS OUT OF ALIGNMENT 2002 01:20:22,240 --> 01:20:24,440 WITH HOW THEY WERE DOING 2003 01:20:24,440 --> 01:20:28,240 RESEARCH ASSESSMENT AND WANTING 2004 01:20:28,240 --> 01:20:30,280 TO PUT THAT BACK INTO THERE. 2005 01:20:30,280 --> 01:20:33,600 THE SECOND EXAMPLE I WANT TO 2006 01:20:33,600 --> 01:20:37,240 SHOW YOU FROM A UNIVERSITY IN 2007 01:20:37,240 --> 01:20:40,640 BELGIUM AND HERE WHAT THEY 2008 01:20:40,640 --> 01:20:44,440 NOTICED WAS THEIR MOTIVATION WAS 2009 01:20:44,440 --> 01:20:47,800 RECOGNITION OF THIS AND HOW THAT 2010 01:20:47,800 --> 01:20:50,480 WAS LIMITING THEIR ABILITY TO 2011 01:20:50,480 --> 01:20:55,800 LOOK AT NEW OPPORTUNITIES FOR 2012 01:20:55,800 --> 01:21:00,840 INTERDISCIPLINARY RESEARCH. 2013 01:21:00,840 --> 01:21:03,360 THIS LED TO A WIRED DEBATE ABOUT 2014 01:21:03,360 --> 01:21:05,560 THE EVALUATION OF THE RESEARCH. 2015 01:21:05,560 --> 01:21:13,800 THESE A FEW EXAMPLES AND 2016 01:21:13,800 --> 01:21:16,040 LESSONS LEARNED ARE MOTIVATIONS 2017 01:21:16,040 --> 01:21:18,400 COMING FROM PLACES WHERE 2018 01:21:18,400 --> 01:21:19,920 ACKNOWLEDGING SOMETHING'S NOT 2019 01:21:19,920 --> 01:21:23,400 QUITE RIGHT WITH THE SYSM AND 2020 01:21:23,400 --> 01:21:27,360 ALSO RECOGNIZING THAT WE WANT TO 2021 01:21:27,360 --> 01:21:30,040 REWARD SOMETHING NEW IN SOME 2022 01:21:30,040 --> 01:21:33,600 CASES A LOT OF IT IS AROUND OPEN 2023 01:21:33,600 --> 01:21:36,000 SCIENCE AND ALSO ABOUT HOW CAN 2024 01:21:36,000 --> 01:21:38,320 WE BRING PARITY FOR EVALUATING 2025 01:21:38,320 --> 01:21:40,440 TEACHING AND MENTORSHIP ALONG 2026 01:21:40,440 --> 01:21:43,520 WITH RESEARCH AND INNOVATION. 2027 01:21:43,520 --> 01:21:47,680 SO THESE ARE SOME OF THE 2028 01:21:47,680 --> 01:21:50,240 INSTITUTIONAL MOTIVATIONS WE'VE 2029 01:21:50,240 --> 01:21:53,280 SEEN AND NOW THE SECOND THING WE 2030 01:21:53,280 --> 01:21:55,640 WORKED ON SO FACILITATING 2031 01:21:55,640 --> 01:21:57,640 KNOWLEDGE SHARING BUT THEN 2032 01:21:57,640 --> 01:22:00,040 FINDING COMMON INTERESTS. 2033 01:22:00,040 --> 01:22:05,680 SO BRINGING GROUPS TOGETHER AND 2034 01:22:05,680 --> 01:22:07,600 REALLY PROMOTING RESEARCH 2035 01:22:07,600 --> 01:22:11,800 ASSESSMENT REFORM LIKE RIGOR IS 2036 01:22:11,800 --> 01:22:15,400 A WIDE TOPIC AND ARE THERE BITS 2037 01:22:15,400 --> 01:22:16,760 AND PIECES PEOPLE CAN AGREE ON 2038 01:22:16,760 --> 01:22:17,280 AND WORK TOGETHER. 2039 01:22:17,280 --> 01:22:19,360 AN EXAMPLE OF WHAT WE'VE DONE 2040 01:22:19,360 --> 01:22:21,840 WITH THIS AT DORA IS REALLY 2041 01:22:21,840 --> 01:22:23,680 USING THESE COMMON INTERESTS TO 2042 01:22:23,680 --> 01:22:24,440 INSPIRE ACTION. 2043 01:22:24,440 --> 01:22:27,680 SO ONE OF OUR COMMUNITIES OF 2044 01:22:27,680 --> 01:22:32,320 PRACTICE IS A GROUP OF RESEARCH 2045 01:22:32,320 --> 01:22:34,400 FUNDERS FROM AROUND THE WORLD 2046 01:22:34,400 --> 01:22:36,840 AND THEY MEET EVERY QUARTER TO 2047 01:22:36,840 --> 01:22:37,720 DISCUSS REFORMS THEY'VE BEEN 2048 01:22:37,720 --> 01:22:39,320 DOING AT THE ORGANIZATIONS AND 2049 01:22:39,320 --> 01:22:42,240 WHAT'S BEEN WORKING AND WHAT 2050 01:22:42,240 --> 01:22:44,160 HASN'T AND THROUGH THESE 2051 01:22:44,160 --> 01:22:49,360 DISCUSSIONS WE CAME TO HEAR THAT 2052 01:22:49,360 --> 01:22:50,600 THE APPROACH OF ASSESSMENT KEPT 2053 01:22:50,600 --> 01:22:52,720 COMING UP IN THE CONVERSATION. 2054 01:22:52,720 --> 01:22:57,560 THIS WAS A COMMUNITY-LED EFFORT 2055 01:22:57,560 --> 01:23:01,360 TO EXAMINE THE NARRATIVE AND WE 2056 01:23:01,360 --> 01:23:02,520 WERE ABLE TO MOTIVATE CHANGE AND 2057 01:23:02,520 --> 01:23:04,880 INSPIRE ACTION. 2058 01:23:04,880 --> 01:23:07,680 THE LAST THING IS BUILDING AND 2059 01:23:07,680 --> 01:23:12,440 SUPPORTING COMMUNITIES OF 2060 01:23:12,440 --> 01:23:16,120 PRACTICE. 2061 01:23:16,120 --> 01:23:17,080 FACILITATING KNOWLEDGE SHARING 2062 01:23:17,080 --> 01:23:20,320 AND ALL FIT INTO HOW CAN WE 2063 01:23:20,320 --> 01:23:22,280 SUPPORT COMMUNITIES OF PRACTICE. 2064 01:23:22,280 --> 01:23:23,680 ANOTHER WAY WE'RE TRYING TO DO 2065 01:23:23,680 --> 01:23:26,320 THIS IS THROUGH OUR COMMUNITY 2066 01:23:26,320 --> 01:23:27,440 ENGAGEMENT GRANT. 2067 01:23:27,440 --> 01:23:30,560 THESE ARE MICROGRANTS GIVEN TO 2068 01:23:30,560 --> 01:23:32,760 MEMBERS OF THE COMMUNITY TO SPUR 2069 01:23:32,760 --> 01:23:35,600 THEM TO DEVELOP WHAT WORKS FOR 2070 01:23:35,600 --> 01:23:36,880 THEM FOR RESPONSIBLE ASSESSMENT 2071 01:23:36,880 --> 01:23:38,080 PRACTICES AND SHARE THAT BACK 2072 01:23:38,080 --> 01:23:38,960 OUT WITH THE REST OF THE DORA 2073 01:23:38,960 --> 01:23:41,920 COMMUNITY. 2074 01:23:41,920 --> 01:23:43,520 AND THAT'S A LITTLE BIT OF WHAT 2075 01:23:43,520 --> 01:23:44,320 WE'VE BEEN DOING. 2076 01:23:44,320 --> 01:23:45,880 A LITTLE BIT ABOUT WHAT WE'VE 2077 01:23:45,880 --> 01:23:46,960 LEARNED FOR MOTIVATIONS. 2078 01:23:46,960 --> 01:23:47,760 THANK YOU AND I LOOK FORWARD TO 2079 01:23:47,760 --> 01:23:57,960 QUESTIONS. 2080 01:24:01,160 --> 01:24:02,240 >> THANK YOU, DR. HATCH. 2081 01:24:02,240 --> 01:24:04,040 THAT WAS OUTSTANDING. 2082 01:24:04,040 --> 01:24:05,440 OUR NEXT SPEAKER AND LAST 2083 01:24:05,440 --> 01:24:06,520 SPEAKER FOR THIS SESSION BEFORE 2084 01:24:06,520 --> 01:24:08,520 WE TAKE A BREAK AND THEN GO INTO 2085 01:24:08,520 --> 01:24:10,880 OUR PLENARY SESSION WHERE WE'RE 2086 01:24:10,880 --> 01:24:13,520 HOPING ALL OF YOU WILL ASK 2087 01:24:13,520 --> 01:24:17,640 CONCISIVE AND CHALLENGING AND 2088 01:24:17,640 --> 01:24:19,640 THOUGHT-PROVOKING QUESTIONS WILL 2089 01:24:19,640 --> 01:24:20,480 BE DR. MALCOLM MACLEOD. 2090 01:24:20,480 --> 01:24:26,560 WELCOME. 2091 01:24:26,560 --> 01:24:28,120 >> THANK YOU. 2092 01:24:28,120 --> 01:24:28,600 VERY MUCH. 2093 01:24:28,600 --> 01:24:30,920 I FEEL THIS MUST BE LIKE WHAT 2094 01:24:30,920 --> 01:24:33,200 FRANK SINATRA FELT LIKE WHEN HE 2095 01:24:33,200 --> 01:24:35,960 CAME OUT OF RETIREMENT. 2096 01:24:35,960 --> 01:24:36,680 IT'S GOOD TO BE BACK. 2097 01:24:36,680 --> 01:24:42,680 THANK YOU FOR HAVING ME. 2098 01:24:42,680 --> 01:24:46,320 SO MY BACKGROUND I'M A CLINICAL 2099 01:24:46,320 --> 01:24:47,680 NEUROLOGIST AND INTERESTED WITH 2100 01:24:47,680 --> 01:24:49,960 WALTER KOROSHETZ AND HOW WE 2101 01:24:49,960 --> 01:24:50,840 DEVELOP DRUGS FOR STROKE AND 2102 01:24:50,840 --> 01:24:53,400 ATTEMPT TO UNDERSTAND WHY IT 2103 01:24:53,400 --> 01:24:57,440 FAILED SO MISERABLY AND I'M THE 2104 01:24:57,440 --> 01:25:02,680 ACADEMIC LEAD FOR RESEARCH 2105 01:25:02,680 --> 01:25:05,200 INTEGRITY AT THE UNIVERSITY OF 2106 01:25:05,200 --> 01:25:06,840 EDINBURGH AND I SHOULD SAY 2107 01:25:06,840 --> 01:25:09,520 ANYTHING HOW I SAY ABOUT 2108 01:25:09,520 --> 01:25:11,600 INSTITUTIONS BEHAVE HAS NOT 2109 01:25:11,600 --> 01:25:13,200 NECESSARILY BEEN DRAWN FROM MY 2110 01:25:13,200 --> 01:25:14,280 OWN PERSONAL EXPERIENCE OF MY 2111 01:25:14,280 --> 01:25:15,920 OWN INSTITUTION AND MY SLIDES 2112 01:25:15,920 --> 01:25:19,520 ARE AVAILABLE IN THE OPEN 2113 01:25:19,520 --> 01:25:19,920 SCIENCE FRAMEWORK. 2114 01:25:19,920 --> 01:25:21,040 SO WHAT MIGHT BE DRIVING I THINK 2115 01:25:21,040 --> 01:25:23,840 WE ALL KNOW THERE'S A PROBLEM 2116 01:25:23,840 --> 01:25:25,240 BUT WHAT MIGHT BE DRIVING THE 2117 01:25:25,240 --> 01:25:25,960 PROBLEM? 2118 01:25:25,960 --> 01:25:27,520 FIRST I THINK THERE'S FOUR 2119 01:25:27,520 --> 01:25:29,400 CATEGORIES OF THINGS WE MIGHT 2120 01:25:29,400 --> 01:25:31,920 WORRY ABOUT. 2121 01:25:31,920 --> 01:25:34,400 FIRST A CLAIM MAY BE MADE ON A 2122 01:25:34,400 --> 01:25:35,080 TYPE 1 STATISTICAL ERROR AND 2123 01:25:35,080 --> 01:25:45,640 THERE'S A 5% CHANCE SWEET THE 2124 01:25:45,640 --> 01:25:48,640 FALSE POSITIVE AND WE MAY HAVE 2125 01:25:48,640 --> 01:25:49,840 MADE A CLAIM MADE UNDER WHICH 2126 01:25:49,840 --> 01:25:53,240 WAS VALID UNDER THE PARTICULAR 2127 01:25:53,240 --> 01:25:54,840 CIRCUMSTANCE UNDER WHICH IT WAS 2128 01:25:54,840 --> 01:25:56,600 TESTED BUT NOT OBSERVED IN THE 2129 01:25:56,600 --> 01:25:58,760 CIRCUMSTANCES AND THE 2130 01:25:58,760 --> 01:25:59,960 OBSERVATIONS MAY HAVE BEEN DUE 2131 01:25:59,960 --> 01:26:02,320 TO PEOPLE DOING WONKY STUDIES 2132 01:26:02,320 --> 01:26:05,800 AND MAY NOT HAVE BLIND IT AND 2133 01:26:05,800 --> 01:26:09,400 MAY HAVE EMERGED THE BIAS OR 2134 01:26:09,400 --> 01:26:10,880 PEOPLE HYPOTHESIZING AFTER THE 2135 01:26:10,880 --> 01:26:12,680 RESULTS ARE KNOWN. 2136 01:26:12,680 --> 01:26:14,560 THESE ARE QUESTIONABLE RESEARCH 2137 01:26:14,560 --> 01:26:17,240 PRACTICES BUT I THINK THEY HAVE 2138 01:26:17,240 --> 01:26:19,640 VARYING DEGREES OF RESEARCH AND 2139 01:26:19,640 --> 01:26:23,680 CULPABILITY AND MAY FOURTH THE 2140 01:26:23,680 --> 01:26:30,120 RESEARCH CHAI HAVE BEEN MADE UP 2141 01:26:30,120 --> 01:26:31,640 OR FALSIFIED AND WE HAVE 2142 01:26:31,640 --> 01:26:34,080 HISTORICALLY FOCUSSED ON THIS 2143 01:26:34,080 --> 01:26:35,480 AND THOUGHT HOW DO WE SORT THE 2144 01:26:35,480 --> 01:26:37,600 BAD GUYS BUT I DON'T THINK THOSE 2145 01:26:37,600 --> 01:26:41,800 ARE WHERE THE MAIN BENEFITS ARE 2146 01:26:41,800 --> 01:26:44,280 TO BE HAD BECAUSE THERE'S 2147 01:26:44,280 --> 01:26:48,240 INTEGRITY OF THE CLAIM AND ISSAY 2148 01:26:48,240 --> 01:26:58,320 QUESTION OF RESEARCHER INTEG 2149 01:26:58,320 --> 01:26:58,840 INTEGRITY. 2150 01:26:58,840 --> 01:26:59,920 SOME OBSERVATIONS TO PROGRESS 2151 01:26:59,920 --> 01:27:01,880 CHANGE WITHIN AN ORGANIZATION 2152 01:27:01,880 --> 01:27:04,120 THERE'S A HUGE AMOUNT OF 2153 01:27:04,120 --> 01:27:05,800 HETEROGENEITY AND I USED TO LOOK 2154 01:27:05,800 --> 01:27:08,360 AT THE WELCOME TRUST AT NIH 2155 01:27:08,360 --> 01:27:09,440 THEY'RE LIKE THAT BUT THEY'RE 2156 01:27:09,440 --> 01:27:11,560 NOT BECAUSE THEY'RE FILLED OF 2157 01:27:11,560 --> 01:27:14,000 INDIVIDUALS WITH A SLIGHTLY 2158 01:27:14,000 --> 01:27:15,480 DIFFERENT TAKES AND SOME TAKE 2159 01:27:15,480 --> 01:27:16,920 MAY BE EVERYTHING'S DANDY OR WE 2160 01:27:16,920 --> 01:27:18,920 CAN ALWAYS DO BETTER BUT THERE'S 2161 01:27:18,920 --> 01:27:20,120 NO GREAT PROBLEM. 2162 01:27:20,120 --> 01:27:22,160 THERE'S A HUGE PROBLEM BUT WE'RE 2163 01:27:22,160 --> 01:27:24,720 FIXING IT, TRUST US. 2164 01:27:24,720 --> 01:27:28,760 WE HAVE NO IDEA HOW TO FIX IT. 2165 01:27:28,760 --> 01:27:30,000 SOME PEOPLE MIGHT ARGUE WELL 2166 01:27:30,000 --> 01:27:31,600 MAYBE YOU SAY WE'VE GOT A 2167 01:27:31,600 --> 01:27:35,600 PROBLEM BUT OUR STAKEHOLDERS ARE 2168 01:27:35,600 --> 01:27:37,320 HAPPY AND THE GRANT INCOME'S 2169 01:27:37,320 --> 01:27:39,840 COMING IN, WHY SHOULD WE ROCK 2170 01:27:39,840 --> 01:27:42,800 THE BOAT OR KILL THE GOOSE 2171 01:27:42,800 --> 01:27:47,040 LAYING THE GOLDEN EGG OR IF YOU 2172 01:27:47,040 --> 01:27:48,280 THINK THINGS ARE BAD FROM WHERE 2173 01:27:48,280 --> 01:27:51,600 YOUR SITTING YOU SHOULD SEE IT 2174 01:27:51,600 --> 01:27:52,880 FROM THE INSIDE TRACK AND THAT'S 2175 01:27:52,880 --> 01:27:57,040 WHY I GET FRIGHTENED AND WE NEED 2176 01:27:57,040 --> 01:27:58,800 TO THI HOW TO ADDRESS THESE 2177 01:27:58,800 --> 01:28:04,040 BECAUSE WE HAVE A PERSUADING JOB 2178 01:28:04,040 --> 01:28:05,240 TO DO ABOUT THE CHANGE. 2179 01:28:05,240 --> 01:28:10,720 I WANT TO INTRODUCE YOU TO THE 2180 01:28:10,720 --> 01:28:12,560 ITALIAN COMMUNIST ACTIVE IN 2181 01:28:12,560 --> 01:28:16,720 MILLAN IN THE 1920s AND HE WAS 2182 01:28:16,720 --> 01:28:19,480 ARGUING HOW TO INTRODUCE 2183 01:28:19,480 --> 01:28:20,880 COMMUNISM AND THE INEVITABLE 2184 01:28:20,880 --> 01:28:22,000 COLLAPSE OF CAPITALISM AND WE'RE 2185 01:28:22,000 --> 01:28:23,600 TRYING DO MUCH THE SAME HERE 2186 01:28:23,600 --> 01:28:26,840 AREN'T WE AND TALKED ABOUT A WAR 2187 01:28:26,840 --> 01:28:31,240 OF POSITION BY ANTONIO GRAMSCI 2188 01:28:31,240 --> 01:28:34,320 AND THERE'S BASIS OF 2189 01:28:34,320 --> 01:28:35,560 SELF-ORGANIZED SIGNIFICANT 2190 01:28:35,560 --> 01:28:40,320 NETWORKS WITH A CLEAR VISION OF 2191 01:28:40,320 --> 01:28:41,320 CHANGE AND WAR OF MANEUVER IS 2192 01:28:41,320 --> 01:28:43,560 THE STRUGGLE OF FORCE, SLUGGING 2193 01:28:43,560 --> 01:28:45,760 IT OUT IN COMMITTEES AND FUNDING 2194 01:28:45,760 --> 01:28:49,240 PANELS AND ON THE BARRICADES AND 2195 01:28:49,240 --> 01:28:50,240 IT'S BETTER THAT IT NEVER COMES 2196 01:28:50,240 --> 01:28:53,800 TO THE USE OF FORCE BUT TO AVOID 2197 01:28:53,800 --> 01:28:57,160 THIS THE THREAT OF FORCE AND 2198 01:28:57,160 --> 01:28:59,240 COERCION NEEDS TO BE REAL AND 2199 01:28:59,240 --> 01:29:00,600 TANGIBLE AND FELT BY THOSE WHO 2200 01:29:00,600 --> 01:29:11,080 MIGHT SEEK TO OPPOSE CHANGE. 2201 01:29:12,080 --> 01:29:15,440 WE'RE LOOKING AT THE SCALE OF 2202 01:29:15,440 --> 01:29:17,200 THE PROBLEM AND POTENTIAL 2203 01:29:17,200 --> 01:29:18,480 CONSEQUENCES OF DOING SOMETHING 2204 01:29:18,480 --> 01:29:22,760 AND POTENTIAL BENEFITS OF DOING 2205 01:29:22,760 --> 01:29:23,440 SOMETHING. 2206 01:29:23,440 --> 01:29:25,800 AND THOSE ARE THE ARGUMENTS 2207 01:29:25,800 --> 01:29:27,600 WE'RE HAVING AND ESSENTIALLY 2208 01:29:27,600 --> 01:29:30,120 IT'S A RISK MANAGEMENT STRATEGY 2209 01:29:30,120 --> 01:29:31,560 FOR THE UNIVERSITY AND YOU NEED 2210 01:29:31,560 --> 01:29:33,480 TO DECIDE WHETHER YOU'RE 2211 01:29:33,480 --> 01:29:34,840 COMFORTABLE WITH THE RISK OR 2212 01:29:34,840 --> 01:29:35,320 SHOULD SEEK CHANGE. 2213 01:29:35,320 --> 01:29:38,040 SECOND OBJECTIVE, REASSURE 2214 01:29:38,040 --> 01:29:38,680 EVERYBODY ABOUT EVERYTHING ALL 2215 01:29:38,680 --> 01:29:39,560 THE TIME. 2216 01:29:39,560 --> 01:29:41,240 DON'T FRIGHTEN ANY HORSES. 2217 01:29:41,240 --> 01:29:42,880 NOTHING IS GOING TO HAPPEN HERE. 2218 01:29:42,880 --> 01:29:45,280 IT'S EVOLUTION NOT REVOLUTION. 2219 01:29:45,280 --> 01:29:46,840 WE'RE NOT TRYING TO RIP THE 2220 01:29:46,840 --> 01:29:49,960 HEART OUT OF OUR RESEARCH ECO 2221 01:29:49,960 --> 01:29:51,560 SYSTEMS AND BUILD THEM UP FROM 2222 01:29:51,560 --> 01:29:54,760 SCRATCH ACCORDING TO SOME 2223 01:29:54,760 --> 01:29:55,040 MANIFESTO. 2224 01:29:55,040 --> 01:29:56,720 IT'S A VALUES-LED PROCESS AND 2225 01:29:56,720 --> 01:29:58,600 THOSE VALUES ARE THE VALUES OF 2226 01:29:58,600 --> 01:30:00,680 OUR RESEARCH COMMUNITY. 2227 01:30:00,680 --> 01:30:04,320 WE'RE NOT IMPOSING SOMETHING 2228 01:30:04,320 --> 01:30:05,320 EXTERNALLY, WE'RE GIVING VOICE 2229 01:30:05,320 --> 01:30:10,440 TO WHAT THEY ASPIRE TO DO WITH 2230 01:30:10,440 --> 01:30:12,440 RESEARCH AND MANY HEARD OF THE 2231 01:30:12,440 --> 01:30:14,680 EXERCISE IN THE U.K. SOME IMPACT 2232 01:30:14,680 --> 01:30:18,400 CASE STUDIES WERE HIGHLY 2233 01:30:18,400 --> 01:30:19,560 EVALUATED, THANK YOU VERY MUCH 2234 01:30:19,560 --> 01:30:21,400 INDEED BUT THIS IS AN EXTERNAL 2235 01:30:21,400 --> 01:30:24,320 SET OF STANDARDS WITH LOCAL 2236 01:30:24,320 --> 01:30:25,680 DECISIONS ON THE PROCESS AND 2237 01:30:25,680 --> 01:30:29,560 OBJECTIVE AND HOW GRANULAR OUR 2238 01:30:29,560 --> 01:30:30,320 FOCUS WILL BE. 2239 01:30:30,320 --> 01:30:32,280 AND IN IMPORTANTLY, IF WE'RE 2240 01:30:32,280 --> 01:30:33,080 ABLE TO ARTICULATE AND DEVELOP 2241 01:30:33,080 --> 01:30:36,440 WAYS IN WHICH WE CAN INTRODUCE 2242 01:30:36,440 --> 01:30:37,840 AND IMPLEMENT INSTITUTIONAL 2243 01:30:37,840 --> 01:30:39,200 CHANGE WE HAVE MANY COLLEAGUES 2244 01:30:39,200 --> 01:30:41,360 ALSO INVOLVED IN EFFORTS TO 2245 01:30:41,360 --> 01:30:42,840 CHANGE STUCKSES WHO MIGHT WANT 2246 01:30:42,840 --> 01:30:45,520 TO JOIN WITH US IN ESTABLISHING 2247 01:30:45,520 --> 01:30:48,040 THOSE AND THIS IS ABOUT 2248 01:30:48,040 --> 01:30:50,280 IMPROVEMENT NOT ABOUT 2249 01:30:50,280 --> 01:30:55,880 ACCOUNTABILITY. 2250 01:30:55,880 --> 01:30:59,280 SEEK SUPPORT AND BUY-IN AND IF 2251 01:30:59,280 --> 01:31:02,080 YOU CAN GET BUY-IN MAKE THE TEST 2252 01:31:02,080 --> 01:31:07,160 SMALLER SO TRIVIAL NO ONE CAN 2253 01:31:07,160 --> 01:31:08,640 DISAGREE AND WE'RE TALKING ABOUT 2254 01:31:08,640 --> 01:31:08,880 RIGOR. 2255 01:31:08,880 --> 01:31:10,080 IF YOU THINK OF THE CHALLENGES 2256 01:31:10,080 --> 01:31:11,600 FOR INSTITUTIONS IN TERMS OF 2257 01:31:11,600 --> 01:31:14,440 EQUITY, DIVERSITY AND INCLUSION 2258 01:31:14,440 --> 01:31:16,440 IN TERMS OF THEIR RESEARCH 2259 01:31:16,440 --> 01:31:18,440 CULTURES MANY CHALLENGES THOSE 2260 01:31:18,440 --> 01:31:20,120 INDIVIDUALS FACE IN SEEKING TO 2261 01:31:20,120 --> 01:31:22,320 GET INSTITUTIONS TO CHANGE ARE 2262 01:31:22,320 --> 01:31:23,880 EXACTLY THE SAME AS OURS AND 2263 01:31:23,880 --> 01:31:25,280 IT'S IMPORTANT WE BUILD 2264 01:31:25,280 --> 01:31:26,280 ALLIANCES. 2265 01:31:26,280 --> 01:31:29,160 IF WE THINK THEN RESEARCHERS 2266 01:31:29,160 --> 01:31:31,200 MIGHT EXIST ALONG A SPECTRUM 2267 01:31:31,200 --> 01:31:32,760 WHAT I WOULD ARGUE IS WHAT 2268 01:31:32,760 --> 01:31:34,320 INSTITUTION HAVE SOUGHT TO DO 2269 01:31:34,320 --> 01:31:38,280 BEFORE IS IDENTIFY THOSE MOST 2270 01:31:38,280 --> 01:31:40,440 EGREGIOUS BEHAVIORS TO MARCH 2271 01:31:40,440 --> 01:31:41,720 INDIVIDUALS FROM THE PREMISES 2272 01:31:41,720 --> 01:31:44,000 FROM THEIR BELONGS PACKED IN A 2273 01:31:44,000 --> 01:31:46,080 CARDBOARD BOX PAUSING THEM TO 2274 01:31:46,080 --> 01:31:47,040 REMOVE THEIR CARD AND TELLING 2275 01:31:47,040 --> 01:31:49,160 THEM NEVER TO DARKEN OUR DOORS 2276 01:31:49,160 --> 01:31:52,280 AGAIN AND THE PROBLEM IS MY 2277 01:31:52,280 --> 01:31:53,280 INSTITUTION CHANGE EFFORTS 2278 01:31:53,280 --> 01:31:54,440 BECOME ASSOCIATED WITH BAD 2279 01:31:54,440 --> 01:31:55,400 THINGS AND WHEN THEY COME 2280 01:31:55,400 --> 01:31:58,680 KNOCKING ON THE DOOR IT'S NEVER 2281 01:31:58,680 --> 01:32:00,360 GOOD AND YOU WANT TO HIDE. 2282 01:32:00,360 --> 01:32:01,680 SO THINKING ABOUT THE 2283 01:32:01,680 --> 01:32:03,360 DISTRIBUTION OF BEHAVIORS, 2284 01:32:03,360 --> 01:32:06,160 THERE'S THAT APPROACH OF 2285 01:32:06,160 --> 01:32:07,560 ELIMINATING IT AND MAKES MORE 2286 01:32:07,560 --> 01:32:10,280 SENSE TO HAVE AN OBJECTIVE TO 2287 01:32:10,280 --> 01:32:15,600 HAVE EVERYONE GET A TINY A 2288 01:32:15,600 --> 01:32:18,560 LITTLE BIT BETTER LIKE IT WILL 2289 01:32:18,560 --> 01:32:21,080 DO MORE GOOD IF EVERYONE GETS 1% 2290 01:32:21,080 --> 01:32:24,080 BETTER THAN ELIMINATING THE MOST 2291 01:32:24,080 --> 01:32:27,640 10% OR 5% EGREGIOUS PRACTICES, 2292 01:32:27,640 --> 01:32:28,920 SMALL CHANGES AND MARGINAL GAINS 2293 01:32:28,920 --> 01:32:32,120 WITH THE CONFIDENCE OVER TIME 2294 01:32:32,120 --> 01:32:34,240 THE AGGREGATE EFFECT OF SEVERAL 2295 01:32:34,240 --> 01:32:35,200 MARGINAL GAINS WILL BE A BIGGER 2296 01:32:35,200 --> 01:32:36,840 CHANGE IN WHAT WE'RE DOING. 2297 01:32:36,840 --> 01:32:38,680 SO THIS IS ABOUT RESEARCH 2298 01:32:38,680 --> 01:32:39,960 IMPROVEMENT WHERE WE'RE FOCUSSED 2299 01:32:39,960 --> 01:32:44,320 ON SYSTEMS AND NOT INDIVIDUALS. 2300 01:32:44,320 --> 01:32:45,760 WHERE WHEN WE FIND FALLIBILITY 2301 01:32:45,760 --> 01:32:48,800 WE RECOGNIZE IT AND WE DON'T 2302 01:32:48,800 --> 01:32:53,800 HAVE THIS PERFECTION TOAV 2303 01:32:53,800 --> 01:32:56,320 POTENTIAL NOBEL PRIZE FINDERS 2304 01:32:56,320 --> 01:32:57,600 AND SOMETIMES HOW THINGS ARE 2305 01:32:57,600 --> 01:32:58,800 CHARACTERIZED AND WE RECOGNIZE 2306 01:32:58,800 --> 01:33:00,680 TEAM WORK AND IMPORTANTLY WHEN 2307 01:33:00,680 --> 01:33:03,680 WE IDENTIFY SHORT COMINGS WE SEE 2308 01:33:03,680 --> 01:33:04,520 THEM AS OPPORTUNITIES FOR 2309 01:33:04,520 --> 01:33:06,880 LEARNING AS AN INSTITUTION AND 2310 01:33:06,880 --> 01:33:08,120 OPPORTUNITIES TO IMPROVE 2311 01:33:08,120 --> 01:33:09,640 SYSTEMS, AS OPPORTUNITIES FOR 2312 01:33:09,640 --> 01:33:13,960 IMPROVEMENT NOT AS SHORT 2313 01:33:13,960 --> 01:33:14,160 COMINGS. 2314 01:33:14,160 --> 01:33:15,640 NOW, I WANT TO MOVE ON A LITTLE 2315 01:33:15,640 --> 01:33:19,040 BIT BECAUSE I'VE BEEN A BULLY 2316 01:33:19,040 --> 01:33:20,200 PULPIT AND HERE'S THE ISSUE. 2317 01:33:20,200 --> 01:33:22,120 WE HAVE INTERVENTION WE THINK 2318 01:33:22,120 --> 01:33:23,600 WILL IMPROVE THINGS. 2319 01:33:23,600 --> 01:33:27,240 IN MY ROLE AT EDINBURGH I'M 2320 01:33:27,240 --> 01:33:28,600 DESPERATE FOR INTERVENTIONS TO 2321 01:33:28,600 --> 01:33:31,000 IMPROVE THINGS BUT I CAN'T JUST 2322 01:33:31,000 --> 01:33:31,960 SAY LET'S DO THIS BECAUSE WE 2323 01:33:31,960 --> 01:33:33,960 NEED TO KNOW IF IT WORKS. 2324 01:33:33,960 --> 01:33:37,480 IF WE HAD A SYMPTOMOLOGY OF 2325 01:33:37,480 --> 01:33:43,120 KNOWING IF IT WORKED WOULD BE 2326 01:33:43,120 --> 01:33:43,720 GREAT. 2327 01:33:43,720 --> 01:33:48,120 HERE'S AN EXAMPLE THIS IS AN 2328 01:33:48,120 --> 01:33:52,000 AUDIT AND ESSENTIALLY THE BLUE 2329 01:33:52,000 --> 01:33:56,080 LINES YOU DON'T NEED THIS 2330 01:33:56,080 --> 01:34:01,560 PASSAGE AND I CAN'T REMEMBER THE 2331 01:34:01,560 --> 01:34:03,360 INTRAOCULAR IMPACT TEST. 2332 01:34:03,360 --> 01:34:08,560 THIS IS THE IMPACT OF ENFORCED 2333 01:34:08,560 --> 01:34:09,720 COMPLIANCE ON PUBLISHING THE 2334 01:34:09,720 --> 01:34:10,440 LIFE SCIENCES. 2335 01:34:10,440 --> 01:34:12,920 WE DID A RANDOMIZED CONTROL 2336 01:34:12,920 --> 01:34:14,480 TRIAL AND ASKED PEOPLE TO 2337 01:34:14,480 --> 01:34:16,320 COMPLETE A CHECKLIST MAKES NO 2338 01:34:16,320 --> 01:34:18,720 DIFFERENCE TO THE PROPORTION OF 2339 01:34:18,720 --> 01:34:19,600 CHECKLISTS COMPLETED. 2340 01:34:19,600 --> 01:34:22,400 IT'S COUNTERINTUITIVE BUT IT 2341 01:34:22,400 --> 01:34:23,600 WOULD BE HUGE AMOUNT OF WORK. 2342 01:34:23,600 --> 01:34:25,680 PEOPLE WERE DOING THE WRONG 2343 01:34:25,680 --> 01:34:28,440 THING BECAUSE WE ASSUMED THEIR 2344 01:34:28,440 --> 01:34:29,320 INTERVENTION -- OVER THE LAST 2345 01:34:29,320 --> 01:34:34,800 TWO YEARS THEY'VE BEEN TRYING TO 2346 01:34:34,800 --> 01:34:35,680 ARTICULATE WHERE INSTITUTIONS 2347 01:34:35,680 --> 01:34:37,880 CAN ADOPT AND THE COST AND 2348 01:34:37,880 --> 01:34:42,680 BENEFIT AND THE CERTAINTY WE 2349 01:34:42,680 --> 01:34:46,640 HAVE IN THOSE. 2350 01:34:46,640 --> 01:34:49,280 HERE WE KNOW HIGH COST AND LOW 2351 01:34:49,280 --> 01:34:50,120 BENEFIT. 2352 01:34:50,120 --> 01:34:53,760 THIS INTERVENTION IS POTENTIALLY 2353 01:34:53,760 --> 01:35:00,400 OF HIGH BENEFITLY LOW -- BENEFIT 2354 01:35:00,400 --> 01:35:01,800 POTENTIALLY C WITH LOWT AND 2355 01:35:01,800 --> 01:35:04,240 NEED TO KNOW IF WE NEED TO DO A 2356 01:35:04,240 --> 01:35:05,680 RANDOMIZED CONTROL TRIAL AND FOR 2357 01:35:05,680 --> 01:35:09,320 A HIGH-COST, HIGH-BENEFIT, 2358 01:35:09,320 --> 01:35:10,240 LOW-CERTAINTY INTERVENTION YOU'D 2359 01:35:10,240 --> 01:35:11,000 WANT TO DO THAT. 2360 01:35:11,000 --> 01:35:12,600 HERE'S THE TWO APPROACHES. 2361 01:35:12,600 --> 01:35:16,160 THERE'S IMPLEMENT WITH AUDIT AND 2362 01:35:16,160 --> 01:35:20,560 THIS IS FROM A PAPER WHERE A 2363 01:35:20,560 --> 01:35:21,920 COMMUNITY HAD WHAT THEY 2364 01:35:21,920 --> 01:35:23,440 CONSIDERED TO REPRESENT BEST 2365 01:35:23,440 --> 01:35:25,160 PRACTICE AND MEASURED THEIR 2366 01:35:25,160 --> 01:35:26,600 PERFORMANCE AND TRIED TO SHIFT 2367 01:35:26,600 --> 01:35:28,200 AND MEASURE AGAIN AND GO AROUND 2368 01:35:28,200 --> 01:35:29,560 IN CYCLE INCORPORATING THINGS 2369 01:35:29,560 --> 01:35:31,280 THAT WORK IN THEIR STANDARD 2370 01:35:31,280 --> 01:35:33,240 PROCEDURES AND WHERE THINGS 2371 01:35:33,240 --> 01:35:35,080 DON'T WORK CHANGING INTERVENTION 2372 01:35:35,080 --> 01:35:36,040 SYSTEMS AND TRYING AGAIN AND 2373 01:35:36,040 --> 01:35:37,680 HERE'S THE ALTERNATIVE, HIGH 2374 01:35:37,680 --> 01:35:40,240 COST AND HIGH POTENTIAL BENEFIT 2375 01:35:40,240 --> 01:35:41,240 RANDOMIZED THROUGH A TRIAL. 2376 01:35:41,240 --> 01:35:42,480 THESE ARE TOOLS WE USE EVERY DAY 2377 01:35:42,480 --> 01:35:47,680 IN OUR WORKING LIFE BUT THE 2378 01:35:47,680 --> 01:35:49,480 AMOUNT OF RESEARCH PRACTITIONERS 2379 01:35:49,480 --> 01:35:52,000 WITH THE SKILLS IN TRIALS AND 2380 01:35:52,000 --> 01:35:54,480 RESEARCH IMPROVEMENT AND THE 2381 01:35:54,480 --> 01:35:57,240 FUNDING FOR THEM IS PITYFULLY 2382 01:35:57,240 --> 01:35:59,160 SMALL AND SPEND YEAR AFTER YEAR 2383 01:35:59,160 --> 01:36:00,960 THROWING GOOD MONEY AFTER BAD 2384 01:36:00,960 --> 01:36:02,520 INSTEAD OF PAUSING, REFLECTING 2385 01:36:02,520 --> 01:36:03,920 AND DESIGNING STUDIES THAT TELL 2386 01:36:03,920 --> 01:36:04,600 US WHAT WE WANT. 2387 01:36:04,600 --> 01:36:08,480 THE FINAL OBJECTIVE IS TO 2388 01:36:08,480 --> 01:36:10,960 EMPOWER INSTITUTIONS OF 2389 01:36:10,960 --> 01:36:11,480 KNOWLEDGE. 2390 01:36:11,480 --> 01:36:13,320 THAT'S CHALLENGING WHEN THERE 2391 01:36:13,320 --> 01:36:18,440 ISN'T VERY GOOD EVIDENCE AROUND. 2392 01:36:18,440 --> 01:36:28,120 THERE'S A RECENT CALL AND TWO 2393 01:36:28,120 --> 01:36:38,640 WERE IMPORTANT IN THE SPACE AND 2394 01:36:39,800 --> 01:36:42,040 RESEARCH AND INNOVATION AND WHAT 2395 01:36:42,040 --> 01:36:43,800 EACH WOULD DO IS ESTABLISH A 2396 01:36:43,800 --> 01:36:47,320 MENU OF INTERVENTIONS IN THEIR 2397 01:36:47,320 --> 01:36:49,600 SPACE, GIVE A DESCRIPTION OF THE 2398 01:36:49,600 --> 01:36:51,000 INTERVENTION AND PURPOSE AND 2399 01:36:51,000 --> 01:36:56,080 IMPLEMENTATION AND EVIDENCE AND 2400 01:36:56,080 --> 01:37:03,120 COSTS AND THE FIRST IS LED BY 2401 01:37:03,120 --> 01:37:04,760 FOLKS LIKE ME WHO TAKE THE 2402 01:37:04,760 --> 01:37:07,320 BACKSTAGE AND THE TEXT OF THE 2403 01:37:07,320 --> 01:37:08,600 SUBMITTED APPLICATIONS IS 2404 01:37:08,600 --> 01:37:09,800 AVAILABLE ON THE OPEN SCIENCE 2405 01:37:09,800 --> 01:37:11,120 FRAMEWORK BEFORE ANY FUNDING 2406 01:37:11,120 --> 01:37:12,600 DECISION IS MADE BECAUSE WE'RE 2407 01:37:12,600 --> 01:37:14,040 UNLIKELY TO GET FUNDED 25% 2408 01:37:14,040 --> 01:37:16,400 CHANCE AND IF WE DON'T GET 2409 01:37:16,400 --> 01:37:17,160 FUNDED, WE'D LIKE SOMEONE ELSE 2410 01:37:17,160 --> 01:37:20,480 TO TAKE UP OUR GOOD IDEAS. 2411 01:37:20,480 --> 01:37:29,680 THE FINAL THING IS THE 2412 01:37:29,680 --> 01:37:31,240 GUARANTORS MAY LOOK AT THEIR 2413 01:37:31,240 --> 01:37:32,160 PRACTICES FOR DATA MANAGEMENT 2414 01:37:32,160 --> 01:37:35,320 AND HANDLING. 2415 01:37:35,320 --> 01:37:41,120 THANK YOU VERY MUCH. 2416 01:37:41,120 --> 01:37:43,600 I APPRECIATE IT AND ENJOYED THE 2417 01:37:43,600 --> 01:38:00,200 HISTORY LESSON. 2418 01:38:00,200 --> 01:38:01,120 >> GREAT TALK GUYS. 2419 01:38:01,120 --> 01:38:02,320 NOW IT'S TIME FOR GROUP 2420 01:38:02,320 --> 01:38:02,600 QUESTIONS. 2421 01:38:02,600 --> 01:38:04,680 WE WANT TO THINK ABOUT THE 2422 01:38:04,680 --> 01:38:04,960 INCENTIVES. 2423 01:38:04,960 --> 01:38:06,480 WE WANT TO THINK OF THE 2424 01:38:06,480 --> 01:38:08,360 PERSPECTIVES OF PARTNERSHIPS AND 2425 01:38:08,360 --> 01:38:10,080 HOW DIFFERENT ORGANIZATIONS CAN 2426 01:38:10,080 --> 01:38:11,760 MAKE A DIFFERENCE. 2427 01:38:11,760 --> 01:38:17,840 THIS IS MEANT TO BE A DIALOGUE. 2428 01:38:17,840 --> 01:38:21,440 WE HAVE A RELATIVELY SMALL GROUP 2429 01:38:21,440 --> 01:38:23,520 OF PEOPLE. 2430 01:38:23,520 --> 01:38:25,040 IT'S INTENTIONAL. 2431 01:38:25,040 --> 01:38:26,360 THERE ARE MICROPHONE. 2432 01:38:26,360 --> 01:38:28,360 WHEN YOU GET TO THE MICROPHONE 2433 01:38:28,360 --> 01:38:29,480 PLEASE STATE YOUR NAME AND THE 2434 01:38:29,480 --> 01:38:31,680 INSTITUTION YOU'RE AFFILIATED 2435 01:38:31,680 --> 01:38:33,480 WITH AND THEN ASK YOUR QUESTION. 2436 01:38:33,480 --> 01:38:37,600 TRY UNLIKE ME TO BE BRIEF AND 2437 01:38:37,600 --> 01:38:38,000 YET CONCISIVE. 2438 01:38:38,000 --> 01:38:40,880 I ASK OUR PANELISTS TO TRY TO BE 2439 01:38:40,880 --> 01:38:44,240 BRIEF IN THEIR ANSWERS. 2440 01:38:44,240 --> 01:38:53,160 THIS IS MEANT TO BE A FULL 2441 01:38:53,160 --> 01:38:57,320 EXCHANGE AND YOU IN THE AUDIENCE 2442 01:38:57,320 --> 01:39:01,080 CAN ARGUE WITH ME AND THE PANEL 2443 01:39:01,080 --> 01:39:02,360 AND FUN. 2444 01:39:02,360 --> 01:39:06,080 I'M REMINDED. 2445 01:39:06,080 --> 01:39:13,560 THE COMMENCEMENT SPEECH CALLED 2446 01:39:13,560 --> 01:39:17,560 WHAT IS WATER BY DAVID FOSTER 2447 01:39:17,560 --> 01:39:21,800 WALLACE AND IT'S A METAPHOR FOR 2448 01:39:21,800 --> 01:39:23,880 IF YOU'RE A FISH AND LIVE IN THE 2449 01:39:23,880 --> 01:39:25,080 WATER YOU DON'T KNOW WHAT IT IS 2450 01:39:25,080 --> 01:39:27,880 BECAUSE IT'S ALL YOU EXPERIENCE. 2451 01:39:27,880 --> 01:39:30,320 EACH OUR SPEAKER HAVE BEEN 2452 01:39:30,320 --> 01:39:33,520 CHOSEN IN PART BECAUSE LIVE IN 2453 01:39:33,520 --> 01:39:35,000 DIFFERENT BODIES OF WATER. 2454 01:39:35,000 --> 01:39:36,840 BRING THAT FORWARD. 2455 01:39:36,840 --> 01:39:38,040 WHAT DID THEY MISS? 2456 01:39:38,040 --> 01:39:41,600 WHAT DID THEY ASSUME THAT'S NOT 2457 01:39:41,600 --> 01:39:43,160 REALLY IN EVIDENCE AND WHAT 2458 01:39:43,160 --> 01:39:44,440 STATEMENTS DID THEY MAKE IF YOU 2459 01:39:44,440 --> 01:39:49,960 LIKE THE LATIN PHRASE FROM LAW. 2460 01:39:49,960 --> 01:39:52,560 ROUGHLY TRANSLATES TO WHAT I 2461 01:39:52,560 --> 01:39:55,600 MYSELF SAID IT IT'S TRUE BECAUSE 2462 01:39:55,600 --> 01:39:57,440 I SAID IT'S TRUE. 2463 01:39:57,440 --> 01:39:59,800 WHAT DID YOU HEAR TODAY THAT 2464 01:39:59,800 --> 01:40:03,440 SAYS I'M NOT VIEW IT'S ACTUALLY 2465 01:40:03,440 --> 01:40:04,160 TRUE. 2466 01:40:04,160 --> 01:40:09,240 COME TO THE MICROPHONE AND STATE 2467 01:40:09,240 --> 01:40:19,400 YOUR NAME. 2468 01:40:20,760 --> 01:40:22,240 >> I'M WITH QUALITY CONTROL AND 2469 01:40:22,240 --> 01:40:26,680 TRYING TO DEVELOP STANDARDS FOR 2470 01:40:26,680 --> 01:40:32,240 RIGOR IN NEURO IMAGING. 2471 01:40:32,240 --> 01:40:34,000 AND WE TALKED ABOUT 2472 01:40:34,000 --> 01:40:35,240 INSTITUTIONAL BUY-IN. 2473 01:40:35,240 --> 01:40:37,600 I THINK THERE IS AN ASSUMPTION 2474 01:40:37,600 --> 01:40:42,400 THAT INSTITUTIONS ARE INTERESTED 2475 01:40:42,400 --> 01:40:45,960 IN BUYING IN IT AND FROM MY 2476 01:40:45,960 --> 01:40:47,440 EXPERIENCE IN TRYING TO TALK TO 2477 01:40:47,440 --> 01:40:51,680 HIGHER UPS AND SO ESPECIALLY 2478 01:40:51,680 --> 01:40:53,920 MEDICAL SCHOOLS I DON'T THINK 2479 01:40:53,920 --> 01:40:56,240 THAT HAS CHANGED IN BUY-IN. 2480 01:40:56,240 --> 01:40:58,600 THERE ARE THINGS ON WEBSITES AND 2481 01:40:58,600 --> 01:41:01,600 SYSTEM REMAINS THE SAME AND HIGH 2482 01:41:01,600 --> 01:41:04,800 IMPACT PAPERS AND I WAS 2483 01:41:04,800 --> 01:41:06,080 WONDERING IS THAT ASSUMPTION 2484 01:41:06,080 --> 01:41:16,600 TESTED OR DO WE MAKE IT TRUE? 2485 01:41:21,400 --> 01:41:25,960 >> YOU NEED TO BE MORE OPERATIC. 2486 01:41:25,960 --> 01:41:30,760 >> I'M HESITANT IN MY RESPONSE 2487 01:41:30,760 --> 01:41:33,000 BECAUSE I'M NOT SURE ABOUT THE 2488 01:41:33,000 --> 01:41:34,280 RIGOR IN AND THE EXAMPLES FROM 2489 01:41:34,280 --> 01:41:36,000 THE CASE STUDIES I SHOWED YOU 2490 01:41:36,000 --> 01:41:37,880 WERE FROM ORGANIZATIONS THAT 2491 01:41:37,880 --> 01:41:39,640 WERE ACTIVELY INTERESTED IN 2492 01:41:39,640 --> 01:41:41,320 RESEARCH ASSESSMENT REFORM AND I 2493 01:41:41,320 --> 01:41:45,520 AGREE WITH YOU THAT IS A MAJOR 2494 01:41:45,520 --> 01:41:54,760 CHALLENGE IS. 2495 01:41:54,760 --> 01:41:57,120 AND THERE ARE TENSIONS I 2496 01:41:57,120 --> 01:41:58,920 MENTIONED AT THE BEGINNING OF 2497 01:41:58,920 --> 01:42:03,320 THE TALK DRIVING REWARDS AND 2498 01:42:03,320 --> 01:42:06,080 RECOGNITION TOWARDS PRESTIGE 2499 01:42:06,080 --> 01:42:11,240 SUCH AS WORLD RANKING AND I 2500 01:42:11,240 --> 01:42:15,360 THINK ONE BIT OF AGAIN WHY I'M 2501 01:42:15,360 --> 01:42:17,560 SLIGHTLY NERVOUS ABOUT THE 2502 01:42:17,560 --> 01:42:20,880 RIGOR, WHEN WE LOOK AT ORGANIZES 2503 01:42:20,880 --> 01:42:22,120 THAT SIGNED DORA THERE ARE 2504 01:42:22,120 --> 01:42:22,880 HUNDREDS OF UNIVERSITIES IN 2505 01:42:22,880 --> 01:42:24,840 EUROPE THAT HAVE DONE SO AND 2506 01:42:24,840 --> 01:42:26,200 THERE ARE FIVE ACADEMIC 2507 01:42:26,200 --> 01:42:26,800 INSTITUTIONS IN THE U.S. THAT 2508 01:42:26,800 --> 01:42:28,120 HAVE. 2509 01:42:28,120 --> 01:42:34,240 SO I THINK IT IS A FAIR 2510 01:42:34,240 --> 01:42:37,560 ASSUMPTION YOU'RE BRINGING UP. 2511 01:42:37,560 --> 01:42:41,080 I DON'T KNOW IF IT'S AS MUCH 2512 01:42:41,080 --> 01:42:42,800 INTEREST BUT CERTAINLY WE'RE NOT 2513 01:42:42,800 --> 01:42:44,840 SEEING AS MUCH INSTITUTIONS IN 2514 01:42:44,840 --> 01:42:45,960 THE UNITED STATES SIGNING DORA 2515 01:42:45,960 --> 01:42:48,440 NOT TO MEAN THEY'RE NOT 2516 01:42:48,440 --> 01:42:48,960 INSTITUTIONS WORKING ON 2517 01:42:48,960 --> 01:42:49,600 ASSESSMENT REFORM WE'RE SEEING 2518 01:42:49,600 --> 01:42:58,200 IN EUROPE. 2519 01:42:58,200 --> 01:42:59,880 >> I WOULD CHALLENGE THE 2520 01:42:59,880 --> 01:43:03,640 QUESTIONER AND SAY IS IT REALLY 2521 01:43:03,640 --> 01:43:04,480 IN DOUBT THAT ANY INDIVIDUAL 2522 01:43:04,480 --> 01:43:09,560 INSTITUTION HAS MORE THAN ONE 2523 01:43:09,560 --> 01:43:12,400 INTEREST THAT SOME AREN'T IN 2524 01:43:12,400 --> 01:43:13,560 FINANCIAL PROFIT BUT SOME IN 2525 01:43:13,560 --> 01:43:15,520 PRESTIGE AND EGO ENHANCEMENT AND 2526 01:43:15,520 --> 01:43:18,120 SOME ARE CERTAINLY FOR ACADEMIC 2527 01:43:18,120 --> 01:43:21,120 INSTITUTIONS IN RIGOR. 2528 01:43:21,120 --> 01:43:23,360 THE QUESTION IS ARE THEY 2529 01:43:23,360 --> 01:43:29,360 SUFFICIENTLY EFFECTIVE AND THEN 2530 01:43:29,360 --> 01:43:31,120 IF IT'S NOT SO MUCH INTERESTED 2531 01:43:31,120 --> 01:43:38,360 OR NOT AND WE HAVE IPSO FACTO 2532 01:43:38,360 --> 01:43:48,920 PRIMA FACIE EVIDENCE AND WHAT IS 2533 01:43:56,120 --> 01:43:58,440 YOUR QUESTION TO THAT? 2534 01:43:58,440 --> 01:44:04,600 >> THE WAY THEY EVALUATE FACULTY 2535 01:44:04,600 --> 01:44:07,520 IS DOWN TO GRANT MONEY -- 2536 01:44:07,520 --> 01:44:08,320 >> WHAT'S YOUR EVIDENCE FOR 2537 01:44:08,320 --> 01:44:09,720 THAT, SIR? 2538 01:44:09,720 --> 01:44:11,680 >> I'M A NEW P.I. WHO JOINED A 2539 01:44:11,680 --> 01:44:15,280 YEAR AGO AND THE TRAINING AND 2540 01:44:15,280 --> 01:44:16,320 ORIENTATION OF FACULTY THEY TELL 2541 01:44:16,320 --> 01:44:19,600 YOU THIS IS WHAT YOU NEED TO 2542 01:44:19,600 --> 01:44:21,160 TARGET TO KEEP YOUR JOB AND PAY 2543 01:44:21,160 --> 01:44:24,720 YOUR SALARY AND PROGRESS. 2544 01:44:24,720 --> 01:44:27,280 I THINK THAT'S MOSTLY TRUE IN 2545 01:44:27,280 --> 01:44:29,600 MOST MEDICAL SCHOOLS. 2546 01:44:29,600 --> 01:44:32,360 >> IS THERE AN AN ACADEMIC 2547 01:44:32,360 --> 01:44:33,800 INTEGRITY STATEMENT IN YOUR 2548 01:44:33,800 --> 01:44:35,320 UNIVERSITY THAT SAYS IN ORDER TO 2549 01:44:35,320 --> 01:44:39,320 KEEP YOUR JOB YOU HAVE TO NOT 2550 01:44:39,320 --> 01:44:40,800 PLAGIARIZE, FALSIFY OR 2551 01:44:40,800 --> 01:44:41,160 FABRICATE. 2552 01:44:41,160 --> 01:44:42,280 >> YES. 2553 01:44:42,280 --> 01:44:44,200 >> SO THEY ALSO SAY THAT? 2554 01:44:44,200 --> 01:44:45,280 >> YES. 2555 01:44:45,280 --> 01:44:46,520 >> OKAY. 2556 01:44:46,520 --> 01:44:49,800 >> MY POINT IS THE WORK WE ARE 2557 01:44:49,800 --> 01:44:52,560 PURSUING TO ACHIEVE IMPROVING 2558 01:44:52,560 --> 01:44:55,600 RIGOR AND REPRODUCIBILITY IS 2559 01:44:55,600 --> 01:44:57,320 NOT -- BECAUSE THE KIND OF 2560 01:44:57,320 --> 01:44:58,920 GRANTS WE WRITE TO ACHIEVE THAT 2561 01:44:58,920 --> 01:45:01,640 ARE NOT BEING FUNDED. 2562 01:45:01,640 --> 01:45:04,440 IF WE DON'T GET DOLLARS I CAN'T 2563 01:45:04,440 --> 01:45:07,440 PAY MY SALARY AND THEN I'M OUT. 2564 01:45:07,440 --> 01:45:16,120 >> GOOD, THANK YOU, SIR. 2565 01:45:16,120 --> 01:45:19,680 >> I'M ALEXANDRA NELSON AND I'M 2566 01:45:19,680 --> 01:45:22,720 INVOLVED IN TRAINING IN 2567 01:45:22,720 --> 01:45:23,240 EXPERIMENTAL DESIGN FOR 2568 01:45:23,240 --> 01:45:24,320 NEUROSCIENCE Ph.D. STUDENTS. 2569 01:45:24,320 --> 01:45:27,320 I WAS REALLY INTRIGUED AND 2570 01:45:27,320 --> 01:45:29,120 EXCITED ABOUT THE COMMENT THAT 2571 01:45:29,120 --> 01:45:31,600 DR. MACLEOD MADE ABOUT MAKING 2572 01:45:31,600 --> 01:45:34,560 SMALL CHANGES AS A WAY TO GET 2573 01:45:34,560 --> 01:45:35,880 MORE BUY-IN AND I'M WONDERING IF 2574 01:45:35,880 --> 01:45:37,640 YOU CAN GIVE A COUPLE EXAMPLES 2575 01:45:37,640 --> 01:45:39,840 OF SOME OF THOSE SMALL CHANGES 2576 01:45:39,840 --> 01:45:43,600 WE MIGHT THINK ABOUT FOR OUR 2577 01:45:43,600 --> 01:45:52,360 INSTITUTIONS. 2578 01:45:52,360 --> 01:45:53,800 >> LET ME GIVE YOU ONE EXAMPLE 2579 01:45:53,800 --> 01:45:56,360 OF WHAT IS SMALL AND EFFECTIVE 2580 01:45:56,360 --> 01:46:06,880 AND I'M A NEUROOLOGIST AND IN 2581 01:46:08,040 --> 01:46:09,240 LOU GHERIG'S DISEASE IMAGINE WE 2582 01:46:09,240 --> 01:46:10,840 GET A TREATMENT THAT REDUCES 2583 01:46:10,840 --> 01:46:16,800 MORTALITY BY 10% IS ABOUT ONE 2584 01:46:16,800 --> 01:46:19,320 PATIENT A MONTH. 2585 01:46:19,320 --> 01:46:23,200 THAT IS BASED ON FOUR TREATMENTS 2586 01:46:23,200 --> 01:46:24,720 IN SERIES. 2587 01:46:24,720 --> 01:46:26,400 IT'S A GENEROUS ESTIMATE. 2588 01:46:26,400 --> 01:46:30,720 EVERY MONTH THAT A PUBLICATION'S 2589 01:46:30,720 --> 01:46:32,680 DELAYED IS ONE PERSON DYING OF 2590 01:46:32,680 --> 01:46:33,600 ALS THEY SHOULDN'T HAVE DIED. 2591 01:46:33,600 --> 01:46:36,160 WE AUDITED THE INTERVAL BETWEEN 2592 01:46:36,160 --> 01:46:39,360 US APPROVING IRB APPROVAL TO AN 2593 01:46:39,360 --> 01:46:44,120 ANIMAL STUDY AND BEING 2594 01:46:44,120 --> 01:46:44,400 PUBLISHED. 2595 01:46:44,400 --> 01:46:47,920 AND THE MEDIAN DELAY WAS 1,000 2596 01:46:47,920 --> 01:46:48,480 DAYS. 2597 01:46:48,480 --> 01:46:49,920 OF SHOWS 250 WERE BETWEEN THE 2598 01:46:49,920 --> 01:46:52,040 WORK BEING SUBMITTED FOR 2599 01:46:52,040 --> 01:46:53,680 PUBLICATION AND ACTUALLY BEING 2600 01:46:53,680 --> 01:46:53,960 PUBLISHED. 2601 01:46:53,960 --> 01:46:56,480 SO WE'VE TAKEN A FEW THAT 2602 01:46:56,480 --> 01:46:58,400 ACTUALLY IF OUR RESEARCHERS 2603 01:46:58,400 --> 01:46:59,720 SUBMITTED THEIR WORK TO BIO 2604 01:46:59,720 --> 01:47:01,000 ARCHIVE AT THE SAME TIME THEY 2605 01:47:01,000 --> 01:47:03,160 SUBMITTED IT TO THE JOURNALS, IT 2606 01:47:03,160 --> 01:47:06,680 WOULD BE THERE AND CITABLE AND 2607 01:47:06,680 --> 01:47:08,000 THERE FOR REUSE BY OTHER 2608 01:47:08,000 --> 01:47:08,800 RESEARCH MUCH QUICKER. 2609 01:47:08,800 --> 01:47:12,080 SO WE'RE WORKING WITH OUR 2610 01:47:12,080 --> 01:47:16,920 COMMUNITIES TO IDENTIFY THEIR 2611 01:47:16,920 --> 01:47:18,600 ATTITUDES TOWARDS BIO ARCHIVING 2612 01:47:18,600 --> 01:47:22,760 AND CONTINUING TO AUDIT THE 2613 01:47:22,760 --> 01:47:24,880 PERCEIVE THE PORTION THAT GO OUT 2614 01:47:24,880 --> 01:47:35,360 TO BIO ARCHIVE AND THAT'S A 2615 01:47:35,360 --> 01:47:37,960 PLAUSIBLE WAY TO LOOK AT BIO 2616 01:47:37,960 --> 01:47:41,120 ARCHIVES THAT MAY DO HARM AND 2617 01:47:41,120 --> 01:47:43,000 THAT'S A NICE PROJECT THAT IS 2618 01:47:43,000 --> 01:47:43,640 PORTABLE BECAUSE ANYONE IN THE 2619 01:47:43,640 --> 01:47:45,120 ROOM CAN DO THAT. 2620 01:47:45,120 --> 01:47:48,560 >> I WANT TO SEE IF OTHERS AGREE 2621 01:47:48,560 --> 01:47:49,960 WITH THIS IDEA. 2622 01:47:49,960 --> 01:47:53,240 IS IT BETTER TO EFFECT CHANGE OR 2623 01:47:53,240 --> 01:47:57,840 MORE LIKELY TO BE SUCCESSFUL TO 2624 01:47:57,840 --> 01:47:59,480 EFFECT CHANGE BY GETTING MANY 2625 01:47:59,480 --> 01:48:01,160 PARTIES IN MANY PROJECTS TO HAVE 2626 01:48:01,160 --> 01:48:03,280 A SMALL IMPROVEMENT OR WOULD WE 2627 01:48:03,280 --> 01:48:05,120 BE BETTER OFF HAVING A SMALLER 2628 01:48:05,120 --> 01:48:07,320 NUMBER OF PARTIES ON A SMALLER 2629 01:48:07,320 --> 01:48:11,280 NUMBER OF PROJECTS HAVE SOME 2630 01:48:11,280 --> 01:48:14,120 REMARKABLY LARGE NOTABLE, 2631 01:48:14,120 --> 01:48:16,320 PALPABLE IMPROVEMENT? 2632 01:48:16,320 --> 01:48:19,000 DOES SOMEBODY WANT TO TAKE THAT 2633 01:48:19,000 --> 01:48:19,360 ON? 2634 01:48:19,360 --> 01:48:29,720 I'LL CALL ON SOMEBODY. 2635 01:48:34,080 --> 01:48:36,520 >> WE DIDN'T HEAR ABOUT MOM WHO 2636 01:48:36,520 --> 01:48:39,320 IS ANOTHER WAY OF MOTIVATING AT 2637 01:48:39,320 --> 01:48:40,880 LEAST IN MY FAMILY AT WHAT 2638 01:48:40,880 --> 01:48:42,480 HAPPENED AND NIH IS MOM AND CAN 2639 01:48:42,480 --> 01:48:45,800 LAY DOWN THE LAW AND WONDER HOW 2640 01:48:45,800 --> 01:48:46,960 THAT AFFECTS WHETHER SOMETHING 2641 01:48:46,960 --> 01:48:47,520 SPREAD OR NOT? 2642 01:48:47,520 --> 01:48:50,200 ANY QUESTION IS ABOUT THE 2643 01:48:50,200 --> 01:48:55,840 TENSION BETWEEN TOP-DOWN VERSUS 2644 01:48:55,840 --> 01:48:58,160 BOTTOM-UP APPROACHES. 2645 01:48:58,160 --> 01:49:00,760 AND IT'S ALMOST A QUESTION OF 2646 01:49:00,760 --> 01:49:02,760 DEFINITIONS, WHEN IS RESEARCH 2647 01:49:02,760 --> 01:49:03,240 RIGOROUS? 2648 01:49:03,240 --> 01:49:05,560 IF WE CAN'T DEFINE IT HOW DO WE 2649 01:49:05,560 --> 01:49:09,280 KNOW IF WE'VE ACHIEVED IT. 2650 01:49:09,280 --> 01:49:10,720 I FEEL LIKE THAT'S THE PROBLEM 2651 01:49:10,720 --> 01:49:13,000 IN GETTING THE IDEA TO SPREAD 2652 01:49:13,000 --> 01:49:14,160 AND BUYING GOOGLE GLASS YOU 2653 01:49:14,160 --> 01:49:15,760 BOUGHT IT OR DIDN'T AND IT'S 2654 01:49:15,760 --> 01:49:18,160 CLEAR WHETHER THAT ACTION HAS 2655 01:49:18,160 --> 01:49:19,640 BEEN PERFORMED. 2656 01:49:19,640 --> 01:49:20,800 I'VE BEEN SURPRISED FOR GOOD OR 2657 01:49:20,800 --> 01:49:22,480 FOR WORSE ABOUT DATA STANDARDS 2658 01:49:22,480 --> 01:49:27,040 WITHIN NIH AND THEY HAVE THE 2659 01:49:27,040 --> 01:49:28,600 POWER TO PUT DOWN THE LAW BUT 2660 01:49:28,600 --> 01:49:30,840 THAT MAY NOT BE THE POWER YOU 2661 01:49:30,840 --> 01:49:33,040 WANT TO PUT DOWN IN ALL 2662 01:49:33,040 --> 01:49:34,280 CIRCUMSTANCES BUT IT'S A POWER 2663 01:49:34,280 --> 01:49:36,720 THAT SHOULDN'T BE IGNORED THAT 2664 01:49:36,720 --> 01:49:37,920 HAS POTENTIAL. 2665 01:49:37,920 --> 01:49:41,720 TO TRY TO SUMMARIZE MY MOM AND 2666 01:49:41,720 --> 01:49:43,160 MIKE HAVE DIFFERENT IDEAS THAN I 2667 01:49:43,160 --> 01:49:44,880 DO WHETHER MY ROOM IS CLEAN OR 2668 01:49:44,880 --> 01:49:46,840 NOT BUT IT WAS CLEAR THAT I 2669 01:49:46,840 --> 01:49:48,480 NEEDED TO REACT TO THAT AND DO 2670 01:49:48,480 --> 01:49:48,760 SOMETHING. 2671 01:49:48,760 --> 01:49:52,200 MY QUESTION IS HOW DO WE USE THE 2672 01:49:52,200 --> 01:49:54,680 COMBINATION OF TOP-DOWN AND 2673 01:49:54,680 --> 01:49:56,600 BOTTOM-UP APPROACHES TO FIGURE 2674 01:49:56,600 --> 01:49:58,960 OUT WHAT CHANGES AT THE 2675 01:49:58,960 --> 01:50:01,480 INCREMENTAL LEVEL ARE ENOUGH OR 2676 01:50:01,480 --> 01:50:02,960 NOT ENOUGH AND LETTING 2677 01:50:02,960 --> 01:50:04,040 COMMUNITIES DEFINE THOSE FOR 2678 01:50:04,040 --> 01:50:05,520 THEMSELVES AND MAKING SURE MOM 2679 01:50:05,520 --> 01:50:08,440 IS IN THE BACKGROUND WHEN 2680 01:50:08,440 --> 01:50:09,880 SOMEBODY'S NOT PLAYING NICELY. 2681 01:50:09,880 --> 01:50:14,560 TO HEAR THOUGHTS ON THAT AND 2682 01:50:14,560 --> 01:50:22,680 IT'S RELATED TO THAT. 2683 01:50:22,680 --> 01:50:24,040 >> ANNA, PLEASE. 2684 01:50:24,040 --> 01:50:25,640 >> WHAT WE'VE SEEN DOCUMENTED IN 2685 01:50:25,640 --> 01:50:29,960 THE CASE STUDIES IS IT'S KIND OF 2686 01:50:29,960 --> 01:50:31,640 A LITTLE BIT OF BOTH AT ACADEMIC 2687 01:50:31,640 --> 01:50:33,120 INSTITUTIONS WHEN WE'RE LOOKING 2688 01:50:33,120 --> 01:50:34,560 AT ONES THAT IMPLEMENTED CHANGES 2689 01:50:34,560 --> 01:50:38,200 THAT THERE'S AN ELEMENT OF 2690 01:50:38,200 --> 01:50:39,320 TOP-DOWN AND ELEMENT OF 2691 01:50:39,320 --> 01:50:44,280 BOTTOM-UP AND WORKING TOGETHER 2692 01:50:44,280 --> 01:50:48,920 IN DIFFERENT WAYS. 2693 01:50:48,920 --> 01:50:54,560 TYPICALLY CHANGE IS FROM THE 2694 01:50:54,560 --> 01:50:56,320 BOTTOM-UP AND PHYSICIAN WHO'S 2695 01:50:56,320 --> 01:50:58,000 FIND SOMEONE IN A PLACE OF POWER 2696 01:50:58,000 --> 01:51:00,240 OR DEAN OF RESEARCH THEY'RE ABLE 2697 01:51:00,240 --> 01:51:04,000 TO CONVINCE OR ALSO INTERESTED 2698 01:51:04,000 --> 01:51:05,160 IN THE SAME TOPIC. 2699 01:51:05,160 --> 01:51:11,080 WHEN WE'RE SEEING CHANGES FROM 2700 01:51:11,080 --> 01:51:12,720 THE TOP-DOWN THEN WE'RE SEEING 2701 01:51:12,720 --> 01:51:16,640 THEN WE'RE SEEING WORK BOTTOM-UP 2702 01:51:16,640 --> 01:51:22,520 BUY-IN CONVENING PEOPLE TO HAVE 2703 01:51:22,520 --> 01:51:26,840 DISCUSSIONS MUCH LIKE TODAY TO 2704 01:51:26,840 --> 01:51:27,520 BUILD CHAMPIONS IN THE 2705 01:51:27,520 --> 01:51:32,720 WORKFORCE. 2706 01:51:32,720 --> 01:51:36,760 >> I THINK IF ANYONE WAS SEEKING 2707 01:51:36,760 --> 01:51:40,200 TO ARTICULATE THE TOP-DOWN WOULD 2708 01:51:40,200 --> 01:51:42,200 BE THERE FOR A LONG TIME AND 2709 01:51:42,200 --> 01:51:43,840 MAKE A VERY GOOD JOB OF IT SO WE 2710 01:51:43,840 --> 01:51:47,240 SHOULD LEAVE THE DECISIONS ON 2711 01:51:47,240 --> 01:51:48,040 WHAT REPRESENTATIVES QUALITY TO 2712 01:51:48,040 --> 01:51:49,920 THE USERS, THE PRACTITIONERS OF 2713 01:51:49,920 --> 01:51:51,440 THAT RESEARCH. 2714 01:51:51,440 --> 01:51:53,440 WHAT I THINK THE TOP-DOWN 2715 01:51:53,440 --> 01:51:57,840 APPROACH COULD BE TO INSIST 2716 01:51:57,840 --> 01:51:58,720 INSTITUTIONS HAVE AND 2717 01:51:58,720 --> 01:52:00,440 DEMONSTRATE THE APPROPRIATE 2718 01:52:00,440 --> 01:52:02,320 FUNCTIONING OF SYSTEMS TO 2719 01:52:02,320 --> 01:52:03,480 IMPROVE AND MONITOR THE RESEARCH 2720 01:52:03,480 --> 01:52:06,040 SO IT'S QUALITY BY DESIGN. 2721 01:52:06,040 --> 01:52:08,400 DON'T SHOW US YOUR OUTPUT BUT 2722 01:52:08,400 --> 01:52:10,600 SHOW US YOU HAVE A PROCESS BY 2723 01:52:10,600 --> 01:52:12,680 WHICH YOU SEEK TO IDENTIFY WHAT 2724 01:52:12,680 --> 01:52:13,800 YOUR STANDARDS ARE AND WORK 2725 01:52:13,800 --> 01:52:15,880 TOWARDS ACHIEVING THOSE 2726 01:52:15,880 --> 01:52:16,840 STANDARDS BECAUSE MY BELIEF IS 2727 01:52:16,840 --> 01:52:18,440 ANY INSTITUTION WHO HAS THAT 2728 01:52:18,440 --> 01:52:20,200 WILL NOT BE DOING VERY MUCH 2729 01:52:20,200 --> 01:52:25,680 WRONG IF IT'S DOING IT PROPERLY. 2730 01:52:25,680 --> 01:52:28,760 LET'S GO TO THIS MICROPHONE. 2731 01:52:28,760 --> 01:52:31,720 >> MY NAME IS NICOLE NELSON I'M 2732 01:52:31,720 --> 01:52:35,120 A PROFESSOR AT UNIVERSITY 2733 01:52:35,120 --> 01:52:39,360 WISCONSIN-MADISON AND ONE AREA 2734 01:52:39,360 --> 01:52:41,960 OF RESEARCH IS HOW PEOPLE LOOK 2735 01:52:41,960 --> 01:52:45,200 TO COME TO PROBLEMS AS 2736 01:52:45,200 --> 01:52:46,200 REPRODUCIBILITY RIGOR PROBLEMS 2737 01:52:46,200 --> 01:52:48,600 AND THEN ACT ON THEM. 2738 01:52:48,600 --> 01:52:50,640 FOR APRIL I ENJOYED IN YOUR TALK 2739 01:52:50,640 --> 01:52:53,240 HEARING HOW MANY CAME TO THE 2740 01:52:53,240 --> 01:52:55,320 TRAINING SESSIONS WITH AN 2741 01:52:55,320 --> 01:52:56,640 INITIAL SELF-INTERESTED 2742 01:52:56,640 --> 01:52:57,600 MOTIVATION THEY WANTED TO FIX 2743 01:52:57,600 --> 01:52:59,080 ONE OF THEIR OWN PROBLEMS AND I 2744 01:52:59,080 --> 01:53:01,680 THINK IT'S IMPORTANT TO 2745 01:53:01,680 --> 01:53:03,720 HIGHLIGHT BECAUSE THE INCENTIVES 2746 01:53:03,720 --> 01:53:05,040 NARRATIVE SEEMS TO PRESUME THE 2747 01:53:05,040 --> 01:53:07,720 SYSTEM AS-IS IS WORKING WELL FOR 2748 01:53:07,720 --> 01:53:10,640 MOST AND THE DON'T WANT TO 2749 01:53:10,640 --> 01:53:11,600 CHANGE BUT SEEMS THERE'S A CHUNK 2750 01:53:11,600 --> 01:53:13,160 OF PEOPLE OR INSTANCES WHERE 2751 01:53:13,160 --> 01:53:13,920 IT'S NOT WORKING WELL AND 2752 01:53:13,920 --> 01:53:24,400 THERE'S INTEREST IN CHANGE. 2753 01:53:29,280 --> 01:53:30,960 WHAT I SEE IS THOSE GOING 2754 01:53:30,960 --> 01:53:33,360 THROUGH TRAINING IS TIED WITH 2755 01:53:33,360 --> 01:53:35,000 RESEARCH ETHICS AND OFFERED WITH 2756 01:53:35,000 --> 01:53:37,280 RESEARCH ETHICS TRAINING MODULES 2757 01:53:37,280 --> 01:53:38,400 ALSO REQUIRED WHICH GIVES A 2758 01:53:38,400 --> 01:53:41,000 SENSE IT'S NOT SOMETHING THAT 2759 01:53:41,000 --> 01:53:43,760 BENEFITS THEM BUT THE SCOLDY 2760 01:53:43,760 --> 01:53:45,560 THINGS YOU'RE DOING WRONG. 2761 01:53:45,560 --> 01:53:47,120 SO WHAT I'M INTERESTED IN 2762 01:53:47,120 --> 01:53:49,120 HEARING YOU REFLECT ON IS HOW 2763 01:53:49,120 --> 01:53:50,920 YOU MANAGED TO MAKE A CULTURE 2764 01:53:50,920 --> 01:53:52,600 WHERE SELF-INTEREST CAN CARRY 2765 01:53:52,600 --> 01:53:54,840 THE DAY AND WHERE THE NATURAL 2766 01:53:54,840 --> 01:53:58,400 INCENTIVE PEOPLE HAVE TO SAVE 2767 01:53:58,400 --> 01:54:00,160 THEMSELVES WASTED TIME IS ABLE 2768 01:54:00,160 --> 01:54:00,960 TO MOTIVATE THEM TO THEN ADOPT 2769 01:54:00,960 --> 01:54:07,320 THESE PRACTICES. 2770 01:54:07,320 --> 01:54:09,520 >> I THINK -- WE'RE ALL VERY 2771 01:54:09,520 --> 01:54:10,280 BUSY, RIGHT. 2772 01:54:10,280 --> 01:54:13,000 I THINK THE PEOPLE THAT COME TO 2773 01:54:13,000 --> 01:54:14,200 A TRAINING THAT'S CALLED LIKE 2774 01:54:14,200 --> 01:54:16,800 HOW TO IMPROVE THE 2775 01:54:16,800 --> 01:54:18,160 REPRODUCIBILITY OF YOUR WORK 2776 01:54:18,160 --> 01:54:19,760 THERE'S A LOT OF SELF-SELECTION 2777 01:54:19,760 --> 01:54:20,720 THAT HAPPENS THERE. 2778 01:54:20,720 --> 01:54:22,040 THOSE PEOPLE ARE INTERESTED IN 2779 01:54:22,040 --> 01:54:24,200 SOME WAY ALMOST LIKE A HOBBY IN 2780 01:54:24,200 --> 01:54:25,800 LIKE TAKING THAT ON AS PART OF 2781 01:54:25,800 --> 01:54:28,880 THEIR IDENTITY BUT FOR THE REST 2782 01:54:28,880 --> 01:54:31,200 OF RESEARCHERS THEY DO WANT 2783 01:54:31,200 --> 01:54:32,880 THEIR RESEARCH TO BE MORE 2784 01:54:32,880 --> 01:54:33,160 RIGOROUS. 2785 01:54:33,160 --> 01:54:34,640 THEY HAVE EXPERIENCES THAT HAVE 2786 01:54:34,640 --> 01:54:39,280 CAUSED THEM TO LOSE TIME TO BE 2787 01:54:39,280 --> 01:54:41,720 DEMOTIVATING TO FRUSTRATE THEM 2788 01:54:41,720 --> 01:54:43,720 AND THEY SEE THIS OPPORTUNITY TO 2789 01:54:43,720 --> 01:54:44,920 LEARN A LITTLE BIT MORE AND WHEN 2790 01:54:44,920 --> 01:54:48,560 YOU GIVE THEM PRACTICAL THINGS 2791 01:54:48,560 --> 01:54:50,600 TO START WITH IT SORT OF IS 2792 01:54:50,600 --> 01:54:54,360 ALMOST A PSYCHOLOGICAL SHIFT 2793 01:54:54,360 --> 01:54:57,280 WHERE REPRODUCIBILITY IS NO 2794 01:54:57,280 --> 01:54:58,640 LONGER THIS BIG THEORETICAL 2795 01:54:58,640 --> 01:54:59,800 THING THEY CAN'T DO 2796 01:54:59,800 --> 01:55:00,160 INDIVIDUALLY. 2797 01:55:00,160 --> 01:55:02,840 TAY HAVE THINGS THEY CAN START 2798 01:55:02,840 --> 01:55:05,040 DOING AND OUR PHILOSOPHY HAS 2799 01:55:05,040 --> 01:55:06,720 BEEN LIKE TO KEEP THINGS 2800 01:55:06,720 --> 01:55:08,960 POSITIVE TO FOCUS ON THE 2801 01:55:08,960 --> 01:55:11,000 ADVANTAGES AND BENEFITS AND ALL 2802 01:55:11,000 --> 01:55:12,680 THE REST OF IT IS POSSIBLE AFTER 2803 01:55:12,680 --> 01:55:12,880 THAT. 2804 01:55:12,880 --> 01:55:14,480 ONCE SOMEONE HAS STARTED THAT 2805 01:55:14,480 --> 01:55:19,440 LEARNING JOURNEY AND START TO 2806 01:55:19,440 --> 01:55:24,960 DIVE A LITTLE BIT DEEPER AND SEE 2807 01:55:24,960 --> 01:55:28,760 BENEFITS TO ADOPTING LIGHT WAIT 2808 01:55:28,760 --> 01:55:30,560 YOU CAN HAVE CONVERSATIONS 2809 01:55:30,560 --> 01:55:32,920 CONVERSATIONS LIKE A CARPENTRIES 2810 01:55:32,920 --> 01:55:34,040 WORKSHOP THEY DIDN'T KNOW ABOUT 2811 01:55:34,040 --> 01:55:36,280 BEFORE THEY CAME TO ARPA-H AND 2812 01:55:36,280 --> 01:55:38,840 THEY SEE WHY THEY SHOULD BE 2813 01:55:38,840 --> 01:55:40,200 AUTOMATING THEIR ANALYSIS AND 2814 01:55:40,200 --> 01:55:41,440 DOCUMENTING THEIR COMPUTATIONAL 2815 01:55:41,440 --> 01:55:43,120 STUFF AND NOW THEY KNOW HOW. 2816 01:55:43,120 --> 01:55:46,640 THEN THEY WILL DEDICATE THE 2817 01:55:46,640 --> 01:55:47,280 THREE DAYS WHEREAS THEY WOULDN'T 2818 01:55:47,280 --> 01:55:47,680 HAVE BEFORE. 2819 01:55:47,680 --> 01:55:50,120 WE NEED TO HAVE ALL THE 2820 01:55:50,120 --> 01:55:51,960 DIFFERENT MESSAGES AND NEED THE 2821 01:55:51,960 --> 01:55:55,080 STICKS AND CARROTS BUT WHEN YOU 2822 01:55:55,080 --> 01:55:56,520 HAVE YOUR FIRST CONVERSATION 2823 01:55:56,520 --> 01:56:00,640 WITH A RESEARCHER FOCUSSING ON 2824 01:56:00,640 --> 01:56:02,080 BENEFITS FIRST GETS TO A POINT 2825 01:56:02,080 --> 01:56:03,480 TO HAVING A BIGGER CONVERSATION 2826 01:56:03,480 --> 01:56:04,840 HOW THIS BENEFITS MORE PEOPLE 2827 01:56:04,840 --> 01:56:15,240 AND RESEARCH IN GENERAL. 2828 01:56:20,080 --> 01:56:22,120 >> KEEP YOUR HAND RAISED IF YOU 2829 01:56:22,120 --> 01:56:25,920 WORK AT A UNIVERSITY OR ACADEMIC 2830 01:56:25,920 --> 01:56:34,480 INSTITUTION. 2831 01:56:34,480 --> 01:56:35,800 RAISE YOUR HAND IF YOU WORK AT 2832 01:56:35,800 --> 01:56:38,640 THE NIH OR A GOVERNMENT RESEARCH 2833 01:56:38,640 --> 01:56:39,200 INSTITUTION. 2834 01:56:39,200 --> 01:56:40,680 THOSE TWO COMBINED IS ALMOST 2835 01:56:40,680 --> 01:56:42,480 EVERYBODY IN THE ROOM. 2836 01:56:42,480 --> 01:56:44,640 SO WHEN WE'RE TALKING ABOUT A 2837 01:56:44,640 --> 01:56:45,840 CONVERSATION AND COMMENT WE 2838 01:56:45,840 --> 01:56:47,720 HEARD, IT'S ABOUT A PARTICULAR 2839 01:56:47,720 --> 01:56:49,680 TYPE OF INDIVIDUAL AND A 2840 01:56:49,680 --> 01:56:51,120 PARTICULAR TYPE OF WORK SETTING. 2841 01:56:51,120 --> 01:56:53,800 THAT'S THE INDIVIDUAL ACADEMIC 2842 01:56:53,800 --> 01:56:56,240 CHOOSING HIS OR HER PROJECTS 2843 01:56:56,240 --> 01:56:58,920 WORKING LARGELY ON HIS OR HER 2844 01:56:58,920 --> 01:57:00,600 OWN WITH MINIMAL REGULATORY 2845 01:57:00,600 --> 01:57:02,680 OVERSIGHT OF THEIR PRODUCTS. 2846 01:57:02,680 --> 01:57:05,640 THAT'S ONE PART AND A VERY 2847 01:57:05,640 --> 01:57:09,160 IMPORTANT PART, THE PART I LIVE 2848 01:57:09,160 --> 01:57:11,600 IN, THE RESEARCH EDEAVOR BUT 2849 01:57:11,600 --> 01:57:12,680 IT'S ONLY ONE PART. 2850 01:57:12,680 --> 01:57:13,640 -- ENDEAVOR. 2851 01:57:13,640 --> 01:57:14,600 IT'S ONLY ONE PART. 2852 01:57:14,600 --> 01:57:17,640 I DON'T KNOW THE NUMBERS EXACTLY 2853 01:57:17,640 --> 01:57:24,880 BUT THE CNS BUDGET OF PFIZER 2854 01:57:24,880 --> 01:57:35,440 PHARMACEUTICALS PROBABLY RIVALS 2855 01:57:39,960 --> 01:57:42,960 THE NINDS' BUDGET AND INCENTIVES 2856 01:57:42,960 --> 01:57:44,400 ARE DIFFERENT AND PEOPLE PERFORM 2857 01:57:44,400 --> 01:57:45,640 DIFFERENTLY IN THEM AND THOSE 2858 01:57:45,640 --> 01:57:47,760 BECOME AN ILLUSTRATION WE MAY BE 2859 01:57:47,760 --> 01:57:49,360 ONLY SEEING THINGS FROM ONE 2860 01:57:49,360 --> 01:57:50,040 POINT OF VIEW AND WE TALK ABOUT 2861 01:57:50,040 --> 01:57:51,720 THE INCENTIVES. 2862 01:57:51,720 --> 01:57:54,240 HOW IS IT PHARMA OR ANOTHER 2863 01:57:54,240 --> 01:57:56,480 GROUP IS ABLE TO MOTIVATE PEOPLE 2864 01:57:56,480 --> 01:58:00,080 TO WORK VERY HARD AND VERY 2865 01:58:00,080 --> 01:58:02,680 RAPIDLY AND VERY RIGOROUSLY TO 2866 01:58:02,680 --> 01:58:04,080 SOLVE PROBLEMS LIKE PRODUCE 2867 01:58:04,080 --> 01:58:04,360 VACCINES? 2868 01:58:04,360 --> 01:58:06,520 SO I THINK WE NEED TO THINK 2869 01:58:06,520 --> 01:58:07,360 THERE ARE MULTIPLE MODELS OUT 2870 01:58:07,360 --> 01:58:10,640 THERE AND THERE'S A WHOLE BODY 2871 01:58:10,640 --> 01:58:12,240 OF RESEARCH THAT HAS VARYING 2872 01:58:12,240 --> 01:58:13,800 DEGREES OF TRUSTWORTHINESS AND 2873 01:58:13,800 --> 01:58:15,960 TRUST FOR DIFFERENT THINGS OTHER 2874 01:58:15,960 --> 01:58:17,800 THAN WHAT WE'RE TALKING ABOUT 2875 01:58:17,800 --> 01:58:24,040 AND I THINK DR. MACLEOD WANTS TO 2876 01:58:24,040 --> 01:58:24,240 COMMENT. 2877 01:58:24,240 --> 01:58:27,520 >> AND THERE'S BEEN SOME WHO 2878 01:58:27,520 --> 01:58:29,480 WORKED WITH US ON 2879 01:58:29,480 --> 01:58:34,200 REPRODUCIBILITY ISSUES AND TALK 2880 01:58:34,200 --> 01:58:38,560 ABOUT PHARMA AND RIGOROUS 2881 01:58:38,560 --> 01:58:38,840 RESEARCH. 2882 01:58:38,840 --> 01:58:39,080 THOMAS. 2883 01:58:39,080 --> 01:58:42,160 >> THOMAS, COME TO THE 2884 01:58:42,160 --> 01:58:42,680 MICROPHONE. 2885 01:58:42,680 --> 01:58:53,160 >> I'M THOMAS STIGLER FROM 2886 01:58:57,840 --> 01:58:59,440 JOHNSON AND IF YOU HAVE 2887 01:58:59,440 --> 01:59:00,640 UNRELIABLE DATA YOU COME TO 2888 01:59:00,640 --> 01:59:02,680 UNRELIABLE DECISIONS AND THAT OF 2889 01:59:02,680 --> 01:59:05,280 COURSE INVALIDATES PROJECTS YOU 2890 01:59:05,280 --> 01:59:07,760 SPENT MILLIONS AND MILLIONS ON 2891 01:59:07,760 --> 01:59:10,360 COMPOUNDS THAT DROP OUT IN THE 2892 01:59:10,360 --> 01:59:13,360 CLINIC EVENTUALLY BECAUSE OF 2893 01:59:13,360 --> 01:59:15,200 WRONG DECISIONS BASED ON SHADY 2894 01:59:15,200 --> 01:59:15,400 DATA. 2895 01:59:15,400 --> 01:59:16,720 FOR PHARMA IT'S VERY IMPORTANT 2896 01:59:16,720 --> 01:59:18,680 TO HAVE RELIABLE DATA YOU CAN 2897 01:59:18,680 --> 01:59:26,400 BASE DECISIONS ON. 2898 01:59:26,400 --> 01:59:30,320 WE HAVE COMBINED TOP-DOWN AND 2899 01:59:30,320 --> 01:59:31,640 BOTTOM-UP APPROACH. 2900 01:59:31,640 --> 01:59:33,360 WE HAVE SENIOR MANAGEMENT BUY-IN 2901 01:59:33,360 --> 01:59:39,240 AND HAVE BUILT A COMMUNITY OF 2902 01:59:39,240 --> 01:59:49,760 CHAMPIONS THAT WOULD AND WE HAVE 2903 01:59:49,760 --> 01:59:51,440 INTERNAL AUDIT TO SEE WHAT 2904 01:59:51,440 --> 01:59:52,840 PEOPLE DO AND TOOK US A LOT OF 2905 01:59:52,840 --> 01:59:56,400 TIME TO CONVINCE PEOPLE THIS IS 2906 01:59:56,400 --> 01:59:56,920 NOT A POLICE. 2907 01:59:56,920 --> 01:59:59,760 JUST WE WANT TO DETECT 2908 01:59:59,760 --> 02:00:01,400 WRONGDOING BUT HAVING 2909 02:00:01,400 --> 02:00:06,640 PARTNERSHIPS TO IMPROVE THE 2910 02:00:06,640 --> 02:00:12,120 CURRENT PRACTICES. 2911 02:00:12,120 --> 02:00:13,520 WE SEE LESS AND LESS ISSUES. 2912 02:00:13,520 --> 02:00:13,880 >> VERY GOOD. 2913 02:00:13,880 --> 02:00:24,160 THANK YOU, SIR. 2914 02:00:30,680 --> 02:00:34,640 >> I'VE BEEN MORE OF A 2915 02:00:34,640 --> 02:00:37,240 METASCIENTIST AND WE CAN USE THE 2916 02:00:37,240 --> 02:00:38,760 ACADEMIC MODEL FOR BETTER OR FOR 2917 02:00:38,760 --> 02:00:41,760 WORSE AND APRIL THIS MAY BE A 2918 02:00:41,760 --> 02:00:43,560 LITTLE BIT DIRECTED AT YOU AND 2919 02:00:43,560 --> 02:00:45,080 THERE'S EARLY CAREER RESEARCHERS 2920 02:00:45,080 --> 02:00:46,520 YOU CALLED OUT AND THEY'RE THE 2921 02:00:46,520 --> 02:00:51,520 ONES MOTIVATED MORE SO TO DO 2922 02:00:51,520 --> 02:00:55,760 RIGOROUS PRACTICE AND I'M MAKING 2923 02:00:55,760 --> 02:00:59,000 AN ASSERTION WITH NO EVIDENCE. 2924 02:00:59,000 --> 02:01:01,760 >> YOU'RE IN GOOD COMPANY. 2925 02:01:01,760 --> 02:01:05,040 >> THE MOM, THE LAB, IS THE ONE 2926 02:01:05,040 --> 02:01:05,480 THEY SIT IN. 2927 02:01:05,480 --> 02:01:07,160 I'M CURIOUS WITH REFLECTIONS IN 2928 02:01:07,160 --> 02:01:10,840 THIS GROUP WHICH IS HOW DOES 2929 02:01:10,840 --> 02:01:14,640 THAT GET EITHER COMPLIMENTED OR 2930 02:01:14,640 --> 02:01:20,200 RESISTED WHEN THE RESEARCHER 2931 02:01:20,200 --> 02:01:22,520 COMES BACK IN THE LAB 2932 02:01:22,520 --> 02:01:23,680 ENVIRONMENT THE INSTITUTION'S 2933 02:01:23,680 --> 02:01:25,560 PROBABLY FURTHER AWAY AND WE 2934 02:01:25,560 --> 02:01:27,920 HAVEN'T TALKED ABOUT THE MIDDLE 2935 02:01:27,920 --> 02:01:29,000 LAYER. 2936 02:01:29,000 --> 02:01:31,040 IT'S FUNDER INSTITUTION OR 2937 02:01:31,040 --> 02:01:33,840 RESEARCHER AT THE BOTTOM AND 2938 02:01:33,840 --> 02:01:34,600 THERE'S STRUCTURE IN THE 2939 02:01:34,600 --> 02:01:37,280 DIFFERENT SECTORS THAT PROBABLY 2940 02:01:37,280 --> 02:01:38,640 ARE MORE INFLUENCING FACTORS OF 2941 02:01:38,640 --> 02:01:41,160 THE NORMATIVE BEHAVIOR. 2942 02:01:41,160 --> 02:01:43,720 MAYBE WE CAN CHEW ON THAT. 2943 02:01:43,720 --> 02:01:44,840 >> APRIL? 2944 02:01:44,840 --> 02:01:55,280 >> HI, I COMPLETELY AGREE. 2945 02:02:06,920 --> 02:02:08,480 LABS RUN DIFFERENTLY AND SOME 2946 02:02:08,480 --> 02:02:13,800 MAY BE DOING THE SAME PROTOCOLS. 2947 02:02:13,800 --> 02:02:22,680 JUST A LITTLE BIT ABOUT WLAE WE 2948 02:02:22,680 --> 02:02:29,120 TALK ABOUT WE ASK SOMEONE TO RUN 2949 02:02:29,120 --> 02:02:35,320 WHAT THEY THINK THEY'RE LAB CAN 2950 02:02:35,320 --> 02:02:37,800 TALK ABOUT ADOPTING AN 2951 02:02:37,800 --> 02:02:38,720 ELECTRONIC LAB NOTEBOOK FOR 2952 02:02:38,720 --> 02:02:41,360 YEARS AND YEARS AND NO ONE DOES 2953 02:02:41,360 --> 02:02:41,560 IT. 2954 02:02:41,560 --> 02:02:42,600 SOMETIMES IT'S LIKE THE 2955 02:02:42,600 --> 02:02:43,440 CONVERSATIONS ARE THERE AND THEY 2956 02:02:43,440 --> 02:02:45,240 JUST NEED ONE PERSON IN THE LAB 2957 02:02:45,240 --> 02:02:46,640 TO PUSH IT INTO LIKE ACTIONS 2958 02:02:46,640 --> 02:02:50,280 THAT WE TRY AND GIVE THEM TINY 2959 02:02:50,280 --> 02:02:51,240 THINGS THAT LIKE WHAT MALCOLM 2960 02:02:51,240 --> 02:02:53,840 WAS SAYING UNLIKELY TO CAUSE A 2961 02:02:53,840 --> 02:02:54,240 LOT OF RESISTANCE. 2962 02:02:54,240 --> 02:02:56,440 THAT'S PART OF WHY WE DON'T HAVE 2963 02:02:56,440 --> 02:02:58,200 A LOT OF STUFF IN OUR CONTENT 2964 02:02:58,200 --> 02:03:01,880 THAT IS A BIG LIFT BECAUSE MY 2965 02:03:01,880 --> 02:03:04,120 PERSONAL EXPERIENCE IS THAT IT 2966 02:03:04,120 --> 02:03:06,640 DOESN'T REALLY MATTER. 2967 02:03:06,640 --> 02:03:10,680 IF YOUR P.I. IS NOT INTERESTED 2968 02:03:10,680 --> 02:03:13,760 IN ADOPTING THE METHOD IT'S NOT 2969 02:03:13,760 --> 02:03:14,040 HAPPENING. 2970 02:03:14,040 --> 02:03:14,880 THOSE ARE MY THOUGHTS. 2971 02:03:14,880 --> 02:03:16,400 IT'S A STICKY PROBLEM. 2972 02:03:16,400 --> 02:03:26,720 IT'S A HARD PROBLEM. 2973 02:03:29,840 --> 02:03:33,080 >> LET ME EMPHASIZE WHAT JASON 2974 02:03:33,080 --> 02:03:34,120 WAS SAYING ABOUT MOM AND I DON'T 2975 02:03:34,120 --> 02:03:36,320 KNOW IF EVERYBODY KNOWS BUT THE 2976 02:03:36,320 --> 02:03:37,840 THE T32 TRAINING REQUIREMENTS 2977 02:03:37,840 --> 02:03:40,960 WHICH HAVE HUGE IMPACT AND YOU 2978 02:03:40,960 --> 02:03:42,160 PROBABLY KNOW THIS THEY 2979 02:03:42,160 --> 02:03:43,120 RECOGNIZE THIS PROBLEM AND SAY 2980 02:03:43,120 --> 02:03:45,680 NOT ONLY SHOULD RIGOR AND 2981 02:03:45,680 --> 02:03:47,400 REPRODUCIBILITY BE TAUGHT TO ALL 2982 02:03:47,400 --> 02:03:49,200 TRAINEES UNDER THESE GRANTS 2983 02:03:49,200 --> 02:03:54,000 WHICH SUPPORT A HUGE PROPORTION 2984 02:03:54,000 --> 02:03:57,560 OF PRE-DOC AND POST-DOC 2985 02:03:57,560 --> 02:03:58,680 RESEARCHERS BUT YOU HAVE TO SHOW 2986 02:03:58,680 --> 02:04:00,920 IN YOUR APPLICATION AND AGAIN 2987 02:04:00,920 --> 02:04:02,040 WE'RE JUST STARTING -- THIS CAME 2988 02:04:02,040 --> 02:04:04,560 OUT IN MARCH OF 2020, YOU HAVE 2989 02:04:04,560 --> 02:04:08,320 TO SHOW THE FACULTY WHO ARE 2990 02:04:08,320 --> 02:04:09,520 GOING TO BE ROLE MODELLING THIS 2991 02:04:09,520 --> 02:04:10,680 IN YOUR LABS. 2992 02:04:10,680 --> 02:04:12,720 DON'T KNOW THE FACT THEY'RE 2993 02:04:12,720 --> 02:04:18,160 COMPLETELY PREPARED FOR THIS 2994 02:04:18,160 --> 02:04:23,680 REQUIREMENT AND IT MAKES GROUPS 2995 02:04:23,680 --> 02:04:25,680 LIKE MINE AND OTHERS MAKE OUR 2996 02:04:25,680 --> 02:04:29,840 JOBS EASIER BECAUSE WE CAN SAY 2997 02:04:29,840 --> 02:04:32,280 WE'RE PREPARING THE INSTITUTION 2998 02:04:32,280 --> 02:04:33,040 FOR THIS REQUIREMENT. 2999 02:04:33,040 --> 02:04:33,600 IT'S INTERESTING. 3000 02:04:33,600 --> 02:04:41,720 I T WAS REALLY 3001 02:04:41,720 --> 02:04:42,960 INTERESTING THE PRACTICE 3002 02:04:42,960 --> 02:04:44,880 REQUIREMENT AND AS I SAID, I 3003 02:04:44,880 --> 02:04:45,240 DON'T KNOW. 3004 02:04:45,240 --> 02:04:47,600 IT REMAINS TO BE SEEN TO WHAT 3005 02:04:47,600 --> 02:04:49,880 TENT IT'S WORDS ON PAPER AND 3006 02:04:49,880 --> 02:04:51,480 THEY'LL DO IT -- EXTENT IT'S 3007 02:04:51,480 --> 02:04:52,440 WORDS ON PAPER BECAUSE YOU'RE 3008 02:04:52,440 --> 02:04:55,280 RIGHT WE COULD BE RUNNING THEM 3009 02:04:55,280 --> 02:04:57,320 INTO A CONCRETE WALL WHERE WE 3010 02:04:57,320 --> 02:04:59,760 TRAIN AND THEY GO IN THE LAB AND 3011 02:04:59,760 --> 02:05:01,400 DON'T SEE THEM AND GET 3012 02:05:01,400 --> 02:05:06,720 UNEDUCATED OR UNTRAINED OR 3013 02:05:06,720 --> 02:05:10,080 CYNICAL. 3014 02:05:10,080 --> 02:05:18,280 >> IT'S AN IMPORTANT POINT AND 3015 02:05:18,280 --> 02:05:21,120 WE NEED TO RECOGNIZE THE 3016 02:05:21,120 --> 02:05:22,560 CANOPOLY OF THE POTENTIAL TOOLS 3017 02:05:22,560 --> 02:05:24,960 AVAILABLE TO US TO EFFECT CHANGE 3018 02:05:24,960 --> 02:05:31,240 AND NOT GET FIXATED ON ONE. 3019 02:05:31,240 --> 02:05:34,040 WHETHER THAT'S SOCIAL CHANGE OF 3020 02:05:34,040 --> 02:05:35,480 A CATALYZING MOMENT OF AN 3021 02:05:35,480 --> 02:05:36,440 EXEMPLAR. 3022 02:05:36,440 --> 02:05:39,680 THIS GOES BACK TO THE QUESTION 3023 02:05:39,680 --> 02:05:41,280 OF SHOULD WE HAVE MANY SMALL 3024 02:05:41,280 --> 02:05:44,520 CHANGES OR A FEW BIG ONES. 3025 02:05:44,520 --> 02:05:47,040 SOMETIMES BIG ONES CAN CATALYZE 3026 02:05:47,040 --> 02:05:47,480 IDEAS. 3027 02:05:47,480 --> 02:05:49,320 NO ONE COULD BREAK THE 3028 02:05:49,320 --> 02:05:51,880 FOUR-MINUTE MILE UNTIL ROGER 3029 02:05:51,880 --> 02:05:53,600 BANISTER BROKE THE FOUR-MINUTE 3030 02:05:53,600 --> 02:05:55,280 MILE AND THEN LOTS OF PEOPLE 3031 02:05:55,280 --> 02:05:57,800 BROKE THE FOUR-MINUTE MILE. 3032 02:05:57,800 --> 02:06:00,640 IS IT IMPORTANT TO HAVE THE ONE 3033 02:06:00,640 --> 02:06:01,800 CATALYZING MOMENT? 3034 02:06:01,800 --> 02:06:07,320 OTHERWISE IT'S A LAW. 3035 02:06:07,320 --> 02:06:10,480 VIRTUOUSO JAZZ CAME OUT BECAUSE 3036 02:06:10,480 --> 02:06:13,280 THEY TAXED AND SO LAWS PROMOTE 3037 02:06:13,280 --> 02:06:23,440 THINGS. 3038 02:06:27,320 --> 02:06:33,800 AND EDUCATION AND WHETHER IT'S 3039 02:06:33,800 --> 02:06:37,360 RULES OR THE LAWYERS SAY OR 3040 02:06:37,360 --> 02:06:39,720 VIRTUOSO JAZZ IS BORN OUT OF 3041 02:06:39,720 --> 02:06:42,320 RULES WE NEED TO LOOK AT THE 3042 02:06:42,320 --> 02:06:47,600 WHERE THE LEVERAGE POINTS. 3043 02:06:47,600 --> 02:06:50,480 >> I'M A PRACTICING LABORATORY 3044 02:06:50,480 --> 02:06:53,280 SCIENTISTS AND TEACH BIO 3045 02:06:53,280 --> 02:06:55,000 STATISTICS IN THE PROGRAM IN 3046 02:06:55,000 --> 02:06:55,240 BIOLOGY. 3047 02:06:55,240 --> 02:06:56,440 I APPRECIATED HEARING FROM STEVE 3048 02:06:56,440 --> 02:07:00,040 AND MALCOLM AND MAYBE OTHERS. 3049 02:07:00,040 --> 02:07:05,760 A RECOGNITION OF THE DIVERSITY 3050 02:07:05,760 --> 02:07:06,960 OF SCIENTIFIC PRACTICES AND 3051 02:07:06,960 --> 02:07:08,840 THERE'S MANY BIOLOGIES AND WHAT 3052 02:07:08,840 --> 02:07:10,480 KIND OF PROCEDURES THEY USE ARE 3053 02:07:10,480 --> 02:07:12,800 UNIQUE TO EACH DISCIPLINE AND 3054 02:07:12,800 --> 02:07:14,080 SUB DISCIPLINE THERE ISN'T GOING 3055 02:07:14,080 --> 02:07:16,040 TO BE A ONE-SIZE FITS ALL REFORM 3056 02:07:16,040 --> 02:07:17,560 AND THAT'S WHY IT'S SO IMPORTANT 3057 02:07:17,560 --> 02:07:20,800 THEY BUBBLE UP FROM WITHIN 3058 02:07:20,800 --> 02:07:23,080 COMMUNITIES AND NOT BE IMPOSED 3059 02:07:23,080 --> 02:07:24,480 ON THEM. 3060 02:07:24,480 --> 02:07:25,960 IN CONNECTION WITH THAT, I 3061 02:07:25,960 --> 02:07:27,360 WANTED TO TALK ABOUT THE 3062 02:07:27,360 --> 02:07:28,440 MOTIVATION TO GET THESE 3063 02:07:28,440 --> 02:07:30,720 COMMUNITIES TO TAKE THIS ON AND 3064 02:07:30,720 --> 02:07:33,080 I HAD THOUGHTS I WANTED TO SHARE 3065 02:07:33,080 --> 02:07:34,120 ABOUT THAT. 3066 02:07:34,120 --> 02:07:41,880 ONE HAD TO DO WITH WHAT WE HEARD 3067 02:07:41,880 --> 02:07:52,400 WITH REPUTATION WE WANT TO BE 3068 02:08:09,000 --> 02:08:11,080 VIEWED AS A FIELD THAT'S 3069 02:08:11,080 --> 02:08:12,680 EXCELLENT AND WHY DON'T WE STHOU 3070 02:08:12,680 --> 02:08:23,200 THAT BY DEVELOPING STANDARDS. 3071 02:08:28,800 --> 02:08:31,720 >> I HAVE THE GOOD FORTUNE AS 3072 02:08:31,720 --> 02:08:32,680 WELL AS THE SAME SIMULTANEOUSLY 3073 02:08:32,680 --> 02:08:35,920 OF WORKING IN THE FIELD OF 3074 02:08:35,920 --> 02:08:36,200 NUTRITION. 3075 02:08:36,200 --> 02:08:38,920 THAT'S ONE WHERE ACCORDING TO 3076 02:08:38,920 --> 02:08:40,840 THE CHARITABLE TRUST DATA TRUST 3077 02:08:40,840 --> 02:08:42,560 IN NUTRITION SCIENTISTS IS LOWER 3078 02:08:42,560 --> 02:08:44,960 THAN TRUST IN OTHER SCIENTISTS 3079 02:08:44,960 --> 02:08:49,320 AND LOWER THAN TRUST IN 3080 02:08:49,320 --> 02:08:59,720 NUTRITION PRACTITIONERS. 3081 02:09:01,560 --> 02:09:06,120 AND ABLE TO QUANTITATIVELY SCORE 3082 02:09:06,120 --> 02:09:07,560 THE TRUST OF DIFFERENT JOURNALS 3083 02:09:07,560 --> 02:09:13,160 AND INSTITUTIONS WOULD BE 3084 02:09:13,160 --> 02:09:16,240 USEFUL. 3085 02:09:16,240 --> 02:09:18,240 >> THE OTHER POINT IN MOTIVATION 3086 02:09:18,240 --> 02:09:21,960 IS IT'S DE-MOTIVATING TO A 3087 02:09:21,960 --> 02:09:23,360 COMMUNITY SO HAVE SOMEONE COME 3088 02:09:23,360 --> 02:09:25,520 AND SAY WE'RE GOING TO FIX YOU 3089 02:09:25,520 --> 02:09:26,920 AND WE'RE HAVING A CONVERSATION 3090 02:09:26,920 --> 02:09:29,720 HOW TO GET PEOPLE TO CHANGE YOUR 3091 02:09:29,720 --> 02:09:32,840 BEHAVIOR BECAUSE WE DECIDED IT'S 3092 02:09:32,840 --> 02:09:37,320 BAD AND WE'RE STRATEGIZING HOW 3093 02:09:37,320 --> 02:09:47,640 TO MANIPULATE YOU. 3094 02:09:53,760 --> 02:09:56,600 IT WOULD BE MORE MOTIVATING TO 3095 02:09:56,600 --> 02:09:58,000 HAVING THE RHETORIC OF ASSERTING 3096 02:09:58,000 --> 02:10:00,080 WHAT THEY TAKE TO BE THEIR 3097 02:10:00,080 --> 02:10:01,640 RIGOROUS GOOD PRACTICE. 3098 02:10:01,640 --> 02:10:05,240 IN THAT SELF-EXAMINATION THEY 3099 02:10:05,240 --> 02:10:06,840 MAY STUMBLE ON WE HAVE A PROBLEM 3100 02:10:06,840 --> 02:10:08,160 HERE AND IDENTIFY THINGS THAT 3101 02:10:08,160 --> 02:10:09,840 NEED TO BE CHANGED BUT IF THEY 3102 02:10:09,840 --> 02:10:11,040 IDENTIFY THINGS THAT NEED TO BE 3103 02:10:11,040 --> 02:10:12,480 CHANGED IT'S MORE MOTIVATING TO 3104 02:10:12,480 --> 02:10:16,840 SEEK OUT THE CHANGES. 3105 02:10:16,840 --> 02:10:22,120 I FEEL LIKE FRAMING IT WITHOUT 3106 02:10:22,120 --> 02:10:24,720 THE PRESUMPTION THERE'S A CHANGE 3107 02:10:24,720 --> 02:10:26,000 AND LATE THE CHANGE COME FROM 3108 02:10:26,000 --> 02:10:26,520 THE TEAM. 3109 02:10:26,520 --> 02:10:30,560 >> I VERY MUCH LIKE THAT AND ASK 3110 02:10:30,560 --> 02:10:31,520 PROFESSOR MACLEOD TO RESPOND 3111 02:10:31,520 --> 02:10:32,760 BRIEFLY AND THEN APRIL BRIEFLY 3112 02:10:32,760 --> 02:10:33,960 AND THEN I'LL TRY TO BE BRIEF. 3113 02:10:33,960 --> 02:10:37,320 >> I AGREE BUT I WOULDN'T USE 3114 02:10:37,320 --> 02:10:38,840 THE WORD PROBLEM BECAUSE PROBLEM 3115 02:10:38,840 --> 02:10:40,360 IMPLIES A NEGATIVE. 3116 02:10:40,360 --> 02:10:42,200 WHEN WE APPROACH COMMUNITIES 3117 02:10:42,200 --> 02:10:46,080 IT'S HOW DO YOU RECOGNIZE GOOD 3118 02:10:46,080 --> 02:10:47,600 RESEARCH IN YOUR AREA AND ARE 3119 02:10:47,600 --> 02:10:49,160 YOU AS GOOD AS AS YOU COULD EVER 3120 02:10:49,160 --> 02:10:53,360 EXPECT TO BE AND WHERE CAN YOU 3121 02:10:53,360 --> 02:10:57,440 GET CLOSER TO BEING PERFECT AND 3122 02:10:57,440 --> 02:10:58,480 WOULD TAKE PROBLEM OUT OUT. 3123 02:10:58,480 --> 02:11:00,520 >> I SEE THE COMMUNICATION FROM 3124 02:11:00,520 --> 02:11:01,840 THE SCIENCE REFORM MOVEMENT AND 3125 02:11:01,840 --> 02:11:06,200 I THINK IT GETS RESISTANCE 3126 02:11:06,200 --> 02:11:06,920 GOING. 3127 02:11:06,920 --> 02:11:08,520 SALT OF THE EARTH AS SOMEONE 3128 02:11:08,520 --> 02:11:08,720 SAID. 3129 02:11:08,720 --> 02:11:10,120 >> APRIL. 3130 02:11:10,120 --> 02:11:16,200 >> WHEN WE TALK ABOUT 3131 02:11:16,200 --> 02:11:18,080 REPRODUCIBILITY WE TALK ABOUT 3132 02:11:18,080 --> 02:11:28,440 WAYS OF CHANGING IT. 3133 02:11:31,160 --> 02:11:35,240 >> AND THERE'S A NARRATIVE IN 3134 02:11:35,240 --> 02:11:36,400 THE GOOD OLD DAYS WE NEW 3135 02:11:36,400 --> 02:11:38,600 SOMETHING AND THINGS ARE BAD NOW 3136 02:11:38,600 --> 02:11:41,760 AND WE'RE IN CRISIS AND WE MUST 3137 02:11:41,760 --> 02:11:42,000 CHANGE. 3138 02:11:42,000 --> 02:11:44,640 I WILL ASSERT WITHOUT HAVING 3139 02:11:44,640 --> 02:11:45,840 COMPLETE AND THOROUGH DATA 3140 02:11:45,840 --> 02:11:49,960 THOUGH I CAN BRING SOME DATA TO 3141 02:11:49,960 --> 02:11:52,360 BEAR ON THIS IS THE GOOD OLD 3142 02:11:52,360 --> 02:11:53,880 DAYS WEREN'T THAT GOOD. 3143 02:11:53,880 --> 02:12:01,320 I CAN SHOW YOU FROM MENDEL AND 3144 02:12:01,320 --> 02:12:03,400 PASTUR AND OTHERS OBFUSCATED 3145 02:12:03,400 --> 02:12:07,760 DATA, ETCETERA, BY MANY 3146 02:12:07,760 --> 02:12:09,920 INDICATORS, SCIENCE IS MORE 3147 02:12:09,920 --> 02:12:10,680 RIGOROUS AND REPRODUCIBILITY AND 3148 02:12:10,680 --> 02:12:11,880 TRANSPARENT TODAY THAN IT HAS 3149 02:12:11,880 --> 02:12:12,800 EVER BEEN BUT WE STILL HAVE A 3150 02:12:12,800 --> 02:12:13,560 LONG WAY TO GO. 3151 02:12:13,560 --> 02:12:23,880 AND THAT'S SAYING THINGS ARE 3152 02:12:23,880 --> 02:12:27,040 WORSE AND WE'RE IN CRISIS BUT 3153 02:12:27,040 --> 02:12:28,640 THINGS ARE BETTER THAN THEN BUT 3154 02:12:28,640 --> 02:12:36,960 COULD BE BETTER STILL. 3155 02:12:36,960 --> 02:12:38,200 >> I REPRESENT THE HEALTH 3156 02:12:38,200 --> 02:12:42,160 RESEARCH ALLIANCE A GROUP THAT 3157 02:12:42,160 --> 02:12:44,000 DR. ALISON MISSED WHEN WE WERE 3158 02:12:44,000 --> 02:12:48,960 DOING THE HAND RAISING SO YOU 3159 02:12:48,960 --> 02:12:53,280 CAN IMAGINE THE LEVERAGE PEOPLE 3160 02:12:53,280 --> 02:12:56,360 LIKE THE AMERICAN HEART SOCIETY 3161 02:12:56,360 --> 02:12:58,120 AND OTHER WEALTHIER 3162 02:12:58,120 --> 02:12:59,080 ORGANIZATIONS HAVE IN THE SPACE 3163 02:12:59,080 --> 02:13:00,840 AND THIS WASN'T MY QUESTION BUT 3164 02:13:00,840 --> 02:13:01,480 IT CAME OUT EARLIER. 3165 02:13:01,480 --> 02:13:04,480 WE HAVE THE LEVERAGE. 3166 02:13:04,480 --> 02:13:07,320 YOU ASK ON AN APPLICATION DO YOU 3167 02:13:07,320 --> 02:13:10,120 USE PRE PRINTS YOU CAN IMAGINE 3168 02:13:10,120 --> 02:13:12,000 THE APPLICANT GOING WHAT ARE YOU 3169 02:13:12,000 --> 02:13:13,160 TALKING ABOUT? 3170 02:13:13,160 --> 02:13:15,240 OR ASKING WHERE IS YOUR DATA 3171 02:13:15,240 --> 02:13:15,480 SHARED? 3172 02:13:15,480 --> 02:13:17,560 YOU DON'T WANT TO LEAVE THINGS 3173 02:13:17,560 --> 02:13:20,720 BLANK ON AN APPLICATION SO BY 3174 02:13:20,720 --> 02:13:23,840 FOLLOWING THE NIH AND THE NINDS 3175 02:13:23,840 --> 02:13:29,840 NOW THE RIGOR THE GUIDELINES, 3176 02:13:29,840 --> 02:13:30,880 NON-PROFIT FUNDERS CAN ALSO MOVE 3177 02:13:30,880 --> 02:13:32,160 BY NUDGING BEHAVIOR. 3178 02:13:32,160 --> 02:13:36,880 MY QUESTION IS LET'S GO BACK TO 3179 02:13:36,880 --> 02:13:38,480 DAMON'S TALK. 3180 02:13:38,480 --> 02:13:40,320 WE BELIEVE IN THE NON-POVERTY 3181 02:13:40,320 --> 02:13:43,360 FUNDER WORLD THAT COHORTS CAN 3182 02:13:43,360 --> 02:13:44,560 MOVE AND MAKE A DIFFERENCE 3183 02:13:44,560 --> 02:13:46,240 BECAUSE YOU CERTAINLY DON'T WANT 3184 02:13:46,240 --> 02:13:47,080 TO BE THE FIRST. 3185 02:13:47,080 --> 02:13:49,960 YOU WANT TO JOIN A GROUP BUT YOU 3186 02:13:49,960 --> 02:13:53,720 SURE AS HECK DON'T WANT TO BE 3187 02:13:53,720 --> 02:13:55,200 THE LAST BUT WHAT DOES THAT 3188 02:13:55,200 --> 02:13:57,000 COHORT HAVE TO LOOK LIKE? 3189 02:13:57,000 --> 02:14:00,000 I'D LOVE TO HEAR DAMON AND 3190 02:14:00,000 --> 02:14:02,120 EVERYBODY ELSE'S EXPERIENCE WITH 3191 02:14:02,120 --> 02:14:03,720 HOW COHESIVE THAT COHORT HAS TO 3192 02:14:03,720 --> 02:14:04,160 BE. 3193 02:14:04,160 --> 02:14:06,080 IF YOU'RE GOING TO MOVE SOMEBODY 3194 02:14:06,080 --> 02:14:08,680 IN THE DIRECTION, DO ALL HAVE TO 3195 02:14:08,680 --> 02:14:13,320 BE AT ZERO AND THEN OR IN THAT 3196 02:14:13,320 --> 02:14:14,800 NODE IN THAT COHORT BECAUSE I 3197 02:14:14,800 --> 02:14:19,200 THINK WE'RE TRYING TO GET RIGOR 3198 02:14:19,200 --> 02:14:21,400 WHICH IS NOT ONE PERSON BUT A 3199 02:14:21,400 --> 02:14:24,200 GROUP OF PEOPLE THAT CAN HAVE 3200 02:14:24,200 --> 02:14:27,760 THESE WIDE BRIDGES BUT HOW CAN 3201 02:14:27,760 --> 02:14:28,520 WE BEST -- 3202 02:14:28,520 --> 02:14:28,800 >> OKAY. 3203 02:14:28,800 --> 02:14:30,600 LET'S GET DAMON UP TO ANSWER 3204 02:14:30,600 --> 02:14:35,080 YOUR QUESTION. 3205 02:14:35,080 --> 02:14:39,600 IS HE HERE? 3206 02:14:39,600 --> 02:14:41,680 >> USING THE COHORT MODEL DOES 3207 02:14:41,680 --> 02:14:43,520 IT HAVE TO BE HOMOGENOUS. 3208 02:14:43,520 --> 02:14:46,240 >> LET'S GET A RESPONSE. 3209 02:14:46,240 --> 02:14:56,760 DOES SOMEBODY WANT TO RESPOND? 3210 02:14:59,800 --> 02:15:03,240 >> DR. KAREN SULT A DEPUTY 3211 02:15:03,240 --> 02:15:05,640 DIRECTOR FROM THE LARGEST FUNDER 3212 02:15:05,640 --> 02:15:06,600 IN RESEARCH INNOVATION IN THE 3213 02:15:06,600 --> 02:15:09,200 U.K. AND MY POLICY IS AREA IS 3214 02:15:09,200 --> 02:15:11,160 FROM INTEGRITY TO OPEN DATA AND 3215 02:15:11,160 --> 02:15:15,720 SCIENCE AND RESEARCH AND 3216 02:15:15,720 --> 02:15:17,720 EQUALITY, DIVERSITY AND 3217 02:15:17,720 --> 02:15:20,880 INCLUSION AND MITIGATING 3218 02:15:20,880 --> 02:15:22,040 INTERNATIONAL RISK AND HAVE A 3219 02:15:22,040 --> 02:15:23,920 LOT TO SAY ABOUT RIGOR AS YOU 3220 02:15:23,920 --> 02:15:26,640 CAN IMAGINE AND TO GET TO THE 3221 02:15:26,640 --> 02:15:29,800 QUESTION, U.K. FUNDED FUTURE 3222 02:15:29,800 --> 02:15:32,520 LEADERS FELLOWSHIPS AND IT'S ONE 3223 02:15:32,520 --> 02:15:43,280 OF THE MORE BELALATENT EXAMPLESD 3224 02:15:57,960 --> 02:16:03,800 CREATING SETS OF SUPPORTS AND 3225 02:16:03,800 --> 02:16:05,280 WHAT DO THEY WANT TO DO THAT 3226 02:16:05,280 --> 02:16:08,200 WILL BENEFIT THE WIDER WORLD AND 3227 02:16:08,200 --> 02:16:09,600 ENABLING THEM TO DO THAT OPPOSED 3228 02:16:09,600 --> 02:16:11,840 TO YOU ARE NOW CARRYING THE 3229 02:16:11,840 --> 02:16:12,960 WEIGHT OF BEING A CHAMPION 3230 02:16:12,960 --> 02:16:15,000 THEREFORE GO OUT AND BE 3231 02:16:15,000 --> 02:16:15,880 BRILLIANT AND IF YOU'RE NOT 3232 02:16:15,880 --> 02:16:17,440 YOU'RE GOING TO SUCK. 3233 02:16:17,440 --> 02:16:19,280 NO ONE IS PUTTING THAT PRESSURE 3234 02:16:19,280 --> 02:16:21,120 ON THEM. 3235 02:16:21,120 --> 02:16:22,480 THERE'S A LOT OF DATA. 3236 02:16:22,480 --> 02:16:26,400 >> COHESIVE SELF-INTEREST AND 3237 02:16:26,400 --> 02:16:28,120 MOTIVATION AND GOALS ARE THE 3238 02:16:28,120 --> 02:16:30,360 MOST IMPORTANT THING ABOUT 3239 02:16:30,360 --> 02:16:31,480 CREATING THAT. 3240 02:16:31,480 --> 02:16:33,560 >> AND BEING VERY INTENTIONAL 3241 02:16:33,560 --> 02:16:34,880 AND STRATEGIC. 3242 02:16:34,880 --> 02:16:36,200 THERE'S A LOT OF QUESTIONS 3243 02:16:36,200 --> 02:16:39,160 AROUND I THINK COHORT CREATIONS 3244 02:16:39,160 --> 02:16:41,360 IN TERMS OF WHAT DISINCENTIVES 3245 02:16:41,360 --> 02:16:43,320 CAN YOU CREATE TO CREATE THEM IN 3246 02:16:43,320 --> 02:16:44,880 THE FIRST PLACE BUT HOW DO YOU 3247 02:16:44,880 --> 02:16:46,000 CUT AGAINST THAT AND THINK 3248 02:16:46,000 --> 02:16:47,080 CAREFULLY ABOUT THE CRITERIA AND 3249 02:16:47,080 --> 02:16:49,040 HOW YOU THINK ABOUT THE PANELS 3250 02:16:49,040 --> 02:16:51,640 OF HOW YOU SET THINGS UP AND WE 3251 02:16:51,640 --> 02:16:58,040 CAN TALK ABOUT THAT LATER. 3252 02:16:58,040 --> 02:17:06,120 I WANTED TO TALK TWO QUICK 3253 02:17:06,120 --> 02:17:09,480 THINGS AND ONE THING TO TALK 3254 02:17:09,480 --> 02:17:11,440 ABOUT IS SYSTEMS. 3255 02:17:11,440 --> 02:17:12,720 WE'VE BEEN SAYING THE WORD 3256 02:17:12,720 --> 02:17:15,120 SYSTEM BUT I DON'T THINK PEOPLE 3257 02:17:15,120 --> 02:17:16,280 HAVE BEEN TALKING ABOUT SYSTEMS 3258 02:17:16,280 --> 02:17:17,640 WE'RE JUST TALKING ABOUT THINGS 3259 02:17:17,640 --> 02:17:20,520 IN THE SYSTEM AND THE SECOND 3260 02:17:20,520 --> 02:17:21,360 PART IS SCALE. 3261 02:17:21,360 --> 02:17:23,040 THIS GOES BACK TO MALCOLM'S 3262 02:17:23,040 --> 02:17:24,480 POINT ABOUT SCALE. 3263 02:17:24,480 --> 02:17:26,160 ON THE SYSTEMS POINT I'VE NOT 3264 02:17:26,160 --> 02:17:28,520 ALWAYS BEEN WORKING FOR A FUNDER 3265 02:17:28,520 --> 02:17:30,520 AND BEING MORE OF A POLICY MAKER 3266 02:17:30,520 --> 02:17:31,880 SIDE AND STRATEGIST. 3267 02:17:31,880 --> 02:17:35,200 I CAME INTO THE ORGANIZATION AS 3268 02:17:35,200 --> 02:17:38,080 AN ACADEMIC AND RESEARCHER FROM 3269 02:17:38,080 --> 02:17:40,760 A LARGE RESEARCH TEAM BUT I'M A 3270 02:17:40,760 --> 02:17:42,040 SYSTEM'S ANALYST AND RESEARCHER 3271 02:17:42,040 --> 02:17:43,400 BY BACKGROUND. 3272 02:17:43,400 --> 02:17:45,360 I'M REALLY INTERESTED IN WHAT IS 3273 02:17:45,360 --> 02:17:49,560 THE COMPLEXITY OF UNDERSTANDING 3274 02:17:49,560 --> 02:17:52,040 A SYSTEM AND I THINK WE DO A 3275 02:17:52,040 --> 02:17:55,040 DISSERVICE AND DEFINITELY IN THE 3276 02:17:55,040 --> 02:17:58,160 U.K. AND WITHIN THE WIDER WORLD 3277 02:17:58,160 --> 02:17:59,680 OF TALKING ABOUT SYSTEMS BUT 3278 02:17:59,680 --> 02:18:01,160 WE'RE NOT TAKING SYSTEMS 3279 02:18:01,160 --> 02:18:03,080 ANALYSIS TO IT IN ANY REAL WAY. 3280 02:18:03,080 --> 02:18:08,440 WHETHER IT'S FROM ECOLOGIST OR 3281 02:18:08,440 --> 02:18:08,920 BIOLOGICAL SYSTEMS. 3282 02:18:08,920 --> 02:18:11,000 THE BIT ABOUT NETWORKS BUT THAT 3283 02:18:11,000 --> 02:18:12,960 TYPE OF WORK IS A VERY VERY 3284 02:18:12,960 --> 02:18:14,680 SPECIFIC AND YOU CAN SEE TALKING 3285 02:18:14,680 --> 02:18:17,200 ABOUT GOOGLE GLASS AND THINKING 3286 02:18:17,200 --> 02:18:19,400 ABOUT INFLUENCERS COMING OUT AND 3287 02:18:19,400 --> 02:18:21,600 PEOPLE AND THE TYPE OF CREATION, 3288 02:18:21,600 --> 02:18:24,840 IT HAS MODELS AGAINST THIS SORT 3289 02:18:24,840 --> 02:18:26,840 OF P.I. SOLE PERSON AND WHAT 3290 02:18:26,840 --> 02:18:27,280 THEY'RE DOING. 3291 02:18:27,280 --> 02:18:29,040 IT'S GOT SOME SIMILARITIES BUT 3292 02:18:29,040 --> 02:18:31,400 NOT THE SAME WHEN WE'RE ACTUALLY 3293 02:18:31,400 --> 02:18:32,480 TALKING ABOUT WHAT TRANS FORMS 3294 02:18:32,480 --> 02:18:36,240 IN YOUR FIELD OVER A PERIOD OF 3295 02:18:36,240 --> 02:18:39,120 TIME, RIGHT, SO THE RIGOR ISN'T 3296 02:18:39,120 --> 02:18:42,120 THE ONE SINGULAR MOMENT BUT A 3297 02:18:42,120 --> 02:18:43,280 PROCESS OF ADAPTATION AND HOW 3298 02:18:43,280 --> 02:18:44,640 DOES IT CHANGE OVER SCALE FROM 3299 02:18:44,640 --> 02:18:46,600 YOU WORKING ON AN INDIVIDUAL 3300 02:18:46,600 --> 02:18:47,680 PROJECT TO NOW WORKING ON 3301 02:18:47,680 --> 02:18:50,240 MULTIPLE PROJECTS 3302 02:18:50,240 --> 02:18:51,400 SIMULTANEOUSLY? 3303 02:18:51,400 --> 02:18:53,400 OR YOU'RE A PART OF 23 3304 02:18:53,400 --> 02:18:54,080 INSTITUTIONS AND NOW HAVE 3305 02:18:54,080 --> 02:18:54,880 DIFFERENT NATIONAL STANDARDS 3306 02:18:54,880 --> 02:18:58,160 YOU'VE GOT TO GRAPPLE WITH SAY 3307 02:18:58,160 --> 02:18:59,440 OVER THINGS LIKE DATA. 3308 02:18:59,440 --> 02:19:02,280 TO GIVE YOU A GREAT EXAMPLE WE 3309 02:19:02,280 --> 02:19:05,840 HAVE DATA SOVEREIGNTY ISSUES OR 3310 02:19:05,840 --> 02:19:10,440 CONCERNS RAISED BY INDIGENOUS 3311 02:19:10,440 --> 02:19:11,880 PEOPLE'S AROUND THE WORLD AND 3312 02:19:11,880 --> 02:19:13,880 THINK OF CHAMPIONING OPEN DATA 3313 02:19:13,880 --> 02:19:14,920 IT'S NOT EVEN PART OF THEIR 3314 02:19:14,920 --> 02:19:15,200 THINKING. 3315 02:19:15,200 --> 02:19:16,360 THEY'RE NOT THINKING WHAT IT 3316 02:19:16,360 --> 02:19:17,880 MEANS FOR A COLLECTIVE TO OWN 3317 02:19:17,880 --> 02:19:18,520 THE DATA. 3318 02:19:18,520 --> 02:19:20,960 NOT A COMMUNITY OR CITY BUT 3319 02:19:20,960 --> 02:19:22,640 THERE IS NO INDIVIDUAL PERSONAL 3320 02:19:22,640 --> 02:19:24,400 DATA NOW. 3321 02:19:24,400 --> 02:19:25,120 IT'S COLLECTIVELY OWNED. 3322 02:19:25,120 --> 02:19:28,760 FOR ME THE TYPE OF WORK I DO IS 3323 02:19:28,760 --> 02:19:31,080 WHERE SYSTEMS WORK IS 3324 02:19:31,080 --> 02:19:31,400 TRANSFORMED. 3325 02:19:31,400 --> 02:19:32,680 >> IS THAT A COMMENT OR 3326 02:19:32,680 --> 02:19:33,600 QUESTION? 3327 02:19:33,600 --> 02:19:35,960 >> A CHALLENGE ACTUALLY. 3328 02:19:35,960 --> 02:19:37,840 >> RESTATE THE CHALLENGE, 3329 02:19:37,840 --> 02:19:38,080 PLEASE. 3330 02:19:38,080 --> 02:19:44,920 >> ARE WE TALKING ABOUT SYSTEMS 3331 02:19:44,920 --> 02:19:46,600 REALLY THINKING ABOUT SYSTEMS 3332 02:19:46,600 --> 02:19:49,880 AND A POINT YOU RAISED, DAVID, 3333 02:19:49,880 --> 02:19:52,120 ABOUT THINKING ABOUT THE NARROW 3334 02:19:52,120 --> 02:19:54,160 SPLIT PLACE AND COMING UP WITH 3335 02:19:54,160 --> 02:19:55,320 INTERVENTIONS AND SOLUTIONS 3336 02:19:55,320 --> 02:19:56,800 MYOPIC OPPOSED TO THINKING ABOUT 3337 02:19:56,800 --> 02:19:58,680 THE LARGER STRUCTURE AND MY 3338 02:19:58,680 --> 02:19:59,600 OTHER POINT WAS SCALE. 3339 02:19:59,600 --> 02:20:02,680 ARE WE ACTUALLY THINKING ABOUT 3340 02:20:02,680 --> 02:20:02,880 SCALE? 3341 02:20:02,880 --> 02:20:04,040 I APPRECIATE MALCOLM'S POINT 3342 02:20:04,040 --> 02:20:05,640 ABOUT THINKING ABOUT SMALL AND 3343 02:20:05,640 --> 02:20:09,080 BIG BUT WE HAVE TO AGGREGATE ANT 3344 02:20:09,080 --> 02:20:10,040 WE'RE ALSONKING ABOUT THE 3345 02:20:10,040 --> 02:20:11,400 RIGOR INTEGRITY OF INSTITUTIONS 3346 02:20:11,400 --> 02:20:13,320 BECAUSE THEY HAVE TO DO THAT ALL 3347 02:20:13,320 --> 02:20:15,760 THE TIME IN DIFFERENT WAYS. 3348 02:20:15,760 --> 02:20:17,240 THERE'S THE FINANCIAL THINGS AND 3349 02:20:17,240 --> 02:20:17,640 VARIOUS PRESSURES. 3350 02:20:17,640 --> 02:20:20,040 HAVE YOU SOMEBODY LOOKING AT 3351 02:20:20,040 --> 02:20:22,640 YOUR BOOKS BUT IT'S NOT JUST 3352 02:20:22,640 --> 02:20:24,880 ABOUT RESEARCH INTEGRITY. 3353 02:20:24,880 --> 02:20:25,760 HOW DO WE BRING THESE IN THE 3354 02:20:25,760 --> 02:20:28,160 CONVERSATION MORE? 3355 02:20:28,160 --> 02:20:30,400 >> RESPONSES FROM THE AUDIENCE 3356 02:20:30,400 --> 02:20:30,640 AS WELL? 3357 02:20:30,640 --> 02:20:31,320 SOMEBODY WANT TO RESPOND TO 3358 02:20:31,320 --> 02:20:41,440 THAT? 3359 02:20:49,120 --> 02:20:51,240 MALCOLM AND LETS BE SUCCINCT. 3360 02:20:51,240 --> 02:20:53,520 >> WE NEED TO BE LOOKED AFTER 3361 02:20:53,520 --> 02:20:55,400 BUT I'D LIKE TO MAKE AN 3362 02:20:55,400 --> 02:20:57,280 DISTINCTION IN AUDIT FOR 3363 02:20:57,280 --> 02:20:58,120 IMPROVEMENT VERSUS 3364 02:20:58,120 --> 02:20:58,840 ACCOUNTABILITY. 3365 02:20:58,840 --> 02:21:00,920 SYSTEMS, ABSOLUTELY. 3366 02:21:00,920 --> 02:21:03,280 BUT MY INSTITUTION PRESUMABLY 3367 02:21:03,280 --> 02:21:05,000 HAS SYSTEMS FOR MAKING DECISIONS 3368 02:21:05,000 --> 02:21:06,960 BUT THAT'S ENTIRELY PRIVILEGED 3369 02:21:06,960 --> 02:21:08,400 INFORMATION ABOUT HOW YOU 3370 02:21:08,400 --> 02:21:10,920 ACTUALLY GET ANY CHANGE MADE AND 3371 02:21:10,920 --> 02:21:12,480 NOBODY EVER WRITES IT DOWN. 3372 02:21:12,480 --> 02:21:14,400 IF THEY WROTE IT DOWN AND 3373 02:21:14,400 --> 02:21:19,480 SOMEONE MIGHT READ IT AND WORK 3374 02:21:19,480 --> 02:21:22,400 OUT -- AND WE DID A RESEARCH 3375 02:21:22,400 --> 02:21:23,800 CULTURE SURVEY AND A KEY THEME 3376 02:21:23,800 --> 02:21:25,880 IS PEOPLE DIDN'T UNDERSTAND HOW 3377 02:21:25,880 --> 02:21:27,160 THE INSTITUTION REACHED 3378 02:21:27,160 --> 02:21:28,360 DECISIONS AND HAVING GREATER 3379 02:21:28,360 --> 02:21:30,040 TRANSPARENCY IN THOSE SYSTEMS 3380 02:21:30,040 --> 02:21:31,320 WILL GO A LONG WAY. 3381 02:21:31,320 --> 02:21:33,640 >> VERY GOOD. 3382 02:21:33,640 --> 02:21:38,960 >> I WANT TO ASK A QUESTION SO 3383 02:21:38,960 --> 02:21:41,200 WE'RE ALL I THINK COMMITTED TO 3384 02:21:41,200 --> 02:21:42,520 DATABASE THINKING HERE AND IT 3385 02:21:42,520 --> 02:21:45,400 DOESN'T MEAN WE ALWAYS HAVE DATA 3386 02:21:45,400 --> 02:21:50,920 OR ALWAYS DO IT, WHAT PERCENTAGE 3387 02:21:50,920 --> 02:21:56,080 OF PEOPLE, WHAT PERCENT OF 3388 02:21:56,080 --> 02:21:58,240 PEOPLE THAT DO SCIENCE ARE 3389 02:21:58,240 --> 02:21:58,880 TENURE TRACK AT UNIVERSITIES AND 3390 02:21:58,880 --> 02:21:59,200 INSTITUTIONS? 3391 02:21:59,200 --> 02:22:09,440 ANYBODY KNOW? 3392 02:22:12,200 --> 02:22:12,880 SCIENCE OVERALL. 3393 02:22:12,880 --> 02:22:23,440 I'LL LEAVE IT TO YOU TO DEFINE. 3394 02:22:24,440 --> 02:22:26,680 IF YOU LOOK AT Ph.D. SCIENTISTS 3395 02:22:26,680 --> 02:22:31,520 IT'S SUBSTANTIALLY UNDER 50%. 3396 02:22:31,520 --> 02:22:35,560 AND SOME MAY BE UNIVERSITIES BUT 3397 02:22:35,560 --> 02:22:36,120 NOT TENURE TRACK. 3398 02:22:36,120 --> 02:22:37,760 WHEN WE'RE THINKING ABOUT THE 3399 02:22:37,760 --> 02:22:43,320 INCENTIVES WE TALKED ABOUT AND 3400 02:22:43,320 --> 02:22:45,800 THE PARTNERSHIPS AND NEED TO 3401 02:22:45,800 --> 02:22:51,160 THINK BROADLY TO THE ELEMENTS OF 3402 02:22:51,160 --> 02:23:01,360 THE SYSTEM. 3403 02:23:21,400 --> 02:23:31,880 >> IT'S GOING TO SAVE TIME AND 3404 02:23:49,000 --> 02:23:49,160 TROUBLE. 3405 02:23:49,160 --> 02:23:51,800 >> AND LOOKING AT RIGOR IN THEIR 3406 02:23:51,800 --> 02:23:52,080 INSTITUTION. 3407 02:23:52,080 --> 02:23:53,800 IS THERE AN EQUIVALENT THIS IS 3408 02:23:53,800 --> 02:23:54,400 GOING TO BE GOOD FOR ME THIS 3409 02:23:54,400 --> 02:24:04,480 YEAR. 3410 02:24:08,600 --> 02:24:11,320 >> I WILL NOT SPEND MY TIME 3411 02:24:11,320 --> 02:24:14,240 TALKING WITH THE RESEARCH 3412 02:24:14,240 --> 02:24:17,080 INTEGRITY OFFICE WRINGING MY 3413 02:24:17,080 --> 02:24:19,240 HANDS THIS PERSON WHO MAY HAVE 3414 02:24:19,240 --> 02:24:22,000 SHOT THEMSELVES IN THE FOOT AND 3415 02:24:22,000 --> 02:24:25,000 MAY ENDED THEIR CAREER BUT I I 3416 02:24:25,000 --> 02:24:27,440 CARE ABOUT THE INTEGRITY OF 3417 02:24:27,440 --> 02:24:30,040 SCIENCE AND A WILL NOT LOSE MY 3418 02:24:30,040 --> 02:24:32,720 INVESTMENT ON THIS PERSON I'VE 3419 02:24:32,720 --> 02:24:34,400 HIRED WHO'S CAREER MAY BE OVER 3420 02:24:34,400 --> 02:24:36,400 OR MANAGE THE SCANDAL 3421 02:24:36,400 --> 02:24:38,400 POTENTIALLY OF THE MISFIRE. 3422 02:24:38,400 --> 02:24:40,640 SO THERE'S SO MUCH BENEFIT TO 3423 02:24:40,640 --> 02:24:40,960 HAVING RIGOR. 3424 02:24:40,960 --> 02:24:43,320 >> I CAN QUESTION IT BECAUSE 3425 02:24:43,320 --> 02:24:48,840 YOU'RE FOCUSSING ON BREACHES OF 3426 02:24:48,840 --> 02:24:50,080 RESEARCH INTEGRITY. 3427 02:24:50,080 --> 02:24:55,760 THE FOURTH CATEGORY THAT MALCOLM 3428 02:24:55,760 --> 02:24:59,000 THAT IS EGREGIOUS BREACHES. 3429 02:24:59,000 --> 02:25:03,960 RIGOR IS THE BOTTOM OF THE 3430 02:25:03,960 --> 02:25:06,000 ICEBERG AND SO NOBODY AT YOUR 3431 02:25:06,000 --> 02:25:08,520 INSTITUTION IS PROBABLY GOING TO 3432 02:25:08,520 --> 02:25:14,160 LOSE THEIR REPUTATION OVER DOING 3433 02:25:14,160 --> 02:25:18,720 SLOPPY WORK. 3434 02:25:18,720 --> 02:25:21,720 THAT DOESN'T REACH THAT LEVEL OF 3435 02:25:21,720 --> 02:25:22,960 PREOCCUPATION OR THAT LEVEL OF 3436 02:25:22,960 --> 02:25:23,840 IMMEDIATE MOTIVATION. 3437 02:25:23,840 --> 02:25:25,320 >> IT MAY REACH MORE THAN YOU 3438 02:25:25,320 --> 02:25:32,280 GIVE IT CREDIT FOR. 3439 02:25:32,280 --> 02:25:34,000 >> IF THE NEWSPAPERS DRIVE YOUR 3440 02:25:34,000 --> 02:25:35,480 FACULTY NAMES THROUGH THE MUD, 3441 02:25:35,480 --> 02:25:37,360 IF FUNDERS DON'T TRUST US, IT 3442 02:25:37,360 --> 02:25:41,280 DOES HAVE IMPLICATIONS BUT IT'S 3443 02:25:41,280 --> 02:25:45,080 NOT ONE TO ONE. 3444 02:25:45,080 --> 02:25:49,320 IT'S NOT A PERFECT THING OF IF 3445 02:25:49,320 --> 02:25:58,440 THIS THEN THIS HAPPENS. 3446 02:25:58,440 --> 02:26:06,000 >> IN MY OPINION I'M INCON 3447 02:26:06,000 --> 02:26:10,000 CONVENIENCE -- INCONVENIENCED TO 3448 02:26:10,000 --> 02:26:11,400 SAY WHAT DRIVES THE INSTITUTIONS 3449 02:26:11,400 --> 02:26:13,480 IS THE FUNDING AND WHEN YOU RUSH 3450 02:26:13,480 --> 02:26:15,280 TO STUDIES FOR PUBLICATION THAT 3451 02:26:15,280 --> 02:26:17,160 COULD HAVE BENEFIT FROM 3452 02:26:17,160 --> 02:26:19,320 ADDITIONAL CONTROLS OR A FEW 3453 02:26:19,320 --> 02:26:23,920 MORE SAMPLES, ETCETERA, THEN 3454 02:26:23,920 --> 02:26:25,920 THERE'S NO MOTIVATION ON THE 3455 02:26:25,920 --> 02:26:27,720 PART OF LEADERSHIP AND 3456 02:26:27,720 --> 02:26:28,920 INSTITUTIONS TO BRING ABOUT 3457 02:26:28,920 --> 02:26:30,480 CHANGE BECAUSE THEY WANT THE 3458 02:26:30,480 --> 02:26:32,360 MONEY TO COME IN AS LONG AS THE 3459 02:26:32,360 --> 02:26:37,440 MONEY'S COMING IN, THAT'S WHAT 3460 02:26:37,440 --> 02:26:39,440 THEY WILL DO. 3461 02:26:39,440 --> 02:26:41,000 THEY DEAL WITH PEOPLE AT THE TOP 3462 02:26:41,000 --> 02:26:46,280 AND THAT'S WHAT DRIVES IT. 3463 02:26:46,280 --> 02:26:49,240 I'VE SPOKEN TO RESEARCH PROVOSTS 3464 02:26:49,240 --> 02:26:50,920 AND THEY SAY WHY DO YOU WANT ME 3465 02:26:50,920 --> 02:26:51,440 TO CHANGE? 3466 02:26:51,440 --> 02:26:52,680 I JUST WANT TO LOOK AT THE 3467 02:26:52,680 --> 02:26:55,600 BOTTOM LINE. 3468 02:26:55,600 --> 02:26:57,880 >> I THINK THAT YOU'RE PARTIALLY 3469 02:26:57,880 --> 02:26:59,920 AGHT I THINK WE'D BE NAIVE 3470 02:26:59,920 --> 02:27:01,520 TO SAY OTHERWISE. 3471 02:27:01,520 --> 02:27:03,800 I DON'T THINK ANYBODY ELSE WOULD 3472 02:27:03,800 --> 02:27:07,120 SAY MONEY DOESN'T DRIVE THESE 3473 02:27:07,120 --> 02:27:10,680 BUT WE ALSO HAVEN'T PRESENTED 3474 02:27:10,680 --> 02:27:12,560 EVIDENCE THAT'S THE SOLE OR 3475 02:27:12,560 --> 02:27:13,520 OVERWHELMING DRIVER. 3476 02:27:13,520 --> 02:27:15,800 IF WE LOOK AT THE FIELD OF 3477 02:27:15,800 --> 02:27:18,240 BEHAVIORAL ECONOMICS AND BOOKS 3478 02:27:18,240 --> 02:27:27,760 LIKE DANIEL CONNAMON PEOPLE ARE 3479 02:27:27,760 --> 02:27:29,880 NOT PURELY RATIONALE BEINGS AND 3480 02:27:29,880 --> 02:27:36,320 RESPOND TO OTHER THINGS THEN 3481 02:27:36,320 --> 02:27:38,160 OTHERS AND THE JOAN OF ARCS THAT 3482 02:27:38,160 --> 02:27:40,080 WITH ALLOW THEMSELVES TO BE 3483 02:27:40,080 --> 02:27:41,360 BURNED AT THE STAKE NOT BECAUSE 3484 02:27:41,360 --> 02:27:43,600 THEY GOT PAID OFF. 3485 02:27:43,600 --> 02:27:45,200 I THINK IT'S REASONABLE TO SAY 3486 02:27:45,200 --> 02:27:46,360 THERE'S OTHER SYSTEMS. 3487 02:27:46,360 --> 02:27:50,880 I CAN GIVE YOU ANECDOTES OF 3488 02:27:50,880 --> 02:27:52,040 PEOPLE WHO TAKE TREMENDOUS PRIDE 3489 02:27:52,040 --> 02:27:57,800 IN T AIR WORK SAY I WOULD 3490 02:27:57,800 --> 02:27:59,880 NEVER PUT OUT ANYTHING I DON'T 3491 02:27:59,880 --> 02:28:01,120 BELIEVE IN AND WE HAVE TO LOOK 3492 02:28:01,120 --> 02:28:02,040 FOR DATA BECAUSE IT'S IMPORTANT 3493 02:28:02,040 --> 02:28:08,440 AS WE LOOK FOR CHANGE. 3494 02:28:08,440 --> 02:28:10,120 IS CHANGE GOING TO BE ABOUT 3495 02:28:10,120 --> 02:28:13,240 DRIVING CULTURES AND IDENTITY? 3496 02:28:13,240 --> 02:28:16,320 IF IT'S ALL ABOUT MONEY THEN ALL 3497 02:28:16,320 --> 02:28:18,120 THE COURSES WE OFFER DON'T 3498 02:28:18,120 --> 02:28:18,440 MATTER. 3499 02:28:18,440 --> 02:28:20,800 IF IT'S NOT ONLY ABOUT MATTER 3500 02:28:20,800 --> 02:28:22,680 THEN ALL THE THINGS STEVE IS 3501 02:28:22,680 --> 02:28:23,480 TALKING ABOUT GETTING LAB 3502 02:28:23,480 --> 02:28:25,440 LEADERS TO WORK WITH PEOPLE IN 3503 02:28:25,440 --> 02:28:29,600 THE LAB HAVE EXPERIENCES MATTER. 3504 02:28:29,600 --> 02:28:31,240 NIH SEEMS TO THINK EXPERIENCE 3505 02:28:31,240 --> 02:28:32,640 MATTERS BECAUSE THEY'RE ASKING 3506 02:28:32,640 --> 02:28:34,800 STEVE TO PUT IT IN. 3507 02:28:34,800 --> 02:28:36,520 I JUST WANT TO CHALLENGE THE 3508 02:28:36,520 --> 02:28:38,320 NARRATIVES AND KEEP US FOCUSES 3509 02:28:38,320 --> 02:28:41,440 ON BEING DATA SCIENTISTS. 3510 02:28:41,440 --> 02:28:42,000 WHERE'S THE DATA FOR THESE 3511 02:28:42,000 --> 02:28:52,160 THINGS. 3512 02:28:55,520 --> 02:28:57,040 I SEE FOUR PEOPLE. 3513 02:28:57,040 --> 02:28:59,040 WE'LL HAVE FOUR PEOPLE STATE 3514 02:28:59,040 --> 02:28:59,880 YOUR QUESTION OR COMMENT BRIEFLY 3515 02:28:59,880 --> 02:29:01,120 AND THEN WE'LL DECIDE WHERE WE 3516 02:29:01,120 --> 02:29:02,640 GO WITH IT. 3517 02:29:02,640 --> 02:29:08,240 >> I'M A PEDIATRIC NEUROLOGIST, 3518 02:29:08,240 --> 02:29:09,480 M.D., Ph.D. AND HAVE A RESEARCH 3519 02:29:09,480 --> 02:29:12,440 LAB AND STARTING TO DO CLINICAL 3520 02:29:12,440 --> 02:29:13,120 RESEARCH. 3521 02:29:13,120 --> 02:29:16,200 SO MY COMMENT IS THAT IT SEEMS 3522 02:29:16,200 --> 02:29:18,840 MORE INSIDIOUS. 3523 02:29:18,840 --> 02:29:20,120 THESE AREN'T THINGS THAT WILL 3524 02:29:20,120 --> 02:29:22,120 RISE TO THE LEVEL OF A DEAN. 3525 02:29:22,120 --> 02:29:23,320 THESE ARE THINGS THAT ARE 3526 02:29:23,320 --> 02:29:25,080 HAPPENING AT A LOW LEVEL ON 3527 02:29:25,080 --> 02:29:28,000 GRANT APPLICATIONS USING THE 3528 02:29:28,000 --> 02:29:28,960 WRONG STATISTICS. 3529 02:29:28,960 --> 02:29:30,640 IT'S NOT ABOUT THE INTEGRATE OF 3530 02:29:30,640 --> 02:29:32,560 THE PERSON IT'S JUST THAT 3531 02:29:32,560 --> 02:29:34,560 THEY'RE MAYBE MISEDUCATED ON 3532 02:29:34,560 --> 02:29:38,360 WHAT TO DO. 3533 02:29:38,360 --> 02:29:41,920 MY QUESTION WAS ABOUT 3534 02:29:41,920 --> 02:29:42,840 CLINICALTRIALS.gov. 3535 02:29:42,840 --> 02:29:44,320 THAT'S AN EXPERIMENT WE DID 3536 02:29:44,320 --> 02:29:45,240 COLLECTIVELY AND I'M WONDERING 3537 02:29:45,240 --> 02:29:47,320 WHAT THE RESULTS OF THAT 3538 02:29:47,320 --> 02:29:49,040 EXPERIMENT HAVE BEEN. 3539 02:29:49,040 --> 02:29:53,800 HAS IT IMPROVED THE 3540 02:29:53,800 --> 02:29:55,760 TRUSTWORTHINESS OF CLINIC 3541 02:29:55,760 --> 02:29:56,040 RESEARCH. 3542 02:29:56,040 --> 02:29:56,760 >> SUBSTANTIALLY. 3543 02:29:56,760 --> 02:29:59,720 THERE WAS A PAPER OUT AND I 3544 02:29:59,720 --> 02:30:05,640 THINK THE AUTHOR IS LAMBORINQU 3545 02:30:05,640 --> 02:30:10,880 OVE OR SOMETHING LIKE THAT IF 3546 02:30:10,880 --> 02:30:16,280 SOMEONE CAN HELP ME AND 3547 02:30:16,280 --> 02:30:17,280 SUBSTANTIAL UNDER THE OF 3548 02:30:17,280 --> 02:30:18,600 CLINICAL TRIALS REGISTERED AND 3549 02:30:18,600 --> 02:30:23,720 DECREASE IN PRIMARY ENTRIES 3550 02:30:23,720 --> 02:30:24,680 POST-DOC. 3551 02:30:24,680 --> 02:30:35,200 SO WE HAVEN'T HIT AUTOPIA YET. 3552 02:30:35,680 --> 02:30:37,680 >> I'M THE REPRODUCIBILITY 3553 02:30:37,680 --> 02:30:38,360 LIBRARIAN AT UNIVERSITY OF 3554 02:30:38,360 --> 02:30:44,040 FLORIDA AND WE LOOK TO PROMOTE 3555 02:30:44,040 --> 02:30:54,480 OPEN AND -- OPENNESS AND 3556 02:30:57,200 --> 02:30:58,800 THERE'S MORE TO RESEARCH RIGOR 3557 02:30:58,800 --> 02:31:00,080 AND OPEN SCIENCE AND 3558 02:31:00,080 --> 02:31:00,920 REPRODUCIBILITY THAN WHAT IS 3559 02:31:00,920 --> 02:31:05,800 JUST EASY TO DO AND THERE'S A 3560 02:31:05,800 --> 02:31:06,400 CONFLICT BETWEEN THE EARLY 3561 02:31:06,400 --> 02:31:07,960 CAREER RESEARCHERS WHO WANT TO 3562 02:31:07,960 --> 02:31:12,040 BE OPEN AND MOSTTIVATED TO DO 3563 02:31:12,040 --> 02:31:13,480 RIGOROUS SCIENCE AND WHAT 3564 02:31:13,480 --> 02:31:15,000 THEY'RE DOING WITH THEIR P.I.s. 3565 02:31:15,000 --> 02:31:16,040 I'D LIKE TO PUT THE CHALLENGE 3566 02:31:16,040 --> 02:31:18,640 OUT THERE IT'S A PROBLEM TO WORK 3567 02:31:18,640 --> 02:31:20,080 ON, HOW DO WE SUPPORT THOSE 3568 02:31:20,080 --> 02:31:22,440 INDIVIDUALS WHAT WANT TO DO 3569 02:31:22,440 --> 02:31:24,840 BETTER BUT CONSTRAINED BY THE 3570 02:31:24,840 --> 02:31:27,760 FACT THERE'S A PRESSURE IN 3571 02:31:27,760 --> 02:31:28,040 ACADEMIA. 3572 02:31:28,040 --> 02:31:34,920 WE'RE SEEING MORE PRECARITY IN 3573 02:31:34,920 --> 02:31:36,800 FUNDING AND WE NEED TO ADDRESS 3574 02:31:36,800 --> 02:31:42,440 THIS ALONGSIDE PRODUCING RIGOR 3575 02:31:42,440 --> 02:31:43,000 AND REPRODUCIBILITY MORE 3576 02:31:43,000 --> 02:31:53,120 BROADLY. 3577 02:32:01,040 --> 02:32:06,000 >> I'M TRAINED IN OBSTETRICS AND 3578 02:32:06,000 --> 02:32:08,160 CURRENTLY A METASCIENTIST. 3579 02:32:08,160 --> 02:32:09,960 WE HELD A VIRTUAL BRAIN STORMING 3580 02:32:09,960 --> 02:32:11,800 EVENT LAST FALL WHERE WE INVITED 3581 02:32:11,800 --> 02:32:14,000 BACK PARTICIPANTS WHO HAD TAKEN 3582 02:32:14,000 --> 02:32:16,200 BACK A MAJOR REPRODUCIBILITY 3583 02:32:16,200 --> 02:32:17,680 WORKSHOP A YEAR TO THREE YEARS 3584 02:32:17,680 --> 02:32:18,840 AGO TO TALK ABOUT WHAT HAPPENED 3585 02:32:18,840 --> 02:32:20,680 WHEN THEY WENT BACK TO THE LAB, 3586 02:32:20,680 --> 02:32:22,640 WHAT WENT WELL AND WHAT WERE 3587 02:32:22,640 --> 02:32:24,120 THEY PREPARED FOR AND WHAT DID 3588 02:32:24,120 --> 02:32:26,680 NOT GO WELL AND HOW DID THEY 3589 02:32:26,680 --> 02:32:28,280 NAVIGATE THAT PROCESS. 3590 02:32:28,280 --> 02:32:30,920 WE SYNTHESIZED THOSE DISCUSSIONS 3591 02:32:30,920 --> 02:32:32,600 INTO A PAPER AVAILABLE AS A PRE 3592 02:32:32,600 --> 02:32:34,480 PRINT AND HOPE ONE DAY WE'LL GET 3593 02:32:34,480 --> 02:32:41,440 PEER REVIEWS BACK BUT IN A VERY 3594 02:32:41,440 --> 02:32:42,680 SKILL AGNOSTIC WAY OF WALK 3595 02:32:42,680 --> 02:32:44,240 THROUGH THE OF HOW DO YOU DECIDE 3596 02:32:44,240 --> 02:32:46,200 WHAT TO IMPLEMENT FOR YOUR 3597 02:32:46,200 --> 02:32:47,840 PROJECT AND HOW DO YOU GO ABOUT 3598 02:32:47,840 --> 02:32:50,520 TALKING TO YOUR LAB TO DECIDE 3599 02:32:50,520 --> 02:32:53,360 WHO YOU CAN IMPLEMENT AND HOW DO 3600 02:32:53,360 --> 02:32:54,560 YOU GET THE RESOURCES AND 3601 02:32:54,560 --> 02:32:58,600 TROUBLE SHOOT AND ADAPT THE PLAN 3602 02:32:58,600 --> 02:33:01,240 AND SHARE YOUR SKILL AND 3603 02:33:01,240 --> 02:33:02,880 TRAINING OTHERS MOVING FORWARD 3604 02:33:02,880 --> 02:33:05,000 AND LOOK FOR FUTURE POSITIONS 3605 02:33:05,000 --> 02:33:06,480 ALIGNED WITH THE PRIORITIES 3606 02:33:06,480 --> 02:33:07,360 YOU'VE ESTABLISHED BASED ON YOUR 3607 02:33:07,360 --> 02:33:08,640 PAST WORK. 3608 02:33:08,640 --> 02:33:11,640 I WOULD ENCOURAGE THOSE OFFERING 3609 02:33:11,640 --> 02:33:13,640 EDUCATION TO MAKE SPACE, IF 3610 02:33:13,640 --> 02:33:16,400 YOU'RE NOT DOING APPLIED 3611 02:33:16,400 --> 02:33:18,040 APPLICATION TO TALK ABOUT WHAT 3612 02:33:18,040 --> 02:33:18,840 HAPPENS AFTERWARDS BECAUSE IF 3613 02:33:18,840 --> 02:33:19,880 YOU'RE APPLICATION IS NOT 3614 02:33:19,880 --> 02:33:21,600 APPLIED, YOU'RE LEAVING THAT ON 3615 02:33:21,600 --> 02:33:23,360 YOUR STUDENTS MOSTLY EARLY 3616 02:33:23,360 --> 02:33:25,440 CAREER RESEARCHERS TO FIGURE IT 3617 02:33:25,440 --> 02:33:26,760 OUT ONCE YOU ARE GONE AND 3618 02:33:26,760 --> 02:33:27,840 THEY'RE BACK IN THEIR LABS AND 3619 02:33:27,840 --> 02:33:30,800 IT'S A VERY COMPLICATED SPACE TO 3620 02:33:30,800 --> 02:33:33,480 NAVIGATE SO THAT MAY BE A 3621 02:33:33,480 --> 02:33:36,120 STARTING RESOURCE HELPFUL TO YOU 3622 02:33:36,120 --> 02:33:37,320 AND INCLUDES INFORMATION 3623 02:33:37,320 --> 02:33:38,320 DIRECTLY FROM WORKSHOP 3624 02:33:38,320 --> 02:33:39,600 PARTICIPANTS ABOUT THINGS THEY 3625 02:33:39,600 --> 02:33:41,120 WOULD HAVE LIKED TO SEE OR FOUND 3626 02:33:41,120 --> 02:33:41,360 HELPFUL. 3627 02:33:41,360 --> 02:33:41,760 THAT'S ALL. 3628 02:33:41,760 --> 02:33:47,200 >> THANK YOU. 3629 02:33:47,200 --> 02:33:49,960 >> MIKE DOHERTY, UNIVERSITY OF 3630 02:33:49,960 --> 02:33:51,600 MARYLAND I'M A DEPARTMENT CHAIR 3631 02:33:51,600 --> 02:33:53,560 AND HAD THE PLEASURE OF LEADING 3632 02:33:53,560 --> 02:33:56,480 CHANGE IN OUR DEPARTMENT WHERE 3633 02:33:56,480 --> 02:33:58,080 WE IMPLEMENTED THE ANNUAL 3634 02:33:58,080 --> 02:33:59,480 PROCESSES AND TENURE PROMOTION 3635 02:33:59,480 --> 02:34:00,880 PROCESSES IMPLEMENTED IN THE 3636 02:34:00,880 --> 02:34:01,840 LAST MONTH OR TWO. 3637 02:34:01,840 --> 02:34:04,880 THE DEPARTMENT OF PSYCHOLOGY 3638 02:34:04,880 --> 02:34:08,000 WHERE WE NOW INCENTIVIZE OPEN 3639 02:34:08,000 --> 02:34:10,440 SCIENCE AND OPEN METHODS AND 3640 02:34:10,440 --> 02:34:11,960 REPRODUCIBILITY AND SPECIFIC 3641 02:34:11,960 --> 02:34:13,200 ACTIONS PEOPLE CAN TAKE. 3642 02:34:13,200 --> 02:34:15,080 THE PRINCIPLE BEHIND THIS IS 3643 02:34:15,080 --> 02:34:17,480 IMPACT AS ACCESS. 3644 02:34:17,480 --> 02:34:19,400 REDEFINING IMPACT AS A WAY WE 3645 02:34:19,400 --> 02:34:22,160 CAN MEASURE IT INDEPENDENT OF 3646 02:34:22,160 --> 02:34:24,320 THINGS LIKE CITATION AND IMPACT 3647 02:34:24,320 --> 02:34:25,480 FACTORS AND THAT BUSINESS WE 3648 02:34:25,480 --> 02:34:27,920 KNOW ARE PROBLEMATIC. 3649 02:34:27,920 --> 02:34:29,800 ONE OF THE THINGS I WANTED TO 3650 02:34:29,800 --> 02:34:31,040 BRING UP THOUGH IS THAT MUCH OF 3651 02:34:31,040 --> 02:34:33,480 WHAT WE WERE ABLE TO ACCOMPLISH 3652 02:34:33,480 --> 02:34:35,240 WAS FRAMED FROM THE PERSPECTIVE 3653 02:34:35,240 --> 02:34:35,720 OF VALUES. 3654 02:34:35,720 --> 02:34:38,000 SO WHEN I ASKED MY FACULTY OR 3655 02:34:38,000 --> 02:34:40,000 ASKED MY YOUNG FACULTY IN 3656 02:34:40,000 --> 02:34:40,920 PARTICULAR YOUNG FACULTY SAYING 3657 02:34:40,920 --> 02:34:42,680 I WANT TO DO RESEARCH IN A 3658 02:34:42,680 --> 02:34:44,520 PARTICULAR WAY AND WANT TO DO IT 3659 02:34:44,520 --> 02:34:47,320 IN A WAY TRUE TO THEIR VALUES 3660 02:34:47,320 --> 02:34:49,880 AND THEN THEY GET IN THE SYSTEM 3661 02:34:49,880 --> 02:34:51,080 AND REALIZE HOLY CRAP I CAN'T DO 3662 02:34:51,080 --> 02:34:52,320 IT LIKE THAT. 3663 02:34:52,320 --> 02:34:53,800 THE SYSTEM DOESN'T SUPPORT IT. 3664 02:34:53,800 --> 02:34:55,520 WHEN WE TOOK THE PROBLEM ON IT 3665 02:34:55,520 --> 02:34:56,560 WAS FRAMED FROM THE PERSPECTIVE 3666 02:34:56,560 --> 02:34:58,600 OF WE WANT TO GIVE OUR YOUNG 3667 02:34:58,600 --> 02:34:59,520 FACULTY AGENCY TO DO THE WORK 3668 02:34:59,520 --> 02:35:01,320 THEY NEED TO DO AND DO IT HOW 3669 02:35:01,320 --> 02:35:03,800 THEY WANT TO IT SO THEY CAN DO 3670 02:35:03,800 --> 02:35:04,720 THE BEST QUALITY WORK. 3671 02:35:04,720 --> 02:35:06,760 THAT'S MORE OF A COMMENT NOT A 3672 02:35:06,760 --> 02:35:09,080 QUESTION BUT THE ISSUE IS COMING 3673 02:35:09,080 --> 02:35:11,840 BACK TO THE VALUES AND 3674 02:35:11,840 --> 02:35:15,480 EMPHASIZING THAT AS A WAY TO 3675 02:35:15,480 --> 02:35:17,320 GIVE THAT TO AN EARLY CAREER 3676 02:35:17,320 --> 02:35:17,640 RESEARCHER. 3677 02:35:17,640 --> 02:35:21,480 >> THAT'S A GOOD NOTE TO GO TO 3678 02:35:21,480 --> 02:35:22,960 LUNCHEON AND TO CHEW ON AND 3679 02:35:22,960 --> 02:35:24,560 ARGUE WITH EACH OTHER AGAIN IN 3680 02:35:24,560 --> 02:35:26,320 THE BEST SENSE OF ARGUE. 3681 02:35:26,320 --> 02:35:28,560 I THINK THE IDENTITY AS A 3682 02:35:28,560 --> 02:35:31,320 SCIENTIST IS A BEAUTIFUL 3683 02:35:31,320 --> 02:35:31,920 IDENTITY. 3684 02:35:31,920 --> 02:35:34,640 AND WHEN SOMEONE ASKS ME HOW DID 3685 02:35:34,640 --> 02:35:36,400 YOU CHOOSE TO BE BECOME A 3686 02:35:36,400 --> 02:35:38,080 SCIENTIST I'M SURE MANY OF YOU 3687 02:35:38,080 --> 02:35:40,240 GET THAT SCIENTIST TOO, I OFTEN 3688 02:35:40,240 --> 02:35:42,840 SAY I DIDN'T CHOOSE, THIS IS 3689 02:35:42,840 --> 02:35:43,720 WHAT I AM. 3690 02:35:43,720 --> 02:35:46,680 AND THAT MEANS A LOT TO ME. 3691 02:35:46,680 --> 02:35:53,520 AND I THINK ABOUT THAT HISTORY 3692 02:35:53,520 --> 02:35:55,640 OF GALILEO BECAUSE HE LIKED TO 3693 02:35:55,640 --> 02:36:02,920 ASK HARD QUESTIONS ABOUT 3694 02:36:02,920 --> 02:36:04,880 ARISTOTLE AND THE WORD MEANS 3695 02:36:04,880 --> 02:36:07,400 WRANGLE AND WRANGLE WITH DOES IT 3696 02:36:07,400 --> 02:36:09,400 NEED TO BE MORE RIGOROUS. 3697 02:36:09,400 --> 02:36:11,240 STEVE TALKED ABOUT ALL THESE "R" 3698 02:36:11,240 --> 02:36:12,680 WORDS AND TALKED ABOUT FOCUSSING 3699 02:36:12,680 --> 02:36:14,040 ON RIGOR. 3700 02:36:14,040 --> 02:36:15,840 WE HEARD ABOUT IDENTITY. 3701 02:36:15,840 --> 02:36:18,320 IS THAT IDENTITY REALLY ALWAYS 3702 02:36:18,320 --> 02:36:21,120 ABOUT BEING RIGOROUS OR IS PART 3703 02:36:21,120 --> 02:36:25,760 OF IT ABOUT BEING CLEAR ON 3704 02:36:25,760 --> 02:36:26,560 RIGOR. 3705 02:36:26,560 --> 02:36:27,840 IS IT OKAY TO SOMETIMES DO 3706 02:36:27,840 --> 02:36:29,240 CHEAP, QUICK, SLOPPY SCIENCE 3707 02:36:29,240 --> 02:36:32,840 BECAUSE WE WANT TO TRY SOMETHING 3708 02:36:32,840 --> 02:36:35,160 OUT QUICKLY OR SOMETIMES LIKE 3709 02:36:35,160 --> 02:36:38,680 WHEN WE PUT A DRUG TO THE FDA OR 3710 02:36:38,680 --> 02:36:40,920 PUT TIRES ON A REAL CAR THAT 3711 02:36:40,920 --> 02:36:42,840 WILL SAVE OR COST LIVES WE WANT 3712 02:36:42,840 --> 02:36:44,040 TO BE RIGOROUS. 3713 02:36:44,040 --> 02:36:46,280 MAYBE SOMETIMES WE WANT TO PLAY 3714 02:36:46,280 --> 02:36:47,120 BUT CAN WE BE OPEN. 3715 02:36:47,120 --> 02:36:49,480 THERE'S THE IDENTITY OF THE 3716 02:36:49,480 --> 02:36:51,680 SCIENTIST AS THE UNCOMPROMISING 3717 02:36:51,680 --> 02:36:54,440 TRUTH TELLER WHO SAY HERE I WAS 3718 02:36:54,440 --> 02:36:56,760 VERY RIGOROUS AND HERE I WAS 3719 02:36:56,760 --> 02:36:56,920 NOT. 3720 02:36:56,920 --> 02:36:58,840 I WAS JUST DOING QUICK ANALYSES 3721 02:36:58,840 --> 02:37:01,200 TO TAKE A LOOK AND HAVE SOME FUN 3722 02:37:01,200 --> 02:37:03,520 AND YOU CAN MAKE OF IT WHAT YOU 3723 02:37:03,520 --> 02:37:03,960 WILL. 3724 02:37:03,960 --> 02:37:05,800 AS LONG AS I'M TRANSPARENT THEN 3725 02:37:05,800 --> 02:37:07,920 I HAVE LATITUDE WITH RIGOR. 3726 02:37:07,920 --> 02:37:09,760 FOOD FOR THOUGHT AS YOU HAVE 3727 02:37:09,760 --> 02:37:11,800 SOME FOOD TO REPLACE THE 3728 02:37:11,800 --> 02:37:13,960 CHEMICALS THAT YOU HAVE ALREADY 3729 02:37:13,960 --> 02:37:17,440 BURNED UP IN YOUR BODIES THIS 3730 02:37:17,440 --> 02:37:17,680 MORNING. 3731 02:37:17,680 --> 02:37:21,000 THANK YOU. 3732 02:37:21,000 --> 02:37:24,040 HI, MY NAME IS JASON WILLIAMS 3733 02:37:24,040 --> 02:37:27,600 FROM COLD SPRING HARBOR 3734 02:37:27,600 --> 02:37:29,360 LABORATORY, NEW YORK. 3735 02:37:29,360 --> 02:37:35,800 MY BACKGROUND IS IN BIO 3736 02:37:35,800 --> 02:37:36,840 INFORMATICS AND HELPING BRING 3737 02:37:36,840 --> 02:37:37,000 TOOLS INTO RESEARCH AND 3738 02:37:37,000 --> 02:37:37,880 TRAINING. 3739 02:37:37,880 --> 02:37:41,560 I'M DELIGHTED TO KICK OFF 3740 02:37:41,560 --> 02:37:44,000 SESSION 3, A CLEAR PATH, NEEDS, 3741 02:37:44,000 --> 02:37:44,640 BEHAVIORS, KNOWLEDGE SKILLS AND 3742 02:37:44,640 --> 02:37:47,080 COMPETENCIES. 3743 02:37:47,080 --> 02:37:48,560 I GUESS THIS GETS INTO SOME 3744 02:37:48,560 --> 02:37:49,920 SPECIFICS BECAUSE IT'S WHAT DO 3745 02:37:49,920 --> 02:37:54,440 WE ACTUALLY WANT RESEARCHER 3746 02:37:54,440 --> 02:37:58,360 GROUPS TO DO AND BEHAVIORS TO 3747 02:37:58,360 --> 02:37:59,920 ADOPT AND HOW WE PRIORITIZE 3748 02:37:59,920 --> 02:38:01,280 RIGOR AND TRANSPARENCY AND WHAT 3749 02:38:01,280 --> 02:38:02,680 SUPPORTS THESE BEHAVIORS. 3750 02:38:02,680 --> 02:38:04,320 I'M GLAD TO BE JOINED BY A 3751 02:38:04,320 --> 02:38:04,720 FANTASTIC PANEL. 3752 02:38:04,720 --> 02:38:08,320 I BELIEVE IT TO THEMSELVES TO 3753 02:38:08,320 --> 02:38:09,960 INTRODUCE THEMSELVES BECAUSE 3754 02:38:09,960 --> 02:38:11,240 THEY'LL DO A FAR BETTER JOB BUT 3755 02:38:11,240 --> 02:38:15,160 WE HAVE A NUMBER OF SPEAKERS 3756 02:38:15,160 --> 02:38:18,160 INCLUDING ONE VIRTUAL AND WE 3757 02:38:18,160 --> 02:38:19,640 HAVE GUNDULA BOSCH AND CARI 3758 02:38:19,640 --> 02:38:23,240 JORDAN JOINING US AS THE DEPUTY 3759 02:38:23,240 --> 02:38:25,840 DWRISHTH FROM THE CARPENTRIES 3760 02:38:25,840 --> 02:38:32,680 AND WITH WEATHER AND TRAVEL, AND 3761 02:38:32,680 --> 02:38:33,360 RUSSELL POLDRACK FROM STANFORD 3762 02:38:33,360 --> 02:38:35,640 HAD MANY CHALLENGES TO MAKE IT 3763 02:38:35,640 --> 02:38:43,960 TODAY AND WE HAVE TRACEY 3764 02:38:43,960 --> 02:38:46,560 WEISBERGER FROM BERLIN. 3765 02:38:46,560 --> 02:38:47,960 I THINK IT WILL BE SIMILAR TO 3766 02:38:47,960 --> 02:38:51,680 BEFORE AND EVERYONE WILL GIVE A 3767 02:38:51,680 --> 02:38:54,800 BRIEF PRESENTATION TO START 3768 02:38:54,800 --> 02:38:57,160 STIMULATING IDEAS AND HAVE A 3769 02:38:57,160 --> 02:39:01,040 ROUND OF QUESTIONS AND 3770 02:39:01,040 --> 02:39:07,320 DISCUS 3771 02:39:07,320 --> 02:39:14,240 DISCUSSION. 3772 02:39:14,240 --> 02:39:15,560 WE'RE GOING TO DO THIS. 3773 02:39:15,560 --> 02:39:17,480 I'LL EXPLAIN THE WORLD CAFE 3774 02:39:17,480 --> 02:39:18,960 APPROACH TO THIS BECAUSE WE HAD 3775 02:39:18,960 --> 02:39:20,680 BREAKOUT AND DISCUSSIONS THAT 3776 02:39:20,680 --> 02:39:23,040 ARE GOING TO BE PART OF THAT SO 3777 02:39:23,040 --> 02:39:26,080 I THINK WE NEED TO GET THIS 3778 02:39:26,080 --> 02:39:36,480 PROJECTED TO THE SCREEN. 3779 02:39:44,000 --> 02:39:47,320 >> THANK YOU, JASON. 3780 02:39:47,320 --> 02:39:48,640 IT'S A PLEASURE TO TELL YOU A 3781 02:39:48,640 --> 02:39:51,360 BIT OF WHAT WE'VE BEEN UP TO AT 3782 02:39:51,360 --> 02:39:52,640 JOHNS HOPKINS SCHOOL OF PUBLIC 3783 02:39:52,640 --> 02:39:55,360 HEALTH. 3784 02:39:55,360 --> 02:40:00,440 MY NAME IS GUNDULA BOSCH AND THE 3785 02:40:00,440 --> 02:40:03,160 NAME ARE THE CENTER SAYS WHAT 3786 02:40:03,160 --> 02:40:04,240 WE'RE DOING. 3787 02:40:04,240 --> 02:40:11,040 WE'RE DEVOTED TO RIGOR, 3788 02:40:11,040 --> 02:40:15,400 REPRODUCIBILITY AND 3789 02:40:15,400 --> 02:40:19,320 REPRODUCIBILITY AND WANTED TO 3790 02:40:19,320 --> 02:40:23,120 GIVE A LITTLE INSIGHT IN OR WORK 3791 02:40:23,120 --> 02:40:28,960 TO TRY TO CATALYZE RIGOR WITH 3792 02:40:28,960 --> 02:40:30,200 OUR TRAINING. 3793 02:40:30,200 --> 02:40:35,360 WE'RE TRYING TO GET INSPIRED BY 3794 02:40:35,360 --> 02:40:39,440 OUR HEROES IN SCIENCE. 3795 02:40:39,440 --> 02:40:43,320 AND MANY HAVE SHOWN THEY'RE 3796 02:40:43,320 --> 02:40:45,240 BROADLY THINKING DISCIPLINARY 3797 02:40:45,240 --> 02:40:46,320 SCIENTISTS AND WE THINK WE 3798 02:40:46,320 --> 02:40:49,680 SHOULD GET INSPIRED THROUGH 3799 02:40:49,680 --> 02:40:51,480 THEIR EXAMPLE BY LOOKING OUTSIDE 3800 02:40:51,480 --> 02:40:52,520 THE BOX AND NOT BEING SO 3801 02:40:52,520 --> 02:40:54,520 SPECIALIZED IN HOW WE TRAIN OUR 3802 02:40:54,520 --> 02:40:56,360 STUDENTS BUT ALLOW OUR STUDENTS 3803 02:40:56,360 --> 02:40:59,720 TO REALLY HAVE AN IDEA OF WHAT 3804 02:40:59,720 --> 02:41:02,880 IS OUTSIDE THE NARROW FIELD AND 3805 02:41:02,880 --> 02:41:05,200 THINK BROADLY AND THINK ABOUT 3806 02:41:05,200 --> 02:41:06,880 THE PHILOSOPHY OF SCIENCE. 3807 02:41:06,880 --> 02:41:11,480 ESSENTIALLY WE HAVE STARTED ON I 3808 02:41:11,480 --> 02:41:16,040 THINK AROUND 2016 THINKING HOW 3809 02:41:16,040 --> 02:41:19,640 TO BRING THE P.H. BACK INTO 3810 02:41:19,640 --> 02:41:21,240 Ph.D. SOMEBODY ELSE COINED FOR 3811 02:41:21,240 --> 02:41:23,880 US AND LOOKED INTO HOW CAN WE 3812 02:41:23,880 --> 02:41:26,400 BRING MORE OF THE PHILOSOPHICAL 3813 02:41:26,400 --> 02:41:28,960 FOUNDATION AND THE CRITICAL 3814 02:41:28,960 --> 02:41:32,400 THINK OF SCIENTIFIC RIGOR INTO 3815 02:41:32,400 --> 02:41:34,120 HOW WE TRAIN GRADUATE STUDENTS 3816 02:41:34,120 --> 02:41:36,120 IN OUR CASE IN THE BIOSCIENCES. 3817 02:41:36,120 --> 02:41:38,400 IN THE MEANTIME WE HAVE EXPANDED 3818 02:41:38,400 --> 02:41:39,760 TO OTHER DISCIPLINES AS WELL. 3819 02:41:39,760 --> 02:41:41,880 THIS FULL SLIDE IS SOMETHING I 3820 02:41:41,880 --> 02:41:43,320 CANNOT TALK THROUGH ALL THE 3821 02:41:43,320 --> 02:41:46,920 DIFFERENT ASPECTS IN MY SHORT 3822 02:41:46,920 --> 02:41:50,920 TALK TODAY BUT WHAT WE FOUND ARE 3823 02:41:50,920 --> 02:41:54,640 COMPETENCIES AND SOME CAUSES 3824 02:41:54,640 --> 02:41:55,920 HAVE BEEN SIMILAR TO THE 3825 02:41:55,920 --> 02:41:56,720 COMPETENCIES. 3826 02:41:56,720 --> 02:41:58,400 WHAT YOU SEE OUT THERE ARE 3827 02:41:58,400 --> 02:42:00,400 APPLIED FORMS OF THE PHILOSOPHY 3828 02:42:00,400 --> 02:42:04,000 OF SCIENCE. 3829 02:42:04,000 --> 02:42:07,280 YOU FIND ELEMENTS OF KNOWLEDGE, 3830 02:42:07,280 --> 02:42:07,960 COMMUNICATION AND SOCIAL 3831 02:42:07,960 --> 02:42:08,320 JUSTICE. 3832 02:42:08,320 --> 02:42:10,600 THIS IS WHAT WE TRY TO BRING 3833 02:42:10,600 --> 02:42:14,960 INTO THE WAY WE TRAIN GRADUATE 3834 02:42:14,960 --> 02:42:16,040 STUDENTS. 3835 02:42:16,040 --> 02:42:19,400 AND I'M HAPPY TO ELABORATE MORE 3836 02:42:19,400 --> 02:42:21,040 IN THE BREAKS OVER THE NEXT TWO 3837 02:42:21,040 --> 02:42:22,640 DAYS BUT I WANTED TO SHOW YOU 3838 02:42:22,640 --> 02:42:24,680 BEFORE WE HAVE GROWN SINCE WE 3839 02:42:24,680 --> 02:42:27,080 STARTED EARLY CONCEPTUALIZING 3840 02:42:27,080 --> 02:42:30,440 AND THINKING ABOUT IT IN 2015 3841 02:42:30,440 --> 02:42:32,080 AND 2016. 3842 02:42:32,080 --> 02:42:34,320 A WORLDWIDE NETWORK OF PARTNER 3843 02:42:34,320 --> 02:42:36,800 INSTITUTIONS JOINING US IN THIS 3844 02:42:36,800 --> 02:42:37,960 ENDEAVOR OR HARDLY IMPLEMENTING 3845 02:42:37,960 --> 02:42:38,680 WHAT WE ARE DOING. 3846 02:42:38,680 --> 02:42:40,960 WE'RE HAPPY TO MAKE THIS NETWORK 3847 02:42:40,960 --> 02:42:45,000 OPEN TO THE COMMUNITY HERE AND 3848 02:42:45,000 --> 02:42:47,040 ALSO FIND WAYS TO SYNERGIZE. 3849 02:42:47,040 --> 02:42:49,080 WE HAVE IN THE MINE TIME SERVED 3850 02:42:49,080 --> 02:42:52,000 OVER 3,000 STUDENTS AT JOHNS 3851 02:42:52,000 --> 02:42:54,160 HOPKINS ACROSS 10 DIVISIONS AND 3852 02:42:54,160 --> 02:42:55,160 FOUR PROGRAMS. 3853 02:42:55,160 --> 02:42:57,320 IT DOESN'T MEAN WE HAVE HUGE 3854 02:42:57,320 --> 02:42:58,520 ENROLLMENTS WE HAVE SOME 3855 02:42:58,520 --> 02:43:00,280 REQUIRED BY BIG CLASSES. 3856 02:43:00,280 --> 02:43:02,920 MOST ARE SMALLER BUT ESSENTIALLY 3857 02:43:02,920 --> 02:43:04,360 WE HAVE COURSES THAT ARE 3858 02:43:04,360 --> 02:43:07,320 AVAILABLE TO ALL OF OUR STUDENTS 3859 02:43:07,320 --> 02:43:09,120 AT JOHNS HOPKINS AVAILABLE AS 3860 02:43:09,120 --> 02:43:14,360 ELECTIVES AND AS PART OF 3861 02:43:14,360 --> 02:43:15,760 REQUIRED PROGRAMS. 3862 02:43:15,760 --> 02:43:17,120 IT'S AVAILABLE TO EVERYBODY ALSO 3863 02:43:17,120 --> 02:43:18,320 MEANS EVERYBODY HERE IN THE ROOM 3864 02:43:18,320 --> 02:43:21,200 IF THEY WANT TO JOIN OUR 3865 02:43:21,200 --> 02:43:21,880 INSTITUTIONAL PARTNERSHIPS AND 3866 02:43:21,880 --> 02:43:24,000 WHAT IS MOST IMPORTANT FOE 3867 02:43:24,000 --> 02:43:27,040 PEOPLE IN THE ROOM IS WE HAVE 3868 02:43:27,040 --> 02:43:29,840 NOW THROUGH GENEROUS FUNDING 3869 02:43:29,840 --> 02:43:31,320 BOTH THROUGH OUR FOUNDATION AS 3870 02:43:31,320 --> 02:43:34,560 WELL AS NSF AND NIH A GROWING 3871 02:43:34,560 --> 02:43:36,080 COLLECTION OF OPEN EDUCATIONAL 3872 02:43:36,080 --> 02:43:37,080 RESOURCES WE ARE HAPPY TO MAKE 3873 02:43:37,080 --> 02:43:39,200 AVAILABLE TO EVERYBODY 3874 02:43:39,200 --> 02:43:44,520 INTERESTED. 3875 02:43:44,520 --> 02:43:46,960 BASICALLY OUR TRAINING LOOK AT 3876 02:43:46,960 --> 02:43:47,520 SCIENTIFIC RIGOR THROUGH 3877 02:43:47,520 --> 02:43:48,560 MULTIPLE LENSES. 3878 02:43:48,560 --> 02:43:51,440 YOU TALKED ABOUT THIS AT LUNCH 3879 02:43:51,440 --> 02:43:52,480 AND YOU BROUGHT UP SOMETHING 3880 02:43:52,480 --> 02:43:56,600 EARLIER THAT WE CANNOT JUST 3881 02:43:56,600 --> 02:43:57,200 TRAINING RIGOR AS WELL AS 3882 02:43:57,200 --> 02:43:58,000 REPRODUCIBILITY AND 3883 02:43:58,000 --> 02:43:58,560 RESPONSIBILITY THROUGH ONE 3884 02:43:58,560 --> 02:44:02,360 COURSE AND CHECK IT OFF. 3885 02:44:02,360 --> 02:44:03,480 WE TRY TO INCLUDE OUR TRAINING 3886 02:44:03,480 --> 02:44:06,760 IN SCIENTIFIC RIGOR IN MANY 3887 02:44:06,760 --> 02:44:09,200 COURSES AND WORKSHOPS AND 3888 02:44:09,200 --> 02:44:10,680 EDUCATIONAL EXPERIENCES. 3889 02:44:10,680 --> 02:44:14,320 THE SLIDE SUMS UP OUR 3890 02:44:14,320 --> 02:44:17,600 EDUCATIONAL PHILOSOPHY AND THE 3891 02:44:17,600 --> 02:44:20,960 THREE Rs WERE IMPLEMENTED IN 3892 02:44:20,960 --> 02:44:23,320 TRAINING EXPERIMENTS IN SOUND 3893 02:44:23,320 --> 02:44:24,720 TRAINING AND STATISTICS AND FORM 3894 02:44:24,720 --> 02:44:26,480 OF TRAINING IN LOGIC AND 3895 02:44:26,480 --> 02:44:29,040 RESEARCH DESIGN OF COURSE WE 3896 02:44:29,040 --> 02:44:30,080 TALKED ABOUT THIS EARLIER AS 3897 02:44:30,080 --> 02:44:31,320 WELL AS ERROR ANALYSIS. 3898 02:44:31,320 --> 02:44:33,120 IS SOMETHING WE ENGINEER ALL THE 3899 02:44:33,120 --> 02:44:33,680 TIME AND DON'T DO ENOUGH I 3900 02:44:33,680 --> 02:44:43,800 THINK. 3901 02:44:45,240 --> 02:44:48,520 THIS EXCERPT OF THE CURRICULUM 3902 02:44:48,520 --> 02:44:49,320 IS SOMETHING THAT Ph.D. STUDENTS 3903 02:44:49,320 --> 02:44:54,200 TAKE OUR CLASS REQUIRED AND 3904 02:44:54,200 --> 02:44:55,320 PARTNER PROGRAMS IMPLEMENT ALL 3905 02:44:55,320 --> 02:44:57,520 THE COMPONENTS. 3906 02:44:57,520 --> 02:44:59,320 THEY'RE AVAILABLE IN SEPARATE 3907 02:44:59,320 --> 02:45:01,840 SMALLER MODULES BUT CAN BE TAIL 3908 02:45:01,840 --> 02:45:03,800 MADE TO FIT INDIVIDUAL PROGRAMS 3909 02:45:03,800 --> 02:45:06,080 IN INDIVIDUAL CURRICULUM. 3910 02:45:06,080 --> 02:45:07,360 WE STARTED WITH SOMETHING WE 3911 02:45:07,360 --> 02:45:08,760 CALL THEORY OF HISTORY AND 3912 02:45:08,760 --> 02:45:10,680 PRACTICE IN SCIENCE AND TWO 3913 02:45:10,680 --> 02:45:16,240 COURSES THAT HAVE TO DO WITH 3914 02:45:16,240 --> 02:45:16,920 ERROR ANALYSIS. 3915 02:45:16,920 --> 02:45:21,240 THE SEQUENCE IS NOT REQUIRES. 3916 02:45:21,240 --> 02:45:27,360 IT ALLOWS THE STUDENTS TO GET A 3917 02:45:27,360 --> 02:45:29,560 ROUGH IDEA OF HOW THE PHILOSOPHY 3918 02:45:29,560 --> 02:45:32,200 OF SCIENCE IS IMPORTANT TO 3919 02:45:32,200 --> 02:45:32,600 SCIENTIFIC PRACTICE. 3920 02:45:32,600 --> 02:45:35,320 TALK ABOUT WHAT IS SCIENCE AND 3921 02:45:35,320 --> 02:45:36,960 HOW DO SCIENTIFIC METHODS 3922 02:45:36,960 --> 02:45:37,640 EVOLVE? 3923 02:45:37,640 --> 02:45:39,160 WHAT COUNTS AS EVIDENCE ACROSS 3924 02:45:39,160 --> 02:45:40,560 THE DISCIPLINES AND HOW DO WE 3925 02:45:40,560 --> 02:45:40,920 EVALUATE IT. 3926 02:45:40,920 --> 02:45:42,960 WHAT CAN WE LEARN FROM HISTORY 3927 02:45:42,960 --> 02:45:45,040 OF SCIENCE WHICH IS PARTICULARLY 3928 02:45:45,040 --> 02:45:46,320 POPULAR AS YOU CAN IMAGINE. 3929 02:45:46,320 --> 02:45:48,080 WHAT CAN WE LEARN ABOUT 3930 02:45:48,080 --> 02:45:48,560 SCIENTIFIC REVOLUTIONS. 3931 02:45:48,560 --> 02:45:51,240 TO GIVE YOU AN IDEA OF HOW THIS 3932 02:45:51,240 --> 02:45:53,640 LOOKS LIKE, I WANTED TO DRAW 3933 02:45:53,640 --> 02:45:55,320 YOUR ATTENTION TO A PUBLICLY 3934 02:45:55,320 --> 02:45:58,200 AVAILABLE LECTURE THAT ALL OF 3935 02:45:58,200 --> 02:45:58,960 YOU CAN WATCH. 3936 02:45:58,960 --> 02:46:01,280 THE PERSON YOU SEE ON THE LOWER 3937 02:46:01,280 --> 02:46:03,240 RIGHT-HAND SIDE IS THE CHAIR OF 3938 02:46:03,240 --> 02:46:05,880 OUR DEPARTMENT WHO IS ACTUALLY A 3939 02:46:05,880 --> 02:46:07,600 FOUNDER OF OUR PROGRAM. 3940 02:46:07,600 --> 02:46:10,760 HE GAVE A PUBLICLY AVAILABLE 3941 02:46:10,760 --> 02:46:14,440 GRAND ROUNDS LECTURE ABOUT THE 3942 02:46:14,440 --> 02:46:16,480 HISTORY OF THIS THERAPY AND THE 3943 02:46:16,480 --> 02:46:18,280 ROLE OF COVID-19 RESEARCH. 3944 02:46:18,280 --> 02:46:19,800 THAT'S A FASCINATE BEING LECTURE 3945 02:46:19,800 --> 02:46:22,200 WHERE HE LISTS ALL THE 3946 02:46:22,200 --> 02:46:23,480 PRINCIPLES I JUST TALKED TO YOU 3947 02:46:23,480 --> 02:46:24,280 ABOUT BEFORE. 3948 02:46:24,280 --> 02:46:25,800 I THOUGHT THIS WOULD BE 3949 02:46:25,800 --> 02:46:26,640 SOMETHING PARTICULARLY OUR 3950 02:46:26,640 --> 02:46:33,240 COLLEAGUES WOULD ENJOY BECAUSE 3951 02:46:33,240 --> 02:46:38,600 OF THE HIGHLIGHTS. 3952 02:46:38,600 --> 02:46:41,520 WE HAVE A COURSE WE CALL ANATOMY 3953 02:46:41,520 --> 02:46:43,320 OF SCIENTIFIC ERA. 3954 02:46:43,320 --> 02:46:45,240 WE BORROWED A PRINCIPLE OUR 3955 02:46:45,240 --> 02:46:46,000 ENGINEERING COLLEAGUES DO ALL 3956 02:46:46,000 --> 02:46:47,680 THE TIME AND LOOK INTO HOW 3957 02:46:47,680 --> 02:46:49,400 SCIENCE CAN GO WRONG AND HOW CAN 3958 02:46:49,400 --> 02:46:50,880 WE DO IT BETTER. 3959 02:46:50,880 --> 02:46:53,480 SO BASICALLY WHAT WE DO IS NOT 3960 02:46:53,480 --> 02:46:55,320 ONLY TEACH A COURSE THAT ALLOWS 3961 02:46:55,320 --> 02:46:57,480 US TO LOOK INTO ERROR ANALYSIS 3962 02:46:57,480 --> 02:47:01,040 BUT ALSO AND THE REASON I'M 3963 02:47:01,040 --> 02:47:05,640 HIGHLIGHTING A CLASSICAL CONDUCT 3964 02:47:05,640 --> 02:47:08,320 OF RESEARCH AND TRANSPLANTING 3965 02:47:08,320 --> 02:47:09,480 THIS INTO THE RESPONSIBLE 3966 02:47:09,480 --> 02:47:12,600 CONDUCT OF RESEARCH COURSE TO 3967 02:47:12,600 --> 02:47:16,280 HAVE AN ETHICS PERSPECTIVE TO 3968 02:47:16,280 --> 02:47:19,080 THE ERROR ANALYSIS AND THE 3969 02:47:19,080 --> 02:47:23,800 MULTI-FACTORIAL WAY OF LOOKING 3970 02:47:23,800 --> 02:47:25,400 AT RIGOR AND REPRODUCIBILITY AN 3971 02:47:25,400 --> 02:47:29,880 THIS FUNDED PROJECT THROUGH THE 3972 02:47:29,880 --> 02:47:31,520 NSF IS SOMETHING THAT MEANS 3973 02:47:31,520 --> 02:47:33,520 SOMETHING TO THOSE WHO DO THE 3974 02:47:33,520 --> 02:47:35,840 SCIENCE OF SCIENCE OR 3975 02:47:35,840 --> 02:47:40,640 METASCIENCE AND WE'RE TEACHING 3976 02:47:40,640 --> 02:47:48,520 MATERIAL AND A COUPLE MONTHS AGO 3977 02:47:48,520 --> 02:47:52,840 IN THE INSTITUTION AND WE USED 3978 02:47:52,840 --> 02:47:54,360 NEW MATERIAL TO TEACH OUR 3979 02:47:54,360 --> 02:47:56,000 STUDENTS WHAT CAN GO WRONG IN 3980 02:47:56,000 --> 02:47:57,680 SCIENCE AND HOW TO DO IT BETTER. 3981 02:47:57,680 --> 02:47:59,960 HOW CAN WE HAVE METHODS 3982 02:47:59,960 --> 02:48:00,880 IMPLEMENTED IN ORDER TO AVOID 3983 02:48:00,880 --> 02:48:05,680 AND REDUCE ERRORS. 3984 02:48:05,680 --> 02:48:08,360 WE ALSO LEAVE THE ROOM FOR THE 3985 02:48:08,360 --> 02:48:12,000 ROLE OF SERENDIPITY AND WE 3986 02:48:12,000 --> 02:48:12,840 CANNOT ONLY TEACH NEGATIVITY BUT 3987 02:48:12,840 --> 02:48:16,160 SOMETHING THE STUDENTS ENJOY. 3988 02:48:16,160 --> 02:48:22,200 I THINK I'M RUNG OUT OF TIME I 3989 02:48:22,200 --> 02:48:25,800 WANTED TO SHOW ANOTHER PROBLEM 3990 02:48:25,800 --> 02:48:26,880 SPEAKING OF RIGOR AND RESEARCH 3991 02:48:26,880 --> 02:48:28,600 REPRODUCIBILITY WE NOTICED OUR 3992 02:48:28,600 --> 02:48:29,920 STUDENTS MAKE A LOT OF MISTAKES 3993 02:48:29,920 --> 02:48:35,880 WHEN IT COMES TO PROBABILITY AND 3994 02:48:35,880 --> 02:48:40,560 STATISTICS IN THE LAB. 3995 02:48:40,560 --> 02:48:42,040 WE HAVE A DEAR COLLEAGUE AND 3996 02:48:42,040 --> 02:48:46,760 WORLD CLASS DEPARTMENT OF 3997 02:48:46,760 --> 02:48:47,880 STATISTICS AND OUR DEAR 3998 02:48:47,880 --> 02:48:49,000 COLLEAGUE TEACHES A WONDERFUL 3999 02:48:49,000 --> 02:48:52,800 COURSE IN STATISTICS FOR THE 4000 02:48:52,800 --> 02:48:56,320 PUBLIC HEALTH SCIENCES THE 4001 02:48:56,320 --> 02:48:57,760 PROBLEM IS OUR OWN STUDENTS 4002 02:48:57,760 --> 02:49:01,240 ACTUALLY HAVE AN ISSUE APPLYING 4003 02:49:01,240 --> 02:49:02,520 THE STATISTICS THAT IS TAUGHT 4004 02:49:02,520 --> 02:49:05,120 FOR THE PUBLIC HEALTH LEVEL TO 4005 02:49:05,120 --> 02:49:06,760 THE LAB AND MAKE A LOT OF 4006 02:49:06,760 --> 02:49:07,040 MISTAKES. 4007 02:49:07,040 --> 02:49:09,280 WE INTRODUCED ANOTHER 4008 02:49:09,280 --> 02:49:10,720 FUNDAMENTAL COURSE THAT HAS 4009 02:49:10,720 --> 02:49:13,280 EVOLVED MUCH LOWER THAN THE 4010 02:49:13,280 --> 02:49:14,840 STATISTICS COURSE THAT IS TAUGHT 4011 02:49:14,840 --> 02:49:15,720 BY OUR COLLEAGUES. 4012 02:49:15,720 --> 02:49:19,320 SO TO HAVE AN IDEA OF WHAT 4013 02:49:19,320 --> 02:49:21,040 BASICALLY IS THE SENSE MAKING 4014 02:49:21,040 --> 02:49:22,800 FROM A STATISTICAL DATA AND HOW 4015 02:49:22,800 --> 02:49:28,240 DO THEY APPLY TO THE LAB? 4016 02:49:28,240 --> 02:49:31,960 WE WORK WITH VISUALIZING AND GET 4017 02:49:31,960 --> 02:49:37,720 PEOPLE TO TALK ABOUT IT AND GET 4018 02:49:37,720 --> 02:49:45,160 MORE IN THE PUBLIC HEALTH LEVEL 4019 02:49:45,160 --> 02:49:55,680 OR SCALE OF BIOSTATISTICS AND 4020 02:49:59,200 --> 02:50:01,320 LOOKED AT RESEARCH THROUGH THE 4021 02:50:01,320 --> 02:50:08,400 LENS OF HOW CAN WE APPLY METHODS 4022 02:50:08,400 --> 02:50:10,400 AND RELATED STATISTICS IN THE 4023 02:50:10,400 --> 02:50:11,160 LEVEL OF CAUSATION RESEARCH. 4024 02:50:11,160 --> 02:50:12,880 THE ONLY THING I WANTED TO SHOW 4025 02:50:12,880 --> 02:50:17,920 YOU HERE AND I'M RUNNING OUT OF 4026 02:50:17,920 --> 02:50:22,360 TIME IS THAT CAUSATION HELP OUR 4027 02:50:22,360 --> 02:50:29,240 STUDENTS LOOK AT THIS ACROSS THE 4028 02:50:29,240 --> 02:50:32,920 AND THERE'S HOW THIS CAN BE 4029 02:50:32,920 --> 02:50:34,520 APPLIED THE BIOMEDICAL AND IT'S 4030 02:50:34,520 --> 02:50:39,080 A COLLABORATION ACROSS THE 4031 02:50:39,080 --> 02:50:40,560 DIFFERENT DIVISIONS IN OUR 4032 02:50:40,560 --> 02:50:42,080 SCHOOL HEARD THE HISTORY ASPECT 4033 02:50:42,080 --> 02:50:45,040 AGAIN AND WHAT LIMITATIONS TO BE 4034 02:50:45,040 --> 02:50:50,920 FACED WHEN WE TRIED TO ESTABLISH 4035 02:50:50,920 --> 02:50:51,240 CAUSALITY. 4036 02:50:51,240 --> 02:50:52,880 WE HAVE DIFFERENT VIEWS ON RIGOR 4037 02:50:52,880 --> 02:50:55,080 TRAINING THROUGH DIFFERENT 4038 02:50:55,080 --> 02:50:56,800 COURSES AT DIFFERENT EDUCATIONAL 4039 02:50:56,800 --> 02:50:57,760 EXPERIENCES THAT HELPED OUR 4040 02:50:57,760 --> 02:50:59,080 STUDENTS MAKE CONNECTIONS THAT 4041 02:50:59,080 --> 02:51:02,960 HAVE A MORE HOLISTIC VIEW OF 4042 02:51:02,960 --> 02:51:03,640 SCIENTIFIC RESEARCH TRAINING AND 4043 02:51:03,640 --> 02:51:04,400 VARIOUS ASPECTS. 4044 02:51:04,400 --> 02:51:05,840 I DON'T NEED TO GO TO THE NEXT 4045 02:51:05,840 --> 02:51:08,360 SLIDE BECAUSE WE'RE RUNNING OUT 4046 02:51:08,360 --> 02:51:09,520 OF TIME BUT IF ANYBODY WANTS TO 4047 02:51:09,520 --> 02:51:11,120 KNOW HOW WE EVALUATE THIS I CAN 4048 02:51:11,120 --> 02:51:15,080 TALK ABOUT THIS IN THE BREAKS. 4049 02:51:15,080 --> 02:51:22,760 THANK YOU VERY MUCH. 4050 02:51:22,760 --> 02:51:25,520 >> WE DON'T HAVE TO CLOSE THE 4051 02:51:25,520 --> 02:51:27,120 TABS BECAUSE KARI'S TALK IS 4052 02:51:27,120 --> 02:51:37,200 THERE. 4053 02:51:51,840 --> 02:51:54,080 >> LET ME PRACTICE, FORWARD, 4054 02:51:54,080 --> 02:51:55,240 BACK. 4055 02:51:55,240 --> 02:51:55,880 OKAY. 4056 02:51:55,880 --> 02:52:00,480 HI, I'M KARI JORDAN EXECUTIVE 4057 02:52:00,480 --> 02:52:02,320 DIRECTOR FOR THE CARPENTRY. 4058 02:52:02,320 --> 02:52:04,560 TODAY I'LL BE SHARING THE NINE 4059 02:52:04,560 --> 02:52:07,160 CORE VALUES OF THE CARPENTRY'S 4060 02:52:07,160 --> 02:52:08,160 ORGANIZATION AND DRAWING PAIR 4061 02:52:08,160 --> 02:52:11,800 LEVELS BETWEEN THEM AND THE 4062 02:52:11,800 --> 02:52:13,840 SKILLS AND BEHAVIORS THAT I 4063 02:52:13,840 --> 02:52:14,760 BELIEVE PROMOTE RESEARCH RIGOR. 4064 02:52:14,760 --> 02:52:17,400 FIRST I WOULD LIKE TO GIVE YOU A 4065 02:52:17,400 --> 02:52:20,200 BRIEF OVERVIEW OF THE CARPENTRY 4066 02:52:20,200 --> 02:52:22,640 IN CASE YOU HAD NOT HEARD OF OUR 4067 02:52:22,640 --> 02:52:23,800 PROJECT. 4068 02:52:23,800 --> 02:52:24,920 IT BUILDS GLOBAL CAPACITY AND 4069 02:52:24,920 --> 02:52:26,560 ESSENTIAL DATA AND COMPUTATIONAL 4070 02:52:26,560 --> 02:52:28,680 SKILLS FOR CONDUCTING EFFICIENT, 4071 02:52:28,680 --> 02:52:32,320 OPEN AND REPRODUCIBLE RESEARCH. 4072 02:52:32,320 --> 02:52:35,960 WE TRY TO FOSTER AN INCLUSIVE 4073 02:52:35,960 --> 02:52:37,560 AND DIVERSE COMMUNITY OF 4074 02:52:37,560 --> 02:52:38,880 INSTRUCTORS AND LEARNERS THAT 4075 02:52:38,880 --> 02:52:39,960 PROMOTES AND MODEL THE 4076 02:52:39,960 --> 02:52:40,640 IMPORTANCE OF SOFTWARE AND DATA 4077 02:52:40,640 --> 02:52:43,480 IN RESEARCH. 4078 02:52:43,480 --> 02:52:47,400 WE COLLABORATIVE DEVELOP 4079 02:52:47,400 --> 02:52:51,720 OPENINGLY AVAILABLE LESSONS AND 4080 02:52:51,720 --> 02:52:53,360 USE EVIDENCE-BASED TEACHING 4081 02:52:53,360 --> 02:52:56,600 APPROACHES AND WE WANT TO BE THE 4082 02:52:56,600 --> 02:52:57,280 INCLUSIVE COMMUNITY TEACHING 4083 02:52:57,280 --> 02:52:59,760 DATA AND CODING SKILLS. 4084 02:52:59,760 --> 02:53:01,280 WE HAVE A RICH HISTORY GOING 4085 02:53:01,280 --> 02:53:03,720 BACK TO 1998 WHEN SOFTWARE CON 4086 02:53:03,720 --> 02:53:07,920 PEN -- CARPENTRY. 4087 02:53:07,920 --> 02:53:10,240 DATA CARPENTRY WAS FOUNDED IN 4088 02:53:10,240 --> 02:53:13,160 2014 WITH THE MISSION OF 4089 02:53:13,160 --> 02:53:14,480 BUILDING COMMUNITIES TEACHING 4090 02:53:14,480 --> 02:53:16,800 UNIVERSAL DATA LITERACY AND IN 4091 02:53:16,800 --> 02:53:18,040 2014 LIBRARY CARPENTRY WAS 4092 02:53:18,040 --> 02:53:21,480 FOUNDED WITH THE MISSION OF 4093 02:53:21,480 --> 02:53:24,800 TEACHING DATA SKILLS TO THOSE 4094 02:53:24,800 --> 02:53:28,000 WORKING IN LIBRARY AND 4095 02:53:28,000 --> 02:53:29,280 SCIENCE-RELATED ROLES. 4096 02:53:29,280 --> 02:53:31,040 AND THEN PROJECTS MERGED TO FORM 4097 02:53:31,040 --> 02:53:34,600 A NEW PROJECT CALLED THE 4098 02:53:34,600 --> 02:53:36,360 CARPENTRY UNDER THE FISCAL 4099 02:53:36,360 --> 02:53:37,320 SPONSORSHIP OF COMMUNITY 4100 02:53:37,320 --> 02:53:37,600 INITIATES. 4101 02:53:37,600 --> 02:53:39,120 WE HAVE SOME INSTRUCTORS IN THE 4102 02:53:39,120 --> 02:53:43,320 ROOM IF YOU WANT TO WAVE YOUR 4103 02:53:43,320 --> 02:53:43,720 HAND. 4104 02:53:43,720 --> 02:53:46,440 I APPRECIATE YOU SO SO MUCH. 4105 02:53:46,440 --> 02:53:49,280 SINCE 2012 AND AS OF THE END OF 4106 02:53:49,280 --> 02:53:51,600 2021, WE'VE RUN ABOUT 3,000 WORK 4107 02:53:51,600 --> 02:53:54,320 SHOPS IN 64 COUNTRIES. 4108 02:53:54,320 --> 02:53:58,040 WE'VE TRAINED 3,419 VOLUNTEER 4109 02:53:58,040 --> 02:54:02,520 INSTRUCTORS TO DELIVER OUR 45 4110 02:54:02,520 --> 02:54:05,160 COLLABORATELY OPEN-SOURCED 4111 02:54:05,160 --> 02:54:05,800 LESSONS TO LEARNERS ACROSS THE 4112 02:54:05,800 --> 02:54:09,240 WORLD. 4113 02:54:09,240 --> 02:54:13,160 THE WAY OUR ORGANIZATION 4114 02:54:13,160 --> 02:54:14,920 SUSTAINS ITSELF THROUGH PEOPLE. 4115 02:54:14,920 --> 02:54:16,600 WE CREATE OPPORTUNITIES FOR 4116 02:54:16,600 --> 02:54:17,960 INDIVIDUAL TO CONTRIBUTE AND 4117 02:54:17,960 --> 02:54:19,120 GROW AND PROVIDE OPPORTUNITIES 4118 02:54:19,120 --> 02:54:22,120 FOR THEM TO TEACH, TO BUILD 4119 02:54:22,120 --> 02:54:24,000 COMMUNITY AND TO DEVELOP 4120 02:54:24,000 --> 02:54:24,320 LESSONS. 4121 02:54:24,320 --> 02:54:26,480 WE'RE ALWAYS LOOKING FOR WAYS TO 4122 02:54:26,480 --> 02:54:31,320 INCENTIVIZE THEIR CONTRIBUTIONS 4123 02:54:31,320 --> 02:54:33,640 AND ALSO AVERAGE RESOURCES 4124 02:54:33,640 --> 02:54:35,120 AVAILABLE TO GLOBAL COMMUNITIES 4125 02:54:35,120 --> 02:54:39,080 AND DISCIPLINE-SPECIFIC 4126 02:54:39,080 --> 02:54:46,120 COMMUNITIES. 4127 02:54:46,120 --> 02:54:50,120 I HOPE THIS OVERVIEW HAS GIVEN 4128 02:54:50,120 --> 02:54:57,720 YOU A CONCISE OVERVIEW OF THE 4129 02:54:57,720 --> 02:54:58,800 CARPENTRY AND WHO OUR AUDIENCE 4130 02:54:58,800 --> 02:54:59,120 IS. 4131 02:54:59,120 --> 02:55:00,360 WE BELIEVE ALL PEOPLE AT ALL 4132 02:55:00,360 --> 02:55:02,080 LEVELS ABLE TO SHARE WHAT THEY 4133 02:55:02,080 --> 02:55:06,160 KNOW, THE MORE EFFICIENTLY WE 4134 02:55:06,160 --> 02:55:08,040 CAN DISTRIBUTE KNOWLEDGE AS 4135 02:55:08,040 --> 02:55:09,840 LEARNERS PROGRESS THEY OFTEN 4136 02:55:09,840 --> 02:55:12,200 BECOME INVOLVED IN THE COMMUNITY 4137 02:55:12,200 --> 02:55:12,760 IN DIFFERENT WAYS. 4138 02:55:12,760 --> 02:55:14,880 TEACHING WORKSHOPS, DEVELOPING 4139 02:55:14,880 --> 02:55:16,360 LESSONS, BUILDING LOCAL 4140 02:55:16,360 --> 02:55:16,680 COMMUNITIES. 4141 02:55:16,680 --> 02:55:18,720 IN THE LONG-TERM, WE HOPE TO 4142 02:55:18,720 --> 02:55:21,680 CREATE A COMMUNITY THAT CAN 4143 02:55:21,680 --> 02:55:23,400 CREATE WIDE-SPREAD SUPPORT AND I 4144 02:55:23,400 --> 02:55:25,520 BELIEVE THAT TYPE OF MIND SET IS 4145 02:55:25,520 --> 02:55:27,760 IMPORTANT TO CHAMPIONING 4146 02:55:27,760 --> 02:55:29,200 RESEARCH RIGOR. 4147 02:55:29,200 --> 02:55:30,760 GOING A BIT DEEPER, I WOULD LIKE 4148 02:55:30,760 --> 02:55:34,120 TO SHARE WITH YOU THE NINE CORE 4149 02:55:34,120 --> 02:55:35,840 VALUES OF THE CARPENTRIES AS I 4150 02:55:35,840 --> 02:55:37,880 BELIEVE THEY DIRECTLY ALIGN WITH 4151 02:55:37,880 --> 02:55:39,560 THE REQUIRED BEHAVIORS, 4152 02:55:39,560 --> 02:55:41,400 KNOWLEDGE, SKILLS AND 4153 02:55:41,400 --> 02:55:46,080 COMPETENCIES FOR RESEARCH RIGOR. 4154 02:55:46,080 --> 02:55:51,000 THE CARPENTRY SERVES OUR 4155 02:55:51,000 --> 02:55:51,720 COMMUNITY AND MAKES EVERY 4156 02:55:51,720 --> 02:55:53,280 DECISION WITH THESE NINE COUR 4157 02:55:53,280 --> 02:55:56,960 VALUES IN MIND AND THEY ARE ACT 4158 02:55:56,960 --> 02:55:58,840 OP 4159 02:55:58,840 --> 02:56:00,360 OPENLY, EMPOWER ONE ANOTHER, 4160 02:56:00,360 --> 02:56:02,640 VALUE ALL CONTRIBUTIONS, ALWAYS 4161 02:56:02,640 --> 02:56:04,920 LEARNING, INCLUSIVE EVOLVE, 4162 02:56:04,920 --> 02:56:08,640 PEOPLE FIRST, ACCESS FOR ALL, 4163 02:56:08,640 --> 02:56:09,760 AND COMMUNITY COLLABORATION, 4164 02:56:09,760 --> 02:56:13,720 STRENGTH THROUGH DIVERSITY. 4165 02:56:13,720 --> 02:56:16,240 I'LL WALK YOU THROUGH EACH 4166 02:56:16,240 --> 02:56:18,640 VALUES AS THEY RELATE TO 4167 02:56:18,640 --> 02:56:19,160 BEHAVIORS I FEEL PROMOTE 4168 02:56:19,160 --> 02:56:26,960 RESEARCH RIGOR. 4169 02:56:26,960 --> 02:56:28,120 STARTING WITH MOTIVATION. 4170 02:56:28,120 --> 02:56:29,440 WHY ARE WE AT THIS MEETING AND 4171 02:56:29,440 --> 02:56:31,160 WHY DO YOU THINK IT'S IMPORTANT 4172 02:56:31,160 --> 02:56:32,720 TO CHAMPION RESEARCH RIGOR? 4173 02:56:32,720 --> 02:56:34,640 THESE TWO CARPENTRY'S VALUES 4174 02:56:34,640 --> 02:56:35,560 COME TO MIND. 4175 02:56:35,560 --> 02:56:36,960 ALWAYS LEARNING. 4176 02:56:36,960 --> 02:56:41,280 WE VALUE A GROWTH MIND SET IN 4177 02:56:41,280 --> 02:56:43,520 ALL THAT WE DO AND STRIVE FOR 4178 02:56:43,520 --> 02:56:45,680 CONTINUOUS IMPROVEMENT AND 4179 02:56:45,680 --> 02:56:47,960 EVOLVING OURSELVES AND 4180 02:56:47,960 --> 02:56:48,640 METHODOLOGIES AND BEING 4181 02:56:48,640 --> 02:56:49,960 RESPONSIVE AND CURIOUS AND 4182 02:56:49,960 --> 02:56:50,640 RECEPTIVE TO FEEDBACK AND EAGER 4183 02:56:50,640 --> 02:56:54,760 TO LEARN. 4184 02:56:54,760 --> 02:56:57,120 STRENGTH THROUGH DIVERSITY. 4185 02:56:57,120 --> 02:56:58,480 APPRECIATING IDENTITIES ARE 4186 02:56:58,480 --> 02:57:00,440 COMPLEX AND INDIVIDUAL. 4187 02:57:00,440 --> 02:57:02,880 WE BELIEVE IN EMPOWERING A 4188 02:57:02,880 --> 02:57:03,880 DIVERSE GROUP OF PEOPLE TO WORK 4189 02:57:03,880 --> 02:57:07,360 WITH DATA AND CODE AND ANSWER 4190 02:57:07,360 --> 02:57:09,440 THE QUESTIONS IMPORTANT TO THEM 4191 02:57:09,440 --> 02:57:10,280 TO ADDRESS CHALLENGES IN SCIENCE 4192 02:57:10,280 --> 02:57:15,320 AND SOCIETY. 4193 02:57:15,320 --> 02:57:17,240 WHAT ARE YOUR GOALS WHEN 4194 02:57:17,240 --> 02:57:17,880 PROMOTING RESEARCH RIGOR? 4195 02:57:17,880 --> 02:57:23,120 I'D LIKE TO POINT TO A FEW OF 4196 02:57:23,120 --> 02:57:25,720 THE CARPENTRIES CORE VALUES. 4197 02:57:25,720 --> 02:57:28,960 ACT OPENLY. 4198 02:57:28,960 --> 02:57:31,920 WE BELIEVE TRANSPARENCY, HONESTY 4199 02:57:31,920 --> 02:57:34,400 AND FAIRNESS ARE KEYS TO 4200 02:57:34,400 --> 02:57:36,320 FOSTERING TRUST WITHIN AN OPEN 4201 02:57:36,320 --> 02:57:36,720 COMMUNITY. 4202 02:57:36,720 --> 02:57:39,480 EMPOWER ONE ANOTHER. 4203 02:57:39,480 --> 02:57:41,960 WE HELP PEOPLE BUILD KNOWLEDGE 4204 02:57:41,960 --> 02:57:43,640 BY CREATE CONDUCIVE ENVIRONMENT 4205 02:57:43,640 --> 02:57:45,600 FOR THE EXCHANGE OF SKILLS, 4206 02:57:45,600 --> 02:57:47,120 PERSPECTIVES AND EXPERIENCES 4207 02:57:47,120 --> 02:57:50,600 THAT EMPOWER PEOPLE AND ENABLE 4208 02:57:50,600 --> 02:57:52,000 THEM TO REACH THEIR FULL 4209 02:57:52,000 --> 02:57:54,440 POTENTIAL. 4210 02:57:54,440 --> 02:57:57,400 INCLUSIVE OF ALL. 4211 02:57:57,400 --> 02:58:01,440 WE WELCOME AND EXTEND EMPATHY 4212 02:58:01,440 --> 02:58:02,440 AND KINDNESS TO LEVERAGE 4213 02:58:02,440 --> 02:58:06,960 CONTRIBUTIONS FROM ALL COMMUNITY 4214 02:58:06,960 --> 02:58:08,120 MEMBERS REGARDLESS OF IDENTITY 4215 02:58:08,120 --> 02:58:09,560 AND EXPRESSION AND THIS IS ONE 4216 02:58:09,560 --> 02:58:11,560 OF MY FAVORITE AND I LOVE ALL 4217 02:58:11,560 --> 02:58:17,760 NINE BUT PEOPLE FIRST IS HOW I 4218 02:58:17,760 --> 02:58:28,000 LIVE MY ROLES. 4219 02:58:30,600 --> 02:58:33,120 WE MAKE EXPRESSION THAT LOWER 4220 02:58:33,120 --> 02:58:37,520 BARRIERS FOR PARTICIPATION. 4221 02:58:37,520 --> 02:58:38,640 LASTLY, BEST PRACTICES. 4222 02:58:38,640 --> 02:58:41,520 THIS IS FUNNY BECAUSE DURING 4223 02:58:41,520 --> 02:58:47,560 LUNCH I LEARNED FROM JASON THAT 4224 02:58:47,560 --> 02:58:49,160 WE SHOULD CHANGE BEST PRACTICES, 4225 02:58:49,160 --> 02:58:50,920 WHAT DID YOU SAY WE SHOULD 4226 02:58:50,920 --> 02:58:54,880 CHANGE IT TO? 4227 02:58:54,880 --> 02:58:55,720 CONSENSUS PRACTICES BECAUSE 4228 02:58:55,720 --> 02:58:58,960 WHO'S CONSENSUS IS THIS? 4229 02:58:58,960 --> 02:58:59,440 IT DEPENDS. 4230 02:58:59,440 --> 02:59:01,680 SOME PRACTICES I BELIEVE WOULD 4231 02:59:01,680 --> 02:59:04,520 BE SOLID IDEALS FOR PROMOTING 4232 02:59:04,520 --> 02:59:06,680 RESEARCH RIGOR AND THESE ARE THE 4233 02:59:06,680 --> 02:59:09,680 LAST THREE CARPENTRIES FOUR 4234 02:59:09,680 --> 02:59:10,280 VALUES. 4235 02:59:10,280 --> 02:59:19,120 VALUE ALL CONTRIBUTIONS. 4236 02:59:19,120 --> 02:59:22,040 WE VALUE INPUT THROUGH CODE, 4237 02:59:22,040 --> 02:59:23,480 LESSONS AND THE BROADER ECO 4238 02:59:23,480 --> 02:59:27,120 SYSTEM AS LONG AS THEY ADHERE TO 4239 02:59:27,120 --> 02:59:29,680 OUR CODE OF CONDUCT OF COURSE 4240 02:59:29,680 --> 02:59:31,640 ACCESS FOR ALL. 4241 02:59:31,640 --> 02:59:33,280 WE VALUE ACCESSIBILITY AS CORE 4242 02:59:33,280 --> 02:59:35,400 AND CREATE MULTIPLE AVENUES FOR 4243 02:59:35,400 --> 02:59:36,680 PARTICIPATION WHERE ALL PEOPLE 4244 02:59:36,680 --> 02:59:40,240 CAN LEARN AND CONTRIBUTE. 4245 02:59:40,240 --> 02:59:42,440 AND LASTLY, COMMUNITY 4246 02:59:42,440 --> 02:59:42,760 COLLABORATION. 4247 02:59:42,760 --> 02:59:45,920 OUR CURRICULA AND PROGRAMS ARE 4248 02:59:45,920 --> 02:59:46,560 DEVELOPED BY AND WITH OUR 4249 02:59:46,560 --> 02:59:50,120 COMMUNITY MEMBERS. 4250 02:59:50,120 --> 02:59:52,000 WE SEE COLLABORATION ACROSS 4251 02:59:52,000 --> 02:59:54,600 BORDERS, DOMAINS AND INITIATIVES 4252 02:59:54,600 --> 03:00:01,000 AS A PATHWAY TO EMPOWER PEOPLE 4253 03:00:01,000 --> 03:00:03,400 AND REALIZE SHARED GOALS. 4254 03:00:03,400 --> 03:00:04,880 I'LL END WITH A FEW QUESTIONS 4255 03:00:04,880 --> 03:00:05,520 FOR TO YOU CONSIDER AS WE 4256 03:00:05,520 --> 03:00:09,840 CONTINUE ON WITH THE SESSION. 4257 03:00:09,840 --> 03:00:15,080 WHICH OF THE CARPENTRIES VALUES 4258 03:00:15,080 --> 03:00:18,160 AND STRENGTH THROUGH DIVERSITY 4259 03:00:18,160 --> 03:00:19,360 ALIGNS WITH YOUR PERSONAL 4260 03:00:19,360 --> 03:00:20,720 MOTIVATION OR CHAMPIONING 4261 03:00:20,720 --> 03:00:22,920 RESEARCH RIGOR? 4262 03:00:22,920 --> 03:00:27,120 WHAT DOES SUCCESS LOOK LIKE FOR 4263 03:00:27,120 --> 03:00:29,400 RESEARCH RIGOR CONSIDERING THESE 4264 03:00:29,400 --> 03:00:32,760 VALUES, ACT OPENLY, EMPOWER ONE 4265 03:00:32,760 --> 03:00:33,360 ANOTHER, INCLUSIVE OF ALL AND 4266 03:00:33,360 --> 03:00:37,440 PEOPLE FIRST. 4267 03:00:37,440 --> 03:00:40,840 AND LASTLY, WHAT DO THESE 4268 03:00:40,840 --> 03:00:42,760 VALUES, VALUE ALL CONTRIBUTIONS, 4269 03:00:42,760 --> 03:00:47,280 ACCESS TO FOR ALL AND COMMUNITY 4270 03:00:47,280 --> 03:00:48,040 COLLABORATION. 4271 03:00:48,040 --> 03:00:49,640 DO YOU FEEL EQUIPPED TO 4272 03:00:49,640 --> 03:00:51,800 IMMEDIATELY APPLY OR ADVOCATE 4273 03:00:51,800 --> 03:00:53,920 FOR AS A RESEARCH RIGOR CHAMPION 4274 03:00:53,920 --> 03:00:56,760 AND WHICH WOULD YOU NEED MORE 4275 03:00:56,760 --> 03:01:01,760 RESOURCES OR SUPPORT FOR? 4276 03:01:01,760 --> 03:01:02,560 THANK YOU SO MUCH AND I LOOK 4277 03:01:02,560 --> 03:01:13,000 FORWARD TO OUR DISCUSSION. 4278 03:01:19,840 --> 03:01:30,320 >> RUSS IS JOINING US VIA ZOOM. 4279 03:01:35,960 --> 03:01:36,520 >> SORRY I CAN'T BE THERE IN 4280 03:01:36,520 --> 03:01:44,960 PERSON. 4281 03:01:44,960 --> 03:01:50,160 >> I'M GOING FOCUS ON A FIELD 4282 03:01:50,160 --> 03:01:51,120 RATHER THAN OTHER WAYS OF 4283 03:01:51,120 --> 03:01:53,160 THINKING ABOUT OUR ORGANIZATIONS 4284 03:01:53,160 --> 03:01:55,120 AND HIGHLIGHT LESSONS WE'VE 4285 03:01:55,120 --> 03:01:58,200 LEARNED WITHIN THE FIELD OF 4286 03:01:58,200 --> 03:01:58,880 NEUROIMAGING ONE OF THE RESEARCH 4287 03:01:58,880 --> 03:02:00,320 AREAS I WORK IN AND I'LL START 4288 03:02:00,320 --> 03:02:02,960 BY HIGHLIGHTING THE FACT THAT 4289 03:02:02,960 --> 03:02:05,400 PART OF THE REASON THAT A LOT OF 4290 03:02:05,400 --> 03:02:08,200 PEOPLE CARE ABOUT RIGOR AND 4291 03:02:08,200 --> 03:02:09,240 REPRODUCIBILITY IN OUR FIELD IS 4292 03:02:09,240 --> 03:02:10,480 WE'VE SEEN A NUMBER OF 4293 03:02:10,480 --> 03:02:11,240 CONTROVERSIES OVER THE LAST 4294 03:02:11,240 --> 03:02:12,400 COUPLE DECADES. 4295 03:02:12,400 --> 03:02:15,120 ONE YOU MAY HAVE HEARD OF WAS A 4296 03:02:15,120 --> 03:02:17,640 WELL-KNOWN PAPER SHOWING IF YOU 4297 03:02:17,640 --> 03:02:20,040 TAKE COMMONLY USED PRACTICES YOU 4298 03:02:20,040 --> 03:02:24,040 CAN PUT A DEAD FISH IN AN MRI 4299 03:02:24,040 --> 03:02:29,680 SCANNER YOU CAN FIND BRAIN AB 4300 03:02:29,680 --> 03:02:31,520 -- ACTIVITY AS IT EXHIBITS 4301 03:02:31,520 --> 03:02:32,160 THEORY OF MIND. 4302 03:02:32,160 --> 03:02:33,720 THAT WAS PROBLEMATIC AND ANOTHER 4303 03:02:33,720 --> 03:02:36,880 PAPER HIGHLIGHTED THAT PEOPLE 4304 03:02:36,880 --> 03:02:39,000 WERE REPORTING BASICALLY 4305 03:02:39,000 --> 03:02:39,680 UNREASONABLY LARGE CORRELATIONS 4306 03:02:39,680 --> 03:02:41,520 BETWEEN BRAIN ACTIVITY AND 4307 03:02:41,520 --> 03:02:42,440 BEHAVIOR WHICH LARGELY CAME FROM 4308 03:02:42,440 --> 03:02:45,960 THE FACT THAT THEY WERE DOING 4309 03:02:45,960 --> 03:02:46,920 CIRCULAR DOUBLE-DIPPING SORTS OF 4310 03:02:46,920 --> 03:02:49,680 ANALYSES. 4311 03:02:49,680 --> 03:02:53,000 MORE RECENTLY A GROUP OF 4312 03:02:53,000 --> 03:02:54,800 RESEARCH SHOWED THAT THE 4313 03:02:54,800 --> 03:02:56,040 TECHNIQUES FOR MULTIPLE 4314 03:02:56,040 --> 03:02:57,200 COMPARISON QUESTION WE THOUGHT 4315 03:02:57,200 --> 03:02:59,080 WERE DOING A GOOD JOB FOR A 4316 03:02:59,080 --> 03:03:00,680 COUPLE OF DECADES TURNED OUT TO 4317 03:03:00,680 --> 03:03:03,440 NOT BE DOING SO WELL AND THEY 4318 03:03:03,440 --> 03:03:08,480 ARGUE COULD HAVE A LARGE IMPACT 4319 03:03:08,480 --> 03:03:10,440 A NUMBER OF RESULTS ON STUDIES 4320 03:03:10,440 --> 03:03:12,760 AND A CONTRIBUTION LAST YEAR 4321 03:03:12,760 --> 03:03:16,240 BASICALLY GAVE OUT THE SAME DATA 4322 03:03:16,240 --> 03:03:17,160 SET TO 70 DIFFERENT RESEARCH 4323 03:03:17,160 --> 03:03:18,400 GROUPS AND ASKED THEM TO ALL ASK 4324 03:03:18,400 --> 03:03:20,320 THE SAME QUESTION WITH THE DATA 4325 03:03:20,320 --> 03:03:23,040 AND WE SAW REMARKABLE 4326 03:03:23,040 --> 03:03:24,440 VARIABILITY IN THE ANSWERS THEY 4327 03:03:24,440 --> 03:03:25,120 GAVE US. 4328 03:03:25,120 --> 03:03:29,640 SO ALL THESE HIGHLIGHT THE FACT 4329 03:03:29,640 --> 03:03:31,120 THAT THE COMPLEX DATA ANALYSIS 4330 03:03:31,120 --> 03:03:34,680 THAT GO INTO BRAIN IMAGING USING 4331 03:03:34,680 --> 03:03:38,240 FUNCTIONAL MRI WHICH IS THE 4332 03:03:38,240 --> 03:03:42,240 TECHNIQUE WE USED LEAVE OPEN THE 4333 03:03:42,240 --> 03:03:43,280 SUBSTANTIAL REPRODUCIBILITY 4334 03:03:43,280 --> 03:03:43,520 PROBLEMS. 4335 03:03:43,520 --> 03:03:44,960 WHAT WE'VE SEEN IN OUR FIELD 4336 03:03:44,960 --> 03:03:46,720 PARTICULARLY IN THE LAST DECADE 4337 03:03:46,720 --> 03:03:48,520 IS A STRONG MOVE TOWARDS OPEN 4338 03:03:48,520 --> 03:03:49,560 AND REPRODUCIBLE SCIENCE. 4339 03:03:49,560 --> 03:03:50,760 I WANT TO HIGHLIGHT TODAY WHAT I 4340 03:03:50,760 --> 03:03:55,120 THINK HAS DRIVEN THAT AND WHAT 4341 03:03:55,120 --> 03:03:56,840 ARE LESSONS TO BE LEARNED HOUN 4342 03:03:56,840 --> 03:04:06,120 WELL OUR FIELD HAS DONE. 4343 03:04:06,120 --> 03:04:07,240 I'LL HIGHLIGHT THE CONTRIBUTIONS 4344 03:04:07,240 --> 03:04:11,840 OUR GROUP HAS MADE AND WE'RE ONE 4345 03:04:11,840 --> 03:04:14,160 OF MANY. 4346 03:04:14,160 --> 03:04:15,200 THERE'S OPEN DATA THAT SHARE 4347 03:04:15,200 --> 03:04:18,080 DIFFERENT TYPES OF DATA. 4348 03:04:18,080 --> 03:04:19,760 ANOTHER IS OPEN TOOLS THAT FOCUS 4349 03:04:19,760 --> 03:04:23,080 ON RIGOR AND REPRODUCIBILITY BE 4350 03:04:23,080 --> 03:04:25,120 THAT FOR DATA CONTROL OR 4351 03:04:25,120 --> 03:04:27,120 PROCESSING OR STUDY DESIGN. 4352 03:04:27,120 --> 03:04:28,920 AND THEN THIS IS ALL UNDER 4353 03:04:28,920 --> 03:04:32,560 PINNED BY A SET OF OPEN 4354 03:04:32,560 --> 03:04:34,440 STANDARDS FOR THE ORGANIZATION 4355 03:04:34,440 --> 03:04:35,120 OF DATA. 4356 03:04:35,120 --> 03:04:37,840 DEVELOPING DATA STANDARDS IS ONE 4357 03:04:37,840 --> 03:04:39,120 OF THE MOST PORE THINGS ONE CAN 4358 03:04:39,120 --> 03:04:43,080 DO BUT TURNED OUT TO BE AMAZE 4359 03:04:43,080 --> 03:04:47,000 LIG IMPACTFUL IN OUR FIELD TO 4360 03:04:47,000 --> 03:04:49,320 SHARE DATA IN A HIGHLY EFFECTIVE 4361 03:04:49,320 --> 03:04:49,560 WAY. 4362 03:04:49,560 --> 03:04:51,440 THE FIELD HAD A FALSE START FOR 4363 03:04:51,440 --> 03:04:53,000 DATA SHARING A COUPLE DECADES 4364 03:04:53,000 --> 03:04:53,240 AGO. 4365 03:04:53,240 --> 03:04:54,760 THERE WAS A PIONEERING GROUP 4366 03:04:54,760 --> 03:05:03,120 THAT STARTED THIS PROJECT CALLED 4367 03:05:03,120 --> 03:05:07,840 THE FMRI AND REQUIRED SUBMISSION 4368 03:05:07,840 --> 03:05:11,200 OF DATA AFTER PUBLICATION. 4369 03:05:11,200 --> 03:05:12,880 AND THIS LED TO A FIRE STORM IN 4370 03:05:12,880 --> 03:05:14,200 THE FIELD. 4371 03:05:14,200 --> 03:05:21,160 THIS IS AN OPEN LETTER SENT 4372 03:05:21,160 --> 03:05:24,280 AROUND BASICALLY SAYING WE'RE 4373 03:05:24,280 --> 03:05:26,480 CONCERNED OF ALL AUTHORS EXCEPT 4374 03:05:26,480 --> 03:05:28,800 FOR PUBLICATION TO SUBMIT ALL 4375 03:05:28,800 --> 03:05:30,720 DATA TO THE DATA CENTER. 4376 03:05:30,720 --> 03:05:32,400 THE FIELD WASN'T READY FOR DATA 4377 03:05:32,400 --> 03:05:33,160 SHARING AT THAT POINT. 4378 03:05:33,160 --> 03:05:35,120 BUT OVER THE LAST TWO DECADES 4379 03:05:35,120 --> 03:05:43,120 THAT'S CHANGED COMPLETELY. 4380 03:05:43,120 --> 03:05:45,680 IN IN ADDITION TO THE PROJECTS 4381 03:05:45,680 --> 03:05:51,040 MANY HAVE SHARED DATA OF MANY 4382 03:05:51,040 --> 03:05:53,080 DIFFERENT TYPES AND SCALES AND 4383 03:05:53,080 --> 03:05:55,120 THE GROUP I'M INVOLVED IN THE 4384 03:05:55,120 --> 03:05:56,760 PROFESSIONAL SOCIETY THAT IS ONE 4385 03:05:56,760 --> 03:05:58,840 IN THIS AREA CALLED THE 4386 03:05:58,840 --> 03:06:01,160 ORGANIZATION FOR HUMAN BRAIN 4387 03:06:01,160 --> 03:06:02,480 HAPPENING HAS BEEN CENTER OF 4388 03:06:02,480 --> 03:06:03,760 DEVELOPMENT OF OPEN SCIENCE 4389 03:06:03,760 --> 03:06:06,000 PRACTICES AND I THINK IT 4390 03:06:06,000 --> 03:06:11,720 HIGHLIGHTS THE IMPORTANCE OF 4391 03:06:11,720 --> 03:06:14,520 THINKING ABOUT PROFESSIONAL 4392 03:06:14,520 --> 03:06:17,040 SOCIETIES BECAUSE THEY CAN 4393 03:06:17,040 --> 03:06:19,280 CHANGE CULTURE WITH LOCAL 4394 03:06:19,280 --> 03:06:23,280 ORGANIZATIONS. 4395 03:06:23,280 --> 03:06:29,320 A COUPLE YEARS AGO AN ANONYMOUS 4396 03:06:29,320 --> 03:06:30,920 RESEARCHER SAID IT HAD BEEN 4397 03:06:30,920 --> 03:06:34,160 TAKEN OVER BY THE ZEALOTS AND 4398 03:06:34,160 --> 03:06:36,240 NOW THEY HAVE BECOME AN OPEN 4399 03:06:36,240 --> 03:06:39,160 SCIENCE ZEALOT THEMSELVES AND 4400 03:06:39,160 --> 03:06:47,120 DOING THEIR WORK OPEN SOURCE. 4401 03:06:47,120 --> 03:06:49,160 THE ATTENTION HAS COME TO 4402 03:06:49,160 --> 03:06:50,120 PROJECTS SPECIFICALLY TO SHARED 4403 03:06:50,120 --> 03:06:50,640 DATA. 4404 03:06:50,640 --> 03:06:56,360 WE CALL IT PROSPECTIVE DATA 4405 03:06:56,360 --> 03:06:58,440 SHARING. 4406 03:06:58,440 --> 03:07:01,560 IT WAS FUNDED TO SHARE DATA ON 4407 03:07:01,560 --> 03:07:03,120 1200 ADULTS AND MY GUESS IS IT'S 4408 03:07:03,120 --> 03:07:04,680 OVER 600 PUBLICATIONS AT THIS 4409 03:07:04,680 --> 03:07:07,360 POINT. 4410 03:07:07,360 --> 03:07:12,120 ONE ONGOING STUDY THE ABCD STUDY 4411 03:07:12,120 --> 03:07:12,960 IS FOLLOWING ABOUT 10,000 4412 03:07:12,960 --> 03:07:14,720 CHILDREN OVER THE COURSE OF A 4413 03:07:14,720 --> 03:07:17,920 DECADE AND SCANNING THEM 4414 03:07:17,920 --> 03:07:19,120 REGULARLY TO UNDERSTAND BRAIN 4415 03:07:19,120 --> 03:07:21,120 DEVELOPMENT AND HOW IT RELATES 4416 03:07:21,120 --> 03:07:23,120 TO VARIOUS OUTCOMES PARTICULARLY 4417 03:07:23,120 --> 03:07:30,280 IN DRUG ABUSE. 4418 03:07:30,280 --> 03:07:31,560 MY GROUP'S BEEN INTERESTED IN 4419 03:07:31,560 --> 03:07:33,000 SHARING DATA AFTER THE DATA HAD 4420 03:07:33,000 --> 03:07:36,360 BEEN COLLECTED AND SO WE'VE 4421 03:07:36,360 --> 03:07:38,960 DEVELOPED A SET OF TOOLS THAT 4422 03:07:38,960 --> 03:07:41,360 BASICALLY ALLOW PEOPLE TO SHARE 4423 03:07:41,360 --> 03:07:42,920 DIFFERENT TYPES OF DATA. 4424 03:07:42,920 --> 03:07:45,000 SOME ARE LIKE OPEN NEURO ALLOW 4425 03:07:45,000 --> 03:07:48,080 TO SHARE FULLY VAU DATA AND 4426 03:07:48,080 --> 03:07:49,720 SHARE STATISTICAL RESULTS AND AT 4427 03:07:49,720 --> 03:07:52,520 THE OTHER END THERE'S THE 4428 03:07:52,520 --> 03:07:57,880 RESULTS THAT COME FROM FOUND IN 4429 03:07:57,880 --> 03:07:59,120 PAPE 4430 03:07:59,120 --> 03:08:03,520 PAPERS AND I'VE SEEN TOOLS FOR 4431 03:08:03,520 --> 03:08:05,000 OPEN SCIENCE AND I'LL COME BACK 4432 03:08:05,000 --> 03:08:06,320 TO HOW I THINKNFRASTRUCTURE IS 4433 03:08:06,320 --> 03:08:15,040 KEY TO THIS. 4434 03:08:15,040 --> 03:08:17,800 THIS SHOWS THE GROWTH OF THE 4435 03:08:17,800 --> 03:08:19,040 OPEN DATABASE WE'VE RUN AND 4436 03:08:19,040 --> 03:08:20,000 SHOWING CONTINUOUS GROWTH IN 4437 03:08:20,000 --> 03:08:22,880 BOTH THE NUMBER OF DATA SETS AND 4438 03:08:22,880 --> 03:08:26,200 NUMBER OF SUBJECTS AND EACH IS 4439 03:08:26,200 --> 03:08:27,040 AN INDIVIDUAL PERSON THAT WAS 4440 03:08:27,040 --> 03:08:31,880 SCANNED AND HAVE 00 PLUS STUDIES 4441 03:08:31,880 --> 03:08:34,360 OVER A 20,000 INDIVIDUAL SUBJECT 4442 03:08:34,360 --> 03:08:35,080 IS MUCH HIGHER THAN THIS AT THIS 4443 03:08:35,080 --> 03:08:38,960 POINT. 4444 03:08:38,960 --> 03:08:41,920 THESE ARE STATISTICS FROM LAST 4445 03:08:41,920 --> 03:08:42,400 YEAR. 4446 03:08:42,400 --> 03:08:43,600 SO I WANT TO SAY A LITTLE BIT 4447 03:08:43,600 --> 03:08:47,280 ABOUT WHAT I THINK THE KEYS TO 4448 03:08:47,280 --> 03:08:49,000 SUCCESS PARTICULARLY OF DATA 4449 03:08:49,000 --> 03:08:50,960 SHARING BUT I THINK IT ALSO 4450 03:08:50,960 --> 03:08:57,840 EXTENDS TO ALL ASPECTS OF OPEN 4451 03:08:57,840 --> 03:09:01,480 SCIENCE PRACTICE IN THE FIELD OF 4452 03:09:01,480 --> 03:09:01,840 NEUROIMAGING. 4453 03:09:01,840 --> 03:09:03,720 WE'RE LUCKY IN SOME SENSE. 4454 03:09:03,720 --> 03:09:06,240 ONE WAY WE'RE LUCKY IS FOR THE 4455 03:09:06,240 --> 03:09:07,680 MOST PART OUR DATA OUR DIGITAL 4456 03:09:07,680 --> 03:09:10,280 END TO END. 4457 03:09:10,280 --> 03:09:12,840 THEY COME OFF AN MRI SCANNER AS 4458 03:09:12,840 --> 03:09:15,200 DIGITAL IMAGES AND GET PROCESSED 4459 03:09:15,200 --> 03:09:17,200 FROM THERE ON AND REDUCES MANUAL 4460 03:09:17,200 --> 03:09:18,760 STEPS IN THE PROCESS. 4461 03:09:18,760 --> 03:09:19,960 THERE'S SOMETIMES MANUAL STEPS 4462 03:09:19,960 --> 03:09:21,120 PARTICULARLY IN DIFFERENT 4463 03:09:21,120 --> 03:09:22,280 ASPECTS OF DATA ANALYSIS BUT 4464 03:09:22,280 --> 03:09:27,400 WE'RE ABLE TO MINIMIZE THOSE AND 4465 03:09:27,400 --> 03:09:29,040 THAT HELPS MAKES IT EASIER TO 4466 03:09:29,040 --> 03:09:29,400 SHARE THINGS. 4467 03:09:29,400 --> 03:09:32,080 WE HAVE A SET OF STANDARDIZED 4468 03:09:32,080 --> 03:09:34,160 FILE FORMATS AND DATA STANDARDS. 4469 03:09:34,160 --> 03:09:37,880 WE'RE LUCKY A GROUP CAME 4470 03:09:37,880 --> 03:09:40,880 TOGETHER BACK AROUND 2000 AND 4471 03:09:40,880 --> 03:09:42,960 WERE LIVING IN THE TOWER OF 4472 03:09:42,960 --> 03:09:44,760 BABBLE WHERE EVERY SOFTWARE 4473 03:09:44,760 --> 03:09:47,920 PACKAGE USED A DIFFERENT FORMAT 4474 03:09:47,920 --> 03:09:50,720 FOR MRI IMAGES AND A GROUP SAID 4475 03:09:50,720 --> 03:09:53,000 WE HAVE TO SOLVE IT HIT AND 4476 03:09:53,000 --> 03:09:54,760 DEVELOPED A THING CALLED NIFTY 4477 03:09:54,760 --> 03:09:57,000 AND EVERY SOFTWARE PACKAGE NOW 4478 03:09:57,000 --> 03:09:58,120 USES NIFTY OR SEVERAL 4479 03:09:58,120 --> 03:09:59,200 ADAPTATIONS FOR DIFFERENT TYPES 4480 03:09:59,200 --> 03:10:02,240 OF DATA. 4481 03:10:02,240 --> 03:10:05,640 BASICALLY MUCH ANY SOFTWARE 4482 03:10:05,640 --> 03:10:07,440 PACKAGE CAN READ ANY DATA FILE 4483 03:10:07,440 --> 03:10:12,680 COLLECTED IN OUR FIELD. 4484 03:10:12,680 --> 03:10:15,040 THE DATA ARE IMMEDIATELY USABLE 4485 03:10:15,040 --> 03:10:16,360 BY ANYONE. 4486 03:10:16,360 --> 03:10:18,480 I MENTIONED UP FRONT THE DATA 4487 03:10:18,480 --> 03:10:20,840 STANDARD WE DEVELOPED THE BRAIN 4488 03:10:20,840 --> 03:10:25,840 IMAGING DATA STRUCTURE WE 4489 03:10:25,840 --> 03:10:27,920 STARTED DEVELOPING IN 2016 AND 4490 03:10:27,920 --> 03:10:30,040 HAS BECOME A LARGE STEERING 4491 03:10:30,040 --> 03:10:32,280 EFFORT AND THERE'S A STEERING 4492 03:10:32,280 --> 03:10:33,000 COMMITTEE AND INTERNATIONAL 4493 03:10:33,000 --> 03:10:34,080 EFFORT AT THIS POINT AND ONE 4494 03:10:34,080 --> 03:10:36,640 THING WE FOCUSSED ON IN THAT 4495 03:10:36,640 --> 03:10:37,800 PARTICULAR EFFORT WAS PROVIDING 4496 03:10:37,800 --> 03:10:42,800 TOOLS TO ALLOW PEOPLE TO 4497 03:10:42,800 --> 03:10:43,720 AUTOMATICALLY VALIDATE THEIR 4498 03:10:43,720 --> 03:10:43,920 DATA. 4499 03:10:43,920 --> 03:10:47,120 THE IDEA IS IF I HAVE A DATA 4500 03:10:47,120 --> 03:10:49,640 SET, DOES IT ACCORD WITH 4501 03:10:49,640 --> 03:10:49,880 STANDARD? 4502 03:10:49,880 --> 03:10:52,680 I CAN GO TO A WEB PAGE AND POINT 4503 03:10:52,680 --> 03:10:54,960 TO MY DATA ON MY COMPUTER AND 4504 03:10:54,960 --> 03:10:57,000 WITHIN SECONDS IT TELLS ME YES, 4505 03:10:57,000 --> 03:10:58,320 YOUR DATA SET MEETS THE STANDARD 4506 03:10:58,320 --> 03:11:00,960 OR DOESN'T, HERE'S THE THINGS 4507 03:11:00,960 --> 03:11:03,000 YOU NEED TO FIX IN ORDER FOR IT 4508 03:11:03,000 --> 03:11:04,760 TO WORK WITH THE STANDARD. 4509 03:11:04,760 --> 03:11:07,280 THAT HAS GREATLY REDUCED THE 4510 03:11:07,280 --> 03:11:10,920 BURDEN OF CURATION FOR THE 4511 03:11:10,920 --> 03:11:13,240 ARCHIVES WHO SHARE THE DATA. 4512 03:11:13,240 --> 03:11:14,880 IT PUTS A LITTLE BIT MORE WORK 4513 03:11:14,880 --> 03:11:16,160 ON THE OWNER OF THE DATA SET TO 4514 03:11:16,160 --> 03:11:21,120 GET IT IN THE STANDARD BUT 4515 03:11:21,120 --> 03:11:23,000 THERE'S A NUMBER OF STOOLS TO 4516 03:11:23,000 --> 03:11:24,200 MAKE IT AS EASY AS POSSIBLE. 4517 03:11:24,200 --> 03:11:27,920 WE HAVE A LOT OF PEOPLE IN OUR 4518 03:11:27,920 --> 03:11:28,920 FIELD DEVELOPING INFRASTRUCTURE 4519 03:11:28,920 --> 03:11:30,600 SOLELY FOR THE PURPOSE OF MAKING 4520 03:11:30,600 --> 03:11:32,560 IT EASIER TO SHARE DATA. 4521 03:11:32,560 --> 03:11:35,360 ANOTHER THING THINK IS OFTEN 4522 03:11:35,360 --> 03:11:37,560 FORGOTTEN IS THE IMPORTANCE OF 4523 03:11:37,560 --> 03:11:39,120 DEMONSTRATED SCIENTIFIC UTILITY. 4524 03:11:39,120 --> 03:11:41,720 EVERYBODY AGREES THAT OPEN 4525 03:11:41,720 --> 03:11:44,280 SCIENCE AND REPRODUCIBILITY AND 4526 03:11:44,280 --> 03:11:46,520 DATA SHARING ARE ALL GREAT 4527 03:11:46,520 --> 03:11:47,360 THINGS BUT KNOWING THEY'RE GREAT 4528 03:11:47,360 --> 03:11:52,840 THINGS IS NOT ENOUGH TO GET 4529 03:11:52,840 --> 03:11:57,880 PEOPLE TO DO IT WE'VE HAD A 4530 03:11:57,880 --> 03:12:01,480 NUMBER OF SUCCESS STORY AND A 4531 03:12:01,480 --> 03:12:05,240 POST-DOC IS NOW A FACULTY MEMBER 4532 03:12:05,240 --> 03:12:08,960 AT SIDNEY AND HE PUBLISHED 4533 03:12:08,960 --> 03:12:13,040 PAPERS IN HIGH IMPACT JOURNALS 4534 03:12:13,040 --> 03:12:20,920 BASED ON PON -- OPENLY SHARED 4535 03:12:20,920 --> 03:12:23,920 DATA AND HE'S ONE OF THOSE 4536 03:12:23,920 --> 03:12:25,720 CANONICAL DATA PARASITES WE 4537 03:12:25,720 --> 03:12:27,720 HEARD ABOUT BUT HAS MADE 4538 03:12:27,720 --> 03:12:31,000 SCIENTIFIC CONTRIBUTIONS BASED 4539 03:12:31,000 --> 03:12:35,920 ON THE SHARED DATA. 4540 03:12:35,920 --> 03:12:38,960 I MENTION THE IMPORTANCE OF 4541 03:12:38,960 --> 03:12:39,360 INFRASTRUCTURE. 4542 03:12:39,360 --> 03:12:40,360 YOU NEED INFRASTRUCTURE TO ALLOW 4543 03:12:40,360 --> 03:12:47,000 TO DO THINGS AS EASILY AS 4544 03:12:47,000 --> 03:12:51,000 POSSIBLE AND I HAVE A FIGURE 4545 03:12:51,000 --> 03:12:53,200 FROM A PROJECT CALLED A BURN AN 4546 03:12:53,200 --> 03:12:56,560 EARLY DATA SHARING PROJECT 4547 03:12:56,560 --> 03:13:01,760 PROBABLY 15 YEARS AGO THAT WENT 4548 03:13:01,760 --> 03:13:07,000 NOWHERE AND IF YOU LOOK AT THE 4549 03:13:07,000 --> 03:13:09,480 ARCHITECT YOU'RE YOU HAD TO 4550 03:13:09,480 --> 03:13:11,440 LEARN DIFFERENT ACRONYMS AND 4551 03:13:11,440 --> 03:13:12,520 COMPUTER SCIENCE CONCEPTS. 4552 03:13:12,520 --> 03:13:21,200 IT WAS A TOOL REALLY CUTTING 4553 03:13:21,200 --> 03:13:22,360 EDGE OF THE TECHNOLOGY BUT SO 4554 03:13:22,360 --> 03:13:24,800 COMPLEX NO ONE COULD GET THEIR 4555 03:13:24,800 --> 03:13:26,640 HEAD AROUND IT SO IT WENT 4556 03:13:26,640 --> 03:13:26,840 NOWHERE. 4557 03:13:26,840 --> 03:13:29,240 DOING THINGS THAT MAY NOT BE 4558 03:13:29,240 --> 03:13:34,160 TECHNICALLY THE COOLEST OR BEST 4559 03:13:34,160 --> 03:13:36,520 THING BUT WORKING SCIENTISTS CAN 4560 03:13:36,520 --> 03:13:40,320 GET THEIR HEADS AROUND AND CLOSE 4561 03:13:40,320 --> 03:13:41,880 TO WHAT THEY ALREADY DO IS 4562 03:13:41,880 --> 03:13:43,720 IMPORTANT. 4563 03:13:43,720 --> 03:13:44,960 THE OTHER THING IS WE CAN'T JUST 4564 03:13:44,960 --> 03:13:46,680 SAY YOU CAN SHARE YOUR DATA BUT 4565 03:13:46,680 --> 03:13:49,360 IF YOU SHARE YOUR DATA, THEN YOU 4566 03:13:49,360 --> 03:13:53,000 CAN TAKE ADVANTAGE OF OTHER NEW 4567 03:13:53,000 --> 03:13:59,000 THINGS OR FOR EXAMPLE WHEN WE 4568 03:13:59,000 --> 03:14:03,320 DEVELOP THE STANDARD ALONG THAT 4569 03:14:03,320 --> 03:14:07,680 WE DEVELOPED BIDS APPS WHICH ARE 4570 03:14:07,680 --> 03:14:10,160 TOOLS THEY CAN APPLY TO THE DATA 4571 03:14:10,160 --> 03:14:15,040 SET AND THEY WOULD PROVEVIOUSLY 4572 03:14:15,040 --> 03:14:18,120 REQUIRE YOU TO CHANGE THE 4573 03:14:18,120 --> 03:14:22,960 STRUCTURE OF THE DATA AND WE 4574 03:14:22,960 --> 03:14:25,120 MADE THEM AWARE OF THEM AND RUN 4575 03:14:25,120 --> 03:14:27,400 THEM WITHOUT THE NEED FOR 4576 03:14:27,400 --> 03:14:27,760 REFORMATTING. 4577 03:14:27,760 --> 03:14:32,040 THAT WAS A VALUE-ADD AND DOING 4578 03:14:32,040 --> 03:14:35,560 THE THINGS THAT ALSO HELPED 4579 03:14:35,560 --> 03:14:36,640 SHARE THE DATA. 4580 03:14:36,640 --> 03:14:38,520 WE SAW COMMUNITY BUY-IN IS 4581 03:14:38,520 --> 03:14:41,840 ESSENTIAL AND IN GENERAL 4582 03:14:41,840 --> 03:14:46,240 MANDATES BUT UNLESS YOU HAVE 4583 03:14:46,240 --> 03:14:46,960 OVERWHELMINGLY POWERFUL 4584 03:14:46,960 --> 03:14:48,960 ADVOCATES AS IN GENOMICS, 4585 03:14:48,960 --> 03:14:50,600 MANDATES ARE PROBABLY NOT THE 4586 03:14:50,600 --> 03:14:55,560 WAY TO GO ABOUT CHANGING 4587 03:14:55,560 --> 03:14:55,840 BEHAVIOR. 4588 03:14:55,840 --> 03:14:57,160 THE OPEN SCIENCE ADVOCATES ARE 4589 03:14:57,160 --> 03:14:58,640 NOT PEOPLE FROM THE OUTSIDE 4590 03:14:58,640 --> 03:15:00,440 COMING IN SAYING YOU NEED TO DO 4591 03:15:00,440 --> 03:15:01,080 OPEN SCIENCE. 4592 03:15:01,080 --> 03:15:04,840 IT'S BEEN MEMBERS OF THE 4593 03:15:04,840 --> 03:15:06,920 COMMUNITY LIKE ME AND IN SILICON 4594 03:15:06,920 --> 03:15:09,880 VALLEY WE HAVE A TERM CALLED DOG 4595 03:15:09,880 --> 03:15:12,120 FOODING WHICH MEANS USE YOUR OWN 4596 03:15:12,120 --> 03:15:12,640 PRODUCTS. 4597 03:15:12,640 --> 03:15:14,320 THOSE WHO HAVE BEEN THE 4598 03:15:14,320 --> 03:15:18,040 ADVOCATES ALSO EAT OUR OWN DOG 4599 03:15:18,040 --> 03:15:18,240 FOOD. 4600 03:15:18,240 --> 03:15:20,720 I THINK THAT'S ALLOWED US TO 4601 03:15:20,720 --> 03:15:22,520 MOTIVATE OTHERS TO MOVE IN THAT 4602 03:15:22,520 --> 03:15:22,920 DIRECTION. 4603 03:15:22,920 --> 03:15:25,920 AND FINALLY I THINK WE HAVE TO 4604 03:15:25,920 --> 03:15:28,040 AT LEAST PART OF THE SUCCESS OF 4605 03:15:28,040 --> 03:15:31,080 OUR PROJECT HAS BEEN BECAUSE WE 4606 03:15:31,080 --> 03:15:34,720 HAVE ADHERED STRICTLY TO THE 4607 03:15:34,720 --> 03:15:36,000 PAREDO PRINCIPLE. 4608 03:15:36,000 --> 03:15:37,720 NOT LETTING THE PERFECT BEING 4609 03:15:37,720 --> 03:15:41,600 THE ENEMY OF THE GOOD AND 4610 03:15:41,600 --> 03:15:42,760 REALIZING OFTEN A RELATIVELY 4611 03:15:42,760 --> 03:15:43,960 SMALL AMOUNT OF THE EFFORT WILL 4612 03:15:43,960 --> 03:15:47,600 COVER A RELATIVELY LARGE NUMBER 4613 03:15:47,600 --> 03:15:49,800 OF USE CASES AND THERE'S ALWAYS 4614 03:15:49,800 --> 03:15:51,680 GOING TO BE PEOPLE WHO FOCUS ON 4615 03:15:51,680 --> 03:15:52,920 HOW YOU CAN'T ADDRESS SOME 4616 03:15:52,920 --> 03:15:54,560 PARTICULAR EDGE CASE AND WE HAD 4617 03:15:54,560 --> 03:16:02,360 TO LEARN TO LISTEN TO THEM AND 4618 03:16:02,360 --> 03:16:03,160 THEN DECIDE IT'S IMPORTANT 4619 03:16:03,160 --> 03:16:08,200 ENOUGH TO WORRY ABOUT. 4620 03:16:08,200 --> 03:16:09,880 IT'S IMPORTANT TO NOT GET STUCK 4621 03:16:09,880 --> 03:16:10,680 ON COVERING EVERY POSSIBLE USE 4622 03:16:10,680 --> 03:16:10,880 CASE. 4623 03:16:10,880 --> 03:16:21,240 THANK YOU VERY MUCH. 4624 03:16:45,840 --> 03:16:47,040 >> THANK YOU FOR THE ORGANIZERS 4625 03:16:47,040 --> 03:16:48,440 FOR SETTING UP THE SESSION AND 4626 03:16:48,440 --> 03:16:49,800 INVITING ME TO SPEAK. 4627 03:16:49,800 --> 03:16:51,960 AS WE ALL KNOW THE THEME OF 4628 03:16:51,960 --> 03:16:58,360 TODAY'S SESSION IS CREATE PATH 4629 03:16:58,360 --> 03:17:00,280 AND WHEN WE SEE A NICE CLEAR 4630 03:17:00,280 --> 03:17:01,840 PATH IT PROBABLY DOESN'T START 4631 03:17:01,840 --> 03:17:05,280 THAT WAY AND WOULD LIKE TO SHARE 4632 03:17:05,280 --> 03:17:13,040 LESSONS LEARNED IN BUSHWACKING 4633 03:17:13,040 --> 03:17:20,400 THROUGH THE WILDERNESS I LOOK AT 4634 03:17:20,400 --> 03:17:22,440 PRACTICES AND WHAT HAS LED TO 4635 03:17:22,440 --> 03:17:24,600 JOURNAL POLICY CHANGE AND OVER 4636 03:17:24,600 --> 03:17:26,080 THE PAST FEW YEARS I'VE THOUGHT 4637 03:17:26,080 --> 03:17:30,800 ABOUT THE WAY WE EDUCATE AND 4638 03:17:30,800 --> 03:17:32,760 TRAIN YOUNG AS WELL AS OLDER 4639 03:17:32,760 --> 03:17:34,560 RESEARCHERS AND WE HAVE A LOT OF 4640 03:17:34,560 --> 03:17:36,680 EDUCATIONAL FORMATS FOCUSSED ON 4641 03:17:36,680 --> 03:17:38,480 STRAIGHT LECTURES AND SHARE WITH 4642 03:17:38,480 --> 03:17:39,440 STUDENTS ON HERE'S A BUNCH OF 4643 03:17:39,440 --> 03:17:40,200 STUFF YOU NEED TO DO AND GOOD 4644 03:17:40,200 --> 03:17:43,200 LUCK. 4645 03:17:43,200 --> 03:17:45,760 I WANTED TO RETHINK THE WAY WE 4646 03:17:45,760 --> 03:17:47,600 WERE OFFERING THIS FOR 4647 03:17:47,600 --> 03:17:48,480 REPRODUCIBLE RESEARCH PRACTICES 4648 03:17:48,480 --> 03:17:50,040 TO FOCUS ON THINGS THAT WERE 4649 03:17:50,040 --> 03:17:51,000 APPLIED THAT FOCUSSED ON GETTING 4650 03:17:51,000 --> 03:17:53,240 STUDENTS TO IMPLEMENT THIS IN 4651 03:17:53,240 --> 03:17:58,680 THEIR OWN RESEARCH RIGHT AWAY TO 4652 03:17:58,680 --> 03:18:05,600 REMOVE SOME BARRIERS PEOPLE 4653 03:18:05,600 --> 03:18:06,000 ENCOUNTERING. 4654 03:18:06,000 --> 03:18:09,160 I IT'S A COURSE IN METARESEARCH 4655 03:18:09,160 --> 03:18:11,000 WHERE PARTICIPANTS ARE FROM ALL 4656 03:18:11,000 --> 03:18:14,440 OVER THE WORLD OR FROM THE FOUR 4657 03:18:14,440 --> 03:18:16,120 UNIVERSITIES AND DIFFERENT FIELD 4658 03:18:16,120 --> 03:18:19,000 AND LEARN BY META AND WORK TO 4659 03:18:19,000 --> 03:18:29,520 DESIGN, CONDUCT AND HAVE A ME 4660 03:18:30,960 --> 03:18:32,520 METARESEARCH PROJECT AND WE HAVE 4661 03:18:32,520 --> 03:18:33,440 EIGHT SESSIONS IN ANOTHER COURSE 4662 03:18:33,440 --> 03:18:35,400 DURING THE FIRST HALF WE TALK 4663 03:18:35,400 --> 03:18:36,720 ABOUT A NEW PRACTICE AND IN THE 4664 03:18:36,720 --> 03:18:38,320 SECOND HALF STUDENTS WORK ON 4665 03:18:38,320 --> 03:18:39,120 IMPLEMENTING IN IN THEIR OWN 4666 03:18:39,120 --> 03:18:41,720 RESEARCH AND THE THIRD ONE IS 4667 03:18:41,720 --> 03:18:44,840 CALLED PUBLIC MY PROTOCOL WHERE 4668 03:18:44,840 --> 03:18:48,360 STUDENTS BRING A PROTOCOL AND 4669 03:18:48,360 --> 03:18:55,600 WORK ON PRO -- PROTOCOL AND 4670 03:18:55,600 --> 03:18:55,840 SUBMIT. 4671 03:18:55,840 --> 03:18:57,080 I'LL BE THINKING ABOUT TWO 4672 03:18:57,080 --> 03:18:58,600 QUESTIONS TODAY. 4673 03:18:58,600 --> 03:18:59,920 ONE, WHAT PRACTSES SHOULD WE 4674 03:18:59,920 --> 03:19:04,080 THINK ABOUT AND SECOND HOW CAN 4675 03:19:04,080 --> 03:19:05,600 WE BEST TEACH PEOPLE ABOUT THE 4676 03:19:05,600 --> 03:19:06,280 PRACTICES. 4677 03:19:06,280 --> 03:19:08,240 THE FIRST I WANT TO EMPHASIZE IS 4678 03:19:08,240 --> 03:19:15,400 I THINK IT WOULD BE HEL -- 4679 03:19:15,400 --> 03:19:21,360 HELPFUL TO INCENTIVIZE OPEN DATA 4680 03:19:21,360 --> 03:19:25,000 AND CODE ON PAR WITH 4681 03:19:25,000 --> 03:19:26,120 PUBLICATION. 4682 03:19:26,120 --> 03:19:28,240 THAT'S OCCURRENCE FOR ACADEMIC 4683 03:19:28,240 --> 03:19:28,480 CREDIT. 4684 03:19:28,480 --> 03:19:30,480 THEY'RE PRIMARILY FOCUSSED ON 4685 03:19:30,480 --> 03:19:33,080 RESULTS AND WHEN WE THINK BIT 4686 03:19:33,080 --> 03:19:34,960 RESULT OFTEN THE LEAST USEFUL 4687 03:19:34,960 --> 03:19:37,360 PART OF OUR WORK AND MAY BE THE 4688 03:19:37,360 --> 03:19:39,680 LEAST REPRODUCIBILITY PART OF 4689 03:19:39,680 --> 03:19:41,880 OUR OUTPUT AND THEY UNDER VALUE 4690 03:19:41,880 --> 03:19:43,880 THE METHODS DEVELOPMENT WORK OR 4691 03:19:43,880 --> 03:19:45,080 OFTEN CUTTING OUT INFORMATION 4692 03:19:45,080 --> 03:19:46,880 METHODS TO LEAVE MORE SPACE FOR 4693 03:19:46,880 --> 03:19:48,560 THE RESULTS AND THE DISCUSSION. 4694 03:19:48,560 --> 03:19:50,160 AND METHODS ARE ONE OF THE 4695 03:19:50,160 --> 03:19:52,960 THINGS WE DEVELOPED THAT IS MOST 4696 03:19:52,960 --> 03:19:54,920 VALUABLE TO OUR COLLEAGUES IN 4697 03:19:54,920 --> 03:19:56,840 THE SCIENTIFIC COMMUNITY. 4698 03:19:56,840 --> 03:19:58,680 SO UNTIL OPEN METHODS AND OPEN 4699 03:19:58,680 --> 03:20:00,640 DATA AND CODE ARE ON PAR WITH 4700 03:20:00,640 --> 03:20:01,920 PUBLICATIONS, RESEARCHERS WHO 4701 03:20:01,920 --> 03:20:03,280 CREATE AND SHARE THESE MATERIALS 4702 03:20:03,280 --> 03:20:05,320 ARE DOING MUCH MORE WORK FOR THE 4703 03:20:05,320 --> 03:20:06,360 SAME UNIT OF CREDIT. 4704 03:20:06,360 --> 03:20:08,840 AND WE HEAR THIS ALL THE TIME 4705 03:20:08,840 --> 03:20:10,240 FROM PARTICIPANTS IN OUR COURSES 4706 03:20:10,240 --> 03:20:14,360 WHO SOME BACK AND SAY I'D LIKE 4707 03:20:14,360 --> 03:20:20,960 TO IMPLEMENT THESE THINGS BUT MY 4708 03:20:20,960 --> 03:20:22,320 SUPERVISOR SAYS IT'S NOT WORK 4709 03:20:22,320 --> 03:20:27,760 INVESTING THE TIME IN. 4710 03:20:27,760 --> 03:20:33,080 THERE'S ADDITIONAL PRACTICES AND 4711 03:20:33,080 --> 03:20:34,880 THE FIRST IS USING RESEARCH 4712 03:20:34,880 --> 03:20:36,120 RESOURCE IDENTIFIERSO SPES TIE 4713 03:20:36,120 --> 03:20:42,680 WHAT RESOURCES WILL BE USED -- 4714 03:20:42,680 --> 03:20:45,080 SPECIFY WHAT RESOURCES WILL BE 4715 03:20:45,080 --> 03:20:50,440 USED AND THERE'S CLEAR EVIDENCE 4716 03:20:50,440 --> 03:20:54,520 THAT WHEN WE USE THESE 4717 03:20:54,520 --> 03:20:57,000 IDENTIFIERS WE GET RESOURCES 4718 03:20:57,000 --> 03:20:59,240 THAT CANNOT BE IDENTIFIED AND 4719 03:20:59,240 --> 03:21:01,000 RESOURCE IDENTIFIERS HAVE 4720 03:21:01,000 --> 03:21:06,800 WARNINGS ON CONTAMINATED OR 4721 03:21:06,800 --> 03:21:08,440 MISDIAGNOSED AND THE PROPORTION 4722 03:21:08,440 --> 03:21:10,440 OF PUBLICATIONS WITH THE CELL 4723 03:21:10,440 --> 03:21:12,000 LINE IS REDUCED. 4724 03:21:12,000 --> 03:21:13,960 THE NEXT IS OPEN METHODS. 4725 03:21:13,960 --> 03:21:16,240 THERE'S HUGE COMMUNITIES 4726 03:21:16,240 --> 03:21:17,240 SURROUNDING OPEN DATA AND OPEN 4727 03:21:17,240 --> 03:21:22,520 CODE BUT LITTLE FOR OPEN 4728 03:21:22,520 --> 03:21:22,760 METHODS. 4729 03:21:22,760 --> 03:21:30,320 IN PARTICULAR I THINK PROTOCOL 4730 03:21:30,320 --> 03:21:31,760 REPOSITORIES ARE IMPORTANT AND 4731 03:21:31,760 --> 03:21:35,400 WITH A PROTOCOL REPOSITORY 4732 03:21:35,400 --> 03:21:37,160 THRESHOLD FOR POSTING IS LOWER 4733 03:21:37,160 --> 03:21:38,760 AND YOU HAVE SOMETHING OTHER 4734 03:21:38,760 --> 03:21:40,240 PEOPLE CAN MAKE WORK AND IT 4735 03:21:40,240 --> 03:21:42,800 MAKES IT EASIER TO POST LIVING 4736 03:21:42,800 --> 03:21:44,040 PROTOCOLS AND TRACK THE 4737 03:21:44,040 --> 03:21:45,040 EVOLUTION ACROSS TIME AND 4738 03:21:45,040 --> 03:21:49,680 LABORATORIES. 4739 03:21:49,680 --> 03:21:53,000 DATA VISUALIZATION. 4740 03:21:53,000 --> 03:21:57,040 IT'S ESSENTIAL BECAUSE THE WAY 4741 03:21:57,040 --> 03:21:59,000 WE VISUALIZE DATA IS CENTRAL TO 4742 03:21:59,000 --> 03:22:01,200 OUR SCIENTIFIC KNOWLEDGE. 4743 03:22:01,200 --> 03:22:02,880 OFTEN THE FIGURES ARE WHERE WE 4744 03:22:02,880 --> 03:22:05,440 SHOW THE MOST IMPORTANT FINDINGS 4745 03:22:05,440 --> 03:22:06,960 AND IF WE DO A BAD JOB OF USING 4746 03:22:06,960 --> 03:22:15,760 THOSE FINDINGS AND USE DATA THAT 4747 03:22:15,760 --> 03:22:18,800 OBFUSCATE WE IMPAIR THE WAY TO 4748 03:22:18,800 --> 03:22:22,840 INTERPRET IT FOR THE FUTURE AND 4749 03:22:22,840 --> 03:22:24,760 OUR GROUP HAS DONE WORK ON THE 4750 03:22:24,760 --> 03:22:27,720 NEED TO REPLACE BAR GRAPHS WITH 4751 03:22:27,720 --> 03:22:29,000 CONTINUOUS DATA AND ANOTHER 4752 03:22:29,000 --> 03:22:30,920 OPPORTUNITY I MIGHT HIGHLIGHT IN 4753 03:22:30,920 --> 03:22:33,440 DATA VISUALIZATION IS THE NEED 4754 03:22:33,440 --> 03:22:36,040 TO USE FLOW CHARTS ACROSS STUDY 4755 03:22:36,040 --> 03:22:37,400 DESIGNS. 4756 03:22:37,400 --> 03:22:42,160 THEY'RE EFFECTIVE WAYS OF 4757 03:22:42,160 --> 03:22:44,080 REPORTING ATTRITION ESSENTIAL 4758 03:22:44,080 --> 03:22:46,120 AND THERE'S MANY WHO HAVE 4759 03:22:46,120 --> 03:22:48,240 EXPERTISE AND I THINK WE CAN 4760 03:22:48,240 --> 03:22:49,920 SPEND TIME ON IT BUT IT'S 4761 03:22:49,920 --> 03:22:51,440 ESSENTIAL TO REMEMBER OUR 4762 03:22:51,440 --> 03:22:53,600 STUDENTS ARE NOT BLACK SLATES. 4763 03:22:53,600 --> 03:22:54,760 THEY HAVE EXPECTATIONS HOW THIS 4764 03:22:54,760 --> 03:22:59,320 IS BEING DONE AND WHAT THEY 4765 03:22:59,320 --> 03:23:01,720 EXPECT TO SEE WE NEED TO 4766 03:23:01,720 --> 03:23:05,280 IDENTIFY RISK CON SENSE AND 4767 03:23:05,280 --> 03:23:06,640 PROBLEMATIC PRACTICES AND FIX 4768 03:23:06,640 --> 03:23:07,080 THESE THINGS. 4769 03:23:07,080 --> 03:23:08,760 TALK ABOUT WHEN STATISTICS ARE 4770 03:23:08,760 --> 03:23:10,000 NEEDED AND NOT AND THE 4771 03:23:10,000 --> 03:23:12,560 IMPORTANCE OF ESTABLISHING CRICK 4772 03:23:12,560 --> 03:23:14,800 COLUMN COLLABORATIVELY WITH 4773 03:23:14,800 --> 03:23:18,120 SCIENTISTS AS WELL STATISTICIAN 4774 03:23:18,120 --> 03:23:20,400 TO ENSURE IT MEETS THE NEEDS OF 4775 03:23:20,400 --> 03:23:22,800 STUDENTS AND WE PUBLISHED A 4776 03:23:22,800 --> 03:23:24,520 PAPER IN 2016 WHICH SHOWS ALMOST 4777 03:23:24,520 --> 03:23:28,040 ALL PHYSIOLOGY PAPERS HAVE 4778 03:23:28,040 --> 03:23:29,440 STATISTICS HOWEVER, STATISTICS 4779 03:23:29,440 --> 03:23:30,520 EDUCATION WAS NOT ALWAYS 4780 03:23:30,520 --> 03:23:32,640 REQUIRED TO GET A Ph.D. IN 4781 03:23:32,640 --> 03:23:37,120 PHYSIOLOGY AND RELATED FIELD 4782 03:23:37,120 --> 03:23:39,600 AMONG TOP-FUNDED PHYSIOLOGY 4783 03:23:39,600 --> 03:23:40,160 DEPARTMENTS. 4784 03:23:40,160 --> 03:23:42,120 WHAT HAVE WE LEARNED FROM OUR 4785 03:23:42,120 --> 03:23:43,320 EDUCATIONAL EXPERIENCES WITH THE 4786 03:23:43,320 --> 03:23:45,040 APPLIED COURSES WE'RE RUNNING? 4787 03:23:45,040 --> 03:23:47,920 THE FIRST THING WE'RE FOCUSSED 4788 03:23:47,920 --> 03:23:51,680 ON IS REPLACING STRAIGHT 4789 03:23:51,680 --> 03:23:52,960 LECTURES WITH APPLIED TRAINING 4790 03:23:52,960 --> 03:23:54,800 WE WANT PARTICIPANTS TO 4791 03:23:54,800 --> 03:23:56,080 IMPLEMENT PRACTICES IN THEIR OWN 4792 03:23:56,080 --> 03:23:57,920 RESEARCH AND INSTEAD OF SAYING I 4793 03:23:57,920 --> 03:24:01,320 HAVE TAKEN A COURSE OR DOES 4794 03:24:01,320 --> 03:24:04,640 ASSIGNMENTS OR PASSED A TEST WE 4795 03:24:04,640 --> 03:24:06,280 WANT TO SHOW WE HAVE IMPLEMENTED 4796 03:24:06,280 --> 03:24:06,720 THE PRACTICES. 4797 03:24:06,720 --> 03:24:09,840 HERE'S WHAT I DID TO IMPLEMENT 4798 03:24:09,840 --> 03:24:12,680 THE USEFUL RESEARCH IN MY OWN 4799 03:24:12,680 --> 03:24:15,360 RESEARCH IN MY LAST PAPER. 4800 03:24:15,360 --> 03:24:18,120 THE OTHER THING WE MAKE USE IS 4801 03:24:18,120 --> 03:24:18,520 GROUP MENTORING. 4802 03:24:18,520 --> 03:24:20,120 WHEN WE HAVE STUDENTS 4803 03:24:20,120 --> 03:24:21,080 IMPLEMENTING THINGS AND THEY'RE 4804 03:24:21,080 --> 03:24:22,440 DO THAT IN THE COURSE THEY START 4805 03:24:22,440 --> 03:24:24,400 TALKING TO EACH OTHER AND SAYING 4806 03:24:24,400 --> 03:24:26,040 I'M HAVING THIS PROBLEM AND 4807 03:24:26,040 --> 03:24:28,400 SOMEONE ELSE SAYS I HAD THAT 4808 03:24:28,400 --> 03:24:30,800 PROBLEM TOO, HERE'S HOW I SOLVED 4809 03:24:30,800 --> 03:24:31,840 IT. 4810 03:24:31,840 --> 03:24:34,520 WE'RE HERE TO HELP THEM GET OVER 4811 03:24:34,520 --> 03:24:35,520 EARLY ROAD BLOCKS THEY ENCOU 4812 03:24:35,520 --> 03:24:37,320 ENCOUNTERED AND THAT REDUCES THE 4813 03:24:37,320 --> 03:24:38,840 BURDEN THEY HAVE WHEN THEY GO 4814 03:24:38,840 --> 03:24:41,080 BACK TO THEIR OWN LAB AND HAVE 4815 03:24:41,080 --> 03:24:42,160 NO ONE AVAILABLE TO SUPPORT TO 4816 03:24:42,160 --> 03:24:42,760 FIGURE OUT HOW TO DO THIS ON 4817 03:24:42,760 --> 03:24:47,720 THEIR OWN. 4818 03:24:47,720 --> 03:24:49,120 TARGETING MISCONCEPTIONS. 4819 03:24:49,120 --> 03:24:50,080 TRAINING RESEARCH GROUPS INSTEAD 4820 03:24:50,080 --> 03:24:51,920 OF INDIVIDUALS. 4821 03:24:51,920 --> 03:24:55,320 COURSES ARE OFTEN DELIVERED TO 4822 03:24:55,320 --> 03:24:57,640 WHOEVER SIGNS UP WHEREAS WE KNOW 4823 03:24:57,640 --> 03:24:59,240 THE RESEARCH ENVIRONMENT IS 4824 03:24:59,240 --> 03:25:00,200 IMPORTANT FOR DETERMINING WHAT 4825 03:25:00,200 --> 03:25:02,800 CAN BE IMPLEMENTED. 4826 03:25:02,800 --> 03:25:05,640 WITH WE'RE ABLE TO GET MORE TO 4827 03:25:05,640 --> 03:25:06,800 TRAIN TOGETHER OR TRAIN THROUGH 4828 03:25:06,800 --> 03:25:08,440 AN ENTIRE RESEARCH GROUP WE CAN 4829 03:25:08,440 --> 03:25:10,440 GET EVERYONE TALKING ABOUT THE 4830 03:25:10,440 --> 03:25:13,040 ISSUES AND DEVELOPING AND 4831 03:25:13,040 --> 03:25:14,160 IMPLEMENTATION STRATEGY FOR AN 4832 03:25:14,160 --> 03:25:15,000 ENTIRE RESEARCH GROUP AT THE 4833 03:25:15,000 --> 03:25:16,880 SAME TIME WHICH IS MUCH FASTER 4834 03:25:16,880 --> 03:25:19,560 AND ALSO REALLY REDUCES THE 4835 03:25:19,560 --> 03:25:21,080 BURDEN ON OUR EARLY CAREER 4836 03:25:21,080 --> 03:25:23,000 RESEARCHERS WHO ARE TYPICALLY 4837 03:25:23,000 --> 03:25:24,120 TAKING THE COURSE BECAUSE 4838 03:25:24,120 --> 03:25:26,080 THERE'S AN INSTRUCTOR WITH 4839 03:25:26,080 --> 03:25:28,160 EXPERIENCE AND ABLE TO HANDLE 4840 03:25:28,160 --> 03:25:31,480 THE QUESTIONS THEY MIGHT GET OR 4841 03:25:31,480 --> 03:25:32,920 WHO MAY HAVE MORE CREDIBILITY 4842 03:25:32,920 --> 03:25:34,800 THAN THEY AS AN EARLY CAREER 4843 03:25:34,800 --> 03:25:36,640 RESEARCHER MAY BE AROUND MORE 4844 03:25:36,640 --> 03:25:38,560 SENIOR MEMBERS OF THEIR LAB 4845 03:25:38,560 --> 03:25:40,000 GROUP. 4846 03:25:40,000 --> 03:25:41,760 IMPLEMENT SYSTEM TO CHANGE 4847 03:25:41,760 --> 03:25:42,960 PRACTICES ACROSS CAREER STAGES. 4848 03:25:42,960 --> 03:25:46,560 THIS IS CRITICAL. 4849 03:25:46,560 --> 03:25:49,280 EVERY SESSION WE RUN WE THEY SAY 4850 03:25:49,280 --> 03:25:51,560 THIS SOUNDS AMAZING BUT I'LL 4851 03:25:51,560 --> 03:25:53,360 NEVER CONVINCE MY SUPERVISOR, 4852 03:25:53,360 --> 03:25:54,760 HOW CAN I CONVINCE THEM? 4853 03:25:54,760 --> 03:26:01,200 WE NEED TO THINK OF SHIFTING 4854 03:26:01,200 --> 03:26:01,880 ENTIRE INCENTIVE SYSTEMS SO 4855 03:26:01,880 --> 03:26:03,840 WE'RE ALSO TALKING TO THE MORE 4856 03:26:03,840 --> 03:26:06,360 SENIOR RESEARCHERS TO GIVE THEM 4857 03:26:06,360 --> 03:26:06,640 INCENTIVES. 4858 03:26:06,640 --> 03:26:08,800 I ALSO THINK IT'S IMPORTANT TO 4859 03:26:08,800 --> 03:26:12,440 TAKE ADVANTAGE OF UNDER UTILIZED 4860 03:26:12,440 --> 03:26:12,800 OPPORTUNITIES. 4861 03:26:12,800 --> 03:26:16,040 WE RECENTLY HELD A VIRTUAL BRAIN 4862 03:26:16,040 --> 03:26:18,840 STORMING EVENT WITH RESEARCHERS 4863 03:26:18,840 --> 03:26:21,760 AROUND GERMANY LOOKING AT MAKING 4864 03:26:21,760 --> 03:26:22,440 REPRODUCIBILITY TRAINING THE 4865 03:26:22,440 --> 03:26:23,440 NORM AND PEOPLE WERE DOING 4866 03:26:23,440 --> 03:26:25,280 DIFFERENT THINGS. 4867 03:26:25,280 --> 03:26:28,640 I WANT TO HIGHLIGHT SOME THAT 4868 03:26:28,640 --> 03:26:33,040 HAVE POTENTIAL TO BE USED MORE. 4869 03:26:33,040 --> 03:26:34,720 ONE IS REQUIRING OPEN SCIENCE 4870 03:26:34,720 --> 03:26:37,160 PRACTICES AND WE HAD SOME 4871 03:26:37,160 --> 03:26:38,800 DEPARTMENTS ABLE TO PUT THEM 4872 03:26:38,800 --> 03:26:40,040 INTO SYSTEM REQUIREMENTS AND 4873 03:26:40,040 --> 03:26:41,800 THEY FOUND WHEN THEY DID THAT, 4874 03:26:41,800 --> 03:26:43,040 STUDENTS WOULD GO TO THE 4875 03:26:43,040 --> 03:26:43,760 SUPERVISOR SAYING I'M 4876 03:26:43,760 --> 03:26:45,760 RESPONSIBLE FOR DOING THIS IN MY 4877 03:26:45,760 --> 03:26:46,000 THESIS. 4878 03:26:46,000 --> 03:26:48,920 HOW DO WE DO IT AND THEN THE 4879 03:26:48,920 --> 03:26:51,920 SUPERVISORS HAD ANSWERS. 4880 03:26:51,920 --> 03:26:54,040 IT HELPED GET BEYOND THE EARLY 4881 03:26:54,040 --> 03:26:55,280 CAREER AUDIENCE AND ADDRESS 4882 03:26:55,280 --> 03:26:56,280 ISSUES WITH THE MORE SENIOR 4883 03:26:56,280 --> 03:26:56,480 PEOPLE. 4884 03:26:56,480 --> 03:27:02,000 THE SECOND IS TO INTEGRATEUC 4885 03:27:02,000 --> 03:27:04,880 REPROD RESEARCH PRACTICES 4886 03:27:04,880 --> 03:27:07,560 AND HAVING QUESTIONS ON HOW TO 4887 03:27:07,560 --> 03:27:08,160 MAKE PROTOCOL REPRODUCIBILITY 4888 03:27:08,160 --> 03:27:17,560 AND IMPLEMENTING THAT. 4889 03:27:17,560 --> 03:27:20,960 AND THEY HAVE EXPECTATIONS AND 4890 03:27:20,960 --> 03:27:22,680 SKILLS BEFORE THEY ENTER 4891 03:27:22,680 --> 03:27:24,640 GRADUATE SCHOOL AND START THEIR 4892 03:27:24,640 --> 03:27:27,360 OWN RESEARCH AND LASTLY THERE 4893 03:27:27,360 --> 03:27:29,880 WAS A SMALL GROUP WHERE 4894 03:27:29,880 --> 03:27:32,120 PARTICIPANTS WORKED TOGETHER TO 4895 03:27:32,120 --> 03:27:35,120 PERFORM METARESEARCH STUDIES OR 4896 03:27:35,120 --> 03:27:38,720 REPLICATION STUDIES. 4897 03:27:38,720 --> 03:27:40,560 NOT ONLY DO STUDENTS LEARN TO DO 4898 03:27:40,560 --> 03:27:44,800 THE RESEARCH DISCUSSED BUT YOU 4899 03:27:44,800 --> 03:27:46,800 CAN OPEN RESEARCH WHILE 4900 03:27:46,800 --> 03:27:49,040 CONDUCTING THAT WITH STUDENTS 4901 03:27:49,040 --> 03:27:51,200 AND THE OUTPUT OF THE COURSE IS 4902 03:27:51,200 --> 03:27:53,960 NOT AN EXAMPLE OR TEST RESULT OR 4903 03:27:53,960 --> 03:27:55,080 GRADE BUT VALUE TO THE 4904 03:27:55,080 --> 03:27:58,000 SCIENTIFIC COMMUNITY. 4905 03:27:58,000 --> 03:27:58,840 NATION ALL I HAVE FOR TODAY AND 4906 03:27:58,840 --> 03:28:09,160 THANK YOU VERY MUCH. 4907 03:28:20,560 --> 03:28:23,400 THANK YOU FOR ALL THE WONDERFUL 4908 03:28:23,400 --> 03:28:24,440 TALKS. 4909 03:28:24,440 --> 03:28:26,080 WE HAVE A LITTLE BIT OF TIME FOR 4910 03:28:26,080 --> 03:28:30,800 DISCUSSION AND HAVE THE WORLD 4911 03:28:30,800 --> 03:28:36,040 CAFE AFTER? 4912 03:28:36,040 --> 03:28:37,720 FIRST OF ALL, I'M GOING TO TALK 4913 03:28:37,720 --> 03:28:40,320 ABOUT AND RECAP WHAT WE HEARD 4914 03:28:40,320 --> 03:28:45,560 AND IF YOU HAVE QUESTIONSES -- 4915 03:28:45,560 --> 03:28:48,600 QUESTIONS YOU CAN COME TO THE 4916 03:28:48,600 --> 03:28:50,360 MICROPHONE AND AS AN INSTINCTIVE 4917 03:28:50,360 --> 03:28:51,840 TEACHER I HAVE A WAY OF FIGURING 4918 03:28:51,840 --> 03:28:53,560 OUT WHO IS AWAKE AND ASLEEP AND 4919 03:28:53,560 --> 03:28:55,080 MOST ARE AWAKE SO WE DID GOOD 4920 03:28:55,080 --> 03:28:56,440 BUT I WANTED TO RECAP SOME 4921 03:28:56,440 --> 03:28:58,760 THINGS I WAS HEARING BECAUSE WE 4922 03:28:58,760 --> 03:29:00,520 WENT FROM THE PHILOSOPHICAL 4923 03:29:00,520 --> 03:29:03,480 UNDER PINNINGS OF WHAT A GOOD 4924 03:29:03,480 --> 03:29:05,000 EDUCATION OR BASIS FOR EDUCATION 4925 03:29:05,000 --> 03:29:08,000 IN RESEARCH RIGOR COULD LOOK 4926 03:29:08,000 --> 03:29:10,680 LIKE IN OUR FIRST TALK WITH 4927 03:29:10,680 --> 03:29:13,120 GUNDULA AND THEN HEARD ABOUT 4928 03:29:13,120 --> 03:29:15,200 COMMUNITY AND VALUE AS KEY 4929 03:29:15,200 --> 03:29:17,040 ELEMENTS HOW IF YOU'RE GOING TO 4930 03:29:17,040 --> 03:29:17,800 CREATE CULTURE CHANGE PEOPLE 4931 03:29:17,800 --> 03:29:23,560 NEED TO BE ALIGNED WITH VALUES 4932 03:29:23,560 --> 03:29:27,440 AND IN FACT IT'S A FANTASTIC 4933 03:29:27,440 --> 03:29:29,320 ORGANIZATION FOR SUSTAINABILITY. 4934 03:29:29,320 --> 03:29:32,720 IT'S AN ORGANIZATION WHICH HAS 4935 03:29:32,720 --> 03:29:33,320 AFFECTED THOUSAND OF PEOPLE 4936 03:29:33,320 --> 03:29:38,640 THROUGH TREMENDOUS EFFORT. 4937 03:29:38,640 --> 03:29:41,880 THEN WE HEARD OF INFRASTRUCTURE 4938 03:29:41,880 --> 03:29:44,320 AS SOMETHING THAT ENABLED IT TO 4939 03:29:44,320 --> 03:29:47,840 TAKE PLACE AND THE LAST TALK 4940 03:29:47,840 --> 03:29:51,520 WITH TRACY TAKES US CLOSE TO 4941 03:29:51,520 --> 03:29:55,520 WHERE WE'LL BE 40 MINUTES FROM 4942 03:29:55,520 --> 03:30:00,320 NOW WITH DIFFERENT IDEAS AND 4943 03:30:00,320 --> 03:30:02,680 RESULTS WE CAN ACCOMPLISH AND 4944 03:30:02,680 --> 03:30:08,680 HOW INCENTIVES ARE LINKED TO 4945 03:30:08,680 --> 03:30:14,880 BEHAVIOR CHANGE. 4946 03:30:14,880 --> 03:30:17,360 YOU NEED TO MAKE THINGS POSSIBLE 4947 03:30:17,360 --> 03:30:19,880 FIRST BEFORE PEOPLE DO THEM AND 4948 03:30:19,880 --> 03:30:25,600 THEN YOU NEED TO INCENTIVIZE 4949 03:30:25,600 --> 03:30:27,120 THEM AND NEED DIFFERENT LAYERS. 4950 03:30:27,120 --> 03:30:28,320 THAT'S OUR TASK. 4951 03:30:28,320 --> 03:30:33,240 WE'RE IN DISCUSSION AND WE WANT 4952 03:30:33,240 --> 03:30:34,360 TO HEAR QUESTION AND COMMENTS 4953 03:30:34,360 --> 03:30:36,640 FROM THE AUDIENCE AND THE WHOLE 4954 03:30:36,640 --> 03:30:39,040 PURPOSE AND WE'LL NO LONGER BE 4955 03:30:39,040 --> 03:30:40,880 PEOPLE SITTING IN SEATS. 4956 03:30:40,880 --> 03:30:42,160 WE'LL BE PEOPLE SITTING IN SEATS 4957 03:30:42,160 --> 03:30:43,040 IN DIFFERENT ROOMS THAT ARE 4958 03:30:43,040 --> 03:30:44,280 SMALLER BUT WILL FORCE YOU TO 4959 03:30:44,280 --> 03:30:48,640 TALK AND TO ENGAGE. 4960 03:30:48,640 --> 03:30:50,800 THE THAFK TASK FOR THE SESSION 4961 03:30:50,800 --> 03:30:52,120 IS WHAT ARE THE ACTUAL BEHAVIORS 4962 03:30:52,120 --> 03:30:54,840 WE NEED TO IMPLEMENT RIGOR AND 4963 03:30:54,840 --> 03:30:55,960 WHAT DO YOU THINK THEY LOOK 4964 03:30:55,960 --> 03:30:56,960 LIKE, THAT'S WHAT WE'RE TRYING 4965 03:30:56,960 --> 03:31:00,600 TO GET TO NOW. 4966 03:31:00,600 --> 03:31:04,400 WE'RE ANXIOUS FOR PEOPLE TO TELL 4967 03:31:04,400 --> 03:31:07,040 US ABOUT WHAT THEIR COMMENTS AND 4968 03:31:07,040 --> 03:31:08,880 IDEAS ARE AND START WITH TALKING 4969 03:31:08,880 --> 03:31:09,600 TO THE FOLKS HERE. 4970 03:31:09,600 --> 03:31:11,960 ONE OF THE QUESTIONS I WOULD 4971 03:31:11,960 --> 03:31:14,240 GIVE FIRST TO TRACY AND ASK 4972 03:31:14,240 --> 03:31:16,120 OTHERS TO THINK ABOUT YOU 4973 03:31:16,120 --> 03:31:16,760 MENTIONED SOMETHING WHICH I'M 4974 03:31:16,760 --> 03:31:19,280 INTERESTED IN WHICH IS THE IDEA 4975 03:31:19,280 --> 03:31:20,160 OF CAREER SPANNING. 4976 03:31:20,160 --> 03:31:21,480 WE'VE BEEN TALKING ABOUT AND ALL 4977 03:31:21,480 --> 03:31:23,640 THE TIMES WE TALK ABOUT THINGS, 4978 03:31:23,640 --> 03:31:24,920 IT'S THOSE PEOPLE NEED TO LEARN 4979 03:31:24,920 --> 03:31:28,920 THIS OR THOSE PEOPLE NEED TO 4980 03:31:28,920 --> 03:31:31,240 LEARN THAT BUT IT'S MANY LAYERS 4981 03:31:31,240 --> 03:31:32,760 OF PEOPLE. 4982 03:31:32,760 --> 03:31:35,840 TRACY, YOU MENTION IN YOUR TALK 4983 03:31:35,840 --> 03:31:37,760 THE SPECIFIC SCENARIO OF WELL, 4984 03:31:37,760 --> 03:31:39,600 THE GRADUATE STUDENTS OR THE 4985 03:31:39,600 --> 03:31:41,800 POST-DOCS WANT TO DO THIS BUT 4986 03:31:41,800 --> 03:31:45,800 THE OLD FUDDY-DUDDIES IF ANYONE 4987 03:31:45,800 --> 03:31:48,120 KNOWS THAT TERM, THE MORE SENIOR 4988 03:31:48,120 --> 03:31:51,080 PEOPLE MAY NOT BE AS RECEPTIVE 4989 03:31:51,080 --> 03:31:52,840 AND WE HEARD IN THE TALK WITH 4990 03:31:52,840 --> 03:31:54,520 RUSS, WHEN PEOPLE COME IN AND 4991 03:31:54,520 --> 03:31:57,240 SAY OPEN SCIENCE IS INVATING OUR 4992 03:31:57,240 --> 03:32:02,120 FIELD, IT SEEMS THEY'RE 4993 03:32:02,120 --> 03:32:06,200 MOTIVATION AT HIGHER LEVELS YOU 4994 03:32:06,200 --> 03:32:08,080 OR RUSS WHO MAY STILL BE ONLINE, 4995 03:32:08,080 --> 03:32:09,880 CAN ANY OF YOU SPEAK TO 4996 03:32:09,880 --> 03:32:11,560 TARGETING OUR EFFORTS NOT JUST 4997 03:32:11,560 --> 03:32:14,600 AT ONE LAYER OF THE COMMUNITY, 4998 03:32:14,600 --> 03:32:16,240 THE GRADUATE STUDENTS WHO ARE 4999 03:32:16,240 --> 03:32:19,000 ALWAYS THE HOPE FOR THE FUTURE 5000 03:32:19,000 --> 03:32:21,600 BUT HOW DO WE CREATE 5001 03:32:21,600 --> 03:32:22,680 OPPORTUNITIES FOR LEARNING FOR 5002 03:32:22,680 --> 03:32:24,880 DIFFERENT LAYERS OF COMMUNITY 5003 03:32:24,880 --> 03:32:26,520 BOTH IN THEIR SENIORITY AND THE 5004 03:32:26,520 --> 03:32:28,080 DIFFERENT POWER OR POSITIONS 5005 03:32:28,080 --> 03:32:29,680 THAT PEOPLE PLAY? 5006 03:32:29,680 --> 03:32:31,480 I SEE A HAND FROM RUSS NOW AND 5007 03:32:31,480 --> 03:32:41,880 THEN I'LL GO KARI NEXT. 5008 03:32:51,720 --> 03:32:52,360 MAYBE WE CAN PROJECT SO OTHERS 5009 03:32:52,360 --> 03:32:56,000 CAN HEAR. 5010 03:32:56,000 --> 03:32:59,960 >> SO ONE THING I'VE SEEN AS 5011 03:32:59,960 --> 03:33:02,120 INTERESTING IS THAT EXACTLY AS 5012 03:33:02,120 --> 03:33:03,720 WAS MENTIONED THE STUDENTS WANT 5013 03:33:03,720 --> 03:33:05,080 TO DO THIS STUFF AND THEIR P.I. 5014 03:33:05,080 --> 03:33:07,520 SAYS NO YOU CAN'T OR NO, IT'S 5015 03:33:07,520 --> 03:33:17,280 NOT WORTH IT. 5016 03:33:17,280 --> 03:33:20,160 AND I'VE SEEN THE BEHAVIOR WHERE 5017 03:33:20,160 --> 03:33:21,000 GRAD STUDENTS WON'T SHUT UP 5018 03:33:21,000 --> 03:33:22,400 ABOUT IT AND SAY WE HAVE TO KEEP 5019 03:33:22,400 --> 03:33:23,320 DOING THIS. 5020 03:33:23,320 --> 03:33:28,240 THE PRESSURE FROM THE BOTTOM IS 5021 03:33:28,240 --> 03:33:29,320 PROBABLY SOME OF THE MOST EFFECT 5022 03:33:29,320 --> 03:33:31,720 OFFICER PRESSURE ONE CAN SEE AND 5023 03:33:31,720 --> 03:33:34,720 FROM THE OTHER SIDE AND PRESSURE 5024 03:33:34,720 --> 03:33:38,680 FROM THE PROFESSIONAL SOCIETIES 5025 03:33:38,680 --> 03:33:42,000 FROM ONE'S COLLEAGUES IN THE 5026 03:33:42,000 --> 03:33:44,920 FIELD ARE THE TWO VECTORS THAT 5027 03:33:44,920 --> 03:33:46,200 CAN HELP CAUSE BEHAVIOR CHANGE 5028 03:33:46,200 --> 03:33:54,640 IN MORE SENIOR PEOPLE. 5029 03:33:54,640 --> 03:33:59,400 >> WE'VE LOOKED AT LIBRARIES AS 5030 03:33:59,400 --> 03:34:03,200 SORT OF THE CENTRAL PLACE FOR 5031 03:34:03,200 --> 03:34:04,160 THIS INFORMATION AND WE 5032 03:34:04,160 --> 03:34:06,040 CHALLENGE INSTITUTIONS TO PUT 5033 03:34:06,040 --> 03:34:07,520 THEIR RESOURCES INTO THE 5034 03:34:07,520 --> 03:34:07,800 LIBRARIES. 5035 03:34:07,800 --> 03:34:09,480 WE HAVE A LOT OF MEMBER 5036 03:34:09,480 --> 03:34:13,280 ORGANIZATIONS AT THE CARPENTRIES 5037 03:34:13,280 --> 03:34:16,640 THAT ARE INSTITUTIONAL MEMBERS 5038 03:34:16,640 --> 03:34:17,800 THROUGH THE UNIVERSITY LIBRARY 5039 03:34:17,800 --> 03:34:22,800 THE NATIONAL LIBRARY OF MEDICINE 5040 03:34:22,800 --> 03:34:28,520 SO WE KNOW ALL RESEARCHERS HAVE 5041 03:34:28,520 --> 03:34:29,760 TO INTERACT WITH THE LIBRARY AT 5042 03:34:29,760 --> 03:34:31,200 SOME POINT AND I HAVE TO 5043 03:34:31,200 --> 03:34:35,760 ADVOCATE FOR THE SKILLS AND 5044 03:34:35,760 --> 03:34:36,600 PERSPECTIVES THROUGH THE LIBRARY 5045 03:34:36,600 --> 03:34:47,120 STAFF INFORMATION SCIENCE STAFF. 5046 03:34:49,080 --> 03:34:52,520 >> THE STUDENTS VOTED WITH THEIR 5047 03:34:52,520 --> 03:34:57,560 FEET AND THE OTHER THING IS THAT 5048 03:34:57,560 --> 03:34:59,560 THE COMMUNITY WE BUILD UP AND 5049 03:34:59,560 --> 03:35:05,360 PEOPLE HEARD ABOUT EFFORTS ASKED 5050 03:35:05,360 --> 03:35:08,160 US HOW DO YOU TEACH THIS? 5051 03:35:08,160 --> 03:35:13,720 HOW DO YOU IMPLEMENT THIS. 5052 03:35:13,720 --> 03:35:18,600 WE HAVE AN EDUCATION CREDIT FOR 5053 03:35:18,600 --> 03:35:20,360 PRACTITIONERS WHICH IS THE FIRST 5054 03:35:20,360 --> 03:35:25,200 INSTITUTE I THINK IN JANUARY AND 5055 03:35:25,200 --> 03:35:28,520 WE HAVE STUDENTS BUT THE MENTORS 5056 03:35:28,520 --> 03:35:30,080 HAVE TO BE EDUCATED AND THE 5057 03:35:30,080 --> 03:35:30,760 MENTORS CAME TO US AND ASKED FOR 5058 03:35:30,760 --> 03:35:36,920 THAT. 5059 03:35:36,920 --> 03:35:38,680 >> IT'S NOT ONLY THE PRESSURE, 5060 03:35:38,680 --> 03:35:40,840 WHICH IS PART OF THE MOTIVATION, 5061 03:35:40,840 --> 03:35:42,600 BUT IT COULD ALSO BE THE 5062 03:35:42,600 --> 03:35:42,960 REASSURANCE. 5063 03:35:42,960 --> 03:35:44,440 WHEN I HEAR PEOPLE AFRAID OF A 5064 03:35:44,440 --> 03:35:46,040 NEW PRACTICE, WHAT THEY'RE 5065 03:35:46,040 --> 03:35:48,800 REALLY SAYING IS I'M AFRAID I 5066 03:35:48,800 --> 03:35:50,480 CANNOT EQUALLY COMPETE WITH 5067 03:35:50,480 --> 03:35:54,560 THOSE ABLE TO EXECUTE ON THIS 5068 03:35:54,560 --> 03:35:57,000 PRACTICE EFFECTIVELY AND I FEEL 5069 03:35:57,000 --> 03:36:01,120 LIKE I CAN'T DO THAT. 5070 03:36:01,120 --> 03:36:04,040 HOW DO WE SUIT TO A FULL-TIME 5071 03:36:04,040 --> 03:36:06,720 PROFESSOR WHO WILL NOT GIVE A 5072 03:36:06,720 --> 03:36:08,680 FIVE-DAY WORKSHOP ON SOMETHING 5073 03:36:08,680 --> 03:36:12,040 BUT MAYBE SINCE THEY'RE NOT 5074 03:36:12,040 --> 03:36:13,360 PRACTITIONERS THEMSELVES A 5075 03:36:13,360 --> 03:36:14,120 TWO-HOUR INFORMATIONAL WORKSHOP 5076 03:36:14,120 --> 03:36:15,120 MAY BE WHAT THEY NEED TO 5077 03:36:15,120 --> 03:36:18,760 UNDERSTAND THE BENEFITS AND MOVE 5078 03:36:18,760 --> 03:36:20,120 THEIR LAB ALONG. 5079 03:36:20,120 --> 03:36:26,680 LET'S GO TO EVERYONE IN THE 5080 03:36:26,680 --> 03:36:27,320 AUDIENCE. 5081 03:36:27,320 --> 03:36:27,920 REMEMBER YOUR NAME AND YOUR 5082 03:36:27,920 --> 03:36:31,120 INSTITUTION IF YOU WANT TO SAY 5083 03:36:31,120 --> 03:36:33,000 MORE ABOUT YOUR BACKGROUND 5084 03:36:33,000 --> 03:36:43,200 BEFORE GIVING COMMENTS. 5085 03:36:43,200 --> 03:36:46,040 I WAS QUITE STRUCK BY COMMENTS 5086 03:36:46,040 --> 03:36:50,680 FROM KARI AND RUSS THOUGH THIS 5087 03:36:50,680 --> 03:36:56,680 IS TALKING ABOUT PRACTICAL 5088 03:36:56,680 --> 03:37:04,520 BEHAVIOR AND CHANGE, BOTH KARI 5089 03:37:04,520 --> 03:37:06,200 AND RUSS WERE TALKING ABOUT 5090 03:37:06,200 --> 03:37:07,320 INSTITUTIONAL BEHAVIORS AND I 5091 03:37:07,320 --> 03:37:11,680 WAS STRUCK BY THE GROUP THAT MET 5092 03:37:11,680 --> 03:37:14,400 TO COME UP WITH A TYPE OF 5093 03:37:14,400 --> 03:37:15,040 LANGUAGE. 5094 03:37:15,040 --> 03:37:16,760 I THINK YOU DESCRIBED IT AS 5095 03:37:16,760 --> 03:37:20,160 NIFTY AND KARI, THE DECISIONS OF 5096 03:37:20,160 --> 03:37:25,760 THE VARIOUS CARPENTRIES TO DO 5097 03:37:25,760 --> 03:37:27,040 THINGS AND THE QUESTION IS CAN 5098 03:37:27,040 --> 03:37:28,480 YOU ALL DESCRIBE OTHER EXAMPLES 5099 03:37:28,480 --> 03:37:29,160 OF THIS? 5100 03:37:29,160 --> 03:37:34,720 AND THE REASON WHY I'M ASKING IS 5101 03:37:34,720 --> 03:37:38,600 THAT I SOMETIMES HEAR A TENSION 5102 03:37:38,600 --> 03:37:39,600 BETWEEN BEHAVIOR'S ALWAYS 5103 03:37:39,600 --> 03:37:41,960 REDUCED TO A SINGULAR UNIT OF AN 5104 03:37:41,960 --> 03:37:44,400 INDIVIDUAL BUT NOT ACTUALLY 5105 03:37:44,400 --> 03:37:47,080 THINKING ABOUT THE BEHAVIORS OF 5106 03:37:47,080 --> 03:37:47,400 INSTITUTIONS. 5107 03:37:47,400 --> 03:37:50,680 WE GOT CONCRETE EXAMPLES OF 5108 03:37:50,680 --> 03:37:53,960 CHOICE THAT COLLECTIVES MADE 5109 03:37:53,960 --> 03:37:55,760 EVEN IF THEY WEREN'T TECHNICALLY 5110 03:37:55,760 --> 03:37:57,040 AN INSTITUTION AND HEARING MORE 5111 03:37:57,040 --> 03:37:57,840 WOULD BE INTERESTING TO PUT THAT 5112 03:37:57,840 --> 03:38:08,080 INTO CONTEXT. 5113 03:38:08,440 --> 03:38:13,240 >> OUR DECISION MAKING ETHOS IS 5114 03:38:13,240 --> 03:38:13,640 COMMUNITY DRIVEN. 5115 03:38:13,640 --> 03:38:15,040 A LOT OF THE CORE VALUES 5116 03:38:15,040 --> 03:38:18,080 MENTIONED THERE WAS A COMMITTEE 5117 03:38:18,080 --> 03:38:19,480 OF NOT ONLY OUR BOARD OF 5118 03:38:19,480 --> 03:38:24,640 DIRECTORS BUT A GROUP OF 5119 03:38:24,640 --> 03:38:26,200 VOLUNTEERS WHO DID EIGHT OF 5120 03:38:26,200 --> 03:38:30,560 CROWD SOURCIE IING FOR THE SKIL 5121 03:38:30,560 --> 03:38:31,080 AND BEHAVIORS ACROSS OUR 5122 03:38:31,080 --> 03:38:36,600 COMMUNITY. 5123 03:38:36,600 --> 03:38:37,600 IT'S ONE OF THOSE PREACHING TO 5124 03:38:37,600 --> 03:38:40,200 THE CHOIR EXAMPLES AND WE HAVE 5125 03:38:40,200 --> 03:38:41,920 MANY WHO COME TO OUR COMMUNITY 5126 03:38:41,920 --> 03:38:43,760 INITIALLY TO LEARN SOMETHING AND 5127 03:38:43,760 --> 03:38:44,880 THEN REALIZE I FEEL GOOD ABOUT 5128 03:38:44,880 --> 03:38:46,560 MYSELF HERE. 5129 03:38:46,560 --> 03:38:49,040 I FEEL LIKE I CAN LEARN HOW TO 5130 03:38:49,040 --> 03:38:50,800 CODE AND WANT TO BE AROUND THESE 5131 03:38:50,800 --> 03:38:51,680 PEOPLE MORE. 5132 03:38:51,680 --> 03:38:56,480 THEY END UP RUNNING THE 5133 03:38:56,480 --> 03:38:58,400 COMMUNITY IT'S LARD FOR ME TO 5134 03:38:58,400 --> 03:39:01,240 GIVE -- THAT IS MY EXAMPLE. 5135 03:39:01,240 --> 03:39:03,520 WE'RE SUCH A COMMUNITY-DRIVEN 5136 03:39:03,520 --> 03:39:04,840 ORGANIZATION, WE TEND TO ATTRACT 5137 03:39:04,840 --> 03:39:07,520 PEOPLE WHO HAVE THESE SKILLS AND 5138 03:39:07,520 --> 03:39:09,520 PERSPECTIVES AND THEN THEY SAY 5139 03:39:09,520 --> 03:39:14,920 AND LITTLE BY LITTLE THEY PULL 5140 03:39:14,920 --> 03:39:17,120 MORE PEOPLE INTO THE COMMUNITY 5141 03:39:17,120 --> 03:39:25,760 AND ADOPT OUR ETHOS AS WELL. 5142 03:39:25,760 --> 03:39:27,120 >> I WANT TO SAY TWO THINGS. 5143 03:39:27,120 --> 03:39:32,680 I THINK THEY'RE RELATED BUT MAY 5144 03:39:32,680 --> 03:39:37,360 NOT BE ONE IS A QUESTION OF WHO 5145 03:39:37,360 --> 03:39:42,080 IS COMING TO THE BASE TRAININGS. 5146 03:39:42,080 --> 03:39:44,400 YOUR COMMENT MADE THE THINK IT'S 5147 03:39:44,400 --> 03:39:45,200 RELATED BECAUSE THERE'S GROUP 5148 03:39:45,200 --> 03:39:53,440 THINK GOING ON HERE. 5149 03:39:53,440 --> 03:39:58,200 THE DIFFERENCE IN SHOWING 5150 03:39:58,200 --> 03:40:01,040 EXAMPLES THERE'S RESISTANCE FROM 5151 03:40:01,040 --> 03:40:06,360 TRADITIONAL METRICS OF SUCCESS 5152 03:40:06,360 --> 03:40:10,680 AND HAS ANYONE LOOKED AT HOW 5153 03:40:10,680 --> 03:40:11,840 THIS PRACTICE DOES MANIFEST IN 5154 03:40:11,840 --> 03:40:14,440 THE MORE TRADITIONAL METRICS? 5155 03:40:14,440 --> 03:40:16,760 IF YOU THINK OF THE 5156 03:40:16,760 --> 03:40:17,680 INSTITUTIONS, PAPERS AREN'T 5157 03:40:17,680 --> 03:40:18,960 GOING AWAY ANY TIME SOON IN 5158 03:40:18,960 --> 03:40:25,480 TERMS OF THEM BEING THE CURRENCY 5159 03:40:25,480 --> 03:40:31,800 WE'RE JUDGING SCIENTISTS AND IS 5160 03:40:31,800 --> 03:40:38,680 THERE A WAY TO PENETRATE INTO 5161 03:40:38,680 --> 03:40:42,680 THE COMMUNITIES THAT HAVEN'T 5162 03:40:42,680 --> 03:40:50,880 ENTERED THE CONVERSATION YET. 5163 03:40:50,880 --> 03:40:55,400 >> WHO XOMS TO OUR WORKSHOP 5164 03:40:55,400 --> 03:40:57,840 PRIMARILY GRADUATE STUDENTS OR 5165 03:40:57,840 --> 03:40:58,640 THOSE WORKING IN NATIONAL LABS 5166 03:40:58,640 --> 03:41:01,160 OR INDIVIDUALS LIKE THAT. 5167 03:41:01,160 --> 03:41:02,320 PEOPLE WHO HAVE RESEARCH OR DATA 5168 03:41:02,320 --> 03:41:04,520 AND NO IDEA WHAT TO DO WITH IT 5169 03:41:04,520 --> 03:41:07,080 OR WANT TO LEARN SKILLS AND 5170 03:41:07,080 --> 03:41:11,720 REPRODUCIBILITY. 5171 03:41:11,720 --> 03:41:16,200 PRIMARILY, OUR ORGANIZATION IS 5172 03:41:16,200 --> 03:41:17,760 FUNDED BY OUR MEMBERSHIP 5173 03:41:17,760 --> 03:41:18,840 STRUCTURE AND OTHER UNIVERSITIES 5174 03:41:18,840 --> 03:41:23,280 AND INSTITUTIONS PAY A FEE AND 5175 03:41:23,280 --> 03:41:26,280 WE INTERN ORGANIZE WORKSHOPS FOR 5176 03:41:26,280 --> 03:41:26,520 THEM. 5177 03:41:26,520 --> 03:41:28,440 IF YOU'RE INSTITUTION HAS A 5178 03:41:28,440 --> 03:41:30,680 MEMBERSHIP YOU'D RECEIVE A 5179 03:41:30,680 --> 03:41:32,960 CERTAIN NUMBER OF SEATS IN OUR 5180 03:41:32,960 --> 03:41:34,960 INSTRUCTOR TRAINING PROGRAM. 5181 03:41:34,960 --> 03:41:38,680 WE GET A LOT OF IF YOUR 5182 03:41:38,680 --> 03:41:39,760 MEMBERSHIP IS THROUGH YOU'RE 5183 03:41:39,760 --> 03:41:43,600 LIBRARY IT'S A DIVERSE GROUP OR 5184 03:41:43,600 --> 03:41:45,040 MAY BE THROUGH ANOTHER LAB AND 5185 03:41:45,040 --> 03:41:46,600 THE MEMBERSHIP IS STRUCTURED 5186 03:41:46,600 --> 03:41:47,320 AROUND THAT LAB. 5187 03:41:47,320 --> 03:41:48,680 WE GET A VARIETY OF INDIVIDUALS 5188 03:41:48,680 --> 03:41:53,680 ATTENDING OUR WORK SHOPS. 5189 03:41:53,680 --> 03:41:56,000 I FORGOT THE SECOND PART. 5190 03:41:56,000 --> 03:42:00,960 >> WHAT I WANT TO DO, IF I CAN, 5191 03:42:00,960 --> 03:42:04,360 ONE QUESTION OR COMMENT OR ONE 5192 03:42:04,360 --> 03:42:06,120 RESPONSE TO STIMULATE MANY 5193 03:42:06,120 --> 03:42:08,840 THOUGHTS AND WE'LL FOLLOW-UP AT 5194 03:42:08,840 --> 03:42:09,200 THE WORLD CAFE. 5195 03:42:09,200 --> 03:42:14,080 LET'S MOVE AHEAD AND TRY TO FARM 5196 03:42:14,080 --> 03:42:15,800 IT OUT TO AS MANY AS WE CAN. 5197 03:42:15,800 --> 03:42:19,320 >> GOOD AFTERNOON. 5198 03:42:19,320 --> 03:42:22,040 I'M CARMEN PROFESSOR OF BIOLOGY 5199 03:42:22,040 --> 03:42:27,000 AT A UNIVERSITY IN PUERTO RICO. 5200 03:42:27,000 --> 03:42:34,640 THERE'S SOMETHING BOTHERING ME A 5201 03:42:34,640 --> 03:42:39,120 LITTLE BIT THIS MORNING IS 5202 03:42:39,120 --> 03:42:41,040 ISSUES OF REPRESENTATION IN THE 5203 03:42:41,040 --> 03:42:44,400 DATA WE'RE TRYING TO REACH TO 5204 03:42:44,400 --> 03:42:46,160 MAKE IT RIGOROUS AND 5205 03:42:46,160 --> 03:42:47,240 REPRODUCIBILITY AND TO PUT INTO 5206 03:42:47,240 --> 03:42:51,800 PERSPECTIVE THE CONTEXT OF HOW 5207 03:42:51,800 --> 03:42:57,280 SIGN HAS GROWN IN A VERY 5208 03:42:57,280 --> 03:43:01,880 PRIVILEGED SITUATION WHERE A LOT 5209 03:43:01,880 --> 03:43:03,320 OF COMMUNITIES HAVE NOT BEEN 5210 03:43:03,320 --> 03:43:07,280 ADDRESSED AT ALL. 5211 03:43:07,280 --> 03:43:11,720 FOR EXAMPLE, THE BEAUTIFUL 5212 03:43:11,720 --> 03:43:13,320 INITIATIVE AT HOPKINS. 5213 03:43:13,320 --> 03:43:14,720 ARE YOU BRINGING IN THE 5214 03:43:14,720 --> 03:43:18,720 COMPONENT OF HISTORY AND ISSUES 5215 03:43:18,720 --> 03:43:20,200 OF INEQUITY AND STRUCTURAL 5216 03:43:20,200 --> 03:43:23,960 RACISM THAT HAS PREVAILED IN 5217 03:43:23,960 --> 03:43:26,000 SCIENCE AT ALL NOT ONLY IN THE 5218 03:43:26,000 --> 03:43:30,680 UNITED STATES BUT THROUGHOUT THE 5219 03:43:30,680 --> 03:43:36,760 WESTERN WORLD AND THE 5220 03:43:36,760 --> 03:43:37,280 NEUROIMAGING DATA. 5221 03:43:37,280 --> 03:43:39,840 HOW CAN WE MAKE ANY CONCLUSIONS 5222 03:43:39,840 --> 03:43:42,720 WHEN IT'S BASED ON A CERTAIN 5223 03:43:42,720 --> 03:43:50,440 GROUP SO THAT WAS MY QUESTION. 5224 03:43:50,440 --> 03:43:52,720 >> I DID NOT HAVE TIME TO TALK 5225 03:43:52,720 --> 03:43:54,560 ABOUT A MAJOR INITIATIVE OF OURS 5226 03:43:54,560 --> 03:43:57,400 AND SOME MENTIONED SOCIAL JUS 5227 03:43:57,400 --> 03:43:59,000 IT'S AS A MAJOR COMPETENCY. 5228 03:43:59,000 --> 03:44:02,800 THIS IS MY ABSOLUTE FAVORITE 5229 03:44:02,800 --> 03:44:03,040 PROJECT. 5230 03:44:03,040 --> 03:44:06,720 WHAT WE DO APART FROM OTHER 5231 03:44:06,720 --> 03:44:09,920 INITIATIVES THAT TARGET OUR 5232 03:44:09,920 --> 03:44:14,120 COMMUNITY WE HAVE A COMMUNITY 5233 03:44:14,120 --> 03:44:15,920 THAT NEEDS A LOT OF SUPPORT. 5234 03:44:15,920 --> 03:44:17,360 BUT THAT PARTICULAR PROJECT WE 5235 03:44:17,360 --> 03:44:23,720 INCLUDE AS A MAJOR COMPETENCY IS 5236 03:44:23,720 --> 03:44:26,760 SOMETHING IF I HAD TIME TO SHOW 5237 03:44:26,760 --> 03:44:30,680 ONE ON THE CAUSATION PROJECT YOU 5238 03:44:30,680 --> 03:44:34,200 WOULD HAVE SEEN THEY SAID ALL 5239 03:44:34,200 --> 03:44:36,040 THE DIFFERENT PEOPLE IN 5240 03:44:36,040 --> 03:44:42,680 TEXTBOOKS ON GETTING CREDIT FOR 5241 03:44:42,680 --> 03:44:45,560 MAJOR DISCOVERIES TEND TO BE IN 5242 03:44:45,560 --> 03:44:46,920 THE MAJORITY ARE WHITE MEN. 5243 03:44:46,920 --> 03:44:49,320 A MAJOR PROJECT IS TO GIVE THOSE 5244 03:44:49,320 --> 03:44:53,960 JUSTICE WHO DID NOT FIND THE 5245 03:44:53,960 --> 03:44:55,040 RIGHTFUL PLACE AND STANCE ON 5246 03:44:55,040 --> 03:44:58,360 HISTORY SO IT'S A MAJOR PROJECT 5247 03:44:58,360 --> 03:45:02,440 WE RUN IN THE STABLE LEVEL AND A 5248 03:45:02,440 --> 03:45:06,200 PROJECT THAT WE DO THROUGH 5249 03:45:06,200 --> 03:45:09,040 INTERVIEWS IN PRODUCING 5250 03:45:09,040 --> 03:45:10,680 PRODUCIBLE, REUSABLE EARNING 5251 03:45:10,680 --> 03:45:16,320 OBJECTS TO MAKE PROJECTS LIKE 5252 03:45:16,320 --> 03:45:17,800 CHICK PEOPLE MADE WHICH 5253 03:45:17,800 --> 03:45:18,440 DISCOVERIES AND CREDIT WHERE 5254 03:45:18,440 --> 03:45:24,960 CREDIT IS DUE. 5255 03:45:24,960 --> 03:45:26,680 BRING THE PEOPLE IN THE WEBSITE 5256 03:45:26,680 --> 03:45:32,880 AND COLLECTIONS SO EVERYBODY CAN 5257 03:45:32,880 --> 03:45:34,000 LOOK AT A FORWARD LOOKING 5258 03:45:34,000 --> 03:45:38,200 PROJECT SO THE NEXT GENERATION 5259 03:45:38,200 --> 03:45:39,400 GETS EDUCATED WITH TRAINING AND 5260 03:45:39,400 --> 03:45:42,200 THOSE WHO DID THE WORK ALSO GET 5261 03:45:42,200 --> 03:45:42,440 CREDIT. 5262 03:45:42,440 --> 03:45:45,040 THAT'S ONE OF THE PROJECTS BUT 5263 03:45:45,040 --> 03:45:47,840 I'M HAPPY TO TALK MORE. 5264 03:45:47,840 --> 03:45:50,680 IT'S A MAJOR INITIATIVE OF OURS. 5265 03:45:50,680 --> 03:45:53,000 >> CLEARLY SOMETHING TO THINK 5266 03:45:53,000 --> 03:45:54,920 ABOUT THE DEFINITION OF RIGOR 5267 03:45:54,920 --> 03:46:00,760 AND HOW IT INTERACTS WITH 5268 03:46:00,760 --> 03:46:01,160 CONCERNS. 5269 03:46:01,160 --> 03:46:04,160 >> THIS IS A MORE PRAGMATIC 5270 03:46:04,160 --> 03:46:04,560 POINT. 5271 03:46:04,560 --> 03:46:09,800 I'M A RESEARCH SCIENTIST AND 5272 03:46:09,800 --> 03:46:11,040 ALSO A FUDDY-DUDDY. 5273 03:46:11,040 --> 03:46:13,760 I WANTED TO MENTION THE 5274 03:46:13,760 --> 03:46:14,640 UNIVERSITY OF CALIFORNIA SYSTEM 5275 03:46:14,640 --> 03:46:16,680 LIBRARIES HAD A SYSTEM-WIDE 5276 03:46:16,680 --> 03:46:21,880 PROJECT THEY CALLED LOVE DATA 5277 03:46:21,880 --> 03:46:23,480 WEEK AND ALL KINDS OF COURSES 5278 03:46:23,480 --> 03:46:26,680 AND THE PLACES TO DEPOSIT DATA 5279 03:46:26,680 --> 03:46:35,840 AND THE PROCESS TO DO IT AND IT 5280 03:46:35,840 --> 03:46:40,280 WAS DONE WHERE IT WAS MORE 5281 03:46:40,280 --> 03:46:41,400 ACCESSIBLE TO PROFESSORS AND 5282 03:46:41,400 --> 03:46:46,760 RAISED AWARENESS THAT'S WHERE WE 5283 03:46:46,760 --> 03:46:51,560 CAN GO FOR STEWARDSHIP AND HELP 5284 03:46:51,560 --> 03:46:53,360 BECAUSE I THINK WE WEREN'T AWARE 5285 03:46:53,360 --> 03:46:54,760 UNTIL THAT. 5286 03:46:54,760 --> 03:47:00,920 >> THANK YOU. 5287 03:47:00,920 --> 03:47:11,560 >> I'M AN ASSOCIATE DEAN AND WE 5288 03:47:11,560 --> 03:47:12,960 HAVE A PROGRAM IN TRAINING. 5289 03:47:12,960 --> 03:47:14,320 GREAT SESSION. 5290 03:47:14,320 --> 03:47:15,720 A LOT OF WHAT WAS SAID RESONATES 5291 03:47:15,720 --> 03:47:19,800 IN THINKING ABOUT THE PATH AND 5292 03:47:19,800 --> 03:47:22,040 TALK ABOUT TRAINING WHAT YOU 5293 03:47:22,040 --> 03:47:26,680 WERE SAYING ABOUT HAVING 5294 03:47:26,680 --> 03:47:28,440 APPLICABLE EXERCISES AND THINK 5295 03:47:28,440 --> 03:47:31,280 OF WHAT'S NEXT FOR TRAINEES AND 5296 03:47:31,280 --> 03:47:34,360 YOU TALK ABOUT GRAPHS AND SHOW 5297 03:47:34,360 --> 03:47:37,640 DATA BETTER IN A WAY THAT'S 5298 03:47:37,640 --> 03:47:39,960 RIGOROUS SCIENCE AND WHAT'S ALSO 5299 03:47:39,960 --> 03:47:43,320 IMPORTANT IS WHEN STUDENT 5300 03:47:43,320 --> 03:47:45,160 TRAINEES AND FACULTY ARE SHOWING 5301 03:47:45,160 --> 03:47:46,560 OUR FINDINGS AT CONFERENCE. 5302 03:47:46,560 --> 03:47:50,680 THERE'S A ROLE FOR OUR SOCIETY 5303 03:47:50,680 --> 03:47:53,120 AS WELL TO SET EXPECTATIONS OF 5304 03:47:53,120 --> 03:47:54,680 ELEMENTS OF RIGOR AND 5305 03:47:54,680 --> 03:47:55,920 REPRODUCIBILITY AND POVERTIER 5306 03:47:55,920 --> 03:47:56,440 PRESENTATIONS IN ORAL 5307 03:47:56,440 --> 03:47:58,160 PRESENTATIONS AND THAT CAN COME 5308 03:47:58,160 --> 03:48:01,840 WITH INCENTIVES AND NOT ONLY 5309 03:48:01,840 --> 03:48:03,560 ONLY HAVE EXPECTATIONS IN 5310 03:48:03,560 --> 03:48:04,640 SHOWING DATA AND WHO TO 5311 03:48:04,640 --> 03:48:05,480 EMPHASIZE TO SHOW WHERE THE DATA 5312 03:48:05,480 --> 03:48:09,280 IS BEING PRESENTED AND AVAILABLE 5313 03:48:09,280 --> 03:48:11,080 FOR OTHERS TO USE OR IF THEY'RE 5314 03:48:11,080 --> 03:48:13,000 USING OPEN DATA SOURCES TO SHOW 5315 03:48:13,000 --> 03:48:14,640 IN THAT IN THEIR PRESENTATIONS. 5316 03:48:14,640 --> 03:48:16,200 I'VE SEEN MORE AND MORE IN THE 5317 03:48:16,200 --> 03:48:18,320 LAST FEW YEARS OUR TALKS ARE 5318 03:48:18,320 --> 03:48:20,280 MOVING TO TED TALKS. 5319 03:48:20,280 --> 03:48:22,480 IT'S BECOME MORE SMOOTH AND 5320 03:48:22,480 --> 03:48:25,480 TELLING MORE SMOOTH STORIES, 5321 03:48:25,480 --> 03:48:26,680 GLANCING OVER ALL THE RIGOROUS 5322 03:48:26,680 --> 03:48:27,760 ELEMENTS OF OUR SCIENCE. 5323 03:48:27,760 --> 03:48:29,360 I THINK THAT'S A MISTAKE. 5324 03:48:29,360 --> 03:48:31,520 WE'RE SHOWING OUR TRAINEES YOU 5325 03:48:31,520 --> 03:48:34,320 CAN DO THIS IN THE LAB WHEN IT 5326 03:48:34,320 --> 03:48:35,920 COMES TO YOUR TALK AND I THINK 5327 03:48:35,920 --> 03:48:37,600 YOU NEED TO BRING BACK ELEMENTS 5328 03:48:37,600 --> 03:48:39,960 OF TRULY SHOWING NOT ONLY SAMPLE 5329 03:48:39,960 --> 03:48:44,080 SIZE AND HOW YOU DERIVE IT BUT 5330 03:48:44,080 --> 03:48:45,800 THE REPLICATION ELEMENT AND WHAT 5331 03:48:45,800 --> 03:48:50,480 ARE YOU REPRODUCING AND THE 5332 03:48:50,480 --> 03:48:53,720 RIGOR AND INCENTIVIZE THE 5333 03:48:53,720 --> 03:48:57,880 ELEMENT AND WONDERING TRACEY AND 5334 03:48:57,880 --> 03:48:59,240 GUNDULA IF ANY OF THIS HAS COME 5335 03:48:59,240 --> 03:49:08,000 UP IN YOUR RESEARCH. 5336 03:49:08,000 --> 03:49:09,640 >> CONFERENCES AREN'T A PLACE I 5337 03:49:09,640 --> 03:49:11,880 LOOKED AT BUT THE FIRST RESEARCH 5338 03:49:11,880 --> 03:49:18,680 STUDY ON BAR GRAPHS WAS ME 5339 03:49:18,680 --> 03:49:20,280 SITTING AT A CONFERENCE 5340 03:49:20,280 --> 03:49:21,160 FRUSTRATED WITH THE BAR GRAPHS 5341 03:49:21,160 --> 03:49:24,080 AND I STARTED DOWNLOADING PAPERS 5342 03:49:24,080 --> 03:49:25,240 AND CHECKING THEM ON THE WAY 5343 03:49:25,240 --> 03:49:27,400 HOME TO SEE HOW MANY HAD BAR 5344 03:49:27,400 --> 03:49:27,840 GRAPHS. 5345 03:49:27,840 --> 03:49:29,840 I THINK IT'S AN IMPORTANT ISSUE. 5346 03:49:29,840 --> 03:49:32,920 ONE OF THE EARLY CAREER 5347 03:49:32,920 --> 03:49:34,040 RESEARCHERS I HAD SHARED A STORY 5348 03:49:34,040 --> 03:49:35,360 HOW THEY HAD GONE TO A 5349 03:49:35,360 --> 03:49:40,440 CONFERENCE AND ORGANIZED A 5350 03:49:40,440 --> 03:49:43,160 SESSION ON EXPERIMENTS THAT 5351 03:49:43,160 --> 03:49:44,480 DIDN'T WORK AND IT DIDN'T WORK 5352 03:49:44,480 --> 03:49:46,280 OUT AND WE WOULD NEVER DO IT 5353 03:49:46,280 --> 03:49:46,480 AGAIN. 5354 03:49:46,480 --> 03:49:47,720 HERE'S WHAT WE LEARN FROM THE 5355 03:49:47,720 --> 03:49:52,600 EXPERIENCE AND IT WAS HUGELY 5356 03:49:52,600 --> 03:49:53,720 POPULAR THEN THE ORGANIZERS 5357 03:49:53,720 --> 03:49:56,120 WOULD NEVER ALLOW EM TO DO IT 5358 03:49:56,120 --> 03:49:56,320 AGAIN. 5359 03:49:56,320 --> 03:49:57,560 -- THEM TO DO IT AGAIN. 5360 03:49:57,560 --> 03:50:01,440 I THINK CREATING A SPACE FOR 5361 03:50:01,440 --> 03:50:03,120 LESS PRETTY SCIENCE AND 5362 03:50:03,120 --> 03:50:04,680 UNSUCCESSFUL THINGS IN 5363 03:50:04,680 --> 03:50:09,400 CONFERENCES WOULD GO A LONG WAY 5364 03:50:09,400 --> 03:50:11,520 BECAUSE IF YOU SEE EVERYONE ELSE 5365 03:50:11,520 --> 03:50:12,240 PRESENTING BEAUTIFUL STORIES YOU 5366 03:50:12,240 --> 03:50:13,640 FEEL YOU HAVE TO HAVE ONE TOO. 5367 03:50:13,640 --> 03:50:15,440 THIS ALSO GOES TO HOW I THINK 5368 03:50:15,440 --> 03:50:16,200 ABOUT BAR GRAPHS. 5369 03:50:16,200 --> 03:50:18,680 PEOPLE DON'T WANT TO SWITCH TO 5370 03:50:18,680 --> 03:50:21,360 DOT PLOTS BECAUSE THEY FEEL 5371 03:50:21,360 --> 03:50:22,800 EVERYONE ELSE IS PERFECT AND 5372 03:50:22,800 --> 03:50:24,720 EVERYONE'S DATA IS A MESS BUT 5373 03:50:24,720 --> 03:50:26,680 YOU'RE JUST NOT SEEING AND IF WE 5374 03:50:26,680 --> 03:50:28,360 WERE SEEING EVERYONE'S MESS 5375 03:50:28,360 --> 03:50:31,240 YOU'D KNOW THAT AND WOULD HAVE A 5376 03:50:31,240 --> 03:50:32,680 DIFFERENT THRESHOLD FOR WHAT 5377 03:50:32,680 --> 03:50:34,000 SCIENCE LOOKS LIKE AND SO YEAH I 5378 03:50:34,000 --> 03:50:35,800 THINK CREATING A SPACE AT 5379 03:50:35,800 --> 03:50:37,400 CONFERENCES FOR THAT AND FINDING 5380 03:50:37,400 --> 03:50:38,520 CREATIVE WAYS TO DO IT WOULD BE 5381 03:50:38,520 --> 03:50:42,240 VERY VALUABLE. 5382 03:50:42,240 --> 03:50:44,760 >> I LOVE THAT COMMENT I CAN 5383 03:50:44,760 --> 03:50:45,840 LINK A LOT OF THINGS WE HEARD 5384 03:50:45,840 --> 03:50:47,560 HERE TO THE ANTI-TED TALK AND 5385 03:50:47,560 --> 03:50:49,520 WHAT THAT WOULD BE LIKE. 5386 03:50:49,520 --> 03:50:54,600 LET'S HEAR FROM STEVEN. 5387 03:50:54,600 --> 03:50:58,520 >> I WANT TO ASK A PRACTICAL 5388 03:50:58,520 --> 03:51:02,360 QUESTION AND BRING IT BACK TO 5389 03:51:02,360 --> 03:51:03,040 RESEARCH RIGOR. 5390 03:51:03,040 --> 03:51:05,440 MOST FOCUS ON ISSUES AROUND DATA 5391 03:51:05,440 --> 03:51:06,680 MANAGEMENT AND STATISTICAL 5392 03:51:06,680 --> 03:51:11,200 ANALYSIS WHICH IS ALMOST 5393 03:51:11,200 --> 03:51:14,240 AGNOSTIC TO FIELD THOUGH THE 5394 03:51:14,240 --> 03:51:16,520 APPLICATION IS SPECIFIC AND WHEN 5395 03:51:16,520 --> 03:51:21,000 WE GET TO RIGOR IT GOES TO 5396 03:51:21,000 --> 03:51:23,800 RANDOMIZATION AND WHERE YOU USE 5397 03:51:23,800 --> 03:51:26,800 INTERNAL REPLICATION AND 5398 03:51:26,800 --> 03:51:28,520 VALIDATE WITH MULTIPLE LABS. 5399 03:51:28,520 --> 03:51:34,680 IT'S DIFFICULT TO TEACH AND 5400 03:51:34,680 --> 03:51:38,280 SECOND BECAUSE OF THE T32 5401 03:51:38,280 --> 03:51:39,120 REQUIREMENTS WE GET STUDENTS 5402 03:51:39,120 --> 03:51:43,920 REQUIRED TO TAKE THESE COURSES 5403 03:51:43,920 --> 03:51:44,640 AND WE'RE GETTING NEUROSCIENCE 5404 03:51:44,640 --> 03:51:47,000 AND CHEMISTS AND CANCER 5405 03:51:47,000 --> 03:51:49,960 BIOLOGISTS AND THEY'RE STUDYING 5406 03:51:49,960 --> 03:51:52,120 VERY DIFFERENT PHENOMENON WITH 5407 03:51:52,120 --> 03:51:55,280 EXTREMELY DIVERSE AND 5408 03:51:55,280 --> 03:51:57,520 HETEROGENEOUS EXPERIMENTAL 5409 03:51:57,520 --> 03:52:00,520 TECHNIQUES WHERE THE RIGOR IS 5410 03:52:00,520 --> 03:52:03,120 QUITE DIFFERENT AND MAY NOT BE 5411 03:52:03,120 --> 03:52:04,120 RELEVANT TO SOMEONE USING 5412 03:52:04,120 --> 03:52:06,640 ANIMALS THERE'S A WHOLE RANGE OF 5413 03:52:06,640 --> 03:52:08,160 THINGS AND SOMEONE USING PLATES 5414 03:52:08,160 --> 03:52:09,960 OR WESTERN BLOTS OR YOU NAME IT 5415 03:52:09,960 --> 03:52:10,720 IT'S A DIFFERENCE SUITE OF 5416 03:52:10,720 --> 03:52:17,400 THINGS. 5417 03:52:17,400 --> 03:52:24,160 AND IF WE'RE FOCUSSING ON RIGOR 5418 03:52:24,160 --> 03:52:26,240 EXPERIMENTAL DESIGN ISSUES AND 5419 03:52:26,240 --> 03:52:27,800 NOT ANALYSIS AND DATA MANAGEMENT 5420 03:52:27,800 --> 03:52:29,560 THEY'RE ALIGNED BUT NOT EXACTLY 5421 03:52:29,560 --> 03:52:36,000 THE SAME, HOW DO WE BRIDGE OR 5422 03:52:36,000 --> 03:52:39,080 TAKE INTO THE CONFIDENT THE 5423 03:52:39,080 --> 03:52:39,600 HETEROGENEITY IN THE LAB 5424 03:52:39,600 --> 03:52:48,440 SCIENCES? 5425 03:52:48,440 --> 03:52:50,960 >> I'VE BEEN TRYING TO KEEP US 5426 03:52:50,960 --> 03:52:52,440 ON TIME AND WE'RE GOING GOOD. 5427 03:52:52,440 --> 03:52:57,600 >> THE COMPONENTS OF SCIENTIFIC 5428 03:52:57,600 --> 03:52:59,880 RIGOR COMPRISE DESIGN AND LOGIC 5429 03:52:59,880 --> 03:53:02,840 AND STATISTICS THEY CANNOT BE 5430 03:53:02,840 --> 03:53:03,120 SEPARATED. 5431 03:53:03,120 --> 03:53:04,320 FOR YOUR COMPLETE QUESTION. 5432 03:53:04,320 --> 03:53:07,400 IN MY VIEW AND IN OUR EXPERIENCE 5433 03:53:07,400 --> 03:53:11,080 WE STARTED WITH WHAT I MENTIONED 5434 03:53:11,080 --> 03:53:14,320 EARLIER WITH SEEING HOW THINGS 5435 03:53:14,320 --> 03:53:16,200 CAN GO WRONG. 5436 03:53:16,200 --> 03:53:18,960 YOU MAY REMEMBER FROM THE SAME 5437 03:53:18,960 --> 03:53:22,160 INSTITUTION I WAS WE HAVE A WIDE 5438 03:53:22,160 --> 03:53:23,800 VARIETY OF PEOPLE FROM DIFFERENT 5439 03:53:23,800 --> 03:53:26,680 DISCIPLINES AND WE HAVE PEOPLE 5440 03:53:26,680 --> 03:53:33,120 FROM DIFFERENT FIELD WHO HAVE 5441 03:53:33,120 --> 03:53:35,680 DIFFERENT RESEARCH DESIGN 5442 03:53:35,680 --> 03:53:35,960 PROBLEMS. 5443 03:53:35,960 --> 03:53:40,960 BASICALLY WE TALK ABOUT THE MAIN 5444 03:53:40,960 --> 03:53:44,720 BASIC ISSUES AND BRING THEM 5445 03:53:44,720 --> 03:53:45,920 TOGETHER THIS IS WHERE SCIENCE 5446 03:53:45,920 --> 03:53:47,000 CAN GO WRONG ON THE AMENDMENTAL 5447 03:53:47,000 --> 03:53:52,280 LEVEL AND NOW LET'S LOOK TO THE 5448 03:53:52,280 --> 03:53:53,080 RESPECT DISCIPLINES AND FIELD 5449 03:53:53,080 --> 03:53:56,760 AND HOW THE PROBLEM LOOKS IN 5450 03:53:56,760 --> 03:53:58,400 YOUR RESEARCH REALITY AND DO 5451 03:53:58,400 --> 03:54:01,240 YOUR BEST TO TELL THE OTHERS IN 5452 03:54:01,240 --> 03:54:02,080 UNDERSTANDABLE WORDS WHAT YOUR 5453 03:54:02,080 --> 03:54:07,840 PROBLEM IS WITH THAT ASPECT OF 5454 03:54:07,840 --> 03:54:12,320 RIGOR THEN IN PRACTICE WE TRIED 5455 03:54:12,320 --> 03:54:13,560 TO COLLABORATE CLOSELY WITH THE 5456 03:54:13,560 --> 03:54:19,240 P.I.s AND I THINK TRACEY HAD A 5457 03:54:19,240 --> 03:54:25,200 WONDERFUL LINE IN YOUR ACTION 5458 03:54:25,200 --> 03:54:25,560 ST 5459 03:54:25,560 --> 03:54:27,160 STEPS IN MAKING IT A REQUIRED 5460 03:54:27,160 --> 03:54:29,800 COMPONENT AND WHAT WE NEED TO DO 5461 03:54:29,800 --> 03:54:32,680 GOING FORWARD WE NEED TO 5462 03:54:32,680 --> 03:54:33,000 COLLABORATE. 5463 03:54:33,000 --> 03:54:35,240 EDUCATORS AND THE MENTOR IN THE 5464 03:54:35,240 --> 03:54:37,840 LAB TO MAKE SURE THESE 5465 03:54:37,840 --> 03:54:39,120 PARTICULAR PRINCIPLES ARE BEING 5466 03:54:39,120 --> 03:54:45,120 INTEGRATED AND WE CAN FOLLOW-UP 5467 03:54:45,120 --> 03:54:47,960 CONNECTING THE COURSE WORK TO 5468 03:54:47,960 --> 03:54:49,320 GET STARTED. 5469 03:54:49,320 --> 03:54:54,040 I THINK THAT'S A GOOD START. 5470 03:54:54,040 --> 03:54:56,440 >> WE HAVE A NUMBER OF 5471 03:54:56,440 --> 03:54:57,720 TECHNIQUES WE USED TO DEAL WITH 5472 03:54:57,720 --> 03:54:58,960 IN OUR COURSE. 5473 03:54:58,960 --> 03:55:01,480 FIRST OF ALL IT'S REALLY 5474 03:55:01,480 --> 03:55:02,520 IMPORTANT TO HAVE DIFFERENT 5475 03:55:02,520 --> 03:55:04,640 FIELD AND TO BE INTERACTING WITH 5476 03:55:04,640 --> 03:55:07,360 DIFFERENT FIELD AS AN INSTRUCTOR 5477 03:55:07,360 --> 03:55:08,440 SPECIFICALLY WHEN PEOPLE DO 5478 03:55:08,440 --> 03:55:09,600 APPLIED WORK BECAUSE THE 5479 03:55:09,600 --> 03:55:11,080 FEEDBACK FROM STUDENTS WILL TELL 5480 03:55:11,080 --> 03:55:15,160 YOU WHERE WE HAVE GABZ AND WHERE 5481 03:55:15,160 --> 03:55:18,680 THINGS AREN'T WORKING AND WILL 5482 03:55:18,680 --> 03:55:22,600 HAVE LEGITIMATE REASONS WHY IT 5483 03:55:22,600 --> 03:55:24,320 WILL NOT WORK AND SOMETIMES YOU 5484 03:55:24,320 --> 03:55:27,200 CAN HELP PROBLEM SOLVE AND IT 5485 03:55:27,200 --> 03:55:31,640 WILL MAKE YOU A BETTER TEACHER 5486 03:55:31,640 --> 03:55:32,880 FOR FUTURE STUDENTS. 5487 03:55:32,880 --> 03:55:37,560 FIRST WE TRY TO MAKE SURE OUR 5488 03:55:37,560 --> 03:55:39,160 ADVERTISEMENTS ARE AS CLEAR AS 5489 03:55:39,160 --> 03:55:40,720 POSSIBLE SO PEOPLE KNOW WHAT 5490 03:55:40,720 --> 03:55:42,280 SKILLS WE'RE DISCUSSING AND 5491 03:55:42,280 --> 03:55:43,240 GAUGE WHETHER A COURSE IS 5492 03:55:43,240 --> 03:55:45,840 APPROPRIATE FOR THEIR EXPERTISE. 5493 03:55:45,840 --> 03:55:48,560 SECOND WE TEAM TEACH TO HAVE 5494 03:55:48,560 --> 03:55:49,480 PEOPLE WITH DIFFERENT EXPERTISE 5495 03:55:49,480 --> 03:55:51,120 WITHIN OUR INSTRUCTOR PANEL. 5496 03:55:51,120 --> 03:55:53,280 I HAD MORE EXPERIENCE IN SMALL 5497 03:55:53,280 --> 03:55:55,200 SAMPLE SIZE HUMAN STUDIES. 5498 03:55:55,200 --> 03:55:58,680 THE PERSON I CO-TEACH WITH HAS 5499 03:55:58,680 --> 03:56:03,160 MORE EXPERIENCE WITH ANIMAL AND 5500 03:56:03,160 --> 03:56:04,480 IN VITRO WORK AND WE ARE HONEST 5501 03:56:04,480 --> 03:56:06,200 ABOUT OUR LIMITATIONS. 5502 03:56:06,200 --> 03:56:07,760 WE'LL SIMPLY TELL THEM WE CANNOT 5503 03:56:07,760 --> 03:56:10,000 BE EXPERTS IN ALL THE THINGS YOU 5504 03:56:10,000 --> 03:56:11,760 DO AND THAT'S OBVIOUS TO THEM 5505 03:56:11,760 --> 03:56:14,680 BECAUSE THEY REALIZE HOW BROAD 5506 03:56:14,680 --> 03:56:18,600 THEIR EXPERTISE AND EXPERIENCES 5507 03:56:18,600 --> 03:56:18,760 ARE. 5508 03:56:18,760 --> 03:56:22,680 THE NEXT THING IS WHEN WE HAVE 5509 03:56:22,680 --> 03:56:23,760 MODULES LIKE DATA VISUALIZATION 5510 03:56:23,760 --> 03:56:25,280 WHERE WHAT YOU NEED DEPENDS ON 5511 03:56:25,280 --> 03:56:26,640 WHAT YOU'RE DOING. 5512 03:56:26,640 --> 03:56:30,120 WE MIGHT GIVE THEM THREE HOURS 5513 03:56:30,120 --> 03:56:34,000 OF LECTURE CONTENT AND SAY IF 5514 03:56:34,000 --> 03:56:35,680 YOU NEED WESTERN BLOTS GO TO 5515 03:56:35,680 --> 03:56:36,960 THIS TIME STAMP. 5516 03:56:36,960 --> 03:56:39,640 IF YOU NEED IMAGE-BASED FIGURES 5517 03:56:39,640 --> 03:56:41,880 GO TO THIS TIME STAMP AND IF YOU 5518 03:56:41,880 --> 03:56:44,840 NEED IT AVAILABLE FOR A BROADER 5519 03:56:44,840 --> 03:56:46,680 AUDIENCE GO TO THIS TIME STAMP 5520 03:56:46,680 --> 03:56:49,240 SO PEOPLE CAN EASILY NAVIGATE 5521 03:56:49,240 --> 03:56:51,680 AND FIND TOOLS RELEVANT TO THEM 5522 03:56:51,680 --> 03:56:53,640 AND THE PEER TEACHING IS 5523 03:56:53,640 --> 03:56:54,440 IMPORTANT BECAUSE SOMETIMES 5524 03:56:54,440 --> 03:56:55,120 OTHER PEOPLE IN THE COURSE HAVE 5525 03:56:55,120 --> 03:56:58,040 THE ANSWERS. 5526 03:56:58,040 --> 03:56:59,840 THEY'RE NOT BLANK SLATES. 5527 03:56:59,840 --> 03:57:00,960 PEOPLE WHO ENROLL IN THESE 5528 03:57:00,960 --> 03:57:02,080 PROGRAMS OFTEN HAVE EXPERIENCE 5529 03:57:02,080 --> 03:57:03,520 FROM OTHER PLACES AND WE HAVE 5530 03:57:03,520 --> 03:57:06,320 HAD TIMES WHERE THE TWO OF US AS 5531 03:57:06,320 --> 03:57:08,080 INSTRUCTORS ARE LIKE THAT'S AN 5532 03:57:08,080 --> 03:57:10,680 EXCELLENT QUESTION, NO CLUE. 5533 03:57:10,680 --> 03:57:12,160 AND TWO OR THREE OTHER STUDENTS 5534 03:57:12,160 --> 03:57:14,600 HAVE THE ANSWERS AND HAVE A GOOD 5535 03:57:14,600 --> 03:57:15,200 DISCUSSION AMONGST THEMSELVES 5536 03:57:15,200 --> 03:57:17,160 AND THOSE ARE ALL THE STRATEGIES 5537 03:57:17,160 --> 03:57:20,520 WE USE TO ADDRESS THE SCENARIOS 5538 03:57:20,520 --> 03:57:21,640 AND AGAIN VALUABLE FOR STUDENTS 5539 03:57:21,640 --> 03:57:23,400 TO HAVE AN UNDERSTANDING HOW 5540 03:57:23,400 --> 03:57:26,680 THINGS APPLY BEYOND THEIR OWN 5541 03:57:26,680 --> 03:57:28,080 RESEARCH FIELD AND IN OTHER 5542 03:57:28,080 --> 03:57:30,160 AREAS THEY MIGHT ENCOUNTER IN 5543 03:57:30,160 --> 03:57:30,480 THE FUTURE. 5544 03:57:30,480 --> 03:57:31,880 IT ENHANCES THE LEARNING 5545 03:57:31,880 --> 03:57:32,920 EXPERIENCE FOR EVERYONE. 5546 03:57:32,920 --> 03:57:34,720 IT'S IMPORTANT TO EMBRACE THAT 5547 03:57:34,720 --> 03:57:38,760 AND NOT TO BE AFRAID OF IT AS AN 5548 03:57:38,760 --> 03:57:43,200 INSTRUCTOR. 5549 03:57:43,200 --> 03:57:45,600 >> FOR THOSE THAT DON'T KNOW THE 5550 03:57:45,600 --> 03:57:48,440 CARPENTRIES DOES NOT EXIST AT AN 5551 03:57:48,440 --> 03:57:52,880 UNIVERSITY OR SINGLE 5552 03:57:52,880 --> 03:57:53,200 INSTITUTION. 5553 03:57:53,200 --> 03:57:54,640 BY DEFINITION EVERYTHING THEY 5554 03:57:54,640 --> 03:57:56,240 BUILT IS BY CONSENSUS AND DON'T 5555 03:57:56,240 --> 03:57:57,240 HAVE A DEPARTMENT OR PROFESSOR 5556 03:57:57,240 --> 03:57:59,080 FROM ANY OF THE DISCIPLINES BUT 5557 03:57:59,080 --> 03:58:03,200 YET YOU'VE CREATED MULTIPLE 5558 03:58:03,200 --> 03:58:06,480 CURRICULA THAT ADDRESS THE DATA 5559 03:58:06,480 --> 03:58:09,800 NEEDS OF THAT PARTICULAR 5560 03:58:09,800 --> 03:58:11,120 DISCIPLINE AND I THINK OUR 5561 03:58:11,120 --> 03:58:13,000 PROBLEM IS SIMILAR WHERE THERE'S 5562 03:58:13,000 --> 03:58:15,640 RESEARCH RIGOR NEEDS THAT ARE 5563 03:58:15,640 --> 03:58:17,680 DISCIPLINE SPECIFIC AND AT THE 5564 03:58:17,680 --> 03:58:20,160 SAME TIME IT MAY BE A BIT OF A 5565 03:58:20,160 --> 03:58:22,400 FAILURE AS THEY AGREE TO THEIR 5566 03:58:22,400 --> 03:58:23,880 OWN SEPARATE AND CAN BE SPECIFIC 5567 03:58:23,880 --> 03:58:26,040 TO WHAT THEY WOULD WANT. 5568 03:58:26,040 --> 03:58:29,640 COULD YOU SPEAK TO HOW THAT AND 5569 03:58:29,640 --> 03:58:30,640 THEN WE HAVE OTHERS TO GET US TO 5570 03:58:30,640 --> 03:58:35,520 THE WRAP-UP OF THE SESSION. 5571 03:58:35,520 --> 03:58:36,760 >> THAT'S WHERE COMMUNITY 5572 03:58:36,760 --> 03:58:38,160 BUILDING IS EXTREMELY IMPORTANT 5573 03:58:38,160 --> 03:58:38,680 FOR US. 5574 03:58:38,680 --> 03:58:42,120 AS JASON SAID, WE'RE A STAFF OF 5575 03:58:42,120 --> 03:58:46,280 PEOPLE THAT ALL WORK REMOTELY 5576 03:58:46,280 --> 03:58:47,440 AND I'M AN ENGINEER. 5577 03:58:47,440 --> 03:58:49,440 I'M NOT A SCIENTIST. 5578 03:58:49,440 --> 03:58:52,360 I DON'T HAVE THE SUBJECT MATTER 5579 03:58:52,360 --> 03:58:54,040 EXPERTISE IN THE VARIOUS TOPICS 5580 03:58:54,040 --> 03:58:55,600 BUT WE HAVE COMMUNITY MEMBERS 5581 03:58:55,600 --> 03:58:57,800 WHO COME TO OUR WORK SHOPS TO 5582 03:58:57,800 --> 03:59:00,800 LEARN ABOUT REPRODUCIBILITY AND 5583 03:59:00,800 --> 03:59:06,480 LEARN ABOUT BASIC SOFTWARE 5584 03:59:06,480 --> 03:59:07,680 DEVELOPMENT AND ACKNOWLEDGE 5585 03:59:07,680 --> 03:59:12,280 OTHER PEOPLE IN THE SAME 5586 03:59:12,280 --> 03:59:13,120 DISCIPLINE AND BUILD THE 5587 03:59:13,120 --> 03:59:14,680 INFRASTRUCTURE AROUND THE 5588 03:59:14,680 --> 03:59:15,520 PRINCIPLES THEY LEARN FROM 5589 03:59:15,520 --> 03:59:21,560 CARPENTRIES WORK SHOPS. 5590 03:59:21,560 --> 03:59:22,760 BEING PART OF THE SUBCOMMUNITY 5591 03:59:22,760 --> 03:59:26,480 HAS PROVEN VALUABLE. 5592 03:59:26,480 --> 03:59:29,440 THEY GO ON TO LAUNCH CURRICULUM 5593 03:59:29,440 --> 03:59:30,160 ADVISORY PROGRAMS AROUND LESSONS 5594 03:59:30,160 --> 03:59:34,360 FOR GENOMICS AND GEOSPATIAL. 5595 03:59:34,360 --> 03:59:38,440 IT'S ALL ABOUT CREATING THE 5596 03:59:38,440 --> 03:59:39,640 INFRASTRUCTURE WHERE PEOPLE 5597 03:59:39,640 --> 03:59:41,280 WOULD LIKE TO COME TOGETHER AND 5598 03:59:41,280 --> 03:59:42,680 CREATE SOMETHING BIGGER BASED ON 5599 03:59:42,680 --> 03:59:45,160 WHAT THEY'VE LEARNED IN THOSE 5600 03:59:45,160 --> 03:59:54,480 FOUNDATIONAL WORK SHOPS WITH US. 5601 03:59:54,480 --> 03:59:56,560 >> I'M THE REPRODUCIBILITY 5602 03:59:56,560 --> 03:59:58,160 LIBRARIAN AT THE UNIVERSITY OF 5603 03:59:58,160 --> 03:59:59,960 FLORIDA AND IN MY PAST AS A 5604 03:59:59,960 --> 04:00:01,360 RESEARCHER ONE AREA WAS COMPLEX 5605 04:00:01,360 --> 04:00:01,600 SYSTEMS. 5606 04:00:01,600 --> 04:00:04,800 I WANT TO THANK KAREN FOR 5607 04:00:04,800 --> 04:00:08,640 BRINGING THAT UP. 5608 04:00:08,640 --> 04:00:12,440 -- THE IMPORTANCE OF SYSTEMS 5609 04:00:12,440 --> 04:00:12,720 THINKING. 5610 04:00:12,720 --> 04:00:16,960 AND I THINK EVERYONE IN THE ROOM 5611 04:00:16,960 --> 04:00:23,840 I THINK APPRECIATES YOUR 5612 04:00:23,840 --> 04:00:25,160 PRESENTATION AND HOW WE COULD DO 5613 04:00:25,160 --> 04:00:26,200 REPRODUCIBILITY TRAINING. 5614 04:00:26,200 --> 04:00:31,560 THERE'S A BIG SYSTEMIC ISSUE OF 5615 04:00:31,560 --> 04:00:34,680 HOW WE ARE SUPPORTING THAT 5616 04:00:34,680 --> 04:00:36,000 TRAINING BECAUSE I AM IN THE 5617 04:00:36,000 --> 04:00:39,040 FORTUNATE POSITION OF HAVING A 5618 04:00:39,040 --> 04:00:40,640 FULL-TIME JOB WHERE I GET TO 5619 04:00:40,640 --> 04:00:42,440 FOCUS ON THAT BUT IT SEEMS 5620 04:00:42,440 --> 04:00:45,080 PROBLEMATIC TO ME THOUGH I LOVE 5621 04:00:45,080 --> 04:00:48,320 THE CARPENTRY'S INVOLVEMENT AND 5622 04:00:48,320 --> 04:00:51,120 I'M AN INSTRUCTOR AND 5623 04:00:51,120 --> 04:00:53,240 INSTRUCTOR-TRAINER AND YOU TEACH 5624 04:00:53,240 --> 04:00:55,840 ESSENTIAL DATA AND COMPUTATIONAL 5625 04:00:55,840 --> 04:01:02,080 SKILLS AND YOUR WORKSHOP 5626 04:01:02,080 --> 04:01:03,920 VOLUNTEER LED. 5627 04:01:03,920 --> 04:01:05,920 WHY ARE THE INSTITUTIONS NOT 5628 04:01:05,920 --> 04:01:07,760 COVERING THAT ESSENTIAL NEED? 5629 04:01:07,760 --> 04:01:10,200 I THINK IT'S A MESSED UP BROKEN 5630 04:01:10,200 --> 04:01:15,240 PART OF OUR SYSTEM AND KIND OF 5631 04:01:15,240 --> 04:01:18,840 AMAZING IT HASN'T YET BEEN 5632 04:01:18,840 --> 04:01:21,160 SWALLOWED UP BY ALSOVIR, FOR 5633 04:01:21,160 --> 04:01:21,440 INSTANCE. 5634 04:01:21,440 --> 04:01:31,640 >> I AGREE. 5635 04:01:33,680 --> 04:01:36,760 >> TO CONTINUE ALONG THE 5636 04:01:36,760 --> 04:01:39,880 QUESTION STEVE BROUGHT UP AND WE 5637 04:01:39,880 --> 04:01:42,600 WERE DISCUSSION THIS OVER LUX. 5638 04:01:42,600 --> 04:01:44,800 IN DINKING ABOUT THE DIFFERENT 5639 04:01:44,800 --> 04:01:45,920 DISCIPLINES I THINK THERE'S ONE 5640 04:01:45,920 --> 04:01:47,760 THING IN COMMON WITH ALL THE 5641 04:01:47,760 --> 04:01:52,840 DISCIPLINES THERE'S ALWAYS A 5642 04:01:52,840 --> 04:01:56,640 VERTEBRATE ANIMAL IN THE ROOM 5643 04:01:56,640 --> 04:01:58,080 THERE'S THE RESEARCHER AND'S 5644 04:01:58,080 --> 04:02:01,800 EASY TO THINK OF WHAT TO FOCUS 5645 04:02:01,800 --> 04:02:04,160 ON FIRST BECAUSE RISK OF 5646 04:02:04,160 --> 04:02:07,720 UNCONSCIOUS BIAS AND THERE'S A 5647 04:02:07,720 --> 04:02:10,680 HUGE CONTRIBUTION TO THE ISSUES 5648 04:02:10,680 --> 04:02:11,800 AS MY ESTEEMED COLLEAGUES 5649 04:02:11,800 --> 04:02:13,720 SITTING NEXT TO ME HERE HAS 5650 04:02:13,720 --> 04:02:20,200 POINTED OUT MANY MANY TIMES. 5651 04:02:20,200 --> 04:02:25,680 A COMMON ELEMENT WOULD BE GREAT 5652 04:02:25,680 --> 04:02:30,680 PLACE TO START AND WE'D MAKE A 5653 04:02:30,680 --> 04:02:31,840 LOT OF PROGRESS IF WE ADDRESSED 5654 04:02:31,840 --> 04:02:37,320 RISK OF BIAS AND GET THE 5655 04:02:37,320 --> 04:02:40,320 COMMUNITY TO DO TO BRING ABOUT 5656 04:02:40,320 --> 04:02:40,520 CHANGE. 5657 04:02:40,520 --> 04:02:42,520 >> MAYBE I COULD CALL OUT RUSS 5658 04:02:42,520 --> 04:02:44,680 ON THE COMMENT TO COME BACK TO 5659 04:02:44,680 --> 04:02:49,120 WHAT YOU SAID. 5660 04:02:49,120 --> 04:02:59,640 ONE THING I HEARD THE NEED TO 5661 04:03:01,160 --> 04:03:04,200 UNBURDEN THE INDIVIDUAL AND IF 5662 04:03:04,200 --> 04:03:14,080 THE ACTIONS OF PEOPLE AND IF WE 5663 04:03:14,080 --> 04:03:18,480 CAN HAVE STRUCTURES NOT 5664 04:03:18,480 --> 04:03:21,800 EXPLOITIVE ONES AND SO IN 5665 04:03:21,800 --> 04:03:26,560 INSTRUCTORS CAN BE PLACED IN A 5666 04:03:26,560 --> 04:03:27,600 POSITION TO BE MORE RIGOROUS 5667 04:03:27,600 --> 04:03:28,800 BECAUSE THEY DON'T HAVE TO THINK 5668 04:03:28,800 --> 04:03:33,960 THROUGH EVERY SINGLE THING. 5669 04:03:33,960 --> 04:03:44,520 THERE'S STANDARDS AVAILABLE AND 5670 04:03:50,040 --> 04:04:00,520 TAGE JUR DATA COULD -- PERSONAL 5671 04:04:03,920 --> 04:04:05,440 BIAS AS AN ELEMENT. 5672 04:04:05,440 --> 04:04:07,040 ONE THING WE HAVE TO FIGURE HOW 5673 04:04:07,040 --> 04:04:08,520 TO ADDRESS THE COMMON ELEMENT OF 5674 04:04:08,520 --> 04:04:10,680 PERSONAL BIASES THAT STAND IN 5675 04:04:10,680 --> 04:04:11,480 THE RAY OF DEVELOPING RIGOROUS 5676 04:04:11,480 --> 04:04:21,640 PRACTICE. 5677 04:04:24,960 --> 04:04:25,240 >> INTERESTING. 5678 04:04:25,240 --> 04:04:28,160 WE BRING BIAS TO EVERYTHING WE 5679 04:04:28,160 --> 04:04:28,800 DO. 5680 04:04:28,800 --> 04:04:29,800 PART OF THE ISSUE IS TRYING TO 5681 04:04:29,800 --> 04:04:35,320 SCULPT THE BIASES OF THE FIELD, 5682 04:04:35,320 --> 04:04:37,600 I THINK, SO WE CAN BE BIASSED IN 5683 04:04:37,600 --> 04:04:39,480 A WAY THAT MEETS WITH THE THINGS 5684 04:04:39,480 --> 04:04:42,120 WE WANT TO INCENTIVIZE. 5685 04:04:42,120 --> 04:04:46,040 I THINK A LOT OF IT DOES COME 5686 04:04:46,040 --> 04:04:47,280 DOWN TO MAKING IT EASY FOR 5687 04:04:47,280 --> 04:04:49,520 PEOPLE TO DO THE RIGHT THING. 5688 04:04:49,520 --> 04:04:50,960 THERE'S ANOTHER -- I DON'T KNOW 5689 04:04:50,960 --> 04:04:52,600 IF YOU THINK OF THIS AS THE BIAS 5690 04:04:52,600 --> 04:04:58,160 BUT WHAT CAME TO MIND IN THE 5691 04:04:58,160 --> 04:05:01,000 DISCUSSION WAS WHEN YOU THINK OF 5692 04:05:01,000 --> 04:05:02,280 BEHAVIOR CHANGE IN MORE SENIOR 5693 04:05:02,280 --> 04:05:04,400 RESEARCHERS WHAT IT TAKES FOR 5694 04:05:04,400 --> 04:05:05,920 SOMEBODY TO SAY WE NEED TO 5695 04:05:05,920 --> 04:05:08,240 CHANGE WHAT WE'RE DOING IS 5696 04:05:08,240 --> 04:05:09,680 SOMETHING WAS WRONG WITH THE 5697 04:05:09,680 --> 04:05:13,920 RESEARCH I BECAME FAMOUS OR 5698 04:05:13,920 --> 04:05:15,960 DOING AND THERE'S A LOT OF THE 5699 04:05:15,960 --> 04:05:17,160 COGNITIVE DISSIDENCE THAT CAN GO 5700 04:05:17,160 --> 04:05:22,920 ON AND FOR SENIOR RESEARCHERS 5701 04:05:22,920 --> 04:05:26,720 FIGURING OUT HOW TO RANK THE 5702 04:05:26,720 --> 04:05:31,720 WATERS OF CHANGING WITHOUT 5703 04:05:31,720 --> 04:05:32,720 NECESSARILY HAVING TO EVERYTHING 5704 04:05:32,720 --> 04:05:34,600 YOU DID WAS PROBLEMATIC. 5705 04:05:34,600 --> 04:05:36,560 I DON'T KNOW WHAT THE RIGHT WAY 5706 04:05:36,560 --> 04:05:38,800 IS TO DO THAT BUT I THINK THAT'S 5707 04:05:38,800 --> 04:05:40,200 AN IMPORTANT FEATURE OF THIS. 5708 04:05:40,200 --> 04:05:41,960 >> I'LL LEAVE THE THOUGHT AND 5709 04:05:41,960 --> 04:05:43,680 MIND AS WE WRAP THIS UP. 5710 04:05:43,680 --> 04:05:49,360 IT'S HARD TO CONVINCE SOMEBODY 5711 04:05:49,360 --> 04:05:50,720 ON SOMETHING IF THEIR JOB 5712 04:05:50,720 --> 04:05:52,080 DEPENDS ON NOT UNDERSTANDING 5713 04:05:52,080 --> 04:05:53,600 WHAT YOU'RE TRYING TO 5714 04:05:53,600 --> 04:05:53,880 COMMUNICATE. 5715 04:05:53,880 --> 04:05:57,720 I SEE WALKING UP TO THE STAGE 5716 04:05:57,720 --> 04:05:59,240 AND WE'LL SET THE STAGE TO WE 5717 04:05:59,240 --> 04:06:02,000 KNOW WHAT TO DO AND WHAT THE 5718 04:06:02,000 --> 04:06:03,720 NUMBERS ANDERS ON THE BACK OF 5719 04:06:03,720 --> 04:06:05,480 OUR BADGES MEAN. 5720 04:06:05,480 --> 04:06:06,760 THANK YOU ONCE AGAIN TO OUR 5721 04:06:06,760 --> 04:06:09,160 PANELISTS AND SPEAKERS. 5722 04:06:09,160 --> 04:06:12,200 THANK YOU. 5723 04:06:12,200 --> 04:06:18,240 >> THANK YOU, JASON FOR 5724 04:06:18,240 --> 04:06:18,720 EXCELLENT MODERATION. 5725 04:06:18,720 --> 04:06:21,000 SO NOW THE FUN CONTINUES. 5726 04:06:21,000 --> 04:06:22,640 WE'RE GOING TRY TO DO BREAKOUT 5727 04:06:22,640 --> 04:06:25,800 SESSIONS 5728 04:06:25,800 --> 04:06:28,480 ALL RIGHT. 5729 04:06:28,480 --> 04:06:31,680 WE HAVE REACHED THE END OF THE 5730 04:06:31,680 --> 04:06:33,240 FIRST DAY OF THE WORKSHOP. 5731 04:06:33,240 --> 04:06:37,320 I HAVE THE -- FIND MYSELF IN THE 5732 04:06:37,320 --> 04:06:38,320 UNFORTUNATE POSITION TO BE 5733 04:06:38,320 --> 04:06:40,760 BETWEEN YOU AND ESCAPING THE 5734 04:06:40,760 --> 04:06:43,720 CAMPUS FOR ENJOYING A MEAL OR 5735 04:06:43,720 --> 04:06:48,600 BEVERAGE SO I WILL BE FAST. 5736 04:06:48,600 --> 04:06:51,720 AND I JUST WANT TO SHARE A FEW 5737 04:06:51,720 --> 04:06:55,000 SORT OF VERY HIGH LEVEL THOUGHTS 5738 04:06:55,000 --> 04:06:57,000 THAT I KEPT FROM TODAY. 5739 04:06:57,000 --> 04:06:59,040 IT'S NOT I'M NOT ATTEMPTING TO 5740 04:06:59,040 --> 04:07:03,280 ACTUALLY SUMMARIZE THE DAY. 5741 04:07:03,280 --> 04:07:05,560 THIS WOULD BE A FOOL'S ERRAND 5742 04:07:05,560 --> 04:07:06,920 BUT SOME OF THE THINGS THAT 5743 04:07:06,920 --> 04:07:08,320 WE'VE HEARD TODAY AND I THINK 5744 04:07:08,320 --> 04:07:11,000 MIGHT GIVE YOU FOOD FOR THOUGHT 5745 04:07:11,000 --> 04:07:13,000 COMING INTO TOMORROW -- 5746 04:07:13,000 --> 04:07:15,120 INCREASING RIGOR IS ABOUT 5747 04:07:15,120 --> 04:07:17,000 CHANGING NORMS AND BEHAVIORS. 5748 04:07:17,000 --> 04:07:18,240 THAT IS WHAT WE'VE HEARD. 5749 04:07:18,240 --> 04:07:22,080 IT'S NOT A SIMPLE CONTAGION. 5750 04:07:22,080 --> 04:07:23,040 IT'S COMPLEX. 5751 04:07:23,040 --> 04:07:24,400 IT HAS A SOCIAL ELEMENT. 5752 04:07:24,400 --> 04:07:31,320 IT FACES RESISTANCE AND -- 5753 04:07:31,320 --> 04:07:32,000 INFLUENCES. 5754 04:07:32,000 --> 04:07:35,480 IT'S IMPORTANT TO APPROACH THIS 5755 04:07:35,480 --> 04:07:38,120 WAS A COORDINATED ATTITUDE. 5756 04:07:38,120 --> 04:07:40,240 THE IMPORTANCE OF BUYING AND 5757 04:07:40,240 --> 04:07:41,760 ENGAGEMENT AND COMMUNITIES AND 5758 04:07:41,760 --> 04:07:43,560 COMMUNITIES OF PRACTICE. 5759 04:07:43,560 --> 04:07:46,000 IN TERMS OF ENGAGEMENT WE'VE 5760 04:07:46,000 --> 04:07:50,160 HEARD THAT INDIVIDUALS CAN HAVE 5761 04:07:50,160 --> 04:07:52,120 BE A VERY GOOD ENTRY POINT FOR 5762 04:07:52,120 --> 04:07:54,680 INDIVIDUALS TO HAVE AN IMMEDIATE 5763 04:07:54,680 --> 04:07:57,000 BENEFIT TO REFLECT UPON TO GET 5764 04:07:57,000 --> 04:07:58,400 ENGAGE WE HAD THAT BUT THEN 5765 04:07:58,400 --> 04:08:02,320 THERE IS THE WHOLE ASPECT OF THE 5766 04:08:02,320 --> 04:08:04,200 COMMUNITY AND IN CONTINUING THIS 5767 04:08:04,200 --> 04:08:12,000 ENGAGEMENT THAT IS IMPORTANT. 5768 04:08:12,000 --> 04:08:13,920 WE'VE HEARD TODAY IN VARIOUS 5769 04:08:13,920 --> 04:08:15,680 FORMS THE IMPORTANCE OF FOCUSING 5770 04:08:15,680 --> 04:08:17,720 ON APPEALING TO VALUES. 5771 04:08:17,720 --> 04:08:19,920 AND I THINK IT'S TRUE FOR 5772 04:08:19,920 --> 04:08:21,640 INSTITUTIONS BUT IT'S ALSO TRUE 5773 04:08:21,640 --> 04:08:24,640 FOR INDIVIDUALS. 5774 04:08:24,640 --> 04:08:27,560 WHO IN THIS ROOM GOT INTO 5775 04:08:27,560 --> 04:08:29,000 SCIENCE SO THAT THEY COULD 5776 04:08:29,000 --> 04:08:31,720 PUBLISH IN SOME SPECIFIC 5777 04:08:31,720 --> 04:08:37,600 JOURNALS. 5778 04:08:37,600 --> 04:08:39,880 [ LAUGHTER ] 5779 04:08:39,880 --> 04:08:42,360 I MEAN THE POINT IS REALLY I 5780 04:08:42,360 --> 04:08:44,080 THINK IT IS -- AND WE ARE 5781 04:08:44,080 --> 04:08:46,360 GETTING INTO SCIENCE BECAUSE WE 5782 04:08:46,360 --> 04:08:49,600 ARE BELIEVING I THINK IN THE 5783 04:08:49,600 --> 04:08:51,320 VALUES AND THE PHILOSOPHY OF 5784 04:08:51,320 --> 04:08:53,920 SCIENCE AND THE NORMS OF SCIENCE 5785 04:08:53,920 --> 04:08:58,280 AND WE DID HEAR VERY IMPORTANT 5786 04:08:58,280 --> 04:08:59,760 MESSAGES ABOUT THE IMPORTANCE OF 5787 04:08:59,760 --> 04:09:01,800 FRAMING OF THESE MESSAGES AS 5788 04:09:01,800 --> 04:09:03,160 WELL. 5789 04:09:03,160 --> 04:09:04,760 APPEALING TO THE VALUE 5790 04:09:04,760 --> 04:09:06,720 FRAMEWORKS BUT ALLOWING THE BEST 5791 04:09:06,720 --> 04:09:08,920 PRACTICES TO BE DEFINED BY THE 5792 04:09:08,920 --> 04:09:12,600 PRACTITIONERS AND NOT BY 5793 04:09:12,600 --> 04:09:14,080 EXTERNAL INFLUENCERS. 5794 04:09:14,080 --> 04:09:17,400 I'M GOING TO QUOTE MY FAVORITE 5795 04:09:17,400 --> 04:09:18,680 SCOTTISH THINKER. 5796 04:09:18,680 --> 04:09:21,400 HOW IS YOUR FIELD REWARDING? 5797 04:09:21,400 --> 04:09:24,960 BEST SCIENCE, EVOLUTION, NOT 5798 04:09:24,960 --> 04:09:27,960 REVOLUTION AND AUDITING FOR 5799 04:09:27,960 --> 04:09:29,120 IMPROVEMENT AND NOT 5800 04:09:29,120 --> 04:09:30,040 ACCOUNTABILITY. 5801 04:09:30,040 --> 04:09:32,000 WE ALSO HEARD FROM RUSS WHO 5802 04:09:32,000 --> 04:09:34,360 JOINED US REMOTELY TO BE AWARE 5803 04:09:34,360 --> 04:09:37,240 OF THE OPEN SCIENCE ZEALOTS AND 5804 04:09:37,240 --> 04:09:41,960 AS A SELF-DEFINED OPEN SCIENCE 5805 04:09:41,960 --> 04:09:43,600 ZEALOT I NEED TO RESPOND. 5806 04:09:43,600 --> 04:09:46,080 OPEN SCIENCE IS EXTREMELY 5807 04:09:46,080 --> 04:09:47,280 IMPORTANT BECAUSE IT'S A 5808 04:09:47,280 --> 04:09:49,280 FRAMEWORK OF VALUES. 5809 04:09:49,280 --> 04:09:52,400 THE OPENNESS IS ACTUALLY WHAT 5810 04:09:52,400 --> 04:09:54,640 DRIVES THE AVAILABILITY OF ALL 5811 04:09:54,640 --> 04:09:57,200 OF THE UNDER PINNINGS OF SCIENCE 5812 04:09:57,200 --> 04:09:58,960 TO BE CRITICIZED. 5813 04:09:58,960 --> 04:10:01,160 IT ALLOWS ORGANIZED SKEPTICISM 5814 04:10:01,160 --> 04:10:03,040 AND ALL OF THESE VALUES AND 5815 04:10:03,040 --> 04:10:04,240 THESE NORMS THAT ARE IMPORTANT 5816 04:10:04,240 --> 04:10:05,560 TO SCIENCE. 5817 04:10:05,560 --> 04:10:07,600 BUT STEVE STARTED TODAY AND HE 5818 04:10:07,600 --> 04:10:10,080 IS RIGHT IS THAT OPENNESS IN 5819 04:10:10,080 --> 04:10:11,800 ITSELF IS NOT SUFFICIENT AND THE 5820 04:10:11,800 --> 04:10:14,040 RIGOR DEFINITIONS ACTUALLY MUCH 5821 04:10:14,040 --> 04:10:15,840 MORE COMPLEX. 5822 04:10:15,840 --> 04:10:20,160 AND SO I THINK ALL OF THAT AND 5823 04:10:20,160 --> 04:10:26,280 IT'S DISCIPLINE SPECIFIC. 5824 04:10:26,280 --> 04:10:28,760 SO I THINK THAT IT'S VERY 5825 04:10:28,760 --> 04:10:30,320 COMPLEX SITUATION THAT WE HAVE 5826 04:10:30,320 --> 04:10:31,560 HAVE AHEAD OF US. 5827 04:10:31,560 --> 04:10:35,760 I THINK OPENNESS IS NUMBER ONE. 5828 04:10:35,760 --> 04:10:38,400 THE PREREQUISITE BUT IT'S NOT 5829 04:10:38,400 --> 04:10:40,480 THAT WE SHOULD STOP THERE. 5830 04:10:40,480 --> 04:10:42,440 I'M GOING TO LEAVE YOU WITH A 5831 04:10:42,440 --> 04:10:44,360 FEW OPEN QUESTIONS TO REFLECT 5832 04:10:44,360 --> 04:10:44,800 OVERNIGHT. 5833 04:10:44,800 --> 04:10:46,680 ONE THAT I HEARD A LOT OF THE 5834 04:10:46,680 --> 04:10:49,440 TENSE TODAY SORT OF WHAT IS THE 5835 04:10:49,440 --> 04:10:52,240 OPTIMAL BALANCE BETWEEN TOP DOWN 5836 04:10:52,240 --> 04:10:53,680 AND BOTTOM UP. 5837 04:10:53,680 --> 04:10:57,120 WE NEED BOTH AND WHERE AND HOW 5838 04:10:57,120 --> 04:10:59,800 CAN PEOPLE WHO ARE DRIVING THESE 5839 04:10:59,800 --> 04:11:01,120 BOTTOM UP APPROACHES? 5840 04:11:01,120 --> 04:11:02,520 AND PEOPLE AT THE TOP WHO'S 5841 04:11:02,520 --> 04:11:03,760 WILLING TO SUPPORT THEM. 5842 04:11:03,760 --> 04:11:05,680 HOW DO THEY INTERACT. 5843 04:11:05,680 --> 04:11:07,760 WHAT IS THE OPTIMAL BALANCE. 5844 04:11:07,760 --> 04:11:09,200 AND THE OTHER QUESTION THAT I 5845 04:11:09,200 --> 04:11:11,880 THINK IS VERY IMPORTANT IS THE 5846 04:11:11,880 --> 04:11:13,880 BALANCE OF THE VALUE FRAMEWORK 5847 04:11:13,880 --> 04:11:16,520 AND THE SPECIFIC BEHAVIORS AND 5848 04:11:16,520 --> 04:11:18,400 PRACTICEs THAT ARE NEEDED IN 5849 04:11:18,400 --> 04:11:20,880 THE FIELD AND WHAT IS AGAIN THIS 5850 04:11:20,880 --> 04:11:21,760 OPTIMAL VALUE? 5851 04:11:21,760 --> 04:11:22,840 THE OTHER THING THAT I WOULD 5852 04:11:22,840 --> 04:11:26,600 LIKE TO ASK YOU TO REFLECT UPON 5853 04:11:26,600 --> 04:11:28,280 AND COME TOMORROW WITH IS 5854 04:11:28,280 --> 04:11:31,920 BASICALLY WHAT WHAT IS -- WHAT 5855 04:11:31,920 --> 04:11:33,520 IS IT GOING TO TAKE FOR US TO 5856 04:11:33,520 --> 04:11:35,280 COME OUT OF THIS ROOM AND 5857 04:11:35,280 --> 04:11:37,920 ACTUALLY HAVE ACTIONABLE THINGS 5858 04:11:37,920 --> 04:11:40,000 TO THINK B. WHAT IS THE NEXT 5859 04:11:40,000 --> 04:11:41,280 STEP FROM THIS CONVERSATION? 5860 04:11:41,280 --> 04:11:43,440 WE HAVE AN INCREDIBLE RICHNESS 5861 04:11:43,440 --> 04:11:45,360 AND DIVERSITY OF PERSPECTIVE IN 5862 04:11:45,360 --> 04:11:45,960 THE ROOM. 5863 04:11:45,960 --> 04:11:48,840 HOW DO WE BUILD ON THAT? 5864 04:11:48,840 --> 04:11:52,080 HOW DO WE GET ACTIONABLE 5865 04:11:52,080 --> 04:11:53,400 INSIGHTS FROM THE DISCUSSION. 5866 04:11:53,400 --> 04:11:55,760 WE HEARD A LOT OF VERY POSITIVE 5867 04:11:55,760 --> 04:11:56,240 THINGS. 5868 04:11:56,240 --> 04:11:57,840 A LOT BEFORE TRAINING AND THINGS 5869 04:11:57,840 --> 04:12:00,440 THAT ARE ACTUALLY TACTICS AND 5870 04:12:00,440 --> 04:12:01,640 APPROACHES TO TRAINING THAT 5871 04:12:01,640 --> 04:12:02,320 WORK. 5872 04:12:02,320 --> 04:12:04,080 WE'VE HEARD THAT THERE ARE 5873 04:12:04,080 --> 04:12:05,480 MOTIVATIONAL ASPECT THAT'S WORK. 5874 04:12:05,480 --> 04:12:08,000 HOW DO WE MAKE THEM WORK? 5875 04:12:08,000 --> 04:12:10,160 WHAT IS IT GOING TO TAKE FOR 5876 04:12:10,160 --> 04:12:11,200 THIS TO BE A COMMUNITY OF 5877 04:12:11,200 --> 04:12:13,680 PRACTICE AND FOR THOSE CHAMPIONS 5878 04:12:13,680 --> 04:12:16,000 TO REALLY CONTINUE -- YOU ARE 5879 04:12:16,000 --> 04:12:17,480 THE CHAMPIONS. 5880 04:12:17,480 --> 04:12:19,400 WHAT ARE YOU GOING TO NEED TO 5881 04:12:19,400 --> 04:12:21,200 CONTINUE THIS WORK STARTING THE 5882 04:12:21,200 --> 04:12:22,400 DAY AFTER TOMORROW. 5883 04:12:22,400 --> 04:12:24,560 SO I WOULD ENCOURAGE TO YOU 5884 04:12:24,560 --> 04:12:26,400 REFLECT ON THAT OVERNIGHT AND WE 5885 04:12:26,400 --> 04:12:29,440 COME BACK TOMORROW REFRESHED AND 5886 04:12:29,440 --> 04:12:31,720 A LITTLE LESS JET LAGGED THAN 5887 04:12:31,720 --> 04:12:33,240 TODAY AND WE'LL CONTINUE THIS 5888 04:12:33,240 --> 04:12:35,560 CONVERSATION AND WE'LL WRAP UP 5889 04:12:35,560 --> 04:12:37,520 WHAT WE HEARD IN THE BREAK OUT 5890 04:12:37,520 --> 04:12:39,240 SESSIONS TOMORROW MORNING AND 5891 04:12:39,240 --> 04:12:40,960 WE'LL START THE DAY AGAIN. 5892 04:12:40,960 --> 04:12:42,480 THANK YOU VERY MUCH FOR THE 5893 04:12:42,480 --> 04:12:44,800 INCREDIBLE RICHNESS AND 5894 04:12:44,800 --> 04:12:47,600 IMPORTANCE OF ALL OF THE 5895 04:12:47,600 --> 04:12:49,160 PERSPECTIVES WE HEARD TODAY AND 5896 04:12:49,160 --> 04:12:50,320 YOUR PARTICIPATION AND HAVE AN 5897 04:12:50,320 --> 04:12:52,600 ENJOYABLE EVENING AND WE'LL SEE 5898 04:12:52,600 --> 04:13:05,960 YOU AGAIN TOMORROW.