1 00:00:05,572 --> 00:03:31,878 CAPTIONS BEGIN IN PROGRESS SHORTLY 2 00:03:31,945 --> 00:03:34,414 MANY YEARS IS ARCHIVED AND THE 3 00:03:34,480 --> 00:03:36,716 LINK IS SHOWN ON THE SLIDE AND 4 00:03:36,783 --> 00:03:45,024 IF YOU HAVE ANY QUESTIONS, 5 00:03:45,091 --> 00:03:48,194 PLEASE GET IN TOUCH NOW WE HAVE 6 00:03:48,261 --> 00:03:53,633 A RATHER SPECIAL ADDITIONAL 7 00:03:53,700 --> 00:03:55,234 EVENT TODAY BECAUSE THE SPEAKERS 8 00:03:55,301 --> 00:04:00,506 ARE GOING TO BE INTRODUCED BY 9 00:04:00,573 --> 00:04:07,981 NINA SHORE WHO IN 2022 WAS 10 00:04:08,047 --> 00:04:09,415 APPOINTED AS THE DEPUTY DIRECTOR 11 00:04:09,482 --> 00:04:11,184 OF THE OFFICE OF INTRAMURAL 12 00:04:11,250 --> 00:04:14,587 RESEARCH AT THE NIH. 13 00:04:14,654 --> 00:04:17,123 NOW THOSE WHO WERE NOT ON THIS 14 00:04:17,190 --> 00:04:18,524 CAMPUS OR EVEN VERY FAMILIAR 15 00:04:18,591 --> 00:04:21,828 WITH IT, YOU MIGHT NOT KNOW THAT 16 00:04:21,894 --> 00:04:23,496 THE MAJORITY OF THE FUNDING, ALL 17 00:04:23,563 --> 00:04:26,532 OF WHICH IS FROM PUBLIC SOURCES, 18 00:04:26,599 --> 00:04:28,735 THE MAJORITY OF FUNDING TO NIH 19 00:04:28,801 --> 00:04:31,871 GOES TO FUND ON A COMPETITIVE 20 00:04:31,938 --> 00:04:34,641 PEER REVIEWED BASIS, RESEARCH 21 00:04:34,707 --> 00:04:36,175 PROPOSALS, FROM INDIVIDUALS AND 22 00:04:36,242 --> 00:04:37,076 INSTITUTIONS THROUGHOUT THE 23 00:04:37,143 --> 00:04:39,579 COUNTRY AND OFTEN THROUGHOUT THE 24 00:04:39,646 --> 00:04:40,380 WORLD. 25 00:04:40,446 --> 00:04:42,482 BUT SOMETHING LIKE ABOUT 9% OF 26 00:04:42,548 --> 00:04:46,386 THE BUDGET IS USED TO SUPPORT 27 00:04:46,452 --> 00:04:48,321 THE INTRAMURAL RESEARCH PROGRAM 28 00:04:48,388 --> 00:04:50,189 WHICH IS BASED HERE AND AT 29 00:04:50,256 --> 00:04:53,760 SEVERAL OTHER CENTERS THROUGHOUT 30 00:04:53,826 --> 00:04:54,427 THE COUNTRY. 31 00:04:54,494 --> 00:05:00,433 NOW, HERE, HERE IS 300-ACRES IN 32 00:05:00,500 --> 00:05:01,501 BETHESDA, MARYLAND, ABOUT 15 33 00:05:01,567 --> 00:05:05,538 MINUTES FROM DOWN TOWN 34 00:05:05,605 --> 00:05:06,239 WASHINGTON. 35 00:05:06,305 --> 00:05:07,106 THERE ARE ABOUT 15,000 PEOPLE 36 00:05:07,173 --> 00:05:11,644 WHO WORK HERE AND THAT INCLUDES 37 00:05:11,711 --> 00:05:17,950 SOMETHING LIKE 1200 PRINCIPAL 38 00:05:18,017 --> 00:05:18,785 INVESTIGATORS AND THEIR 39 00:05:18,851 --> 00:05:20,553 ENTOURAGE, THERE ARE ABOUT 5000 40 00:05:20,620 --> 00:05:22,422 POST DOCTORAL FELLOWS AND 41 00:05:22,488 --> 00:05:24,057 CLINICAL FELLOWS AS WELL AS 42 00:05:24,123 --> 00:05:27,260 MEDICAL STUDENTS WHO ROTATE, 43 00:05:27,326 --> 00:05:28,928 SPEND A YEAR HERE WHILE THEY'RE 44 00:05:28,995 --> 00:05:34,333 IN MEDICAL SCHOOL, THERE ARE 27 45 00:05:34,400 --> 00:05:35,134 INSTITUTES AND CENTERS SO--AND 46 00:05:35,201 --> 00:05:40,073 THIS IS ALSO THE HOME OF THE 47 00:05:40,139 --> 00:05:41,340 WORLD'S LARGEST RESEARCH 48 00:05:41,407 --> 00:05:41,774 HOSPITAL. 49 00:05:41,841 --> 00:05:44,477 PEOPLE ARE ADMITTED ON THE BASIS 50 00:05:44,544 --> 00:05:47,880 OF PROTOCOLS FOR RESEARCH AND 51 00:05:47,947 --> 00:05:49,282 DEVELOPMENT. 52 00:05:49,348 --> 00:05:52,351 I THINK THERE'S 250 BEDS AND A 53 00:05:52,418 --> 00:05:58,291 HUGE NUMBER OF OUT PATIENT 54 00:05:58,357 --> 00:06:01,461 ATTENDEES AND CLINICS AND 55 00:06:01,527 --> 00:06:06,466 DR. SHORE IS RESPONSIBLE FOR 56 00:06:06,532 --> 00:06:08,101 GUIDING THIS ENORMOUS SHIP AND 57 00:06:08,167 --> 00:06:09,035 IT'S A TREMENDOUS 58 00:06:09,102 --> 00:06:09,502 RESPONSIBILITY. 59 00:06:09,569 --> 00:06:13,306 THE MAJOR GOAL OF COURSE IS THAT 60 00:06:13,372 --> 00:06:19,579 OF THE NIH ITSELF, TO DEVELOP, 61 00:06:19,645 --> 00:06:21,013 PROMOTE RESEARCH THAT ADVANCES 62 00:06:21,080 --> 00:06:27,553 OUR UNDERSTANDING OF DISEASE, 63 00:06:27,620 --> 00:06:28,354 MECHANISMS, NEW TREATMENTS, 64 00:06:28,421 --> 00:06:29,222 DIAGNOSIS AND ALL FOR THE 65 00:06:29,288 --> 00:06:32,091 BENEFIT OF THE WORLD'S PUBLIC. 66 00:06:32,158 --> 00:06:36,329 SO WE'RE VERY DELIGHTED THAT 67 00:06:36,395 --> 00:06:43,536 TODAY NINA IS GOING TO INTRODUCE 68 00:06:43,603 --> 00:06:44,670 OUR ASPECTERS WHO WILL TALK TO 69 00:06:44,737 --> 00:06:46,706 US ABOUT 1 OF THE MOST 70 00:06:46,773 --> 00:06:48,007 CHALLENGING AND SEEMINGLY DAILY 71 00:06:48,074 --> 00:06:54,380 CHANGING TOPICS AND THAT IS 72 00:06:54,447 --> 00:06:54,881 ARTIFICIAL INTELLIGENCE. 73 00:06:54,947 --> 00:06:59,519 MAY I HAVE THE NEXT SLIDE, 74 00:06:59,585 --> 00:07:00,887 PLEASE, NO, NEXT 1. 75 00:07:00,953 --> 00:07:01,754 NEXT, PLEASE. 76 00:07:01,821 --> 00:07:02,121 YES. 77 00:07:02,188 --> 00:07:03,890 SO I USUALLY BEGIN THESE 78 00:07:03,956 --> 00:07:05,291 SESSIONS BY WRITING A FEW 79 00:07:05,358 --> 00:07:08,261 QUESTIONS OF THINGS THAT COME TO 80 00:07:08,327 --> 00:07:10,696 MY MIND WHENEVER WE'VE HAD A 81 00:07:10,763 --> 00:07:11,898 SESSION, SO THESE HAVE JUST OFF 82 00:07:11,964 --> 00:07:13,866 THE TOP OF MY HEAD THAT WE'RE 83 00:07:13,933 --> 00:07:14,934 INTERESTED IN, AND THESE ARE 84 00:07:15,001 --> 00:07:18,738 TOPICS THAT I'M SURE WILL BE 85 00:07:18,805 --> 00:07:19,005 DISCUSSED. 86 00:07:19,071 --> 00:07:20,706 HOW WILL AI AFFECT THE PRACTICE 87 00:07:20,773 --> 00:07:24,043 OF MEDICINE IN THE ROLE OF A 88 00:07:24,110 --> 00:07:24,310 PHYSICIAN? 89 00:07:24,377 --> 00:07:25,945 WHO OWNS, WHO REGULATES AI AND 90 00:07:26,012 --> 00:07:29,415 HOW ARE THEY GOING TO DETERMINE 91 00:07:29,482 --> 00:07:29,949 ITS COST. 92 00:07:30,016 --> 00:07:33,052 HOW CAN YOU TELL IF AI WAS USED 93 00:07:33,119 --> 00:07:36,255 TO GENERATE ANY KIND OF A 94 00:07:36,322 --> 00:07:37,323 DOCUMENT? 95 00:07:37,390 --> 00:07:39,192 SHOULD ALL PAPERS INDICATE THAT 96 00:07:39,258 --> 00:07:42,962 AI WAS USED AND IF SO, HOW? 97 00:07:43,029 --> 00:07:47,934 IS IT ETHICAL TO USE AI FOR 98 00:07:48,000 --> 00:07:48,734 PERSONAL, PROFESSIONAL 99 00:07:48,801 --> 00:07:53,973 MANUSCRIPTS, GRANTS, ET CETERA. 100 00:07:54,040 --> 00:07:56,943 AND I WONDER WHETHER ARTIFICIAL 101 00:07:57,009 --> 00:07:58,444 INTELIENCE IN EDUCATION WILL 102 00:07:58,511 --> 00:08:00,880 HAVE A FEEDBACK IN REDUCING OUR 103 00:08:00,947 --> 00:08:01,814 STUDENTS ABILITY TO WRITE IN AND 104 00:08:01,881 --> 00:08:04,717 WHERE DO YOU THINK AI IS 105 00:08:04,784 --> 00:08:04,951 HEADING? 106 00:08:05,017 --> 00:08:09,021 WHAT ARE YOUR FEARS ABOUT AI? 107 00:08:09,088 --> 00:08:12,325 AND WE'RE FORTUNATE TODAY TO 108 00:08:12,391 --> 00:08:14,827 HAVE 2 REMARKABLE INDIVIDUALS 109 00:08:14,894 --> 00:08:17,463 WHOSE POSITION IN THEIR 110 00:08:17,530 --> 00:08:19,065 PROFESSIONAL LIFE PERMITS THEM 111 00:08:19,131 --> 00:08:20,800 TO NOT ONLY WORK AND CONSIDER 112 00:08:20,867 --> 00:08:23,669 THESE ISSUES BUT TO SHARE THEIR 113 00:08:23,736 --> 00:08:24,337 KNOWLEDGE WITH US. 114 00:08:24,403 --> 00:08:30,109 SO MAY I PLEASE INTRODUCE TO YOU 115 00:08:30,176 --> 00:08:31,811 NINA SHORE. 116 00:08:31,878 --> 00:08:42,355 KD--SALLY APPROXIMATE CAUSE 117 00:08:42,722 --> 00:08:44,557 [ APPLAUSE ] 118 00:08:44,624 --> 00:08:46,792 >> THANK YOU, DR. ARIAS, AND 119 00:08:46,859 --> 00:08:48,561 THANKS TO YOU FOR COMING. 120 00:08:48,628 --> 00:08:51,297 IT IS SO WONDERFUL TO SEE REAL 121 00:08:51,364 --> 00:08:53,299 PEOPLE IN REAL SEATS IN THIS 122 00:08:53,366 --> 00:08:54,834 AUDITORIUM AND THANKS TO THOSE 123 00:08:54,901 --> 00:08:56,736 OF YOU WHO ARE TUNING IN ON 124 00:08:56,802 --> 00:08:59,372 VIDEOCAST, WE ARE ALL IN FOR A 125 00:08:59,438 --> 00:09:02,475 REAL TREAT TODAY BECAUSE WE ARE 126 00:09:02,541 --> 00:09:05,778 GOING TO HEAR 2 EXPERTS TALK 127 00:09:05,845 --> 00:09:09,448 WITH US ABOUT AS YOU'VE HEARD A 128 00:09:09,515 --> 00:09:11,851 VERY, VERY CONTROVERSIAL AND 129 00:09:11,918 --> 00:09:12,985 CRITICALLY IMPORTANT TOPIC, THE 130 00:09:13,052 --> 00:09:16,923 NOTION OF THE USE OF AI IN 131 00:09:16,989 --> 00:09:17,523 PUBLICATIONS. 132 00:09:17,590 --> 00:09:21,060 SO AS IS OUR USUAL PRACTICE, WE 133 00:09:21,127 --> 00:09:22,828 HAVE 2 WONDERFUL SPEAKERS TODAY, 134 00:09:22,895 --> 00:09:26,465 OUR FIRST SPEAKER IS DR. HOLDEN 135 00:09:26,532 --> 00:09:28,134 THORP, WHO IS AS MOST OF YOU 136 00:09:28,200 --> 00:09:31,704 KNOW THE CURRENT EDITOR IN CHIEF 137 00:09:31,771 --> 00:09:33,773 OF SCIENCE MAGAZINE. 138 00:09:33,839 --> 00:09:36,175 DR. THORP IS PROFESSOR OF 139 00:09:36,242 --> 00:09:37,443 CHEMISTRY AT GEORGE WASHINGTON 140 00:09:37,510 --> 00:09:39,545 UNIVERSITY AND PRIOR TO HIS 141 00:09:39,612 --> 00:09:42,048 CURRENT POSITIONS, HE WAS THE 142 00:09:42,114 --> 00:09:45,618 TENTH CHANCELLOR OF THE 143 00:09:45,685 --> 00:09:46,953 UNIVERSITY OF NORTH CAROLINA AT 144 00:09:47,019 --> 00:09:48,354 CHAPEL HILL WHERE HE HAD BEEN 145 00:09:48,421 --> 00:09:51,457 THE DEAN OF THE COLLEGE OF ARTS 146 00:09:51,524 --> 00:09:55,061 AND SCIENCES AND A KEENAN 147 00:09:55,127 --> 00:09:56,395 PROFESSOR OF CHEMISTRY. 148 00:09:56,462 --> 00:09:58,464 HIS RESEARCH HAS WON PREOF THE 149 00:09:58,531 --> 00:10:03,936 IEJOUS AWARDS AND FUNDING IN 150 00:10:04,003 --> 00:10:05,638 BOTH ACADEMIA AND INDUSTRY 151 00:10:05,705 --> 00:10:08,307 EMPLOY DR. THORP HOLDS AN 152 00:10:08,374 --> 00:10:09,208 UNDERGRADUATE DEGREE FROM UNC 153 00:10:09,275 --> 00:10:12,912 AND A Ph.D. IN CHEMISTRY FROM 154 00:10:12,979 --> 00:10:13,179 CAL TECH. 155 00:10:13,245 --> 00:10:15,681 HE DID HIS POST DOCTORAL 156 00:10:15,748 --> 00:10:21,187 TRAINING AT YALE UNIVERSITY. 157 00:10:21,253 --> 00:10:22,254 A MULTITALENTED SCHOLAR, HE IS 158 00:10:22,321 --> 00:10:24,156 ALSO A MASTER GUITARIST WHO 159 00:10:24,223 --> 00:10:25,424 STUDIED AT BERKELEY COLLEGE OF 160 00:10:25,491 --> 00:10:34,800 MUSIC AND A MUCH AWARDED RUBICS 161 00:10:34,867 --> 00:10:35,601 CUBE OFFICKIANAD O. 162 00:10:35,668 --> 00:10:42,408 OUR NEXT SPEAKER IS DR. VARDIT 163 00:10:42,475 --> 00:10:42,675 RSVITSKY. 164 00:10:42,742 --> 00:10:44,176 SHE'S WITH THE HASTINGS CENTER, 165 00:10:44,243 --> 00:10:46,045 SHE IS PROFESSOR THEA THE 166 00:10:46,112 --> 00:10:48,514 UNIVERSITY OF MONTREAL AND A 167 00:10:48,581 --> 00:10:51,617 SENIOR LECTURE ON GLOBAL HEALTH 168 00:10:51,684 --> 00:10:54,286 AND SOCIAL MEDICINE AT HARVARD 169 00:10:54,353 --> 00:10:56,989 MEDICAL SCHOOL. 170 00:10:57,056 --> 00:10:58,724 SHE IS IMMEDIATE PAST PRESIDENT 171 00:10:58,791 --> 00:11:01,093 AND CURRENT VICE PRESIDENT OF 172 00:11:01,160 --> 00:11:02,762 THE INTERNATIONAL ASSOCIATION OF 173 00:11:02,828 --> 00:11:05,398 BIOETHICS AND THE DIRECTOR OF 174 00:11:05,464 --> 00:11:08,067 ETHICS AND HEALTH AT THE CENTER 175 00:11:08,134 --> 00:11:09,835 FOR RESEARCH ON ETHICS. 176 00:11:09,902 --> 00:11:15,307 HE'S A FELLOW OF THE PEER 177 00:11:15,374 --> 00:11:16,375 ELLIOTT TRUDEAU FOUNDATION WHERE 178 00:11:16,442 --> 00:11:19,011 SHE CHAIRED THE COVID-19 IMPACT 179 00:11:19,078 --> 00:11:24,884 COMMITTEE AND A FELLOW OF THE 180 00:11:24,950 --> 00:11:27,820 HASTINGS CENTER. 181 00:11:27,887 --> 00:11:30,456 DR. RAVITSKY HAS BEEN AWARDED A 182 00:11:30,523 --> 00:11:33,459 Mc CONNELL UNIVERSITY OF 183 00:11:33,526 --> 00:11:34,293 MONTREAL RESEARCH CHAIR AWARD 184 00:11:34,360 --> 00:11:37,797 AND IS THE LEAD CENTER OF 185 00:11:37,863 --> 00:11:39,131 PENN CENTER GUIDE TO BIOETHICS. 186 00:11:39,198 --> 00:11:41,300 SHE'S REALLY HERE TODAY BECAUSE 187 00:11:41,367 --> 00:11:46,839 HER RESEARCH HAS FOCUSED ON 188 00:11:46,906 --> 00:11:52,378 BIOETHICS ASPECTS OF DISRUPTIVE 189 00:11:52,445 --> 00:11:53,813 TECHNOLOGIES AND THE DISRUPTIVE 190 00:11:53,879 --> 00:11:59,385 TECHNOLOGY FOR THIS ERA IS 191 00:11:59,452 --> 00:12:04,323 WITHOUT A DOUBT AI AND LANGUAGE 192 00:12:04,390 --> 00:12:04,790 MODELS. 193 00:12:04,857 --> 00:12:07,593 DR. RAVITSKY HOLDS A BACHELOR'S 194 00:12:07,660 --> 00:12:11,997 DEGREE IN PHILOSOPHY, AND A 195 00:12:12,064 --> 00:12:12,998 MASTER'S DEGREE OF PHILOSOPHY 196 00:12:13,065 --> 00:12:14,767 FROM THE UNIVERSITY OF NEW 197 00:12:14,834 --> 00:12:15,067 MEXICO. 198 00:12:15,134 --> 00:12:18,304 SHE COMPLETED HER Ph.D. IN 199 00:12:18,370 --> 00:12:21,307 PHILOSOPHY, WITH A 200 00:12:21,373 --> 00:12:22,475 SPECIALIZATION IN BIOETHICS AT 201 00:12:22,541 --> 00:12:23,542 [INDISCERNIBLE] UNIVERSITY IN 202 00:12:23,609 --> 00:12:25,544 ISRAEL AND WAS A POST DOCTORAL 203 00:12:25,611 --> 00:12:29,315 FELLOW AT THE DEPARTMENT OF 204 00:12:29,381 --> 00:12:31,517 CLINICAL BIOETHICS, RIGHT HERE 205 00:12:31,584 --> 00:12:35,187 AT THE NIH IN THE SOCIAL AND 206 00:12:35,254 --> 00:12:37,289 BEHAVIORIAL RESEARCH BRANCH OF 207 00:12:37,356 --> 00:12:40,626 NHGRI, SO WITHOUT FURTHER ADO, I 208 00:12:40,693 --> 00:12:43,295 AM GOING TO TURN THE PODIUM OVER 209 00:12:43,362 --> 00:12:43,963 TO DR. THORP. 210 00:12:44,029 --> 00:12:54,406 THANK YOU FOR BEING WITH US. 211 00:12:54,473 --> 00:12:58,310 [ APPLAUSE ] 212 00:12:58,377 --> 00:12:59,778 >> THANK YOU NINA AND HELLO 213 00:12:59,845 --> 00:13:02,648 INTERNET AND IT'S AN HONOR 214 00:13:02,715 --> 00:13:04,950 THANKFUL FOR YOU INCLUDING ME 215 00:13:05,017 --> 00:13:06,218 FOR THIS IMPORTANT PROGRAM AND 216 00:13:06,285 --> 00:13:08,654 ALWAYS GOOD TO BE AROUND 217 00:13:08,721 --> 00:13:10,823 DR. ARIAS AND THANK YOU FOR ALL 218 00:13:10,890 --> 00:13:13,759 YOU'VE DONE AND YOU TOO, NINA, 219 00:13:13,826 --> 00:13:14,793 THESE THINGS, MANAGING THEM IS 220 00:13:14,860 --> 00:13:15,194 NOT EASY. 221 00:13:15,261 --> 00:13:16,962 I KNOW A BIT ABOUT THAT, THANK 222 00:13:17,029 --> 00:13:18,597 YOU FOR STEPPING UP AND DOING 223 00:13:18,664 --> 00:13:19,899 THIS FOR ALL OF US. 224 00:13:19,965 --> 00:13:21,467 SO LET ME JUST ADD A COUPLE 225 00:13:21,534 --> 00:13:23,969 THINGS ABOUT THE INTRODUCTION, 226 00:13:24,036 --> 00:13:27,039 SINCE THERE ARE SOME YOUNGER 227 00:13:27,106 --> 00:13:27,840 SCIENTISTS HERE AND PROBABLY 228 00:13:27,907 --> 00:13:29,808 MANY MORE ON THE SCREEN, SO I 229 00:13:29,875 --> 00:13:33,479 DID DO ALL THOSE EXCITING THINGS 230 00:13:33,546 --> 00:13:34,914 BUT IT WASN'T A STRAIGHT LINE, 231 00:13:34,980 --> 00:13:37,816 WHEN I WAS A CHANCELLOR AT THE 232 00:13:37,883 --> 00:13:39,518 UNIVERSITY OF NORTH CAROLINA, I 233 00:13:39,585 --> 00:13:44,857 HAD AN IMMENSE AMOUNT OF TROUBLE 234 00:13:44,924 --> 00:13:46,025 BECAUSE MY SIDE LOST AN 235 00:13:46,091 --> 00:13:48,194 CERTAINLY--CERTAINLY LEKS AND I 236 00:13:48,260 --> 00:13:49,728 DISCOVERED AN AUTHENTICS SCANDAL 237 00:13:49,795 --> 00:13:51,463 AT THE SAME TIME AND I WAS NOT 238 00:13:51,530 --> 00:13:52,831 ABLE TO RESOLVE THOSE COMPLETELY 239 00:13:52,898 --> 00:13:53,766 EVEN THOUGH THE SCALPEDDAL 240 00:13:53,832 --> 00:13:55,000 STARTED WHEN I WAS IN MIDDLE 241 00:13:55,067 --> 00:13:56,735 SCHOOL, I WAS STILL IN CHARGE 242 00:13:56,802 --> 00:13:58,504 WHEN IT CAME TO LIGHT, SO I LEFT 243 00:13:58,571 --> 00:14:00,339 CHAPEL HILL AND WENT TO 244 00:14:00,406 --> 00:14:01,607 WASHINGTON UNIVERSITY IN 245 00:14:01,674 --> 00:14:03,842 ST. LOUIS WHERE I WAS A PROVOST 246 00:14:03,909 --> 00:14:06,245 AND I HAD A GREAT TIME. 247 00:14:06,312 --> 00:14:10,282 AND I WAS A RUBICS CUBE CHAMPION 248 00:14:10,349 --> 00:14:12,184 IN THE 1980S WHICH IS A VERY 249 00:14:12,251 --> 00:14:13,953 DIFFERENT THING BUT BEING A 250 00:14:14,019 --> 00:14:15,054 RUBIC CUBE CHAMPION NOW BECAUSE 251 00:14:15,120 --> 00:14:17,323 WE WERE EXCITED WHEN WE COULD DO 252 00:14:17,389 --> 00:14:23,229 THE 3 BY 3 IN MAYBE, 30-SECONDS. 253 00:14:23,295 --> 00:14:25,965 NOW, EXCELLENT TIME WOULD BE 254 00:14:26,031 --> 00:14:26,232 5-SECONDS. 255 00:14:26,298 --> 00:14:28,634 SO WHEN I MEET THESE YOUNG KIDS 256 00:14:28,701 --> 00:14:31,103 WHO ARE DOING THIS, SOME OF THEM 257 00:14:31,170 --> 00:14:32,104 THEY'VE STUDIED THE HISTORY AND 258 00:14:32,171 --> 00:14:34,740 THEY'VE HEARD OF ME AND THEY'LL 259 00:14:34,807 --> 00:14:35,808 SAY SOMETHING LIKE YOU'RE 1 OF 260 00:14:35,874 --> 00:14:37,443 THOSE OLD GUYS FROM THE 80S 261 00:14:37,509 --> 00:14:39,211 AFTER THEY STUDY ME AND I SAY 262 00:14:39,278 --> 00:14:40,279 YES, THAT'S CORRECT, I CAN'T DO 263 00:14:40,346 --> 00:14:40,980 WHAT DO YOU. 264 00:14:41,046 --> 00:14:42,147 AND YOU MIGHT ALSO NOTICE THAT 265 00:14:42,214 --> 00:14:44,583 MY HAND MOVE AMS ARE A LITTLE 266 00:14:44,650 --> 00:14:47,786 AWKWARD AND THAT I HAVE A HARD 267 00:14:47,853 --> 00:14:50,623 TIME MODULATING MY VOCAL TONE 268 00:14:50,689 --> 00:14:52,925 AND THAT'S BECAUSE I'M ON THE 269 00:14:52,992 --> 00:14:53,425 AUTISM SPECTRUM. 270 00:14:53,492 --> 00:14:55,527 SO RATHER THAN BEING 271 00:14:55,594 --> 00:14:56,362 SELF-CONSCIOUS ABOUT MODULATING 272 00:14:56,428 --> 00:14:58,697 MY VOCAL TOWN, I WILL FOCUS ON 273 00:14:58,764 --> 00:15:00,933 THE CONTENT INSTEAD, WE NEED 274 00:15:01,000 --> 00:15:01,734 MORE NEURODIVERSITY IN SCIENCE 275 00:15:01,800 --> 00:15:05,904 AND I'M PROUD TO HELP ADVOCATE 276 00:15:05,971 --> 00:15:08,307 FOR THAT, WE CAN TALK ABOUT THAT 277 00:15:08,374 --> 00:15:09,275 LATER WITH QUESTIONS IF YOU WANT 278 00:15:09,341 --> 00:15:11,277 BUT IN THE MEAN TIME, I HAVE THE 279 00:15:11,343 --> 00:15:13,012 BEST JOB IN ALL OF SCIENCE 280 00:15:13,078 --> 00:15:14,680 BECAUSE RUNNING SCIENCE 281 00:15:14,747 --> 00:15:17,283 MAGAZINE, ALLOWS ME TO DO 3 282 00:15:17,349 --> 00:15:19,385 THINGS, ANY OF WHICH WOULD BE 283 00:15:19,451 --> 00:15:24,623 REALLY EXCITING ON THEIR OWN. 284 00:15:24,690 --> 00:15:26,292 I'M IN CHARGE OF HANDLING 285 00:15:26,358 --> 00:15:27,626 RESEARCH PAPERS AND I WORK WITH 286 00:15:27,693 --> 00:15:29,161 SOME OF THE SMARTEST PEOPLE IN 287 00:15:29,228 --> 00:15:37,903 ALL OF SCIENCE WHO HANDLE OUR 288 00:15:37,970 --> 00:15:39,038 PAPERS, THEY SEE--HERE'S 1 HERE, 289 00:15:39,104 --> 00:15:40,406 I DIDN'T KNOW [INDISCERNIBLE] IS 290 00:15:40,472 --> 00:15:41,874 GOING TO BE HERE, SO THE PERSON 291 00:15:41,940 --> 00:15:44,176 WHO ACTUALLY DOES ALL THE WORK 292 00:15:44,243 --> 00:15:47,379 DOES ALL THE WORK IS HERE. 293 00:15:47,446 --> 00:15:49,748 THIS IS VALL DEVINCENTURE OUR 294 00:15:49,815 --> 00:15:50,349 EXECUTIVE EDITOR. 295 00:15:50,416 --> 00:15:52,251 THE PEOPLE I WORK WITH ARE SOME 296 00:15:52,318 --> 00:15:53,952 OF THE SMARTEST PEOPLE I'VE EVER 297 00:15:54,019 --> 00:15:55,821 WORKED WITH AT ANY INSTITUTION, 298 00:15:55,888 --> 00:15:57,523 THEY KNOW MORE ABOUT SCIENCE 299 00:15:57,589 --> 00:15:59,158 THAN ANYBODY I'VE EVER ACTED 300 00:15:59,224 --> 00:16:00,359 WITH AND THEY WORK EXTREMELY 301 00:16:00,426 --> 00:16:03,996 HARD TO MAKE HUR THAT OUR PAPERS 302 00:16:04,063 --> 00:16:12,204 ARE ACCURATE AND HANDLED FAIRLY 303 00:16:12,271 --> 00:16:14,073 AND IT'S JUST A JOY TO DO GREAT 304 00:16:14,139 --> 00:16:15,674 WORK AND WORK WITH THEM EVERY 305 00:16:15,741 --> 00:16:15,841 DAY. 306 00:16:15,908 --> 00:16:18,077 I ALSO WORK IN THE NEWS 307 00:16:18,143 --> 00:16:18,644 DEPARTMENT, THE SCIENCE 308 00:16:18,711 --> 00:16:20,412 DEPARTMENT HAS THE LARGEST 309 00:16:20,479 --> 00:16:22,348 CONSCIENCE NEWS DIVISION LEFT, 310 00:16:22,414 --> 00:16:23,982 IT'S A TOUGH TIME FOR 311 00:16:24,049 --> 00:16:25,351 YOWRNALLISM AND WE'RE STILL 1 OF 312 00:16:25,417 --> 00:16:27,319 THE FEW PLACES THAT CAN STILL DO 313 00:16:27,386 --> 00:16:28,520 SCIENCE NEWS AT THE SCALE WE DO 314 00:16:28,587 --> 00:16:28,687 IT. 315 00:16:28,754 --> 00:16:30,622 THE WAY IT WORKS WITH NEWS IS 316 00:16:30,689 --> 00:16:32,024 I'M THE BOSS BUT I DON'T GET TO 317 00:16:32,091 --> 00:16:35,394 TELL THEM WHAT TO DO, THAT'S THE 318 00:16:35,461 --> 00:16:40,132 WAY JOURNALISM WORKS IN AMERICA. 319 00:16:40,199 --> 00:16:40,799 THEY'RE EDITORIALLY INDEPENDENT, 320 00:16:40,866 --> 00:16:42,501 WHICH MEANS I CAN TELL THEM 321 00:16:42,568 --> 00:16:44,670 THINGS, THEY USUALLY DON'T TELL 322 00:16:44,737 --> 00:16:47,072 ME STUFF, I DON'T SEE THEIR 323 00:16:47,139 --> 00:16:50,275 STORIES UNTIL THEY GET POSTED, 324 00:16:50,342 --> 00:16:53,112 BUT IF THEY MAKE A MISTAKE OR 325 00:16:53,178 --> 00:16:55,214 HAVE SOME OTHER PROBLEM, I'M THE 326 00:16:55,280 --> 00:16:56,415 1 WHO HAS TO HELP THEM FIGURE 327 00:16:56,482 --> 00:16:57,983 OUT WHAT TO DO WITH ABOUT IT. 328 00:16:58,050 --> 00:16:59,218 BUT IT'S A YOI TO DO THAT 329 00:16:59,284 --> 00:17:01,153 BECAUSE THE WO, THEY DO IS 330 00:17:01,220 --> 00:17:01,453 OUTSTANDING. 331 00:17:01,520 --> 00:17:02,554 AND THEN WE ALSO HAVE THE 332 00:17:02,621 --> 00:17:04,423 COMMENTARY SECTION OF THE 333 00:17:04,490 --> 00:17:06,325 YOWRNAL WHERE I USUALLY WRITE MY 334 00:17:06,392 --> 00:17:08,394 EDITORIAL A COUPLE TIMES A 335 00:17:08,460 --> 00:17:09,762 MONTH, SOMETIMES PEOPLE IN 336 00:17:09,828 --> 00:17:11,764 BUILDING 1 ARE NOT THRILLED WITH 337 00:17:11,830 --> 00:17:14,099 MY EDITORIALS BUT THAT'S THE WAY 338 00:17:14,166 --> 00:17:15,300 YOWRNALLISM WORKS AND SOMETIMES 339 00:17:15,367 --> 00:17:16,769 THEY'RE HAPPY WHEN THEY DO 340 00:17:16,835 --> 00:17:19,304 SOMETHING I THINK IS REALLY 341 00:17:19,371 --> 00:17:20,105 GOOD. 342 00:17:20,172 --> 00:17:21,874 SO, I MONITORED THE NEWS IN 343 00:17:21,940 --> 00:17:24,610 SCIENCE AND TALK ABOUT IT VERY 344 00:17:24,676 --> 00:17:26,011 DIFFERENT ASPECTS OF IT AND I 345 00:17:26,078 --> 00:17:27,880 ALWAYS SAY TO PEOPLE WHEN THEY 346 00:17:27,946 --> 00:17:29,648 ASK ME, WHAT'S IT LIKE TO WRITE 347 00:17:29,715 --> 00:17:31,383 A COLUMN EVERY 2 WEEKS, YOU KNOW 348 00:17:31,450 --> 00:17:33,819 HOW DO YOU COME UP WITH THINGS, 349 00:17:33,886 --> 00:17:35,821 I SAY, I DON'T KNOW, YOU DO HAVE 350 00:17:35,888 --> 00:17:37,890 ANY IDEAS FOR NEXT WEEK BECAUSE 351 00:17:37,956 --> 00:17:39,425 EVERY 2 WEEKS I TRY TO COME UP 352 00:17:39,491 --> 00:17:41,960 WITH SOMETHING BUT I WORK WITH 353 00:17:42,027 --> 00:17:43,896 AN OUTSTANDING EDITOR WHO MAKES 354 00:17:43,962 --> 00:17:45,664 ME SOUND REALLY GOOD AND THAT'S 355 00:17:45,731 --> 00:17:47,566 A REAL PRIVILEGE AND SHE RUNS 356 00:17:47,633 --> 00:17:49,568 THE REST OF OUR COMMENTARY 357 00:17:49,635 --> 00:17:51,370 SECTION WHICH I ENJOY IMMENSELY. 358 00:17:51,437 --> 00:17:53,071 SO I WANT TO TALK ABOUT THE 359 00:17:53,138 --> 00:18:00,979 CONTEXT IN WHICH AI HAS KIND OF 360 00:18:01,046 --> 00:18:01,780 COMING TO US. 361 00:18:01,847 --> 00:18:03,081 AND I'M MOSTLY GOING TO TALK 362 00:18:03,148 --> 00:18:04,516 ABOUT USING AI AND PAPERS. 363 00:18:04,583 --> 00:18:06,752 I WILL NOT TALK ABOUT USING AI 364 00:18:06,819 --> 00:18:08,020 AND RESEARCH, THERE'S AMAZING 365 00:18:08,086 --> 00:18:10,823 THINGS GOING ON WITH AI AND 366 00:18:10,889 --> 00:18:17,996 RESEARCH, ESPECIALLY IN PROTEIN 367 00:18:18,063 --> 00:18:19,832 FOLDING AND MATERIAL SCIENCE AND 368 00:18:19,898 --> 00:18:20,966 OF COURSE HELPING PEOPLE CODE 369 00:18:21,033 --> 00:18:25,404 WHICH IS PART OF RESEARCH FOR 370 00:18:25,471 --> 00:18:25,737 SURE. 371 00:18:25,804 --> 00:18:27,773 AND THIS STUFF HAS BEEN GOING 372 00:18:27,840 --> 00:18:32,010 LONG BEFORE THIS KIND OF CRAZY 373 00:18:32,077 --> 00:18:32,444 EXPLOSION HAPPENED. 374 00:18:32,511 --> 00:18:34,446 SO I'M GOING TO FOCUS ON WHAT IT 375 00:18:34,513 --> 00:18:36,548 MEANS THAT AI IS HERE AND WE'RE 376 00:18:36,615 --> 00:18:37,950 TRYING TO PUBLISH JOURNALS AND 377 00:18:38,016 --> 00:18:40,018 HOW WE KIND OF SEE THIS PLAYING 378 00:18:40,085 --> 00:18:41,887 OUT, SO OF COURSE, WE'RE LIVING 379 00:18:41,954 --> 00:18:44,556 THROUGH A TIME WHEN TRUST IN 380 00:18:44,623 --> 00:18:47,292 SCIENCE IS BEING QUESTIONED, THE 381 00:18:47,359 --> 00:18:49,228 GOOD NEWS IS THAT TRUST IN 382 00:18:49,294 --> 00:18:52,865 CONSCIENCE IS ACTUALLY STILL 383 00:18:52,931 --> 00:18:56,068 PRETTY HIGH, 77% OF THE COUNTRY 384 00:18:56,134 --> 00:18:57,135 HAS CONFIDENCE THAT SCIENCE ACTS 385 00:18:57,202 --> 00:18:58,670 IN THE BEST INTEREST OF THE 386 00:18:58,737 --> 00:19:00,305 PUBLIC, AND WE'RE DOING A WHOLE 387 00:19:00,372 --> 00:19:02,374 LOT BETTER THAN ELECTED 388 00:19:02,441 --> 00:19:06,411 OFFICIALS, BUSINESS LEADERS 389 00:19:06,478 --> 00:19:07,446 JOURNALISTS, BUT SCIENCE, 390 00:19:07,513 --> 00:19:09,281 THERE'S A PARTIS AN DIVIDE WHEN 391 00:19:09,348 --> 00:19:10,482 IT COMES TO WEATHER SCIENCE 392 00:19:10,549 --> 00:19:12,384 SHOULD BE INVOLVED IN HELPING TO 393 00:19:12,451 --> 00:19:14,887 IMPLEMENT SCIENCE POLICY, SO 394 00:19:14,953 --> 00:19:15,954 CONSERVATIVES TEND TO BELIEVE 395 00:19:16,021 --> 00:19:19,424 MORE THAT WE SHOULD JUST CREATE 396 00:19:19,491 --> 00:19:20,259 EXCELLENT SCIENTIFIC INFORMATION 397 00:19:20,325 --> 00:19:23,128 AND LET THEM DECIDE WHAT TO DO 398 00:19:23,195 --> 00:19:25,330 WITH IT AND LIBERALS ARE MORE 399 00:19:25,397 --> 00:19:26,999 OPEN TO THE IDEA TAKEN--THEY WE 400 00:19:27,065 --> 00:19:28,033 SHOULD BE INVOLVED IN HELPING 401 00:19:28,100 --> 00:19:34,606 THEM AND I THINK THIS PARTIS AN 402 00:19:34,673 --> 00:19:35,807 DIVIDE REALLY EXPLAINS A LOT OF 403 00:19:35,874 --> 00:19:37,643 THINGS THAT WE'RE SEEING. 404 00:19:37,709 --> 00:19:40,979 THERE IS A MODEST DROP IN 405 00:19:41,046 --> 00:19:44,716 CONFIDENCE IN SCIENCE AS YOU CAN 406 00:19:44,783 --> 00:19:45,851 SEE IN THIS DIAGRAM BUT IT'S 407 00:19:45,918 --> 00:19:49,788 ABOUT THE SAME AS THE DROP IN 408 00:19:49,855 --> 00:19:50,789 EVERY OTHER INSTITUTION. 409 00:19:50,856 --> 00:19:52,791 SO WE'RE SEEING OVER THE LAST 4 410 00:19:52,858 --> 00:19:54,893 OR 5 YEARS, EVEN RELIGIOUS 411 00:19:54,960 --> 00:19:56,194 LEADERS AND THE MILITARY ARE 412 00:19:56,261 --> 00:19:59,565 SEEING A SLIGHT EROSION IN 413 00:19:59,631 --> 00:20:01,400 TRUST, BUT AND TRUST IN SCIENCE 414 00:20:01,466 --> 00:20:06,038 AS FALLEN OFF ABOUT THE SAME 415 00:20:06,104 --> 00:20:08,941 AMOUNT AND THIS LATEST POLL, 416 00:20:09,007 --> 00:20:10,242 TRUSTED ELECTED OFFICIALS WAS 417 00:20:10,309 --> 00:20:10,776 24%. 418 00:20:10,842 --> 00:20:11,677 SO THAT'S FALLEN THE MOST. 419 00:20:11,743 --> 00:20:13,979 NOW WE ALSO HAVE A WHOLE LOT OF 420 00:20:14,046 --> 00:20:16,214 STUFF GOING ON AROUND SCIENTIFIC 421 00:20:16,281 --> 00:20:17,849 INTEGRITY, AND AGAIN, AI IS 422 00:20:17,916 --> 00:20:19,451 COMING IN THIS MOMENT WHEN 423 00:20:19,518 --> 00:20:22,220 PEOPLE ARE ASKING QUESTIONS 424 00:20:22,287 --> 00:20:23,488 ABOUT WHETHER WE'RE DOING A GOOD 425 00:20:23,555 --> 00:20:28,026 JOB OF TAKING CARE OF THE 426 00:20:28,093 --> 00:20:28,427 SCIENTIFIC RECORD. 427 00:20:28,493 --> 00:20:31,229 THE THING THAT KIND OF KICKED 428 00:20:31,296 --> 00:20:33,098 THIS MOMENT OFF IN THE MEDIA WAS 429 00:20:33,165 --> 00:20:35,534 THE SITUATION AT STANFORD 430 00:20:35,601 --> 00:20:36,335 UNIVERSITY WHERE MARK 431 00:20:36,401 --> 00:20:38,136 [INDISCERNIBLE] WHO WAS THE 432 00:20:38,203 --> 00:20:39,738 PRESIDENT HAD A SITUATION THAT'S 433 00:20:39,805 --> 00:20:42,841 VERY COMMON THAT WE SEE QUITE 434 00:20:42,908 --> 00:20:44,576 FREQUENTLY WHERE THERE WERE SOME 435 00:20:44,643 --> 00:20:46,111 IMAGES IN SOME PAPERS IN HIS LAB 436 00:20:46,178 --> 00:20:49,181 WHEN HE HAD A VERY LARGE LAB WAS 437 00:20:49,247 --> 00:20:50,616 WAS DOING A LOT OF OTHER STUFF 438 00:20:50,682 --> 00:20:52,551 THAT HE DIDN'T CATCH WHEN THEY 439 00:20:52,618 --> 00:20:56,955 PUBLISHED IT AND THEN LATER SLEW 440 00:20:57,022 --> 00:20:59,858 SOME PEOPLE ON PUB PIER, EXPOSED 441 00:20:59,925 --> 00:21:03,528 THESE IMAGES AS HAVING BEEN 442 00:21:03,595 --> 00:21:06,732 MANIPULATED AND UNFORTUNATELY 443 00:21:06,798 --> 00:21:11,069 WHAT HAPPENS FREQUENTLY IN THESE 444 00:21:11,136 --> 00:21:13,405 CASES IS THAT THEN RATHER THAN 445 00:21:13,472 --> 00:21:14,339 SOMEBODY SAYING I CAN BE THE 446 00:21:14,406 --> 00:21:16,541 BELIEVE I MISSED THAT AND 447 00:21:16,608 --> 00:21:17,275 STRAIGHTENING THE WHOLE THING 448 00:21:17,342 --> 00:21:19,077 OUT, A LOT OF DRAMA ENSUED AND 449 00:21:19,144 --> 00:21:21,613 THIS IS VERY, VERY GOOD FOR THE 450 00:21:21,680 --> 00:21:22,214 INVESTIGATIVE YOWRNALLISTS. 451 00:21:22,280 --> 00:21:23,515 BECAUSE AS LONG AS THE 452 00:21:23,582 --> 00:21:26,818 INSTITUTIONS AND THE PI ARE YOU 453 00:21:26,885 --> 00:21:27,986 KNOW BEING DEFENSIVE AND 454 00:21:28,053 --> 00:21:28,854 THROWING UP ROAD BLOCKS IN 455 00:21:28,920 --> 00:21:30,689 EMERGING ITS OF GETTING 456 00:21:30,756 --> 00:21:32,257 INFORMATION AND NOT TALKING TO 457 00:21:32,324 --> 00:21:33,792 REPORTERS, THAT'S JUST AN 458 00:21:33,859 --> 00:21:34,926 INVITATION FOR THE NATIONAL 459 00:21:34,993 --> 00:21:35,761 NEWSPAPERS TO CONTINUE TO WRITE 460 00:21:35,827 --> 00:21:38,630 ABOUT THIS AND IF THEY HAPPEN TO 461 00:21:38,697 --> 00:21:42,634 BE AT A RITZY INTUITION LIKE 462 00:21:42,701 --> 00:21:44,503 STANFORD OR HARVARD WHERE A LOT 463 00:21:44,569 --> 00:21:48,040 THESE THINGS PLAYED OUT, BECAUSE 464 00:21:48,106 --> 00:21:51,309 MOST PEOPLE WHO WORK AT THE 465 00:21:51,376 --> 00:21:53,478 NEW YORK TIMES AND WASHINGTON 466 00:21:53,545 --> 00:21:56,581 POST WENT TO THOSE SCHOOLS, THEY 467 00:21:56,648 --> 00:22:00,185 LIKE TO DO IS PUT THE TICK TOCK, 468 00:22:00,252 --> 00:22:02,154 NOT TIKTOK, THE APP BUT TICK 469 00:22:02,220 --> 00:22:05,357 TOCK WITH SEASON TO WITH WORDS 470 00:22:05,424 --> 00:22:06,758 TO BUILD UP TENSION TO MAKE 471 00:22:06,825 --> 00:22:11,029 PEOPLE RESIGN OR HAVE TO 472 00:22:11,096 --> 00:22:13,198 DO--HAVE THEIR CAREERS CAREERSD 473 00:22:13,265 --> 00:22:13,498 IN SOME WAY. 474 00:22:13,565 --> 00:22:15,934 OUR VIEW IS WE DON'T NEED ALL 475 00:22:16,001 --> 00:22:19,705 THAT DRAMA, WE WOULD BE HAPPY TO 476 00:22:19,771 --> 00:22:20,939 CORRECT AND RETRACT PAPERS 477 00:22:21,006 --> 00:22:21,506 WHENEVER WE'RE ASKED. 478 00:22:21,573 --> 00:22:24,943 ONE OF THE THINGS THAT WE'RE 479 00:22:25,010 --> 00:22:26,578 DOING, VALL HAS DONE MOST OF THE 480 00:22:26,645 --> 00:22:28,647 WORK ON THIS BUT WE'VE LAUNCHED 481 00:22:28,714 --> 00:22:31,450 AN EFFORT WHERE WE USE THE 482 00:22:31,516 --> 00:22:36,621 PROGRAM PROOF FIG TO FIND ALL 483 00:22:36,688 --> 00:22:37,556 IMAGES AND WE'RE GOING TO TELL 484 00:22:37,622 --> 00:22:39,591 YOU WHY IT'S UNLIKELY WE WILL 485 00:22:39,658 --> 00:22:41,093 POLICE OURSELVES OUT OF THIS 486 00:22:41,159 --> 00:22:42,127 PROBLEM, EVEN AT SCIENCE WHERE 487 00:22:42,194 --> 00:22:47,165 WE ARE VERY SELECTIVE, WE SCREEN 488 00:22:47,232 --> 00:22:50,135 300 PAPERS WITH PROOFIG, BEFORE 489 00:22:50,202 --> 00:22:51,970 WE,A NOUNSED WE WERE DOING IT 490 00:22:52,037 --> 00:22:53,171 AND WE FOUND 10 THAT WERE 491 00:22:53,238 --> 00:22:54,673 PROBLEMATIC AND THIS WAS TOWARDS 492 00:22:54,740 --> 00:22:58,910 THE END WHEN THEY WERE COMING 493 00:22:58,977 --> 00:23:00,078 BACK FROM REVISION: EIGHT OF 494 00:23:00,145 --> 00:23:01,813 THEM HAD PROBLEMS THAT WE FELT 495 00:23:01,880 --> 00:23:02,547 HAD REASONABLE EXPLANATIONS THAT 496 00:23:02,614 --> 00:23:05,450 COULD BE WORKED OUT AND 2 WE HAD 497 00:23:05,517 --> 00:23:07,018 TO TELL THE AUTHORS THAT WE 498 00:23:07,085 --> 00:23:08,620 WEREN'T GOING TO PUBLISH THEIR 499 00:23:08,687 --> 00:23:09,321 PAPER, RIGHT? 500 00:23:09,387 --> 00:23:11,690 SO IF CONSCIENCE IS GETTING 10 501 00:23:11,757 --> 00:23:15,694 OUT OF 302 OF THOSE ARE SO 502 00:23:15,761 --> 00:23:18,130 FRAUDULENT THAT WE CAN'T PUBLISH 503 00:23:18,196 --> 00:23:20,165 THEM, JUST IMAGINE WHAT IT'S 504 00:23:20,232 --> 00:23:21,800 LIKE AT PLUS OR SCIENTIFIC 505 00:23:21,867 --> 00:23:23,869 REPORTS OR SOME JOURNAL THAT'S A 506 00:23:23,935 --> 00:23:25,904 LOT LARGER WHERE THERE'S A LOT 507 00:23:25,971 --> 00:23:26,471 LESS OVERSIGHT. 508 00:23:26,538 --> 00:23:27,939 SO WE DON'T THINK THAT YOU CAN 509 00:23:28,006 --> 00:23:30,008 JUST CHANGE THE GUIDELINES AND 510 00:23:30,075 --> 00:23:31,777 CHANGE THE RULES AND PROBLEM 511 00:23:31,843 --> 00:23:33,745 PROGRAMS TO GET PROBLEMS LIKE 512 00:23:33,812 --> 00:23:35,247 THIS, INSTEAD WE THINK WE HAVE 513 00:23:35,313 --> 00:23:38,216 TO BE MORE FORTH RIGHT ABOUT 514 00:23:38,283 --> 00:23:43,088 ADMITTING THE FACT THAT THERE 515 00:23:43,155 --> 00:23:44,723 ARE PROBLEMS IN A PAPER AND 516 00:23:44,790 --> 00:23:45,791 KREKING AND RETRACTING THEM AS 517 00:23:45,857 --> 00:23:48,193 QUICKLY AS POSSIBLE WITH AS 518 00:23:48,260 --> 00:23:49,261 LITTLE DRAMA AS POSSIBLE AND IT 519 00:23:49,327 --> 00:23:50,462 IS POSSIBLE TO DO IT THAT WAY, 520 00:23:50,529 --> 00:23:53,031 YOU KNOW IT WAS A BIG--THERE WAS 521 00:23:53,098 --> 00:23:55,700 A BIG SPLASH ABOUT A BUNCH OF 522 00:23:55,767 --> 00:23:57,903 PROBLEMATIC PAPERS AT 523 00:23:57,969 --> 00:23:59,471 DANA-FARBER, BUT MOST OF THEM 524 00:23:59,538 --> 00:24:00,972 HAVE BEEN RETRACTED NOW AND YOU 525 00:24:01,039 --> 00:24:02,474 DON'T EACH REALLY HEAR THAT MUCH 526 00:24:02,541 --> 00:24:04,543 ABOUT THAT ANYMORE BECAUSE THE 527 00:24:04,609 --> 00:24:05,377 DANA-FARBER PEOPLE ALL JUST 528 00:24:05,443 --> 00:24:08,046 SAID, OH THIS IS--WE SHOULD HAVE 529 00:24:08,113 --> 00:24:09,214 CAUGHT THESE AND THEY RETRACTED 530 00:24:09,281 --> 00:24:12,851 THEM ALL AND IT'S OVER. 531 00:24:12,918 --> 00:24:14,820 AND THEY DIDN'T REALLY GIVE THE 532 00:24:14,886 --> 00:24:17,022 JOURNALISTS THAT MUCH NEW STUFF 533 00:24:17,088 --> 00:24:17,255 WRITE. 534 00:24:17,322 --> 00:24:19,124 THEY SAID OH IF PEOPLE WERE OUT 535 00:24:19,191 --> 00:24:21,793 TO GET US, IT WE DIDN'T REALLY 536 00:24:21,860 --> 00:24:24,129 DO THIS, OR IT WAS THE POST 537 00:24:24,196 --> 00:24:24,963 DOC'S FAULT AND I DEPARTMENT 538 00:24:25,030 --> 00:24:26,598 KNOW ABOUT IT, THEN THE 539 00:24:26,665 --> 00:24:27,532 NEWSPAPERS WOULD HAVE WRITTEN A 540 00:24:27,599 --> 00:24:29,301 WHOLE LOT MORE ABOUT THIS, SO IF 541 00:24:29,367 --> 00:24:31,269 WE DO PROPERLY, EVEN ELIZABETH 542 00:24:31,336 --> 00:24:32,571 CIBOL IS SOMEBODY WHO CRITICIZED 543 00:24:32,637 --> 00:24:35,674 ME WHEN SHE DOESN'T LIKE WHAT WE 544 00:24:35,740 --> 00:24:37,409 DO, BUT SHE ALSO IS FAIR WHEN WE 545 00:24:37,475 --> 00:24:40,712 DO SOMETHING SHE LIKES, SHE 546 00:24:40,779 --> 00:24:50,355 APPLAUDED THE WAY WE HANDLED THE 547 00:24:50,422 --> 00:24:51,323 MARK TESSIER-LAVINE MATTER. 548 00:24:51,389 --> 00:24:52,591 BUT UNFORT MATILY MOST 549 00:24:52,657 --> 00:24:54,092 INSTITUTIONS DON'T CO THIS 550 00:24:54,159 --> 00:24:56,194 BECAUSE THE ORI GUIDELINES ARE 551 00:24:56,261 --> 00:25:00,165 VERY ELABORATE AS I'M SURE YOU 552 00:25:00,232 --> 00:25:01,199 ALL KNOW WORKING HERE AND 553 00:25:01,266 --> 00:25:05,203 THERE'S QUITE A LOT OF BACK AND 554 00:25:05,270 --> 00:25:06,404 FORTH THAT HAPPENS WITH THE 555 00:25:06,471 --> 00:25:07,439 INSTITUTION AND 1 OF THE WORST 556 00:25:07,505 --> 00:25:10,375 EXAMPLES OF THIS HAS BEEN THIS 557 00:25:10,442 --> 00:25:11,209 SUPER CONDUCTIVITY SCANDAL AT 558 00:25:11,276 --> 00:25:13,044 THE UNIVERSITY OF ROUGH ATOM 559 00:25:13,111 --> 00:25:15,647 CHESTER WHICH YOU KNOW MUCH TO 560 00:25:15,714 --> 00:25:18,083 OUR CHAGRIN AND OUR NEWS 561 00:25:18,149 --> 00:25:19,351 DEPARTMENT NATURE HAS DONE A 562 00:25:19,417 --> 00:25:20,785 GREAT JOB COVERING BUT WE GIVE 563 00:25:20,852 --> 00:25:22,754 THEM CREDIT WHEN THEY WRITE GOOD 564 00:25:22,821 --> 00:25:24,055 NEWS STORIES AND IN THE CASE OF 565 00:25:24,122 --> 00:25:27,158 THIS MATTER AT THE UNIVERSITY OF 566 00:25:27,225 --> 00:25:29,761 ROCHESTER WHICH IS IN PHYSICS, 567 00:25:29,828 --> 00:25:32,397 THEY HAD 4 INQUIRIES, THE FIRST 568 00:25:32,464 --> 00:25:34,199 3 THEY CONCLUDED NOTHING WAS 569 00:25:34,266 --> 00:25:35,967 WRONG AND FINALLY ON THE FOURTH 570 00:25:36,034 --> 00:25:37,969 1 THEY DID A MORE THOROUGH 571 00:25:38,036 --> 00:25:38,770 INVESTIGATION ONLY BECAUSE THEY 572 00:25:38,837 --> 00:25:40,972 WERE REQUIRED TO BY THE NSF AND 573 00:25:41,039 --> 00:25:42,641 ONLY THEN DID THEY INTRODUCE THE 574 00:25:42,707 --> 00:25:45,410 STUDENTS AND SO, 1 OF THE THINGS 575 00:25:45,477 --> 00:25:49,481 ABOUT THESE MATTERS IS THAT THE 576 00:25:49,547 --> 00:25:50,982 STUDENTS ARE QUITE THE KAICIALTS 577 00:25:51,049 --> 00:25:52,183 WHEN THESE THINGS HAPPEN BECAUSE 578 00:25:52,250 --> 00:25:54,719 IF THERE'S A LOT OF DRAMA THEN 579 00:25:54,786 --> 00:25:55,787 THEIR LAB GETS CALLED INTO 580 00:25:55,854 --> 00:26:00,292 QUESTION AND THEY MAY HAVE 581 00:26:00,358 --> 00:26:01,927 PROBLEMATIC DAT IN THEIR THESIS 582 00:26:01,993 --> 00:26:03,328 AND STUFF LIKE THAT. 583 00:26:03,395 --> 00:26:06,865 SO THIS IS THE STUFF THAT AI IS 584 00:26:06,932 --> 00:26:08,767 COMING INTO, 1 WHERE THERE'S 585 00:26:08,833 --> 00:26:10,101 PUBLIC TRUST IN CONSCIENCE IS 586 00:26:10,168 --> 00:26:11,503 ERODING AND WHERE WE'RE HAVING A 587 00:26:11,569 --> 00:26:17,108 VERY HARD TIME POLICING 588 00:26:17,175 --> 00:26:18,510 OURSELVES AND SO HERE WE GO, 589 00:26:18,576 --> 00:26:20,445 THIS IS A FAMOUS NOW 590 00:26:20,512 --> 00:26:22,847 ILLUSTRATION THAT MADE IT INTO A 591 00:26:22,914 --> 00:26:25,784 PAPER OF A SQUIRREL OR MOUSE 592 00:26:25,850 --> 00:26:26,685 THAT DOESN'T EXIST. 593 00:26:26,751 --> 00:26:31,690 THIS ACTUALLY PASSED ALL THE 594 00:26:31,756 --> 00:26:32,958 PROCESSES, AND GOT INTO A 595 00:26:33,024 --> 00:26:36,995 YOWRNAL BECAUSE IT WAS--SOMEBODY 596 00:26:37,062 --> 00:26:39,364 TOLD 1 OF THESE PROGRAMS TO MAKE 597 00:26:39,431 --> 00:26:41,132 A DIAGRAM OF THE SEX ORGANS OF A 598 00:26:41,199 --> 00:26:42,567 MOUSE AND THIS IS WHAT IT CAME 599 00:26:42,634 --> 00:26:43,735 UP WITH. 600 00:26:43,802 --> 00:26:45,470 AND THE REVIEWERS DIDN'T CATCH 601 00:26:45,537 --> 00:26:46,571 THIS, SO WHEN SOMETHING LIKE 602 00:26:46,638 --> 00:26:49,207 THIS HAPPENS AND THIS IMAGE GETS 603 00:26:49,274 --> 00:26:50,375 CIRCULATED ALL OVER THE INTERNET 604 00:26:50,442 --> 00:26:52,243 THEN IT CAUSES PEOPLE TO LOSE A 605 00:26:52,310 --> 00:26:55,347 LOT OF CONFIDENCE IN SCIENTIFIC 606 00:26:55,413 --> 00:26:55,814 PUBLISHING. 607 00:26:55,880 --> 00:26:57,315 BUT EVEN BEFORE THE DRAWING 608 00:26:57,382 --> 00:27:02,988 PROGRAMS CAME ALONG, WE HAD 609 00:27:03,054 --> 00:27:04,289 CHATGPT AND LARGE LANGUAGE 610 00:27:04,356 --> 00:27:05,490 MODELS WHICH GENERATE TEXT FOR 611 00:27:05,557 --> 00:27:05,857 PAPERS. 612 00:27:05,924 --> 00:27:08,360 WE TOOK A VERY TOUGH STANCE AT 613 00:27:08,426 --> 00:27:12,464 FIRST AND I PUBLISHED THIS 614 00:27:12,530 --> 00:27:15,600 EDITORIAL WHICH I HAVE TO SAY, 615 00:27:15,667 --> 00:27:16,668 IS ALSO ANOTHER INTERESTING 616 00:27:16,735 --> 00:27:20,405 LESSON IN THE WAY SCIENCE WORKS 617 00:27:20,472 --> 00:27:22,307 BECAUSE NORMALLY WHEN I PUBLISH 618 00:27:22,374 --> 00:27:24,209 EDITORIALS, THEY DON'T GET A LOT 619 00:27:24,275 --> 00:27:28,346 OF CITATIONS, THEY ARE INDEXED 620 00:27:28,413 --> 00:27:30,849 ON PUB MED, OCCASIONALLY A 621 00:27:30,915 --> 00:27:32,417 SCIENCE EFTHIMIOSORRIAL OR 622 00:27:32,484 --> 00:27:34,285 SOMEBODY WILL CITE 1 AND I WILL 623 00:27:34,352 --> 00:27:36,688 GET 4 OR 5 CITATIONS ON 1 EMPLOY 624 00:27:36,755 --> 00:27:38,590 I LOOKED UP THIS EDITORIAL WHICH 625 00:27:38,656 --> 00:27:40,558 HAS BEEN OUT FOR A YEAR WHICH 626 00:27:40,625 --> 00:27:43,862 TOOK ME ABOUT 2 HOURS TO WRITE. 627 00:27:43,928 --> 00:27:46,264 IT'S 720 WORDS LONG HAS NO 628 00:27:46,331 --> 00:27:49,801 EQUATIONS OR ANYTHING AND IT 629 00:27:49,868 --> 00:27:52,670 EVEN REFERS TO THE ELSA FROM THE 630 00:27:52,737 --> 00:27:54,572 MOVIE FROZEN AND IT'S BEEN CITED 631 00:27:54,639 --> 00:27:59,110 900 TIMES IN 1 YEAR, I GET THESE 632 00:27:59,177 --> 00:28:00,412 E-MAILS FROM PREDATORY 633 00:28:00,478 --> 00:28:02,814 PUBLISHERS SAYING, YOU'RE THE 634 00:28:02,881 --> 00:28:05,383 MOST HIGHLY CITED AUTHOR IN CHAT 635 00:28:05,450 --> 00:28:06,985 GPT, WILL YOU SEND US A PAPER 636 00:28:07,052 --> 00:28:10,889 FOR OUR SPECIAL ISSUE, I SPENT 637 00:28:10,955 --> 00:28:12,624 MILLIONS OF DOLLARS AND 15 YEARS 638 00:28:12,690 --> 00:28:14,859 OF RESEARCH AND NOW I HAVE MORE 639 00:28:14,926 --> 00:28:15,560 TIARASSIZATIONS THAN ANYTHING ON 640 00:28:15,627 --> 00:28:16,628 THIS ARTICLE EMPLOY BUT WE TOOK 641 00:28:16,694 --> 00:28:17,695 THE STANCE AT THE BEGIN 642 00:28:17,762 --> 00:28:21,566 THAGOREAN WE DIDN'T WANT TO LIVE 643 00:28:21,633 --> 00:28:22,867 THROUGH THE SAME THING WE'RE 644 00:28:22,934 --> 00:28:24,436 LIVING THROUGH WITH BAD IMAGES 645 00:28:24,502 --> 00:28:26,037 WITH BAD WORDS, THAT WE DIDN'T 646 00:28:26,104 --> 00:28:28,039 WANT TO PUBLISH PAPERS WITH TEXT 647 00:28:28,106 --> 00:28:33,845 THAT WAS GENERATED BY CHAT GPT 648 00:28:33,912 --> 00:28:37,549 AND HAVE THE ELIZABETH BIK OF 649 00:28:37,615 --> 00:28:38,983 WORDS, WHOEVER THAT TURNS OUT TO 650 00:28:39,050 --> 00:28:41,486 BE, GO OUT ON PUB PEER AND SAY 651 00:28:41,553 --> 00:28:43,488 THIS IS A BAD PAPER BECAUSE IT 652 00:28:43,555 --> 00:28:45,690 WAS GENERATED BY CHAT GPT IF IT 653 00:28:45,757 --> 00:28:48,193 TURNS OUT THAT'S SOMETHING THAT 654 00:28:48,259 --> 00:28:48,993 THE SCIENTIFIC COMMUNITY DOESN'T 655 00:28:49,060 --> 00:28:49,227 ACCEPT. 656 00:28:49,294 --> 00:28:51,129 SO WE TOOK THE POSITION AT THE 657 00:28:51,196 --> 00:28:53,131 BEGINNING THAT THERE WERE TO BE 658 00:28:53,198 --> 00:28:55,233 NO IMAGES WHICH IS THE POSITION 659 00:28:55,300 --> 00:28:58,570 WE TILL HAVE, GENERATED WITH AI, 660 00:28:58,636 --> 00:29:00,071 UNLESS THERE WAS PERMISSION 661 00:29:00,138 --> 00:29:01,873 FROM THE EDITOR BECAUSE THE AI 662 00:29:01,940 --> 00:29:06,945 GENERATED IMAGE WAS PART OF THE 663 00:29:07,011 --> 00:29:10,582 ARTICLE AND ALSO KNOW AI, LLM 664 00:29:10,648 --> 00:29:11,249 GENERATED TEXT. 665 00:29:11,316 --> 00:29:12,617 NOW WE FELT AT THE TIME AND WE 666 00:29:12,684 --> 00:29:14,619 GOT A LOT OF AT THAT TIMIC FROM 667 00:29:14,686 --> 00:29:15,653 PEOPLE WHO SAID, WELL, BUT THIS 668 00:29:15,720 --> 00:29:17,088 CAN BE USED TO IMPROVE WRITING 669 00:29:17,155 --> 00:29:20,091 AND THIS WAS A TOOL THAT WILL 670 00:29:20,158 --> 00:29:22,160 EXPAND THE RATE AT WHICH PEOPLE 671 00:29:22,227 --> 00:29:24,562 CAN PRODUCE PAPERS AND THEY WILL 672 00:29:24,629 --> 00:29:26,097 SPEND LESS TIME WRITING THINGS 673 00:29:26,164 --> 00:29:27,332 UP AND MORE TIME WORKING IN THE 674 00:29:27,398 --> 00:29:29,968 LAB AND TELL BE GOOD FOR PEOPLE 675 00:29:30,034 --> 00:29:32,036 WHOM ENGLISH IS NOT THEIR FIRST 676 00:29:32,103 --> 00:29:33,671 LANGUAGE, AND OUR POSITION WAS 677 00:29:33,738 --> 00:29:37,242 YEAH, BUT WE'VE GOT SKIN IN THE 678 00:29:37,308 --> 00:29:39,444 GAME BECAUSE--AND THE COMMERCIAL 679 00:29:39,511 --> 00:29:40,245 PUBLISHERS HAVE EVEN MORE SKIN 680 00:29:40,311 --> 00:29:42,447 IN THE GAME BECAUSE THEY MAKE 681 00:29:42,514 --> 00:29:46,851 MORE MONEY THE MORE PAPERS THERE 682 00:29:46,918 --> 00:29:47,318 ARE. 683 00:29:47,385 --> 00:29:49,087 SO FOR A PUBLISHER TO SAY, WE'RE 684 00:29:49,154 --> 00:29:50,488 OKAY WITH THIS, WE HAVE A 685 00:29:50,555 --> 00:29:51,556 CONFLICT BECAUSE THE PUBLISHERS 686 00:29:51,623 --> 00:29:53,424 ARE GOING TO GET MORE REVENUE IF 687 00:29:53,491 --> 00:29:57,061 THERE ARE MORE PAPERS SO WE TOOK 688 00:29:57,128 --> 00:29:59,797 THE POSITION THAT WE WERE NOT 689 00:29:59,864 --> 00:30:04,102 GOING TO START ALLOWING THIS 690 00:30:04,169 --> 00:30:05,603 UNTIL OTHER MORE OBLIGATIONS 691 00:30:05,670 --> 00:30:07,872 YECTIVE ENTITIES SAID IT WAS 692 00:30:07,939 --> 00:30:10,208 OKAY TO USE CHAT GPT TO HELP 693 00:30:10,275 --> 00:30:13,945 WRITE YOUR PAPER EMPLOY --PAPER. 694 00:30:14,012 --> 00:30:15,713 SO WE DID THAT 8 MONTHS LATER 695 00:30:15,780 --> 00:30:18,016 AND THIS IS THE PIECE THAT VALL 696 00:30:18,082 --> 00:30:21,786 AND I WROTE SAYING THAT WE SAID 697 00:30:21,853 --> 00:30:24,222 ON THE FIRST GO ROUND WE BELIEVE 698 00:30:24,289 --> 00:30:26,191 IT'S PRUDENT TO WAIT UNTIL WE 699 00:30:26,257 --> 00:30:29,160 HAVE MORE CLARITY FOR USES ON 700 00:30:29,227 --> 00:30:30,228 WHAT THE SCIENTIFIC COMMUNITY 701 00:30:30,295 --> 00:30:31,629 WILL FEEL IS PERMISSIBLE AND 702 00:30:31,696 --> 00:30:34,065 BY THE TIME WE CHANGED THIS AND 703 00:30:34,132 --> 00:30:35,500 LOOSENED UP OUR POLICY A BIT, 704 00:30:35,567 --> 00:30:36,801 THERE HAD ALREADY BEEN A NUMBER 705 00:30:36,868 --> 00:30:39,437 OF SOCIETIES WHO HAD TAKEN THE 706 00:30:39,504 --> 00:30:41,973 INDEPENDENT POSITION THAT THERE 707 00:30:42,040 --> 00:30:44,409 WERE PERMISSIBLE USES OF CHAT 708 00:30:44,475 --> 00:30:45,577 GPT TO HELP IMPROVE YOUR TEXT 709 00:30:45,643 --> 00:30:46,911 AND THINGS LIKE THAT. 710 00:30:46,978 --> 00:30:48,179 I'M ACTUALLY NOT CONVINCED IT 711 00:30:48,246 --> 00:30:52,684 SAVES YOU THAT MUCH TIME. 712 00:30:52,750 --> 00:30:54,686 I GUESS TIME WILL TELL IF THAT'S 713 00:30:54,752 --> 00:30:56,888 THE CASE, BECAUSE OF COURSE, WE 714 00:30:56,955 --> 00:30:58,890 WOULD ALL ALLOW CHAT GPT TO BE 715 00:30:58,957 --> 00:31:04,128 THE AUTHOR SO IF IT MAKES A 716 00:31:04,195 --> 00:31:05,463 MISTAKE, IT'S ON THE PEOPLE WHO 717 00:31:05,530 --> 00:31:06,998 SIGNED THE AUTHOR FORMS 718 00:31:07,065 --> 00:31:08,399 REGARDLESS OF WHERE IT WAS 719 00:31:08,466 --> 00:31:09,467 GENERATED BY AI OR NOT. 720 00:31:09,534 --> 00:31:10,969 SO THEY'RE JUST AS RESPONSIBLE 721 00:31:11,035 --> 00:31:13,004 FOR THE TEXT THAT'S IN THE PAPER 722 00:31:13,071 --> 00:31:15,106 AS THEY WERE IF THEY WROTE IT 723 00:31:15,173 --> 00:31:15,406 THEMSELVES. 724 00:31:15,473 --> 00:31:17,642 SO DOES IT TAKE MORE TIME TO 725 00:31:17,709 --> 00:31:20,712 WRITE IT YOURSELF, OR TO CHECK 726 00:31:20,778 --> 00:31:22,614 WHAT CHAT GPT WRITES, I GUESS 727 00:31:22,680 --> 00:31:24,482 YOUR MILEAGE WILL VARY ON THAT, 728 00:31:24,549 --> 00:31:27,652 BUT I DO WORRY THAT PLACES THAT 729 00:31:27,719 --> 00:31:29,420 A LOT OF PLACES THAT PUBLISH A 730 00:31:29,487 --> 00:31:32,056 LOT MORE THAN WE DO ARE GOING TO 731 00:31:32,123 --> 00:31:35,393 SEE A LOT OF AI GENERATED PAPERS 732 00:31:35,460 --> 00:31:36,694 AND THERE WILL PROBABLY BE A LOT 733 00:31:36,761 --> 00:31:38,563 OF PROBLEMS IN THERE, AND AS 734 00:31:38,630 --> 00:31:40,531 THOSE PROBLEMS COME UP, THAT'S 735 00:31:40,598 --> 00:31:41,599 GOING TO BOG EVERYBODY DOWN 736 00:31:41,666 --> 00:31:42,634 TRYING TO FIGURE OUT WHETHER 737 00:31:42,700 --> 00:31:44,369 WE'RE GOING TO CORRECT THEM OR 738 00:31:44,435 --> 00:31:45,436 RETRACT THEM OR WHAT WE'RE GOING 739 00:31:45,503 --> 00:31:48,339 TO DO WITH THEM, JUST TO GIVE 740 00:31:48,406 --> 00:31:53,778 YOU A WAY OF THINKING ABOUT 741 00:31:53,845 --> 00:31:57,749 THIS, I WOULD SAY, WE PROBABLY 742 00:31:57,815 --> 00:32:00,184 SPEND SAY 25% OF OUR TIME, 25% 743 00:32:00,251 --> 00:32:06,724 OF OUR TIME ON PROBLEM PAPERS. 744 00:32:06,791 --> 00:32:08,359 AND THAT IS A LOT OF TIME WE 745 00:32:08,426 --> 00:32:09,661 COULD SPEND DOING OTHER THINGS 746 00:32:09,727 --> 00:32:12,964 BUT BECAUSE THESE THINGS ARE SO 747 00:32:13,031 --> 00:32:13,698 CONTENTIOUS AND BECAUSE THERE'S 748 00:32:13,765 --> 00:32:16,668 SO MUCH IN THE NEWS ABOUT THEM 749 00:32:16,734 --> 00:32:18,169 AND BECAUSE THE SLEWS AND THE 750 00:32:18,236 --> 00:32:19,904 PEOPLE WHO RAISE QUESTIONS ABOUT 751 00:32:19,971 --> 00:32:21,105 THEM ARE SO INSISTENT AND 752 00:32:21,172 --> 00:32:24,409 BECAUSE THE UNIVERSITIES ARE SO 753 00:32:24,475 --> 00:32:28,046 SLOW AT RESPONDING WE'RE 754 00:32:28,112 --> 00:32:30,114 CONSTANTLY TRYING TO MEDIATE 755 00:32:30,181 --> 00:32:36,120 THIS AND OUR VIEW IS WE DECIDED 756 00:32:36,187 --> 00:32:37,221 TO PUBLISH THE PAPER. 757 00:32:37,288 --> 00:32:38,856 WE PUSH THE BUTTON AND PUBLISHED 758 00:32:38,923 --> 00:32:39,023 IT. 759 00:32:39,090 --> 00:32:40,692 ONCE WE DO THAT, WE'RE 760 00:32:40,758 --> 00:32:43,127 RESPONSIBLE FOR WHETHER IT'S 761 00:32:43,194 --> 00:32:43,761 CORRECTED OR NOT. 762 00:32:43,828 --> 00:32:45,363 YOU KNOW A LOT OF PEOPLE, 763 00:32:45,430 --> 00:32:47,465 CRITICS WILL SAY, WELL, NOBODY 764 00:32:47,532 --> 00:32:49,200 WANTS TO TAKE RESPONSIBILITY FOR 765 00:32:49,267 --> 00:32:49,400 THESE. 766 00:32:49,467 --> 00:32:50,601 WELL WE'RE HAPPY TO TAKE 767 00:32:50,668 --> 00:32:51,903 RESPONSIBILITY FOR IT, IT'S ON 768 00:32:51,969 --> 00:32:53,538 OUR WEBSITE, WE DECIDED TO 769 00:32:53,604 --> 00:32:54,972 PUBLISH IT, IF IT NEEDS TO BE 770 00:32:55,039 --> 00:32:56,541 CORRECTED IT'S OUR JOB TO DO 771 00:32:56,607 --> 00:33:01,045 THAT BUT WE'VE GOT TO HAVE HELP 772 00:33:01,112 --> 00:33:03,014 FROM THE AUTHORS AND THE 773 00:33:03,081 --> 00:33:05,083 INSTITUTIONS TO DO THAT. 774 00:33:05,149 --> 00:33:07,752 AND SO I HAVE BEEN RAISING A LOT 775 00:33:07,819 --> 00:33:09,287 OF HELL FRANKLY WITH THE 776 00:33:09,354 --> 00:33:10,421 INSTITUTIONS ABOUT THE FACT THAT 777 00:33:10,488 --> 00:33:12,657 THEY'VE GOT TO GET A LOT BETTER 778 00:33:12,724 --> 00:33:16,828 AT RESPONDING TO THIS AND 779 00:33:16,894 --> 00:33:19,030 WHETHER THAT'S BECAUSE OF BAD 780 00:33:19,097 --> 00:33:20,865 IMAGES OR SOMETHING HAPPENS WITH 781 00:33:20,932 --> 00:33:23,968 CHAT GPT OR BECAUSE OF OUTRIGHT 782 00:33:24,035 --> 00:33:25,436 FRAUD, IT DOESN'T MATTER ISSUES 783 00:33:25,503 --> 00:33:27,071 OUR YOB CORPS IS TO MAKE SURE 784 00:33:27,138 --> 00:33:28,606 THAT THE SCIENTIFIC RECORD IS AS 785 00:33:28,673 --> 00:33:30,141 ACCURATE AS WE CAN MAKE IT. 786 00:33:30,208 --> 00:33:32,877 SO I PUBLISHED ANOTHER PIECE AND 787 00:33:32,944 --> 00:33:36,314 I GUESS THIS IS KIND OF OUR 788 00:33:36,381 --> 00:33:40,718 SLOGAN, THAT CORRECTION IS 789 00:33:40,785 --> 00:33:43,221 COURAGEOUS, BECAUSE IF WE CAN 790 00:33:43,287 --> 00:33:44,589 SHOW AND THERE'S ACTUALLY SOCIAL 791 00:33:44,655 --> 00:33:50,762 SCIENCE RESEARCH THAT SUPPORTS 792 00:33:50,828 --> 00:33:51,362 THIS. 793 00:33:51,429 --> 00:33:53,398 THAT YOU CAN OVERCOME THE 794 00:33:53,464 --> 00:33:54,465 PERCEPTION THAT SCIENTISTS ARE 795 00:33:54,532 --> 00:33:56,200 BIASED BECAUSE OF OUR POLITICS 796 00:33:56,267 --> 00:33:57,635 OR BECAUSE WE DON'T DO A GOOD 797 00:33:57,702 --> 00:33:59,036 JOB OR SOMETHING LIKE THAT, CAN 798 00:33:59,103 --> 00:34:00,138 YOU OVERCOME MOST OF THOSE 799 00:34:00,204 --> 00:34:02,440 THINGS IN TERMS OF BUILDING 800 00:34:02,507 --> 00:34:05,843 TRUST IF YOU CAN CONVINCE THE 801 00:34:05,910 --> 00:34:09,380 PUBLIC THAT WE WILL MAKE 802 00:34:09,447 --> 00:34:13,951 AJUSTMENTS AND BE HUMBLE WHEN WE 803 00:34:14,018 --> 00:34:15,219 MAKE A MISTAKE AND IF THE 804 00:34:15,286 --> 00:34:17,989 RESEARCH IS VERY CLEAR ON THAT 805 00:34:18,055 --> 00:34:19,056 BUT THAT ISN'T HAPPENING EVERY 806 00:34:19,123 --> 00:34:22,960 TIME 1 OF THESE MATTERS TURNS 807 00:34:23,027 --> 00:34:24,695 INTO A YIENT MELODRAMA AND SO WE 808 00:34:24,762 --> 00:34:26,664 REALLY HAVE TO HAVE THE 809 00:34:26,731 --> 00:34:27,832 INSTITUTIONS SUPPORT IN DOING 810 00:34:27,899 --> 00:34:30,401 THAT, AND 1 OF THE THINGS QUITE 811 00:34:30,468 --> 00:34:32,537 FRANKLY, I WAS VERY DISMAYED 812 00:34:32,603 --> 00:34:33,805 ABOUT, YOUR COLLEAGUES OVER AT 813 00:34:33,871 --> 00:34:36,474 THE OFFICE OF RESEARCH INTEGRITY 814 00:34:36,541 --> 00:34:40,645 ARE TRYING TO IMPROVE THE 815 00:34:40,711 --> 00:34:41,546 TRANSPARENCY AND THEIR POLICIES 816 00:34:41,612 --> 00:34:45,016 AND ALL OF THE INSTITUTIONS AND 817 00:34:45,082 --> 00:34:46,751 THE AMERICAN ASSOCIATION OF 818 00:34:46,818 --> 00:34:49,754 UNIVERSITIES AND THE APLU, WHICH 819 00:34:49,821 --> 00:34:52,490 IS THE AMERICAS PUBLIC LAND 820 00:34:52,557 --> 00:34:57,895 GRANT UNIVERSITIES OPPOSED THE 821 00:34:57,962 --> 00:34:59,397 ORI CHANGES WHICH IN MY VIEW, 822 00:34:59,464 --> 00:35:00,798 EVEN IF YOU DON'T LIKE SOME OF 823 00:35:00,865 --> 00:35:05,203 THEM IS JUST THE WORST POSSIBLE 824 00:35:05,269 --> 00:35:07,171 OPTICS WE COULD HAVE, TO HAVE 825 00:35:07,238 --> 00:35:08,239 THE INSTITUTION SAYING THANKS 826 00:35:08,306 --> 00:35:09,540 FOR YOUR TAX MONEY BUOY WOO 827 00:35:09,607 --> 00:35:12,276 DON'T THINK YOU SHOULD HAVE MORE 828 00:35:12,343 --> 00:35:14,212 TRANSPARENCY IN HOW WE MANAGE 829 00:35:14,278 --> 00:35:16,047 RETRACTION ANDS CORRECTIONS WHEN 830 00:35:16,113 --> 00:35:16,414 THEY HAPPEN. 831 00:35:16,481 --> 00:35:19,016 SO THIS IS A REALLY IMPORTANT 832 00:35:19,083 --> 00:35:21,252 THING FOR US ALL AND AI ARRIVING 833 00:35:21,319 --> 00:35:31,829 NOW IS ONLY GOING TO MAKE THIS 834 00:35:33,297 --> 00:35:33,798 EVEN MORE IMPORTANT. 835 00:35:33,865 --> 00:35:35,967 OKAY, SOME OF YOU MAY KNOW I HAD 836 00:35:36,033 --> 00:35:39,604 AN INTERESTING WOWEEKS A COUPLE 837 00:35:39,670 --> 00:35:42,373 MONTHS AGO BEFORE TESTIFYING ON 838 00:35:42,440 --> 00:35:44,375 THE SUBMITEE CORONA VIRUS, I WAS 839 00:35:44,442 --> 00:35:47,378 TALKING ABOUT E-MAILS BETWEEN ME 840 00:35:47,445 --> 00:35:48,579 AND ESERVERS BETWEEN HERE AND 841 00:35:48,646 --> 00:35:49,914 METHESTIMATE THAD DAILY BASIS AS 842 00:35:49,981 --> 00:35:54,719 YOU ALL KNOW YOU WRITE FOIA-ABLE 843 00:35:54,785 --> 00:35:57,255 E-MAILS, I DO TOO SO I DON'T 844 00:35:57,321 --> 00:35:58,990 WRITE ANY E-MAILS THAT YOU THAT 845 00:35:59,056 --> 00:36:00,525 I DON'T EXPECT TO BECOME A 846 00:36:00,591 --> 00:36:02,727 PUBLIC RECORD AND ALL THE 847 00:36:02,793 --> 00:36:04,829 E-MAILS I HAD WITH FRANCIS 848 00:36:04,896 --> 00:36:07,565 COLLINS AND TONY FAUCI, WERE RED 849 00:36:07,632 --> 00:36:08,299 IN CONGRESS. 850 00:36:08,366 --> 00:36:13,170 THEY WERE TRYING TO PROVE THAT 851 00:36:13,237 --> 00:36:17,942 SOMEHOW PROVED THAT I WAS TRYING 852 00:36:18,009 --> 00:36:20,578 TO ENCOURAGE YOU FOR RESEARCH IN 853 00:36:20,645 --> 00:36:21,646 THE CORONA VIRUS, AND THEY 854 00:36:21,712 --> 00:36:24,715 WANTED ME TO TELL THEM UNDER 855 00:36:24,782 --> 00:36:27,485 OATH AND I WAS ALSO ABLE TO 856 00:36:27,552 --> 00:36:28,719 EXPLAIN AND LANCET AND NATURE 857 00:36:28,786 --> 00:36:30,555 WERE CALLED IN, THEY DECIDED NOT 858 00:36:30,621 --> 00:36:35,259 TO COME IN FAIRNESS THEY'RE IN 859 00:36:35,326 --> 00:36:36,494 ENGLAND SO 1 PERSON SAID WOULD 860 00:36:36,561 --> 00:36:37,929 YOU GO TO THE HOUSE OF LORDS IF 861 00:36:37,995 --> 00:36:40,031 YOU WERE CALLED TO TESTIFY THERE 862 00:36:40,097 --> 00:36:41,098 AND THOUGHT YEAH, WHY WOULDN'T I 863 00:36:41,165 --> 00:36:43,601 GO TO THE HOUSE OF LORDS THAT 864 00:36:43,668 --> 00:36:45,303 SOUNDS PRETTY EXSIGHING, THAT'S 865 00:36:45,369 --> 00:36:46,837 THE 1 WHERE THEY YELL AT EACH 866 00:36:46,904 --> 00:36:47,905 OTHER THE WHOLE TIME. 867 00:36:47,972 --> 00:36:50,441 SO YES, I WOULD PROBABLY GO DO 868 00:36:50,508 --> 00:36:50,641 THAT. 869 00:36:50,708 --> 00:36:53,644 BUT THE NICE THING WAS I WAS 870 00:36:53,711 --> 00:36:55,379 ABLE TO EXPLAIN A LOT ABOUT 871 00:36:55,446 --> 00:36:57,048 EVERYTHING WE DO AND 1 THING'S 872 00:36:57,114 --> 00:37:00,685 FOR SURE, THE MEMBERS OF THAT 873 00:37:00,751 --> 00:37:02,386 COMMITTEE DID NOT UNDERSTAND THE 874 00:37:02,453 --> 00:37:03,321 EXTRAORDINARY AMOUNT OF WORK 875 00:37:03,387 --> 00:37:06,524 THAT WE DO TO GO FROM A 876 00:37:06,591 --> 00:37:07,692 SUBMITTED PAPER TO SOME THINGS 877 00:37:07,758 --> 00:37:09,860 IN THE RECORD AND WHAT THEY 878 00:37:09,927 --> 00:37:11,362 REALLY DIDN'T KNOW WAS WHAT WE 879 00:37:11,429 --> 00:37:14,365 DO AFTER THE PAPER IS PUBLISHED 880 00:37:14,432 --> 00:37:16,667 AND SO, I WAS ABLE TO TELL THEM 881 00:37:16,734 --> 00:37:18,736 BECAUSE YOU KNOW YOU HEAR PEOPLE 882 00:37:18,803 --> 00:37:20,271 NOW SAY LET'S GET RID OF 883 00:37:20,338 --> 00:37:23,674 YOWRNALS BECAUSE WE DON'T NEED 884 00:37:23,741 --> 00:37:25,209 THE JOURNALS, INFORMATION CAN 885 00:37:25,276 --> 00:37:26,043 JUST GOOT INTERNET, IT'S NOT 886 00:37:26,110 --> 00:37:28,245 LIKE IN THE OLD DAYS WHEN THE 887 00:37:28,312 --> 00:37:29,847 YOWRNAL'S MAIN ROLE WAS TO PRINT 888 00:37:29,914 --> 00:37:33,250 THE YOWRNALS AND PUT THEM IN THE 889 00:37:33,317 --> 00:37:34,218 LIBRARY BUT THERE ARE SEVERAL 890 00:37:34,285 --> 00:37:35,820 THINGS THAT WE DO THAT ARE 891 00:37:35,886 --> 00:37:36,520 REALLY IMPORTANT. 892 00:37:36,587 --> 00:37:38,456 OF COURSE 1 OF THEM IS RUP THE 893 00:37:38,522 --> 00:37:40,891 PEER REVIEW PROCESS, AND PLENTY 894 00:37:40,958 --> 00:37:42,026 OF CRITICS OR JOURNALS ARE 895 00:37:42,093 --> 00:37:43,894 TRYING TO IPT GREATER VENT THEIR 896 00:37:43,961 --> 00:37:45,563 OWN WAYS OF DOING THAT, WE WILL 897 00:37:45,630 --> 00:37:46,897 SEE IF THEY ARE SUCCESSFUL AT 898 00:37:46,964 --> 00:37:51,369 THAT, BUT THE OTHER THING WE DO, 899 00:37:51,435 --> 00:37:55,206 THAT IS ABSOLUTELY CRUCIAL IS WE 900 00:37:55,272 --> 00:37:56,607 TAKE RESPONSIBILITY FOR WHAT IS 901 00:37:56,674 --> 00:37:58,109 PUBLISHED AND IF THERE'S A 902 00:37:58,175 --> 00:38:01,178 PROBLEM AFTER THE FACT, THEN WE 903 00:38:01,245 --> 00:38:07,318 TAKE RESPONSIBILITY FOR THAT AND 904 00:38:07,385 --> 00:38:08,653 I SNEAKED A PEEK AT 1 OF THE 905 00:38:08,719 --> 00:38:10,388 QUESTIONS THAT CHRIS HAD ON HIS 906 00:38:10,454 --> 00:38:11,088 SCREEN, WE ALSO TAKE 907 00:38:11,155 --> 00:38:12,256 RESPONSIBILITY FOR ALL THE DATA 908 00:38:12,323 --> 00:38:17,461 AND CODE THAT HAVE TO BE POSTED 909 00:38:17,528 --> 00:38:19,363 TO GO ALONG WITH THE PAPER. 910 00:38:19,430 --> 00:38:22,099 SO IF JOURNALS DON'T DO THAT, IF 911 00:38:22,166 --> 00:38:23,034 THE JOURNALS DON'T TAKE 912 00:38:23,100 --> 00:38:23,768 RESPONSIBILITY FOR THE CODE AND 913 00:38:23,834 --> 00:38:27,004 ALL OF THAT AND THE DATA AND FOR 914 00:38:27,071 --> 00:38:28,072 MAINTAINING THE PAPER, WHO ARE 915 00:38:28,139 --> 00:38:30,374 YOU GOING TO WRITE TO WHEN YOU 916 00:38:30,441 --> 00:38:33,110 HAVE A PROBLEM WITH A PAPER WHEN 917 00:38:33,177 --> 00:38:34,912 YOU KNOW THAT THE AUTHORS AND 918 00:38:34,979 --> 00:38:37,448 THE INSTITUTIONS ARE UNLIKELY TO 919 00:38:37,515 --> 00:38:43,320 BE RESPONSIVE AND SO, I WAS ABLE 920 00:38:43,387 --> 00:38:43,921 TO EXPLAIN THAT. 921 00:38:43,988 --> 00:38:45,790 I DON'T KNOW IF THEY LISTENED 922 00:38:45,856 --> 00:38:47,625 BUT IT'S AT LEAST IN THE 923 00:38:47,692 --> 00:38:48,292 CONGRESSIONAL RECORD NOW, 924 00:38:48,359 --> 00:38:49,827 SOMEBODY WANTS TO READ IT 1 DAY, 925 00:38:49,894 --> 00:38:53,297 SO IT WAS AN HONOR TO GO 926 00:38:53,364 --> 00:38:56,200 REPRESENT MY COLLEAGUES IN 927 00:38:56,267 --> 00:38:58,069 CONGRESS AND TO EXPLAIN HOW THIS 928 00:38:58,135 --> 00:38:58,436 WORKS. 929 00:38:58,502 --> 00:39:00,838 AND I GUESS MY MESSAGE HERE AT 930 00:39:00,905 --> 00:39:04,041 THE END WOULD BE, AND WE CAN 931 00:39:04,108 --> 00:39:05,009 TALK MORE ABOUT AI IN THE 932 00:39:05,076 --> 00:39:06,944 QUESTIONS AND I'M SURE THE OTHER 933 00:39:07,011 --> 00:39:08,112 SPEAKER WHO'S MUCH MORE 934 00:39:08,179 --> 00:39:09,080 KNOWLEDGEABLE ABOUT IT WILL HAVE 935 00:39:09,146 --> 00:39:11,148 A LOT MORE TO SAY ABOUT THAT BUT 936 00:39:11,215 --> 00:39:16,587 MY MESSAGE WOULD BE THAT WE HAVE 937 00:39:16,654 --> 00:39:19,323 AN ENORMOUS RESPONSIBILITY TO 938 00:39:19,390 --> 00:39:20,858 MAINTAIN AN EXCELLENT SCIENTIFIC 939 00:39:20,925 --> 00:39:23,861 RECORD THAT CAN STAND THE TEST 940 00:39:23,928 --> 00:39:26,697 OF TIME AND WE ARE ALL CALLED 941 00:39:26,764 --> 00:39:28,532 TOGETHER TO DO THAT AND TO 942 00:39:28,599 --> 00:39:32,937 EXPLAIN THE IMPORTANCE OF IT 943 00:39:33,003 --> 00:39:34,071 WHICH FRANKLY WE'VE DONE A 944 00:39:34,138 --> 00:39:36,107 PRETTY LOUSY YOB CORPS OF TR THE 945 00:39:36,173 --> 00:39:37,708 LAST 50 YEARS OR SO. 946 00:39:37,775 --> 00:39:40,578 SO WITH THEY WILL OF COURSE PLUG 947 00:39:40,644 --> 00:39:42,079 OUR NEWS LETTER, HOPEFULLY 948 00:39:42,146 --> 00:39:44,949 EVERYBODY HERE IS GETTING 949 00:39:45,015 --> 00:39:46,817 SCIENCE ADVISOR, THE NEW LETTER 950 00:39:46,884 --> 00:39:47,985 FROM SCIENCE, THERE'S A QR CODE 951 00:39:48,052 --> 00:39:49,520 IF YOU WANT TO TAKE A PICTURE 952 00:39:49,587 --> 00:39:52,623 BUT YOU SHOULD BE ANNOYED 953 00:39:52,690 --> 00:39:54,024 WITHADS ON OUR WEBSITE WHEN YOU 954 00:39:54,091 --> 00:39:56,794 COME TO IT SO PLEASE SIGN UP FOR 955 00:39:56,861 --> 00:39:58,629 SCIENCE ADVISOR, GREAT RUN DOWN 956 00:39:58,696 --> 00:40:00,731 OF THE NEWS IN CONSCIENCE AND WE 957 00:40:00,798 --> 00:40:01,799 HAVE A REALLY GREAT PERSON WHO 958 00:40:01,866 --> 00:40:03,234 WRITE ITS AND MAKE ITS 959 00:40:03,300 --> 00:40:05,069 INCREDIBLY FUN AND I GET TO WORK 960 00:40:05,136 --> 00:40:05,770 WITH EXTRAORDINARY PEOPLE EMPLOY 961 00:40:05,836 --> 00:40:11,542 HERE IS OUR TEAM OF EDITORS, OF 962 00:40:11,609 --> 00:40:14,645 SCIENCE PLUS OUR OTHER JOURNALS, 963 00:40:14,712 --> 00:40:16,380 THESE PEOPLE ARE OUTSTANDING 964 00:40:16,447 --> 00:40:18,816 COLLEAGUES WHO WORK TIRELESSLY 965 00:40:18,883 --> 00:40:22,319 TO MAKE SURE THAT WHAT WE BRING 966 00:40:22,386 --> 00:40:24,889 YOU IS ACCURATE AND IMPORTANT 967 00:40:24,955 --> 00:40:27,591 AND IT'S AN HONOR TO SEE THEM DO 968 00:40:27,658 --> 00:40:28,058 THAT EVERY DAY. 969 00:40:28,125 --> 00:40:32,963 THIS IS THE TEAM THAT MAKES SURE 970 00:40:33,030 --> 00:40:34,265 THAT THESE--OUR PAPERS ARE 971 00:40:34,331 --> 00:40:35,866 COVERED ACCURATELY BY THE NEWS 972 00:40:35,933 --> 00:40:40,604 MEDIA BECAUSE AS MUCH AS WE 973 00:40:40,671 --> 00:40:43,274 PROBABLY THINK SCIENCE HAS A 974 00:40:43,340 --> 00:40:45,009 VERY--A LOT OF WATTAGE, THE 975 00:40:45,075 --> 00:40:46,677 TRUTH IS MOST PEOPLE DON'T READ 976 00:40:46,744 --> 00:40:48,179 SCIENTIFIC PAPERS BUT A LOT OF 977 00:40:48,245 --> 00:40:50,114 PEOPLE READ NEWS STORIES ABOUT 978 00:40:50,181 --> 00:40:51,615 SCIENTIFIC PAPERS AND SO MAKING 979 00:40:51,682 --> 00:40:53,584 SURE THAT THOSE ARE ACCURATE AND 980 00:40:53,651 --> 00:40:56,187 AS WIDE SPREAD AS POSSIBLE IS 981 00:40:56,253 --> 00:40:58,155 THE MOST IMPORTANT THING THAT 982 00:40:58,222 --> 00:41:00,958 SCIENCE AND THE AAAS DO TO HELP 983 00:41:01,025 --> 00:41:02,226 THE PUBLIC UNDERSTANDING OF 984 00:41:02,293 --> 00:41:03,561 SCIENCE AND I HOPE YOU ALSO 985 00:41:03,627 --> 00:41:05,162 ADPREE THAT CONSCIENCE IS THE 986 00:41:05,229 --> 00:41:05,996 MOST BEAUTIFUL YOWRNAL IN THE 987 00:41:06,063 --> 00:41:08,399 WORLD AND HAS THE MOST 988 00:41:08,465 --> 00:41:12,469 ILLUSTRATIVE FIGURES AND THIS IS 989 00:41:12,536 --> 00:41:13,437 THE RELATIVELY LARGE TEAM THAT 990 00:41:13,504 --> 00:41:17,441 IT TAKES TO MAKE ALL THOSE 991 00:41:17,508 --> 00:41:19,577 MAGNIFICENT ILITRATIONS AND 992 00:41:19,643 --> 00:41:20,311 BEAUTIFUL COVERS AND EVERYTHING 993 00:41:20,377 --> 00:41:22,613 THAT YOU GET TO SEE EVERY WEEK 994 00:41:22,680 --> 00:41:27,084 IN OUR MAGAZINE MAGAZINE. 995 00:41:27,151 --> 00:41:28,719 SO IT'S REALLY AN HONOR TO BE 996 00:41:28,786 --> 00:41:29,887 PART OF THIS EXTRAORDINARY 997 00:41:29,954 --> 00:41:30,754 SERIES THAT'S RUN FOR ALL THIS 998 00:41:30,821 --> 00:41:33,524 TIME AND I LOOK FORWARD TO THE 999 00:41:33,591 --> 00:41:34,458 DISCUSSION AFTERWARD ANDS 1000 00:41:34,525 --> 00:41:36,093 ESPECIALLY THE TALK FOR THE NEXT 1001 00:41:36,160 --> 00:41:46,537 SPEAKER, SO THANK YOU ALL VERY 1002 00:41:46,604 --> 00:41:46,804 MUCH. 1003 00:41:46,871 --> 00:41:56,747 [ APPLAUSE ] 1004 00:41:56,814 --> 00:41:59,884 NTHANK -- 1005 00:41:59,950 --> 00:42:01,185 >> THANK YOU SO UPON FOR 1006 00:42:01,252 --> 00:42:02,453 INVITING ME TO SHARE SOME 1007 00:42:02,519 --> 00:42:03,654 THOUGHTS WITH YOU EMPLOY I HOPE 1008 00:42:03,721 --> 00:42:07,625 MY SLIDES ARE SHOWING UP OKAY 1009 00:42:07,691 --> 00:42:08,926 AND THANK YOU FOR THE KIND 1010 00:42:08,993 --> 00:42:10,361 INTRODUCTION AND THANK YOU FOR 1011 00:42:10,427 --> 00:42:11,729 THIS FASCINATING TALK AND I LOVE 1012 00:42:11,795 --> 00:42:14,765 IT SO MUCH AND I LOVE THE STORY 1013 00:42:14,832 --> 00:42:17,034 ABOUT THE OPED BEING CITED 900 1014 00:42:17,101 --> 00:42:17,501 TIMES. 1015 00:42:17,568 --> 00:42:20,671 THE IRONY OF OUR PROFESSION 1016 00:42:20,738 --> 00:42:20,905 TIMES. 1017 00:42:20,971 --> 00:42:23,974 I WOULD LIKE TO SHARE WITH YOU 1018 00:42:24,041 --> 00:42:26,343 SOME THOUGHTS ABOUT THE 1019 00:42:26,410 --> 00:42:29,213 BIOETHICS LITERATURE THAT IS 1020 00:42:29,280 --> 00:42:32,116 QUICKLY EMERGING IN RESPONSE TO 1021 00:42:32,182 --> 00:42:34,852 THE IMPLEMENTATION OF AI IN 1022 00:42:34,919 --> 00:42:36,320 HEALTHCARE AND IN BIOMEDICAL 1023 00:42:36,387 --> 00:42:40,124 RESEARCH WHICH HAS MANY ETHICAL 1024 00:42:40,190 --> 00:42:41,058 IMPLICATIONS AND WILL TOUCH 1025 00:42:41,125 --> 00:42:43,160 QUICKLY ON THE MAIN 1S IN ORDER 1026 00:42:43,227 --> 00:42:46,430 TO FEED INTO THE DISCUSSION. 1027 00:42:46,497 --> 00:42:47,665 THE FIRST THING I WILL LIKE TO 1028 00:42:47,731 --> 00:42:53,938 POINT OUT IS THAT THE NATIONAL 1029 00:42:54,004 --> 00:42:55,773 ACADEMY OF MEDICINE HAS AN 1030 00:42:55,839 --> 00:42:57,942 INITIATIVE TO DEVELOP A CODE OF 1031 00:42:58,008 --> 00:43:00,911 CONDUCT THAT WILL GUIDE THE USE 1032 00:43:00,978 --> 00:43:04,548 OF AI IN HEALTHCARE ACROSS EVERY 1033 00:43:04,615 --> 00:43:07,751 ASPECT OF OUR HEALTHCARE SYSTEM. 1034 00:43:07,818 --> 00:43:11,922 THERE'S A STEERING COMMITTEE 1035 00:43:11,989 --> 00:43:13,691 THAT STEERS THIS EFFORT, I'M 1036 00:43:13,757 --> 00:43:17,127 HONORED TO BE A MEMBER OF IT AND 1037 00:43:17,194 --> 00:43:19,196 WE CURRENTLY HAVE AN INITIAL 1038 00:43:19,263 --> 00:43:21,799 DOCUMENT FOR WHICH WE'RE 1039 00:43:21,865 --> 00:43:22,766 INVITING COMMENTS. 1040 00:43:22,833 --> 00:43:24,234 YOU CAN FIND IT IN THE LIRNG 1041 00:43:24,301 --> 00:43:26,904 THEY PUT ON THE SCREEN, THIS IS 1042 00:43:26,971 --> 00:43:29,873 REALLY A NATIONAL EFFORT WITH A 1043 00:43:29,940 --> 00:43:32,543 HOPE TO INSPIRE ALSO THE 1044 00:43:32,609 --> 00:43:34,411 RESPONSIBLE AND WISE AND 1045 00:43:34,478 --> 00:43:38,382 CAUTIOUS IMPLEMENTATION OF AI 1046 00:43:38,449 --> 00:43:38,649 GLOBALLY. 1047 00:43:38,716 --> 00:43:40,484 SO IT'S REALLY INTERESTING TO 1048 00:43:40,551 --> 00:43:42,219 NOTE THAT THESE--THE ISSUES THAT 1049 00:43:42,286 --> 00:43:44,855 I WILL DISCUSS TODAY ARE BEING 1050 00:43:44,922 --> 00:43:47,591 ADDRESSED AT THE NATIONAL LEVEL. 1051 00:43:47,658 --> 00:43:50,027 SO WHEN I TAKE A VERY HIGH LEVEL 1052 00:43:50,094 --> 00:43:55,599 VIEW OF THE BIOETHICS LITERATURE 1053 00:43:55,666 --> 00:43:57,334 ON AI IN HEALTH, HERE ARE SOME 1054 00:43:57,401 --> 00:43:59,970 OF THE THEMES THAT EMERGE AND I 1055 00:44:00,037 --> 00:44:01,672 WILL DIVIDE THEM BETWEEN THE 1056 00:44:01,739 --> 00:44:03,207 INDIVIDUAL LEVEL AND SYSTEMIC 1057 00:44:03,273 --> 00:44:05,309 LEVEL TO TRY TO PUT ORDER IN 1058 00:44:05,376 --> 00:44:09,780 THIS RICHNESS OF CHALLENGES THAT 1059 00:44:09,847 --> 00:44:10,581 WE'RE SEEING ARISING. 1060 00:44:10,647 --> 00:44:15,552 AT THE INDIVIDUAL LEVEL, WHEN WE 1061 00:44:15,619 --> 00:44:19,390 USE AI TOOLS IN PATIENT CARE, 1062 00:44:19,456 --> 00:44:21,825 FOR EXAMPLE, IF WE'RE RECORDING 1063 00:44:21,892 --> 00:44:24,695 THE CLINICAL ENCOUNTER, THEN 1064 00:44:24,762 --> 00:44:25,796 ALLOWING GENERATIVE AI TO 1065 00:44:25,863 --> 00:44:28,298 GENERATE THE CLINICAL NOTES IN 1066 00:44:28,365 --> 00:44:30,267 ORDER TO SAVE CLINICIANS A LOT 1067 00:44:30,334 --> 00:44:32,936 OF TIME AND THAT'S JUST 1 1068 00:44:33,003 --> 00:44:35,139 EXAMPLE OF COURSE, WE CAN USE AI 1069 00:44:35,205 --> 00:44:37,041 NOT JUST GENERATIVE ARK I, WE 1070 00:44:37,107 --> 00:44:39,243 CAN USE ALGORITHMS TO READ 1071 00:44:39,309 --> 00:44:41,245 IMAGES, THAT'S PROBABLY THE MOST 1072 00:44:41,311 --> 00:44:44,348 ADVANCED USE OF AI IN CLINICAL 1073 00:44:44,415 --> 00:44:45,516 CARE TODAY, THERE ARE MULTIPLE 1074 00:44:45,582 --> 00:44:46,683 USES THAT ARE ALREADY HITTING 1075 00:44:46,750 --> 00:44:48,519 THE GROUND AS WE SPEAK. 1076 00:44:48,585 --> 00:44:51,522 SO 1 OF THE ISSUES THAT EMERGE 1077 00:44:51,588 --> 00:44:54,324 IS DO PATIENTS HAVE A RIGHT TO 1078 00:44:54,391 --> 00:44:56,960 KNOW, THAT AI IS INVOLVED IN 1079 00:44:57,027 --> 00:44:59,063 THEIR CARE AND IN THE FUTURE 1080 00:44:59,129 --> 00:45:00,831 MAYBE AI WILL BE SO EMBEDDED 1081 00:45:00,898 --> 00:45:03,300 INTO OUR SYSTEMS AND HOSPITALS 1082 00:45:03,367 --> 00:45:05,235 AND CLINICS THAT CLINICIANS WILL 1083 00:45:05,302 --> 00:45:08,272 HAVE TO BE INFORMED THAT AI IS 1084 00:45:08,338 --> 00:45:10,140 INVOLVED IN THE DELIVERY OF 1085 00:45:10,207 --> 00:45:11,842 CARE, SO WHAT DOES THAT MEAN, 1086 00:45:11,909 --> 00:45:17,081 THE RIGHT TO KNOW, SHOULD EVERY 1087 00:45:17,147 --> 00:45:17,915 PATIENT GIVE INFORMED CONSENT 1088 00:45:17,981 --> 00:45:24,721 FOR EVERY USE OF AI IN THEIR 1089 00:45:24,788 --> 00:45:25,055 CARE? 1090 00:45:25,122 --> 00:45:26,757 IS INFORMED CONSENT ENOUGH? 1091 00:45:26,824 --> 00:45:28,492 AND WHAT DOES IT INCLUDE IN 1092 00:45:28,559 --> 00:45:30,961 SHOULD THEY KNOW WHAT AI TOOL? 1093 00:45:31,028 --> 00:45:32,362 HOW THE ALGORITHM WAS DEVELOPED? 1094 00:45:32,429 --> 00:45:34,932 WHAT DATA IT WAS TESTED ON? 1095 00:45:34,998 --> 00:45:39,136 WHAT DOES IT MEAN TO BE INFORMED 1096 00:45:39,203 --> 00:45:40,337 ENOUGH TO GIVE CONSENT WHEN 1097 00:45:40,404 --> 00:45:42,072 WE'RE TALKING ABOUT THE USE OF 1098 00:45:42,139 --> 00:45:45,309 AI IN YOUR OWN CARE? 1099 00:45:45,375 --> 00:45:47,778 AND WHAT HAPPENS WHEN THE 1100 00:45:47,845 --> 00:45:50,080 STANDARD OF CARE SWITCHES FROM 1101 00:45:50,147 --> 00:45:52,449 NOT USING AI AND YOU SHOULD BE 1102 00:45:52,516 --> 00:45:54,618 TOLD IF IT IS USED TO USING IT 1103 00:45:54,685 --> 00:45:59,089 AND IF IT'S NOT USED, YOU SHOULD 1104 00:45:59,156 --> 00:46:01,625 CONSENT TO GETTING ONLY HUMAN 1105 00:46:01,692 --> 00:46:01,825 CARE. 1106 00:46:01,892 --> 00:46:03,961 SO MAYBE AROUND THE CORNER IS A 1107 00:46:04,027 --> 00:46:07,731 NEW CLINICAL REALITY WHERE WE'RE 1108 00:46:07,798 --> 00:46:09,032 EXPECTING AI TO DELIVER A PART 1109 00:46:09,099 --> 00:46:11,835 OF OUR CARE, BE INVOLVED IN THE 1110 00:46:11,902 --> 00:46:13,036 ASSPECS OF OUR CARE AND WE HAVE 1111 00:46:13,103 --> 00:46:16,340 A RIGHT TO KNOW WHEN IT IS NOT 1112 00:46:16,406 --> 00:46:16,740 INVOLVED. 1113 00:46:16,807 --> 00:46:21,678 WHEN DO WE KNOW THAT THAT SWITCH 1114 00:46:21,745 --> 00:46:21,945 OCCURRED. 1115 00:46:22,012 --> 00:46:23,113 ANOTHER CONCERN I'M SEEING IN 1116 00:46:23,180 --> 00:46:24,114 THE LITERATURE IS THE NOTION IF 1117 00:46:24,181 --> 00:46:28,051 I GO BACK TO THAT EXAMPLE OF A 1118 00:46:28,118 --> 00:46:30,020 RECORDING OF THE CLINICAL 1119 00:46:30,087 --> 00:46:34,858 CONVERSATION AND AI TAKING 1120 00:46:34,925 --> 00:46:35,092 NOTES. 1121 00:46:35,159 --> 00:46:39,796 AT WHAT POINT DO WE IDENTIFY 1122 00:46:39,863 --> 00:46:41,665 CLINICIANS OVER RELIANCE ON 1123 00:46:41,732 --> 00:46:43,901 GENERATIVE ARK I. 1124 00:46:43,967 --> 00:46:45,135 CLINICIANS SO FAR ARE VERY 1125 00:46:45,202 --> 00:46:47,037 EXCITED ABOUT THESE TOOLS, THEY 1126 00:46:47,104 --> 00:46:48,972 SAVE TIME, SOMETIMES THE TEDIOUS 1127 00:46:49,039 --> 00:46:50,641 TASK AT THE END OF A MEETING OR 1128 00:46:50,707 --> 00:46:56,947 AT THE END OF A DAY OF TAKING 1129 00:46:57,014 --> 00:46:58,482 NOTES IT ALLEGEDLY ALLOWS YOU TO 1130 00:46:58,549 --> 00:46:59,883 FOCUS MORE ON HUMAN INTERACTION 1131 00:46:59,950 --> 00:47:02,286 AND PATIENT CARE BUT SO FAR 1132 00:47:02,352 --> 00:47:05,189 CLINICIANS MUST EDIT THE NOTES, 1133 00:47:05,255 --> 00:47:06,790 APPROVE THEM, THEY CAN'T JUST 1134 00:47:06,857 --> 00:47:12,095 LET AI DO THE WORK, AT WHAT 1135 00:47:12,162 --> 00:47:16,700 POINT DO WE THINK THERE'S 1136 00:47:16,767 --> 00:47:17,734 OVERRELIANCE AND WHAT HAPPENS IF 1137 00:47:17,801 --> 00:47:19,303 CLIN IPGS GET OUT OF THE HABIT 1138 00:47:19,369 --> 00:47:22,372 OF CERTAIN THINGS AND AT THE 1139 00:47:22,439 --> 00:47:25,042 RISK OF DE-SKILLING, WHAT IF 1140 00:47:25,108 --> 00:47:26,210 CLIN 8 HOURSS LOSE CERTAIN 1141 00:47:26,276 --> 00:47:27,744 SKILLS BA YOU THEY GOT IMPORTANT 1142 00:47:27,811 --> 00:47:29,012 FOR AI DOING IT? 1143 00:47:29,079 --> 00:47:31,014 IS IT IMPORTANT THEY MAINTAIN 1144 00:47:31,081 --> 00:47:33,283 THESE SKILLS IN A WORLD WHERE AI 1145 00:47:33,350 --> 00:47:34,918 IS THE STANDARD OF CARE? 1146 00:47:34,985 --> 00:47:36,453 SO THIS IS JUST A FLAVOR OF 1147 00:47:36,520 --> 00:47:38,822 ISSUES WE'RE THINKING OF IN THE 1148 00:47:38,889 --> 00:47:39,556 CLINICAL CONTEXT. 1149 00:47:39,623 --> 00:47:41,858 OTHER INDIVIDUAL LEVEL CONCERNS 1150 00:47:41,925 --> 00:47:44,027 TOUCH ON WHAT THE LITERATURE 1151 00:47:44,094 --> 00:47:47,831 CALLS THE BLACK BOX NATURE OF 1152 00:47:47,898 --> 00:47:51,368 THE ALGORITHM, IF I GO FOR MY 1153 00:47:51,435 --> 00:47:53,103 MAMMOGRAPHY, AND I'M TOLD THAT I 1154 00:47:53,170 --> 00:47:56,340 SHOULD PROCEED TO A BIOPSY 1155 00:47:56,406 --> 00:47:58,175 BECAUSE AN ALGORITHM READ MY 1156 00:47:58,242 --> 00:48:00,377 IMAGE, AND THAT IS THE 1157 00:48:00,444 --> 00:48:02,246 RECOMMENDATION OF AN ALGORITHM, 1158 00:48:02,312 --> 00:48:04,448 AS A PATIENT, I DON'T UNDERSTAND 1159 00:48:04,514 --> 00:48:07,417 HOW AI GOT TO THAT CONCLUSION, 1160 00:48:07,484 --> 00:48:09,753 MAYBE MY CLINICIAN DOESN'T, THE 1161 00:48:09,820 --> 00:48:11,021 LITERATURE IS CONCERNED THAT 1162 00:48:11,088 --> 00:48:14,358 THIS BLACK BOX NATURE OF AI 1163 00:48:14,424 --> 00:48:17,995 POWER TOOLS IN THE CLINIC MAY BE 1164 00:48:18,061 --> 00:48:21,265 A SOURCE OF LACK OF TRUST AND 1165 00:48:21,331 --> 00:48:22,099 SLOWER UPTAKE. 1166 00:48:22,165 --> 00:48:24,534 WE'RE NOT SEEING IT, SO FAR 1167 00:48:24,601 --> 00:48:27,638 PATIENTS TEND TO TRUST AI 1168 00:48:27,704 --> 00:48:29,406 POWERED TOOLS AND WE KNOW THAT 1169 00:48:29,473 --> 00:48:35,579 HUMANS MAKE MISTAKES AS WELL BUT 1170 00:48:35,646 --> 00:48:37,047 THERE'S ENTIRE LITERATURE 1171 00:48:37,114 --> 00:48:38,215 EMERGING ON WHETHER AI 1172 00:48:38,282 --> 00:48:40,651 HEALTHCARE SHOULD BE 1173 00:48:40,717 --> 00:48:42,486 EXPLAINABLE, SHOULD BE 1174 00:48:42,552 --> 00:48:43,487 TRANSPARENT, SHOULD BE SOME 1175 00:48:43,553 --> 00:48:45,355 EFFORT TO OPEN THE BLACK BOX AND 1176 00:48:45,422 --> 00:48:46,523 THROW LIGHT IN THERE SO THAT 1177 00:48:46,590 --> 00:48:50,060 PATIENTS AND THEIR CLINICIANS 1178 00:48:50,127 --> 00:48:57,467 UNDERSTAND HOW AI DELIVERED 1179 00:48:57,534 --> 00:48:58,368 RECOMMENDATIONS, DECISIONS AND 1180 00:48:58,435 --> 00:49:00,003 SO THIS WILL INCREASE TRUST, 1181 00:49:00,070 --> 00:49:01,004 INCREASE THE UPTAKE OF THESE 1182 00:49:01,071 --> 00:49:06,476 TOOLS AND INCREASE THE 1183 00:49:06,543 --> 00:49:07,344 ACCOUNTABILITY OF THOSE USING 1184 00:49:07,411 --> 00:49:11,848 THEM EMPLOY BUT THIS NOTION OF 1185 00:49:11,915 --> 00:49:13,517 TRANSPARENT AI AND STANDS WITH 1186 00:49:13,583 --> 00:49:15,519 THE TENSION OF MORE RELIABILITY, 1187 00:49:15,585 --> 00:49:17,020 MORE ACCURACY, TOOLS THAT ARE 1188 00:49:17,087 --> 00:49:21,958 MORE EFFECTIVE AND SAFER, I'M 1189 00:49:22,025 --> 00:49:24,027 NOT AN AI DEVELOPER, I'M AN 1190 00:49:24,094 --> 00:49:26,363 ETHICIST BUT WHEN I SPEAK TO THE 1191 00:49:26,430 --> 00:49:29,032 DEVELOPERS THEY PRESENT IT AS IF 1192 00:49:29,099 --> 00:49:30,100 MORE EXPLAINABILITY MEANS 1193 00:49:30,167 --> 00:49:32,035 REDUCED RELIABILITY AND WE HAVE 1194 00:49:32,102 --> 00:49:34,438 TO ACTUALLY NEGOTIATE BETWEEN 1195 00:49:34,504 --> 00:49:35,972 THESE 2 VALUES TO THINGS THAT WE 1196 00:49:36,039 --> 00:49:39,142 CARE ABOUT AND THAT'S DEFINITELY 1197 00:49:39,209 --> 00:49:41,845 TAKING INTO ACCOUNT PATIENTS AND 1198 00:49:41,912 --> 00:49:43,380 PHYSICIANS PREFERENCES IF WE'RE 1199 00:49:43,447 --> 00:49:44,281 GOING TO SACRIFICE A LITTLE BIT 1200 00:49:44,348 --> 00:49:46,283 OF 1 FOR THE SAKE OF THE OTHER. 1201 00:49:46,350 --> 00:49:51,355 ANOTHER SET OF CONCERNS TOUCHES 1202 00:49:51,421 --> 00:49:52,622 ON PRIVACY PROTECTIONS. 1203 00:49:52,689 --> 00:49:54,925 AI ALLOWS US MORE TRIANGULATION 1204 00:49:54,991 --> 00:49:56,927 OF DATA FROM MULTIPLE SOURCES, 1205 00:49:56,993 --> 00:49:59,730 HIPAA PROTECTION IS LIMITED, IT 1206 00:49:59,796 --> 00:50:01,832 ALL DEPENDS ON THE USE OF THE AI 1207 00:50:01,898 --> 00:50:04,868 TOOL AND THERE'S THE RISK OF 1208 00:50:04,935 --> 00:50:06,603 REIDENTIFIABILITY EVEN IF DATA 1209 00:50:06,670 --> 00:50:08,205 WAS ANONYMIZED, IT'S A CONCERN 1210 00:50:08,271 --> 00:50:09,306 FOR RESEARCH OF COURSE, WE WILL 1211 00:50:09,373 --> 00:50:10,974 TOUCH ON THAT IN A MINUTE BUT - 1212 00:50:11,041 --> 00:50:13,310 ALSO A CONCERN FOR PROTECTING 1213 00:50:13,377 --> 00:50:15,345 PATIENT PRIVACY IN CLINICAL 1214 00:50:15,412 --> 00:50:15,579 CARE. 1215 00:50:15,645 --> 00:50:19,282 NOW I WANT TO TRANSITION TO SOME 1216 00:50:19,349 --> 00:50:20,917 ISSUES AT THE SYSTEMIC LEVEL, SO 1217 00:50:20,984 --> 00:50:23,653 FIRST OF ALL CURRENTLY BECAUSE 1218 00:50:23,720 --> 00:50:25,856 WE'RE STILL BUILDING THE 1219 00:50:25,922 --> 00:50:26,456 GOVERNANCE STRUCTURES 1220 00:50:26,523 --> 00:50:29,092 SURROUNDING THE DELIVERY OF AI 1221 00:50:29,159 --> 00:50:32,429 POWER TOOLS IN THE CLINIC AND IN 1222 00:50:32,496 --> 00:50:34,398 RESEARCH, THERE'S LACK OF 1223 00:50:34,464 --> 00:50:37,934 CLARITY REGARDING WHO WILL BE 1224 00:50:38,001 --> 00:50:39,536 LIABLE FOR AI BASED MEDICAL 1225 00:50:39,603 --> 00:50:39,770 HARM. 1226 00:50:39,836 --> 00:50:41,204 WOULD IT BE THE INDIVIDUAL 1227 00:50:41,271 --> 00:50:43,340 CLINICIAN WHO USED THE TOOL, I 1228 00:50:43,407 --> 00:50:43,740 DOUBT IT? 1229 00:50:43,807 --> 00:50:45,876 WILL IT BE THE ORGANIZATION FOR 1230 00:50:45,942 --> 00:50:49,379 EXAMPLE, THE HOSPITAL, OR THE 1231 00:50:49,446 --> 00:50:50,347 HEALTHCARE SYSTEM? 1232 00:50:50,414 --> 00:50:55,919 DO WE WANT TO BUILD SYSTEMIC 1233 00:50:55,986 --> 00:50:56,586 COMPENSATION FOR THE FIRST 1234 00:50:56,653 --> 00:50:58,355 GENERATION OF PATIENT WHO IS ARE 1235 00:50:58,422 --> 00:51:01,591 HARMED BY THE LIMITS OF AI BASED 1236 00:51:01,658 --> 00:51:05,061 TOOLS SIMILAR TO WHAT WE HAVE 1237 00:51:05,128 --> 00:51:05,862 WITH VACCINE COMPENSATION. 1238 00:51:05,929 --> 00:51:08,398 THERE'S A NEED TO BUILD 1239 00:51:08,465 --> 00:51:11,435 GOVERNANCE AROUND ALL OF THESE 1240 00:51:11,501 --> 00:51:13,170 QUESTIONS, THERE ARE LEGAL BUT 1241 00:51:13,236 --> 00:51:14,571 THERE ARE ALSO ETHICAL, ANOTHER 1242 00:51:14,638 --> 00:51:18,241 ISSUE AT THE SYSTEMIC LEVEL IS 1243 00:51:18,308 --> 00:51:20,777 ALGORITHMIC BIAS, MANY OF THE 1244 00:51:20,844 --> 00:51:21,478 ALGORITHMS HAVE BEEN TRAIN 1245 00:51:21,545 --> 00:51:23,580 OFFICE OF DIVERSITY DATA SETS 1246 00:51:23,647 --> 00:51:24,848 THAT HAVE LIMITED DIVERSITY JUST 1247 00:51:24,915 --> 00:51:27,083 LIKE WE'VE SEEN IN GENOMICS AND 1248 00:51:27,150 --> 00:51:30,287 IN BIOMEDICAL RESEARCH IN 1249 00:51:30,353 --> 00:51:34,124 GENERAL, CERTAIN POPULATIONS ARE 1250 00:51:34,191 --> 00:51:35,158 OVERREPRESENTED. 1251 00:51:35,225 --> 00:51:36,726 MINORITIES ARE UNDERREPRESENTED. 1252 00:51:36,793 --> 00:51:37,994 IF AN ALGORITHM WAS TRAINED ON 1253 00:51:38,061 --> 00:51:42,566 WHITE SKIN, IT WILL PERFORM 1254 00:51:42,632 --> 00:51:44,534 LESS WELL, IDENTIFYING MELANOMA 1255 00:51:44,601 --> 00:51:47,304 AND DARKER SKIN TONES SO 1256 00:51:47,370 --> 00:51:49,039 ALGORITHMIC BIAS IS AN ISSUE 1257 00:51:49,105 --> 00:51:50,373 EVERYBODY'S AWARE OF AND TRYING 1258 00:51:50,440 --> 00:51:51,775 TO TACKLE THROUGH DIVERSIFYING 1259 00:51:51,842 --> 00:51:53,076 DATA SETS AND IN A SECOND, I 1260 00:51:53,143 --> 00:51:55,445 WILL TELL YOU TO A BRIDGE TO THE 1261 00:51:55,512 --> 00:51:58,248 INITIATIVE THAT ADDRESSES THIS 1262 00:51:58,315 --> 00:51:59,783 HEAD ON. 1263 00:51:59,850 --> 00:52:01,084 ANOTHER FASCINATING QUESTION AT 1264 00:52:01,151 --> 00:52:03,386 THE SYSTEMIC LEVEL IS WHEN WE 1265 00:52:03,453 --> 00:52:06,022 INTEGRATE AI INTO CLINICAL CARE, 1266 00:52:06,089 --> 00:52:09,893 ARE THERE CERTAIN TASKS, ROLES, 1267 00:52:09,960 --> 00:52:10,827 RESPONSIBILITIES THAT SHOULD 1268 00:52:10,894 --> 00:52:13,730 REMAIN SOLELY IN THE HANDS OF 1269 00:52:13,797 --> 00:52:17,334 HUMANS EVEN IF AI CAN PERFORM 1270 00:52:17,400 --> 00:52:19,302 THEM PRETTY WELL, THINGS RELATED 1271 00:52:19,369 --> 00:52:22,973 TO COMPASSION AND CARE AND 1272 00:52:23,039 --> 00:52:24,174 ADVICE AND EMERGING RESEARCH 1273 00:52:24,241 --> 00:52:25,742 SHOWS THAT CHAT BOTS FOR 1274 00:52:25,809 --> 00:52:27,310 EXAMPLE, ARE PERFOR THE 1275 00:52:27,377 --> 00:52:29,179 PURPOSING VERY WELL, IN TERMS OF 1276 00:52:29,246 --> 00:52:31,348 GIVING PARENTS THE IMPRESSION 1277 00:52:31,414 --> 00:52:34,084 THAT THEY'RE VERY COMPASSIONATE, 1278 00:52:34,150 --> 00:52:35,919 THEY'RE VERY PATIENT SYSTEMS, 1279 00:52:35,986 --> 00:52:39,155 THEY HAVE ENDLESS AMOUNT OF TIME 1280 00:52:39,222 --> 00:52:41,091 UPLIKE HUMAN CLINICIANS. 1281 00:52:41,157 --> 00:52:44,561 DO WE FEEL RESISTANCE TO 1282 00:52:44,628 --> 00:52:46,997 INTEGRATING AI IN SOME CAPACITY, 1283 00:52:47,063 --> 00:52:49,833 CERTAIN ROLES WE BELIEVE SHOULD 1284 00:52:49,900 --> 00:52:50,767 REMAIN HUMAN ROLES? 1285 00:52:50,834 --> 00:52:52,969 THIS WILL REMAIN TO BE SEEN AND 1286 00:52:53,036 --> 00:52:54,838 OVERALL, I THINK 1 OF THE 1287 00:52:54,905 --> 00:52:56,106 GREATEST CHALLENGES ACROSS THE 1288 00:52:56,172 --> 00:52:58,475 BOARD IS THE PACE OF DEVELOPMENT 1289 00:52:58,542 --> 00:53:01,144 OF ALL THESE TOOLS. 1290 00:53:01,211 --> 00:53:03,246 THIS PRESENTS A CHALLENGE FOR 1291 00:53:03,313 --> 00:53:05,549 RESEARCH, GOVERNANCE, IMP 1292 00:53:05,615 --> 00:53:07,250 LEMMATION, SOMETIMES WHEN WE DO 1293 00:53:07,317 --> 00:53:08,685 OUR RESEARCH ON THE 1294 00:53:08,752 --> 00:53:09,719 IMPLEMENTATION OF AI, WE PEEL 1295 00:53:09,786 --> 00:53:11,922 LIKE BY THE TIME WE FIGURE OUT 1296 00:53:11,988 --> 00:53:14,991 WHAT TO ASK PATIENTS AND 1297 00:53:15,058 --> 00:53:16,192 CLINICIANS ABOUT THEIR 1298 00:53:16,259 --> 00:53:16,760 PREFERENCES, THE TECHNOLOGY 1299 00:53:16,826 --> 00:53:18,995 SHIFTED AND WE HAVE TO REDESIGN 1300 00:53:19,062 --> 00:53:21,364 OUR SURVEYS AND DEFINITELY OUR 1301 00:53:21,431 --> 00:53:24,801 GOVERNMENT IS DRAFT FRAMEWORKS. 1302 00:53:24,868 --> 00:53:29,205 SO THIS IS FAIRLY RAPID PACE OF 1303 00:53:29,272 --> 00:53:29,906 DEVELOPMENT PRESENTS CHALLENGES 1304 00:53:29,973 --> 00:53:31,575 FOR USER ANDS FOR US RESEARCHERS 1305 00:53:31,641 --> 00:53:34,477 WHO ARE TRYING TO ROLL OUT THESE 1306 00:53:34,544 --> 00:53:36,046 TECHNOLOGIES IN A WAY THAT IS 1307 00:53:36,112 --> 00:53:37,414 RESPONSIBILITY AND CAUTIOUS. 1308 00:53:37,480 --> 00:53:40,483 SO I WANT TO NOW GIVE YOU THE 1309 00:53:40,550 --> 00:53:45,188 EXAMPLE OF OUR NIH FUNDED BRIDGE 1310 00:53:45,255 --> 00:53:46,756 TO AI INITIATIVE BECAUSE I 1311 00:53:46,823 --> 00:53:47,924 WANT--I SPOKE A LITTLE BIT ABOUT 1312 00:53:47,991 --> 00:53:49,926 WHAT WE'RE SEEING IN THE 1313 00:53:49,993 --> 00:53:51,127 BIOETHICS LITERATURE IN THE 1314 00:53:51,194 --> 00:53:53,997 CONTEXT OF CLINICAL CARE AND NOW 1315 00:53:54,064 --> 00:53:56,766 I WANT TO ADDRESS CHALLENGES OF 1316 00:53:56,833 --> 00:53:58,735 USING AI IN BIOMEDICAL RESEARCH. 1317 00:53:58,802 --> 00:54:04,841 SO BRIDGE 2 AI IS AN INITIATIVE 1318 00:54:04,908 --> 00:54:07,043 MEANT TO AS THE TIELT SAYS BUILD 1319 00:54:07,110 --> 00:54:09,245 A BRIDGE FROM BIOMEDICAL AND 1320 00:54:09,312 --> 00:54:10,547 BEHAVIORIAL RESEARCH TO 1321 00:54:10,614 --> 00:54:16,853 ARTIFICIAL INTELIENCE AND IT'S 1322 00:54:16,920 --> 00:54:24,060 REALLY BASED ON THE NOTION THAT 1323 00:54:24,127 --> 00:54:28,798 IN ORDER TO PERFORM WELL AND 1324 00:54:28,865 --> 00:54:32,369 RESPONSIBLY AI MUST BE CREATED, 1325 00:54:32,435 --> 00:54:34,537 TRAINED, DEVELOPED BASED ON DATA 1326 00:54:34,604 --> 00:54:35,972 SETS THAT ARE AI READY AND THAT 1327 00:54:36,039 --> 00:54:38,908 MEANS A LOT OF THINGS, THE DATA 1328 00:54:38,975 --> 00:54:42,579 WAS ETHICALLY SOURCED, THAT WE 1329 00:54:42,646 --> 00:54:45,782 HAVE ETHICAL BEST PRACTICES, AND 1330 00:54:45,849 --> 00:54:50,153 THAT DIVERSITY OF THE DATA AND 1331 00:54:50,220 --> 00:54:52,922 OF THE TEAMS, THAT GENERATE THE 1332 00:54:52,989 --> 00:54:56,459 DATA IS GUARANTEED, SO THIS IS 1333 00:54:56,526 --> 00:54:58,828 INITIATIVE THAT CURRENTLY HAS 4 1334 00:54:58,895 --> 00:55:00,864 PROGECS RUNNING, EACH 1 OF THEM 1335 00:55:00,930 --> 00:55:03,867 COLLECTS DATA, A DIFFERENT TYPE 1336 00:55:03,933 --> 00:55:05,268 OF DATA, EMPHASIZES THE 1337 00:55:05,335 --> 00:55:10,073 CHARACTERISTICS OF THE DATA, 1338 00:55:10,140 --> 00:55:11,608 DIVERSE, FAIR, AI-READY, ETHICAL 1339 00:55:11,675 --> 00:55:12,809 CONSIDERATIONS, PEOPLE, TRAINING 1340 00:55:12,876 --> 00:55:14,811 OF THE TEAMS TO DO THIS WELL, 1341 00:55:14,878 --> 00:55:17,013 THE INITIATIVE IS SUPPOSED TO 1342 00:55:17,080 --> 00:55:21,084 GENERATE FLAGSHIP DATA SETS THAT 1343 00:55:21,151 --> 00:55:22,852 WERE REALLY TEACH THE BIOMEDICAL 1344 00:55:22,919 --> 00:55:24,788 RESEARCH COMMUNITY HOW TO 1345 00:55:24,854 --> 00:55:27,857 GENERATE GOOD HIGH QUALITY 1346 00:55:27,924 --> 00:55:29,592 RESPONSIBLE DATA FOR AI POWERED 1347 00:55:29,659 --> 00:55:29,993 RESEARCH. 1348 00:55:30,060 --> 00:55:31,561 SO I WANT TO SHARE THE EXAMPLE 1349 00:55:31,628 --> 00:55:34,230 OF 1 OF THOSE 4 PROJECTS, THE 1350 00:55:34,297 --> 00:55:38,134 VOICE AS A BIOMARKER OF HEALTH 1351 00:55:38,201 --> 00:55:38,368 PROJECT. 1352 00:55:38,435 --> 00:55:41,504 IN QUICKLY, A FEW WORDS, ABOUT 1353 00:55:41,571 --> 00:55:42,706 VOICE AS A BIOMARKER, THIS IS 1354 00:55:42,772 --> 00:55:44,841 OUR TEAM AND I WOULD LIKE TO 1355 00:55:44,908 --> 00:55:45,909 THANK THEM FIRST OF ALL BECAUSE 1356 00:55:45,975 --> 00:55:47,610 SOME OF THE SLIDES I WILL SHARE 1357 00:55:47,677 --> 00:55:51,481 NOW WERE GENERATED BY THE TEAM. 1358 00:55:51,548 --> 00:55:53,149 YOU KNOW WE'RE ALL AWARE OF THE 1359 00:55:53,216 --> 00:55:55,885 FACT THAT THE HUMAN VOICE IS THE 1360 00:55:55,952 --> 00:56:00,123 MOST BEAUTIFUL TRIEWMENT BUT THE 1361 00:56:00,190 --> 00:56:01,424 MOST DIFFICULT TO PLAY. 1362 00:56:01,491 --> 00:56:03,460 THE HUMAN VOICE CARRIES 1363 00:56:03,526 --> 00:56:04,194 IDENTITY, LOVE, EMOTIONS, THIS 1364 00:56:04,260 --> 00:56:06,329 IS THE PICTURE OF OUR TWINS OF 1365 00:56:06,396 --> 00:56:08,431 OUR PI AND SHE SAYS THAT FROM AN 1366 00:56:08,498 --> 00:56:11,167 EARLY AGE SHE COULDN'T TELL 1367 00:56:11,234 --> 00:56:13,837 WHICH 1 WAS CRYING BECAUSE VOICE 1368 00:56:13,903 --> 00:56:14,871 REALLY CONVEYS IDENTITY SO WHEN 1369 00:56:14,938 --> 00:56:16,773 I SPEAK TO YOU NOW, I'M DOING 1370 00:56:16,840 --> 00:56:19,109 ALL THOSE THINGS YOU SEE ON 1371 00:56:19,175 --> 00:56:20,710 SCREEN SPEAKING, GENERATING 1372 00:56:20,777 --> 00:56:24,614 HUMAN VOICES ACTUALLY AN 1373 00:56:24,681 --> 00:56:25,448 INCREDIBLY COMPLEX ACTIVITY CAN 1374 00:56:25,515 --> 00:56:29,652 SO MANY THINGS CAN GO WRONG, THE 1375 00:56:29,719 --> 00:56:32,122 NOTION OF VOICES OF BIOMARKER IS 1376 00:56:32,188 --> 00:56:36,025 TO USE RECORDINGS, SPEECH, 1377 00:56:36,092 --> 00:56:37,894 COUGH, BREATHING, CRIES, AS A 1378 00:56:37,961 --> 00:56:42,265 BIOMARKER OF DISEASE USING AI TO 1379 00:56:42,332 --> 00:56:44,167 ALLOW TO USE THE VOICE IN ORDER 1380 00:56:44,234 --> 00:56:46,369 TO DIAGNOSE DEC EARLY, HAD IS AN 1381 00:56:46,436 --> 00:56:48,538 EXPANDING MARK THAT'S PREDICTED 1382 00:56:48,605 --> 00:56:54,110 TO REACH 5 MILLION IN JUST A FEW 1383 00:56:54,177 --> 00:56:57,013 YEARS AND VOICE AS YOU KNOW IS 1384 00:56:57,080 --> 00:56:57,947 USED BEYOND HEALTH. 1385 00:56:58,014 --> 00:56:58,982 WE'RE REALLY CONCERNED ABOUT 1386 00:56:59,048 --> 00:57:00,650 DEEP FAKE VOICE THAT'S ALREADY 1387 00:57:00,717 --> 00:57:01,484 HAPPENING, PEOPLE GETTING A CALL 1388 00:57:01,551 --> 00:57:03,253 AND YOU KNOW THEY THINK THEY'RE 1389 00:57:03,319 --> 00:57:05,321 SPEAKING TO THEIR CHILD WHO WAS 1390 00:57:05,388 --> 00:57:12,095 KIDNAPPED BUT ACTUALLY THIS IS A 1391 00:57:12,162 --> 00:57:14,664 CLONING OF THE VOICE, SO WE'RE 1392 00:57:14,731 --> 00:57:16,733 LOOKING AT THESE CATEGORIES AS 1393 00:57:16,800 --> 00:57:18,001 CANDIDATES FOR FASTER DIAGNOSIS 1394 00:57:18,067 --> 00:57:20,270 AND FOLLOW UP OF DISEASE 1395 00:57:20,336 --> 00:57:21,671 PROGRESSION BASED ON VOICE 1396 00:57:21,738 --> 00:57:21,971 RECORDINGS. 1397 00:57:22,038 --> 00:57:23,239 THESE ARE THE TYPES OF DISEASES 1398 00:57:23,306 --> 00:57:25,275 WE CAN LOOK AT UNDER EACH OF 1399 00:57:25,341 --> 00:57:26,476 THESE CATEGORIES, SO WE CAN SEE 1400 00:57:26,543 --> 00:57:28,011 THAT WE'RE REALLY CASTING A WIDE 1401 00:57:28,077 --> 00:57:30,180 NET AND THE CURRENT ISSUE IS 1402 00:57:30,246 --> 00:57:37,620 THAT THERE ARE DATA SETS OF 1403 00:57:37,687 --> 00:57:44,594 VOICE, SAMPLES BUT THEY'RE SO 1404 00:57:44,661 --> 00:57:47,030 THEY'RE REALLY NOT READY IN THAT 1405 00:57:47,096 --> 00:57:49,799 SENSE, SO THEY WORK IN SILOS OF 1406 00:57:49,866 --> 00:57:51,334 DIFFERENT DISEASES, WE WANT TO 1407 00:57:51,401 --> 00:57:52,168 WORK ACROSS DISEASES, SO OUR 1408 00:57:52,235 --> 00:57:54,304 MISSION IS TO BUILD A LARGE 1409 00:57:54,370 --> 00:57:57,040 SCALE, ETHICALLY SOURCED DIVERSE 1410 00:57:57,106 --> 00:57:59,008 HUMAN VOICE DATABASE THAT IS AI 1411 00:57:59,075 --> 00:58:01,010 READY TO FUEL VOICE AI RESEARCH. 1412 00:58:01,077 --> 00:58:03,680 I JUST CAME BACK FROM ORLANDO WE 1413 00:58:03,746 --> 00:58:05,582 HAD OUR SECOND VOICE SYMPOSIUM 1414 00:58:05,648 --> 00:58:06,583 WITH A COUPLE HUNDRED PEOPLE 1415 00:58:06,649 --> 00:58:08,651 FROM ALL OVER THE WORLD 1416 00:58:08,718 --> 00:58:10,053 INCLUDING CEOs OF START UPS 1417 00:58:10,119 --> 00:58:12,822 THAT TRY TO ALREADY ROLL THIS 1418 00:58:12,889 --> 00:58:18,261 OUT AS A PRODUCT IN MENTAL 1419 00:58:18,328 --> 00:58:22,966 HEALTH AND CANCER THIS IS AN 1420 00:58:23,032 --> 00:58:31,941 INCREDIBLY BUSY SPACE, SO THESE 1421 00:58:32,008 --> 00:58:33,676 ARE ISSUES AND CREATE A VOICE 1422 00:58:33,743 --> 00:58:35,111 FOR AI, FIRST OF ALL WHAT DOES 1423 00:58:35,178 --> 00:58:37,881 IT MEAN TO COLLECT DIVERSE VOICE 1424 00:58:37,947 --> 00:58:39,849 SAMPLES TO AVOID ALGORITHMIC 1425 00:58:39,916 --> 00:58:41,517 BIAS, USUALLY WHEN WE THINK 1426 00:58:41,584 --> 00:58:43,820 ABOUT GENOMICS WE THINK ABOUT 1427 00:58:43,887 --> 00:58:45,655 ETHNICITY, HEAR WE HAVE TO 1428 00:58:45,722 --> 00:58:49,392 CONSIDER AGE, WE HAVE TO 1429 00:58:49,459 --> 00:58:50,493 CONSIDER ACCENT, AND REALLY 1430 00:58:50,560 --> 00:58:51,694 SHEDS NEW LIGHT ON THE NOTION OF 1431 00:58:51,761 --> 00:58:53,897 DIVERSITY, IF YOU WANT THE 1432 00:58:53,963 --> 00:58:56,332 PRODUCT TO BE BENEFICIAL TO 1433 00:58:56,399 --> 00:58:57,934 VARIOUS POPULATIONS, WE NEED TO 1434 00:58:58,001 --> 00:58:59,535 THINK REALLY HARD ABOUT WHAT DID 1435 00:58:59,602 --> 00:59:02,105 IT MEAN TO BE REPRESENTATIVE 1436 00:59:02,171 --> 00:59:06,676 WITH YOUR COLLECTIVE VOICES. 1437 00:59:06,743 --> 00:59:07,443 PRIVACY AND CONFIDENTIALITY, 1438 00:59:07,510 --> 00:59:11,281 VOICE IS COST EFFECTIVE, 1439 00:59:11,347 --> 00:59:12,348 NONINVASIVE, AND SAFE TO 1440 00:59:12,415 --> 00:59:12,916 COLLECT, WE'RE DEVELOPING AN 1441 00:59:12,982 --> 00:59:13,416 ACTIVITIES AND PROJECTS 1442 00:59:13,483 --> 00:59:14,117 ACTIVITIES AND PROJECTS SO 1443 00:59:14,183 --> 00:59:14,817 TAKEN--THEY PEOPLE CAN RECORD 1444 00:59:14,884 --> 00:59:17,120 THEMSELVES AT HOME AND UPLOAD 1445 00:59:17,186 --> 00:59:18,855 THEIR VOICE RECORDING TO A CLOUD 1446 00:59:18,922 --> 00:59:21,157 SO THAT THEY DON'T EVEN HAVE TO 1447 00:59:21,224 --> 00:59:23,159 GO TO A MEDICAL FACILITY TO GET 1448 00:59:23,226 --> 00:59:26,029 THE BENEFITS OF THIS TECHNOLOGY 1449 00:59:26,095 --> 00:59:28,564 BUT CAN THESE RECORDINGS EXPOSE 1450 00:59:28,631 --> 00:59:29,399 THEIR INDIVIDUAL IDENTITY, CAN 1451 00:59:29,465 --> 00:59:31,567 THEIR VOICE BE USED WITHOUT 1452 00:59:31,634 --> 00:59:33,169 THEIR CONSENT, WHAT ABOUT 1453 00:59:33,236 --> 00:59:36,572 SHARING IT WITH A COMMERCIAL 1454 00:59:36,639 --> 00:59:39,208 SPACE, IF WE CREATE THIS 1455 00:59:39,275 --> 00:59:41,611 INCREDIBLE HIGH QUALITY DATA 1456 00:59:41,678 --> 00:59:43,112 SET, PRIVATE PARTNERS MAY WANT 1457 00:59:43,179 --> 00:59:45,081 ACCESS TO THIS INFORMATION, THIS 1458 00:59:45,148 --> 00:59:47,517 MAY ENHANCE THE BENEFITS THAT WE 1459 00:59:47,583 --> 00:59:48,918 GENERATE BUT IS IT OKAY TO DO, 1460 00:59:48,985 --> 00:59:51,587 HOW DO WE GET CONSENT FOR IT. 1461 00:59:51,654 --> 00:59:53,890 THE ISSUE OF EXPLAINABILITY THAT 1462 00:59:53,957 --> 00:59:56,859 I ALREADY TOUCHED UPON, IF WE 1463 00:59:56,926 --> 00:59:58,294 CAN DEVELOP BETTER ALGORITHMS 1464 00:59:58,361 --> 00:59:59,796 BUT WE CAN'T EXPLAIN THEM TO 1465 00:59:59,862 --> 01:00:01,631 PATIENTS WHAT DO WE CHOOSE TO DO 1466 01:00:01,698 --> 01:00:05,101 AND FINALLY, BACK TO THE POINT 1467 01:00:05,168 --> 01:00:07,870 THAT WAS JUST MADE, SCIENCE 1468 01:00:07,937 --> 01:00:09,038 COMMUNICATION TO BUILD TRUST, 1469 01:00:09,105 --> 01:00:10,073 HOW DO WE COMMUNICATE TO THE 1470 01:00:10,139 --> 01:00:11,841 PUBLIC WHAT IT IS WE'RE DOING 1471 01:00:11,908 --> 01:00:13,977 AND HOW THE BENEFITS ARE SO 1472 01:00:14,043 --> 01:00:15,378 PROMISING WITHOUT HYPING THE 1473 01:00:15,445 --> 01:00:17,213 OVERHYPING THEM AND WITHOUT 1474 01:00:17,280 --> 01:00:19,048 LOSING THE TRUST OF THE PUBLIC, 1475 01:00:19,115 --> 01:00:21,250 SO JUST A MENU OF ISSUES THAT 1476 01:00:21,317 --> 01:00:22,552 WE'RE DEALING WITH IN ORDER ON 1477 01:00:22,618 --> 01:00:25,722 DO ALL THIS RESPONSIBLY, THIS IS 1478 01:00:25,788 --> 01:00:26,556 OUR MANTRA, OUR VOICE, OUR 1479 01:00:26,622 --> 01:00:27,991 HEALTH, OUR FUTURE AND I THANK 1480 01:00:28,057 --> 01:00:29,659 YOU SO MUCH FOR YOUR ATTENTION 1481 01:00:29,726 --> 01:00:40,169 AND LOOKING FORWARD TO THE 1482 01:00:55,785 --> 01:00:55,952 DISCUSSION. 1483 01:00:56,019 --> 01:00:57,353 NTHANK YOU FOR EXCITING 1484 01:00:57,420 --> 01:00:59,255 PRESENTATIONS AND THERE ARE A 1485 01:00:59,322 --> 01:01:08,931 LOT OF QUESTIONS WE HAVE TO 1486 01:01:08,998 --> 01:01:09,198 CONSIDER. 1487 01:01:09,265 --> 01:01:12,502 ALL RIGHT, SO WE'RE ASKED--THERE 1488 01:01:12,568 --> 01:01:16,005 SEEMS TO BE AN ANALOGY BETWEEN 1489 01:01:16,072 --> 01:01:20,810 THE DRIVERLESS CAR AND THE 1490 01:01:20,877 --> 01:01:23,746 DRIVERLESS DIAGNOSIS. 1491 01:01:23,813 --> 01:01:27,750 BOTH PREMISES, BOTH PROMISE 1492 01:01:27,817 --> 01:01:28,684 FEWER ACCIDENTS, WHY IS THERE 1493 01:01:28,751 --> 01:01:31,387 SUCH A WORRY THAT AI WILL MAKE 1494 01:01:31,454 --> 01:01:34,424 AN INCORRECT DIAGNOSIS, SAY 1% 1495 01:01:34,490 --> 01:01:37,560 OF THE TIME WHEN DOCTORS MAKE AN 1496 01:01:37,627 --> 01:01:38,928 INCORRECT DIAGNOSIS, 10% OF THE 1497 01:01:38,995 --> 01:01:39,395 TIME. 1498 01:01:39,462 --> 01:01:40,696 THESE ARE RANDOM NUMBERS OF 1499 01:01:40,763 --> 01:01:51,274 COURSE, BUT IT SEEMS TO ME THE 1500 01:02:07,657 --> 01:02:09,358 QUESTIONER THAT-- 1501 01:02:09,425 --> 01:02:10,326 >> IT'S SO IMPORTANT IS THAT YOU 1502 01:02:10,393 --> 01:02:12,895 KNOW A LOT OF PEOPLE ASK, A LOT 1503 01:02:12,962 --> 01:02:15,631 OF PEOPLE ARE SKEPTICAL ABOUT 1504 01:02:15,698 --> 01:02:20,803 WHY WE NEED REPRESENTATION OF 1505 01:02:20,870 --> 01:02:24,207 EVERY GROUP WHY DOES IT MATTER, 1506 01:02:24,273 --> 01:02:25,808 IS IT SOMETHING THAT'S 1507 01:02:25,875 --> 01:02:27,243 INDEPENDENT OF RACE AND GENDER 1508 01:02:27,310 --> 01:02:31,647 AND IDENTITY OF WHO DOESN'T BUT 1509 01:02:31,714 --> 01:02:34,083 WE'VE NEVER HAD IN MY OPINION A 1510 01:02:34,150 --> 01:02:36,452 STRONGER ARGUMENT FOR WHY WE 1511 01:02:36,519 --> 01:02:38,287 NEED A DIVERSE SCIENTIFIC 1512 01:02:38,354 --> 01:02:43,526 WORKFORCE THAN THE FACT THAT WE 1513 01:02:43,593 --> 01:02:45,161 NEED TO MAKE AI THAT HELPS 1514 01:02:45,228 --> 01:02:47,130 EVERYBODY AND DOESN'T JUST MAKE 1515 01:02:47,196 --> 01:02:56,305 LIFE BETTER FOR THOSE OF US WHO 1516 01:02:56,372 --> 01:03:03,613 ARE ALREADY DOING WELL--BUT 1 1517 01:03:03,679 --> 01:03:05,481 THING I IT WILL HAVE TO PROVE 1518 01:03:05,548 --> 01:03:07,917 FOR MEDICINE AND DIAGNOSIS, AND 1519 01:03:07,984 --> 01:03:08,618 SINCE MEDICINE NEVER REALLY 1520 01:03:08,684 --> 01:03:09,919 WORKED WELL FOR EVERYBODY TO 1521 01:03:09,986 --> 01:03:11,220 BEGIN WITH, THIS COULD JUST MAKE 1522 01:03:11,287 --> 01:03:12,488 THE WHOLE THING WORSE, SO THAT 1523 01:03:12,555 --> 01:03:14,857 WOULD BE 1 ARGUMENT FOR NOT 1524 01:03:14,924 --> 01:03:17,226 USING IT, IF I WERE FROM A 1525 01:03:17,293 --> 01:03:19,262 MARGINALIZED GROUP, I MIGHT BE 1526 01:03:19,328 --> 01:03:24,500 VERY, VERY SUSPICIOUS. 1527 01:03:24,567 --> 01:03:26,769 >> VARDIT, DO YOU HAVE A COMMENT 1528 01:03:26,836 --> 01:03:27,904 ABOUT THAT? 1529 01:03:27,970 --> 01:03:29,572 >> YES, I THINK 1 OF THE 1530 01:03:29,639 --> 01:03:31,507 GREATEST PROMISES OF AI IS THAT 1531 01:03:31,574 --> 01:03:35,044 IT COULD BECOME THE BIG 1532 01:03:35,111 --> 01:03:38,014 EQUALIZER THAT IT COULD MAKE 1533 01:03:38,080 --> 01:03:38,581 INTERVENTIONS MORE ACCESS 1534 01:03:38,648 --> 01:03:41,551 CLINICAL COMMUNITY, THAT IT CAN 1535 01:03:41,617 --> 01:03:47,256 BRIDGE ACROSS GEOGRAPHIC 1536 01:03:47,323 --> 01:03:50,026 BARRIERS AND THAT IT CAN 1537 01:03:50,092 --> 01:04:00,336 BE--WE'RE ALL STILL UNDER THE 1538 01:04:00,403 --> 01:04:01,170 SPELL OF TELEHEALTH, AND 1539 01:04:01,237 --> 01:04:03,839 THINKING THIS IS AMAZING, THIS 1540 01:04:03,906 --> 01:04:05,608 OPENS THE DOORS TO POPULATIONS 1541 01:04:05,675 --> 01:04:07,343 THAT ARE MARGINALIZED FOR 1542 01:04:07,410 --> 01:04:09,545 VARIOUS REASONS, AI CAN PUSH 1543 01:04:09,612 --> 01:04:11,514 THAT EVEN FURTHER, BUT IF AND 1544 01:04:11,581 --> 01:04:14,150 THAT IS WHEN THE BENEFIT BECOMES 1545 01:04:14,217 --> 01:04:17,553 A RISK, IF WE DON'T DO THIS 1546 01:04:17,620 --> 01:04:19,855 RIGHT AND AI THAT IS DEFINITELY 1547 01:04:19,922 --> 01:04:22,592 GOING TO SOME DEGREE 1548 01:04:22,658 --> 01:04:24,093 REVOLUTIONIZE THE WAY WE DELIVER 1549 01:04:24,160 --> 01:04:27,730 CARE IS DOING THE OPPOSITE,AX 1550 01:04:27,797 --> 01:04:30,199 ASKER BAITING HEALTH GAPS, THAT 1551 01:04:30,266 --> 01:04:31,267 WOULD BE--NOT JUST BREAK TRUST 1552 01:04:31,334 --> 01:04:34,470 BUT JUST MAKE THE ENTIRE 1553 01:04:34,537 --> 01:04:36,639 ENTERPRISE ETHICALLY 1554 01:04:36,706 --> 01:04:37,273 UNACCEPTABLE AND IRRESPONSIBLE. 1555 01:04:37,340 --> 01:04:39,976 SO MUCH OF IT IS ABOUT THE DATA 1556 01:04:40,042 --> 01:04:43,012 SETS AND HOW THESE ALGORITHMS 1557 01:04:43,079 --> 01:04:45,381 ARE TAUGHT BUT SOME OF IT IS 1558 01:04:45,448 --> 01:04:49,485 JUST THE INTENTIONALITY OF 1559 01:04:49,552 --> 01:04:51,487 DESIGNING, THE USE, THE 1560 01:04:51,554 --> 01:04:52,188 IMPLEMENTATION, THE DELIVERY, SO 1561 01:04:52,255 --> 01:04:53,823 I WILL GIVE YOU AN EXAMPLE BACK 1562 01:04:53,889 --> 01:05:00,696 TO THE VOICE PROJECT, WE'RE 1563 01:05:00,763 --> 01:05:02,698 DESIGNING AN APP, SO THAT 1564 01:05:02,765 --> 01:05:04,867 PATIENTS CAN RECORD THEIR VOICE 1565 01:05:04,934 --> 01:05:05,801 SAMPLE AT HOME. 1566 01:05:05,868 --> 01:05:06,802 YOU KNOW THE FIRST GENERATION 1567 01:05:06,869 --> 01:05:08,170 THAT WHILE WE'RE DEVELOPING THE 1568 01:05:08,237 --> 01:05:08,671 ACTIVITIES AND PROJECTS 1569 01:05:08,738 --> 01:05:10,039 ACTIVITIES AND PROJECTS, WE ARE 1570 01:05:10,106 --> 01:05:11,707 BRINGING PEOPLE INTO THE CLINIC 1571 01:05:11,774 --> 01:05:13,476 TO FINE TUNE THE DESIGN OF THE 1572 01:05:13,542 --> 01:05:15,444 APP SO THAT WE CAN CONTROL 1573 01:05:15,511 --> 01:05:16,512 EXACTLY THE MICROPHONE THAT THEY 1574 01:05:16,579 --> 01:05:19,649 USE AND THE DANCE BETWEEN THE 1575 01:05:19,715 --> 01:05:20,950 MOUTH AND THE MICROPHONE AND THE 1576 01:05:21,017 --> 01:05:23,119 ENVIRONMENT IN WHICH THEY'RE 1577 01:05:23,185 --> 01:05:24,787 RECORDING, BUT OUR HOPE IS TO 1578 01:05:24,854 --> 01:05:26,389 DESIGN IT IN SUCH A WAY THAT 1579 01:05:26,455 --> 01:05:29,258 ANYBODY CAN DO IT AT HOME. 1580 01:05:29,325 --> 01:05:30,726 DOES EVERYBODY HAVE A SMART 1581 01:05:30,793 --> 01:05:33,396 PHONE IN CAN ANYBODY FOLLOW 1582 01:05:33,462 --> 01:05:36,032 WRITTEN INSTRUCTIONS REGARDING 1583 01:05:36,098 --> 01:05:36,866 WHAT TO RECORD? 1584 01:05:36,932 --> 01:05:41,704 YOU KNOW WHAT TEXT WE WANT THEM 1585 01:05:41,771 --> 01:05:43,339 TO READ, WHAT ABOUT PEOPLE WHO 1586 01:05:43,406 --> 01:05:44,073 SPEAK DIFFERENT LANGUAGES THAT 1587 01:05:44,140 --> 01:05:45,741 ARE NOT SORT OF THE MAIN 1588 01:05:45,808 --> 01:05:46,909 LANGUAGES, SO THERE'S SO MUCH TO 1589 01:05:46,976 --> 01:05:48,644 THINK ABOUT WHEN YOU TRY TO 1590 01:05:48,711 --> 01:05:50,279 BRING DOWN THOSE BARRIERS AND 1591 01:05:50,346 --> 01:05:52,715 REALLY USE SUCH A PROMISING TOOL 1592 01:05:52,782 --> 01:05:57,320 IN A WAY THAT REMOVES--THAT 1593 01:05:57,386 --> 01:05:57,887 ENHANCES EQUITY. 1594 01:05:57,953 --> 01:06:00,990 IT'S MORE THAN JUST DATA 1595 01:06:01,057 --> 01:06:02,258 DIVERSITY, THERE'S LOTS TO 1596 01:06:02,325 --> 01:06:05,227 CONSIDER AND I THINK HAVING THE 1597 01:06:05,294 --> 01:06:06,195 DIVERSE TEAMS MEANS YOU NEED TO 1598 01:06:06,262 --> 01:06:08,964 GET A LOT OF PERSPECTS INTO 1599 01:06:09,031 --> 01:06:11,801 THE DESIGN SO YOU CAN THINK NOT 1600 01:06:11,867 --> 01:06:14,603 JUST ABOUT AGAIN THE DESIGN OF 1601 01:06:14,670 --> 01:06:15,571 THE ALGORITHM, YOU CAN THINK 1602 01:06:15,638 --> 01:06:16,939 ABOUT THE DELIVERY METHOD AND 1603 01:06:17,006 --> 01:06:18,307 ALL THOSE OTHER CONSIDERATIONS I 1604 01:06:18,374 --> 01:06:19,809 JUST NAMED. 1605 01:06:19,875 --> 01:06:21,077 YOU NEED MULTIDISCIPLINARY TEAMS 1606 01:06:21,143 --> 01:06:24,080 TO FEED INTO THAT THINKING. 1607 01:06:24,146 --> 01:06:26,082 SO I'M--I'M JUST ADDING MORE 1608 01:06:26,148 --> 01:06:27,383 PERSPECTIVES ON THIS ISSUE OF 1609 01:06:27,450 --> 01:06:28,684 YESTERDAY AND EQUITY BUT THIS IS 1610 01:06:28,751 --> 01:06:31,987 A KEY ELEMENT IN THE WISE AND 1611 01:06:32,054 --> 01:06:34,190 RESPONSIBLE DELIVERY OF THIS 1612 01:06:34,256 --> 01:06:35,358 PROMISING TOOL. 1613 01:06:35,424 --> 01:06:36,292 >> THANK YOU. 1614 01:06:36,359 --> 01:06:39,061 HOLDEN, WE HAVE A QUESTION HERE, 1615 01:06:39,128 --> 01:06:42,164 WHAT ARE JOURNALS DOING TO 1616 01:06:42,231 --> 01:06:46,635 ENFORCE OR ENCOURAGE AUTHORS TO 1617 01:06:46,702 --> 01:06:49,171 MAKE AVAILABLE NOT ONLY THE CODE 1618 01:06:49,238 --> 01:06:51,774 BUT MORE IMPORTANTLY THE MODEL 1619 01:06:51,841 --> 01:06:55,478 WEIGHTS AND IF POSSIBLE OR 1620 01:06:55,544 --> 01:06:56,979 FEASIBLE, THE TRAINING DATA THE 1621 01:06:57,046 --> 01:06:59,348 QUESTIONER IS OF THE OPINION 1622 01:06:59,415 --> 01:07:02,318 THAT THE MODEL WEIGHTS ARE THE 1623 01:07:02,385 --> 01:07:05,621 SINGLE MOST IMPORTANT FACTOR TO 1624 01:07:05,688 --> 01:07:08,124 TESTING REPRODUCIBILITY AS THAT 1625 01:07:08,190 --> 01:07:11,527 IS THE QUOTE MAGIC SAUCE AS IT 1626 01:07:11,594 --> 01:07:19,468 WERE TO RUN ANY MODEL. 1627 01:07:19,535 --> 01:07:20,536 >> YEAH, SO, THIS IS SOMETHING 1628 01:07:20,603 --> 01:07:21,704 ON PAPERS, THIS IS SOMETHING WE 1629 01:07:21,771 --> 01:07:24,540 SPENT QUITE A LOT OF TIME ON AND 1630 01:07:24,607 --> 01:07:27,610 YOU KNOW I--I STOPPED PUBLISHING 1631 01:07:27,676 --> 01:07:30,112 BACK WHEN A PDF OF SUPPORTING 1632 01:07:30,179 --> 01:07:30,846 INFORMATION WAS THE MAX YOU 1633 01:07:30,913 --> 01:07:32,481 WOULD PUT IN THE PAPER AND THEN 1634 01:07:32,548 --> 01:07:36,352 I GOT THIS YOB CORPS AND 15 1635 01:07:36,419 --> 01:07:39,855 YEARS LATER AND CAME TO A 1636 01:07:39,922 --> 01:07:40,589 TOTALLY DIFFERENT WORLD WHERE 1637 01:07:40,656 --> 01:07:42,591 TONS AND TONS OF DATA AND CODE 1638 01:07:42,658 --> 01:07:49,432 ARE POSTED ALONG WITH THE PAPER 1639 01:07:49,498 --> 01:07:52,768 SO WE'RE ALWAYS FINDING NEW 1640 01:07:52,835 --> 01:07:54,770 KINDS OF DATA AND CODE WE CAN 1641 01:07:54,837 --> 01:07:56,739 USE, AND IT'S AN ONION AND YOU 1642 01:07:56,806 --> 01:07:58,407 KEEP PEELING IT AND PEELING IT 1643 01:07:58,474 --> 01:08:00,209 AND PEELING IT AND THERE'S 1644 01:08:00,276 --> 01:08:01,143 ALWAYS SOMETHING YOU HAVEN'T 1645 01:08:01,210 --> 01:08:02,778 THOUGHT OF THAT YOU HAVE TO 1646 01:08:02,845 --> 01:08:03,746 LEARN TO ARCHIVE SOMEHOW SO THAT 1647 01:08:03,813 --> 01:08:07,917 PEOPLE CAN COME BACK ASK REPEAT 1648 01:08:07,983 --> 01:08:08,617 THE PAPER. 1649 01:08:08,684 --> 01:08:10,486 AND OUR GOAL IS TO HAVE 1650 01:08:10,553 --> 01:08:12,121 EVERYTHING YOU NEED THERE AND WE 1651 01:08:12,188 --> 01:08:14,824 TRY TO BE AS TOUGH AS WE CAN BE 1652 01:08:14,890 --> 01:08:19,595 ABOUT REQUIRING AUTHORS TO 1653 01:08:19,662 --> 01:08:21,530 INCLUDE THAT AND WE ALLOW 1654 01:08:21,597 --> 01:08:23,065 AUTHORS TO USE WHATEVER 1655 01:08:23,132 --> 01:08:24,467 REPOSITORY THEY WANT BUT WE ALSO 1656 01:08:24,533 --> 01:08:27,102 HAVE A PROGRAM WHERE IF THE 1657 01:08:27,169 --> 01:08:30,406 AUTHORS WANT TO USE DRYAD WHICH 1658 01:08:30,473 --> 01:08:32,441 IS 1 OF THE OPTIONS THEN SCIENCE 1659 01:08:32,508 --> 01:08:34,877 HAS A PROGRAM THAT WOULD ARK LOW 1660 01:08:34,944 --> 01:08:39,582 AUTHORS TO USE DRYAD VERY 1661 01:08:39,648 --> 01:08:41,417 CONVENIENTLY, BUT IF FOR SOME 1662 01:08:41,484 --> 01:08:43,986 REASON THEY'RE ON GITHUB OR 1663 01:08:44,053 --> 01:08:45,421 ZENOTO, THEN THEY CAN DO THAT 1664 01:08:45,488 --> 01:08:45,721 TOO. 1665 01:08:45,788 --> 01:08:50,526 YES, THIS IS ANOTHER THING THAT 1666 01:08:50,593 --> 01:08:52,061 HELPS EXPLAIN WHY PUBLISHING A 1667 01:08:52,127 --> 01:08:54,697 PEER REVIEWED PAPER IS SO 1668 01:08:54,763 --> 01:08:56,899 IMPORTANT BECAUSE IF IT'S JUST A 1669 01:08:56,966 --> 01:09:00,536 PREPRINT, THERE'S NOBODY THERE 1670 01:09:00,603 --> 01:09:03,038 TO HOLD THE AUTHORS ACCOUNTABLE, 1671 01:09:03,105 --> 01:09:04,039 IF THEY DON'T POST EVERYTHING 1672 01:09:04,106 --> 01:09:05,307 THAT SHOULD GO ALONG WITH THE 1673 01:09:05,374 --> 01:09:11,580 PAPER INCLUDING THE CODE OF 1674 01:09:11,647 --> 01:09:11,914 COURSE. 1675 01:09:11,981 --> 01:09:14,617 THERE'S A QUESTION IN THE 1676 01:09:14,683 --> 01:09:15,150 AUDIENCE HERE. 1677 01:09:15,217 --> 01:09:17,152 >> THERE'S A QUESTION FROM THE 1678 01:09:17,219 --> 01:09:17,853 AUDIENCE. 1679 01:09:17,920 --> 01:09:19,154 >> YES, HI, SO REALLY GREAT 1680 01:09:19,221 --> 01:09:21,490 TOPIC, IT'S EASY FOR US TO MAKE 1681 01:09:21,557 --> 01:09:23,826 [INDISCERNIBLE] THOSE AND GITHUB 1682 01:09:23,893 --> 01:09:25,194 AND THE REPOSITORY WHERE WE DUMP 1683 01:09:25,261 --> 01:09:28,497 EVERYTHING AND IT SHOULD BE 1684 01:09:28,564 --> 01:09:29,899 RUNNING BUT [INDISCERNIBLE] AS 1685 01:09:29,965 --> 01:09:30,833 THE SOFTWARE HAS BECOME NEW 1686 01:09:30,900 --> 01:09:33,702 VERSION AND SO ON, IT'S 1687 01:09:33,769 --> 01:09:35,004 PRACTICALLY IMPOSSIBLE TO RUN 1688 01:09:35,070 --> 01:09:37,039 THE ANALYSIS PEOPLE HAVE DONE SO 1689 01:09:37,106 --> 01:09:39,308 IN A WAY THAT'S BRINGING IT BACK 1690 01:09:39,375 --> 01:09:41,510 TO YOU, THE PUBLISHING ENTITY 1691 01:09:41,577 --> 01:09:42,645 RIGHT, SHOULD YOU HAVE SOME 1692 01:09:42,711 --> 01:09:44,179 QUALITY CONTROL TO MAKE SURE THE 1693 01:09:44,246 --> 01:09:46,348 CODE CANS KEEP RUNNING AT LEAST 1694 01:09:46,415 --> 01:09:50,853 ON SOME TIME MACHINE SO THATY WE 1695 01:09:50,920 --> 01:09:53,322 CAN REALLY REDO [INDISCERNIBLE]? 1696 01:09:53,389 --> 01:09:55,491 >> YEAH, SO I MET SOME GUYS FROM 1697 01:09:55,558 --> 01:09:57,026 THE NIH WHO WERE WORKING ON A 1698 01:09:57,092 --> 01:09:58,694 NEW SET OF POLICIES UNDER THIS, 1699 01:09:58,761 --> 01:09:59,995 I DON'T KNOW WHERE IT STANDS. 1700 01:10:00,062 --> 01:10:01,664 IT WAS A COUPLE YEARING AGO WHEN 1701 01:10:01,730 --> 01:10:03,499 THEY CAME TO TALK TO ME EMPLOY 1702 01:10:03,566 --> 01:10:05,701 THE HARSH FACT RIGHT NOW IS, YOU 1703 01:10:05,768 --> 01:10:07,536 COULD POST EVERYTHING AT THE 1704 01:10:07,603 --> 01:10:10,306 TIME OF THE PAPER AND AFTER THE 1705 01:10:10,372 --> 01:10:11,807 PAPER'S PUBLISHED, YOU COULD 1706 01:10:11,874 --> 01:10:14,410 TAKE IT ALL DONE AND NOBODY 1707 01:10:14,476 --> 01:10:15,678 WOULD FIGURE IT OUT UNLESS 1708 01:10:15,744 --> 01:10:19,481 SOMEBODY WANTED TO GO LOOK FOR 1709 01:10:19,548 --> 01:10:22,418 IT AGAIN. 1710 01:10:22,484 --> 01:10:24,186 AND TO SOMEHOW MAINTAIN THAT IN 1711 01:10:24,253 --> 01:10:26,055 A WAY THAT MADE IT IMPOSSIBLE TO 1712 01:10:26,121 --> 01:10:28,724 DO THAT IS A VERY EXPENSIVE 1713 01:10:28,791 --> 01:10:29,024 PROPOSITION. 1714 01:10:29,091 --> 01:10:30,359 I DON'T THINK THE JOURNALS COULD 1715 01:10:30,426 --> 01:10:32,094 DO THAT ON OUR OWN. 1716 01:10:32,161 --> 01:10:36,165 IT WOULD REQUIRE THE FUNDING 1717 01:10:36,231 --> 01:10:37,232 AGENCIES TO HELP FIGURE OUT HOW 1718 01:10:37,299 --> 01:10:42,371 WE WERE GOING TO DO THAT BUT 1719 01:10:42,438 --> 01:10:43,906 YOU'RE ABSOLUTELY RIGHT. 1720 01:10:43,973 --> 01:10:46,875 THERE COULD BE OUTDATED CODE YOU 1721 01:10:46,942 --> 01:10:50,045 CAN'T RUN ANYMORE OR THERE COULD 1722 01:10:50,112 --> 01:10:53,849 BE REPOSITORIES THAT GO AWAY 1723 01:10:53,916 --> 01:10:55,584 BECAUSE WE DON'T HAVE SUPER 1724 01:10:55,651 --> 01:10:57,886 STRICT RULES ABOUT WHAT THEY'RE 1725 01:10:57,953 --> 01:11:00,756 GOING TO USE. 1726 01:11:00,823 --> 01:11:03,525 AND THIS IS A COST AND ACTIVITY 1727 01:11:03,592 --> 01:11:06,495 OF SCIENTIFIC PUBLISHING THAT 1728 01:11:06,562 --> 01:11:08,497 NOBODY HAS PUT AS MUCH TIME INTO 1729 01:11:08,564 --> 01:11:15,270 AS IT DESERVES, THAT'S FOR SURE. 1730 01:11:15,337 --> 01:11:17,006 >> LET'S CONSIDER QUESTIONS 1731 01:11:17,072 --> 01:11:22,645 ABOUT THE PROPRIETARY ASPECT OF 1732 01:11:22,711 --> 01:11:27,449 AI, WHO OWNS IT AND IF IT'S 1733 01:11:27,516 --> 01:11:30,319 GOING TO BE PROPRIETARY, WHAT 1734 01:11:30,386 --> 01:11:33,489 ARE THE GUARANTEES FOR 1735 01:11:33,555 --> 01:11:33,922 TRANSPARENCY? 1736 01:11:33,989 --> 01:11:36,492 >> WELL I WILL LET VARDIT TAKE 1737 01:11:36,558 --> 01:11:38,927 FIRST CRACK AT THAT. 1738 01:11:38,994 --> 01:11:39,194 >> OKAY. 1739 01:11:39,261 --> 01:11:40,963 >> THAT IS 1 OF THE MILLION 1740 01:11:41,030 --> 01:11:43,866 DOLLAR QUESTIONS, IN THIS SPACE, 1741 01:11:43,932 --> 01:11:45,401 AND INTERESTINGLY, THIS NATIONAL 1742 01:11:45,467 --> 01:11:46,969 ACADEMY OF MEDICINE INITIATIVE 1743 01:11:47,036 --> 01:11:52,274 THAT I STARTED WITH, INVITED TO 1744 01:11:52,341 --> 01:11:56,045 THE TABLE PARTNERS SUCH AS 1745 01:11:56,111 --> 01:11:57,546 GOOGLE AND MICROSOFT BECAUSE ON 1746 01:11:57,613 --> 01:12:00,115 SOME AI AND HEALTH APPLICATIONS, 1747 01:12:00,182 --> 01:12:01,684 THEY'RE VERY ADVANCED IN THEIR 1748 01:12:01,750 --> 01:12:04,620 RESEARCH AND IT'S OBVIOUS THAT 1749 01:12:04,687 --> 01:12:06,255 THIS SPACE WILL REQUIRE 1750 01:12:06,321 --> 01:12:08,891 PARTNERSHIPS BETWEEN PUBLISH AND 1751 01:12:08,957 --> 01:12:10,626 PRIVATE ENTITIES, ANY GOVERNANCE 1752 01:12:10,693 --> 01:12:12,227 THAT DOESN'T ADDRESS THOSE 1753 01:12:12,294 --> 01:12:15,564 TENSIONS BETWEEN PUBLIC AND 1754 01:12:15,631 --> 01:12:16,565 PRIVATE PLAYERS WILL--YOU KNOW 1755 01:12:16,632 --> 01:12:18,467 WILL HAVE SHORT COMINGS AND WILL 1756 01:12:18,534 --> 01:12:19,735 NOT PROTECT PATIENTS AND 1757 01:12:19,802 --> 01:12:24,106 CLINICIAN ANDS HEALTHCARE 1758 01:12:24,173 --> 01:12:24,707 SYSTEMS APPROPRIATELY, SO 1759 01:12:24,773 --> 01:12:26,141 OBVIOUSLY IF A TOOL IS DEVELOPED 1760 01:12:26,208 --> 01:12:31,280 IN THE PRIVATE SECTOR, IT HAS 1761 01:12:31,346 --> 01:12:32,448 COMPLETELY DIFFERENT LIMITATIONS 1762 01:12:32,514 --> 01:12:36,185 TO ACCESS, THAN IF IT IS FOR 1763 01:12:36,251 --> 01:12:38,020 EXAMPLE, DEVELOPED BY US WITHIN 1764 01:12:38,087 --> 01:12:43,559 THE BRIDGE TO AI PROJECT WITH 1765 01:12:43,625 --> 01:12:44,827 COMPLETELY PUBLIC FUNDING BUT AS 1766 01:12:44,893 --> 01:12:47,463 I JUST NOTED IN MY EXAMPLE, A 1767 01:12:47,529 --> 01:12:49,364 PART OF WHAT WE DO WITHIN THIS 1768 01:12:49,431 --> 01:12:50,933 INITIATIVE THAT IS A PUBLIC 1769 01:12:50,999 --> 01:12:54,136 INITIATIVE IS TO INVITE THE 1770 01:12:54,203 --> 01:12:55,871 START-UPS AND THE PRIVATE SECTOR 1771 01:12:55,938 --> 01:12:59,274 TO JOIN US AROUND THE TABLE TO 1772 01:12:59,341 --> 01:13:00,242 THINK TOGETHER ABOUT GOVERNANCE 1773 01:13:00,309 --> 01:13:03,145 AND ABOUT ISSUES OF ACCESS AND 1774 01:13:03,212 --> 01:13:03,378 EQUITY. 1775 01:13:03,445 --> 01:13:05,347 I THINK IT'S A BIT EARLY TO KNOW 1776 01:13:05,414 --> 01:13:07,750 HOW THIS WILL ALL PLAY OUT AND 1777 01:13:07,816 --> 01:13:12,421 AGAIN, I'M NOT A LAWYER, AND 1778 01:13:12,488 --> 01:13:14,323 I--I WOULD STRUGGLE TO DESCRIBE 1779 01:13:14,389 --> 01:13:15,958 THE VARIOUS MODELS THAT ARE 1780 01:13:16,024 --> 01:13:19,695 CURRENTLY AVAILABLE, BUT THIS IS 1781 01:13:19,762 --> 01:13:20,429 ALL FAST MOVING, UNDER 1782 01:13:20,496 --> 01:13:23,665 DEVELOPMENT AND WE HAVE MORE 1783 01:13:23,732 --> 01:13:24,833 QUESTIONS THAN ANSWERS. 1784 01:13:24,900 --> 01:13:29,738 WHAT ENCOURAGES ME IS THAT I SEE 1785 01:13:29,805 --> 01:13:31,273 TABLES WHERE THE PUBLIC AND THE 1786 01:13:31,340 --> 01:13:32,207 PRIVATE SECTOR ARE TALKING TO 1787 01:13:32,274 --> 01:13:35,377 EACH OTHER AND IT'S LESS SILOED 1788 01:13:35,444 --> 01:13:36,311 THAN BIOMEDICAL RESEARCH USED TO 1789 01:13:36,378 --> 01:13:37,479 BE BECAUSE OF THIS 1790 01:13:37,546 --> 01:13:38,547 ACKNOWLEDGMENT THAT WE CAN'T DO 1791 01:13:38,614 --> 01:13:41,450 IT WITHOUT EACH OTHER, SO, I 1792 01:13:41,517 --> 01:13:42,417 DIDN'T FULLY ANSWER THE 1793 01:13:42,484 --> 01:13:44,186 QUESTION, I JUST LAID OUT SOME 1794 01:13:44,253 --> 01:13:45,187 CONTEXT. 1795 01:13:45,254 --> 01:13:46,488 >> YEAH, AND I THINK, WELL, 1796 01:13:46,555 --> 01:13:49,491 FIRST OF ALL OPEN AI IS A VERY 1797 01:13:49,558 --> 01:13:50,893 IRONIC NAME FOR THEIR COMPANY 1798 01:13:50,959 --> 01:13:52,060 BECAUSE IT'S ANYTHING BUT OPEN 1799 01:13:52,127 --> 01:13:54,696 AS FAR AS THE CODE IS CONCERNED 1800 01:13:54,763 --> 01:13:56,331 AND THAT IS SOMETHING THAT WE 1801 01:13:56,398 --> 01:13:58,534 WORRY BODY WHEN WE WERE PUTTING 1802 01:13:58,600 --> 01:14:00,536 OUR POLICIES TOGETHER FOR CHAT 1803 01:14:00,602 --> 01:14:04,072 GPT BUT WE ALSO WORRY ABOUT WITH 1804 01:14:04,139 --> 01:14:07,242 RESEARCH, BECAUSE IF SOMEBODY 1805 01:14:07,309 --> 01:14:12,981 USES A COMMERCIAL AI PROGRAM, AS 1806 01:14:13,048 --> 01:14:15,150 PART OF THEIR RESEARCH EFFORT, 1807 01:14:15,217 --> 01:14:17,486 THEN, YOU KNOW JUST AS WAS ASKED 1808 01:14:17,553 --> 01:14:20,088 BEFORE ABOUT THE ALGORITHMS, 1809 01:14:20,155 --> 01:14:22,224 NOW, THAT'S A PROPRIETARY 1810 01:14:22,291 --> 01:14:23,025 ALGORITHM THAT'S BEEN USED AND 1811 01:14:23,091 --> 01:14:25,828 HOW ARE WE GOING TO DEPOSIT THAT 1812 01:14:25,894 --> 01:14:28,564 ON GITHUB IF WE DON'T HAVE THE 1813 01:14:28,630 --> 01:14:30,532 CODE AND DO WE ALLOW THAT IN 1814 01:14:30,599 --> 01:14:34,236 BECAUSE THEN YOU WOULD HAVE TO 1815 01:14:34,303 --> 01:14:36,939 SOMEHOW ACCESS THE PROPRIETARY 1816 01:14:37,005 --> 01:14:38,173 LLM IN ORDER TO REPEAT THE 1817 01:14:38,240 --> 01:14:40,108 ANALYSIS IN THE PAPER. 1818 01:14:40,175 --> 01:14:41,310 AND YOU KNOW MY PREDICTION FOR 1819 01:14:41,376 --> 01:14:43,745 WHAT IS GOING TO HAPPEN IS 1820 01:14:43,812 --> 01:14:44,580 EVENTUALLY, WE WILL HAVE ENOUGH 1821 01:14:44,646 --> 01:14:48,851 OF THESE THINGS THAT ARE OPEN 1822 01:14:48,917 --> 01:14:50,285 SOURCE THAT THIS WON'T BE AS BIG 1823 01:14:50,352 --> 01:14:55,858 OF A DEAL AS IT IS RIGHT NOW BUT 1824 01:14:55,924 --> 01:14:59,194 THE PROPRIETARY NATURE OF THESE 1825 01:14:59,261 --> 01:15:00,028 COMMERCIAL ALGORITHMS IS A 1826 01:15:00,095 --> 01:15:01,763 CHALLENGE FOR US ALL BUT WE'RE 1827 01:15:01,830 --> 01:15:03,065 SEEING THAT ACROSS, YOU KNOW IN 1828 01:15:03,131 --> 01:15:05,467 SOCIAL SCIENCE WE HAVE A RELATED 1829 01:15:05,534 --> 01:15:08,103 PROBLEM WHICH IS THAT FACEBOOK 1830 01:15:08,170 --> 01:15:10,072 AND LINKED IN HAVE MORE SOCIAL 1831 01:15:10,138 --> 01:15:13,542 SCIENCE DATA THAN ANY ACADEMIC 1832 01:15:13,609 --> 01:15:16,979 HAD EVER GENERATED. 1833 01:15:17,045 --> 01:15:18,413 WE ARE CONITANTLY HAVING TO 1834 01:15:18,480 --> 01:15:21,149 DECIDE, DO WE PUBLISH PAPERS 1835 01:15:21,216 --> 01:15:23,151 THAT ANALYZE THOSE DATA NOT 1836 01:15:23,218 --> 01:15:24,086 BEING COMPLETELY ASSURED THAT 1837 01:15:24,152 --> 01:15:28,824 THE COMPANIES HAVE ALLOWED THE 1838 01:15:28,891 --> 01:15:31,326 ACADEMICS WHO HAVE DONE THE 1839 01:15:31,393 --> 01:15:32,628 ANALYSIS FULL ACCESS TO THE 1840 01:15:32,694 --> 01:15:33,095 DATA. 1841 01:15:33,161 --> 01:15:35,063 NOW MOSTLY IF IT'S A REALLY 1842 01:15:35,130 --> 01:15:36,031 IMPORTANT FINDING, WE WILL COME 1843 01:15:36,098 --> 01:15:37,199 DOWN ON THE SIDE THAT IT'S 1844 01:15:37,266 --> 01:15:38,634 BETTER FOR THE WORLD TO SEE THAT 1845 01:15:38,700 --> 01:15:41,270 AND DO THE BEST WE CAN AT 1846 01:15:41,336 --> 01:15:44,907 WORKING THAT OUT, BUT I THINK 1847 01:15:44,973 --> 01:15:49,378 WOOR IN 1848 01:15:49,444 --> 01:15:51,013 WE'RE IN A MOMENT NOW WHICH IS 1849 01:15:51,079 --> 01:15:52,948 PROBABLY UNUSUAL IN MY TIME AND 1850 01:15:53,015 --> 01:15:54,716 I GUESS MAYBE WE'RE IN A SIMILAR 1851 01:15:54,783 --> 01:15:57,252 MOMENT A FEW OTHER TIMES BUT 1852 01:15:57,319 --> 01:15:59,121 RIGHT NOW, BETWEEN THE SOCIAL 1853 01:15:59,187 --> 01:16:02,391 MEDIA COMPANIES HAVING ALL THE 1854 01:16:02,457 --> 01:16:04,259 SOCIAL SCIENCE DATA, THE HEALTH 1855 01:16:04,326 --> 01:16:06,028 INSURANCE COMPANIES HAVING ALL 1856 01:16:06,094 --> 01:16:07,329 THE HEALTH INSURANCE DATA AND 1857 01:16:07,396 --> 01:16:10,599 THE AI COMPANIES HAVING THE AI 1858 01:16:10,666 --> 01:16:13,602 ALGORITHMS, YOU KNOW, DOING THE 1859 01:16:13,669 --> 01:16:15,437 MOST AMAZING SCIENCE THAT WE CAN 1860 01:16:15,504 --> 01:16:17,773 DO, USING THOSE ASSETS IS ALWAYS 1861 01:16:17,839 --> 01:16:20,542 A CHALLENGE FOR US IN TERMS OF 1862 01:16:20,609 --> 01:16:21,843 HOW WE MAKE THIS ACCESSIBLE TO 1863 01:16:21,910 --> 01:16:29,418 THE PUBLIC AS WE POSSIBLY CAN. 1864 01:16:29,484 --> 01:16:30,719 >> ALONG THAT LINE, IF YOU 1865 01:16:30,786 --> 01:16:38,393 VISUALIZE A MODEL OF PUBLIC AND 1866 01:16:38,460 --> 01:16:45,000 PRIVATE CREATION OF AI SYSTEMS, 1867 01:16:45,067 --> 01:16:49,271 HOW DO YOU SEE WE COULD BE 1868 01:16:49,338 --> 01:16:50,038 REGULATED? 1869 01:16:50,105 --> 01:16:52,474 IS THAT A FEDERAL 1870 01:16:52,541 --> 01:16:53,709 RESPONSIBILITY, I REALIZE 1871 01:16:53,775 --> 01:16:54,409 NEITHER REVIEW TRUSTEES 1872 01:16:54,476 --> 01:16:55,577 [INDISCERNIBLE] I THINK BUT JUST 1873 01:16:55,644 --> 01:16:59,348 FROM THE STANDPOINT OF YOUR IMUT 1874 01:16:59,414 --> 01:17:00,582 FEELING ABOUT IT, HOW WOULD YOU 1875 01:17:00,649 --> 01:17:03,752 LIKE TO SEE IT REGULATED? 1876 01:17:03,819 --> 01:17:05,320 >> WELL, THE CLINICAL SIDE IS 1877 01:17:05,387 --> 01:17:06,488 WHERE WE'RE PROBABLY LIKELY TO 1878 01:17:06,555 --> 01:17:08,590 SEE THAT THE SOONEST, I WOULD 1879 01:17:08,657 --> 01:17:10,325 THINK GIVEN THE LICENSING AND 1880 01:17:10,392 --> 01:17:12,728 EVERYTHING THAT GOES ON. 1881 01:17:12,794 --> 01:17:17,432 SO, I DON'T KNOW WHAT PART IT 1882 01:17:17,499 --> 01:17:18,333 THINKS ABOUT THAT? 1883 01:17:18,400 --> 01:17:21,837 >> I WILL NOTE AGAIN THAT IT'S 1884 01:17:21,903 --> 01:17:22,704 THE NATIONAL ACADEMY OF MEDICINE 1885 01:17:22,771 --> 01:17:25,307 THAT IS LOOKING AT THIS. 1886 01:17:25,374 --> 01:17:27,743 I THINK RIGHT NOW, WE'RE SEEING 1887 01:17:27,809 --> 01:17:29,978 A SITUATION WHERE DIFFERENT 1888 01:17:30,045 --> 01:17:32,381 TOOLS ARE BEING ROLLED OUT IN 1889 01:17:32,447 --> 01:17:35,684 DIFFERENT SYSTEMS BASED ON 1890 01:17:35,751 --> 01:17:38,420 PRETTY LOCAL GOVERNANCE 1891 01:17:38,487 --> 01:17:39,121 APPROACHES, BUT EVERYBODY'S 1892 01:17:39,187 --> 01:17:40,622 AWARE OF THE FACT THAT THIS 1893 01:17:40,689 --> 01:17:43,625 NEEDS TO BE SYSTEMIC, THERE'S 1894 01:17:43,692 --> 01:17:46,595 EVEN TALK ABOUT AI IN HELT AS A 1895 01:17:46,661 --> 01:17:48,330 GLOBAL CHALLENGE AND THAT THE 1896 01:17:48,397 --> 01:17:50,298 BEST APPROACH WOULD BE 1897 01:17:50,365 --> 01:17:51,133 INTERNATIONAL GOVERNANCE, YOU 1898 01:17:51,199 --> 01:17:54,169 KNOW THAT'S ALWAYS HARD TO 1899 01:17:54,236 --> 01:17:56,171 ACHIEVE BUT I THINK THERE'S AN 1900 01:17:56,238 --> 01:17:57,572 OVERALL RECOGNITION FROM AN 1901 01:17:57,639 --> 01:18:00,375 ETHICAL PERSPECTIVE IN TERMS OF 1902 01:18:00,442 --> 01:18:02,010 PROTECTION AND PRIVACY, IN TERMS 1903 01:18:02,077 --> 01:18:04,312 OF PREVENTION AND BIAS, IN TERMS 1904 01:18:04,379 --> 01:18:05,981 OF RIGHT TO KNOW, ALL THOSE 1905 01:18:06,048 --> 01:18:09,151 CHALLENGES THAT I STARTED WITH, 1906 01:18:09,217 --> 01:18:11,586 THAT THE MORE LOCAL GOVERNANCE 1907 01:18:11,653 --> 01:18:13,422 FRAMEWORK, THE MORE IT'S A PATCH 1908 01:18:13,488 --> 01:18:15,757 WORK, THE LESS IT WILL BE GOOD 1909 01:18:15,824 --> 01:18:18,060 FOR PATIENTS, SO THERE'S THIS 1910 01:18:18,126 --> 01:18:21,163 AMBITION TO MAKE THIS A NATIONAL 1911 01:18:21,229 --> 01:18:23,131 EFFORT, HOW IT WILL ACTUALLY 1912 01:18:23,198 --> 01:18:26,701 PLAY OUT, I REALLY DON'T KNOW. 1913 01:18:26,768 --> 01:18:28,370 >> YEAH, I MEAN, IN 1914 01:18:28,437 --> 01:18:30,338 PSYCHOTHERAPY, THERE ARE A LOT 1915 01:18:30,405 --> 01:18:32,174 OF ALGORITHMS BEING DEPLOYED 1916 01:18:32,240 --> 01:18:33,742 WITH VERY LITTLE REGULATION, IT 1917 01:18:33,809 --> 01:18:36,711 SEEMS TO ME, UNLESS I'M MISSING 1918 01:18:36,778 --> 01:18:42,684 SOMETHING, AND YOU KNOW, THAT 1919 01:18:42,751 --> 01:18:45,153 COULD BE PRETTY WORRISOME. 1920 01:18:45,220 --> 01:18:47,856 I WENT TO A MEETING WITH A BUNCH 1921 01:18:47,923 --> 01:18:51,393 OF AI MENTAL HEALTH FOLKS AND 1922 01:18:51,460 --> 01:18:54,262 YOU KNOW THE AI ALGORITHMS, 1923 01:18:54,329 --> 01:18:57,799 THERE ARE GREAT THINGS THEY CAN 1924 01:18:57,866 --> 01:18:59,568 DO IN COGNITIVE BEHAVIORIAL 1925 01:18:59,634 --> 01:19:03,338 THERAPY AND PROBABLY A FEW OTHER 1926 01:19:03,405 --> 01:19:04,406 THINGS BUT THE AI'S JOB IS TO 1927 01:19:04,473 --> 01:19:07,843 KEEP YOU FROM HANGING UP, RIGHT? 1928 01:19:07,909 --> 01:19:09,845 AND SO, IN THE END, IT'S 1929 01:19:09,911 --> 01:19:12,013 PROGRAMMED TO TELL YOU TOUGH 1930 01:19:12,080 --> 01:19:14,015 THAT WILL KEEP YOU RESPONDING TO 1931 01:19:14,082 --> 01:19:15,550 IT WHICH MAY MEAN THAT IT WILL 1932 01:19:15,617 --> 01:19:17,185 TELL YOU THINGS THAT YOU WANT TO 1933 01:19:17,252 --> 01:19:18,487 HEAR THAT WILL KEEP YOU ON THE 1934 01:19:18,553 --> 01:19:22,624 HOOK THAT MAY NOT BE THE THINGS 1935 01:19:22,691 --> 01:19:23,692 A TRAINED THERAPIST WOULD TELL 1936 01:19:23,758 --> 01:19:26,828 YOU AND HOW PRECISELY WE'RE 1937 01:19:26,895 --> 01:19:33,268 GOING TO FIX THAT, I DON'T KNOW. 1938 01:19:33,335 --> 01:19:37,973 BUT THERE ARE IN MY OPINION VERY 1939 01:19:38,039 --> 01:19:39,307 LIGHTLY REGULATED ALGORITHMS 1940 01:19:39,374 --> 01:19:41,243 BEING USED FOR PSYCHOTHERAPY 1941 01:19:41,309 --> 01:19:42,344 RIGHT NOW. 1942 01:19:42,410 --> 01:19:45,247 AND I DON'T KNOW, I DON'T KNOW 1943 01:19:45,313 --> 01:19:47,349 HOW MUCH WE KNOW ABOUT WHAT 1944 01:19:47,415 --> 01:19:49,251 THEY'RE DOING, I AM GLAD THAT 1945 01:19:49,317 --> 01:19:54,289 NAM IS WORKING ON THIS KIND OF 1946 01:19:54,356 --> 01:19:54,489 THING. 1947 01:19:54,556 --> 01:19:55,824 >> ARE EITHER OF YOU CONCERNED 1948 01:19:55,891 --> 01:19:57,125 ABOUT A POSSIBLY INCREASING 1949 01:19:57,192 --> 01:20:02,898 PRESENCE OF SOCIAL MEDIA AS THE 1950 01:20:02,964 --> 01:20:11,173 MEANS OF MAKING SOME KIND OF AI 1951 01:20:11,239 --> 01:20:12,941 AVAILABLE EN MASS WITHOUT ANY 1952 01:20:13,008 --> 01:20:13,475 REGULATION AT ALL? 1953 01:20:13,542 --> 01:20:15,177 IS THAT A PRACTICAL MATTER YOU 1954 01:20:15,243 --> 01:20:17,279 MIGHT SEE ARISING IN THE NEAR 1955 01:20:17,345 --> 01:20:17,512 FUTURE? 1956 01:20:17,579 --> 01:20:19,648 >> SO HOW EXACTLY ARE YOU SAYING 1957 01:20:19,714 --> 01:20:20,782 SOCIAL MEDIA WOULD--ARE YOU 1958 01:20:20,849 --> 01:20:22,517 TALKING ABOUT FREE ON SOME 1959 01:20:22,584 --> 01:20:23,218 WEBSITE? 1960 01:20:23,285 --> 01:20:26,788 OR SOCIAL MEDIA PROMOTING IT? 1961 01:20:26,855 --> 01:20:27,088 >> YEAH. 1962 01:20:27,155 --> 01:20:28,557 >> YEAH, WELL, SOCIAL MEDIA'S 1963 01:20:28,623 --> 01:20:29,991 GOOD AT PROMOTING THING ANDS SO, 1964 01:20:30,058 --> 01:20:35,764 YEAH, IT COULD BE EASILY BE 1965 01:20:35,830 --> 01:20:39,167 PROMOTING THE WRONG THING FOR 1966 01:20:39,234 --> 01:20:40,435 WHO CONVINCE THEMSELVES AS 1967 01:20:40,502 --> 01:20:42,938 EVERYONE DOES WITH THE INTERNET 1968 01:20:43,004 --> 01:20:46,241 THAT THEY'VE DORPHED SOMETHING 1969 01:20:46,308 --> 01:20:46,942 USEFUL. 1970 01:20:47,008 --> 01:20:52,147 >> ON THAT NOTE, WE ALL KNOW HOW 1971 01:20:52,214 --> 01:20:54,649 DR. GOOGLE CHANGED CLINICAL 1972 01:20:54,716 --> 01:20:55,817 CONVERSATIONS WITH PATIENTS COME 1973 01:20:55,884 --> 01:20:57,986 AND THEY'VE ALREADY PRETTY MUCH 1974 01:20:58,053 --> 01:20:59,354 DIAGNOSED THEMSELVES AND THEY 1975 01:20:59,421 --> 01:21:01,223 TELL THEIR CLINICIAN WHAT 1976 01:21:01,289 --> 01:21:05,594 MEDICATION THEY WANT PRESCRIBED, 1977 01:21:05,660 --> 01:21:09,231 WITH CHAT GPT, THE STAKES ARE 1978 01:21:09,297 --> 01:21:11,566 HIGHER, THE ASKING CHAT GPT FOR 1979 01:21:11,633 --> 01:21:12,867 CLINICAL ADVICE IS MANAGE THAT'S 1980 01:21:12,934 --> 01:21:16,204 ALREADY HAPPENING AND IT'S 1981 01:21:16,271 --> 01:21:18,373 GIVING MUCH BETTER ADVICE THAN 1982 01:21:18,440 --> 01:21:21,009 THE TRADITIONAL SEARCH ENGINES 1983 01:21:21,076 --> 01:21:22,677 BUT WHEN IT HALLUCINATES, WHEN 1984 01:21:22,744 --> 01:21:25,413 IT MAKES UP THINGS, THEY SOUND 1985 01:21:25,480 --> 01:21:26,248 VERY GOOD. 1986 01:21:26,314 --> 01:21:28,750 THEY SOUND VERY CONVINCING. 1987 01:21:28,817 --> 01:21:32,220 SO, THIS IS VERY RISKY IN TERMS 1988 01:21:32,287 --> 01:21:36,024 OF CONVINCING PATIENTS AND 1989 01:21:36,091 --> 01:21:37,492 POTENTIALLY EEIVET CONVINCING 1990 01:21:37,559 --> 01:21:38,693 CLINICIANS THAT THE ADVICE IS 1991 01:21:38,760 --> 01:21:39,027 SOUND. 1992 01:21:39,094 --> 01:21:41,129 WE ALL KNOW THAT GENERATIVE AI 1993 01:21:41,196 --> 01:21:42,364 CAN MAKE UP SCIENTIFIC 1994 01:21:42,430 --> 01:21:44,499 REFERENCES THAT DOESN'T EXIST, 1995 01:21:44,566 --> 01:21:46,835 IT CAN MAKE UP AN ENTIRE BODY OF 1996 01:21:46,901 --> 01:21:47,669 LITERATURE THAT DOESN'T EXIST 1997 01:21:47,736 --> 01:21:48,937 AND SEEM TO RELY ON THAT 1998 01:21:49,004 --> 01:21:50,805 EVIDENCE IS IN THERE, SO I WOULD 1999 01:21:50,872 --> 01:21:55,744 SAY THAT IN TERMS OF PATIENTS 2000 01:21:55,810 --> 01:21:58,813 GOING ONLINE FOR HELP, THE RISK 2001 01:21:58,880 --> 01:22:02,417 IS BIGGER BECAUSE THE QUALITY IS 2002 01:22:02,484 --> 01:22:03,551 BETTER PARADOXICALLY, AND THEN, 2003 01:22:03,618 --> 01:22:07,989 GOING BACK TO SOCIAL MEDIA, IT'S 2004 01:22:08,056 --> 01:22:11,960 NOT JUST THE SOCIAL MEDIA CAN 2005 01:22:12,027 --> 01:22:14,496 AMPLIFY OR HYPE UP WHAT AI CAN 2006 01:22:14,562 --> 01:22:17,399 DELIVER, IT'S ALSO THE USE OF AI 2007 01:22:17,465 --> 01:22:19,501 TO CREATE SOCIAL MEDIA MESSAGING 2008 01:22:19,567 --> 01:22:22,137 THAT COULD BE BASED ON 2009 01:22:22,203 --> 01:22:22,971 MISINFORMATION, DISINFORMATION 2010 01:22:23,038 --> 01:22:27,042 AND WELL, WE'RE IN AN ELECTION 2011 01:22:27,108 --> 01:22:29,678 YEAR, AND ACTUALLY IMPACT 2012 01:22:29,744 --> 01:22:32,080 DEMOCRATIC POSTS THAT GO WAY 2013 01:22:32,147 --> 01:22:33,148 BEYOND HEALTH AND IMPACT THE 2014 01:22:33,214 --> 01:22:37,118 TRUST NOT JUST IN SCIENCE BUT IN 2015 01:22:37,185 --> 01:22:39,120 OUR ENTIRE SOCIAL FABRIC. 2016 01:22:39,187 --> 01:22:42,624 SO, AGAIN, THE RISKS ARE--I KNOW 2017 01:22:42,691 --> 01:22:46,394 A LOT OF PEOPLE CALL THEM 2018 01:22:46,461 --> 01:22:47,929 EXSTENTIAL RISK BECAUSE BEYOND 2019 01:22:47,996 --> 01:22:50,098 HEALTH, OF THE POWER OF ARK I TO 2020 01:22:50,165 --> 01:22:52,233 FRAME, ENHANCE AND DELIVER 2021 01:22:52,300 --> 01:23:00,108 MESSAGES IS UNPRECEDENTED. 2022 01:23:00,175 --> 01:23:00,442 >> OKAY. 2023 01:23:00,508 --> 01:23:02,744 >> I WAS WONDERING IF THE 2 OF 2024 01:23:02,811 --> 01:23:07,349 YOU CAN ADDRESS THE QUESTION OF 2025 01:23:07,415 --> 01:23:11,353 HOW LIKELY CHATGPT WHEN YOU ASK 2026 01:23:11,419 --> 01:23:13,288 A QUESTION, CAN DISTINGUISH 2027 01:23:13,355 --> 01:23:16,458 BETWEEN FAKE NEWS AND REAL NEWS, 2028 01:23:16,524 --> 01:23:18,093 IN SCIENCE OR IN HEALTH AND IN 2029 01:23:18,159 --> 01:23:20,428 MEDICINE ? 2030 01:23:20,495 --> 01:23:21,830 WHAT IS THE LIKELIHOOD IT CAN 2031 01:23:21,896 --> 01:23:23,698 GIVE YOU BOTH SIDES OR IS IT 2032 01:23:23,765 --> 01:23:29,037 GOING TO TAKE JUST WHATEVER THIS 2033 01:23:29,104 --> 01:23:31,940 IN THE MEDIA MORE LIKELY TO BE 2034 01:23:32,006 --> 01:23:32,807 INCLUDED IN THE RESPONSE? 2035 01:23:32,874 --> 01:23:35,076 WHAT DO YOU THINK ABOUT THAT? 2036 01:23:35,143 --> 01:23:39,080 HOW DO WE DEAL WITH THAT? 2037 01:23:39,147 --> 01:23:42,717 >> WELL, I'M ALWAYS IMPRESSED 2038 01:23:42,784 --> 01:23:45,487 WHEN I ASK--THIS IS PURLY 2039 01:23:45,553 --> 01:23:47,522 ANECDOTAL, I MEAN SOMEBODY WILL 2040 01:23:47,589 --> 01:23:55,029 STUDY THIS BUT IT DOES SEEM TO 2041 01:23:55,096 --> 01:23:57,365 DO A CONSCIENTIOUS JOB IF YOU 2042 01:23:57,432 --> 01:23:59,834 ASK IT A QUESTION THAT IS BASED 2043 01:23:59,901 --> 01:24:01,569 ON MISINFORMATION, IT'LL USUALLY 2044 01:24:01,636 --> 01:24:02,137 CORRECT YOU. 2045 01:24:02,203 --> 01:24:03,905 NOW WILL IT KEEP DOING THAT IF 2046 01:24:03,972 --> 01:24:05,540 YOU ARGUE WITH IT BUT CRITERIA I 2047 01:24:05,607 --> 01:24:06,474 DON'T KNOW, I MEAN IT'S 2048 01:24:06,541 --> 01:24:08,543 PROGRAMMED TO KEEP YOU ENGAGED 2049 01:24:08,610 --> 01:24:11,246 SO YOU GO, I DON'T KNOW WELL, I 2050 01:24:11,312 --> 01:24:12,680 DO THINK VACCINES CAUSE AUTISM 2051 01:24:12,747 --> 01:24:14,649 AND HERE'S WHY, WHAT IT WILL DO 2052 01:24:14,716 --> 01:24:15,650 IF YOU STAY IN CONVERSATION WITH 2053 01:24:15,717 --> 01:24:18,486 IT BUT IF YOU ASK IT, DO 2054 01:24:18,553 --> 01:24:19,988 VACCINES CAUSE AUTISM, IT WILL 2055 01:24:20,054 --> 01:24:21,189 SAY NO, WAKE FIELD'S PAPER WAS 2056 01:24:21,256 --> 01:24:23,425 WRONG AND IT WAS RETRACTED AND 2057 01:24:23,491 --> 01:24:25,393 IT USUALLY GETS ALL THAT 2058 01:24:25,460 --> 01:24:25,627 CORRECT. 2059 01:24:25,693 --> 01:24:27,595 I TEACH A CLASS ABOUT SCIENCE 2060 01:24:27,662 --> 01:24:29,497 AND POLITICS AT GW AND I HAVE MY 2061 01:24:29,564 --> 01:24:36,070 STUDENTS DO A LOT OF THESE THING 2062 01:24:36,137 --> 01:24:37,972 AND IT--AGAIN, THIS PURELY 2063 01:24:38,039 --> 01:24:39,741 ANECDOTA, BOUND TO BE A WAY, A 2064 01:24:39,808 --> 01:24:40,809 SERIOUS ANALYSIS OF THIS COULD 2065 01:24:40,875 --> 01:24:43,111 BE DONE BUT FOR MY STUDENTS WHEN 2066 01:24:43,178 --> 01:24:44,512 THEY ASK QUESTIONS ABOUT THE 2067 01:24:44,579 --> 01:24:49,484 VARIOUS THINGS WE GO OVER, IT AT 2068 01:24:49,551 --> 01:24:54,389 LEAST STARTS TRYING TO GIVE YOU 2069 01:24:54,456 --> 01:24:55,290 THE RIGHT ANSWER. 2070 01:24:55,356 --> 01:24:56,825 NOW WHAT WORRIES ME IS IF YOU 2071 01:24:56,891 --> 01:24:58,493 GET IN AN ARGUMENT WITH IT, WHAT 2072 01:24:58,560 --> 01:25:01,996 WILL IT DO TO KEEP YOU--TO KEEP 2073 01:25:02,063 --> 01:25:02,564 YOU ENGAGED. 2074 01:25:02,630 --> 01:25:07,435 I THINK THAT COULD GO ALL KINDS 2075 01:25:07,502 --> 01:25:08,570 OF CRAZY PLACES. 2076 01:25:08,636 --> 01:25:10,872 >> SO I RECENTLY PARTICIPATED IN 2077 01:25:10,939 --> 01:25:15,176 A PANEL WITH PETER LEE, 2078 01:25:15,243 --> 01:25:16,878 MICROSOFT PRESIDENT FOR RESEARCH 2079 01:25:16,945 --> 01:25:19,881 IN INCUBATION AND HE ALSO 2080 01:25:19,948 --> 01:25:22,383 PROVIDED THOSE ANECDOTAL STORIES 2081 01:25:22,450 --> 01:25:26,221 ABOUT HIS OWN ATTEMPTS TO 2082 01:25:26,287 --> 01:25:29,424 MISLEAD CHATGPT4, SO HE GAVE A 2083 01:25:29,491 --> 01:25:31,559 LIST OF SYMPTOMS AND HE NUBBING 2084 01:25:31,626 --> 01:25:34,229 IN SOMETHING THAT WOULDN'T ALIGN 2085 01:25:34,295 --> 01:25:35,129 AND THEN A RECOMMENDATION FOR 2086 01:25:35,196 --> 01:25:38,900 TREATMENT THAT HAD A MISTAKE 2087 01:25:38,967 --> 01:25:41,336 BUILD-IN, AND ALL THOSE THINGS 2088 01:25:41,402 --> 01:25:46,140 WERE PICKED UP. 2089 01:25:46,207 --> 01:25:49,143 THE ISSUE IS WITH GENERAL MODELS 2090 01:25:49,210 --> 01:25:52,380 IS THAT THEY'RE TRAINING ON DATA 2091 01:25:52,447 --> 01:25:57,852 SETS THAT ARE NOT SPECIFIC AND 2092 01:25:57,919 --> 01:25:58,586 PARTICULAR. 2093 01:25:58,653 --> 01:26:00,121 SO WITH SIMPLE MISTAKES IT PICKS 2094 01:26:00,188 --> 01:26:01,523 UP, BUT I THINK THE WAY THAT 2095 01:26:01,589 --> 01:26:03,925 SOME PEOPLE ARGUE WE SHOULD GO 2096 01:26:03,992 --> 01:26:06,461 FORWARD IS REALLY CURATE DATA 2097 01:26:06,528 --> 01:26:10,798 SETS FOR SPECIFIC USES AND NOT 2098 01:26:10,865 --> 01:26:13,434 ALLOW--IS NOT MOVE FORWARD WITH 2099 01:26:13,501 --> 01:26:16,804 VERY IMNL MODELS FOR PARTICULAR 2100 01:26:16,871 --> 01:26:21,709 MEDICAL KNOLLS, OBJECTIVES, 2101 01:26:21,776 --> 01:26:23,578 THAT'S EXACTLY WHAT BRIDGE 2 AI 2102 01:26:23,645 --> 01:26:25,680 IS TRYING TO DO, CURATE THIS 2103 01:26:25,747 --> 01:26:30,018 GOLD DATA SET FOR TRAINING. 2104 01:26:30,084 --> 01:26:33,221 SO I TEND TO AGREE THAT AT A 2105 01:26:33,288 --> 01:26:35,223 SUPERFICIAL LEVEL BASED ON 2106 01:26:35,290 --> 01:26:36,724 ANECDOTAL REPORTING THAT WE'RE 2107 01:26:36,791 --> 01:26:38,660 HEARING EVERYWHERE, IT'S PRETTY 2108 01:26:38,726 --> 01:26:41,329 GOOD AT PICKING UP 2109 01:26:41,396 --> 01:26:43,031 MISINFORMATION OR MISTAKES THAT 2110 01:26:43,097 --> 01:26:46,601 ARE BUILT IN TO TEST IT, BUT HOW 2111 01:26:46,668 --> 01:26:48,536 RELIABLE IT IS, I DON'T THINK 2112 01:26:48,603 --> 01:26:49,871 ANYBODY KNOWS AT THIS POINT AND 2113 01:26:49,938 --> 01:26:53,875 THE TECHNOLOGY IS IMPROVING 2114 01:26:53,942 --> 01:26:56,544 LITERALLY EVERY DAY. 2115 01:26:56,611 --> 01:27:01,583 >> SO, IF WE HAVE A QUESTION, IF 2116 01:27:01,649 --> 01:27:03,618 AI CONTINUES ITS PRESENT RATE OF 2117 01:27:03,685 --> 01:27:04,919 DEVELOPMENT AND EXTENSION AND 2118 01:27:04,986 --> 01:27:08,957 EVERYTHING, WHAT DO YOU THINK 2119 01:27:09,023 --> 01:27:12,360 THE EFFECT OF THE SAY WITHIN 2120 01:27:12,427 --> 01:27:16,931 ABOUT 5 YEARS ON MEDICAL CARE IS 2121 01:27:16,998 --> 01:27:17,999 GOING TO BE? 2122 01:27:18,066 --> 01:27:22,003 >> MY CRYSTAL BALL SAYS THAT I 2123 01:27:22,070 --> 01:27:24,539 THINK 1 OF THE PLACES WHERE 2124 01:27:24,606 --> 01:27:31,379 PEOPLE ARE REALLY EXCITED IS THE 2125 01:27:31,446 --> 01:27:31,913 NOTION OF REDUCING 2126 01:27:31,980 --> 01:27:33,982 ADMINISTRATIVE BURDEN ON 2127 01:27:34,048 --> 01:27:37,118 CLINICIANS, SO, SYSTEMS THAT 2128 01:27:37,185 --> 01:27:38,720 GENERATE NOTES, AMBIENT 2129 01:27:38,786 --> 01:27:42,924 REPORTING OF CONVERSATIONS, 2130 01:27:42,991 --> 01:27:43,925 SYNTHESIS, PROPOSING TREATMENT, 2131 01:27:43,992 --> 01:27:45,059 ACCOMMODATIONS AND TESTS THAT 2132 01:27:45,126 --> 01:27:47,829 THE CLINICIAN CAN THEN EDIT 2133 01:27:47,895 --> 01:27:49,097 INSTEAD OF GENERATE, THESE 2134 01:27:49,163 --> 01:27:51,499 THINGS ARE ALREADY HERE, THEY'RE 2135 01:27:51,566 --> 01:27:53,801 WORKING QUITE WELL, AS I SAID, 2136 01:27:53,868 --> 01:27:55,470 THERE'S THE RISK OF DE-SKILLING, 2137 01:27:55,536 --> 01:27:57,005 WE DON'T WANT TO OVERRELY ON 2138 01:27:57,071 --> 01:27:59,674 THEM BUT I THINK 1 OF THE FIRST 2139 01:27:59,741 --> 01:28:01,876 IMPACS WE WILL SEE IS IN 2140 01:28:01,943 --> 01:28:06,347 REDUCING BURN OUT AND REDUCING 2141 01:28:06,414 --> 01:28:07,081 ADMINISTRATIVE BURDEN. 2142 01:28:07,148 --> 01:28:09,017 OF COURSE, WE WOULD LIKE THOSE 2143 01:28:09,083 --> 01:28:13,287 RESOURCES THAT ARE LIBERATED TO 2144 01:28:13,354 --> 01:28:17,058 GO INTO PATIENT CARE AND HUMAN 2145 01:28:17,125 --> 01:28:18,693 CONTACT AND NOT JUST YOU KNOW 2146 01:28:18,760 --> 01:28:20,762 INCREASE THE BURDEN ON 2147 01:28:20,828 --> 01:28:22,263 CLINICIANS BY EXPECTING THEM TO 2148 01:28:22,330 --> 01:28:25,099 SEE MORE PATIENTS BECAUSE THEY 2149 01:28:25,166 --> 01:28:31,072 HAVE TO WRITE LESS NOTES IS 2150 01:28:31,139 --> 01:28:33,041 SOMETHING ABOUT THE CLENICAL, 2151 01:28:33,107 --> 01:28:34,008 SOMETHING ABOUT THE CLINICAL 2152 01:28:34,075 --> 01:28:36,044 INTEGRATION WILL BE A BIG CHANGE 2153 01:28:36,110 --> 01:28:37,945 PROBABLY IN THE FIRST 5 YEARS 2154 01:28:38,012 --> 01:28:40,348 AND THEN IMAGING, THE POWER OF 2155 01:28:40,415 --> 01:28:43,851 THE ALGORITHMS AND ACCURATELY, 2156 01:28:43,918 --> 01:28:45,520 READING AND INTRURP RETINAL 2157 01:28:45,586 --> 01:28:46,220 LOCATIONING IMAGES BETTER THAN 2158 01:28:46,287 --> 01:28:49,290 THE HUMAN EYE IS ALSO BECOMING, 2159 01:28:49,357 --> 01:28:51,492 YOU KNOW VERY WELL TEABED SO 2160 01:28:51,559 --> 01:28:52,527 THIS IS PROBABLY ANOTHER CHANGE 2161 01:28:52,593 --> 01:28:55,096 THAT WE WILL SEE IN THE COMING 5 2162 01:28:55,163 --> 01:28:57,598 YEARS WHERE, THE STANDARD OF 2163 01:28:57,665 --> 01:29:01,169 CARE WILL SWITCH FROM AI WITH 2164 01:29:01,235 --> 01:29:02,904 SPECIFIC IMAGES AND SOMETIMES TO 2165 01:29:02,970 --> 01:29:06,074 ALMOST STANDARD OF CARE OF 2166 01:29:06,140 --> 01:29:07,542 CAPACITY IN CERTAIN DIAGNOSTIC 2167 01:29:07,608 --> 01:29:12,046 IMAGES AND SOME CONTEXT THAT AI 2168 01:29:12,113 --> 01:29:13,681 USED WILL BECOME THE STANDARD OF 2169 01:29:13,748 --> 01:29:15,583 CARE, SO THESE ARE THE 2 THINGS 2170 01:29:15,650 --> 01:29:19,654 THAT I'M HEARING, ARE THE MOST 2171 01:29:19,721 --> 01:29:21,689 ADVANCED AND THEREFORE WE CAN 2172 01:29:21,756 --> 01:29:23,324 EXPECT REAL DIFFERENCE IN THE 2173 01:29:23,391 --> 01:29:25,259 DELIVERY OF CARE EMPLOY OTHER 2174 01:29:25,326 --> 01:29:26,594 THINGS, IT'S JUST NOBODY KNOWS, 2175 01:29:26,661 --> 01:29:29,230 ARE WE TALKING ABOUT A 6 MONTH 2176 01:29:29,297 --> 01:29:31,466 HORIZON OR A 6 YEAR HORIZON. 2177 01:29:31,532 --> 01:29:33,434 PEOPLE REALLY STRUGGLE WITH THIS 2178 01:29:33,501 --> 01:29:34,936 ANSWER, EVEN THE DEVELOPERS 2179 01:29:35,002 --> 01:29:36,304 THEMSELVES BECAUSE AGAIN, THE 2180 01:29:36,370 --> 01:29:38,740 PACE OF LEARNING OF THE 2181 01:29:38,806 --> 01:29:40,608 ALGORITHMS IS SO ALMOST 2182 01:29:40,675 --> 01:29:44,779 UNPREDICTABLE, THAT I'VE HEARD 2183 01:29:44,846 --> 01:29:45,613 VERY DIVERSE PREDICTIONS BUT 2184 01:29:45,680 --> 01:29:47,915 THOSE 2 THAT I NAMED, I THINK ON 2185 01:29:47,982 --> 01:29:50,518 A 5 YEAR HORIZON ARE PRETTY--I 2186 01:29:50,585 --> 01:29:51,919 KNOW PEOPLE ARE PRETTY CONFIDENT 2187 01:29:51,986 --> 01:29:53,755 WE WILL SEE THAT DIFFERENCE 2188 01:29:53,821 --> 01:29:54,889 ALREADY PRESENT IN OUR 2189 01:29:54,956 --> 01:29:56,457 HEALTHCARE SYSTEM. 2190 01:29:56,524 --> 01:29:57,425 >> YEAH, I THINK--I JUST CAME 2191 01:29:57,492 --> 01:29:59,193 FROM A MEETING WITH A BUNCH OF 2192 01:29:59,260 --> 01:30:00,795 JOURNALIST WHO IS COVER THIS, 2193 01:30:00,862 --> 01:30:06,334 AND I THINK A LOT OF THEM 2194 01:30:06,400 --> 01:30:12,540 BELIEVE THAT THE PACE OF DORPHY 2195 01:30:12,607 --> 01:30:14,008 -DISCOVERY IS GOING TO 2196 01:30:14,075 --> 01:30:14,742 DEPEND ON WHETHER PEOPLE CAN 2197 01:30:14,809 --> 01:30:17,745 FIGURE OUT HOW TO PAY FOR THIS. 2198 01:30:17,812 --> 01:30:19,046 RIGHT NOW COMPANIES ARE PUTTING 2199 01:30:19,113 --> 01:30:21,015 UP BILLIONS AND BILLIONS IN 2200 01:30:21,082 --> 01:30:22,416 FRONT IS IT'S NOT CLEAR HOW THIS 2201 01:30:22,483 --> 01:30:24,285 STUFF IS GOING TO GET PAID FOR 2202 01:30:24,352 --> 01:30:25,553 AND EEIVETTUALLY THEY'RE GOING 2203 01:30:25,620 --> 01:30:29,257 TO TIRE OF DOING THAT, SO YOU 2204 01:30:29,323 --> 01:30:31,025 KNOW THE SERVERS EAT A LOT OF 2205 01:30:31,092 --> 01:30:32,794 ENERGY AND IT TAKES A LOT OF 2206 01:30:32,860 --> 01:30:34,862 HIGH QUALITY PROGRAMMERS TO MAKE 2207 01:30:34,929 --> 01:30:36,597 THESE THINGS, AND TO MAKE THEM 2208 01:30:36,664 --> 01:30:37,565 AVAILABLE AND MAINTAIN THE 2209 01:30:37,632 --> 01:30:40,001 SERVERS AND ALL THAT STUFF, AND 2210 01:30:40,067 --> 01:30:42,537 SO, HOW EXACTLY ARE THEY GETTING 2211 01:30:42,603 --> 01:30:42,904 MONEY? 2212 01:30:42,970 --> 01:30:45,540 I MEAN YOU CAN GO USE CHAT GPT 2213 01:30:45,606 --> 01:30:46,841 FOR FREE, THESE THINGS THAT MAKE 2214 01:30:46,908 --> 01:30:48,509 CODE OR THESE THINGS THAT MAKE 2215 01:30:48,576 --> 01:30:49,811 IMAGES, YOU KNOW THEY'RE SLOWLY 2216 01:30:49,877 --> 01:30:51,546 TARTING TO CHARGE FOR THAT BUT 2217 01:30:51,612 --> 01:30:52,947 WILL THEY BE ABLE TO DO THAT 2218 01:30:53,014 --> 01:30:56,050 FAST ENOUGH TO CONTINUE TO PAY 2219 01:30:56,117 --> 01:30:57,418 FOR THE RESEARCH? 2220 01:30:57,485 --> 01:30:58,052 THAT'S AN UNKNOWN. 2221 01:30:58,119 --> 01:31:00,021 IT'S A LOT LIKE WHEN THE 2222 01:31:00,087 --> 01:31:00,755 INTERNET FIRST CAME ALONG AND 2223 01:31:00,822 --> 01:31:02,757 MOST OF THE WEBSITES THAT 2224 01:31:02,824 --> 01:31:04,725 STARTED DIDN'T MAKE IT UNTIL 2225 01:31:04,792 --> 01:31:06,694 AMAZON AND GOOGLE FIGURED OUT 2226 01:31:06,761 --> 01:31:09,797 HOW TO SCALE ADs AND AMAZON 2227 01:31:09,864 --> 01:31:11,732 FIGURED OUT HOW TO BUILD ALL 2228 01:31:11,799 --> 01:31:13,000 THOSE WAREHOUSES AND STUFF. 2229 01:31:13,067 --> 01:31:14,368 >> WE HAVE A QUESTION IN THE 2230 01:31:14,435 --> 01:31:14,635 AUDIENCE. 2231 01:31:14,702 --> 01:31:16,137 >> YEAH, I JUST WANT TO PUSH A 2232 01:31:16,204 --> 01:31:19,774 LITTLE BIT ON THE NOTION OF 2233 01:31:19,841 --> 01:31:23,644 CURATING THE DATA SET THAT YOU 2234 01:31:23,711 --> 01:31:23,945 ACCRUE. 2235 01:31:24,011 --> 01:31:28,216 BECAUSE IT JUST SEEMS TO ME AS I 2236 01:31:28,282 --> 01:31:30,651 THINK ABOUT IT THAT I'VE 2237 01:31:30,718 --> 01:31:32,286 ALWAYS--ALWAYS, THIS IS LIKE IN 2238 01:31:32,353 --> 01:31:33,454 THE LAST WHATEVER 2 YEARS WHEN 2239 01:31:33,521 --> 01:31:37,592 PEOPLE HAVE BEEN TALKING ABOUT 2240 01:31:37,658 --> 01:31:38,960 THIS, CURATING THIS DATA SET AS 2241 01:31:39,026 --> 01:31:41,929 KIND OF A WEIGHTED AVERAGE SO 2242 01:31:41,996 --> 01:31:45,099 THAT YOU COME UP WITH THE 2243 01:31:45,166 --> 01:31:47,301 PERFECT ANSWER FOR THE WHOLE 2244 01:31:47,368 --> 01:31:50,404 POPULATION, BUT IN OUR CLINICS, 2245 01:31:50,471 --> 01:31:53,074 IF WE'RE TALKING ABOUT USING AI 2246 01:31:53,140 --> 01:31:56,711 IN MEDICINE, WE'RE SEEING THE 2247 01:31:56,777 --> 01:31:58,713 INDIVIDUAL WHO MAY BE AT 1 END 2248 01:31:58,779 --> 01:32:02,550 OR OTHER OF THE BELL SHAPED 2249 01:32:02,617 --> 01:32:02,884 CURVE, RIGHT? 2250 01:32:02,950 --> 01:32:05,186 SO SOMEHOW THE WAY TO DO THIS 2251 01:32:05,253 --> 01:32:11,425 MUST BE AT SOME SET POINT 2252 01:32:11,492 --> 01:32:13,461 BETWEEN PERFECT PERSONALIZED 2253 01:32:13,527 --> 01:32:16,764 MEDICINE SO THAT YOU PARSE OUT 2254 01:32:16,831 --> 01:32:21,636 BY DOZENS OF CHARACTERISTICS 2255 01:32:21,702 --> 01:32:25,273 WHERE IN THE SPECTRUM THIS 2256 01:32:25,339 --> 01:32:27,141 PERSON ACTUALLY FITS AND AT THE 2257 01:32:27,208 --> 01:32:28,309 OTHER EXTREME, GETTING THIS 2258 01:32:28,376 --> 01:32:31,379 WEIGHTED AVERAGE WHERE YOU HAVE 2259 01:32:31,445 --> 01:32:34,015 A PERFECT ANSWER FOR EVERYBODY 2260 01:32:34,081 --> 01:32:36,617 THAT WORKS--WALKS INTO YOUR 2261 01:32:36,684 --> 01:32:38,853 OFFICE THAT IS AN AVERAGE, AND I 2262 01:32:38,920 --> 01:32:42,056 MEAN CLEARLY NOT SO PERFEC, 2263 01:32:42,123 --> 01:32:44,592 IT'S A POPULATION ANSWER SO--SO 2264 01:32:44,659 --> 01:32:50,998 HOW DO WE FIGURE OUT WHAT WE DO 2265 01:32:51,065 --> 01:32:56,003 WITH THIS VERY DIVERSE DATA SET 2266 01:32:56,070 --> 01:32:58,439 I MEAN, DO WE--DO WE ACCRUE A 2267 01:32:58,506 --> 01:33:00,641 SET THAT IS A CUMULATIVE SET AND 2268 01:33:00,708 --> 01:33:07,348 THEN PARSE IT OUT BY SUBSETS OF 2269 01:33:07,415 --> 01:33:07,915 CHARACTERISTICS? 2270 01:33:07,982 --> 01:33:13,354 AND IF SO, WHAT CHARACTERISTICS 2271 01:33:13,421 --> 01:33:15,523 DO WE USE TO PARSE IT OUT OR DO 2272 01:33:15,589 --> 01:33:17,491 WE TAKE THIS WHOLE DATA SET AND 2273 01:33:17,558 --> 01:33:20,227 SAY THE ANSWER IS ISSUE THE 2274 01:33:20,294 --> 01:33:21,829 WEIGHTED AVERAGE OF EVERYBODY. 2275 01:33:21,896 --> 01:33:26,467 I'M NOT SURE HOW WE KNOW WHERE 2276 01:33:26,534 --> 01:33:27,268 THAT SITS. 2277 01:33:27,335 --> 01:33:29,203 >> YEAH, 1 THING THAT WORRIES ME 2278 01:33:29,270 --> 01:33:30,805 IN TERMS OF THE SCIENTIFIC 2279 01:33:30,871 --> 01:33:33,040 LITERATURE IS WE DON'T PUBLISH 2280 01:33:33,107 --> 01:33:35,476 CASE REPORTS THAT SAY, SO AND SO 2281 01:33:35,543 --> 01:33:39,947 PRESENTED WITH SUCH AND SUCH, 2282 01:33:40,014 --> 01:33:41,682 WAS OBVIOUS DIAGNOSIS, WAS GIIVE 2283 01:33:41,749 --> 01:33:43,784 STANDARD OF CARE AND DID FINE, 2284 01:33:43,851 --> 01:33:44,151 RIGHT? 2285 01:33:44,218 --> 01:33:45,653 SO WE ONLY PUBLISHED, YOU KNOW 2286 01:33:45,720 --> 01:33:47,388 THIS PERSON CAME IN, WE DIDN'T 2287 01:33:47,455 --> 01:33:49,690 KNOW WHAT WAS WRONG WITH THEM, 2288 01:33:49,757 --> 01:33:51,258 IT WAS THIS EXOTIC THING AND WE 2289 01:33:51,325 --> 01:33:52,693 CAME UP WITH THIS WAY OF 2290 01:33:52,760 --> 01:33:54,095 TREATING IT, IS IT 2291 01:33:54,161 --> 01:33:55,162 GOING--BECAUSE THOSE THINGS ARE 2292 01:33:55,229 --> 01:33:56,564 MORE PREVALENT IN THE SCIENTIFIC 2293 01:33:56,630 --> 01:33:58,599 LITERATURE, IS IT GOING TO 2294 01:33:58,666 --> 01:33:59,433 OVERWEIGHT THEM COMPARED TO 2295 01:33:59,500 --> 01:34:01,502 PEOPLE JUST COME IN AND GET THE 2296 01:34:01,569 --> 01:34:03,137 STANDARD OF CARE AND DO OKAY, 2297 01:34:03,204 --> 01:34:05,006 AND ARE EASY TO DIAGNOSE, I 2298 01:34:05,072 --> 01:34:06,073 DON'T KNOW. 2299 01:34:06,140 --> 01:34:12,313 NI MEAN WE ENCOUNTERED THIS IN A 2300 01:34:12,380 --> 01:34:13,814 MUCH LESS TECHNOLOGIC LOAMACYY 2301 01:34:13,881 --> 01:34:15,649 COMPLEX UNIVERSE WHEN WE WENT TO 2302 01:34:15,716 --> 01:34:17,785 ELECTRONIC MEDICAL RECORDS AND 2303 01:34:17,852 --> 01:34:20,788 WE WERE ASKED TO WRITE, WE WERE 2304 01:34:20,855 --> 01:34:23,524 ASKED TO WRITE MACROS FOR HOW 2305 01:34:23,591 --> 01:34:26,360 YOU TREAT DEC X BUT IN 2306 01:34:26,427 --> 01:34:27,895 THAT--DISEASE X BUT IN THAT 2307 01:34:27,962 --> 01:34:29,764 ALGORITHM THAT WE PUT INTO THE 2308 01:34:29,830 --> 01:34:30,498 ELECTRONIC DATABASE WE FORGOT 2309 01:34:30,564 --> 01:34:37,271 THAT SOME OF OUR PATIENTS ARE 25 2310 01:34:37,338 --> 01:34:41,142 WEEK PREMIES, OR THAT SOME OF 2311 01:34:41,208 --> 01:34:42,643 OUR PATIENTS WEIGH 900 KILOS OR 2312 01:34:42,710 --> 01:34:46,647 WHATEVER IT IS AND YOU KNOW 2313 01:34:46,714 --> 01:34:50,618 THE--WE MAKE MAKE MISTAKES LESS 2314 01:34:50,684 --> 01:34:54,288 FREQUENTLY OVER ALL BUT WE MAY 2315 01:34:54,355 --> 01:34:58,926 MAKE THEM PREFERENTIALLY IN THE 2316 01:34:58,993 --> 01:35:02,997 OUTLIER POPULATIONS AND I JUST 2317 01:35:03,064 --> 01:35:07,902 WORRY ABOUT THAT. 2318 01:35:07,968 --> 01:35:09,036 >> VARDIT? 2319 01:35:09,103 --> 01:35:11,238 NI AM THE BIOETHICISTOT TEAM SO 2320 01:35:11,305 --> 01:35:12,506 I FEEL LIKE THIS QUESTION DRAGS 2321 01:35:12,573 --> 01:35:14,075 ME OUT OF MY SCOPE AND 2322 01:35:14,141 --> 01:35:16,444 DEFINITELY OUT OF MY COMFORT 2323 01:35:16,510 --> 01:35:18,579 ZONE BUT IT'S INTERESTING WHEN I 2324 01:35:18,646 --> 01:35:21,482 LISTEN TO THE OTHER PARTS, THE 2325 01:35:21,549 --> 01:35:24,652 OTHER TEAM MEMBERS DISCUSS THE 2326 01:35:24,718 --> 01:35:27,288 DATA COLLECTION, HOW ON 1 HAND 2327 01:35:27,354 --> 01:35:29,056 THEY'RE SPEAKING BASED ON 2328 01:35:29,123 --> 01:35:31,225 DISEASE CATEGORIES, SO, YOU KNOW 2329 01:35:31,292 --> 01:35:34,795 WHAT IS TYPICAL FOR PARKINSON'S, 2330 01:35:34,862 --> 01:35:37,498 WHAT VOICE DEVIATION CAN BE 2331 01:35:37,565 --> 01:35:39,867 EXPECTED AND BECOME PREDICTIVE 2332 01:35:39,934 --> 01:35:41,902 OF DISEASE PROGRESSION FOR 2333 01:35:41,969 --> 01:35:44,105 EXAMPLE, ON THE OTHER HAND, THEY 2334 01:35:44,171 --> 01:35:48,742 TALK ABOUT AGE GROUPS, OBVIOUSLY 2335 01:35:48,809 --> 01:35:50,578 A CHILD DOESN'T SOUND LIKE AN 2336 01:35:50,644 --> 01:35:54,949 ELDERLY PERSON, ET CETERA, SO 2337 01:35:55,015 --> 01:35:57,518 AGAIN, THE DIVERSITY OF THE DATA 2338 01:35:57,585 --> 01:36:00,888 HERE IS MULTIDIMENSIONAL AND I 2339 01:36:00,955 --> 01:36:03,891 THINK THE GOAL IS TO COME UP 2340 01:36:03,958 --> 01:36:07,728 WITH CHARACTERISTICS THAT WOULD 2341 01:36:07,795 --> 01:36:09,230 ARK LOW EARLIER DIAGNOSIS ASK 2342 01:36:09,296 --> 01:36:11,866 FOLLOW UP AT THE LEVEL OF 2343 01:36:11,932 --> 01:36:14,034 PRECISION MEDICINE, SO, IF WE 2344 01:36:14,101 --> 01:36:17,138 KNOW THAT A TYPICAL--THE TYPICAL 2345 01:36:17,204 --> 01:36:21,475 CHANGES TO VOICE AND SPEECH 2346 01:36:21,542 --> 01:36:25,146 ASSOCIATED WITH ALZHEIMER'S OR 2347 01:36:25,212 --> 01:36:28,749 LARYNGIAL CANCER, OR LOOK LIKE 2348 01:36:28,816 --> 01:36:30,851 THAT, IT THEN--IT THEN ALLOWS 2349 01:36:30,918 --> 01:36:33,220 YOU TO TAILOR THAT TO THE BASE 2350 01:36:33,287 --> 01:36:36,090 LINE OF THE INDIVIDUAL PATIENT. 2351 01:36:36,157 --> 01:36:38,526 I AM REPORTING SECTD HAND MY 2352 01:36:38,592 --> 01:36:38,893 UNDERSTANDING. 2353 01:36:38,959 --> 01:36:41,195 I HAVE OF THOSE GOALS, IT'S 2354 01:36:41,262 --> 01:36:45,166 REALLY NOT WHAT I DO ON THE 2355 01:36:45,232 --> 01:36:46,700 PROJECT BUT I THINK YOU'RE 2356 01:36:46,767 --> 01:36:48,068 PUTTING YOUR FINGER ON AN 2357 01:36:48,135 --> 01:36:50,037 IMPORTANT ISSUE AND AN IMPORTANT 2358 01:36:50,104 --> 01:36:50,304 CHALLENGE. 2359 01:36:50,371 --> 01:36:51,872 I WILL JUST KEEP MY ANSWER AT 2360 01:36:51,939 --> 01:36:56,310 THAT LEVEL SO I DON'T SPEAK TOO 2361 01:36:56,377 --> 01:37:01,282 MUCH OUT OF MY ZONE OF 2362 01:37:01,348 --> 01:37:01,549 EXPERTISE. 2363 01:37:01,615 --> 01:37:02,750 >> THANK YOU DR. SHORE. 2364 01:37:02,816 --> 01:37:06,754 WE HAVE ANOTHER QUESTION IN THE 2365 01:37:06,820 --> 01:37:07,021 AUDIENCE. 2366 01:37:07,087 --> 01:37:08,155 >> KIND OF A QUICK 1. 2367 01:37:08,222 --> 01:37:09,723 YOU KIND OF ALLUDED TO THIS, I 2368 01:37:09,790 --> 01:37:12,726 THINK BUT MY QUESTION IS, WHAT'S 2369 01:37:12,793 --> 01:37:16,063 GOING STOP THIS ALL FROM DOING 2370 01:37:16,130 --> 01:37:18,999 INTO BOEING, SO MY UNDERSTAND 2371 01:37:19,066 --> 01:37:22,069 SUGGEST THAT BOEING STARTED WITH 2372 01:37:22,136 --> 01:37:23,571 ENGINEERS AND PEOPLE WHO WANTED 2373 01:37:23,637 --> 01:37:26,273 TO MAKE THE BEST PRODUCT, AND 2374 01:37:26,340 --> 01:37:27,741 OVER TIME LEADERSHIP DISAPPEARED 2375 01:37:27,808 --> 01:37:29,743 AND THEN THEY GOT TAKEN OVER BY 2376 01:37:29,810 --> 01:37:31,045 BEAN COUNTERS SO WHAT WILL STOP 2377 01:37:31,111 --> 01:37:32,680 THAT FROM HAPPENING HERE, IT 2378 01:37:32,746 --> 01:37:36,884 COULD REALLY GO HAYWIRE? 2379 01:37:36,951 --> 01:37:38,385 >> WELL, HAS BT THAT ALREADY 2380 01:37:38,452 --> 01:37:40,521 HAPPENED TO SOME EXTENT, BETWEEN 2381 01:37:40,588 --> 01:37:41,755 THE HEALTH INSURANCE COMPANIES 2382 01:37:41,822 --> 01:37:44,792 AND THE HOSPITAL ADMIN TRAITORS, 2383 01:37:44,858 --> 01:37:46,727 PROBABLY ALREADY THE CASE, SO, 2384 01:37:46,794 --> 01:37:50,731 YEAH, HOW DO YOU IMAGINE THIS 2385 01:37:50,798 --> 01:37:51,432 MAKING IT WORSE? 2386 01:37:51,498 --> 01:37:54,168 >> BECAUSE IT'S MORE POWERFUL, I 2387 01:37:54,235 --> 01:37:54,501 THINK. 2388 01:37:54,568 --> 01:37:57,738 >> IT COULD BE DONE FASTER, I 2389 01:37:57,805 --> 01:37:58,072 GUESS. 2390 01:37:58,138 --> 01:37:58,439 >> YEAH. 2391 01:37:58,505 --> 01:37:58,706 >> YEAH. 2392 01:37:58,772 --> 01:38:00,908 >> AND IT WILL GIVE THE BEAN 2393 01:38:00,975 --> 01:38:02,209 COUNTERS MORE DATA TO COUNT. 2394 01:38:02,276 --> 01:38:03,644 >> YEAH, I'M SURE OUR 2395 01:38:03,711 --> 01:38:06,814 BIOETHICIST IS THINK BEING THIS 2396 01:38:06,880 --> 01:38:07,748 A LOT. 2397 01:38:07,815 --> 01:38:10,251 >> YEAH, SO EVERYBODY'S THINKING 2398 01:38:10,317 --> 01:38:15,055 ABOUT GOVERNANCE AS GUARD RAILS. 2399 01:38:15,122 --> 01:38:18,892 EVERYBODY'S ACUTELY AWARE OF 2400 01:38:18,959 --> 01:38:21,228 THESE RISKS AND EVERYBODY'S ALSO 2401 01:38:21,295 --> 01:38:24,865 WORRIED THAT A REGULATORY 2402 01:38:24,932 --> 01:38:28,535 APPROACH IS INSUFFICIENT. 2403 01:38:28,602 --> 01:38:31,071 THE COMMERCIAL DRIVE AS ALREADY 2404 01:38:31,138 --> 01:38:32,573 NOTED IS IMMENSE, AND 2405 01:38:32,640 --> 01:38:34,775 EVERYBODY'S TALKING ABOUT 2406 01:38:34,842 --> 01:38:35,342 PATIENT-CENTERED AND 2407 01:38:35,409 --> 01:38:40,447 HUMAN-CENTERED CENTERED AI DEVET 2408 01:38:40,514 --> 01:38:42,116 AND DELIVERING THE BENEFITS IN A 2409 01:38:42,182 --> 01:38:44,551 WAY THAT OUTWAYS THE RISKS, HOW 2410 01:38:44,618 --> 01:38:47,955 TO GET THERE, IT'S REALLY OUR 2411 01:38:48,022 --> 01:38:49,590 SOCIETY DECIDING THAT THIS 2412 01:38:49,657 --> 01:38:53,394 DESERVES THE RIGHT KIND OF 2413 01:38:53,460 --> 01:38:56,230 REGULATORY APPROACHES, TO KEEP 2414 01:38:56,297 --> 01:38:58,932 BAD ACTORS UNDER CONTROL, LIKE 2415 01:38:58,999 --> 01:39:00,134 IN ANY OTHER OF SCIENCE, THE 2416 01:39:00,200 --> 01:39:02,569 TOOL IS JUST A TOOL, IT'S WHAT 2417 01:39:02,636 --> 01:39:04,338 WE DO WITH IT AND I THINK 2418 01:39:04,405 --> 01:39:07,107 EVERYBODY REALIZES THAT WITHOUT 2419 01:39:07,174 --> 01:39:08,042 GOOD GOVERNANCE, THIS--THE HARM 2420 01:39:08,108 --> 01:39:09,810 THAT COULD BE GENERATED, AGAIN 2421 01:39:09,877 --> 01:39:13,013 I'M USING THE SAME TERM, IS 2422 01:39:13,080 --> 01:39:13,814 UNPRECEDENTED. 2423 01:39:13,881 --> 01:39:18,452 SO THERE'S ALL THOSE NATIONAL 2424 01:39:18,519 --> 01:39:20,154 AROUND THE WORLD AND GLOBAL 2425 01:39:20,220 --> 01:39:23,724 INITIATIVES TO WORKING GROUPS 2426 01:39:23,791 --> 01:39:26,427 AND THINK TANKS AND MEDICAL 2427 01:39:26,493 --> 01:39:27,127 SOCIETIES, EVERYBODY'S PUTTING 2428 01:39:27,194 --> 01:39:28,962 THEIR HEADS TOGETHER TO TRY AND 2429 01:39:29,029 --> 01:39:31,632 COME UP WITH THOSE GUARD RAILS, 2430 01:39:31,699 --> 01:39:34,835 BUT IT'S EARLY DAYS AND I THINK 2431 01:39:34,902 --> 01:39:37,705 WHAT POLICY APPROACHES WILL END 2432 01:39:37,771 --> 01:39:39,773 UP BEING EFFECTIVE, AND WILL BE 2433 01:39:39,840 --> 01:39:44,311 PICKED UP, TIME WILL TELL NI'M 2434 01:39:44,378 --> 01:39:45,813 ALSO VERY SURPRISED BY TRULY 2435 01:39:45,879 --> 01:39:46,680 INTELIENT PEOPLE WHO DEEPLY 2436 01:39:46,747 --> 01:39:47,715 BELIEVE THAT GOVERNMENT IS 2437 01:39:47,781 --> 01:39:50,017 TAKING OVER OUR MINDS AND OUR 2438 01:39:50,084 --> 01:39:51,418 BODIES AND THERE'S A VERY 2439 01:39:51,485 --> 01:39:54,621 SIZABLE PROPORTION OF PEOPLE WHO 2440 01:39:54,688 --> 01:39:56,023 I KNOW INTELLIGENT PEOPLE AND 2441 01:39:56,090 --> 01:39:56,857 THEY REALLY, REALLY BELIEVE THIS 2442 01:39:56,924 --> 01:39:58,292 AND SO I THINK THERE'S GOING TO 2443 01:39:58,359 --> 01:40:01,595 BE A LOT OF BLOW BACK TO THIS AS 2444 01:40:01,662 --> 01:40:01,795 WELL. 2445 01:40:01,862 --> 01:40:03,731 PEOPLE ARE GOING TO FIGHT 2446 01:40:03,797 --> 01:40:05,699 AGAINST IT, THAT'S MY FEELING. 2447 01:40:05,766 --> 01:40:09,336 >> YEAH, I'M WORRY BODY THAT 2448 01:40:09,403 --> 01:40:09,536 ALSO. 2449 01:40:09,603 --> 01:40:13,941 >> BOTH OF YOU USE THE WORD 2450 01:40:14,007 --> 01:40:15,743 RIGHT IN 1 OF THE COMMENTS ABOUT 2451 01:40:15,809 --> 01:40:18,011 WRITING AND SO 1 OF THE 2452 01:40:18,078 --> 01:40:19,413 QUESTIONS THAT YOU MIGHT BE 2453 01:40:19,480 --> 01:40:24,985 INTERESTED IN YOUR VIEWS, HOW IS 2454 01:40:25,052 --> 01:40:26,954 THE--ARE YOU CONCERNED ABOUT THE 2455 01:40:27,020 --> 01:40:31,492 AVAILABILITY OF AI IN TERMS OF 2456 01:40:31,558 --> 01:40:34,762 EFFECTING THE ABILITY OF OUR 2457 01:40:34,828 --> 01:40:38,632 FUTURE OF OUR STUDENTS AT ALL TO 2458 01:40:38,699 --> 01:40:40,134 BE ABLE TO WRITE WHETHER THEY'RE 2459 01:40:40,200 --> 01:40:44,071 WRITING FOR A JOURNAL LIKE 2460 01:40:44,138 --> 01:40:49,009 SCIENCE OR SOCIAL SCIENCE AREA, 2461 01:40:49,076 --> 01:40:50,344 IS THERE SOME CONCERN ABOUT THE 2462 01:40:50,411 --> 01:40:56,283 IMPACT ON THE EDUCATIONAL SYSTEM 2463 01:40:56,350 --> 01:41:00,254 PARTICULARLY INFLUENCING THEIR 2464 01:41:00,320 --> 01:41:02,556 ABILITY TO WRITE? 2465 01:41:02,623 --> 01:41:04,525 >> YEAH, SO, MY CLASS AT GW IS 2466 01:41:04,591 --> 01:41:07,394 BASED ON WRITING ASSIGNMENTS AND 2467 01:41:07,461 --> 01:41:09,363 IT'S FOR FRESH MEN AND SO THIS 2468 01:41:09,430 --> 01:41:13,000 WAS THE FIRST YEAR I DID THAT 2469 01:41:13,066 --> 01:41:14,201 SINCE CHAT GPT HAD COME ALONG. 2470 01:41:14,268 --> 01:41:16,303 AND SO WHAT I DECIDED TO DO WAS 2471 01:41:16,370 --> 01:41:18,839 TO GIVE THEM AND THE PROMPTS, 2472 01:41:18,906 --> 01:41:20,474 YOU KNOW FOR FIRST YEAR 2473 01:41:20,541 --> 01:41:22,342 UNDERGRADUATES, YOU CAN'T GIVE 2474 01:41:22,409 --> 01:41:26,647 THEM SUPER COMPLICATED PROMPTS 2475 01:41:26,713 --> 01:41:28,048 THAT--ON THEIR FIRST DAY OF 2476 01:41:28,115 --> 01:41:28,282 COLLEGE. 2477 01:41:28,348 --> 01:41:30,584 SO MOST OF THE PROMPTS CHAT GPT 2478 01:41:30,651 --> 01:41:33,987 COULD PROBABLY GET A B ON PRETTY 2479 01:41:34,054 --> 01:41:36,657 EASILY THAT YOU COULD USE, SO 2480 01:41:36,723 --> 01:41:38,659 WHAT I DID WAS AND THE STUDENTS 2481 01:41:38,725 --> 01:41:39,827 DID NOT COMPLAIN ABOUT THIS SO I 2482 01:41:39,893 --> 01:41:42,463 GUESS THAT WOULD BE THE NO 1 2483 01:41:42,529 --> 01:41:44,031 DROPPED WHEN I TOLD THEM THIS 2484 01:41:44,097 --> 01:41:44,398 WAS THE PLAN. 2485 01:41:44,465 --> 01:41:46,800 SO IF YOU WANT THE OPTIMISTIC 2486 01:41:46,867 --> 01:41:49,770 PIECE, THAT WOULD BE IT. 2487 01:41:49,837 --> 01:41:54,074 I GAVE THEM THE PROMPT AND I 2488 01:41:54,141 --> 01:41:56,276 GAVE THEM WHAT CHAT GPT CAME UP 2489 01:41:56,343 --> 01:41:57,911 WITH, AND I SAID, YOU KNOW YOUR 2490 01:41:57,978 --> 01:42:00,080 JOB IS TO COME UP WITH SOMETHING 2491 01:42:00,147 --> 01:42:02,850 MORE CREATIVE THAN THIS, I WILL 2492 01:42:02,916 --> 01:42:05,486 GRADE IT AGAINST WHAT THE 2493 01:42:05,552 --> 01:42:07,120 COMPUTER DID, AND YOU GET TO 2494 01:42:07,187 --> 01:42:09,957 BRING 1 PIECE OF PAPER TO CLASS 2495 01:42:10,023 --> 01:42:12,392 THAT DOESN'T HAVE ANY COMPLETE 2496 01:42:12,459 --> 01:42:14,027 SENTENCES ON THIS, BUT YOU HAVE 2497 01:42:14,094 --> 01:42:16,096 TO TURN IN WITH YOUR ESSAY AND 2498 01:42:16,163 --> 01:42:17,798 IN THE LAST HOUR OF CLASS, YOU 2499 01:42:17,865 --> 01:42:18,932 WILL WRITE RAIN SHOWER ESSAY IN 2500 01:42:18,999 --> 01:42:20,334 LONG HAND AND YOU WILL GIVE ME 2501 01:42:20,400 --> 01:42:21,401 THAT AND THIS PIECE OF PAPER 2502 01:42:21,468 --> 01:42:24,171 THAT YOU PUT YOUR NOTES ON, AND 2503 01:42:24,238 --> 01:42:26,673 YOU KNOW MY MAIN GOAL IS ALWAYS 2504 01:42:26,740 --> 01:42:28,008 TO FIND THE STUDENTS WHO NEED TO 2505 01:42:28,075 --> 01:42:33,647 GO TO THE WRITING CENTER, AND 2506 01:42:33,714 --> 01:42:35,148 BECAUSE THESE UNIVERSITY WRITING 2507 01:42:35,215 --> 01:42:36,683 CENTERS DO A GREAT JOB, THE MAIN 2508 01:42:36,750 --> 01:42:38,852 PROBLEM WITH THEM IS NOT AS MANY 2509 01:42:38,919 --> 01:42:40,487 OPPORTUNITIES GET TO THEM AS 2510 01:42:40,554 --> 01:42:40,854 NEEDED. 2511 01:42:40,921 --> 01:42:45,158 AND WHEN I DID THAT, I FOUND THE 2512 01:42:45,225 --> 01:42:46,093 SAME NUMBER OF STUDENTS THAT 2513 01:42:46,159 --> 01:42:47,427 NEED TO GO TO THE WRITING CENTER 2514 01:42:47,494 --> 01:42:50,697 THAT I DID THE YEAR BEFORE WHEN 2515 01:42:50,764 --> 01:42:52,332 THEY WERE TYPING THEIR 2516 01:42:52,399 --> 01:42:55,202 ASSIGNMENTS AND OVER THE COURSE 2517 01:42:55,269 --> 01:42:57,804 OF THE SEMESTER THEY ALL GOT TO 2518 01:42:57,871 --> 01:43:00,007 THE POINT WHERE THEY WERE DOING 2519 01:43:00,073 --> 01:43:05,746 A FINE JOB WRITING THEIR 2520 01:43:05,812 --> 01:43:06,179 ASSIGNMENTS. 2521 01:43:06,246 --> 01:43:12,452 SO I THINK IT'S A CHALLENGE FOR 2522 01:43:12,519 --> 01:43:13,987 FACULTY TO INNOVATE BUT I THINK 2523 01:43:14,054 --> 01:43:15,689 IT'S DOABLE, AND I DON'T THINK 2524 01:43:15,756 --> 01:43:19,359 IT'S ANY DIFFERENT THAN THE PORD 2525 01:43:19,426 --> 01:43:21,094 PROCESSOR OR THE CARD CATALOG 2526 01:43:21,161 --> 01:43:24,731 GOING AWAY OR ANY OF THESE OTHER 2527 01:43:24,798 --> 01:43:28,001 THINGS THAT WE'VE BEEN THROUGH. 2528 01:43:28,068 --> 01:43:30,304 SOMEHOW WE STILL CONTINUE TO 2529 01:43:30,370 --> 01:43:31,338 EDUCATE PEOPLE AND THEY STILL 2530 01:43:31,405 --> 01:43:33,540 WANT TO COME TO COLLEGE AND 2531 01:43:33,607 --> 01:43:33,874 LEARN. 2532 01:43:33,941 --> 01:43:37,878 O I GUESS I'M NOT AS PESSIMISTIC 2533 01:43:37,945 --> 01:43:39,613 ABOUT THAT AS A LOT OF PEOPLE 2534 01:43:39,680 --> 01:43:44,451 ARE NWHAT IS YOUR VIEW, VARDIT? 2535 01:43:44,518 --> 01:43:45,786 >> WELL, MY TEENAGE KIDS AGREE 2536 01:43:45,852 --> 01:43:50,624 WITH THIS ASSESSMENT, TELLING 2537 01:43:50,691 --> 01:43:51,592 MOOY THAT, YOU KNOW MOM, WHEN 2538 01:43:51,658 --> 01:43:53,360 YOU HAD THE QUESTION, YOU HAD TO 2539 01:43:53,427 --> 01:43:56,263 GO TO THE LIBRARY, NOW HAVE TO 2540 01:43:56,330 --> 01:43:59,032 KNOW HOW TO ASK GOOGLE AND NOW 2541 01:43:59,099 --> 01:44:01,234 WE'RE LEARNING WHAT PROMPTS GIVE 2542 01:44:01,301 --> 01:44:04,972 US THE BEST OUTCOMES SO THE ART 2543 01:44:05,038 --> 01:44:07,207 OF HOW TO ASK GOOGLE IS BECOMING 2544 01:44:07,274 --> 01:44:10,077 THE ART OF PROMPTING BUT THIS IS 2545 01:44:10,143 --> 01:44:11,578 ONLY ENHANCING OUR RESEARCH 2546 01:44:11,645 --> 01:44:14,748 CAPACITY AND OUR ABILITY TO MAKE 2547 01:44:14,815 --> 01:44:16,750 ARGUE AMS THAT ARE MORE 2548 01:44:16,817 --> 01:44:18,919 SOPHISTICATED AND BETTER 2549 01:44:18,986 --> 01:44:19,353 ARTICULATED. 2550 01:44:19,419 --> 01:44:24,257 SO I TEND TO AGREE, THINKING 2551 01:44:24,324 --> 01:44:26,126 WILL REMAIN A HUMAN ACTIVITY AND 2552 01:44:26,193 --> 01:44:28,095 THIS IS MAYBE SHORT CUTS. 2553 01:44:28,161 --> 01:44:32,165 I HAVE TO DISCLOSE THAT RECENTLY 2554 01:44:32,232 --> 01:44:33,300 BEFORE WE--MY RESEARCH TEAM, 2555 01:44:33,367 --> 01:44:36,403 BEFORE WE SUBMIT A PAPER TO A 2556 01:44:36,470 --> 01:44:38,972 YOWRNAL, WE ASK GPT TOAC AS A 2557 01:44:39,039 --> 01:44:40,340 PEER REVIEWER AND WE JUST FEED 2558 01:44:40,407 --> 01:44:42,709 THE PAPER AND SAY, IF YOU WERE A 2559 01:44:42,776 --> 01:44:45,212 REVIEWER WHAT WOULD YOU ASK US? 2560 01:44:45,278 --> 01:44:46,513 AND IT'S ASKING DARN GOOD 2561 01:44:46,580 --> 01:44:48,348 QUESTIONS THAT ALLOW US TO 2562 01:44:48,415 --> 01:44:50,751 UPGRADE THE PAPER BEFORE PEER 2563 01:44:50,817 --> 01:44:51,485 REVIEW. 2564 01:44:51,551 --> 01:44:53,920 SO I TOTALLY AGREE, IT'S ABOUT 2565 01:44:53,987 --> 01:44:57,224 FINDING AS TEACHERS, IT'S ABOUT 2566 01:44:57,290 --> 01:45:01,595 PED GOGY AND CREATING THE NEW 2567 01:45:01,662 --> 01:45:03,930 WAYS WITH THIS TOOL TO ENHANCE 2568 01:45:03,997 --> 01:45:05,899 OUR CRITICAL THINKING, OUR 2569 01:45:05,966 --> 01:45:12,205 ARTICULATION OF ARGUMENTS, I 2570 01:45:12,272 --> 01:45:16,109 THINK THE WAY TO DEVELOP THIS IS 2571 01:45:16,176 --> 01:45:18,078 MORE MAJARRISM, CHAT GPT, THE 2572 01:45:18,145 --> 01:45:21,481 BRIGHT STUDENTS WILL FIND WAYS 2573 01:45:21,548 --> 01:45:23,450 TO OVERCOME THOSE DETECTION 2574 01:45:23,517 --> 01:45:25,852 TOOLS AND SO IT'S REALLY ABOUT 2575 01:45:25,919 --> 01:45:26,887 ACKNOWLEDGING THAT THEY'RE THERE 2576 01:45:26,953 --> 01:45:29,122 AND PLAYING WITH THEM INSTEAD OF 2577 01:45:29,189 --> 01:45:31,291 TRYING TO BAN THEM OR PLAY 2578 01:45:31,358 --> 01:45:31,625 AGAINST THEM. 2579 01:45:31,692 --> 01:45:33,427 IT'S NOT JUST A SHORT CUT, WE 2580 01:45:33,493 --> 01:45:35,429 HAVE TO FIND CREATIVE WAY FOR 2581 01:45:35,495 --> 01:45:37,731 THEM TO ACTUALLY ENHANCE AND 2582 01:45:37,798 --> 01:45:40,333 DEEPEN OUR THINKING AND OUR 2583 01:45:40,400 --> 01:45:40,967 RESEARCH CAPACITY. 2584 01:45:41,034 --> 01:45:43,503 IT FORCES US AS PROFESSORS AND 2585 01:45:43,570 --> 01:45:47,507 YOU KNOW HIGH SCHOOL TEACHERS TO 2586 01:45:47,574 --> 01:45:51,845 BE--TO STAY IN TOUCH WITH 2587 01:45:51,912 --> 01:45:53,346 TECHNOLOGY AND WITH FAST PACED 2588 01:45:53,413 --> 01:45:54,314 DEVELOPMENT OF THESE TOOLS AND 2589 01:45:54,381 --> 01:45:56,083 IT FORCES US TO BE VERY CREATIVE 2590 01:45:56,149 --> 01:45:57,818 IN OUR TEACHING SO THAT'S 2591 01:45:57,884 --> 01:45:59,786 PROBABLY OUR A GOOD THING, 2592 01:45:59,853 --> 01:46:01,555 KEEPING US ON OUR TOES. 2593 01:46:01,621 --> 01:46:02,856 >> I THINK THE WORST THING YOU 2594 01:46:02,923 --> 01:46:04,791 WOULD BE WOULD BE TO GIVE TO THE 2595 01:46:04,858 --> 01:46:06,460 ASSIGNMENT, TO THE STUDENTSA THE 2596 01:46:06,526 --> 01:46:07,627 HOME, TELL THEM THEY CAN'T USE 2597 01:46:07,694 --> 01:46:09,329 THESE TOOLS AND TO SIGN 2598 01:46:09,396 --> 01:46:10,430 SOMETHING SAYING THAT 2599 01:46:10,497 --> 01:46:11,331 DIDN'T,OOSE A HORRIBLE POSITION 2600 01:46:11,398 --> 01:46:13,033 TO PUT THEM IN, SO I WOULD NOT 2601 01:46:13,100 --> 01:46:17,204 DO THAT, I DON'T THINK THESE 2602 01:46:17,270 --> 01:46:18,472 TOOLS EXIST, THEY'RE NO 2603 01:46:18,538 --> 01:46:20,440 DIFFERENT FROM A TYPE WRITER OR 2604 01:46:20,507 --> 01:46:24,177 ANYTHING ELSE THAT'S COME ALONG, 2605 01:46:24,244 --> 01:46:27,447 AND TO SAY THAT IT'S CHEATING IF 2606 01:46:27,514 --> 01:46:29,449 YOU USE IT WILL JUST NOT WORK 2607 01:46:29,516 --> 01:46:31,084 OUT VERY WELL, SO THAT'S WHY I 2608 01:46:31,151 --> 01:46:33,386 CAME UP WITH A SCHEME OF HAVING 2609 01:46:33,453 --> 01:46:34,588 MY STUDENTS WRITE THEIR ESSAYS 2610 01:46:34,654 --> 01:46:37,724 IN CLASS IS BY THE WAY OUT OF 16 2611 01:46:37,791 --> 01:46:42,963 STUDENTS I HAD 1 WHO WROTE IN 2612 01:46:43,029 --> 01:46:43,196 CURSIVE. 2613 01:46:43,263 --> 01:46:43,563 FIFTEEN PRINT. 2614 01:46:43,630 --> 01:46:44,998 SO SOME PEOPLE ARE SURPRISED 2615 01:46:45,065 --> 01:46:47,467 THERE'S EVEN 1 AND SOME PEOPLE 2616 01:46:47,534 --> 01:46:48,969 WHO THINK CURSIVE HAND WRITING 2617 01:46:49,035 --> 01:46:51,204 AND IMPORTANT OR HORRIFIED BY 2618 01:46:51,271 --> 01:46:51,404 THAT. 2619 01:46:51,471 --> 01:46:54,841 >> SO, DO YOU HAVE ANY 2620 01:46:54,908 --> 01:46:59,146 TECHNIQUES THAT YOU--EITHER OF 2621 01:46:59,212 --> 01:47:03,049 YOU USE TO DETERMINE WHETHER, 2622 01:47:03,116 --> 01:47:05,519 LET'S SAY A DOCUMENT OR LETTER 2623 01:47:05,585 --> 01:47:09,055 OF RECOMMENDATION, AN ESSAY FOR 2624 01:47:09,122 --> 01:47:10,590 ADMISSION TO COLLEGE OR DO HAVE 2625 01:47:10,657 --> 01:47:12,993 YOU ANY TECHNIQUES THAT YOU USE 2626 01:47:13,059 --> 01:47:16,763 TO TRY AND EVALUATE AT A 2627 01:47:16,830 --> 01:47:20,066 DISTANCE WHETHER THIS IS 2628 01:47:20,133 --> 01:47:22,936 GENERATED BY AI OR BY THE 2629 01:47:23,003 --> 01:47:23,236 INDIVIDUAL. 2630 01:47:23,303 --> 01:47:25,138 >> NOT ME, I THINK THE PERSON 2631 01:47:25,205 --> 01:47:26,139 SIGNS IT, THEY'RE RESPONSIBLE 2632 01:47:26,206 --> 01:47:28,074 FOR WHAT'S IN THERE, AND IF YOU 2633 01:47:28,141 --> 01:47:30,477 HAVEN'T TOLD THEM NOT TO USE THE 2634 01:47:30,544 --> 01:47:31,645 TOOL, THEN YOU JUDGE IT AS 2635 01:47:31,711 --> 01:47:33,213 THOUGH THEY WROTE IT AND YOU 2636 01:47:33,280 --> 01:47:34,614 HOLD THEM ACCOUNTABLE FOR WHAT'S 2637 01:47:34,681 --> 01:47:35,048 IN THERE. 2638 01:47:35,115 --> 01:47:37,050 IF IT'S NOT VERY--IF IT'S BORING 2639 01:47:37,117 --> 01:47:39,519 AND IT'S GOT ERRORS IN IT, THEN 2640 01:47:39,586 --> 01:47:45,692 IT WAS PROBABLY WRITTEN BY CHAT 2641 01:47:45,759 --> 01:47:45,859 GPT. 2642 01:47:45,926 --> 01:47:47,394 >> SO I KNOW THERE ARE ONLINE 2643 01:47:47,460 --> 01:47:48,562 TOOLS THAT WILL ALLOW YOU TO RUN 2644 01:47:48,628 --> 01:47:50,463 A TEXT THROUGH AND GET CLUES, 2645 01:47:50,530 --> 01:47:52,132 OBVIOUSLY IF A PAPER INCLUDES 2646 01:47:52,199 --> 01:47:58,071 REFERENCES THAT DON'T EXIST, 2647 01:47:58,138 --> 01:47:58,905 THAT'S AN INTERESTING SIGN. 2648 01:47:58,972 --> 01:48:04,244 WHAT I HAVE DONE IN THE PAST, IF 2649 01:48:04,311 --> 01:48:07,848 STUDENT IMPROVED IN SURPRISING 2650 01:48:07,914 --> 01:48:10,150 SPEED OVER THE COURSE OF THIS 2651 01:48:10,217 --> 01:48:12,252 SEMESTER, I SAT DOWN TO HAVE A 2652 01:48:12,319 --> 01:48:15,121 CONVERSATION EMPLOY I WANTED TO 2653 01:48:15,188 --> 01:48:17,324 SEE AND SPEECH THEY CAN 2654 01:48:17,390 --> 01:48:18,391 ARTICULATE WHAT THEY ARTICULATED 2655 01:48:18,458 --> 01:48:20,160 IN THE WRITTEN ASSIGNMENT, 2656 01:48:20,227 --> 01:48:23,230 SOMETIMES IT'S A LANGUAGE 2657 01:48:23,296 --> 01:48:24,497 BARRIER, AT HARVARD MEDICAL 2658 01:48:24,564 --> 01:48:26,233 SCHOOL, WE HAVE MANY 2659 01:48:26,299 --> 01:48:27,767 INTERNATIONAL STUDENTS AND THESE 2660 01:48:27,834 --> 01:48:28,768 TOOLS ACTUALLY HELP OVERCOME 2661 01:48:28,835 --> 01:48:32,539 LANGUAGE BARRIERS AND THEY ARE 2662 01:48:32,606 --> 01:48:34,441 EQUALIZING, RATHER THAN CHEATING 2663 01:48:34,507 --> 01:48:36,443 TOOLS BUT IT'S REALLY ABOUT 2664 01:48:36,509 --> 01:48:38,511 ASSESSING THE THINKING PROCESSES 2665 01:48:38,578 --> 01:48:40,814 BEHIND THE WRITING TO SEE IF THE 2666 01:48:40,881 --> 01:48:42,682 STUDENT COULD HAVE COME UP WITH 2667 01:48:42,749 --> 01:48:44,184 THIS THEMSELVES. 2668 01:48:44,251 --> 01:48:46,653 SO, YOU KNOW TALKING, 2669 01:48:46,720 --> 01:48:48,321 CONVERSATIONAL ASSESSMENT FOR ME 2670 01:48:48,388 --> 01:48:53,660 IS SOMETHING THAT I TEND TO RELY 2671 01:48:53,727 --> 01:48:54,027 ON. 2672 01:48:54,094 --> 01:48:56,863 >> WE HAVE A QUESTION IN A 2673 01:48:56,930 --> 01:48:58,598 SOMEWHAT DIFFERENT DIMENSION, 2674 01:48:58,665 --> 01:49:01,201 DEALING WITH YOUR DISCUSSION OR 2675 01:49:01,268 --> 01:49:04,938 VOICE AS A UNIQUE IDENTIFIER, 2676 01:49:05,005 --> 01:49:06,840 THE QUESTIONER SAYS THAT'S VERY 2677 01:49:06,907 --> 01:49:16,383 INTERESTING AND SHE BRINGS 2678 01:49:16,449 --> 01:49:17,784 ATTENTION TO THE FACT THAT 2679 01:49:17,851 --> 01:49:20,487 TENNESSEE WAS THE FIRST STATE TO 2680 01:49:20,553 --> 01:49:24,157 BRING A LAW PROTECTIONS ARTISTS 2681 01:49:24,224 --> 01:49:25,025 AND OTHERS AGAINST AI. 2682 01:49:25,091 --> 01:49:26,993 DO YOU THINK THERE SHOULD BE 2683 01:49:27,060 --> 01:49:28,061 MORE PROTECTIONS FOR THOSE 2684 01:49:28,128 --> 01:49:30,297 PEOPLE IN THOSE CATEGORIES? 2685 01:49:30,363 --> 01:49:33,533 >> I KNOW THAT MY ARTIST FRIENDS 2686 01:49:33,600 --> 01:49:37,437 ARE VERY WORRIED. 2687 01:49:37,504 --> 01:49:39,472 THE MUSICIANS THE PAINTERS, THE 2688 01:49:39,539 --> 01:49:41,007 GRAPHIC DESIGNERS ARE VERY 2689 01:49:41,074 --> 01:49:41,241 WORRIED. 2690 01:49:41,308 --> 01:49:42,642 AGAIN IT'S A MATTER OF 2691 01:49:42,709 --> 01:49:45,078 GOVERNANCE AND I THINK WE HAVE 2692 01:49:45,145 --> 01:49:46,813 VERY TOUGH DECISIONWHAT 2693 01:49:46,880 --> 01:49:47,514 INTELLECTUAL PROPERTY MEANS IN 2694 01:49:47,580 --> 01:49:50,550 THIS DAY AND ANAL, WHAT IS 2695 01:49:50,617 --> 01:49:51,851 INNOVATION, WHAT IS CREATION, 2696 01:49:51,918 --> 01:49:53,620 WHAT IS REPLICATION, WHAT IS 2697 01:49:53,687 --> 01:49:55,121 INSPIRATION, I MEAN TO SOME 2698 01:49:55,188 --> 01:49:56,189 DEGREE, WE'VE DEALT WITH THIS IN 2699 01:49:56,256 --> 01:49:59,993 THE PAST BUT THIS IS A TOTALLY 2700 01:50:00,060 --> 01:50:01,494 NEW LEVEL OF CHALLENGE EMPLOY SO 2701 01:50:01,561 --> 01:50:04,597 I KEEP GOING BACK TO GOVERNANCE, 2702 01:50:04,664 --> 01:50:05,932 GOVERNANCE, POLICY, BUT THE 2703 01:50:05,999 --> 01:50:07,667 ETHICS IS EMBEDDED IN ALL OF 2704 01:50:07,734 --> 01:50:09,769 THAT AND YOU KNOW THESE ARE 2705 01:50:09,836 --> 01:50:10,603 VALUE BASED DECISIONS THAT WE 2706 01:50:10,670 --> 01:50:12,172 WILL HAVE TO MAKE ABOUT WHAT IT 2707 01:50:12,238 --> 01:50:15,942 MEANS TO BE A HUMAN CREATOR AND 2708 01:50:16,009 --> 01:50:19,612 WHAT IS--WHAT IT THAT WE WANT TO 2709 01:50:19,679 --> 01:50:20,413 PROTECT? 2710 01:50:20,480 --> 01:50:21,948 DON'T HAVE ANSWERS, BUT I'M 2711 01:50:22,015 --> 01:50:23,717 SEEING A LOT OF THINKING AROUND 2712 01:50:23,783 --> 01:50:25,986 ME AT LEAST, A LOT OF INVESTMENT 2713 01:50:26,052 --> 01:50:29,155 IN KIND OF FIGURING OUT THE 2714 01:50:29,222 --> 01:50:30,423 CONCEPTUAL CHALLENGES BEHIND 2715 01:50:30,490 --> 01:50:30,623 THIS. 2716 01:50:30,690 --> 01:50:33,360 >> YEAH, IN MUSIC WE'VE HAD 2717 01:50:33,426 --> 01:50:33,927 CONSTANT EVOLUTION OF 2718 01:50:33,994 --> 01:50:36,162 TECHNOLOGY, YOU KNOW WE HAVE 2719 01:50:36,229 --> 01:50:39,366 MULTITRACK RECORDING AND THEN WE 2720 01:50:39,432 --> 01:50:41,101 HAVE--THEN IT WENT DIGITAL AND 2721 01:50:41,167 --> 01:50:43,436 NOW WE HAVE AUTOTUNE THAT MAKES 2722 01:50:43,503 --> 01:50:44,504 AUTOTUNE SINGERS SOUND IN TUNE, 2723 01:50:44,571 --> 01:50:46,506 MOST OF THOSE SONGS YOU LISTEN 2724 01:50:46,573 --> 01:50:48,708 TO ON THE RADIO ARE AUTOTUNED, A 2725 01:50:48,775 --> 01:50:50,777 LOT OF THOSE FOLKS YOU'RE 2726 01:50:50,844 --> 01:50:54,547 LISTENING TO AREN'T SUPER GREAT 2727 01:50:54,614 --> 01:50:58,585 SINGERS IN TUNE; YOU KNOW WE 2728 01:50:58,651 --> 01:50:59,419 HAVE PROGRAMS THAT--DIGITAL 2729 01:50:59,486 --> 01:51:01,154 PROGRAMS THAT YOU RECORD ON THAT 2730 01:51:01,221 --> 01:51:04,924 FIX ALL THE MISTAKES, WHEN WE GO 2731 01:51:04,991 --> 01:51:07,127 ON PODCASTS, THEY TAKE THE 2732 01:51:07,193 --> 01:51:11,398 UMs, AND THE YOU KNOWs OUT, 2733 01:51:11,464 --> 01:51:13,266 THE DIFFERENCE--AND IT STILL 2734 01:51:13,333 --> 01:51:14,200 TAKES CREATIVITY TO DO THAT ALL 2735 01:51:14,267 --> 01:51:15,702 THAT BUT THE DIFFERENCE WITH 2736 01:51:15,769 --> 01:51:17,904 THIS IS IT'S SOMEBODY'S 2737 01:51:17,971 --> 01:51:19,172 INTELLECTUAL PROPERTY BEING USED 2738 01:51:19,239 --> 01:51:21,574 TO TRAIN THE ALGORITHM THAT'S 2739 01:51:21,641 --> 01:51:23,510 PRODUCING THE RESULT. 2740 01:51:23,576 --> 01:51:28,415 AND SO, ESPECIALLY IN 2741 01:51:28,481 --> 01:51:29,416 ILLUSTRATIONS AND IN MUSIC AND 2742 01:51:29,482 --> 01:51:31,951 STUFF, WE HAVE A LOT OF ROAD,A 2743 01:51:32,018 --> 01:51:33,353 HEAD OF US AS EVERYBODY ARGUES 2744 01:51:33,420 --> 01:51:34,854 OVER WHAT THAT MEANS. 2745 01:51:34,921 --> 01:51:36,423 I MEAN YOU SEIZE NEWS 2746 01:51:36,489 --> 01:51:37,357 ORGANIZATIONS SUING THE 2747 01:51:37,424 --> 01:51:39,192 COMPANIES BECAUSE THEY KNOW 2748 01:51:39,259 --> 01:51:41,528 THEIR ARTICLES ARE BEING USED TO 2749 01:51:41,594 --> 01:51:43,263 TRAIN THE ALGORITHMS AND YOU 2750 01:51:43,329 --> 01:51:45,565 KNOW, THE COURTS WILL FIGURE OUT 2751 01:51:45,632 --> 01:51:47,133 A WAY TO DEAL WITH ALL THAT BUT 2752 01:51:47,200 --> 01:51:49,002 THAT'S GOING TO TAKE A WHILE 2753 01:51:49,069 --> 01:51:51,604 NTHERE IS AN INTERESTING ANALOGY 2754 01:51:51,671 --> 01:51:53,706 WITH OUR RESEARCH PARTICIPANTS, 2755 01:51:53,773 --> 01:51:55,809 WE'RE WONDERING SHOULD THEY BE 2756 01:51:55,875 --> 01:51:58,178 COMPENSATED FOR GIVING US THEIR 2757 01:51:58,244 --> 01:52:01,414 VOICE IF THIS, YOU KNOW, THE USE 2758 01:52:01,481 --> 01:52:06,319 OF THIS DATA ENDS UP PRODUCING A 2759 01:52:06,386 --> 01:52:07,587 VERY PROFITABLE DIAGNOSTIC TOOL 2760 01:52:07,654 --> 01:52:08,555 FOR EXAMPLE, ESPECIALLY FOR 2761 01:52:08,621 --> 01:52:13,326 PARTNERING WITH THE PRIVATE 2762 01:52:13,393 --> 01:52:14,194 SECTOR, YOU KNOW, THEY'RE 2763 01:52:14,260 --> 01:52:14,861 PORTAISS--SYNTH PARTICIPATE IN A 2764 01:52:14,928 --> 01:52:16,696 TRIALING IN RESEARCH TO 2765 01:52:16,763 --> 01:52:17,363 CONTRIBUTE TO GENERALIZABLE 2766 01:52:17,430 --> 01:52:18,865 KNOWLEDGE AND HELP FUTURE 2767 01:52:18,932 --> 01:52:20,934 GENERATED RAYINGS BUT WHAT ABOUT 2768 01:52:21,000 --> 01:52:21,701 COMPENSATION, SO THIS IS 1 OF 2769 01:52:21,768 --> 01:52:22,635 THE REQUESTIES THAT WE'RE 2770 01:52:22,702 --> 01:52:24,270 THINKING ABOUT AND I FIND AN 2771 01:52:24,337 --> 01:52:24,938 INTERESTING ANALOGY BETWEEN THAT 2772 01:52:25,004 --> 01:52:28,174 AND THE NOTION THAT IF YOUR 2773 01:52:28,241 --> 01:52:30,276 CREATION HELPS TRAIN THE 2774 01:52:30,343 --> 01:52:40,787 ALGORITHM, YOU NEED TO BE 2775 01:52:41,254 --> 01:52:41,921 COMPENSATED FOR THAT. 2776 01:52:41,988 --> 01:52:42,722 >> WE HAVE AN INTERESTING 2777 01:52:42,789 --> 01:52:46,960 QUESTION HERE THAT LINKS THE 2778 01:52:47,026 --> 01:52:47,927 PUBLIC HEALTH STATUS IN THE 2779 01:52:47,994 --> 01:52:51,431 UNITED STATES, THE PUBLIC HEALTH 2780 01:52:51,498 --> 01:52:56,469 SYSTEM, THE AVAILABILITY OF 2781 01:52:56,536 --> 01:52:57,871 MEDICAL CARE PARTICULARLY THOSE 2782 01:52:57,937 --> 01:53:03,877 AT THE LOWER END OF THE ECONOMIC 2783 01:53:03,943 --> 01:53:04,711 LADDER. 2784 01:53:04,777 --> 01:53:14,454 HOW DO YOU THINK AI COULD 2785 01:53:14,521 --> 01:53:17,757 INTERACT IN ENHANCING THE PUBLIC 2786 01:53:17,824 --> 01:53:21,828 HEALTH SYSTEM BUT ALSO IS THERE 2787 01:53:21,895 --> 01:53:23,663 A FEAR THAT THE AVAILABILITY OF 2788 01:53:23,730 --> 01:53:28,735 ARK I MAY BE USED IN--AI MAY BE 2789 01:53:28,801 --> 01:53:30,603 USED IN PERHAPS SOME POLITICAL 2790 01:53:30,670 --> 01:53:32,639 MANNER TO NOT DEVELOP THE PUBLIC 2791 01:53:32,705 --> 01:53:34,474 HEALTH SYSTEM AS FAST OR AS 2792 01:53:34,541 --> 01:53:38,011 BADLY AS WE NEED IT. 2793 01:53:38,077 --> 01:53:42,615 >> I WILL LET THE BIOETHICIST 2794 01:53:42,682 --> 01:53:44,350 START THAT 1. 2795 01:53:44,417 --> 01:53:45,652 >> I WAS GOING TO BOUNCE THAT 2796 01:53:45,718 --> 01:53:46,219 BACK TO YOU. 2797 01:53:46,286 --> 01:53:47,654 I DON'T EACH KNOW WHERE TO 2798 01:53:47,720 --> 01:53:47,987 START. 2799 01:53:48,054 --> 01:53:52,525 >> YEAH, I MEAN, WHO KNOWS? 2800 01:53:52,592 --> 01:53:55,862 I THINK THERE ARE POLITICAL 2801 01:53:55,929 --> 01:53:57,664 FORCES THAT DISAGREE ABOUT THE 2802 01:53:57,730 --> 01:54:01,568 EXTENT TO WHICH WE'RE OBLIGATED 2803 01:54:01,634 --> 01:54:02,268 TO PROVIDE HEALTHCARE TO 2804 01:54:02,335 --> 01:54:04,904 EVERYONE AND THIS WILL BE 1 MORE 2805 01:54:04,971 --> 01:54:06,072 ACCESS ACROSS WHICH THAT 2806 01:54:06,139 --> 01:54:08,608 ARGUMENT IS GOING TO OCCUR. 2807 01:54:08,675 --> 01:54:10,977 SO WILL THAT MAKE IT BETTER OR 2808 01:54:11,044 --> 01:54:12,111 WORSE, I DON'T KNOW, I DON'T 2809 01:54:12,178 --> 01:54:14,781 THINK WE KNOW YET, WE'RE IN A 2810 01:54:14,847 --> 01:54:18,051 VICIOUS FIGHT ABOUT THIS. 2811 01:54:18,117 --> 01:54:19,686 I DON'T EXPECT THAT TO GO AWAY 2812 01:54:19,752 --> 01:54:22,855 BECAUSE OF THESE TOOLS. 2813 01:54:22,922 --> 01:54:28,695 THAT WILL BE MY--BECAUSE THOSE 2814 01:54:28,761 --> 01:54:29,529 ARE IDEOLOGICAL THINGS. 2815 01:54:29,596 --> 01:54:31,397 >> YEAH, I'M GOING TO SIGN-OFF 2816 01:54:31,464 --> 01:54:32,432 ON THAT SMART ANSWER. 2817 01:54:32,498 --> 01:54:34,634 AS I SAID COULD BE A BIG 2818 01:54:34,701 --> 01:54:37,337 EQUALIZER, COULD BE AN 2819 01:54:37,403 --> 01:54:38,871 EXACERBATER, AND THAT DEPENDS ON 2820 01:54:38,938 --> 01:54:41,507 OUR VALUE BASED DECISIONS ON 2821 01:54:41,574 --> 01:54:44,010 WHAT TO PRIORITIZE WHEN WE 2822 01:54:44,077 --> 01:54:45,578 CHOOSE WHAT TO DEVELOP AND HOW 2823 01:54:45,645 --> 01:54:46,980 TO IMPLEMENT, SO WE KNOW, THE 2824 01:54:47,046 --> 01:54:47,914 ANSWER STAYED VERY HIGH LEVEL 2825 01:54:47,981 --> 01:54:50,817 BECAUSE I THINK NOBODY KNOWS AT 2826 01:54:50,883 --> 01:54:52,385 THIS POINT. 2827 01:54:52,452 --> 01:54:54,254 >> ALL RIGHT, SO, I'M GOING TO 2828 01:54:54,320 --> 01:54:56,556 TURN THE MICROPHONE OVER TO 2829 01:54:56,623 --> 01:54:58,157 DR. SHORE WHO WILL CONCLUDE THIS 2830 01:54:58,224 --> 01:55:01,594 SESSION BUT LET ME THANK YOU ON 2831 01:55:01,661 --> 01:55:03,463 BEHALF OF EVERYBODY HERE AND THE 2832 01:55:03,529 --> 01:55:04,864 MANY, MANY PEOPLE AROUND THE 2833 01:55:04,931 --> 01:55:07,166 WORLD WHO HAVE TUNED IN OR WILL 2834 01:55:07,233 --> 01:55:10,036 TUNE IN AND HEAR THIS 2835 01:55:10,103 --> 01:55:11,638 DISCUSSION, I'M SURE THEY WILL 2836 01:55:11,704 --> 01:55:13,740 APPRECIATE IT AS MUCH AS ALL OF 2837 01:55:13,806 --> 01:55:18,578 US DO, SO THANK YOU DR. SHORE. 2838 01:55:18,645 --> 01:55:21,848 >> WELL, I REALLY WANT TO THANK 2839 01:55:21,914 --> 01:55:24,050 BOTH OF OUR SPEAKERS TODAY, ALL 2840 01:55:24,117 --> 01:55:27,920 OF YOU WHO CAME AND ALL OF YOU 2841 01:55:27,987 --> 01:55:31,557 ON VIDEOCAST WHO REALLY MADE 2842 01:55:31,624 --> 01:55:33,960 THIS SESSION MUCH FOOD FOR 2843 01:55:34,027 --> 01:55:34,193 THOUGHT. 2844 01:55:34,260 --> 01:55:40,333 I THINK, YOU KNOW AS THEY SAY ON 2845 01:55:40,400 --> 01:55:41,401 MSNBC, WATCH THE SPACE. 2846 01:55:41,467 --> 01:55:44,937 THIS WILL BE VERY, VERY INTENSE 2847 01:55:45,004 --> 01:55:48,775 OVER THE NEXT MANY YEARS AND I 2848 01:55:48,841 --> 01:55:52,312 DARE SAY IT'S GOING TO BE AN 2849 01:55:52,378 --> 01:55:54,814 ITERATIVE WALK TO WHATEVER IS 2850 01:55:54,881 --> 01:55:57,083 THE BEST OUTCOME FOR THIS SO 2851 01:55:57,150 --> 01:55:59,285 THANK YOU SO MUCH FOR 2852 01:55:59,352 --> 01:56:00,553 CONTRIBUTING REALLY NOT JUST TO 2853 01:56:00,620 --> 01:56:02,188 OUR KNOWLEDGE BUT TO THE 2854 01:56:02,255 --> 01:56:06,626 QUESTIONS THAT WE HAVE ABOUT 2855 01:56:06,693 --> 01:56:06,826 THIS. 2856 01:56:06,893 --> 01:56:17,103 [ APPLAUSE ]