GOOD MORNING, EVERYONE. I'M GLAD TO SEE EVERYONE HERE. WE HAVE A VERY FULL AGENDA FOR THE NEXT DAY AND A HALF. A REMINDER OF THE USUAL ITEMS, IT IS OPEN TO THE PUBLIC INCLUDING MEMBERS OF THE PAST. MEMBERS OF THE ACD, SPEAK INTO THE MICROPHONES WHEN YOU WANT TO SAY SOMETHING. THESE MICROPHONES ARE A LITTLE PUZZLING. YOU WANT TO TOUCH THE PERSON -- THERE IS SOME LIMIT AS TO HOW MANY OF THESE CAN BE PUT ON AT THE SAME TIME. YOU HAVE NOTEBOOKS FOR EVERYTHING YOU NEED FOR THE NEXT DAY AND A HALF A FUTURE TABS FOR DAY 4. WE MAKE THEM FAR IN ADVANCE BECAUSE EVERYBODY IS BUSY. CONCLUSION OF THE MEETING, BOOKS HERE WE WILL MAIL THEM TO YOU SO YOU DON'T HAVE TO TAKE THEM THROUGH AIRPORT SECURITY AND OTHER THINGS AT THE LUNCH BREAK WE WILL TODAY TAKE A PHOTO. PLEASE DON'T RUSH OFF TO THE LUNCH BREAK UNTIL WE HAVE THAT PHOTO. WE LIKE TO GET EVERYBODY CAPTURED AND PUT IT UP ON THE WEBSITE FOR THE ACD. I'M PLEASED TODAY TO ANNOUNCE THE ARRIVAL OF SEVERAL INDIVIDUALS HERE AT ACD FOR THE FIRST TIME TODAY. I WILL NAME THEM. THEY CAN RAISE THEIR HANDS FOR YOU TO SEE WHO THEY ARE. SHELLIBERGIER AT THE EPIGENETICS INSTITUTE. WELCOME. RABERITIA DIAS BRYNNETON AND PROFESSOR OF PHARMACOLOGY AND NEUROLOGY AT THE UNIVERSITY OF ARIZONA, WELCOME. WENDY CHAPMAN PROFESSOR AND CHAIR OF BIOMEDICAL FORMATICS. REBECCA ASSOCIATE CHAIR OF BIOENGINEERING RICE UNIVERSITY. DID I SAY IT CLOSE TO RIGHT? GOOD. THE DENAKATABY DID SHE MAKE IT THROUGH SECURITY SHE HAS BEEN SHAKE ENAT THE GATE BUT WILL BE HERE SOON. -- JUDITH KIM BELL PROFESSOR OF BIOCHEMISTRY UNIVERSITY OF WISCONSIN MADISON. CHRISTINA JOHNSON, CHANCELLOR OF THE STATE UNIVERSITY, NEW YORK AND CO-CHAIR ON WORKING GROUP TO CHANGE CULTURE OF ENDING HARASSMENT. YOU WILL HEAR FROM THAT GROUP IN THE COURSE OF THE MEETING IN WHAT WILL BE A VERY IMPORTANT AND INTERESTING DISCUSSION. ONE OTHER NEW MEMBER UNABLE TO JOIN US FOR THE MEETINGS BECAUSE OF DUTIES AND COMMENCEMENT EVENTS IS BARBARA WOLD AT CAL TECH. SHE AGREED TO SERVE AT A NEW WORKING GROUP I WILL TELL YOU ABOUT LATER. MARK DIBEL IS A NEW MEMBER AND UNABLE TO BE HERE TODAY. [INDISCERNIBLE] IS JOINING US BY PHONE. DR. HILL DREDGE, ARE YOU THERE? MAYBE HE HASN'T YET SIGNED IN. DENA IS HERE. I'M GLAD TO SEE YOU MADE IT THROUGH SECURITY. I'M INTRODUCING NEW MEMBERS OF COUNCIL AND MENTIONED YOUR NAME AS ONE OF THE SEVEN NEW ARRIVALS TO THE ACD. DELIGHTED TO MEET YOU. IF WE CAN PAUSE AND GIVE A ROUND OF APPLAUSE TO ALL OF THE NEW MEMBERS. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: NOW IT HAS BEEN AN INTENSE SIX MONTHS SINCE WE LAST MET. I THOUGHT IT WOULD BE FUN SINCE WE HAVE NEW MEMBERS AND PRODUCED A NEW NIH WELCOME VIDEO THAT VISITORS SEE MIGHT SHOW YOU THE SIX-MINUTE VIDEO TO SEE HOW IT HIGHLIGHTS THE NUMBER OF THINGS GOING ON RIGHT NOW EXCITING SCIENCE AND DEEP COMMITMENT FOR THOSE WHO WORK HERE. CAN WE ROLL THAT VIDEO, PLEASE. >> THE HUMAN BODY, INTRICATE, REMARKABLE, AND INFINITELY COMPLEX POWERED BY A HEART THAT BEATS A BILLION TIMES BY THE AGE OF 30 DREKED BY A BRAIN WITH ALMOST 100 BILLION NEURONS. CREATING BEAUTY AND EXPERIENCING JOY, HERE AT THE NIH, WE EXPLORE THE BODY'S CELLS AND DECODE ITS GENES AND INVESTIGATE ITS MIKE SKROEBS, TREAT IT WHEN THINGS GO WRONG ALL WITH ONE GOAL, HELPING AMERICANS LIVE LONGER, HEALTHIER, HAPPIER LIVES. THANKS IN LARGE PART TO NIH RESEARCH, THE CURATE FOR THE MOST COMMON CHILDHOOD LEUKEMIA IS 98%, IS NOW A TREATABLE DISORDER AND BLOOD THINNING DRUGS LIKE TPA ARE USED REGULARLY TO PREVENT STROKES AND SAVE LIVES. NIH CONTRIBUTED TO THE 70% DROP IN HEART DISEASE AND 20% REDUCTION IN CANCER DEATHS FROM A COUPLE DECADES AGO. THESE REPRESENT ONLY A FRACTION OF THE WORK THAT NIH DOES. OUR LIF SAVING RESEARCH IS PIONEERED BY PEOPLE, PEOPLE WITH A PASSION FOR HELPING OTHERS AND THOUSANDS OF PEOPLE BOTH AT NIH AND AT RESEARCH CENTERS ACROSS THE COUNTRY WHO DEAD INDICATE EVERY DAY TO MAKING DISCOVERIES ABOUT HOW LIFE WORKS AND FINDING NEW TREATMENTS AND CURES. OUR EVERYDAY HEROS AND RESEARCHERS AND CLINICIANS AND PATIENTS AND VOLUNTEERS AND THOUSANDS OF PEOPLE WHO PROUDLY KEEP THE AGENCY RUNNING AT ITS BEST. ALL WITH A DRIVE TO CONTRIBUTE TO NIH'S MISSION OF TURNING DISCOVERY INTO HEALTH. >> I WAS DIAGNOSED WITH ADVANCED METASTATIC CERVICAL CANCER THAT WAS BODY-ED WITH AT THAT POINT. IT WASN'T LIKELY TO WORK FOR ME BUT I THOUGHT IT WOULD BE SOMETHING GOOD I COULD DO FOR A PERSON TEN YEARS DOWN THE ROAD. THEY CLEARED OUT MY IMMUNE SYSTEM WITH VERY HEAVY DUTY CHEMOTO MAKE SPACE FOR THE NEW IMMUNE SYSTEM THEY BUILT ME AND CAME BACK A MONTH LATER AND GAVE SCANS BACK IN FEBRUARY OF THAT YEAR THESE SPOTS ARE TUMORS IN THIS ONE TODAY THOSE SPOTS ARE GONE CLINICAL TRIAL OUT OF SIXTEEN I WAS ONE OF TWO THEY WORKED FOR. THEY DESIGNED ANOTHER TREATMENT BASED ON WHAT THEY FOUND FROM MY RESPONSE HAVING ME BE A LITTLE LINK IN THE CHAIN OF CANCER DISCOVERY WITH WHAT I HOPED FOR BUT I DIDN'T THINK I WOULD BE HAD HERE TO SEE IT WHERE THERE IS NOT A TREATMENT ANYWHERE ELSE. THERE IS NIH PRODUCING MIRACLES AND CANCER CURES. >> WE ARE LOOKING AT DISEASES THAT CAUSE BLINDNESS AND WHAT WE CAN DO TO PREVENT THAT BLINDNESS AND TREAT IT. [INDISCERNIBLE] TOLD EVERYBODY THAT I WANT TO BE A DOCTOR THAT DISCOVERS NEW THINGS. NOW, I'M LIVING MY DREAM. WE CAN COMBINE OUR PASSION OF BEING A SCIENTIST OF BEING CURIOUS BASIC AND CLINICAL SCIENTISTS AND STEM CELL BIOLOGISTS AND SURGEONS AND ANIMAL BIOLOGIST WE ARE WORKING ON SAME MISSION TO BRING SOMETHING BACK TO PATIENTS TO COMBINE BASIC SCIENCE, TECHNOLOGY, AND CLINICS. YOU CAN'T DO THAT ANYPLACE ELSE. THAT IS THE BEAUTY OF NIH. >> I'M A CLINICAL RESEARCH DOCTOR HERE. I TAKE CARE OF JUD SYNDROME THAT IS EXCELLENT FOR STUDYING RARE DISEASES THERE WAS INTERSECTION BETWEEN ACADEMIC MEDICINE HERE WITH THE BASIC LAB COMPONENT AS WELL AS THE CLINICAL CARE. WE CURE PATIENTS FROM ALL OVER THE COUNTRY THAT ARE OFTEN SEEN BY PEOPLE THAT HAVE NEVER HEARD OF THE DISEASE. HERE THEY ARE COMING SOMEWHERE WHERE NOT ONLY DO WE KNOW ABOUT THE DISEASE BUT WE SEE PEOPLE, YOU KNOW, JUST LIKE THEM WITH SIM ISSUES SO PATIENTS WILL COME AND STAY AND HAVE A BONE MARROW TRANSPLANT TO BE CURED OF THE DISEASE AND UNDERSTAND THE FACT TO EFFECT THE GREATER POPULATION. YOU REALLY FEEL YOU CAN MAKE A DIFFERENCE HERE. >> DEPUTY DIRECTOR MANAGEMENT NOW OVERSEEING A HUGE OPERATION TO SUPPORT ALL RESEARCH THAT IS GOING ON. RESEARCH IN THE LAB DZ AND PHYSICIANS IN THE CLINICS ARE DOING THEIR BEST TO GET SOMETHING BETTER FOR PATIENTS. WE WANT TO SUPPORT THEM IN ANY WAY WE CAN. FOR THEM TO DO THEIR JOB WE HAVE TO DO OUR JOB. YOU CAN THINK YOU ARE QUITE FAR AWAY FROM BEING IN A CLINIC OR RESEARCH LABORATORY. WHEN YOU CAN TIE WHAT YOU ARE DOING TO SOMETHING THAT WILL HELP SOMEBODY, YOU WANT TO GET THE JOB DONE. NIH IS A PLACE OF HOPE FOR EVERYBODY NO MATTER WHERE YOU ARE IN THE WORLD. >> THESE PEOPLE AND SO MANY MORE MAKE YOUR NIH WHAT IT IS TODAY. A LEADING SOURCE OF SCIENTIFIC KNOWLEDGE. WHILE NIH CONDUCTS ITS OWN RESEARCH, MOST OF THE NIH BUDGET SUPPORTS RESEARCH AT ACADEMIC AND MEDICAL INSTITUTIONS ACROSS THE UNITED STATES AND AROUND THE WORLD. THE NATIONAL INSTITUTES OF HEALTH ARE A SOURCE OF HOPE FOR ALL WHO CARE ABOUT THEIR HEALTH AND THE HEALTH OF FUTURE GENERATIONS. >> WELCOME TO THE NATIONAL INSTITUTES OF HEALTH. I'M FRANCIS COLLINS. IT IS MY PRIVILEGE TO LEAD NIH. TODAY NIH IS THE LARGEST FUNDER OF BIOMEDICAL RESEARCH IN THE WORLD. WE ARE ALSO A FAMILY AND WE CARE FOR EACH OTHER AND ARE PROUD TO SAY THAT EVERY YEAR OUR FUNDING LEADS TO BREAKTHROUGHS AND UNDERSTANDING OF BIOMEDICINE AND GENERATES DOZENS OF NEW INVENTIONS THAT FIND NEW WAYS TO CURE DISEASES AND PREVENT ILLNESS. REMARKABLE TIME OF DISCOVERY TO WORK HERE. OPPORTUNITIES OF SCIENCE AND MEDICINE HAVE NEVER BEEN MORE EXCITING OR URGENT. WE THINK OF NIH AS NOT ONLY THE NATIONAL INSTITUTES OF HEALTH BUT ALSO pTHANK YOU FOR VISITING TODAY TO LEARN MORE ABOUT NIH AND THIS IMPORTANT WORK. >> FRANCIS S. COLLINS: THERE YOU HAVE IT. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: NEW MEMBERS OF ACD YOU HAVE AT YOUR PLACE A LAPEL PEN THAT WE WEAR HOPE AT NIH WE LIKE TO THINK OF NIH AS STANDING AS HOPE AND HEALTH. WEAR THAT WITH PRIDE WHEREVER YOU GO. I UNDERSTAND DR. HILL DREJ IS ON THE PHONE DUE TO SOMETHING WITH THE TECHNOLOGY HE CAN HEAR US BUT WE CAN'T HEAR HIM. WELCOME AND THANK YOU FOR JOINING US. MANY ISSUES TO DISCUSS IN THE COURSE OF THE NEXT DAY AND A HALF. IF WOULD BE USEFUL IF I COULD WALK YOU QUICKLY THROUGH THE AGENDA TO GET PREPARED FOR WHAT IS COMING WHICH IS UNDER TAB 1 OF YOUR COUNCIL BOOKS. WE WILL HAVE THIS OPEN SESSION THIS MORNING. BY THE WAY, I DO TEND TO HAVE A LOT TO SAY BUT I ALSO REALLY ENJOY IT WHEN PEOPLE JUMP IN WITH QUESTIONS AND DISCUSSIONS SO IT DOESN'T TURN INTO A MONOLOGUE. YOU ARE INVITED TO DO. WE WILL HAVE A BREAK ABOUT 10:45 AND INTERIM REPORT FROM THE ACD WORKING GROUP ON ARTIFICIAL INTELLIGENCE THAT WAS SET UP LAST DECEMBER. THEY HAVE BEEN AT IT NOW FOR SIX MONTHS AND ARE EXPECTED TO PRODUCE THE FINAL REPORT IN THE DECEMBER MEETING OF THIS YEAR. WE WILL HEAR FROM DAVID GLAZER AND LARRY TAI BACK. WE HEAR FROM AT EVERY MEETING OF THE ACD INCLUDING REQUESTS FOR CONSIDERATION OF NEW PROPOSALS TO HAVE ACCESS TO THE GENOME SEQUENCE DATA FROM HELA CELLS AND PRODUCTIVE AND LONG RELATIONSHIP WITH THE LAX FAMILY YOU HAVEN'T HEARD ABOUT BEFORE BUT IF YOU ARE NEW WILL BE EXPLAINED TO YOU. WE WILL TAKE A PHOTOAND A LUNCH BREAK AND WE WILL COME BACK AT 1:15 TO HEAR FROM THE ACD WORKING GROUP ON DIVERSITY THAT WILL BE LED BY ROY WILSON AND HANNAH VALANTINE. ROY IS OCCUPIED THIS MORNING BUT WE HAVE TWO MEMBERS OF THE INAUGURAL PART OF THE DIVERSITY WORKING GROUP, A GROUP THAT HAS BEEN AROUND FOR A WHILE. WAYNE RILEY, CAN YOU STAND UP SO WE CAN SEE YOU AND SAM SILVERSTEIN. THANKS FOR JOINING US AS WELL. WHEN WE GET TO THE PARTICULAR SESSION I WILL HAVE HANNAH VALANTINE INTRODUCE THE CURRENT MEMBERS OF DIVERSITY WORKING GROUP AND TELL YOU WHERE THEY ARE WITH THEIR VERY IMPORTANT DELIBERATIONS AND 2:15 BRENDAN WILL PRESENT TO US THE HIGH RISK HIGH REWARD PROGRAM FINAL REPORT. SOMETHING YOU HEARD ABOUT PREVIOUSLY AT MEETINGS SIX MONTHS AGO IT IS AN EFFORT TO BE SURE VERY IMPORTANT PART OF PORTFOLIO THAT FOCUSES ON WHAT IT SAYS TO -- PRODUCTIVE AS POSSIBLE AND WELCOMING AS POSSIBLE TO PEOPLE WITH DIVERSE PERSPECTIVES. WE WILL TAKE A BREAK AND AT 3:45 WE SCHEDULED A GOOD CHUNK OF TIME FOR THIS AS YOU CAN SEE MORE THAN TWO HOURS ACD WORKING GROUP IN CHANGING CULTURE ON SEXUAL HARASSMENT WILL COME FORWARD WITH THEIR INTERIM REPORT. THIS WAS SET UP BACK IN DECEMBER. AFTER SIX MONTHS AND FINAL REPORT WILL COME TOGETHER IN DECEMBER. THEY WILL HAVE A LOT OF WORK AND INFORMATION TO PUT IN FRONT OF YOU CO-CHAIRS AT THE TABLE [INDISCERNIBLE] I'M SURE THAT WILL INSPIRE A LOT OF IMPORTANT DISCUSSION. WE WILL ADJOURN FOR COUNCIL ACD MEMBERS YOU WILL GET A 15 MINUTE BREAK. WE ARE GENEROUS WITH OUR TIMING. THERE WILL IN FACT BE A SHUTTLE TO TAKE YOU TO THE WONDERFUL EVENING EVENT THAT WILL BE HELD AT THE HOME OF LARRY AND ROBIN TABAK. HE HAS BEEN COOKING FOR DAYS. A LITTLE CHANCE THERE TO RELAX AND LET YOUR HAD HAIR DOWN FROM WHAT WILL BE A VERY FULL DAY. I SHOULD HAVE SAID PART OF THE AGENDA ABOUT CHANGING CULTURE TO END SEXUAL HARASSMENT WILL INCLUDE ALSO A PRESENTATION BY HANNAH VALANTINE ON INTERIM RESULTS ON A WELL-DESIGNED SURVEY WE TOOK OF OUR OWN EMPLOYEES, CONTRACTORS, AND TRAINEES AT NIH. YOU WILL FIND THE RESULTS TO BE VERY INTERESTING AND HOPEFULLY THIS IS A SURVEY INSTITUTIONS MIGHT BE INTERESTED IN ADOPTING AS WELL. YOU WILL SEE IT GIVES PRETTY INTERESTING RESULTS AND SOME SUGGESTIONS ABOUT WAYS WE MIGHT INTERVENE AND TOMORROW FRIDAY JUNE 14TH, WE WILL GET STARTED AT 9 O'CLOCK. LARRY WILL GO THROUGH THE TRADITIONAL REVIEW OF OUTSIDE AWARDS ACD APPROVAL. THAT IS SOMETHING THAT EVERYBODY WANTS TO HEAR; RIGHT? THE HIGHLIGHT. WE TRY IF WE CAN FIT IT IN AND MANAGED TO FIT IT IN THIS TIME TO HAVE A PRESENTATION FROM NIH INSTITUTE OR CENTER DIRECTOR. WE ARE FORTUNATE THAT [INDISCERNIBLE] WHO IS THE DIRECTOR OF NATIONAL INSTITUTE ON MINORITY AND HEALTH DISPARITIES WILL BE OUR SPEAKER TO TALK TO YOU ABOUT WHERE THAT PARTICULAR INSTITUTE IS GOING AT THE PRESENT TIME UNDER HIS LEADERSHIP HAVING NOW BEEN HERE FOR A COUPLE YEARS. AT 10:15 FINAL REPORT OF ACD BRAIN INITIATIVE WORKING GROUP 2.0 AND ALSO NEUROETHIC SUBGROUP BRAIN 2.0 REMIND YOU BRAIN INITIATIVE WAS STARTED FIVE YEARS AGO. WE FUNDED IT NOW TO THE POINT OF REMARKETABLE PROGRESS IN TERMS OF DEVELOPMENT OF NEW TECHNOLOGIES FOR UNDERSTANDING HOW THE BRAIN WORKS WITH AMBITIOUS GOALS TO CARRY THAT FORWARD TO AT LEAST 2025 AND PROBABLY BEYOND AND WE ASKED A NEW GROUP TO COME LOOK AT THE PROGRESS THAT HAD BEEN MADE SINCE THE ORIGINAL PLAN WAS PUT FORWARD BY A GROUP THAT WAS CHAIRED BY COREY BARDMAN AND BILL NEWSOM AND REPORTED TO THE ACD. YOU WILL WANT TO HEAR WHAT THEY CAME UP WITH AS RECOMMENDATIONS FOR THE NEXT FIVE YEARS EFFORT. THEY WERE GRATIFIED BY PROGRESS MADE SO FAR OUTSTRIPPED EXPECTATIONS AND MADE IT MORE EXCITING TO CONTEMPLATE A NEW 2.0 VERSION OF THIS TO GO AS FAR AND FAST AS WE CAN MANAGE WITH RESOURCES WE HAVE. THERE WILL BE A BRIEF BREAK AND AS A FINAL PRESENTATION WE WILL HAVE A PRESENTATION FROM MICHAEL LOUER DEPUTY DIRECTOR OF EXTRAMURAL RESEARCH RESEARCH INTEGRITY A GROUP THAT PRESENTED LAST DECEMBER AND GIVING YOU AN UPDATE ON WHAT HAPPENED SINCE THE RECOMMENDATIONS WERE PRESENTED TO THE ACD, ANOTHER OBVIOUSLY VERY IMPORTANT AND VERY SENSITIVE TOPIC. YOU CAN SEE THERE WON'T BE DOWNTIME IN THE COURSE OF THIS EXCEPT FOR OCCASIONAL BRIEF BREAKS I'M COUNTING ON THE WISDOM OF THIS REMARKABLE FOLKS AROUND THE TABLE TO GUIDE US. THIS IS NOT A RUBBER STAMP MOMENT WE ARE HERE TO GATHER YOUR WISE INSIGHTS INTO HOW WE CAN STEER THE AMAZING SHIP CALLED NIH IN THE BEST POSSIBLE DIRECTION. THAT IS WHAT YOU ARE IN FOR. I WOULD LIKE TO RUN THROUGH THINGS THAT HAPPENED SINCE LAST ACD GATHERED. IF I COULD HAVE THE SLIDES PUT UP, I WOULD LIKE TO START WITH SOMETHING ABOUT NEW RECRUITS THAT WE HAVE IN MANAGED TO BRING ON BOARD SOME REALLY REMARKABLE LEADERS. I WILL START WITH THE IF FIRST OF THOSE WHO HAPPENS TO BE SITTING OVER TO MY RIGHT. THAT IS BRUCE TROM BERG WHO WAS SWORN IN ON JANUARY 7TH AND YOU SEE THE PHOTOWITH BRUCE AND HIS WIFE PATTY AS NEW DIRECTOR OF NAGS INSTITUTE OF BIOIMAGING AND ENGINEERING NIB BRUCE WAS A PROFESSOR AT UNIVERSITY OF CALIFORNIA IRVINE WITH DUEL APPOINTMENTS BIOMEDICAL ENGINEERING AND SURGERY AND PHD CHEMISTRY TENNESSEE KNOXVILLE AND HE ARRIVED WITH ENORMOUS ENERGY AND VISION FOR CUTTING EDGE NIH WHICH IS RESPONSIBLE FOR MORE PATENTS PER DOLLAR OF ANYTHING ELSE WE DO. IT IS A WONDERFUL OPPORTUNITY TO HAVE HIM IN OUR MIDST AND GLAD TO HAVE HIM HERE. GIVE HIM A BIT OF AN APPLAUSE AS HE STANDS UP TO RECEIVE IT. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: WELCOME, BRUCE. I'M ALSO VERY HAPPY TO INTRODUCE OUR NEW DIRECTOR OF CENTER FOR SCIENTIFIC REVIEW PICTURES WITH LARRY AND MYSELF SHE HAS BEEN IN OUR AREA OF SCIENTIFIC REVIEW SINCE 2,000 AND SHE COMES TO US WITH WISDOM VISION AND REMARKABLE SKILLS AND CREDIBILITY WITH LOTS OF PARTIES ALWAYS LOOKING AT CSR AND TELLING US HOW WE SHOULD DO OUR JOB. NOENI, WOULD YOU PLEASE STAND UP SO WE CAN APPLAUD YOU. >> AUDIENCE: [APPLAUSE] NOT HERE BUT I WILL SHOW YOU HER PICTURE SHE IS COMING VERY SOON. I'M HAPPY TO SAY WE HAVE BEEN ABLE TO RECRUIT DR. DEBORA SHE SAYS TUCHI. THAT IS HOW I WILL SAY IT, TOOUSI WHO IF INCOMING DIRECTOR TO ARRIVE SEPTEMBER THIRD. SHE IS CURRENTLY PROFESSOR OF SURGERY AND DIRECTOR OF COCHLEAR IMPLANT PROGRAM AT DUKE UNIVERSITY AND SHE WILL BRING A LOT OF SKILLS AND A LOT OF CREDIBILITY. SHE HAS BEEN PRESIDENT OF MOST OF THE ASSOCIATIONS OF OTOLAIR INGOLOGISTS WELL-KNOWN IN HER COMMUNITY AND LONG. >> DIANNE BABSKI: TIME NIH GRANTEE AND INTERESTING AND SET OF IDEAS WHERE NICD MIGHT GO FORWARD NEXT. WE ARE LOOKING FORWARD TO HAVING HER HERE IN DECEMBER. SPECIAL THANKS ASKING HER TO COME UP TOO. SHE HAS BEEN LEADING JUDITH DURING THE TRANSITION PERIOD. THANK YOU JUDITH. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: ONE MORE HAPPY TO SAY IF IN THE DIRECTOR'S OFFICE MANAGED TO RECRUIT DR. TERRY SHA WETS ASSOCIATE DEPUTY DIRECTOR IMPORTANT ROLE JOINS FROM NAID AND STRATEGIC PLANNING AND EVALUATION BRANCH WITHIN NAID. SHE IS BIOPHYSICIST BY TRAINING AND HAD HAD A STINT AT THE DIRECTORS OFFICE SERVING AS SENIOR ADVISOR TO LARRY. THRILLED TO HAVE HER BACK. LEADING DEVELOPMENT OF OD STRATEGIC ENGAGEMENT AGENDA TO ENHANCE COORDINATION ACROSS THE DIRECTOR'S OFFICE AND STRENGTHEN ENGAGEMENT WITH OTCS. WOULD YOU PLEASE STAND UP? >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: THOSE ARE SEARCHES THAT YIELDED UP WONDERFUL RESULTS OTHERS IN THE WORKS WITH 27 INSTITUTES AND CENTERS AND -- YOU CAN IMAGINE WE ARE ALWAYS SEARCHING AND I WILL SAY THAT IT IS GRAT -- THIS IS SEEN AS ONE OF THE PLACES YOU CAN MAKE A MARK WHERE YOU HAVE CHANCE TO LEAD AND STEER AN AREA OF SCIENCE AS INSTITUTE DIRECTORS AND OTHER LEADERS CAN DO. ONES THAT ARE CURRENTLY IN THE WORKS ONE IS NEW DIRECTOR FOR NATIONAL INSTITUTE OF NURSING RESEARCH. THAT POSITION HAS BEEN ABLY MANAGE BY ANNE AS ACTING DIRECTOR -- RETIRED 25 YEARS IN THAT ROLE AND SEARCH COMMITTEE, TWO OF OUR INSTITUTE DIRECTORS THAT HAVE DONE A LOT OF DUE DILIGENCE AND WE HAVE INTERVIEWS THAT ARE ESSENTIALLY COMPLETED AND DOING ADDITIONAL CHECKING AND I'M HOPING WE MAY BE GETTING CLOSE TO THE POINT OF MAKING AN OFFER IN THAT SPACE. NOT INSTITUTE DIRECTOR BUT IMPORTANT LEADERSHIP ROLE, WE ARE LOOKING FOR FULL-TIME DIRECTOR OF BRAIN INITIATIVE. I MENTIONED YOU WILL HEAR ABOUT THAT IN BRAIN 2.0 PRESENTATION TOMORROW. THIS HAS BEEN MANAGED UP UNTIL NOW BY JOINT LEADERSHIP OF DIRECTORS OF NIMH AND NIDS THAT IS WALTER GORDON AND PRIOR TO THAT IS [INDISCERNIBLE] AND THEY HAVE DONE A FANTASTIC JOB. THEY WOULD AGREE THE TIME HAS COME TO HAVE SOMEBODY EMPLOYED THAT WOULD BE FULL-TIME DEVOTED TO THE BRAIN INITIATIVE AND THINKS ABOUT IT EVERY MORNING AND NIGHT AND IN-BETWEEN AS OPPOSED TO PEOPLE HAVING INSTITUTES TO RUN. WE RUN ALONG WITH THIS AND HOPE TO HAVE A FORMAL ANNOUNCEMENT PRETTY SOON OF NAMING OF A FULL-TIME DIRECTOR VERY IMPORTANT ROLE GOING FORWARD. THIRD SEARCH WE ARE IN THE MIDDLE OF AND COULD USE YOUR IDEAS ABOUT. WE ARE LOOKING FOR THE KIND OF PERSON NOT THE USUAL NIH RECRUIT THAT IS THE JOB WE CALL NIH CHIEF DATA STRATEGIST WHICH IS A HIGH-LEVEL INDIVIDUAL REPORTING TO ME OVERSEE VAST ARRAYS OF ACTIVITIES WE HAVE BIG DATA AND MACHINE LEARNING AND YOU WILL HEAR ABOUT THE WORKING GROUP ABOUT ALL THINGS WE SHOULD BE DOING IN THIS SPACE. WE BELIEVE TIME IS RIGHT TO BRING SOMEONE INTO THE MIDST WITH REAL SKILLS I THE SPACE AND WOULDN'T NECESSARILY BE SOMEBODY FROM ACADEMIA. IN FACT, WE WOULD BE PARTICULARLY INTERESTED IN PEOPLE WITH DEEP SILICON VALLEY EXPERIENCE AND NOT NECESSARILY SOMEBODY WHO HAS TO HAVE A DOCTORAL DEGREE BUT ENTREPRENEURIAL SPIRIT ABOUT VISION AND NEEDS AND OPPORTUNITIES COULD GO SEE AREA OF DATA SCIENCE AND ARTIFICIAL INTELLIGENCE LIFE SCIENCE MAY BE EXCITING SET OF OPPORTUNITIES AND NIH IS MOST EXCITING PLACE TO TRY TO MOVE THAT FORWARD IN TERMS OF NEW PROGRAMS AND TRAINING AND INITIATIVES AND ALL THAT WE PUT A RECRUITING VIDEO WE WILL SEND AROUND TO THE NAICD AND -- READING THE FEDERAL JOBS LISTINGS HENCE TO DO SOMETHING DFFERENT WITH THE 5 OR 6 MINUTE RECRUITING VIDEO WE ARE HOPING AND HAVE HAD INTERESTING LEADS IN THE NEXT COUPLE WEEKS TO LAND THE PERSON I WANT TO DESCRIBE TAO HERE AND GIVE THEM THE OPPORTUNITY TO SHAPE THE ENTERPRISE IN DATA SCIENCE FOR NIH GOING FORWARD. I MUST SAY IN THE MEANTIME WE ARE MOST FORTUNATE WE HAVE DR. SUZANNE GREG ORICK WHO IS OVERSEEING OUR DATA SCIENCE EFFORTS IN OFFICE OF DATA SCIENCE AND HAS PAST MANY MONTHS MAKING SURE WE HAVE ONGOING SUBSTANTIAL MOMENTUM IN THIS SPACE ASSISTED BY MANY OTHER RS PARTICULARLY LARRY TAI BACK AND MAKE SURE WE ARE NOT WASTING TIME AND LOOKING FOR WAY TO FURTHER ENHANCE THIS BY BRINGING IN A PERSON WITH PERSPECTIVE FROM A DIFFERENT SECTOR. IF YOU HAVE WE WILL SEND AROUND THE VIDEO TO SEE HOW WE ARE PRESENTING THE OPPORTUNITY. ON TO ANOTHER SORT OF PART OF THIS WHICH IS TO TELL YOU ABOUT NOTABLE EVENTS THAT HAVE HAPPENED SINCE WE MET IN DECEMBER I LIKE TO GRAB PHOTOGRAPHS OF THINGS THAT HAVE HAPPENED AND SOME IN THE WHITE HOUSE REALM AND SOME IN CONGRESSIONAL REALM AND SOME AWARDS ASPECIAL EVENTS AND START WITH THE WHITE HOUSE PART AND BRING TO YOUR ATTENTION THE WONDERFUL VISIT WE HAD FOR THE SECOND YEAR IN A ROW FROM THE FIRST LADY MEL ANIA TRUMP THAT CAME TO THE CHILDREN'S IN ON THIS CAMPUS VALENTINE'S DAY IN 2018 AND SPENT MORE THAN AN HOUR WITH THE KIDS THERE MAKING VALENTINE'S AND COOKIES AND THINGS SHE IS WONDERFUL IN THAT SETTING IMMEDIATELY CONNECTS WITH THE KIDS AND THEY CONNECT WITH HER AND DRAW YOUR ATTENTION TO THE PICTURE ON THE RIGHT WHERE SHE IS SPEAKING WITH A YOUNG BOY AMANI A YOUNG BOY 10 YEARS OLD AT THE CHILDREN'S INN. -- HE HAD FOR HER VISIT MADE HER A BRACELET OR NECKLACE AND MADE HER A SPEECH THAT HE GAVE TO HER SHE WAS CHARMED BY THAT PERHAPS REFLECTING THAT WHEN THE FIRST LADY HAD HER OWN WHITE HOUSE EVENT A LITTLE AFTER THIS ON MAY 7TH FOCUSING ON HER THEME OF BE BEST, SHE ASKED ME TO BE ONE OF THE THREE SPEAKERS TO TALK ABOUT WAYS IN WHICH WE COULD FOCUS FOR CHILDREN ON WAYS TO GIVE THEM THE BEST OPPORTUNITY. MY THEME WAS WELLNESS. IT WAS GREAT TO SEE THIS IS NOW AFTER THE BONE MARROW TRANSPLANT AND AMANI IF YOU LOOK CAREFULLY RIGHT THERE STANDING UP HE IS THERE NOW DOING BEAUTIFULLY AFTER THE TRANSPLANT AND PROBABLY WILL BE CURED OF SICKLE CELL DISEASE AND FIRST LADY AND PRESIDENT ARE TURNING AROUND TO ADMIRE THE FACT THIS HAD IS A REAL SUCCESS STORY. FIRST LADY WAS INDEED CHARMED TO SEE HIM AGAIN. A NICE AND UPBEAT KIND OF OCCASION RIGHT NOW WHAT IS HAPPENING IN AREA OF SICKLE CELL DISEASE IS GRATIFYING. THIS IS JUST ONE OF THAT. SPEAKING OF ADMINISTRATION, WE HAVE A DIRECTOR OF THE OFFICE OF SCIENCE AND TECHNOLOGY APOLOGICY. YOU MAY KNOW IT WAS QUITE A LONG TIME HAVING THAT POSITION FILLED. KEVIN DROEG AMEYER FROM OKLAHOMA WAS CONFIRMED IN THE FIRST FEW DAYS OF THIS YEAR AND IMMEDIATELY STEPPED INTO THAT ROLE TO VISIT US WE GAVE HIM A TOUR WHAT IS GOING ON STEVE ROSEN BERG TALKING TO HIM ABOUT PARTICULAR AREAS OF SCIENCE MAKING SURE HE WOULD BE INTERESTED AND TONY FOUCHI AND VISITING THE CLINICAL CENTER HAVING JIM GILLMAN CLINICAL CENTER CEO EXPLAIN TO HIM LAYOUT OF LARGEST RESEARCH HOSPITAL IN THE WORLD NIH CLINICAL CENTER WE ARE OFF TO A GREAT START WITH INTERACTIONS WITH KELVIN. CONGRESS IS ALSO OF COURSE A PLACE WHERE WE SPEND A LOT OF TIME ANSWERING QUESTIONS AND PROVIDING INFORMATION AND SOMETIMES SITTING AT WITNESS TABLES YOU WILL HEAR AT A BIT FROM AID TREE ON HAL ET POINT OF CONTACT FROM EVERYTHING LEGISLATIVE ABOUT APROPRIATION HEARINGS AND LITTLE DETAIL ABOUT IT THAT WITH PHOTOS AND HOUSE HEARINGS AFTER SECOND NOOIFRN DAYS LATER ON APRIL 11TH. WE HAD THE OPPORTUNITY TO TELL GREAT STORIES ABOUT WHAT NIH IS DOING AND ANSWER THEIR QUESTIONS. THIS IS A PHOTOGRAPH OF ME WITH A WONDERFUL YOUNG MAN WITH DOWN SYNDROME AND ONE THING WE WERE ASKED ABOUT IS WHAT WE ARE DOING WITH DOWN SYNDROME RESEARCH WE MADE A COMMITMENT TO MORE THAN TRIPLE THE FUNDING OF THIS EFFORT OVER THE COURSE OF 2 OR 3 YEARS BASED ON THINGS WE NOW BELIEVE CAN BE DONE FOR INDIVIDUALS WITH THESE CONDITIONS AND LEARN FROM DOWNSYNDROMES AND ALZHEIMER'S DISEASE AND WHY ARE THEY PROTECTED AGAINST CORONARY DISEASE AND SOLID TUMORS THEY GET AT ALMOST ZERO FREQUENCY MUCH WE CAN LEARN THERE AND WE ARE HAPPY TO HAVE A CHANCE TO DRAW THE LINKS TOGETHER. I HAVE BEEN ON THE ROAD A BIT. IN THIS CASE IF NOT TOO FAR. THIS IS ONE YOU CAN GO TO IN YOUR CAR WENT TO VISIT THE UNIVERSITY OF DELAWA DELAWARE. LOTS OF FOLKS JOINED THIS EFFORT WE HAD A WONDERFUL DAY TOURING WHAT THEY ARE DOING IF IN DELAWARE HEARING ABOUT HOW ENTHUSIASTIC THEY ARE ABOUT NIH SUPPORT AND AID PROGRAM AND OTHER THINGS I TRAVELED TO SEATTLE AND HAD A WONDERFUL DAY THERE ONE OF THE PEOPLE IN THE PICTURE SITTING AT THE TABLE, JAY S. WHO WAS THE HOST OF A REMARKABLE AFTERNOON AS WE LOOKED AT WHAT IS GOING ON WITH GENOMICS AT UW PRESENTATION AND TO SEE HOW ADVANCED THEY ARE WITH ALL NIH SUPPORT THEY HAVE BEEN ABLE TO GET. JAY WILL BE SPEAKING TOMORROW AFTER WE ADJOURN IF YOU CAN STICK AROUND AT 2 O'CLOCK. JAY WILL BE GIVING I'M SURE AN EXCITING LECTURE ABOUT ADVANCES IN GENOMICS OF MANY SORTS PART OF ANJEWEL TRENT -- HE IS RETIRED FOR TWO YEARS WENT TO ARIZONA TO [INDISCERNIBLE] BRING A DISTINGUISHED SCIENTIST TO DELIVER IT. THIS YEAR IT IS JAY. THANK YOU JAY. 2 O'CLOCK TOMORROW AT THE LIP SIT AUDITORIUM IN THE MAIN CLINICAL CENTER WE WILL HEAR ABOUT THAT IF ABLE TO STAY AROUND LOOKING FORWARD TO THAT. MEETING WITH SENATOR MURRAY WENT WELL SHE IS INTERESTED IN WHAT IS GOING ON IN HER STATE CHANCE TO SEE MANY DEMONSTRATIONS GREAT OPPORTUNITY TO SPEND TIME WITH HER AND WE HAD A SEPARATE DISCUSSION ABOUT SEXUAL HARASSMENT A TOPIC OF GREAT INTEREST TO SENATOR MARIE THAT WE WILL TALK ABOUT AT THIS MEETING LATER ON TODAY. VARIOUS PEOPLE IN THE NIH COMMUNITY HAVE BEEN RECOGNIZED IN AWARDS SMATTERING AND APOLOGIES TO ANYBODY HERE WHO IS LISTENING THAT SHOULD HAVE BEEN PUT UP AS WELL PUT UP A COUPLE OF THEM JEFF ROGERS RECEIVING PRESIDENT'S MEDAL FROM AMERICAN SOCIETY OF NEF ROLLING IN SAN DIEGO AND LAURA B. THE PRESIDENTIAL AWARD NORA IS DIRECTOR OF NOOID AH NATIONAL INSTITUTION OF DRUG ABUSE AND HAS BEEN INCREDIBLY INVOLVED WITH OUR EFFORTS TO TRY TO BRING TH BEST SCIENCE SPECIAL EVENTS, WE HAVE LOTS OF THOSE. THIS WAS A GROUNDBREAKING FOR A NEW CELL PROCESSING CENTER IN THE CLINICAL CENTER. WE FEEL THE TIME IS RIGHT FOR CLINICAL CENTER TO EXPAND CAPABILITY FOR THINGS CANCER IMMUNOTHERAPY AND WAYS CELLS CAN BETHERAPIEUTIC THERE ARE NOT ENOUGH WOMEN IN THE PICTURE I WILL MENTION THAT. THERE HAS BEEN LOTS OF FOCUS HERE ON OPIOID CRISIS. WE HAD THE OPPORTUNITY TO ANNOUNCE A MAJOR SET OF INITIATIVES ON APRIL EIGHTH AT THE DEPARTMENT INCLUDING HEALING COMMUNITIES STUDY THAT AIMS TO PROVIDE RESOURCES TO FOUR STATES TO SEE IF WE BROUGHT EVERYTHING TOGETHER IN TERMS OF CAPABILITIES AND STAKEHOLDERS COULD WE REDUCE DEATH RATES. THIS IS WHAT WE WERE TRYING TO DO WITH THE STUDY. THESE ARE THE FOLKS THAT IS OUR SECRETARY ALEX SAIZ AR AND ELEANOR MCCATS DIRECTOR OF SAM IS AN AN IMPORTANT PART OF OPIOID EFFORT AND BREND GERARD WHO IS ASSOCIATE INSTITUTE OF HEALTH ONE OF THOSE ASSISTANT THANK YOU PEDIATRIC INTENSIVE CARE EXPERT AND WONDERFUL ALLIE FOR US AND MANY OTHERS IN THIS AREA. WE HAD THE CHANCE LAST MONTH TO HAVE JOHN PORTER ON OUR CAMPUS MANY HAVE BEEN AROUND A WHILE WHO WILL REMEMBER THE CHAIR APROPRIATION SUB-COMMITTEE AND HOUSE OF REPRESENTATIVES REPUBLICAN DECIDED OVER THE DECISION ULTIMATELY TO DOUBLE THE NIH DID BUDGET BEGINNING IN 1998 AND EXTENDED IN 2003 IT WAS SUCCESSFULLY DONE MANY PEOPLE TAKE CREDIT FOR THAT BUT MOST WOULD AGREE IT WAS JOHN PORTER WHO LED THAT EFFORT. BUILDING WE ARE HAPPY TO HAVE ON CAMPUS PAIR OF BUILDINGS IS JOHN PORTER NEUROSCIENCE CENTER. WE THOUGHT IT WAS APPROPRIATE FOR PEOPLE WORKING THERE THAT GOT TO CAMPUS LAST WEEK TO KNOW WHO WAS JOHN PORTER ANYWAY MUCH HELP FROM JOHN BESHG LOW PUT TOGETHER THIS PARTICULAR DISPLAY YOU SEE WHEN YOU WALK IN THE BUILDING AND HAD MR. PORTER COME OUT FOR OPPORTUNITY TO DEDICATE THAT EXHIBIT ALONG WITH BOARD MEMBERS OF RESEARCH AMERICA. HE CONTINUES TO BE A CRITICAL PART OF AND SPECIAL DATA. WE HAD HAD ANOTHER SPECIAL DAY I THOUGHT SO MAY 13TH, ONCE A YEAR I GET TO INVITE SOMEBODY TO COME SPEAK AT NIH PART OF KURLT TRAL CENTER NAMED IN HONOR OF EDROLL CULTURE ALLOWS US TO BRING TO CAMPUS SOMEBODY WHO IS NOT A MAINSTREAM CARD-CARRYING SCIENTIST BUT HAS SOMETHING TO SAY TO SCIENTISTS WE HAD NONE OTHER THAN BEST KNOWN OPERATIC SOP RANNO OF OUR ERA [INDISCERNIBLE] PHLEGMING WHO IS PERSON OF INTENSE INTELLECTUAL SCIENCE. I HAD PLEASURE OF WORKING WITH RENAE ON THAT PROGRAM THAT TRIES TO BRING TOGETHER BEST AND NEWEST INSIGHTS WITH MUSIC HOW IT EFFECTS US AND IS PROCESSED AND TOUCHES ON DEEPER PARTS OF OUR BRAIN PASSION AND EMOTION. WE LEARNED LOTS OF THINGS IN THAT REGARD YOUR BRAIN HAS A MUSIC ROOM AND YOU HEAR THINGS DIFFERENTLY THAN VOICE. IT IS IMPORTANT OR THE BRAIN WOULDN'T HAVE THAT PARTICULAR PROPERTY. RENƒ GAVE A WONDERFUL PRESENTATION ALL SHE HAS DONE OVER THE COURSE OF THE LAST COUPLE YEARS INCLUDING BEING IN MRI SCANNER IN THE CENTER FOR TWO HOURS AND SINGING AND LISTENING TO SOMEBODY ELSE SINGING AND SEEING WHICH PARTS OF THE BRAIN ACTIVATE IN THAT EXPERIENCE FUN PRESENTATION I GOT TO DO A BIT OF AN INTERVIEW WITH HER AND WE GOT TO SING. THAT IS GOING ON MY CV. >> AUDIENCE: [LAUGHING]. >> FRANCIS S. COLLINS: SHE WAS A REMARKABLE CONTRIBUTOR AND CONTINUES TO BE WE HAVE WORKING GROUP ON MUSIC AND THE MIND MADE UP OF MULTIPLE DIFFERENT INSTITUTES AND CENTERS FUNDING $5 MILLION TO BRING MUSIC THERAPISTS AND SOLID NEUROSCIENCE TOGETHER TO SEE WHAT THEY CAN LEARN FROM EEM OTHER. THOSE APPLICATIONS ARE BEING REVIEWED NOW AND AWARDS SHOULD BE MADE BY THE END OF THE YEAR. ONCE YEAR A YEAR WE HAVE THE OPPORTUNITY TO TAKE PART IN LORI PRIZE THAT IS TOP PRIZE GIVEN BY THE FOUNDATION FOR NIH. JURIED AWARD THAT GOES THROUGH EXTENSIVE CONSIDERATION WHO WOULD BE THE MOST APPROPRIATE PERSON TO RECOGNIZE. WE WERE THRILLED THAT THEIR CHOICE THIS YEAR IS YASMIN BELL KAD INTRAMURAL INVESTIGATOR IN NAID STUDYING MICROBIOME AND ITS RELATIONSHIP TO IMMUNE RESPONSE. MAY 22ND IN GALA EVENT SHE WAS HONORED I HAD A CHANCE TO DO INTERVIEW OF HER IN FRONT OF THE AUDIENCE TO TALK MORE ABOUT HER WORK. MUCH CONGRATULATIONS TO YAZ MINE. IT WAS GREAT TO SEE THIS SELECTION. WE ALSO OVER THE COURSE OF MANY MONTHS SINCE LAST DECEMBER HAVE BEEN MISSING SOMEONE WHO IS SUCH A CENTRAL PART OF OUR LEADERSHIP AT NIH. THAT IS STEVE KATZ WHO AS YOU KNOW DIED SUDDENLY OF A STROKE BACK IN DECEMBER. WE HAD A CELEBRATION OF STEVE KATZ'S LIFE ON MAY 3RD. YOU WILL NOTE IF YOU LOOK CLOSELY HERE A NUMBER O PEOPLE WHO CAME BACK FOR THIS PARTICULAR EFFORT THAT WOULD INCLUDE STORY LANDIS AND HAR YOLD VARMIS AND [INDISCERNIBLE] FORMER NIH DIRECTOR ASSEMBLED FOR THIS PURPOSE AND VIFIAN KING CAME BACK FOR THIS PURPOSE AND LINDA KATZ WIDOW AND HIS CHILDREN AND SPOUSE. THIS WAS A VERY SPECIAL DAY INDEED. STEVE WAS BOTH A WONDERFUL SCIENTIST AND A MUSICIAN. WE HAD TO HAVE A MUSICAL PART OF THIS IN THIS INSTANCE LED BY HIS DAUGHTER WHO IS HERE SINGING LEAD ON A SONG THAT ALL OF US ASSOCITE WITH STEVE WHICH IS A WONDERFUL JEWISH TRADITION SONG CALLED [INDISCERNIBLE] IF YOU HAVE HEARD IT IT WILL BE IN YOUR BRAIN FOREVER. IT IS A COMPELLING SONG AND SPECIAL TO HAVE A CHANCE WITH ALL HIS FAMILY THERE TO HAVE THIS KIND OF RECOGNITION AND REMEMBRANCE. WE MISS STEVE EVERY DAY FOR ALL HE DID FOR US AND WHICH WE WILL ALWAYS BE GRATEFUL. LOTS OF THINGS HAVE HAPPENED IN SCIENCE. IT WOULD TAKE ME THE REST OF THE DAY IF I WAS REALLY GOING TO ENUMERATE THEM. WOINT. I WILL MENTION ONE PARTICULAR VISIBLE ONE THAT HAPPENED IN TERMS OF PUBLIC RECOGNITION. IT WAS IN 60 MINUTES WHICH WAS THE STORY ABOUT SICKLE CELL DISEASE WHICH JOHN LA POOK WHO IS THE CORRESPONDENT FOR 60 MINUTES SPENT MORE THAN A YEAR BUILDING UP ARGUMENTS AND OPPORTUNITY HERE TO PROVIDE THIS KIND OF INPUT. THIS PARTICULAR STORY WAS, I THINK, ONE OF THE MORE INSPIRING ONES YOU HEARD IN A WHILE COVERING PARTICULARLY THE EXPERIENCE OF JAN EL-STEVENSON WHO IN THE STORY INITIALLY WITH SICKLE CELL DISEASE SUFFERING AS YOU MIGHT SEE IN THIS PHOTOGRAPH WITH CHRONIC AROUND SEVERE ATTACKS OF SICKLE CELL CRISIS ASSOCIATED WITH REALLY UNBEARABLE PAIN AND ULTIMATELY GOING THROUGH THE EXPERIENCE THAT JOHN AND HIS TEAM OVERSAW OF A GENE THERAPY CURE OF THIS, WHICH INVOLVED USE OF A GENE THERAPY VECTOR AND COLLABORATION WITH BLUEBERG WHICH REQUIRED HARVESTING BONE MARROW STEM CELLS AND TAKING THEM OUT OF THE BODY AND DOING TRANCE INSPECTION AND MAKING SURE IT IS DONE EFFICIENTLY AND WENT THROUGH BONE MARROW OBLATION TO MAKE SPACE FOR CORRECTED CELLS AND INFUSED BACK IN AGAIN. AT THE END OF THE STORY YOU SEE JANE WILL, PRACTICING JIU-JITSU VERY EFFECTIVELY I MIGHT SAY AND INTERVIEW WITH CORRESPONDENT AND HER DAD TALKING ABOUT HOW THIS BECAME A NEW LIFE FOR HER IN EARLY 20S NOW FROM EVERYTHING WE CAN SEE SEEMS TO HAVE ACHIEVED NOT JUST A GOOD RESULT BUT QUITE LIKELY A CURE AND TO BE ABLE TO SAY THAT FOR THE FIRST MOLECULAR DISEASE WE CAN NOW TALK ABOUT A MOLECULAR CURE IS A DREAM COME TRUE FOR ALL OF THE PATIENTS WITH THE DISEASE AND ALL OF US THAT HOPED AND DREAMED WE WOULD GET TO THAT POINT. THERE ARE MULTIPLE PROTOCOLS FOR SICKLE CELL DISEASE SOME INVOLVING GENE VECTOR THERAPY AND [INDISCERNIBLE] AND VARIOUS STRATEGIES AND SOME INVOLVING RNA TRANCE SPLANT AND ACOURSE BONE MARROW TRANSPLANT. [INDISCERNIBLE] TURNING OUT TO BE LEAST EXPERIENCED HANDS IF YOU HAVE A DONOR ALSO A GOOD OUTCOME. 15% OF SICKLE CELL PATIENTS ACTUALLY HAVE AN APPROPRIATE DONOR WE CAN'T RELY ON THAT. I SKIPPED OVER SOMETHING I REALIZED I WILL STEP BACK A MINUTE TO SAY ANOTHER WORD ABOUT STEVE KATZ IN OUR EFFORTS TO TRY TO RECOGNIZE HIS CONTRIBUTION WE THOUGHT THIS FIT NICELY WITH ONE OF THE RECOMMENDATIONS OF WORKING GROUP WITH ACD FOCUSED ON NEXT GENERATION OF RESEARCHERS. ONE OF THE RECOMMENDATIONS OF THE WORKING GROUP IS WE AUGHT TO HAVE A SEPARATE COMPETITIVE INVESTIGATOR INITIATIVE RO1 IN WHICH EARLY STAGE INVESTIGATORS COULD -- THE IDEA OF BEING THAT THE APPLICANT WOULD NOT FEEL OBLIGATED TO USE PRELIMINARY DATA POST DOCTORAL TRAINING AND START OUT IN A TOTALLY NEW DIRECTION THEY ARE EXCITED ABOUT ALL TOO OFTEN POST DOCKS STARTING OUT ASSISTANT PROFESSORS FEEL A CERTAIN AMOUNT OF PRESSURE TO CONTINUE WHAT THEY ARE DOING THEY HAVE STRONGEST PRELIMINARY DATA CASE WHICH MIGHT NOT BE BEST THING FOR THEM OR FOR SCIENCE. STEVE WAS ONE OF THOSE THAT PARTICULARLY EMBRACED THIS CONCEPT. WE HAVE ACCEPTED THAT RECOMMENDATION AND ARE IN THE PROCESS OF DEVELOPING SUCH AN RO1 PROGRAM THAT WILL ISSUE AWARDS OF THIS SORT. THEY WILL BE THE STEVE AND IRA KATZ R01 AWARDS TO BE ABLE TO RECOGNIZE HIS CONTRIBUTION. WE AIM TO LAUNCH THAT SOMETIME IN FISCAL YEAR 2020. YEAH. SORRY I FORGOT TO SAY THAT AT THE TIME. >> [INDISCERNIBLE]. >> PLEASE. THANK YOU. PLEASE. >> SO YEAH. I WANT TO APPLAUD YOU FOR THE CATS AWARDS IT IS A FANTASTIC THING. I'M CURIOUS HOW MANY WILL BE REVIEWING THESE AND HOW MR. THERE WILL BE. >> FRANCIS S. COLLINS: THIS IS APPROPRIATE QUESTION WE ARE DOING IT CAREFULLY AND THINKING IT THREW WE DON'T WANT IT TO FALL IN HANDS OF TYPICAL PEER REVIEW PANEL WHERE IS THE PRELIMINARY DATA THAT IS THE POINT CALLING MYCLOUER AT THE FOREFRONT OF TRYING TO DESIGN THE DETAILS TO YOU AND SEE WHAT HE WILL SAY TO YOUR QUESTION. >> YES AND YES WE ARE CONVENED A WORKING GROUP OF PEOPLE ACROSS NIH TO THINK OF A VARIETY OF IMPLEMENTATION ISSUES. WE DON'T KNOW HOW MANY WE WILL GET. THAT IS GOING TO BE THE INTERESTING PART OF THIS EXPERIMENT. ONCE WE ARE READY TO LAUNCH THIS, WE WILL MARKET THE PROGRAM BECAUSE WE WANT TO GET AS MANY OUTSTANDING APPLICATIONS AS WE CAN GET. >> FRANCIS S. COLLINS: I'M SURE WE WILL HAVE MORE TO TELL YOU ABOUT THIS WHEN WE GET TO DECEMBER. APPRECIATE BY ENTHUSIASM BY NODDING HAD HEADS AROUND THE TABLE THIS SEEMS LIKE IDEA TIME TO COME AND TO RECOGNIZE STEVE IN THIS WAY MAKES IT MORE SPECIAL FOR US. OTHER THINGS HAPPENING SCIENTIFICALLY WE GRABBED TITLES OF A VARIETY OF PRESS RELEASES THAT HAPPENED SINCE YOU WERE HERE AND YOU CAN SEE DIFFERENT THINGS BEING HIGHLIGHTED FROM ARTIFICIAL INTELLIGENCE ADVANCES TO CONCERNS ABOUT MENTAL HEALTH ISSUES PARTICULARLY SUICIDE RISK AND WHAT WE CAN DO ABOUT THAT AND FIRST TRIAL -- NOW FOUND ITS WAY INTO REAL TRIALS AND GENE THERAPY RESTORING IMMUNITY WITH X-LINKED SKID IF IN WAY THAT HAS A FANTASTIC OUTCOME. NEUROSCIENCE HERE IT IS POSSIBLE IF YOU PLAY THIS RIGHT YOU CAN TURN SOMEBODY'S CORTICAL ACTIVITY INTO SPEECH SOUNDS I CAN TELL YOU ABOUT THAT IT IS SPOOKY BUT AMAZING TO SEE IT IS POSSIBLE. TRAVEL DATA SHARING AGREEMENT WITH NAV AHO NATION AS PART OF ECHOSTUDY IMPROVEMENT IN WHAT TO DO ABOUT SEVERE HEAD INJURY AND VERY RECENTLY STUDY FROM INTRAMURAL PROGRAM SHOWING IT IS REALLY TRUE, GS HEAVILY PROCESSED FOODS CAUSE HEAVY WEIGHT GAINING IF YOU DIDN'T KNOW ABOUT IT AND THOUGHT IT WAS AN URBAN LEGEND IT IS TRUE. SMATTERING OF THOSE KINDS OF THINGS. TALKING ABOUT GLOBAL HEALTH AS WELL WE ARE IN THE PLACE WE DON'T THINK GLOBAL IS IN DOMESTIC THEY ARE INTERWOVEN WHEN IT COMES TO THINGS LIKE INFECTIOUS DISEASES. PROGRAM THAT WE INITIATED FIRST TIME THIS YEAR JOINTLY WITH GAITS FOUNDATION IS TO BRING -- THEY SPEND TWO YEARS WORKING IN RESEARCH LABORATORIES OF INVESTIGATORS HERE IN SUCH THINGS AS INFECTIOUS DISEASES AND NONCOMMUNICABLE DISEASES. THIS FIRST GROUP OF 10 ARRIVED FROM EIGHT DIFFERENT COUNTRIES IN SUBIS A HARRANT AFRICA AND EGIP THE AND ARE CHARTING A NEW COURSE FOR SOMETHING WE HOPE TO BECOME A REAL TRADITION. IN ADDITION TO TWO YEARS SUPPORT WHILE THEY ARE HERE GATES FOUNDATION GIVES START-UP PACKAGE TWO YEARS SUPPORT WHEN GO BACK TO AFRICA WHICH THEY ARE REQUIRED TO DO TO ESTABLISH THEMSELVES AS INDEPEND YEPT INVESTIGATORS TO GET THEIR OWN GROUP GOING. IT IS INSPIRING GROUP OF YOUNG SCIENTISTS TO GET A CHANCE TO SPEND TIME WITH. CELEBRATION OF 30 YEARS OF HUMAN FRONTIER SCIENCE PROGRAM AND JOINT EFFORT OF MANY DIFFERENT COUNTRIES BUT SPONSORED MOST PROMINENTLY BY JAPAN IT THAT LED TO THE SUPPORT OF A LOT OF POST DOCTORAL TRAINING AND RESEARCH PROJECTS IN THE INSTANCE GATHERING AT THE HOME OF JAPANESE AMBASSADOR. WILL YOU SEE A BUNCH OF US INCLUDING FRANCE KORTIVA HEAD OF THE NATIONAL [INDISCERNIBLE] FOUNDATION AND OTHER DIGNITY ARIES INCLUDING WARRIC ANDERSON HERE WHO IS DIRECTOR OF HUMAN FRONTIER SCIENCE PROGRAM AS WELL. LOTS TO CELEBRATE THERE. HONORING TONI FAUCI TALKING ABOUT GLOBAL HEALTH TO TELL YOU A BIT WHERE WE ARE IN TALKING ABOUT INFECTIOUS DISEASE ISSUES. ONE IS EBOLA AND MEASLES WHICH IS A GLOBAL HEALTH PROBLEM BUT BECAME A DOMESTIC ONE AS WELL IN THE PAST FEW MONTHS. THOUGHT IT WOULD BE USEFUL FOR YOU TO HEAR FROM THE GUY THAT KNOWS MORE ABOUT IT THAN ANYONE ON THE PLANET. HOW ARE WE DOING THERE? >> WE HAVE BEEN DEEPLY -- FIRST IS EBOLA UPDATE. WHEN YOU LOOK AT EBOLA, YOU LOOK AT IT FROM TWO STANDPOINTS OF EVOLUTION OF OUTBREAKS IN THESE REGIONS AND PARTICULAR ROLE NIH PLAYED IN THIS WHICH IS RATHER UNIQUE. THIS IS ONE OF THE FIRST TIMES A VERY INTENSIVE RESEARCH PROGRAM HAS BEEN CONDUCTED IN A CONTEXT OF AN ONGOING OUTBREAK YOU DON'T USUALLY SEE IT BUT IT IS USUALLY AFTER THE FACT. FIRST IS WEST AFRICAN OUTBREAK IN OUR HISTORY FROM 2014 TO 2016 IN WEST AFRICAN COUNTRIES YOU RECALL IT GOT LOTS OF PUBLICITY 28,000 CASES 11,000 DEATHS AND MORTALITY OF 40%. IN THE CONTEXT OF THAT, WHAT WE DEVELOPED IS WHAT WE CALLED PARTNERSHIP FOR RESEARCH -- WE REFERRED TO AS PREVAIL WHICH WAS LED LARGELY BY CLIFF LAIN ONE OF THE DEPUTY DIRECTORS HE SPENT A CONSIDERABLE AMOUNT OF TIME IN LIEBERIA AND LATER ON IN THE TWO WESTERN AFRICAN COUNTRIES YOU NOTE TRIALS DONE PHASE 2 TRIAL AND PHASE I TRIAL HERE AT NIH. PHASE II TRIAL CANDIDATE VACCINES + PLACEBO ONE IS BEING USED IN OUTBREAK IN DRC AND THERAPEUTIC Z MAP AND STUDY OF EBOLA SURVIVORS AS WELL AS OTHERS YOU SEE GOING DOWN TO PREVAIL 1 THROUGH 7. OF IMPORTANCE GOOD SCIENTIFIC DATA CAME FROM THAT. THESE ARE THREE REPRESENTATIVE PUBLICATIONS THAT APPEARED FROM THE WORK THAT WAS DONE BY THE NIH AND NIH SPONSORED INVESTIGATORS IN THE PLACEBO CONTROL VACCINE TRIAL AND Z MAP STUDY AND INTERESTING INFORMATION ON SURVIVORS AND AFTER EFFECTS OF EBOLA INFECTION. IMPORTANTLY, WE ASK THE NATIONAL ACADEMY OF SCIENCES TO EVALUATE THAT UNIQUE APPROACH OF DOING A NUMBER OF TRIALS IN THE CONTEXT OF AN OUTBREAK AND TO OUR GREAT SATISFACTION, THEY CAME TO THE CONCLUSION THAT WHAT WE WERE DOING WAS ABSOLUTELY APPROPRIATE AND CORRECT. MAINLY CORE PRINCIPLES OF SCIENCE AND ETHICS IN CONDUCTING CLINICAL RESEARCH SHOULDN'T CHANGE BECAUSE YOU ARE IN THE MIDDLE OF AN EPIDEMIC. WENT ON TO SAY TRIALS WE DID WERE ETHICAL AND APPROPRIATE AND MOST EFFICIENT AND RELIABLE WAY TO DETERMINE SAFETY AND EFFICACY OF ANY INTERVENTION. RIGHT NOW AS WE SPEAK, WE ARE IN THE MIDDLE OF ANOTHER INTERESTING PROBLEM WHICH IS ONGOING AND RAGING OUTBREAK IN DEMOCRATIC REPUBLIC OF THE CONGO AFTER A COUPLE DAYS AROUND 1400 DEATHS AND CONFIRMED CASES IN THE COUNTRY AND DEMOCRATIC REPUBLIC OF THE CONGO. NOTICE ON THE MAP IT ABUTTS U GONE DAH. YU CAN SEE THIS IS NOT A PROBLEM GOING AWAY. IF YOU LOOK FROM AUGUST UNTIL NOW, JUNE, YOU CAN SEE THERE HAVE BEEN UPS AND DOWNS BUT WE ARE NOW IN AN UP TREND. IT IS NOT AN OUTBREAK UNDER CONTROL. AGAIN, IN THE MIDST OF THIS LED LARGELY BY CLIFF LANE IN OUR GROUP WE INAUGURATED AND ARE IN THE MIDDLE OF RANDOMIZED CONTROL TRIAL OF THERAPEUTICS INTERVENTIONS ONE IS Z MAP INTERVENTION OF BROADLY NEUTRALIZING ANTIBODY AND COMBINATION OF THREE WE DID IN THE WEST AFRICAN OUTBREAK AND [INDISCERNIBLE] -- AND IMPORTANTLY, MONDAYI CLONAL ANTIBODY 114 THAT WAS DEVELOPED HERE IN THE VACCINE RESEARCH CENTER IN NIH CAMPUS RESULT OF BRINGING OVER PERSON INFECTED IN KICK WICK OUTYEARS AGO BROUGHT IT IS NOW IN CLINICAL TRIAL. IT IS SOMETHING THAT ORIGINATED IN AFRICA. IT IS NOW COMING BACK. WE HAVE OVER 300 PATIENTS NOW. POWER OF THE STUDY WILL REQUIRE 500 PATIENTS AND WAY THAT THEY ARE ENROLLING NOW IS HIGHLY LIKELY WE WILL HAVE ENOUGH PATIENTS TO GET AN EFFICACY SIGNAL FROM THE TRIAL. IT THAT IS VERY IMPORTANT AND DOESN'T USUALLY HAN IN THE MIDDLE OF THE OUTBREAK. SITES OF PALM DRC I MENTION STRONGER ABUTMENT WITH UGANDA CONCERNED AND WONDERED WHY WE HADN'T SEEN SPILLOVER OF CASES OF EBOLA FROM DRC OR UGANDA OR RWANDA. IT WAS DIFFICULT TO DO RESEARCH WHAT YOU READ IN NEWSPAPERS MAINLY VIOLENCE OF PEOPLE WHO ARE INTERVENING. SEVERAL OF THE DOCTORS WHO WERE INVOLVED IN SOME OF THE STUDIES ALL CONGO LEEZ AND ONE PERSON FROM SEN AGAL WHO WAS KILLED IN TRYING TO IMPLEMENT THE VACCINATION AND RANDOMIZED TRIAL I MENTIONED WE HAVE OVER 132,000 PEOPLE THAT RECEIVED THE INTERVENTION. IT IS HIGHLY LIKELY THAT THE LACK OF EXPLOSION OF THIS HAS BEEN DUE AT LEAST IN PART TO SOME OF THE EFFICACY OF THE VACCINE. NOT SURE HOW EF KASHS IT IS BUT PROBABLY SUBSTANTIALLY EFFECTIVE BUT MAYBE NOT AS HIGH AS IT WAS ORIGINALLY REPORTED THIS IS PICTURE OF TED ROSS WHO GOES FREQUENTLY THERE VISITING ONE OF THE INDIVIDUALS ON THE VACCINE TEAM THAT WAS ACTUALLY ATTACKED IN IMPLEMENTING THE VACCINE. SURE AS ONE WOULD HAVE THOUGHT, SOONER OR LATER, THE OUTBREAK CAME TO UGANDA. YOU HAVE PROBABLY SEEN IN NEWSPAPERS FIRST SINGLE CASE OF 5-YEAR-OLD pBOY INFECTED IN DRC ACROSS BORDER AND CAME AND GOT SICK IN UGANDA FOLLOWED BY HIS GRANDMOTHER GOT SICK AND DIED YESTERDAY. THERE IS ONE MORE CASE. THREE CASES IN UGANDA. THIS IS THE NEW YORK TIMES ARTICLE FROM A COUPLE DAYS AGO WHEN THE FIRST OF THE INDIVIDUALS THE 5-YEAR-OLD BOY DIED. BECAUSE OF THIS, IT IS CLEAR THIS IS NOT UNDER CONTROL AND NUMBER OF DIFFERENT OPINIONS HOW LONG THIS WILL TAKE. MAY TAKE UP TO TWO YEARS TO GET IT UNDER CONTROL. DOUBT IT WILL TAKE THAT LONG BUT WON'T BE NEXT MONTH OR MONTH AFTER PROBABLY AT LEAST A YEAR BEFORE WE SEE COMPLETE CONTROL OF THAT. QUICKLY GOING ON TO MEASLES I WILL RUN THROUGH A FEW THINGS OR MANY PEOPLE DEPENDING WHEN YOU DID YOUR TRAINING AS TO WHETHER YOU HAVE EVER SEEN A CASE OF MEASLES. OKAY. WE KNOW WHAT MEASLES IS. IT IS A HIGHLY CONTAGIOUS VIRUS. I DON'T WANT TO GO OVER MICROBIO-101 WITH YOU IT IS THE MOST CONTAGIOUS VIRUS KNOWN TO MAN. WE KNOW LOTS ABOUT MEASLES WE STUDIED IT EXTENSIVELY. TYPICAL SYMPTOMS ARE FEVER COUGH RASH TWO TO FOUR DAYS LATER CONTAGIOUS FROM FOUR DAYS BEFORE THE RASH OCCURS TO FOUR DAYS AFTER IT APPEARS. I TELL YOU THIS. THIS IS IMPORTANT IN THE KINETICS OF THE SPREAD WE ARE SEEING. NOT A TRIVIAL DISEASE 9% DEVELOP AN EAR INFECTION 1 TO UP TO 10% DEVELOP PNEUMONIA AND ONE IN FOUR CASES ARE HOSPITALIZED 1 IN 1,000 HAVE ENCEPHALITIS AND 1 TO 3 PER THOUSAND DIE. I TELL YOU THIS BECAUSE ANTIVAXERS CLAIM IT IS A RATHER TRIVIAL DISEASE WE SHOULDN'T WORRY ABOUT IT DOESN'T MAKE A DIFFERENCE IF YOU GET VACCCINATED COULDN'T BE FATHER FROM THE TRUTH. RISK GROUPS ARE CHILDREN THAT ARE YOUNG PREGNANT WOMEN AND IMMUNOCOMPROMISED ADULTS. A LITTLE HISTORICAL CONTEXT, PRIOR TO THE VACCINE ERA THERE WERE 2.6 MILLION DEATHS EACH YEAR GLOBALLY. SO MUCH FOR THE LACK OF SERIOUSNESS OF THE DISEASE. WE SAW A DRAMATIC DECREASE WHEN VACCINES WERE INTRODUCED IN 1963 AND THEY HAVE PREVENTED ABOUT 20 MILLION DEATHS IN 17 YEARS FROM 2000 TO 2017 AND LAST RECORDED YEAR 110,000 DEATHS MEASLES IN YOUNG CHILDREN AND LESS THAN 5 YEARS OLD. IN THE UNITED STATES SOMETHING WE TEND TO FORGET 3 TO 4 MILLION CASES EACH YEAR BEFORE INTRODUCED THE VACCINE IN 1963 LED TO 48,000 HOSPITALIZATIONS AND 500 DEATHS EACH YEAR. AS MEASLES IS ONE OF THE MOST CONTAGIOUS VIRUSS KNOWN, THE VACCINE IS ONE OF THE MOST EFFECTIVE VACCINES WE DEVELOPED AGAINST ANYTHING. TWO DOSES PRIME OF 12 TO 15 MONTHS AND BOOST OF 4 TO 6 YEARS GIVES YOU 97% PROTECTION. WE DON'T HAVE OTHER VACCINES MORE EFFECTIVE THAN MEASLES VACCINE I SAY THIS TO YOU BECAUSE OF PARADOX OF NOT WANTING TO VACCINE YOUR CHILDREN. ELIMINATE VACCINE BY YEAR 2000. NOTE NUMBER OF CASES AROUND 1960. VACCINE WAS INTRODUCED IN 1963 AND MEASLES ELIMINATED IN 2000. I EMPHASIZED RECENT ARTICLE I WROTE IN NEW ENGLAND JOURNAL WE ARE NOW GOING BACKWARDS WHAT HAPPENS IS AS LONG AS THERE IS MEASLES SOMEWHERE IN THE WORLD THERE IS A LOT I MENTIONED 110,000 DEATHS GLOBALLY IN 2017, UNDERSTANDABLY THERE WILL CONTINUE TO BE IMPORTATION OF CASES PEOPLE COMING FROM A COUNTRY WHERE THERE ARE MEASLES INADVERTENTLY COMING TO THE COUNTRY OR PEOPLE VISITING PEOPLE AND THEN COMING BACK. THIS IS WHAT WE SAW IN THE WILLIAMS BURRING SECTION OF BROOKLYN WHEN A CHILD WENT OVER TO VISIT RELATIVES IN ISRAEL AND CAME BACK AND WE HAD EXPLOSION IN NEW YORK. WE ARE SEEING THIS NOW THIS IS LARGEST NUMBER OF CASES AS OF A FEW DAYS AGO 1,022 CASES OF MEASLES WHICH IS WORSE WE HAVE SEEN IN 25 YEARS INVOLVING 28 STATES SHOWN HERE AND RELATIVE INTENSITY GEOGRAPHICALLY IS SHOWN ON THE SLIDE WITH OVER 560 CASES IN BROOKLYN AND WILLIAMS BURRING SECTION IN QUEENS AND 266 CASES IN ROBBINGLAND COUNTY. REASON FOR INCREASE IS OBVIOUS I MENTIONED TO YOU INCREASE OF NUMBER OF TRAVELERS THAT CONTRACT MEASLES AND BRAINING BACK TO THE UNITED STATES AND U.S. CITIZENS THAT GO OVER THERE AND COME BACK. IT SPREADS IN COMMUNITIES WHERE YOU HAVE UNVACCINATED PEOPLE YOU HAVE HEARD OF IMMUNITY I DON'T HAVE TO EXPLAIN IT TO YOU. THE HEARD IMMUNITY KICKOFF FOR MEASLES IS 33 93 TO 95%. YOU WILL NOT HAVE AN OUTBREAK. YOU MAY HAVE INDIVIDUAL INFECTION. IT WASN'T THE CASE IN WILLIAM'S BURRING SECTION IN BROOKLYN VAXLE EVEN WENT TO SOMEWHERE BELOW 80% BETWEEN 70 AND 80 WHICH IS A PERFECT SETUP FOR OUTBREAK WE HAVE SEEN REASON FOR INCREASE IN MEASLES CASES VACCINE HESITANCY AND MISCONCEPTIONS OF ADVER EVENTS AND AUTISM AND PHILOSOPHICAL OR NON-MEDICAL EXEMPTIONS WHERE PEOPLE FEEL I CALL IT LIBERTARIANISM TAKEN TO THE EXTREME THEY ARE PERSONAL BELIEFS THEY DON'T WANT ANYONE CIVIL OR MEDICAL TO TELL THEM WHAT TO DO WITH THEMSELVES. FINALLY, THIS IS A SERIOUS PROBLEM. WHO DECLARED NOW THAT THE ANTIVACCINE MOVEMENT IS ONE OF TOP 10 THREATS TO GLOBAL HEALTH IN 2019 TRAGEDY FRUSTRATING PARADOXICAL WE HAVE A DISEASE WE GOT RID OF SOME TIME AGO THAT IS NOW COMING BACK WITH A VENGEANCE. I WILL STOP THERE HAPPY TO ANSWER QUESTIONS. >> QUESTIONS AND COMMENTS FROM A. CD MEMBERS YES, PLEASE. >> IN TERMS OF DEVELOPMENT OF CLINICAL TRIALS FOR EBOLA TREATMENT HAVE YOU ACTUALLY DEVELOPED INNOVATIONS AND DEPLOYING IT AND EXECUTING AND DESIGNING CLINICAL TRIALS IT THAT WOULD BE TRANSFERABLE TO OTHER CONDITIONS? >> I'M NOT SURE I UNDERSTAND THE QUESTION. >> THE QUESTION IS. >> PULL THE MICROPHONE A LITTLE CLOSER, CAN YOU? IT IS A LITTLE HARD TO HEAR. THAT IS BETTER. >> WERE THERE INNOVATIONS IN CLINICAL TRIAL DESIGN OR EXECUTION THAT CAN BE DEPLOYED. >> SURE. >> IN OTHER CONDITIONS OR OTHER DISEASES IN CLINICAL TRIALS? >> YEAH. I MEAN THE STANDARD CLINICAL TRIAL DESIGN WE USED WAS A RANDOMIZED CONTROL TRIAL. ONE ISSUE WE HAD IS WE DID A PLACEBO CONTROL TRIAL WITH Z MAP THAT IS AN INTERVENTION WHICH IS GOLD STANDARD KNOWING IF YOU WANT TO GET IT APPROVED. WE HAD ALMOST THE STATISTICAL OF SIGNAL OF EFFICACY. IT WASN'T QUITE 0.05. YOU KNOW? IT WAS 91.7% CHANCE IT ACTUALLY WORKED. WE PUBLISHED IT IN THE NEW ENGLAND JOURNAL WHEN OUTBREAK IN DRC CAME WE WANTED TO DO RANDOMIZED CONTROLLED TRIAL WE COULDN'T DO PLACEBO WE BROKE EBBINGI PORE IT WAS A SIGNAL IT MIGHT BE EFFECTIVE. THE DESIGN WAS AN INTERESTING DESIGN APROPOS OF YOUR QUESTION. IT WAS A RANDOMIZED CONTROL TRIAL. CONTROL WAS Z MAP. WE WANTED TO SEE IF ANYTHING WAS GOOD OR BETSER THAN Z MAP WHICH IS AGAINST MONTI CLONAL ANTIBODY [INDISCERNIBLE] SO WE KNOW WE COULDN'T GIVE THEM NOTHING. IT WAS A SUGGESTION THAT Z MAP WORKS. THAT WAS THE DESIGN OF THE TRIAL. >> THANK YOU, DR. FOUCHI. CAN YOU SAY WHETHER THE LATEST OUTBREAK OF IT, THE BREADTH OF IT IS BEGINNING TO PLAY AGAINST THE PROPAGANDA OF THE ANTIVAXERS DO YOU SEE ANY INCREASE IN VACCINATION RATES MORE GENERALLY PARTICULARLY IN GROUPS THAT ARE AGAINST IT. >> YEAH. >> COULD YOU SPECULATE ON HOW BAD IT WOULD HAVE TO GET BEFORE SOMEONE WHO KNEW SOMEONE WITH MEASLES HAD A SIDE EFFECT AND THEREFORE IT BECAME IRRATIONAL NO THE TO VACCINATE. >> YEAH. YOU KNOW, THAT IS A GREAT QUESTION. I INCORRECTLY THOUGHT THAT IN NEW YORK CITY WHEN THEY GOT UP TO THE HUNDREDS OF NUMBERS THAT THEY HAVE NOW THAT THEY WOULD SAY OH, MY GOSH. WE GOT IT WRONG. THEY ACTUALLY HAD AN ANTIVAX RALLY IN NEW YORK CITY. COMPLETELY BLEW ME AWAY THEY DID THAT. IN ANSWER TO YOUR QUESTION HOW BAD DOES IT HAVE TO GET? PROBLEM IS IT WILL LIKELY NOT GET SO BAD TO GET PEOPLE WHO ARE REALLY PHILOSOPHICALLY WED TO THIS LIBERTARIAN MOVEMENT. I DON'T THINK WE WILL CHANGE THEIR MIND. I THINK WHAT WILL CHANGE ARE THE PEOPLE WHO WERE FOOLED BY THE PROPAGANDA OF ADVERSE EVENTS. YOU KNOW, THERE ARE REALLY TWO GROUP AND THOSE THAT THINK IT CAUSES AUTISM IF YOU CONVINCE THEM IT DOESN'T THEY WILL GET VACCINATED AND PEOPLE DON'T WANT ANY AUTHORITY TELLING THEM WHAT TO DO WITH THEIR CHILDREN. I WAS SURPRISED GREAT QUESTION I COULDN'T BELIEVE THEY HAD A PROBE ANTIVAX RALLY IN THE MIDDLE OF AN OUTBREAK. >> JOSE. >> IT SOUNDS LIKE LOTS OF OPPOSITION TO ANTE VACCINATION COMES TO THE [INDISCERNIBLE] CONNECTION. I WONDER WHETHER NAID OR NIH INITIATIVE CONSIDER SOON AS WE SAW [INDISCERNIBLE] AUTISM LESS OF ARGUMENT WE WILL HAVE AND THERE WILL BE A NEED TO PUT FUNDING INTO THE GENETIC AND OTHER CAUSES OF AUTISM AS ROUNDABOUT WAY TO GET THAT CAMP OUT OF THE EQUATION. >> YOU ARE ABSOLUTELY CORRECT. WE ARE DOING AN AWFUL LO THE TO LOOK AT THE OBVIOUS CONNECTIONS AND PARTICULARLY THINGS WE LEARNED THAT AUTISM DEFECTS START EVEN BEFORE SOMEBODY IS BORN THE APPROPRIATE CASE. >> JORN WOULD TOTALLY RESONATE WITH WHAT YOU SAID NIH MADE EFFORTS WITH [INDISCERNIBLE] TO TRY TO SPEED UP THE PROCESS OF DOING THAT KIND OF DIAGNOSTIC ABILITY BOTH IN TERMS OF GENETICS TURNING OUT TO BE EXTREMELY REVEALING AND LOOKING FOR SUBTLE TERMS OF AUTISM EYE MOVEMENTS POSSIBLE TO MAKE SURE WELL BEFORE THE DIAGNOSIS MMR -- DATA BUILDS UP WILL IT CONVINCE PEOPLE WHO ARE OTHERWISE ABSOLUTELY LOCKED IN PERSPECTIVE WE HAVE TO HAVE ALL EVIDENCE WE CAN WE WANT TO FIGURE OUT WHAT IS AUTISM AND HOW CAN WE HELP THOSE KIDS SF? IT IS A REALLY IMPORTANT QUESTION. >> TONY, THANK SOZ MUCH FOR BRINGING THAT NFTHS TO THIS GROUP AND FOR YOUR LEADERSHIP IF IN THIS ALWAYS CHALLENGING ROLE. ONE THING TO HAVE OUTBREAK OF EBOLA THAT IS STRESSING US AND ANOTHER OUTBREAK WE SHOULDN'T HAVE HAD MEASLES IN OUR OWN COUNTRY CLEAR SIGN WE TURNED THE CORNER ON THAT ONE TOO. I GOT MEASLES AT AGE 29 AND WAS HOSPITALIZED WITH NUMONITIS AND CONCERNS ABOUT WHETHER MY BRAIN WAS WORKING PROPERLY. I WAS A PRETTY DARN SICK COOKIE. DIDN'T GET VACCINATED OR GO TO SCHOOL UNTIL THE 6TH GRADE EVERYBODY ELSE HAD MEASLES ABOUT I THEN I NEVER GOT EXPOSED UNTIL DAUGHTER'S PLAY MEAT BROUGHT IT TO OUR HOUSE IN CHAPEL HILL. IT WAS AN EXPERIENCE. I HAVE GREAT RESPECT FOR THIS DISEASE. FEW THINGS TO SAY ABOUT GLOBAL HEALTH. IN FACT, RELEVANT TO THAT NEXT MONDAY AND TUESDAY HERE AT NIH WE WILL HAVE ANNUAL MEETING OF GROUP CALMED HEADS OF INTERNATIONAL RESEARCH ORGANIZATIONS HEROES WHICH HAS MET EVER SINCE HARE YOLD V. AND GEORGE R. STARTED IT 23 YEARS AGO. BRINGS AROUND THE SAME TABLE LEADERS OF ORGANIZATIONS ACROSS THE WORLD THAT ARE RESPONSIBLE FOR ABOUT 90% OF TOTAL PUBLIC FUNDING OF BIOMEDICAL RESEARCH. THERE IS ALWAYS AN OPPORTUNITY TO SHARE IDEAS AND CONSIDER COLLABORATIONS TOGETHER. THAT INCLUDES WELCOME TRUST AND UKNRC INDIA JAPAN -- IF NEW ZEALAND CANADA AND CHINA. CHINA WON'T BE REPRESENTED THIS TIME. JEREMY FER AR SERVES AS CURRENT CHAIR I HAVE BEEN THE CHAIR BUT IT WILL BE NICE TO HOST THIS YEAR. WE WILL TALK ABOUT LOTS OF THINGS PLAN S ON OPEN ACCESS PUBLICATION AND INCLUDING VARIOUS IDEAS OF RISK HIGH RISK AND REWARD PROBLEMS. -- WE WILL HEAR ABOUT INTERNATIONAL COHORT CONSORTIUM I WILL CALL ON JEFF GINS BERG TO SAY MORE ABOUT THAT. HE WILL PRESENT AGAIN AT HEROS NEXT WEEK THANKS FOR SPENDING TIME IN OUR NEIGHBORHOOD AND FEW DAYS HERE SESSION NIH HAS BEEN ASKED TO PLAY A SIGNIFICANT ROLE IN ABOUT WHAT WE SHOULD BE DOING INTERNATIONALLY ABOUT CLINICAL USES OF HUMAN GENE LINE EDITING IN THE WAKE WHAT HAPPENED BACK IN NOVEMBER WITH ANNOUNCEMENT EDITING OF TWO TWINS BY SCIENTIST DR. WHO IN CHINA AND WHAT IN FACT SHOULD THE INTERNATIONAL COMMUNITY SHOULD BE DOING TO ADDRESS THAT OBVIOUSLY. LOTS OF COMPLEXITIES THERE INVOLVEMENT WHO. HEROS WILL BE A GOOD PLACE TO TALK ABOUT IT AS WELL. WE ARE SURVEYING ALL HEROS MEMBERS TO MAKE SURE WE HAVE CLEAR SENSE WHAT CURRENT AND OR LEGAL RESTRICTIONS ARE IN THEIR COUNTRIES ABOUT SUCH ACTIVITIES THAT HASN'T ALWAYS BEEN ENTIRELY CLEAR DAY AFTER HEROS MONDAY AND TUESDAY, [INDISCERNIBLE] WILL MEET GACD WHICH IS CHILD OF HEROS THEY WILL WORK ON THEIR SERIES OF PROJECTS HYPERTENSION -- THESE ARE ALL NONCOMMUNICABLE AND OF INCREASING IMPORTANCE IN LOW AND MIDDLE INCOME COUNTRIES. SPEAKING OF INTERNATIONAL ISSUES, I MENTIONED BACK IN DECEMBER STRUGGLES THAT WE HAVE BEEN HAVING WITH HOW TO ADAPT TO THE EUROPEAN GENERAL DATA PROTECTION REGULATION. GDPR. ANY OF YOU WHO HAVE INVOLVED IN INTERNATIONAL COLLABORATIONS THAT INVOLVE EXCHANGE OF BIOSAMPLES OR DATA, IF THEY HAPPEN TO INVOLVE EUROPE, YOU WILL HAVE FOUND OUT THAT THINGS GET VERY COMPLICATED JUST ABOUT A YEAR AGO WITH ISSUANCE OF GDPR REGULATIONS. I CAN TELL YOU FROM MY OWN RESEARCH EFFORT 25 YEAR COLLABORATION INVESTIGATORS IN FINLAND WE FIND OURSELVES SEVERELY HAM STRUNG BY VIOLATIONS THEY ARE WRITTEN IN WAY THAT THERE IS LOTS OF ROOM FOR INTERPRETATION AND DIFFERENT INSTITUTIONS INTERPRETING THEM DIFFERENTLY AND LAWYERS ARE TAKING CONSERVATIVE VIEW. SUBSTANTIAL FINANCIAL PENALTIES ASSOCIATED WITH CROSSING ANY LINES THAT ARE THERE. FRANKLY IT HAS BEEN A TOUGH YEAR TRYING TO KEEP LOTS OF COLLABORATIONS GOING IN TIME WHERE LIMITATIONS IN SHARING HAS BECOME REALLY QUITE A SERIOUS PROBLEM. WE AND IN THIS CASE CARRIE AND ROB EAST FOEGERITY CENTER AND BUNCH OF OTHER FOLKS HAVE WORKED HARD TO TRY TO SEE A WAY THREW THICKET OVERSIGHT COMPLICATIONS. -- OF EUROPEAN COMMISSION AND WE ARE HEARING NOW THAT ALONG WITH OUR HELP FROM THE STATE DEPARTMENT, THERE IS GOING TO BE A CONSULTATION MEETING IN BRUSSELS. IT WILL BE PROBABLY IN THE NEXT MONTH OR TWO. IT MIGHT BE AN OPPORTUNITY TO REALLY GET FORWARD MOTION HERE IN TERMS OF GETTING MORE EXPLICIT INDICATIONS HOW REGULATIONS OUGHT TO BE INTERPRETED. VIEW WOULD BE IF INDIVIDUAL CONSENTED AS PART OF RESEARCH TO DONATE BIOSAMPLES AND DATA AND MADE CLEAR THEY WANT ALL INVESTIGATORS TO USE THAT INFORMATION FOR MAXIMUM PROGRESS TO HAPPEN IT OUGHT TO BE HONORED NOT CURRENT CASE GDP IS OVERSEEING THAT RULING THAT INSTANCE DOESN'T SEEM RIGHT INDIVIDUAL HAS FINAL SAY ABOUT WHAT HAPPENS TO MATERIALS AND DATA. WE WILL KEEP YOU POSTED ON THAT. CURIOUS THAT IF ANY OF YOU ENCOUNTERED SIMILAR DIFFICULTIES WITH GDPR. I SEE JOSE NODDING HAVE YOU HAD LUCK THERE FROM YOUR STANCE THERE BEING ABLE TO TRY TO GET PAST WHAT OFTEN TIMES VERY LEGALISTIC INTERPRETATIONS? >> MAIN PROBLEM IS WITHIN THE EUROPEAN UNION MEMBERS EACH COUNTRY HAS THEIR OWN INTERPRETATION YOU DEAL WITH SCIENTISTS IN FINLAND THAT FEEL DIFFERENT FROM PEOPLE IN GERMANY LOGISTICAL NIGHTMARE. >> PEOPLE IN DIFFERENT COUNTRIES IN DIFFERENT INSTITUTIONS FEEL DIFFERENTLY. -- THIS EFFORT TO BRING TOGETHER LARGE NUMBER OF COHORT STUDIES ENROLLING 100,000 PARTICIPANTS LEADING EFFORT IN THEIR ORGANIZATION G2MC AND RECENTLY HAD IMPORTANT MEETING IN RAIK AVIK. PLEASE, JEFF. >> THANK DZ FRANCIS FOR CHANCE TO GIVE BRIEF UPDATE ON IHCC INTERNATIONAL 100 + -- I CO-CHAIR IT WITH CHAIR MIN OELIO AND PETER GOOD HAND TO AFFORD GREAT LINKAGES TO THAT ORGANIZATION. OUR VISION HAS BEEN TO CREATE A GLOBAL NETWORK OF LARGE COHORTS TO ENABLE ENHANCEMENT OF UNDERSTANDING OF BIOLOGICAL ENVIRONMENTAL AND MOLE EBBING LAL UNDERSTANDING OF DISEASE IMPACT GLOBAL HEALTH FORPED CONSORTIUM LAST YEAR HAD FIRST SUMMIT. FRANCIS MENTIONED CRITERIA OVER 100,000 POTENTIAL ENROLEES OR PERSPECTIVE ENROLEES BIOLOGICAL SAMPLES BANKED AND EDUCATIONAL FOLLOWUP IS A [INDISCERNIBLE] CRITERIA. ROUGHLY 30 MILLION PARTICIPANTS REPRESENTED AT FIRST SUMMIT BY COHORTS IN THE ROOM. OUT OF THAT SUMMIT, WE BEGAN TO WORK ON WORK STREAMS AROUND THE SCIENTIFIC AGENDA FOR CONSORTIUM AS WELL AS DATA AND POLICY AGENDAS FRAN KRIS MENTIONED WE HAD MEETING IN RAIK AVIK IN APRIL. 30 COUNTRIES IN THAT MEETING AND ROBUST DISCUSSION OF SCIENTIFIC PRIORITIES FOR IHCC AND SOME THINGS FLOATED TO TOP OF AGENDA WERE OPPORTUNITY TO DEVELOP MULTIETHNIC POLYGENIC RISK WARS TO REDUCE ETHNICITY GAP THAT EXISTED IN GENOMIC DATABASES BY SEQUENCING AND UNDER-REPRESENTED GROUPS AS WELL AS A VERY LOFTY GOAL POTENTIALLY TO DO THE FULL CATALOGUE OF HUMAN KNOCKOUTS AND EXTENSIVE OPPORTUNITY WITH NUMBERS THAT IS A POSSIBILITY IN THE FUTURE. WE ALSO ARE INITIATING AN EFFORT TO CREATE A GLOBAL ATLAS TO ALLOW COHORTS TO BE DISCOVERABLE BY INVESTIGATORS AROUND THE GLOBE AND ENHANCE THE COLLAB RALTTIVE EFFORTS WE MENTIONED IN TERMS OF POLICY DOING THINGS WITH GDPR AND DATA SHARING AND GOVERNANCE AND HOW TO DO INDUSTRY IN CONSORTIUM ARE TOP OF THE LIST. NEXT WEEK WE WILL BE BACK LEADING DISCUSSION WITH THE HEROS AND THINKING ABOUT HOW TO REALLY ENABLE THIS EFFORT TO MOVE FORWARD FOR SCIENTIFIC ADVANCEMENT. >> JEFF THANKS FOR THE LEADERSHIP OF THIS REALLY IMPORTANT EFFORT. IN THAT REGARD I COULD GIVE YOU A QUICK SNAPSHOT WHAT IS HAPPENING WITH OUR MOST RECENT AND AMBITIOUS LONGITUDINAL COHORT CONSORTIUM BEING ALL OF US. AS OF JUNE 6TH, 248,000 PEOPLE FROM ALL 50 STATES HAVE REGISTERED FOR THE PROGRAM AND 154,000 OF THEM COMPLETED ALL THE STEPS INCLUDING BIOSAMPLES AND MEASUREMENTS. HAPPY TO TELL YOU 154,000, 51% ARE RACIAL AND ETHNIC MINORITIES. IF YOU ALSO COUNT OTHER UNDER-REPRESENTED GROUPS SUCH AS RURAL OR THOSE WHO ARE OF LOWER SOCIUSIO ECONOMIC STATUS GET TO 80% OF ALL GROUPS ESSENTIALLY UNDER-REPRESENTED AND OFTEN NOT MUCH ATTENDED TO IN RESEARCH. 438 CLINICS ENROLLING IN PARTICIPANTS AND TWO TRAVELING MOBILE EXHIBITS. THIS HAS 38 ENGAGEMENT PARTNERS WITH DEEP TIES TO DIVERSE COMMUNITIES ACROSS THE COUNTRY. WE ARE HOSTING SEVERAL TRIBAL CONSULTATION AND LISTENING SESSIONS ACROSS THE COUNTRY TO GATHER INPUT ABOUT HOW TO SUCCESSFUL COLLABORATE WITH TRAVEL NATIONS IMPORTANT ISSUE HAS BEEN TOPIC IN A PARTICULAR DISCUSSION HERE WE WANT TO BE SURE WE DO THAT RIGHT. FIRST ANNIVERSARY OF THE LAUNCH WAS PAST MAY 6TH. ALL THAT I TOLD YOU ABOUT HAS BEEN ACCOMPLISHED IN THE PAST YEAR. SCIENTIFIC SIM POSIUM AND FACEBOOK LIVE THAT GARNERED LOTS OF VIEWS AND IMPRESSIONS WE AT THAT TIME LAUNCHED THE DATA BROWSER THAT YOU ARE WELCOME TO LOOK AT DATA BROWSER.RESEARCH.ORG DEMOGRAPHICS AND PARTICIPANTS ANSWERED VARIOUS QUESTIONS AND LOTS OF OTHER FEATURES OF THE POPULATION. WE DON'T YET HAVE GENOMIC DATA BUT IT IS COMING AWARDS HAVE BEEN MADE TO GENOMIC DATA CENTERED TO GENERATE THAT INFORMATION GENOMICS WILL -- RESEARCH WORKBENCH WILL BE FIRST CURATED DATA SET OF TOOLS WILL BE AVAILABLE. THIS IS WHERE I THINK RESEARCHERS WILL GET REALLY INTERESTED IN BEING ABLE TO SEE WHAT IS THERE. OUR GOAL IS TO HAVE FULLY ANONYMIZED DATA AVAILABLE TO QUALIFIED INVESTIGATOR TO BEGIN TO MAKE OBSERVATIONS AND DISCOVERIES FROM THIS INFORMATION. LOTS THAT WILL BE HAPPENING THERE. PARTNERSHIP WITH FIT BITT AND PARTICIPANTS ARE SHARING DATA IF THEY HAVE A FIT BITT FROM FIT BITT ACCOUNTS AND XOMING THERE IN TERMS OF DIGITAL DATA FROM HEALTH WEARABLE DEVICES MOST COMPREHENSIVE POTENTIALLY -- AIMING FOR 1 MILLION PARTICIPANTS ULTIMATELY. I SEE A SPARROW WHO HAS BEEN VERY MUCH HELPFUL TO US IN SOME INTERACTION HAS HIS HAND UP. PLEA PLEASE. >> SPERO MANSON: I WANTED TO UNDERSCORE WITH RESPECT TO INVOLVEMENT AND PARTICIPATION IN TRIBAL NATIONS IN THE RESEARCH PROGRAM I WANT TO UNDERSCORE AND CREDIT THE INSTITUTES FOR I THINK REALLY REMARKABLE PROGRESS. DR. DAVID WILSON'S EFFORTS AND TRIBAL HEALTH RESEARCH ISSUE IN 2019 TRIBAL HEALTH RESEARCH PLAN NIH STRATEGICALLY SECOND THE ROLL OUT OF TRIBAL CONSERVATION PROCESS PEOPLE MIGHT NOT REALIZE THIS IS SPECIAL SET OF GOVERNMENT TO GOVERNMENT RELATIONSHIPS FIRST UNDERTAKING BY NIH IN THIS REGARD LETTER IN APRIL AND AGAIN IN MAY THIS YEAR WERE EXTREMELY WELL-RECEIVED BY TRIBAL LEADERSHIP AROUND THE COUNTRY I WANT TO MRAUD INSTITUTE'S ADVANCES IN THIS AREA AND MY SENSE OF READING CONSTITUENTS IN INDIAN COUNTRIES VERY POSITIVE AND OPENING CONVERSATIONS INSTALLED FOR A LONG TIME MY THANK YOU AND CREDIT IN THIS INSTITUTE IN THIS REGARD. >> FRANCIS S. COLLINS: THANKS SPERO WE WANT TO TAKE WITH GREATEST SERIOUSNESS AND RESPECT TO THE DIFFERENT TRIBES OF SOVEREIGN NATIONS DIFFERENT MEANS OF GETTING ENGAGED AND RESEARCH TO BE RESPECTED AND NOT RUSH INTO DECISIONS WITHOUT HAVING A CHANCE TO LISTEN LOTS OF LISTENING SESSIONS WILL HAPPEN IN THE COURSE OF NEXT FEW MONTHS TO FURTHER ENHANCE THAT CONNECTIVITY WE WANT TO BE RESPECTFUL AND HEAR ALL CONCERNS. OBVIOUSLY THIS HASN'T BEEN FOR MEDICAL RESEARCH A PRETTY HISTORY. BE AWARE OF THAT AND READY THIS TIME TO DO THINGS RIGHT. WE ARE TOTALLY COMMITTED TO THAT. COUPLE OTHER THINGS -- HEAL INITIATIVE WHICH IS HELPING TO END ADDICTION LONG TERM IS UNDERWAY I SHOWED YOU QUICK PHOTOGRAPH OF ANNOUNCEMENT NUMBER OF THINGS THAT HAPPENED BACK IN APRIL. YOU MAY REMEMBER THAT CONGRESS BECAUSE OF DEEP CONCERN ABOUT THIS ALLOCATED $500 MILLION A YEAR FOR BRINGING NIH TO BEST POSSIBLE PLACE TO IMPROVE PREVENTION AND TREATMENT STRATEGIES OPIOID ADDICTION AND ENHANCED PAIN MANAGEMENT COMING UP WITH ALTERNATIVES OPEN YOIDS TO HELP PEOPLE WITH CHRONIC PAIN. 26 PROJECTS LED BY OVER 10 INSTITUTES AND CENTERS THAT ARE OUT THERE. SOME OF THEM NOW HAVING ALREADY DONE REVIEWS AND FUNDING PLAN AND MANY IN REVIEW RIGHT NOW BY THE END OF THIS YEAR, FISCAL YEAR THAT IS SEPTEMBER 30TH, WE WILL HAVE MADE DECISIONS ON SOME MONEY CARRIED OVER FROM LAST YEAR WE HEARD ABOUT IT LATE IN THE FISCAL YEAR ALL MONEY THIS YEAR TOTAL $850 MILLION NEEDS TO BE SPENT WE WILL HAVE NO TROUBLE SPENDING IT WITH CREATIVE IDEAS PEOPLE PUT FORWARD. INCLUDES AREA OF INTENSE FOCUS TO TRY TO HELP PREVENT OPIOID OVERDOSES AND BEST MANAGE ADDICTION TO THOSE THAT FELL INTO THAT DIFFICULT PLACE AND DOING WORK TO DEVELOP ALTERNATIVES TO OPIOID DRUGS DIAGNOSTICS AND INTEGRATIVE APPROACHES INVOLVED ENORMOUS NUMBER OF NIH LEADERS INCLUDING WEEKLY INTENSE MEETINGS I'M ENGAGED TO HELP TO LEAD AND DO WHAT WE CAN IN THIS SPACE AND HELP FROM COLLEAGUES PARTICULARLY IN SAM IS AN AND CDC AND FDA. MUCH MORE TO SAY ABOUT THAT I WANT YOU TO HEAR HOW MUCH WE ARE HANDS ON DECK IN THIS CRITICAL SPACE. ANOTHER PROJECT TO QUICKLY TOUCH ON I WILL BE QUICK IS ACCELERATING MEDICINES PARTNERSHIP IF YOU HAVE BEEN AROUND A WHILE YOU KNOW THIS PARTICULAR NAME COLLABORATION BETWEEN NIH AND SEVERAL INSTITUTES AND INDUSTRY PARTNERS FOCUSED INITIALLY ON ALZHEIMER'S DIABETES AND RHEUMATOID ARTHRITIS AND LUPUS WE ARE IN THE FIFTH YEAR IN INSTANCE MET AND EXCEEDED EXPECTATIONS AND PROJECTS BROUGHT SCIENTISTS AROUND SAME TABLE SECTORS PRECOMPETITIVE SPACE MAKING DATA ACCESSIBLE TO EVERYBODY AND HAS IN FACT BEEN CO-SHARED IN TERMS OF COST BETWEEN INDUSTRY AND NIH. WONDERFUL SUCCESSFUL MODELS INTERESTED WHERE THEY HAVE GOTTEN TO AMP [INDISCERNIBLE] ON THE WEB AND SEE THE DETAILS I WILL SAY WITH SOME DELIGHT THAT WE HAVE NOW AN OPPORTUNITY TO START A NEW POTENTIAL PROJECT THAT IS UNDER CONSIDERATION WHICH IS ON SCHIZOPHRENIA. THIS THIS IS A PLACE WE DESPERATELY NEED NEW THERAPEUTIC IDEAS WE ALMOST HAVE A SCHIZOPHRENIA PROGRAM GOING FIVE YEARS AGO WASN'T QUITE ENOUGH ENTHUSIASM BEING ABLE TO DO SO PEOPLE WEREN'T SURE WHAT -- THERE IS ENTHUSIASM BECAUSE OF DISCOVERIES MADE THROUGH GENOMICS LEADING TO POTENTIALLY TARGETING PATHWAYS. GROUP THAT IS WORKING ON DEVELOPING A PLAN THAT WE HOPE TO BE AVAILABLE BY THE FALL FOR COMPANIES TO DECIDE WHETHER THEY WANT TO SIGN ON LOOKS LIKE WE ARE LIKELY TO HAVE A CRITICAL MASS. FIFTH AMP PROJECT WE STARTED ONE ON PARKINSON'S DISEASE TWOR YEARS AGO AND POSSIBLE 6TH AMP PROJECT GENE THERAPY WITH ULTRA RARE DISEASES WITH LOTS OF INTERESTS THERE AS WELL. ALL THOSE THINGS ARE EXCITING AND WE ARE SDLIETHED TO SEE THOSE KINDS OF PARTNERSHIPS GOING FORWARD. HUMAN FETAL TISSUE. YOU HAVE SEEN IN THE PRESS THAT THE PRESIDENT DECIDED TO TERMINATE SUPPORT FOR HUMAN FETAL TISSUE RESEARCH BY FEDERAL RESEARCHERS ON JUNE FIFTH EXCITING ETHICAL CONCERNS INTRAMURAL PROJECTS WILL CONTINUE WITH SAMPLES ON AND THEY ARE LIMITED AND NOT ALLOWED TO PROCURE ANY ADDITIONAL SAMPLES. EXTRAMURAL RESEARCH ERRS WITH FUNDING GRANTS INVOLVING HUMAN FETAL TISSUE ARE ABLE TO CONTINUE RESEARCH -- FUTURE NEW AND COMPETING -- USE OF HUMAN FETAL TISSUE WILL NEED TO GO IN ADDITIONAL LEVEL OF REVIEW BOARD ESTABLISHED BY SECRETARY FOLLOWING GUIDELINES ESTABLISHED IN NIH LEGISLATION OF 1993. CAN I HAVE SLIDES BACK UP AGAIN JORDAN? MY SET OF SLIDES. I HOPE THEY ARE UP THERE SOMEWHERE. THERE IS ANOTHER ANNOUNCEMENT I WANTED TO MAKE ABOUT NEW ACD ACTIVITY. IT IS ON A BLACK SLIDE. THAT WOULD EXPLAIN IT. OKAY. WE ARE PUTTING FORWARD TO THE ACD PROMOTION OF IDEA OF NEW WORKING GROUP. ENHANCING REPRODUCIBILITY AND RIG OR IN ANIMAL STUDIES. THIS IS PART OF A LONG TERM FOCUS THAT WE HAVE HAD NOW OVER 5 OR SIX YEARS AND WE BELIEVE IS HIGHLY JUSTIFIED BY NEED FOR US TO PAY ATTENTION TO WHETHER THE MONEY THAT TAXPAYERS ARE PROVIDNG AND WE ARE ASKING SCIENTISTS TO USE FOR GOOD PURPOSES ARE USED IN A WAY THAT PRODUCED DATA THAT DOES IN FACT HAVE APPROPRIATE ABILITIES TO BE REPRODUCED. RIGOROUSLY DESIGNED HEADLINE 2014 ESSAY LARRY AND I WROTE ABOUT A NUMBER OF INITIATIVES WE AIM TO INSPIRE. LOTS GOT DONE AT THAT TIME. A COUPLE YEARS AFTER THAT. 21ST CENTURY CURES ACT AS YOU KNOW WAS A MAJOR PIECE OF LEGISLATION EFFECTED NIH AND PROVIDED US WITH ADDITIONAL RESOURCES AND SECTION IN THERE ACTUALLY ASKED NIH DIRECTOR TO CONVENE WORKING GROUP UNDER NIACD. WE HAVE LOOKED AT THAT CAREFULLY. WE LOOKED AT WHAT WE HAVE ALREADY DONE AND WE TRIED TO IDENTIFY AREAS WHERE WE MADE GOOD PROGRESS AND OTHERS WHERE WE THINK THERE IS WORK THAT NEEDS TO BE DONE. THAT HAS MOTIVATED THE DESIRE TO FOCUS IN A PARTICULAR WAY ON ANIMAL STUDIES WHERE WE THINK THERE ARE STILL NEEDS FOR DEEP THINKING ABOUT THIS. PARTICULARLY THIS RELATES TO ANIMAL MODELS FOR HUMAN DISEASES THAT RELATES IN A COUPLE WAYS ARE ANIMAL MODELS GOOD REPRESENTATIONS OF HUMAN ILLNESS OR ARE WE IN FACT STUDYING SOMETHING WE CAN EXTRAPOLATE AND TRANSLATE INTO CLINICAL UTILITY? ON TOP OF THAT ARE ANIMAL MODELS BEING STUDIED IN A WAY WHERE DESIGN OF EXPERIMENTS IS APPROPRIATELY RIGOROUS SO IT IS NOT CONFOUNDED BY ALL SORTS OF MISADVENTURES DRAWING CONCLUSIONS THAT WON'T SEEM TO BE HELD UP. DESIGN IS CRITICAL IN THE SPACE POWER ANALYSIS BLINDING AND SO ON. WE PROPOSE A CHARGE TO A NEW WORKING GROUP TO BEGIN THEIR WORK SHORTLY AFTER THIS MEETING TO IDENTIFY GAPS AND OPPORTUNITIES TO IMPROVE RIG OR REPRODUCIBILITY AND TRANSLATIONAL VALIDITY DOES THIS MODEL ACTUALLY TRANSLATE TO HUMAN ILLNESS AND TRANSPARENCY AND EVALUATE HOW ANIMAL MODELS ARE CURRENTLY DEVELOPED VALIDATED AND ACCEPTED ANDAC KRECHT SCIENCE FOR VALIDATING ALTERNATIVE MODELS FOR RESEARCH SUCH AS TISSUE CHIPS CONSIDER BENEFITS AND BURDENS REGISTERING ANIMAL STUDIES THAT AID IN FIRST HUMAN TRIALS DO IN CLINICAL TRIALS IF DESIGNING AN ANIMAL STUDY YOU THINK OUGHT TO BE DEFINITIVE WAY AN -- INITIATING IT SO IT IS ABSOLUTELY CLEAR HOW IT IS DESIGNED AND WHAT END POINT IS AND NUMBER OF ANIMALS AND POWER CALCULATIONS IS TO GET THAT OUT THERE. THAT IS A PROPOSAL. THERE WILL BE OBJECTIONS TO THAT. SOUNDS LIKE IT MIGHT BE A BIT OF A BURDEN. STUDIES THAT AIM TO LEAD TO FIRST IN HUMAN TRIALS IS THE TO EBBINGUS WHAT I'M PUTTING HERE. MODEL FINANCIAL IMPLICATIONS BECAUSE IF WE ARE INSISTING ON POWER, WELL, SOMETIMES IT MEANS YOU HAVE TO DO MORE ANIMALS INSTAELD OF FEWER. AT THE SAME TIME LOTS OF ARGUMENTS TRYING TO LIMIT NUMBER OF ANIMALS IN STUDY. IF YOU LIMIT IT TO POINT WHERE YOU DON'T HAVE STATISTICAL POWER WHY DO IT AT ALL AND CONSIDER WHETHER WE ARE STILL IN A PLACE WE NEED MORE TO EBBINGUS IN TRAINING EXPERIMENTAL DESIGN AND STATISTICS. ANSWER IS UNDOUBTEDLY YES. THAT WAS BASICALLY PROPOSED CHARGE. I'M HAPPY TO SAY BARBARA WOLD WHO IS NEW MEMBER OF ACD WHO IS NOT HERE AND HAS BEEN ON THE PHONE WITH ME AND LARRY TABEK ON THE PHONE OVER THE LAST 10 DAYS OR SO AGREED TO CO-CHAIR THIS WITH LARRY WE DON'T KNOW WHO THE RIGHT MEMBERS WILL BE WE HAVE A TENTATIVE ROSTER IF YOU HAVE IDEAS WHO WOULD BE JUST PERFECT FOR THIS FEEL FREE TO SHARE THOSE WITH LARRY OR ME IN THE COURSE OF THE MEETING. WE WOULD LIKE TO GET THE GROUP UP AND GOING AND SEE WHAT THEY CAN COME UP WITH. GENTLEMEN, JEFF? >> I WANT TO MAKE SURE YOU ARE INCLUDING INDUSTRY REPRESENTATIVES IN THIS GROUP. >> FRANCIS S. COLLINS: ABSOLUTELY THEY HAVE LOTS OF PERSPECTIVE HERE IN WHAT WE HAVE BEEN DOING HASN'T NECESSARILY WORKED OUT THAT WELL IN TERMS OF THINGS THEY CAN THEN TRANSLATE TO HUMAN TRIALS. YES, LINDA. >> THIS IS INCREDIBLY WONDERFUL AND WELCOME INITIATIVE TO -- TISSUE CHIPS GOING BACK A DECADE IT IS STARTING TO PERMEATE ALL OF THE INSTITUTES WHAT WILL COME OUT OF THAT I THINK IS ECONOMIC ADVANTAGES OF DOING I THINK IT WILL HELP PUSH THAT FIELD TO MATURE MORE QUICKLY TO GET DATA OUT OF THIS TO ILLUSTRATE WITH NUMBERS HOW MUCH MORE COST EFFECTIVE IT MAY BE TO PUT MORE RESOURCES TOGETHER TO GET TISSUE CHIPS UP TO SPEED. THIS IS GOOD. SPAEK. >> SO I THINK THIS IS GREAT THIS IS HAPPENING. TWO POINTS WORTH CONSIDERING IN TERMS OF THE CHARGE, FRAN KRIS IS ONE IS THAT IRRESPECTIVE OF ALL SAFEGUARDS AND ROBUST AS WE CAN DO EXPERIMENTS THERE ARE LIMITATIONS TO ANY EXPERIMENTAL METHOD PERIOD. WE CAN DO A PERFECT DESIGN OR SAMPLE OR PERFECT POWER AND IT IS UNIQUE TO THE MODEL. I THINK THE CONSIDERATION OF YOU KNOW WHAT WE HAVE ALWAYS DONE IN SCIENCE OF USING MULTIPLE MODELS TO VALIDATE POTENTIAL TRANSLATABILITY SHOULD BE IMPORTANT CONSIDERATION. THERE ARE FINANCIAL AND OTHER RESOURCE ELEMENTS OF THAT. THAT IS ONE POINT AND THE OTHER IS MORE DIFFICULT TO GRAPPLE WITH IS AFTER DATA ARE GENERATED AND CONCLUSIONS PRESENTED BY ANY SPECIFIC EXPERIMENT THERE IS AMPLIFICATION OF THE PERHAPS SOMETIMES OVERINTERPRETATION OF THAT. THOSE ELEMENTS ARE MORE SOCIAL WHICH GOES A LONG WAY IN PROPAGATING WHAT IS HEARD MENTALITY SO-TO-SPEAK IN DRIVING SCIENCE. WE HAVE SEEN THIS HAPPEN. I AM NOT SURE WHETHER HOW EASILY THAT CAN BE INCLUDED IN THE CHARGE WHICH IS IMPORTANT THE CONSIDERATION SO WE ARE AWARE OF THE ELEMENT OF IT. SOMETIMES YOU FOCUS SO MUCH ON EXPERIMENTAL COMPONENT SOCIAL ASPECTS OF SCIENTIFIC COMPONENTS ARE TOO. >> BEHAVIORAL AMONGST OURSELVES TOO, YES. FRANCIS? >> AGAIN, IT IS A REALLY GREAT IDEA AND IMPLICIT IN THIS. YOU TOUCHED ON IT IS THE IDEA OF ALTERNATIVES TO ANIMAL MODELS. IT IS A VERY LARGE CHARGE AND I DON'T KNOW WHETHER IT SHOULD BE EXPLICIT IN THIS WORKING GROUP OR SUBSEQUENT WORKING GROUP TO LOOK AT THE WHOLE AREA. I THINK WE HAVEN'T TOUCHED ON THE ETHICS OF ANIMAL STUDIES BUT IT IS AN AREA WHERE I THINK DILIGENT IN TERMS OF LOOKING FOR ALTERNATIVES AND BEGINNING TO DO RESEARCH TO DEVELOP THEM. I -- THAT IS BUILDING ON LINDA'S POINT I THINK. >> YEAH. >> IT IS PERHAPS SOMETHING FOR YOU TO CONSIDER IN THIS ONE OR PERHAPS THE NEXT ONE. >> FRANCIS S. COLLINS: I THINK THEY HAVE TO TOUCH ON IT THIRD BULLET IN THIS SLIDE CURRENT STATUS FOR VALIDATINGALITY TERN RTIVE MODELS HOW DO WE FIT THAT IN? YES, ANNE? >> YES. I HAD TWO QUESTIONS IF IN TERMS OF CONSIDERING VALIDATING ALTERNATIVES, HOW WOULD IT DIFFER FROM REQUIREMENTS THAT EXIST ALREADY IN TERMS OF I COOK AND ANIMAL PROTOCOLS TO ALREADY CONSIDERED ALTERNATIVES? >> FRANCIS S. COLLINS: I THINK THAT SORT OF FALLS UPON THE INVESTIGATAR TO SAY IS THERE RIGHT NOW ANALITY TERN RTIVE I CAN USE INSTEAD OF ANIMAL EXPERIMENT TO ANSWER THIS QUESTION. FROM OUR PERSPECTIVE IT SHOULD BE WHAT IS NIH DOING TO ENHANCE DEVELOPMENT ALTERNATIVES TO ANIMAL MODELS WE DON'T HAVE YET THAT MEANS INVESTIGATORS LOOKING AT AN ISSUE DECIDE I HAVE TO USE AN ANIMAL MODEL THAT IS WHAT I HAVE. >> ANOTHER QUESTION TRANSLATIONAL VALIDITY YOU HIGHLIGHTED IT IS IMPORTANT NOT TO STUD -- I WONDER WHETHER TRANSLATIONAL VALIDITY IS THE RIGHT TERM. I SAY THAT BECAUS THERE MIGHT BE A GENETIC CHANGE IN AN ANIMAL THAT IS VERY INFORMATIVE ABOUT HUMAN DISEASE EEFRM THOUGH ANIMAL ITSELF DOESN'T HAVE THE DISEASE GENETIC CHANGE PRESENT IN AUTISM THAT DRIVES A CLEAR CHANGE IN NEURAL CIRCUITS SHARED ACROSS MICE AND HUMANS EVEN THOUGH SAME CIRCUIT CHANGE HAS DIFFERENT EFFECTSES ON BEHAVIOR IN MICE AND HUMANS SUPER INFORMATIVE TO LOOK AT WHAT IS HAPPENING IN BRAINS OF MICE EVEN THOUGH WAY THEY SHOW THE DISEASE IS DIFFERENT IN HUMANS. >> FRANCIS S. COLLINS: POINT WELL TAKEN I MADE THE TERM UP IN THE LAST COUPLE DAYS I WILL ACCEPT IT IS LESS ARTFUL THAN IT COULD BE. >> INCLUDE IN THE WORKING GROUP SOMEBODY WORKING ON GENETIC DISEASE MODELS AND THOUGHT ABOUT HOW MODELS WILL INFORM HUMAN DISEASE EVEN IFS COMPLEX DISORDER STUDIED IN SIMPLER ANIMAL. >> FRANCIS S. COLLINS: POINT TAKEN. >> SYSTEMS BIOLOGY APPROACHES TO DO WHAT CAN YOU TRANSLATE IN THE IMMUNE SYSTEM GOING FROM MICE TO PEOPLE WHERE THERE ARE GOOD DATA SETS TO SPARE LIKEN AND CROHN'S DISEASE AND THERE ARE GLIMMERS YOU CAN TEASE THINGS OUT MAJOR PHENOTYPE MIGHT NOT LOOK THE SAME BUT -- VERY EARLY STAGES IF THIS THAT KIND OF WORK. >> FRANCIS S. COLLINS: GREAT THANKFUL. WE ARE RUNNIN TINY LATE WE HAVE TO HEAR BRIEF PRESENTATIONS THEY WILL BE BRIEF FROM NEIL SHAP IRO BUDGET ANWLIS AND LEGISLATIVE EXPERT WHAT IS HAPPENING IN KRURN UT USUAL CRAZY BUSINESS WHAT WILL BE GOING FORWARD IN TERMS OF CONGRESSIONAL APPROPRIATIONS AND HOW WE WILL DEAL WITH THEM AND OTHER THINGS THAT HAPPENED LEGISLATIVELY ASK NEIL TO KICK IT OFF. HANG ON PEOPLE WE WILL GET YOU TO A BREAK HERE PRETTY SOON. >> GOOD MORNING I WILL START QUICK WITH A RECAP OF GOOD NEWS I WAS ABLE TO PRESENT IN DECEMBER SINCE WE HAVE MANY NEW MEMBERS NIH RECEIVED FULL APROPRIATION AT START OF THE FISCAL YEAR AND INCREASE OF $2 BILLION UP TO TOTAL OF $39 BILLION THIS WAS 4TH IN A ROW OF INCREASES FROM CONGRESS. REALLY GREAT SUPPORT WITH CONGRESSIONAL APPROPRIATIONS IN RECENT YEARS AND PART OF BILL AND LABOR AND HUMAN AND HEALTH SERVICES AS WELL AS DEFENSE THAT WAS PASSED IN TIME. MUCH OF THE GOVERNMENT AS YOU MAY RECALL WAS UNDER CONTINUING RESOLUTIONS AND 35 DAY SHUTDOWN. UNFORTUNATELY FOR NIH THAT ONLY APPLIE TO ONE SMALL PROGRAM OF OURS NIHES OTHER THAN THAT WE HAD FUNDING UNFORTUNATELY DID NOT SHUT DOWN WITH PARTS OF THE GOVERNMENT AND COME IN FEBRUARY FINAL APPROPRIATIONS WERE DONE AND IN THAT WE DID RECEIVE A SMALL INCREASE FOR THAT SUPER FUN PROGRAM OF $2 MILLION AND THEN IN TERMS OF DEVELOPMENT SINCE THEN SINCE WE GO THROUGH THE FISCAL YEAR, WE HAD A TRANSFER FROM HHS WHICH IS RESPONSIBLE FOR UNACCOMPANIED AILEN CHILDREN PROGRAM ADMINISTERED BY THE ADMINISTRATION OF CHILDREN AND FAMILIES THAT PROGRAM DIDN'T HAVE ENOUGH FUNDING AS A RESULT OF SITUATION AT THE BORDER THAT I'M SURE YOU HEARD ABOUT IN THE NEWS NIH AND NUMBER OF OTHER NIHHS SUPPORTED THAT PROGRAM THIS YEAR. IN ADDITION TO NIH FOR NIHHIV/AIDS PROGRAM. AS PART OF ANNUAL PROCESS WHERE WE REAMOAKATE FUNDS AMONG INSTITUTES AND SENATORS BASED ON PRY ORITYIZATION -- NAID IS LARGEST PORTION OF THE AIDS BUDGE AND HAS A STRONG COMMITMENT TO BASIC RESEARCH IN THAT AREA IMPROVE SCIENTIFIC COORDINATION AND MANAGEMENT EFFICIENCY. SO THEN IN THE SPRING WE HAD RELEASE OF 2020 PRESIDENT'S BUDGET AS THOSE ON THE COMMITTEE RECALL WE ARE ALWAYS IN MULTIPLE BUDGET CYCLES BETWEEN APPROPRIATIONS AND FOLLOWING FISCAL YEAR. 2020 PRESIDENT'S BUDGET PROPOSAL WAS THE SAME AS IT PROPOSED LAST YEAR FOR 2019 AND DECREASE OF 4.8 BILLION DOLLARS. AND LAST YEAR WHAT HAD HAPPENED THAT IS TIED TO THE OVERALL BUDGET PICTURE IS THERE WAS PASSAGE OF BIPARTISAN BUDGET ACT INCREASED DISCRETIONARY CAPS FOR 2018/2019 WHEN THAT HAPPENS 2019 BUDGET WAS ADJUSTED BASED ON THE CAPS IT WAS ORIGINALLY SEVERAL BILLION LOWER WE ARE IN SITUATION AGAIN 2020 INCREASE TO DISCRETIONARY CAPS EXPIRES AT END OF CURRENT FISCAL YEAR UNDER 2020 UNDER CURRENT LAW CAPS WOULD BE LOWER WHICH RESULTED IF IN NUMBER OF PROPOSED BUDGET DECREASES BASED ON ADMINISTRATION MEETING STATUTORY CAPS IN PRESENT ARE IN PLACE. ADRIAN WILL HAVE MORE TO SAY ABOUT THAT SHORTLY. THAT WAS ASSUMPTION THIS WAS BASED ON AND OTHER PROPOSALS IN PRESIDENT'S BUDGET I WOULD LIKE TO MENTION CONSOLIDATION FOR -- THAT HAS BEEN PROPOSED FOR A COUPLE YEARS NOW. LAST YEAR TWO ADDITIONAL CONSOLIDATIONS PROPOSED THAT WERE NOT REPEATED THIS YEAR. ALSO IN MATERIALS OF HEALING INITIATIVES YOU HEARD ABOUT WE HAD BUDGET DECREASED PROPOSED IN REQUEST THERE WAS NOT DECREASE FOR THAT THAT WAS HELD HARMLESS AND WE HAD TARGETED INCREASES FOR NEXT GENERATION RESEARCH INITIATIVES AND CHILDHOOD CANCER DATA INITIATIVE. TWO OTHER PROPOSALS THAT WERE NOT DIRECTLY DOLLAR RELATED TO MENTION IS ONE WOULD CAP THE PERCENTAGE OF INVESTIGATOR SALARY TO BE PAID WITHIN NIH GRANT FUNDS AT 90% OF SALARY. THAT WOULD BE ADMINISTRATIVE PROPOSAL AND STATUTORY PROPOSAL TO LOWER HIGHEST LEVEL OF EXTRAMURAL SALARIES FROM EXECUTIVE LEVEL TO EXECUTIVE LEVEL 5 FROM EXECUTIVE LEVEL 2. THAT STATUTORY PROPOSAL WOULD APPLY ACROSS HHS AGENCIES IN OUR BILL THAT ONE IS NOT EXCLUSIVE TO NIH AND THAT IT HAD BEEN PROPOSED IN PREVIOUS YEARS. THEN WE IN ADDITION IN NIH SPECIFIC PROPOSAL TO INCREASE CAPS ON AMOUNTS OF MONEY TO SPEND ON FACILITY REPAIR AND IMPROVEMENT PROJECTS USING INSTITUTION CENTER APPROPRIATIONS THAT IS A FUNDING MECHANISM WE HAVE IN ADDITION TO BUILDING AND FACILITIES ACCOUNT WHICH IS DEDICATED TO CONSTRUCTION REPAIRS AND IMPROVEMENTS IN PROPOSAL CAPS WOULD BE RAISED ON HOW MUCH -- REPAIR AND IMPROVEMENT ACTIVITIES CURRENTLY BECAUSE OF $3.5 MILLION CAP, THAT AUTHORITY IS USED FOR SMALL INSTITUTE-SPECIFIC PROJECT IF WE HAVE A HIGHER PROJECT CAP WE COULD USE MORE BROADLY FOR NIH WIDE PROJECTS TO ADDRESS BACKLOG AND MAINTENANCE AND REPAIRS THAT IS CURRENTLY AT $2 BILLION AND GROWING AND LOOKING AT NUMBER OF WAYS POTENTIALLY WE CAN ADDRESS STATE OF OUR FACILITIES. THIS WOULD BE ONE OF THEM. MORE BROADLY, INDEPENDENT REVIEW WE HOPE TO HAVE -- WILL BE COMPLETED SOON BY THE NATIONAL ACADEMIES THAT WAS COMMISSIONED BY CONGRESS WHO WILL REPORT ON FACILITY NEEDS OF MAIN CAMEL PUS HERE IN BETHESDA. WE ARE LOOKING FORWARD TO RESULTS ON THAT. MOST RECENTLY, IF IN LATE APRIL OR EARLY MAY, THE HOUSE APPROPRIATIONS COMMITTEE WENT THROUGH MARKUP OF LABOR HHS BILL ONCE AGAIN, THEY INCLUDED $2 BILLION INCREASE FOR NIH COMPARED TO THIS YEAR. PART OF THAT WAS TO ADDRESS 201ST CENTURY CURE ZACK THAT HAS MULTIYEAR PROFILE FUNDING KIND OF GOES UP AND DOWN. TO AVOID A DECREASE WHICH THIS YEAR WOULD HAVE BEEN 219 MILLION FOR 2020 IN THE HOUSE MARK, THEY ADJUSTED FOR THAT SO THAT THE TOTAL LEVELS WOULD STILL GO UP BY 2 BILLION FROM THE CURRENT STATE WITHOUT THAT DECREASE FOR THE CURES ACT. A COUPLE OTHER PIECES OF THAT BILL. THE ALL OF US RESEARCH PROGRAM INCREASED TO $5 MILLION THAT IS ONE THAT WE HAVE TRIED TO RAMP UP IN RECENT YEARS IT FUNDED CHILDHOOD CANCER DATA INITIATIVE REQUESTS THAT DIDN'T FUND OTHER PROPOSALS I MENTIONED FROM THE PRESIDENT'S BUDGET. IT ALSO INCLUDED $25 MILLION FOR RESEARCH ON PREVENTION OF GUN VIOLENCE IT THAT WAS MATCHED AS WELL. THERE IS ALSO A MATCHING PROPOSAL FOR CDC AND $50 MILLION BETWEEN THE TWO OPERATING DIVISIONS. WITH THAT, WE TURN IT OVER TO ADRIAN. >> FRANCIS S. COLLINS: NEIL THANK YOU FOR GOING OVER DETAILS FINANCES YOU SEE WAREHOUSE MARK IS SENATE HAS YET TO ARRIVE AT THEIR CONCLUSION. YOU WILL HEAR A LITTLE MORE WHERE WE STAND FROM ADRIAN ABOUT THAT AND OTHER THINGS. >> I'M COGNIZANT I DREW THE SHORT STRAW I'M STANDING BETWEEN YOU AND COFFEE. EQUIP RECAP LOTS OF NEW PEOPLE IN CONGRESS. 20% OF THE HOUSE IS NEW. BIG CULTURE SHIFT. WE HAVE FOUR NEW MEMBERS OF HOUSE APPROPRIATIONS COMMITTEE THREE ARE ON DEMOCRATIC SIDE. REPUBLICAN SIDE TOM GRAIFS WHAT IS INTERESTING ABOUT THAT TO NOTE EVERYONE IS EXCITED ABOUT THE FRESHMAN MEMBERS AND GETTING TO KNOW THEM SENIOR LEVEL RETIRED JUNIOR CLASS MOVED INTO POSITIONS OF POWER. THIS WAS REALLY INTERESTING. IT SHIFTED CULTURE OF HOUSE APROPRIATION SUBXHIETEE WHAT WE HEARD STRONG MESSAGES FOR SUPPORT FOR HEALTH DISPARITIES RESEARCH AND SINCERE CONCERN OVER MATERNAL MORTALITY ISSUES AND ISSUES THAT WERE THERE BEFORE BUT WERE REALLY EMPHASIZED TOM GRAIFS BRINGS FISCAL HOCK TO THE SUB-COMMITTEE. MUCH LESS MODERATING FORCE. QUICKLY, HOUSE FLOOR, THEY STARTED DEBATE ON THE BILL NEIL TOLD YOU ABOUT YESTERDAY AT NOON VOTED ON SEVEN 7 AMENDMENTS BETWEEN MIDNIGHT AND 4 A.M. I DID NOT WATCH IT. NO. I DO NOT KNOW. THEY LIKE TO BE CONFUSING AND TOOK NUMBERING SYSTEM THEY CREATED MONDAY AND THREW IT OUT AND STARTED OVER AGAIN. SOMETIME TODAY I WILL BE ABLE TO TELL YOU WHAT HAPPENED BUT I CAN'T YET. 189 AMENDMENTS FOR OUR SECTION OF THE BILL IS A 4 /* A FOR BILL MINIBUS. THIS IS FOUR BILLS 189 AMENDMENTS WERE PROPOSED 79 AMENDMENTS WILL GET A VOTE ON THE FLOOR. 25 WERE RELATED TO NIH SPECIFICALLY THOUGH FRANKLY BECAUSE WE STUDY SO MUCH WE ARE INTERESTED WHETHER WE ARE DOING THE WORK OR IT IS A PUBLIC HEALTH ISSUE CD CONSIDER. IS DOING OR SOMEONE ELSE IS INVOLVED IN TWO I WANT TO POINT OUT TO YOU IS MEADOWS AMENDMENT MARK MEADOWS WANTS US TO CONSOLIDATE WITH ARK. I DON'T THINK ANYBODY ELSE IS BUT HE IS PUTTING THAT OUT. INTERESTING I WILL DO THIS QUICKLY COFFEE I UNDERSTAND THERE IS A PROVISION THAT GOT PUT INTO THE BILL DURING CLINTON ADMINISTRATION TO PROHIBIT FUNDS FROM NHHS FROM CREATING NATIONAL PATIENT IDENTIFIER IT WAS SOMETHING HILARY CLINTON PROPOSED THERE IS AN AMENDMENT FIRST TIME IN TWO DECADES TO -- STRIKE THAT. LANGUAGE IT CAME A LITTLE OUT OF NOWHERE. IT IS AN INTERESTING PROPOSAL GIVEN RISE OF ELECTRONIC HEALTH RECORD AND RISE OF PRECISION MEDICINE AND TRYING TO DO MORE DATA SHARING AND THIS IS AN INTERESTING ISSUE AND I'M EXCITED TO SEE CONGRESS HAS START TODAY TAKE IT UP. SENATE APPROPRIATIONS. WHAT IS INTERESTING ABOUT SENATE APPROA APPROPRIATIONS HEARING IS NOT ONLY IS IT OUR CRITICS PUSHING PUSHING US ON SEXUAL HARASSMENT IT IS OUR CHAMPIONS WE WANT TO SUPPORT YOU AND FUND YOU BUT NIH WE EXPECT YOU TO TAKE LEADERSHIP ROLE ON THESE VERY SERIOUS ISSUES. SENATE APROPRIATION BILL I'M ABLE TO NORMALLY TELL YOU WHAT IS IN HOUSE AND SENATE BILLS SO YOU HAVE DEBATE THIS YEAR WE DON'T HAVE A SENATE BILL AND DON'T KNOW WHEN WE WILL. THEY HAVEN'T EVEN STARTED DECIDING WHAT LEVEL OF FUNDING THE GOVERNMENT WILL HAVE NEXT YEAR. TIME IS TICKING WE HAVE AS OF THIS WEEK WE HAVE 19 WEEKS UNTIL THE END OF THE FISCAL YEAR. THEY HAVE 12 BILLS TO MOVE AND 19 WEEKS TO DO IT AND WE ARE NOWHERE RIGHT NOW. WHY ARE WE NOWHERE? WELL, WE ARE NWHERE BECAUSE OF THE ISSUE I KEEP BRINGING TO YOU. THOSE THAT ARE NEW, YOU WILL PROBABLY HEAR THIS AGAIN. IN 2011 WE CREATED STATUTORY BUDGET CAPS WHICH IS WHAT THE TEA PARTY DID ON OUR FISCAL SITUATION CREATED STATUTORY BUDGET CAPS AND SEQUESTER BECAME A NATIONAL TERM. EVERY TWO YEARS THERE IS A DEAL TO FIX THE SEQUESTER. DEAL WE ARE IN FY19 WHICH WE ARE IN NOW IF NOTHING IS DONE DRAMATIC CUT. DARK ORANGE IS WHAT IS CURRENT LAW. RIGHT NOW, NONDEFENSE PORTION OF THE GOVERNMENT IS OPERATING 597 BILLION. IF NOTHING IS DONE IT WILL FALL TO 578 BILLION. THIS IS NONDEFENSE. THIS IS IT TRANSPORTATION AND NATIONAL PARKS AND AGRICULTURE AND LABOR AND HEALTH AND US. THIS IS OUR PART OF THE BUDGET. THEY ARE TALKING WHAT IS HAPPENING? THEY ARE TALKING AS OF YESTERDAY THAT IS NOT TRUE TWO DAYS AGO TALKED AT THE WHITE HOUSE YESTERDAY AT THE CAPITOL WALK OUT OF THE MEETINGS AND SAY WE ARE CLOSE THEY AVE BEEN SAYING WE ARE CLOSE FOR A WHILE. WE ARE WATCHING IT AND I DON'T KNOW WHAT IS GOING TO HAPPEN. I WANT TO MENTION A POLICY ISSUE ON FOREIGN INFLUENCE. YOU HEARD A LOT ABOUT IT. THERE WAS A WORKING GROUP ON THAT. IT WAS VERY HELPFUL. WE CONTINUE TO HEAR ABOUT IT FROM MULTIPLE AREAS OF THE CONGRESS. ONE THING THAT IS REALLY INTERESTING IS THIS IS COMING FROM THE SECURITY COMMITTEES. THESE ARE NOT PEOPLE THAT KNOW US OR OUR FIELDS VERY WELL. ALSO, WHEN THEY TALK ABOUT SECURITY THREAT THEY ALSO MEAN ECONOMIC THREAT. IT IS NOT A NATURAL CONNECTION FOR US. WHEN WE SEE ECONOMIC COMPETITIVENESS, THEY HEAR THAT AS SECURITY THREAT. BILLS SO FAR AND PRESIDENTIAL COMMISSION AND [INDISCERNIBLE] FOREIGN AND MILITARY SCIENTISTS SUGGESTIONS HEARING LARRY TABAK WAS AT UNIVERSITIES MIGHT NEED THREAT INFORMATION NETWORK SHARING IN THE COMMUNITY ANOTHER POLICY I REALLY WANT YOU TO KNOW IS WE HAVE A THREAT IN THE FORM OF FEDERAL ADVISORY COMMITTEE AMENDMENTS ACT. IT WOULD MAKE PEER REVIEWER NOOZ SPECIAL GOVERNMENT EMPLOYEES YOU ARE SPECIAL GOVERNMENT EMPLOYEES YOU WENT THROUGH THAT PAPERWORK. -- IT WOULD REQUIRE ALL OF MEMBERS OF YOUR WORKING GROUPS LOTS OF YOU HAVE BEEN LEADING WORKING GROUPS TO START A WORKING GROUP EVERYONE YOU WOULD HAVE TO RECRUIT WOULD HAVE TO GO THROUGH A SPECIAL GOVERNMENT EMPLOYEE PROCESS. FOR YOUR POSITIONS AND FOR THE ADVISORY COMMITTEE POSITIONS AND WORKING GROUP POSITIONS, EVERYONE WOULD REQUIRE A PUBLIC NOMINATION PROCESS AND A PUBLIC COMMENT PERIOD AND WHEN THERE IS A NEW MEMBER AND FRAN KRIS SAYS WE HAVE SEVERAL NEW MEMBERS OF THE ADVISORY COMMITTEE HE WOULD HAVE TO DISCLOSE PUBLICLY WHO YOU ARE WHY YOU WERE SELECTED QUALIFICATIONS WHAT HOLE AND NICHE DO YOU FILL AND WOULD HAVE TO POST ANY OF YOUR FINANCIAL CONFLICT OF INTEREST WAIVERS ON THE INTERNET. YAY! SO THIS IS A BILL THAT MOVED THROUGH THE HOUSE AND WAS UP FOR CONSIDERATION IN THE SENATE AND WE CONVINCED CHAMPIONS TO PUT A HOLD ON IT. HOLD HAS TO LAST FOR A YEAR AND A HALF FOR ME TO KEEP IT FROM GETTING TO THE WHITE HOUSE FOR A VOTE. THIS IS TRANSPARENCY AND APPLE PIE AND SUN SHINE. EVERYBODY LOVES TRANSPARENCY; RIGHT? WE ARE WORKING HARD TO MAKE SURE PEOPLE UNDERSTAND THE IMPACT THIS WOULD HAVE ON NIH AND WAY WE DO BUSINESS AND WAY WE SEEK ADVISE FROM OUR COMMUNITY. WHAT WILL HAPPEN? SHORT ANSWER IS I DON'T KNOW. THE THING TO REMEMBER IS CONGRESS'S PURVIEW IS EVERYTHING. THAT MEANS WHEN THEY WORK OUT A DEAL THEY CAN BRING EVERYTHING. WHAT IS THE UNIVERSE? THIS IS THE UNIVERSE. HAVING IT RIGHT NOW IT IS ELECTION SEASON IT STARTED EARLIER THAN EVER. 15% OF THE UNITED STATES SENATE IS RUNNING FOR PRESIDENT. >> AUDIENCE: [LAUGHING]. >> NO COMMENT. THE PRESIDENT, MAKE NO MISTAKE. THE PRESIDENT IS RUNNING FOR PRESIDENT. >> AUDIENCE: [LAUGHING]. >> SO THAT IS JUST SORT OF THE ENVIRONMENT IT THAT WE ARE IF IN. THE CENTRAL ISSUE IS THESE BUDGET CAPS WHICH IS WHAT THEY ARE TALKING ABOUT. CONGRESS IS P MATH. IF I TEACH YOU ANYTHING IT IS CONGRESS IS MATH. NUMBER TO KNOW IS 279. YOU HAVE TO GET 279 PEOPLE TO AGREE ON ANY PACKAGE. NIED 218 VOTES TO PASS ANYTHING IN THE HOUSE. YOU NEED 60 VOTES TO PASS ANYTHING IN THE pPRESIDENT NOT TO VETO IT. 2 SEVEN 9 PEOPLE HAVE TO AGREE ON THIS PACKAGE WHICH IS WHERE THINGS LIKE THE DEBT CEILING WHICH IS SCHEDULES TO -- WE WILL RUN OUT OF ROOM IN OUR DEBT CEILING SOMETIME IN NOVEMBER. ADMINISTRATION REALLY WANTS CONGRESS TO FOLD THOSE TWO IN CONGRESS IS NOT SURE THEY WANT TO TAKE ON BOTH CLIFFS SIMULTANEOUSLY MIDWEST IS HURTING BECAUSE OF TARIFF CONVERSATION GOING ON WALL FUNDING IMMIGRATION POLICY GOD ONLY KNOWS WHAT WILL BE IN THE NOOUP TOMORROW THAT COULD ENTER IF INTO THIS DEBATE. IT THAT IS WHAT YOU WILL SORT OF START TO HEAR ABOUT. WHEN YOU TRY TO GET 279 PEOPLE TO AGREE ON ANYTHING, THEY WILL BRING IN WHATEVER THEIR FAVORED ISSUE IS. THIS IS [INDISCERNIBLE] SAY AT END OF THE TESTIMONY IS I LOOK FORWARD TO YOUR QUESTIONS I LOOK FORWARD TO YOUR QUESTIONS WHETHER NOR NOW OR AT THE BREAK OR WHAT DO YOU WANT TO DO SCHEDULEWISE. >> QUICK QUESTIONS FOR ADRIAN WE ARE RUNNING A LITTLE LATE BUT IF THERE IS SOMETHING ON YOUR MINDS. WE WILL CATCH YOU AT THE BREAK. >> FINE. >> FRANCIS S. COLLINS: ONE LAST THING BEFORE THE BREAK I WANT TO SAY SOMETHING ABOUT A PARTICULAR DECISION I MADE YOU MIGHT HAVE SEN WRITTEN ABOUT IN WASHINGTON POST AND NEW YORK TIMES YESTERDAY. SEXUAL HARASSMENT HOW IT REFLECT DZ PROBLEM IN CULTURE BIOMEDICAL SCIENCE WORKFORCE NOT ONLY DO WITH VERY ATTO ADDRESS EGREGIOUS EXAMPLES IN SEXUAL HARASSMENT WE WILL TALK ABOUT IN WORKING GROUP LATER THIS AFTERNOON AND IMPORTANT TO LOOK AT CULTURE AND WHETHER THERE ARE OTHER THINGS WE HAVE TO DO TO PROVIDE OPPORTUNITIES FOR WOMEN AND OTHER GROUPS UNDER-REPRESENTED IN SCIENCE TO FEEL WELCOMED AND RESPECTED. IN THAT REGARD I HAVE SAT ON TOO MANY PANELS AND BEEN TO TOO MANY MEETINGS IN THE COURSE OF THE LAST FIVE YEARS SEEMED DESPITE ALL OF THE TALENT PRESIDENT IN A PARTICULAR FIELD PANELS WERE POPULATED LARGELY BY WHITE MALES I AMPLE ONE OF THEM AND DECIDED THERE IS ONE THING I COULD DO WHICH IS TO SAY I WON'T DO THAT ANYMORE. IF I GET AN INVITATION TO COME TO A SIM POSIUM AND THAT KIND OF EMPHASIS ON DIVERSITY ON MARQUEE SPEAKERS IN PANELS IS NOT APPARENT I WILL DECLINE. AS A STEP IN THAT DIRECTION MADE THAT ANNOUNCEMENT YESTERDAY. YOU CAN READ THE STATEMENT ON NIH DIRECTORS WEBSITE ABOUT EXPLICITLY WHAT THE GOALS ARE NO MORE MA MAN OELS AS THEY ARE CALLED PANELS THAT ARE OCCUPIED BY ONLY MEN AND EXTENDING IT IN ADDITION TO WOMEN AND OTHER GROUPS UNDER-REPRESENTED IN OUR COMMUNITY. THIS IS SOMETHING I HOPE OTHERS MIGHT NOTICE AND CHALLENGE OTHER SCIENTIFIC LEADERS TO ADOPT A SIMILAR STRATEGY IN HOW THEY USE THEIR TIME AND INFLUENCE IN SCIENTIFIC MEETINGS. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: OKAY. YOU ARE VERY KIND. SO WITH THAT, I THINK WE SHOULD HEAR FROM JOSE. >> SORRY. QUICK QUESTION THAT ACTUALLY THIS IS VERY PERTINENT TO HISTORICAL TRANSCENDENCE OF THE MOMENT WITH INCORPORATION OF ACD MEMBERS FIRST TIMELE IN HISTORY WE HAVE GENDER PARITY IN ACD. I WAS COUNTING. IT IS 10 AND 10 AT LEAST FOR THE TIME BEING AND WITH THE TURNOVER IT COULD EVEN BE -- >> FRANCIS S. COLLINS: I DON'T KNOW ABOUT ALL OF HISTORY BUT QUITE LIKELY YOU HAVE MADE A GOOD POINT. THE FACT THAT WE HAVE THIS AT THIS MEETING SEVEN NEW MEMBERS AND DISTINGUISHED SCIENTISTS REPRESENTING MULTIPLE DIFFERENT SCOMPL DISCIPLINES THAT TURN OUT TO BE WOMEN IS EXAMPLE OF TALENT WE HAVE AND USING PERSPECTIVES WE HAVE. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: WITH THAT, WE ARE NOW QUITE A BIT LATE WHERE WE WERE SUPPOSED TO BE. TAKE A TEN MINUTE BREAK AND HOPING ARTIFICIAL INTELLIGENCE WORKING GROUP CAN BECOME ARTIFICIALLY INTELLIGENCE ALSO. RECONVENE AT 11:20. . NOW GOING TO HEAR THE INTERIM REPORT FROM THE ARTIFICIAL INTELLIGENCE WORKING GROUP. WE HAVE AT THE PODIUM DAVID GLAZER WHO IS CO-CHAIRING THIS WITH LARRY TABAK WHO WILL TELL US WHERE THEY ARE. DAVID, PLEASE PROCEED. >> DAVID GLAZER: THANKS, FRANCIS. I WILL GO THROUGH CHARGE AND SLIDES THAT LARRY TOOK US THROUGH A FEW MONTHS AGO. AM I HEARING AUDIO? IS IT WORKING NOW? HOW IS THAT? IS IT WORKING NOW? >> FRANCIS S. COLLINS: IS THAT MICROPHONE ACTUALLY ACTIVATED? >> DAVID GLAZER: I CAN'T TELL. >> FRANCIS S. COLLINS: THUMP ON IT. >> FRANCIS S. COLLINS: THERE WE GO. >> DAVID GLAZER: WE WILL GET INTO THE PAST AND THE REPORT AND LEAVE HALF OF THE TIME FOR DISCUSSION. LOTS OF DATA IS GENERATED ALL THE TIME AND NIH ITSELF HAS A LARGE AMOUNT OF DATA THAT IS GENERATED AND MANAGED AND ASSOCIATED WITH NIH PROJECTS IN PARALLEL ARTIFICIAL INTELLIGENCE IS MAKING A GROWING IMPACT IN ALL ASPECTS OF OUR LIFE. DIFFERENT KINDS OF ARTIFICIAL INTELLIGENCE I'M USING THESE WORDS INTERCHANGEABLY THEY ARE NOT BUT I'M USING AI AS GENERIC TERM TO COVER ALL OF THESE. THESE ARE ALL OF THEM. SOME THINGS ARE HAPPENING WE ARE SEEING EARLY SIGNS WHERE AI CAN MAKE A LARGE DIFFERENCE IN BIOMEDICAL RESEARCH AND CARE. AT THE SAME TIME, THERE ARE WAYS TO GET IT WRONG AND NAìVE APPLICATIONS OF NEW TECHNOLOGIES WILL HAVE SIDE-EFFECTS WE DON'T WANT. THAT IS WHY THIS IS BOTH IMPORTANT AND IMPORTANT TO DO THOUGHTFULLY AND LED TO THE CHARGE THAT FRANCIS PRESENTED US WITH ALMOST A YEAR AGO TODAY AND SINCE THEN I HAVE HAD A PRIVILEGE OF WORKING WITH A TERRIFIC GROUP THAT I LEARN NEW THINGS FROM IN EVERY MEETING A COUPLE OF THEM ARE IN THE ROOM NOW INCLUDING DENA AND JESS WHOSE PICTURE IS NOT ON HERE AND INVALUABLE IN KEEPING US PUSHING FORWARD AND DAVID HESS LETTER I'M TOLD OR ON THE PHONE. WHAT HAVE WE DONE FOR THE LAST SIX MONTHS? WE TALKED ABOUT THE WHOLE SPACE AND SAID: HOW CAN WE ORGANIZE OUR CONVERSATION TO LEAD TO SIX MONTHS FROM NOW ACTIONABLE RECOMMENDATIONS WE THINK WILL MAKE THE MOST IMPACT? WE DIVIDED OUR WORK UP INTO FIVE DIFFERENT THEMES. I WILL GO THROUGH EACH OF THE THEMES AND I HAVE TWO SLIDES ON EACH OF THE THEME. ONE SLIDE HIGH LEVEL LAYS OUT WHAT THE THEME IS IMPORTANT AREA TO WORK ON AND NEXT SLIDE IS THINKS THAT I RECOMMEND NIH SHOULD DO IMMEDIATELY NOT WAITING FOR FINAL REPORT BABY STEPS AND RIGHT QUESTIONS THAT WE THINK ARE THE ONES TO ANSWER IN OUR FINAL REPORT AND THAT WILL FOCUS OUR WORK. WHEN WE GET TO THE DISCUSSION, WHAT WILL BE PROBABLY THE MOST USEFUL HE ANYTHING IS FAIR GAME. WHAT WILL BE MOST USEFUL IS YOU MISSED A QUESTION OR ARE ASKING A WRONG QUESTION. THOUGHTS OR ANSWERS ARE ALWAYS WELCOME. THERE WILL BE MANY THOUGHTS ON ANSWERS AND THOUGHTS ON QUESTIONS WILL BE REALLY VALUABLE TODAY TO POINT US IN THE RIGHT DIRECTION. WITH THAT, LET'S JUMP INTO THE FIRST THEME WHICH IS AROUND DATA. CERTAINLY MY EXPERIENCE AND EXPERIENCE OF MINE WITH PEOPLE I WORK WITH IN THE TECH WORLD AI IN GENERAL ARE EXCITED ABOUT THE CHANCE TO TAKE THEIR SKILLS AND APPLY THEM TO THE AREA. SECOND QUESTION THEY ASK WE WILL SEE COMING UP AND SECOND QUESTION IS GREAT WHERE ARE THE DATA SETS? ANSWER IS WELL, THERE IS A LOT OF BYTES SOMEWHERE BUT HAVING -- HAVING RAW BYTES OUT THERE AND HAVING AI-READY DATA IS A HUGE GAP. AND WE SUSPECT ON THE COMMITTEE OR WORKING GROUP RATHER THAT THIS MAY BE ONE OF THE PLACES THAT IS THE HIGHEST LEVERAGE POINTS FOR THE NIH AND WE SUSPECT IT IS A PLACE THE NIH CAN DISPROPORTIONATELY COMPARED TO THE LARGER COMMUNITY MAKE AN IMPACT IN GENERATING HIGHER QUANTITY AND QUALITY IN AI-READY DATA. WHAT WE THINK THE NIH AND WHAT WE RECOMMEND WE DO NOW IS START THE PROCESS OF CATALOGING WHAT IS OUT THERE AND THIS IS A GOOD AND BAD AND UGLY CATALOG AND THERE ARE DATA SETS THAT ARE ALMOST REALLY VALUABLE TO WORK ON AI. WHAT IS THE GAP OR IS IT ABOUT IT THAT PARTICULAR DATA SET THAT IF ONLY IT WOULD BE EXACTLY WHAT THE FIELD COULD TAKE ADVANTAGE OF? WHERE ARE THE DATA SETS THAT ARE EXEMPLARS AND WE WANT MORE THINGS LIKE THIS AND WE THINK THOSE WILL MATTER. WE THINK IT WILL BE AN ONGOING PROCESS AND WE THINK WE CAN START RIGHT NOW THAT WILL BE A USEFUL INPUT OF THAT CATALOG AND WHAT IS OUT THERE. YOU CAN SEE QUESTIONS TO ANSWER NEXT. I HAVE USED THE PHRASE AI-READY DATA ONE QUESTION TO ANSWER IS GETTING CRISPER WHAT DO WE MEAN BY AI-READY DATA THESE ARE ATTRIBUTES WE THINK ARE RELEVANT WHAT WE THINK IT MEANS FOR DATA TO BE USEFUL AND FRIENDLY AND POWERFUL IN WORKING WITH AI TRAINING AND AI MODELS AND AS WE DEFINE IT, OTHER QUESTIONS TO ASK IS HOW CAN THE NIH GET THERE TO BE MORE OF THIS DATA AND GET THERE TO BE NOVEL SOURCES OR TYPES OF DATA? I THINK ONE -- JUST ONE ATTRIBUTE I WILL POINT OUT AMONG MANY, EACH OF THE SUBBULLETS ON THE TWO QUESTIONS ARE FASCINATING. INTERVENTION-BASED DATA THAT SAYS HAD HERE IS SOME DATA BEFORE AND AFTER AN INTERVENTION WOULD BE REALLY POWERFUL TO START TO MODEL -- YOU KNOW, BUILD MODELS WHAT -- HOW DO INTERVENTIONS WORK WRAND DO THEY WORK? THOSE ARE HARDER DATA SETS TO GENERATE AND ONE OF MANY INTERESTING THINGS WE THINK THERE IS LOTS OF OPPORTUNITIES. THAT IS THE DATA THEME. THE SECOND THEME, AND THIS CAME UP IN MANY CONVERSATIONS AND CAME UP IN JUST THE CONSTITUTION OF THE WORKING GROUP ITSELF IS MORE MULTILINGUAL RESEARCHERS WE STARTED TO USE BILINGUAL YOU WILL SEE IN THE SECOND BULLET WHY WE SWITCHED THAT TO MUMENTI LINGUAL. WHAT A FEW OF US HAVE FOUND WORKING IN THE INTERSECTION OF TECH AND BIOLOGY IS THAT YOU -- IT IS ABSOLUTELY ESSENTIAL YOU HAVE MULTILINGUAL TEAMS AVEND YOUR WORKING GROUPS AND COMMUNITY OF WORK I'M LOOKING AT LINDA YOUR WHOLE DEPARTMENT OR PREMISE IS BASED AROUND THIS PREMIS IT IS ESSENTIAL YOU HAVE ORGANIZATIONS THAT ARE MULTIWILL ING WAL TO DO THAT YOU DON'T NEED EVERY PERSON TO BE BOTH PHD AND MACHINE LEARNING IN SOME FORM OF BIOLOGY OR MEDICINE. YOU NEED BRIDGES AND TRANSLATORS AND PEOPLE THAT ARE EXPERTS IN SOMETHING AND EXPERIENCED ENOUGH IN SOMETHING ELSE THEY CAN CONNECT THOSE WORLDS. THOSE PEOPLE RIGHT NOW ARE OFTEN THE RIGHT LIMITING FACTORS IN GOOD PROGRESS. YOU MAKE A LOT OF PROGRESS WITHOUT THAT. IT CAN BE PROGRESS THAT IS DIVERGENT IF YOU HAVE GOOD CONNECTORS. WE THINK THIS IS A CRITICAL LEVERAGE POINT AND WE THINK THERE ARE A COUPLE MEDIATE ACTIONS WE RECOMMEND ONE AROUND COSPONSORING WORKSHOP IN UPCOMING CONFERENCE IN FIELD OF MACHINE LEARNING AND JESS GAVE ME UPDATE OVER COFFEE THIS IS STARTING TO HAPPEN AS THIS YEAR'S FELLOWS ARE STARTING AND BEING ENROLLED AND SIGNED UP. ASSIGN 1/3 TO AI PROJECTS START WITH THAT AND THEN DEFINING WHAT IT LOOK DZ LIKE TO BE MULTILINGUAL IN THIS BASE ONE OF THE ATTRIBUTES. HOW CAN THE NIH ENCOURAGE AND GROW AND CATALYZE THAT COMMUNITY? SOME OF THAT WILL BE CURRICULUM DEVELOPMENT PROBABLY AT ALL LEVELS WHEN THEY ARE -- CERTAINLY IN MY AREA HIGH SCHOOLS DO CLASSES IN MACHINE LEARNING. I DON'T KNOW ANY DOING CLASSES AT INTERSECTION OR UNIT AT BIOMEDICAL APPLICATIONS START AT THAT LEVEL AND GO ALL THE WAY THROUGH WHAT ARE MED SCHOOLS INCLUDING IN MACHINE LEARNING IN THEIR CURRICULA? I DON'T KNOW THE ANSWER BUT ALMOST SURE IT IS SOMETHING TO START TO ENCOURAGE THOSE CONNECTIONS TO HAPPEN. AS THE COMMUNITY GROWS HOW CAN WE CATALYZE THEM BECOME A COMMUNITY AS OPPOSED TO THEM BEING INDIVIDUALS WHO HAPPEN TO HAVE A RARE COMBINATION OF SKILLS AND TALENTS. THIRD THEME IS THE ETHICAL AND LEGAL THEME. THERE ARE -- WE CAN DO A WHOLE SESSION WHAT ARE SOME OF THE SURPRISING SHARP EDGES AND SURPRISING RISKS THAT IF YOU DON'T THINK ABOUT THIS. I THINK, YOU KNOW, AS I HAVE BEEN TALKING TO PEOPLE ABOUT THIS AND TRYING TO FIND A LAY EXPLANATION OF THE NATURE OF THESE RISKS, ONE WHOLE CATEGORY OF RISKS IS IF YOU ARE NOT CAREFUL WHAT MACHINE LEARNING CAN DO IS ADD AN AURA OF LEGITIMACY OF BIAS. IT CAN TAKE BIAS INPUT AND SHIELD IT WITH MAGICAL TECHNOLOGY AND NOW SAY I'M NOT BIASSED. THE COMPUTER SAYS THIS IF YOU ARE NOT CAREFUL. YOU CAN OBVIOUSLY BUT YOU CAN BE CAREFUL. THERE ARE WAYS TO AVOID THAT RISK AND GET POWER OF NEW TECHNOLOGY WITHOUT -- WITHOUT IT THAT PARTICULAR HARM AND OTHER RISKS AND THINGS TO WATCH OUT FOR. THAT ONE IS NOT OBVIOUS UNTIL THE RIGHT PERSON IS IN THE ROOM AND THEN IT IS COMPLETELY OBVIOUS ONCE IT HAS BEEN POINTED OUT WE ACTUALLY TALKED ABOUT A POTENTIAL RECOMMENDATION IS TO FORMLE AN NIH ADVISORY BODY OF SOME SORT ON THIS. IT WAS QUICKLY POINTED OUT TO US THAT IS NOT A QUICK OR EASY THING AND A PRE-REQUISITE TO IT IS TO SAY WHAT WOULD SUCH A BODY DO TO MAKE SURE IT IS A GOOD IDEA AND TO UNDERSTAND WHAT KIND OF A BODY IT WOULD BE. ONE THING WE THINK WE SHOULD DO NOW IS TO START DRAFTING THE CHARTER SO THAT THERE COULD BE A CONVERSATION ABOUT WHAT FORMLE SHOULD A NEW BODY TAKE GIVEN IT THAT CHARTER. WE THINK THAT IS SOMETHING THAT COULD GET STARTED ON NOW TO HAVE SOME FORMAL CONVENIENTU FOR THE CONVERSATIONS OF THE TOPIC I JUST MENTIONED. QUESTIONS TO TAKE A MINUTE OR 2 ON IS FIRST TWO WE TALKED ABOUT TECHNOLOGY WHEN YOU TAKE MEDICATION OR GET A PRESKRINCRIPTIOPRESCRIPTION, THERE IS A LABEL IN THE BOTTLE THAT SAYS YOU SHOULD KNOW THIS BEFORE TAKING THIS MEDICATION TRAINING DATA SHOULD HAVE THIS LABEL HERE IS WHAT YOU SHOULD KNOW BEFORE TAKING THIS DATA BUILT MODELS HERE IS WHAT YOU SHOULD KNOW BEFORE USING THIS MODEL APPLYING AND DEPLOYING THIS MODEL. THOSE CAN'T BE AD HOC BUT JUST LIKE WITH PRESCRIPTION LABELS THERE HAVE TO BE FORMS AND STANDARDS ASKED AND ANSWERS AND KEY THINGS YOU WANT TO HIGHLIGHT AND DISCOVER QUESTIONS IN THE LINKS IF ANYONE IS INTERESTED GO TO SOME EARLY PAPERS NOT ON BIOMEDICINE BUT GENERAL IDEA WHAT WOULD SUCH A LABEL LOOK LIKE IN FIELD OF TRAINING DATA AND TRAINED MODELS. SOME QUESTIONS ARE WHAT SHOULD THAT LOOK LIKE AND OTHER QUESTIONS IN ETHICAL REVIEW PROCESSES IT THAT COME OUT OF THAT CHARTER WE TALKED ABOUT AND IN GENERAL ED INDICATING THE COMMUNITY THE EXAMPLE I GAVE AROUND IF YOU ARE NOT CAREFUL YOU CAN MAKE THIS MISTAKE HOW CAN WE GET EVERYONE TO KNOW THOSE ARE THE THINGS TO NOT TRIP OVER AS THEY ARE APPLYING NEW TECHNOLOGY IN THIS IMPORTANT SPACE. MOVING ON TO THE 4TH I SAID THERE WERE USUALLY TWO QUESTIONS I GET ASKED WHEN I TALK TO PEOPLE IN TECH AND AFTER THEY SAY WHERE IS THE DATA THEY SAY HOW CAN I HELP AND WHAT PROBLEM IS IMPORTANT TO SOLVE? IF YOU ASK -- IF YOU ASK OR IF YOU ASK A LOT OF -- SOMEONE WHO IS PURELY HAS A BACKGROUND IN BIOLOGY, WHERE CAN AI HELP? THEY ARE NOT SURE THEY DON'T KNOW WHAT AI CAN AND CAN'T DO; RIGHT? FLAW ABOUT ANY SUFFICIENTLY ADVANCED TECHNOLOGY IS DISTINGUISHABLE FOR MAGIC THINK IS IF YOU DON'T KNOW YOU DON'T KNOW WHEN TO APPLY IT. ON THE OTHER SIDE TECHNOS WHAT TO DO BUT NOT BY WHERE IT IS MOST USEFUL BY CONNECTING THOSE AND CATALYZING AND UNDERSTANDING WHERE ARE THE MOST VALUABLE PLACES TO APPLY AI IN BIOMEDICINE WE CAN FOCUS THE THEORITIES AND ENERGY. REPRESENTATION SOMETHING TO DO NOW LET'S START WITH SUCCESS STORIES AND PUTTING TOGETHER THINGS WE WANT TO SEE MORE OF. THIS IS NOT THE ANSWER BY ITSELF BUT THE START. THIS DID INSPIRE CREATIVITY AND HELP THINKING BY EXAMPLE. WHERE ARE PLACES AND FEW CANDIDATES FOR THIS AND ON THE EARLIER SLIDE OF SOME OF THE PLACES WE ARE SEEING AI TAKE PART IN BIOMEDICINE AND CATALOG WE WANT TO SEE 1 THOUSAND OR 100 OF THESE IN A YEAR. HOW DO WE RECOGNIZE THOSE OPPORTUNITIES AND RAISE AWARENESS IN THE RIGHT COMMUNITIES OF THOSE OPPORTUNITIES? WE HAVE A FAIR AMOUNT OF DISCUSSION IN THE WORKING GROUP ABOUT -- THIS SHOULD APPLY BOTH TO BIOMEDICINE AND PUBLIC HAD HEALTH AND SOME OF THE BIGGEST OPPORTUNITIES MIGHT BE AROUND HEALTH DISPARITIES AND BRIDGING SOME GAPS AND BE CLEAR WHEN WE SAY AREAS APPLYING TO BIOMEDICINE WE ARE INCLUDING THAT LARGE AREA NOT JUST YOUR RESEARCH OR DIRECT CARE OF AN INDIVIDUAL PATIENT THE LAST OF THE FIVE THEMES THIS IS THE LAST WE ARE NOT SURE HOW MUCH MEAT IS HERE WE ARE SURE IT IS WORTH EXPLORING BUT NOT MUCH RIGHT NOW WE WILL FIND OUT AREAS ON FRONTIER OF AI KNOWS WHAT IT NEEDS NEXT AND IS WORKING ON IT AND PROBABLY SOME AREAS THOSE ADVANCES ARE PREFERENTIALLY AVAILABLE IN BIOMEDICINE IT IS A TECH THING AND ONE IT THAT WILL HELP BIOMEDICINE MORE THAN IT WILL HELP OTHERS AND THEREFORE AI COMMUNITY WON'T DO THAT BASIC RESEARCH IF IT DIDN'T UNDERSTAND IT WOULD APPLY EVENTUALLY IN BIOMEDICINE. EXAMPLE PEOPLE ALWAYS WHEN I HAVE BEEN TALKING ABOUT THIS PEOPLE ALWAYS SAY WHAT IS AN EXAMPLE AND EXPLAINABILITY IS ONE EXAMPLE WHERE THE AI COMMUNITY CARES ABOUT EXPLAINABILITY PEOPLE DOING GOOD WORK ON IT I EXPECT BIOMEDICAL APPLICATIONS CARE MORE. WHAT DO I MEAN BY EXPLAINABILITY? IF I GO TO MY DOCTOR AND THEY SAY YOU SHOULD START TAKING THIS DRUG TWICE A WEEK. WHY? WELL, YOU HAVE THREE OF THE FIVE RISK FACTORS SCORE OF 1 TO 3 AND WROTE DOWN FIVE NUMBERS AND CHAD SDO SCORE IS WHATEVER OH, I UNDERSTAND IT IS LIKELY WE CAN TRAIN A MACHINE LEARNING MODEL TO HAVE MUCH BETTER AREA UNDER THE CURVE THAN DOCTOR DOING FIVE CHECK BOXES ON THE THE FORM I GO TO MY DOCTOR AND I WANT YOU TO TAKE THIS MEDICATION TWICE A WEEK REST OF YOUR LIFE WHY? BECAUSE THE COMPUTER TOLD ME TO TELL YOU THAT. I KNOW HAVE AN INTERESTING DILEMMA AND BELIEVE THAT THE SECOND ADVICE IS PROBABLY BETTER FOR ME BUT I DON'T UNDERSTAND IT. THAT IS INTERESTING. RIGHT? WHAT CAN WE DO TO ADVANCE THE STATE OF THE AI TECH TO SHRINK THAT GAP TO GET BOTH AREA UNDER THE CURVE AND CONFIDENCE IN IT. THAT IS A RESEARCH AREA AND PEOPLE DOING THAT WORK AND AN EXAMPLE WHAT COULD HAPPEN HERE. THESE WERE SOME OF THE -- UNDER THE QUESTIONS TO ANSWER, YOU CAN SEE THAT WE PUT TOGETHER SOME OF THE SORTS OF AREAS THAT WE THINK ARE PROBABLY ON THE FRONTIER OF AI AND WOULD BE PREFERENTIALLY VALUABLE IN THE AREA OF BIOMEDICINE. THOSE ARE QUESTIONS WE WANT TO ANSWER IS WHAT CAN THE NIH DO TO SUPPORT THE AI COMMUNITY IN DEVELOPING METHODS THAT WILL EVENTUALLY LEAD TO APPLICATION FROM PREVIOUS NEED IN BIOMEDICINE. THAT WAS A QUICK TOUR THROUGH THE FIVE THEMES AND TWO SLIDES JUST SUMMARIZE IT SO YOU CAN SEE IT ALL. IT IS IN THE BOOKS TOO IF YOU WANT TO LOOK AT IT. THESE WERE THE DO-NOW RECOMMENDATIONS ACROSS THEMES WE THINK THEY ARE BABY STEPS BUT VERY MUCH GOING IN THE RIGHT DIRECTION AND LAYING GROUNDWORK SO THAT OVER THE NEXT SIX MONTHS WE CAN START TO WORK ON ANSWERS TO ALL THESE QUESTIONS AND IN TERMS OF TIMELINE, OUR FINAL RECOMMENDATIONS ARE DUE SIX MONTHS FROM NOW. THIS WAS OUR FIRST FACE -- WE HAD ONE FACE-TO-FACE MEETING RIGHT HERE IN BUILDING ONE TO KICK OURSELVES OFF AND PLANNING ANOTHER FACE-TO-FACE MEETING ON THE WEST COAST THAT IS FRANCIS AND LARRY PROMISED SOME OF US WORKING GROUP WOULD OENT HAVE TO FLY HERE ONCE AND PEOPLE WOULD FLY THE OTHER DIRECTION ONCE AND USUAL SET OF PHONE CALLS. I THINK I WILL GO BACK TO THIS AND LEAVE THIS UP. IT IS OUR TIMELINE. VERY INTERESTED IN QUESTIONS AND COMMENTS AND DISCUSSION ON WHAT WE HAVE DONE SO FAR? >> FRANCIS S. COLLINS: DAVID, THAT IS TERRIFIC. THANK YOU. LET'S HEAR DISCUSSION. LINDA. >> CONGRATULATIONS FABULOUS START WITH AMAZING PROGRESS KUDOS TO YOU GUYS. ONE THING IS MESSAGING AND WHAT COMES OUT OF THIS IS AS MUCH AS WHAT AI CAN DO AND ALSO WHAT AI PROBABLY CAN'T DO THAT NIH IS UNIQUELY POSITIONED TO DO. THERE IS A PERVASIVE SENSE AT MY INSTITUTION LED BY UPPER ADMINISTRATION THAT AI WILL DO EVERYTHING AND REALLY SOON SO YOU PUT A BIOLOGIST TOGETHER WITH AI AND ALL ANSWERS WILL COME BACK AND HARKS BACK TO DAY ALGLUMAN'S GRANT WHEN I FIRST MET LAY TAKE DATA AND CRANK KNOB OF CALCULUS AND HE DIDN'T KNOW ABOUT AI AND ANSWER COMES OUT HIS EXPERIMENTS WERE WEREN'T UNDER CONDITIONS YOU COULD GET USABLE DATA. YOU NEVER ESCAPE MECHANISM OR ESCAPE NEEDING TO LINK THINGS MULTIPLE TIME SCALES BIOACHEMISTRY AND -- FAR OUTSIDE OF THE REALM WHAT AI CAN DO. THAT MESSAGE IS KIND OF GETTING LOST IN THIS AI IS GOING TO DO EVERYTHING. I'M A HUGE FAN OF AI AND WORK WITH DENA AND [INDISCERNIBLE] WHO IS AN LP AND MACHINE LEARNING EXPERT REAL WORLD PROJECTS TO BRING AI IT IS A BIGGER MATH AND ENGINEERS ALLS USE IMAGINE BUT THINK OF THE ENGINEERING YOU NEED ENGINEERS NOT MULTILINGUAL COMPUTER SCIENTIST TALKING TO A BIOLOGIST BUT TRANSLATOR ENGINEER THAT THINKS ABOUT BIOLOGIY FROM MOLECULAR LEVEL TO FRAME QUESTIONS I'M CONCERNED ABOUT THE MESSAGES TO ENSURE THAT PART OF IT IS BROUGHT IN. IT SAY LITTLE HIDDEN UNDER MULTILINGUAL YOU MIGHT GAIN A LOT FOR WHAT NIH CAN DO TO HELP THIS WHOLE THING MOVE VERY NICELY FORWARD BY EXPLICITLY CALLING OUT THE NEED FOR ENGINEERS TO HELP TRANSLATE BETWEEN COMPUTER SCIENTISTS AND BIOLOGISTS AND CLINICIANS I REALLY STRONGLY FEEL ABOUT IT. >> THANK YOU FOR THAT. I AGREE ONE THING THAT WILL BE INTERESTING IN THE NEXT 6 MONTHS WE CAN WRITE IT IN OUR RECOMMENDATIONS EVERYBODY WILL AGREE WHAT CAN NIH DO TO HELP CREATE THOSE CORRECTLY SKILLED GROUP TEAMS WITH CORRECT UNDERSTANDING TO MOVE IT FORWARD THAT IS PART OF WHAT WE WANT TO INCLUDE. >> PART IS NURTURING WHEN CHEMICAL ENGINEERING GOT BORN IN TURN OF 1900S -- AS EFFECTIVELY AS THEY COULD IF THEY HAD A TRANSLATOR WHO WAS ENGINEER TRAINED IN MODERN MOLECULAR CHEMISTRY. NOW YOU NEED ENGINEERS TRAINED IN MODERN BIOLOGY TO HELP THAT TRANSLATION. IT IS ONLY HAPPENING AND SPROUTING UP EVERYWHERE. FOSTERING THAT NIH DID A GAZILLION YEARS BEFORE NIB WAS FORMED THROUGH B CON AND REKINDLING THAT I THINK WOULD BE VERY VALUABLE. >> FRANCIS S. COLLINS: MAYBE PEOPLE CAN START TO SET UP THEIR CARDS OR I MIGHT NOT SEE YOU AS SIGNALING YOUR INTEREST IN SPEAKING. JEFF AND DENA AND WENDY. KRISTINA IS CUED UP. >> NO PROBLEM. I RESINATE WITH WHAT YOU ARE SAYING TO AMPLIFY WHAT LINDA SAID. BACK IN THE 90S WE DID A PROJECT LOOKING AT USING MACHINE LEARNING AT THE TIME BACK PROPAGATIONS AND SOME OF THE EARLY ONES WHAT WE FOUND IS FIRST THING WE FOUND WAS NOT ANNOTATED DATA SET TO TRAIN ON. STEP BACK AND APPRECIATE THIS AND GET A PATHOLOGIST TO HELP US IDENTIFY WHAT WERE CANCER CELLS NOT. ONE THING I WOULD BE CURIOUS THINKING OF CREDENTIALS OF PERSON ANNOTATING DATA SETS TRAINED ON IT AND FOUND WE WERE SOLVING THE WRONG PROBLEM I WAS TRYING TO GET FALSE NEGATIVE RATES TO NOTHING IT IS MORE IMPORTANT TO GET FALSE POSITIVE RATES NEEDLE IN HEY STACK AND RECENT THING TERRY WROTE IN BOOK DEEP LEARNING COMBINING AN EXPERT TAKE A PROBLEM FROM 80 TO 90% TO ALMOST 100% IN ACCURACY WE FOUND PAIRING PATHOLOGIST WITH THE BOX WE SOLD THE BOX TO SIDE TECH WHO BOUGHT BY WHOLE LOGIC SUCCESSFUL APPLICATIONS ONE THING WE LEARNED IS HAVING THE EXPERT TALKING ABOUT THERE WORKING IN THE TEAM IS IMPORTANT AND MAKE SURE TO SOLVE RIGHT PROBLEM TOO USING RIGHT DATABASE AND 3 AT THE END OF THE DAY RESULT TOOK THE ACCURACY VERY, VERY HIGH. I'M SUPER EXCITED ABOUT THIS. I'M WONDERING DID YOU EVER HAVE DISCUSSIONS ABOUT REALLY THE QUALITIES OF CREDENTIALKRED EN ENIE ENE ENSHALING. >> THAT IS WHERE WE WILL DO THE WORK BUT WE HAVEN'T DONE THE WORK YET. I THIS I THAT YOU KNOW IT COULD BE THAT SOME OF THE RECOMMENDATIONS AROUND THE SECOND SUM PLE HERE COULD INVOLVE STAND YADS OR FRAMEWORKS OR PROCESSES FOR LABELING. WHAT ARE GUIDELINES HOW TO TAKE A DATA SET AND TURN TO A LABELED DATA SET INCLUDING CREDENTIALS AND TOOLS AND COULD BE IT WILL BE SOMETHING IN THERE. THE OTHER POINT YOU MADE I'M REPEATING SO I REMEMBER IT IS I LIKE YOUR IDEA OF AI AS AN AUGMENTATION FOR HUMANS AS ONE OF OF THE WAYS TO APPLY AI. YOU KNOW? IT IS SELF-DRIVING CARS MAY BE A WHILE AWAY BUT CARS THAT YELL AT ME WHEN LEAVING THE LANE OR ABOUT TO RUN INTO SOMETHING ARE HERE TODAY AND HELPING ME TO BE A BETTER DRIVER TODAY. THERE ARE PROBABLY EQUIVALENTS WHERE WE CAN MULTIPLY THE VALUE OF A TRAINED HUMAN BY USING A. BY : >> SUPER EXCITING. THANK YOU. >> YEAH. JEFF? >> THANKS, DAVID. THAT IS GREAT. AS YOU AND I DISCUSSED VAST MAJORITY OF DATA WE ARE GENERATING IS QUITE DIRTY AND SIGNIFICANT NEED FOR DATA JANITORS TO GET THINGS TO BE AI READY I'M WONDERING IF YOU HAD DISCUSSIONS ABOUT WHAT WORKFORCE HAS TO GENERATE DATA TO BE AI READY AND AI RESEARCHERS TO HAVE ALLOCATION OF FUNDING TO GET DATA TO THE POINT IT CAN BE DEPOSITED AND USED BY AI RESEARCHERS. >> DAVID GLAZER: WE TALKED ABOUT THE NEED WE DON'T HAVE SILER BULLET I BELIEVE THAT PART OF THE ANSWER IS DEFINING THE CRITERIA SO PEOPLE WILL KNOW AT END OF GENERATING DATA THEY GENERATED GRADE A DATA OR GRADE C DATA FOR PURPOSE OF PURPOSES BEYOND PUBLISHING INITIAL PAPER. IF PEOPLE DON'T KNOW FIRST THEMSELVES, IT IS HARD FOR THEM TO KNOW WHAT THEY WOULD NEED TO INVEST IN AND ALSO IF THE COMMUNITY DOESN'T KNOW IT IS HARD FOR THE EXTRA INVESTMENT TO BE VALUED. I THINK A FIRST STEP IS GETTING SOME UNDERSTANDING OF, HEY, YES. THIS IS A GOOD DATA SET. OUR PROJECT HAS GOOD JANITORS AS OPPOSED TO YOUR PROJECT I'M NO THE SURE I WANT TO SLEEP IN YOUR HOTEL. AND I THINK THAT WILL BE PART OF THE ANSWER IS GETTING SOME AGREEMENT WHAT DOES IT LOOK LIKE WHEN YOU HAVE DONE A GOOD JOB OF THE HARD NECESSARY WORK OF DATA JANITOR. >> FRANCIS S. COLLINS: GREAT. DENA. >> YES. I WANT TO GO BACK TO WHAT LINDA MENTIONED. SOMETIMES THERE IS AN IMPRESSION THAT AI CAN REPLACE A DOCTOR OR WILL REPLACE A DOCTOR OR THE BIOLOGIST OR THE BIOENGINEER. DEFINITELY THAT NOTION DID NOT COME AND ALL OF THE MEMBERS I'M SURE ON THE COMMITTEE BELIEVE STRONGLY ACTUALLY THAT THIS IS NOT THE CASE. IN FACT, IF YOU LOOK AT SUCCESSES, THEY ARE TYPICALLY WHEN THEY ARE THE AI EXPERTS COME TOGETHER AND PROJECT THAT HAS PEOPLE REPRESENTATION ON EITHER MEDICAL DOCTORS AND AI EXPERT OR AI EXPERT WITH BIOENGINEERS OR BIOLOGISTS. THERE IS EMPHASIS WE TRY TO CAPTURE THROUGH MULTILINGUAL PEOPLE BUT IT IS REALLY A WHOLE TEAM THAT COMPLEMENTS EACH OTHER AND TYPICALLY SUCCESSES COME FROM A TEAM THAT HAVE EXPERTISE THAT COMPLEMENT EACH OTHER WITH PEOPLE IN THE MIDDLE OF THAT ARE MAYBE MORE EQUIPPED IF IN TRANSLATION BETWEEN THE DOMAINS PARTICULARLY IN THE BEGINNING NOW THAT COLLABORATIONS ARE STARTING. THERE IS AN AND PROBABLY IMPORTANT TO EMPHASIZE IT IS NOT REALLY A PLACEMENT BUT REALLY AN EMPOWERMENT TO PEOPLE CURRENTLY WORKING IN THE FIELD. >> FRANCIS S. COLLINS: WENDY? >> I LOVE THE THEMES AND AREA THAT NIH IS PARTICULARLY WELL-SUIT TODAY HELP WITH I DIDN'T SEE THERE. THAT IS REALLY FACILITATING THE USEFULNESS OF AI IN CONTEXT AND HOW CAN NIH SUPPORT EVALUATION OF THE ALGORITHMS IN CONTEXT OF WHERE THEY WILL ACTUALLY BE USED WITH THE DOCTOR OR PATIENTS. INFRASTRUCTURE THAT IS NEEDED TO REALLY MAKE THESE THINGS, YOU KNOW, WORK IN THE HOSPITAL AND STANDARDS AND INTEROPERABILITY NEED TO BE PART OF EHR IF THEY ARE PART OF THE WORKFLOW AND HUMAN INTERACTION PART OF IT AND I THINK YOU KNOW THIS MULTILINGUAL IDEA IS ONE PLACE THIS COULD FIT IN TERMS OF AUGMENTING HUMANS AND REALLY HOW DO WE MAKE IT USEFUL WHICH IS A PLACE WE HAVE NOT GOTTEN TO YET. >> FRANCIS S. COLLINS: YES. IF THAT MAKES ITS WAY TO A THEME ONE WORD ANSWER IS DEPLOY HOW CAN NIH HELP WITH DEPLOYMENT OF GOOD AI MODELS IS THAT A FAIR WAY TO THINK ABOUT IT. >> YEAH. THAT IS FAIR NATIONAL LIBRARY OF MEDICINE DID WORK IN THIS SPACE THAT WOULD BE EASY FOR THEM TO FACILITATE TO. >> FRANCIS S. COLLINS: JAY NEXT AND THEN BRENDAN. >> YEAH. SORRY. I LOVE ALL THESE THEMES AS WELL. I GUESS I HAVE A CONCERN IN THIS AREA AS IT RELATES TO BIOMEDICAL RESEARCH IN PARTICULAR THAT IS AN INCREASING TREND TOWARDS CARING OF PREDICTIVE PERFORMANCE OVER UNDERSTANDING YOU HINTED AT THIS A LITTLE BIT IF YOU TAKE TOOLS FROM A WORLD IN WHICH A MAIN GOAL IS ARGUABLY PROFIT OR PERFORMANCE TOWARDS YOU KNOW BASIC BIOLOGY AND NIH AND MAIN GOAL IS UNDERSTANDING AND I HAVE SEEN AI INCREASINGLY BEING APPLIED IN GENOMICS THERE IS A TREND IN PART BECAUSE TOOLS ARE NOT FULLY MATURE TO EXTRACT WHAT FEATURES PERFORMANCE IS BASED ON PEOPLE EMPHASIZING PERFORMANCE AND UNDERSTANDING HOW PERFORMANCE IS ACHIEVED YOU HINTED IN ONE EXAMPLE IN THE CONTEXT OF DOCTOR AND A PATIENT BUT IT IS ALSO TRUE AS METHODS ARE APPLIED TO BASIC BIOLOGY IT WILL BE IMPORTANT TO EMPHASIZE IT SHOULD IN MANY I VIEW A PREFERENCE FOR ML METHODS THAT ALLOW YOU TO UNDERSTAND WHY YOU ARE SEEING WHAT YOU ARE SEEING; RIGHT? >> FRANCIS S. COLLINS: YEAH. >> THANK YOU. >> FRANCIS S. COLLINS: GOOD POINT. BRENDAN. >> I WILL FOLLOW UP ON JAY'S POINT IN TERMS OF A PRACTICAL SENSE THAT I HAVE NO TOPICAL EXPERTISE HERE IN FACT DIAGNOSTIC CLINICAL OPERATION IN CONTEXT OF GENOMIC VARIANT INTERPRETATION HAS IMPLEMENTED AI PLATFORM AND FRONT-END TO IN FACT HELP HUMAN COMPONENT ON BACK-END. WHEN WE CONSIDERED THIS I ASKED THE QUESTION HOW DO WE KNOW WHAT THE QUALITY IS? PERHAPS THAT QUESTION IS IF NOT ALL THAT DIFFERENT THAN WHAT THE PRACTICE OF MEDICINE HAS ALWAYS BEEN BUT IT JUST -- IT IS MOVING FORWARD AND WE ARE ASSESSING IT BUT CONCERN IS I KEEP IN THE BACK OF MY MIND IS HOW DO YOU REALLY CALIBRATE QUALITY AND WHAT DO YOU BENCHMARK THAT ESPECIALLY WHEN IN AREA EVEN TODAY FROM HUMAN SIDE IT VARIES FROM OPERATION TO OPERATION. I'M NOT SURE HOW YOU WOULD PROPOSE. IT IS INTERESTING. I THINK IN ADVISORY COMMITTEE IT MIGHT BE EXPERT OPINION AND MAYBE ONE APPROACH. YOU KNOW, IT SEEMS THAT THE ACTUAL APPLICATION OF IT IS JUST SO DIFFERENT FROM CONTEXT TO CONTEXT. I'M JUST SPEAKING FROM THE PERSPECTIVE FROM HOW DOES AI PLATFORM GENERATE A VARIANT PRIORITIZED VARIANT LIST FOR HUMANS TO INTERPRET BEYOND. >> DAVID GLAZER: IT IS INTERESTING YOU SAID IN THIS QUESTION THAT I THINK SOME OF THAT IS THE GENERAL QUESTION IN THE FIELD. HOW DO YOU -- YOU KNOW, HOW DO YOU JUDGE WHAT IS WORKING AND IF NOT WORKING? THERE ARE PROBABLY SOME AI SPECIFIC ASPECTS OF THAT. I'M NOT SURE WHAT THEY ARE YET. >> FRANCIS S. COLLINS: LET ME ASK IF THERE ARE QUESTIONS ON THE PHONE FROM MEMBERS OF THE WORKING GROUP THAT CALLED IF IN. I UNDERSTAND DAVID AND [INDISCERNIBLE] ARE ON THE PHONE DO YOU HAVE ANYTHING YOU WOULD LIKE TO RAISE OR COMMENTS SINCE YOU WORKED ON THIS EFFORT? IS. >> I CAN JUMP IN. THIS IS [INDISCERNIBLE] CAN YOU HEAR ME. >> FRANCIS S. COLLINS: YES, WE CAN, PLEASE. >> YES, WE CAN. >> I WANT TO GO BACK TO THE VERY FIRST COMMENT I THINK WAS MADE BY LINDA ABOUT WHAT AI CAN'T DO AND WHAT NIH MIGHT BE BETTER POSITIONED TO DO. I THINK THAT IS SOMETHING THAT HAS BEEN AN UNDERCURRENT IN SECTIONS WE WORKED ON AND ESPECIALLY IN OPPORTUNITIES TO USE AI IN DOMAINS NIH RESEARCHER IT IS STRIKING TO ME WHEN YOU HAVE WELL DEFINED QUESTION OR DATA OR WHATEVER IT IS IT IS EASIER TO LET AI DO ITS MAGIC ABOUT YOU VERY BEGINNING OF THE PROCESS IS SITTING DOWN AND WRITING A QUESTION WHICH IS NOT SOMETHING AI CAN DO EVER. I THINK NIH IS POSITIONED TO IDENTIFY REALLY IMPACTFUL QUESTIONS TO MAKE A DIFFERENCE ACROSS THE COUNTRY WHICH IS SOMETHING THAT IS LACKING ON THE AI SIDE. I THINK IT IS A REALLY GREAT COMMENT THAT I THINK IS WORTH -- WORTH DWELLING ON A LITTLE BIT. SO -- >> GREAT POINT, THANK YOU. I HAVE JEFF AND DENA AND THEN LINDA. >> A NUMBER OF THE COMMENTS I HEARD TODAY SEEM TO ANTICIPATE THAT AI WILL HAVE REAL-WORLD AND CLINICAL APPLICATIONS AND I WONDER IF IT PRESUPPOSES WE UNDERSTAND THE TRANSLATIONAL PATHWAY THAT WILL BE NECESSARY TO GET THESE INTO THE CLINIC AND WONDER IF WORKING GROUP CAN CONSIDER THINKING ABOUT SORT OF THE ANTICIPATE THAT FUTURE AND POTENTIALLY WORKING WITH FDA ON REALLY HELPING TO DEFINE WHAT IT WOULD TAKE TO TRANSLATE. WE HAD LARRY SET UP A BRIEFING BY A COUPLE OF THE PEOPLE AT THE FDA WHO ARE WORKING ON EXACTLY THIS. THEY HAVE DONE GREAT WORK. WE CAN SEND OUT A LINK TO THEIR PAPER AND WORK THAT THINK HAVE DONE. SHORT ANSWER IS WE HAVE STARTED THAT CONVERSATION. WE ONLY STARTED IT SO FAR. ONE OF THE SLIDES WAS A LINK TO THE RECENT FDA AI APPROVALS AND SOME OF THE ALREADY EXISTING THINGS THAT MADE IT THROUGH ONE OF THE FDA PROCESSES THAT ARE AI-BASED INTERVENTIONS. IT IS STARTING. TO THE FIRST PART OF YOUR QUESTION I'M CONFIDENT IT IT WILL HAPPEN. IT ALREADY STARTED TO HAPPEN. HOW DO WE DO IT BETTER GOING FORWARD. >> DAVID GLAZER: YEAH DENA. >> I WANT TO GO BACK TO ONE OF THE QUESTIONS ABOUT HOW TO TRUST AI AND HOW CAN AI ALSO FEED BACK INFORMATION FOR WHY IT MADE CERTAIN DECISIONS AND OF COURSE THERE ARE MANY MAKERS ABOUT INTERPRETABILITY OF AI AND EXPLAINABILITY. I WOULD LIKE TO GIVE ONE EVER THE SIMPLEST METHODS. LET'S SAY FOR EXAMPLE I WON'T -- I AM LESS FAMILIAR WITH THE AI PROGRAM IN GENERAL. LET'S LOOK AT FOR EXAMPLE SOME AI MODEL THAT IS TRYING TO MAKE A DECISION ABOUT CANCER FROM MAMMOGRAMS FOR EXAMPLE. APPROACH THAT -- AGAIN, THESE ARE SOME OF THE SIMPLER APPROACHES AND THERE ARE MORE COMPLEX ONES AND AI WILL POINT IN THE IMAGE WHERE IT SUSPECT THAT IT -- THE REGION THAT IT MADE IT MAKE ITS DECISION ABOUT THE PRESENCE OF CANCER. A PRSON OR EXPERT CAN LOOK AT THAT AND DO AN ADDITIONAL SCREENING. SIMILARLY, IF IT IS MAKING A DECISION BASED ON MEDICAL RECORDS LIKE A SCAN OR MANY MEDICAL RECORDS TO MAKE A DECISION ABOUT A PARTICULAR DIAGNOSIS OR PROGNOSIS, IT IS ALL -- IT CAN ALSO HIGHLIGHT IN THOED MEDICAL RECORDS THE TEXT THAT NEEDED -- LEANED TOWARDS A PARTICULAR DECISION AND GAVE A PROBABILITY OR CONFIDENCE IN ITS DECISION. AS WE WORK TOGETHER AS A COMMUNITY BRINGING THE -- DEVELOPING MORE SOPHISTICATED AI MODELS PARTICULARLY TARGETED TOWARDS EXPLAINABILITY AND ADDRESSING MEDICAL DATA IT WOULD BE EVEN MORE SOPHISTICATED MODEL THAT INTERACT OR INTER ACTIVELY ALLOW THE EXPERT TO WORK WITH THE MODEL. >> OKAY SPAEK LINDA AND FRANCIS. I WILL FOLLOW ON WHAT DENA SAID AND ELABORATE WHAT THE PHONE CALLER SAID. >> SO THE EXAMPLE THAT DENA USED ON THE MAMMOGRAM SYSTEM HAS BEEN IMPLEMENTED ON TENS OF THOUSANDS OF MAMMOGRAMS AT MGH. IT HELPS THE CLINICIAN MAKE PREDICTIONS ABOUT WHETHER A PATIENT WILL GET BREAST CANCER NOT WITHIN TWO YEARS AND TO QUINTILES. OKAY? THAT -- MILLIONS AND MILLIONS OF VERY HIGH QUALITY MAMMOGRAMS EXIST WITH EXTREMELY WELL-KNOWN ANNOTATED OUTCOMES TO USE NATURAL LANGUAGE PROCESSING. SXURED BY THE EXPERIENCE WE BROUGHT IT INTO ENDOMIOSIS WHO KNOWS WHAT IT IS IN THIS ROOM -- IN PUB MED APPROXIMATELY I DON'T KNOW WHO MISSES WORK FOR THAT AND DON'T WANT TO KNOW ABOUT IT BUT DRUGS TO TREAT IT IF YOU WATCH SPORT AD MOW MYOSIS EXPECTS WE DON'T KNOW 25 PAPERS IN ALL OF PUN MED FOR SOMETHING THAT CAUSES ABOUT 10% OF WOMEN TO MISS SCHOOL OR WORK ONE DAY A MONTH IT IS HARD TO INTERPRET IMAGES NO GREAT GUIDELINES WE CAN GET DATA OUT OF NATURAL BY USING LP WITH GREG EVEN AH ON MEDICAL RECORDS AND TRY TO INFER AND LOOK AT THEM IMPOSSIBLE TO DO THAT -- NOR ARE IMAGES ACQUIRED IN ANY KIND OF STANDARD WAY THAT REGULAR EVEN AH COULD LOOK AT THEM HOW SHE LOOKS AT MAMMOGRAMS AI CAN STIMULATE THE COMMUNITY TO UP THEIR GAME BUT ON THE OTHER HAND EVEN IF ABLE TO USE AI ON THAT THE MECHANISMS FOR WHAT CAUSES AD KNOW MYOSIS THERE ARE NO DRUGS YOU NEED SOMETHING COMPLETELY DIFFERENT THAN AI TO FIX THE PATIENT CAN HELP DIAGNOSE BETTER BUT NEED SOMETHING ELSE TO FIX HER THAN AI. COMMITTEES TO BRING EXAMPLES OUT WORKS FABULOUSLY WELL AI SUCCESSES CAN INFORM ADVANCES IN FIELDS THAT HAVEN'T BEEN ANNOTATING AND IMAGING AND OTHERWISE UP THEIR GAME WE CAN IN GYN ECOLOGY BUT THERE ARE WHOLE UNIVERSES WHERE WE NEED MECHANISTIC DATA SETS DRIVEN BY MECHANISTIC THINKING BY TAKING ALL KINDS OF DATA SETS AND FIGURE OUT HOW DO THEY RELATE AND INFORMATION FLOW AND LINKING CHEMISTRY AND BIOPHYSICS TO GET THINGS THAT COULD EVER BE EVEN USEFUL TO AI. >> FRANCIS S. COLLINS: WELL SAID FRANCIS. >> THANK R YOU, DAVID. VERY INSPIRING. I WONDER IF IS THERE A ROLL FOR AI AND MACHINE LEARNING IN ACQUIRING THE DATA AND IN A WAY THAT WOULD BE AI READY? I UNDERSTAND THE IMPORTANCE OF THAT. WHAT I'M THINKING OF IS MAYBE INCLUDED IN AREAS TO APPLY AI. THE INTERACTION WITH THE PATIENT INITIALLY ELECTRONIC MEDICAL RECORDS THAT ARE A DISASTER AND IF NOT THEY TAKE ENORMOUS AMOUNT OF EXPENSIVE EFFORT TO PUT IN PROPERLY. I WONDER IF YOU HAVE CONSIDERED OR WORKING GROUP IS CONSIDERING THE FRONT END OF THIS. IN FACT, THE INFORMATION FRONT END AS OPPOSED TO BLACK BOX EXPERT THAT OF COURSE IS [INDISCERNIBLE]. >> RIGHT. >> [INDISCERNIBLE]. >> I THINK YOU ARE SAYING IS IT POSSIBLE TO USE AI TO HELP WITH TAKING EXISTING LOW QUALITY DATA AND TURNING IT INTO AI READY DATA. >> RIGHT. >> I THINK WE SHOULD EXPLORE THAT. I THINK SOMETHING IS THERE AND I WORRY THAT IT MIGHT YOU KNOW GIVE US VERY CONCENTRATED GARBAGE. >> AUDIENCE: [LAUGHING]. >> WELL, MINE, I SUPPOSE THERE IS A ROLE FOR OTHER AI THAT IS AUTHENTIC INTELLIGENCE WHICH SLT HUMAN IN THERE SOMEWHERE. >> RIGHT. >> I'M TALKING ABOUT TAKING OUT DRUDGERY AND PROVIDING OPTIONS AND I'M THINKING ABOUT YOU YOU KNOW MOST OF US GO TO THE DOCTOR AND FILL OUT RATHER PAINFULLY FOR 20 MINUTES AGAIN AND AGAIN AND AGAIN OUR MEDICAL HISTORY PRESUMABLY WITH NATURAL LANGUAGE PROCESSING YOU COULD GET AN AI TO GO AND DO IT BEYOND JUST THE CHECK LIST. >> I MEAN I THINK. >> THAT IS JUST A SILLY. >> YEAH. I THINK IN THE PROCESS OF GENERATING THIS MIGHT BE A PERFECT PLACE FOR AUGMENTATION AS YOU WERE SAYING I DON'T WANT -- I DON'T NECESSARILY WANT MY MEDICATION HISTORY TO BE AUTOMATICALLY EXTRACTED FROM MY RECORDS BUT WOULD LOVE IT IF THE CHECK LIST I GOT SAID IS THIS RIGHT AIS IS THIS RIGHT IS THIS RIGHT AND HI TO CHANGE 5% OF IT INSTEAD OF REMEMBERING 100% OF IT. PLACES LIKE THAT ACT OF CLEANING UP MESSY DATA AI COULD PROVIDE A GOOD FIRST STEP AND HUMAN -- THAT COULD -- YEAH. >> DAVID GLAZER: DENA AND WE WILL WIND THIS UP BUT PLEASE. >> YEAH. SO I THINK THERE ARE -- THE ANSWER GOES ALONG THREE AXIS TO YOUR QUESTION. AI CAN HELP TO SOME EXTENT IN CLEANING EXISTING DATA. FOR EXAMPLE, THERE IS A LOT OF WORK ON MISSING DATA WHICH IS COMMON IN MEDICAL RECORDS AND SECOND AXIS IS AI CAN HELP ACQUIRE AI ACTUALLY AND DIGITAL HEALTH IN AI AND ACQUIRE NEW TYPE OF DATA THAT CAN AUGMENT EXISTING DATA AND PROVIDE CONTEXT FOR IT AND USING CENSORS AND WEARABLE ADDITIONAL INFORMATION ONLINE TO PROVIDE FOR CONTEXT OF DATA TO EXPLAIN IN A BETTER WAY AND CORRECT IT SOMETIMES AND THIRD THING IS AI CAN CLOSE THE LOOP BY DISCOVERING WHAT KIND OF QUESTION COULD BE ASKED TO ACTUALLY CORRECT OR IMPROVE DATA SET WE HAVE. ALL OF THESE ARE INTERESTING DIFFERENT AXIS TO IMPROVE ON. >> COULD YOU GO BACK ONE SLIDE? I WANT AC TO LOOK AT THE LIST OF DO-NO RECOMMENDATIONS YOU ARE GIVING US AN INTERIM REPORT WE WILL HAVE MUCH MORE SPECIFICS IN DECEMBER AS I UNDERSTOOD IT YOU ARE SAYING WE SHOULD START THESE THINGS NOW. IS THERE -- I GUESS I WANT TO HEAR IF THERE IS ANY CONCERN FROM ACD MEMBERS ABOUT PROCEEDING WITH THIS WE SHOULD HEAR IT BUT THEY SEEM LIKE PRETTY REASONABLE RECOMMENDATIONS I SEE NODDING HEADS WE WON'T TAKE A VOTE WE GENERALLY DON'T ABOUT INTERIM RECOMMENDATIONS WE DO WITH FINAL RECOMMENDATIONS BUT IF I HAD ANY CONCERNS I WOULD WANT TO KNOW. LOOKS LIKE EVERYBODY IS FAIRLY HAPPY WITH THAT. GREAT. THANK YOU VERY MUCH. THAT WAS A LUCID PRESENTATION OF A TOPIC THAT CAN SOMETIMES GET PRETTY WOOLLY AND THANKS FOR SAVING US FROM WOOLLINESS AND INSPIRING US WHAT CAN BE DONE HERE AND TALKING ABOUT MONEY I'M SURE THE TIME CAN COME WHERE IT THAT STARTS. >> DAVID GLAZER: I WILL WAIT UNTIL I HAVE 279 PEOPLE AGREEING BEFORE I. >> FRANCIS S. COLLINS: YOU CAN IMAGINE IT MIGHT TAKE A WHILE. VERY GOOD. THANK YOU. THANKS TO YOU ALL FOR BEING EFFICIENT AND MAKING UP FOR LACK OF DISCIPLINE OF NIH DIRECTOR IN THE MORNING LET'S MOVE TO A PRESENTATION ON HELA JEN OHM DATA ACCESS WORKING GROUP FROM SPERO AND CARRIE THIS IS A WORKING GROUP FIRST CONVENED IN 2013 AFTER WE CAME TO AGREEMENT IN LAX FAMILY ACCESS COMPLETE GENOME OF HELA CELLS SHOULD BE SEEN. THEY HAVE CONCERNS ABOUT THIS. THEY HAVE BEEN WONDERFUL PARTICIPANTS ON THIS INCLUDING WORKING ON THE SERVING GROUP AND EVALUATE REQUEST FOR ACCESS AND FOUR SUCH REQUESTS TO PUT IN FRONT OF YOU AT THIS TIME AND CARRIE WILL TELL YOU WILL A NEW AND INTERACTIVE WEBSITE THAT ALLOWS US TO CELEBRATE CONTRIBUTIONS OF HELA CELLS TO RESEARCH. TAKE IT AWAY. >> THANK YOU. DELIGHTED TO BE HERE PRESENT ON BEHAD HALF OF DR. [INDISCERNIBLE] AND MYSELF. WORK OF THE WORKING GROUP. FOR THOSE THAT ARE NEW TO THE ACD AND HAVEN'T SEEN THIS WORKING GROUP PRESENT BEFORE, AS FRANCIS MENTIONED, THERE IS A DATA USE AGREEMENT BETWEEN -- THAT WAS RESOLVED BETWEEN NIH AND MEMBERS OF THE LAX FAMILY THAT REQUEST THAT ALL RESEARCHERS WHO ARE APPLYING FOR ACCESS TO HELA GENOME WE CALL DB GAP ABIDE BY NUMBER OF TERMS IN HELA SPECIFIC DATA USE AGREEMENT INCLUDING LIMITATION TO BIOMEDICAL RESEARCH AND THEY DON'T CONTACT MEMBERS OF THE LAX FAMILY THAT REQUEST OR DISCLOSE COMMERCIAL PLANS AND INCLUDE AN ACKNOWLEDGMENT OF CONTRIBUTIONS OF HEN REET AH LAX AND LAX FAMILY IN PUBLICATIONS AND PRESENTATIONS AND GENOME SEQUENCE DATA BE DEPOSITED INTO DB GAP. WHAT WORKING GROUP DOES ESSENTIALLY IS EVALUATE REQUESTS FOR THE DATA WITH THAT DATA USE AGREEMENT TO SEE IF IT IS IN FACT CONSISTENT. THIS IS NOT A REPEAT OF PEER REVIEW AND THIS IS NOT SCIENTIFIC ASSESSMENT BUT CONSISTENCY WITH PRINCIPLES OF DATA USE AGREEMENT AND REPORT EVALUATIONS TO YOU WHICH IS WHAT IS HAPPENING RIGHT NOW AND TO MAKE RECOMMENDATIONS POTENTIALLY IF THERE ARE TERMS THAT NEED TO BE ADJUSTED IN THE DATA USE AGREEMENT. THIS IS THE WORKING GROUP ROSTER AND AS FRANCIS MENTIONED WE ARE MRIF LEDGED TO HAVE MEMBERS OF THE LAX FAMILY SITTING AT THE TABLE WITH US TO WORK ON THESE AND THEY ARE ACTIVELY ENGAGED WITH THESE REQUESTS AND IT IS TRULY WONDERFUL AND I WANT TO MENTION THE ROLE PLAY BY EXECUTIVE SECRETARY. EXEC SECS OF ACD WORKING GROUPS ARE ENORMOUSLY IMPORTANT WE COULDN'T GET WORK DONE WITHOUT THEM KEEP TRAINS RUNNING ON TIME AND LOOKING GOOD. HELA WORKING GROUP AND SHE WAS IN A VERY BAD CAR ACCIDENT THIS WEEKEND SHE IS RECOVERING WE SEND BEST WISHES FOR RECOVERY TO SHERYL OTHERWISE SHE WOULD HAVE BEEN HERE WORKING GROUP USES SET OF CRITERIA RELATIVE TO THE REQUESTS. IT FOLLOWS PRINCIPLES OF AGREEMENT AND I -- THESE ARE THE DETERMINERS OR DETERMINATIONS THAT ARE MADE BASED ON THESE CRITERIA. ESSENTIALLY, THERE ARE SORT OF FOUR DECISION POINTS FOR THE WORKING GROUP TO COME UP WITH THAT EITHER FIND IT CONSISTENT OR INCONSISTENT WITH DATA USE AGREEMENT CONDITIONAL UPON COLLECTION OF ADDITIONAL INFORMATION OR SOMETIMES THEY WILL SAY THAT WE NEED TO HOLD OFF AND FIND THAT ADDITIONAL INFORMATION BEFORE WE CAN MAKE THIS EVALUATION. THIS IS NOT OUR FIRST TIME AT THE RODEO. THIS WORKING GROUP HAS BEEN WORK FORGE QUITE SOME TIME AND HAVE EVALUATED 84 REQUESTS AND WE ARE BRINGING FOUR NEW REQUESTS TO THE ACD TODAY. I WILL NOTE THAT IN FACT THIS IS NOT A RUBBER STAMP. WE DO SOMETIMES DISAPPROVE REQUESTS AND NIH DIRECTOR DISAPPROVES REQUESTS IF NOT FOUND CONSISTENT WITH DATA USE AGREEMENT. TO NOTE THIS IS TINY TEXT YOU HAVE AVAILABLE IN YOUR PACKETS AS WELL. THE LIST OF WHOLE GENOME SEQUENCE DATA HAS BEEN DEPOSITED IN DB GAP CONSISTENT WITH THE LAX FAMILY. BEFORE WE GET TO THE BUSINESS AND ASK OF YOU FRANCIS MENTIONED THAT I WANT TO NOTE AS OF TODAY THAT WE HAVE RULED OUT A NEW INTERACTIVE WEB RESOURCE TO REALLY HIGHLIGHT THE CONTRIBUTIONS OF HELA CELLS TO BIOMEDICAL RESEARCH. WE ARE EXCITED ABOUT THE NEW WEBSITE WHICH HAS A LOT OF REALLY SORT OF BEAUTIFUL VISUALS TO HELP DEMONSTRATE THE INCREDIBLE CONTRIBUTION OF HELA CELLS TO VAST ARRAY OF DIFFERENT AREAS IN BIOMEDICAL RESEARCH I ENCOURAGE EVERYBODY TO TAKE A LOOK AT NICE TIMELINE. THERE IS AN INTERACTIVE WORLD MAP AND IT DEMONSTRATES HOW IMPACTFUL THE CELLS HAVE BEEN ON BIOMEDICAL RESEARCH. IT IS PRETTY EXTRAORDINARY. ON TO BUSINESS, THE WORKING GROUP EVALUATED FOUR EVALUATIONS OR FOR ACCESS REQUESTS IT SAYS TWO AT THE TOP A LITTLE BIT OF A TYPOTHERE AND THEY FOUND ALL FOUR OF THE REQUESTS CONSISTENT WITH DATA USE AGREEMENT AND ACD MEMBERS HAVE ADDITIONAL INFORMATION ABOUT THESE REQUESTS IN THEIR PACKETS. WE ARE BRINGING THESE EVALUATIONS TO YOU TO ASK FOR YOUR CONCURRENCE WITH THE REQUESTS. I WILL TURN IT OVER TO SPERO TO SEE IF YOU HAVE ANYTHING TO ADD. >> SPERO MANSON: BEFORE WE SOLICIT A MOTION TO APPROVE AND VOTE ON IT I WILL UNDERSCORE SOMETHING YOU ARE PROBABLY AWARE OF JANUARY 29 ISSUE OF SCIENCE MAGAZINE -- PUBLIC GENOMIC DATA. I THINK THAT THE FWHAGSAL INSTITUTES OF HEALTH HAS TWO REMARKABLE EXAMPLES AMONG MANY THAT SPEAK TO AND AMPLIFY LETTER SUBMITTED TO GROUP BY US IN RESPONSE TO ARTICLE THAT IS IN PREPARED BY THAT GROUP THAT ILLUSTRATE MAJOR MODELS WE HAVE AVAILABLE TO US IN TERMS OF GOING BEYOND THE RATHER UNFETED RESTRICTIONS THAT THOSE AUTHORS HAD RECOMMENDED IN JANUARY OF 2019 I THINK THAT OLIVIS RESEARCH PROGRAM IS ONE OF THOSE AND HEN REET AH LAX IS ANOTHER ONE OF THOSE THEY ARE BOTH FOCUSED ON M- ETHICS AND ACCESS AND APPROPRIATE QUESTION OF DATA. I WANT TO UNDERSCORE WHAT A PRIVILEGE IT HAS BEEN TO BE PART OF THIS SERIES OF CONVERSATIONS AND ILLUSTRATE THE FACT IT IS NOT UNIQUE TO MANY THINGS BEING DONE BY NIH AND HOPEFULLY IT WILL SERVE AS A GUIDE FOR FUTURE WORK IN THIS AREA. >> FRANCIS S. COLLINS: THANK YOU SPERO ARE THERE QUESTIONS ABOUT THE FOUR PROPOSALS REVIEWED BY WORKING GROUP AND FELT -- PUT FORWARD FOR YOUR POSSIBLE APPROVAL? YOU HAVE IN YOUR BOOKS IN DETAIL WHAT THE SCIENTIFIC QUESTIONS ARE FOR EACH OF THE FOUR PROJECTS TRY TO AIM TO PROCEED WITH. SHELLY? >> I'M CURIOUS ABOUT THE CURATION OF THE DATA AND GIVEN QUESTIONS THAT HAVE COME UP ABOUT SO LINE INTEGRITY HOW IS THIS BEING -- I KNOW IT IS NOT RELATED TO THE SPECIFIC PROPOSALS BUT WONDERING IN GENERAL HOW THAT IS BEING DONE FOR HELA SO LINE? >> GREAT QUESTION, SHELLY. LOTS OF ANALYSIS WERE DONE A WHILE BACK WITH DIFFERENT ISOLATES OF HELA CELLS MANY HAD BEEN CARRIED OVER MANY, MANY YEARS IN LABORATORIES AND NOT NECESSARILY THEREFORE EXPECTED TO BE QUITE THE SAME. IT WAS ACTUALLY QUITE GRATIFYING TO SEE THE STRONG RELATIONSHIPS AND SIMILARITIES BETWEEN DIFFERENT ISOLATES MANY OF WHICH HAD BEEN SORT OF NEXT TO EACH OTHER FOR A LONG TIME. DESPITE THE FACT IT IS OBVIOUS WILL I AN ANNU MROID CELL LINE WITH LOTS OF THE ABNORMALITIES THAT MIGHT BE GENERALLY STABLE YOU MIGHT BE ABLE TO SAY THIS MORE EXPLICITLY AND ACCURATELY AS I AM YOUR LAB DOES SOME OF THE ELEGANT ANALYSIS. >> YEAH. THE THING I DON'T KNOW BUT SUSPECT THE ANSWER. THERE ARE DIFFERENCES. RIGHT? THEY ARE NOT AS DIFFERENT AS I THINK ONE MIGHT BE LED TO BELIEVE KIND OF BY THE PRESS CHARACTERIZATIONS OF IT BUT THERE ARE QUITE AN AMAZING RANGE OF GENOMIC AND EPIGENETIC ANALYSIS BEING DONE WE COLLECTIVELY SETTLED ON ONE PARTICULAR SUBLINE TO FOCUS ON. I WISH THERE WAS GREATER CONSENSUS ON IT IT WOULD MAKE LIFE EASIER ON THE BACK END BUT RIGHT. YEAH. >> FRANCIS S. COLLINS: CARRIE ANYTHING ELSE TO SAY ABOUT THE ISSUE. >> CARRIE WOLINETZ: I THINK WE COVERED IT. >> FRANCIS S. COLLINS: THIS IS WHERE WE NEED A VOTE. CAN I ASK FOR A MOTION? >> SO MOVED. >> FRANCIS S. COLLINS: MOVED FROM MAN CIS AND SECOND FROM CHRISTINA ALL IN FAVOR RAISE YOUR HAND AND SAY INTO THE MICROPHONE SO PEOPLE ON THE PHONE CAN HEAR. ALL RIGHT MOTION CARRIES THANK YOU VERY MUCH. YES. SOMEONE APPROACHED THE MICROPHONE. >> YES. I'M SHEF ON WES CO A MEMBER OF THE WORK GROUP ON WORKFORCE DIVERSITY AND ENCOURAGED TO SEE THERE WAS GOING TO BE A WEBSITE ON CONTRIBUTIONS OF HELA CELLS AND IT WOULD BE NICE TO TAKE IT TO THE NEXT LEVEL TAKE A FEW STORIES PEOPLE THAT HAVE BEEN IMPACTED IN LIVES AND IMPROVED BECAUSE OF RESEARCH DONE THOSE THAT WORK I'M AN AMERICAN INDIAN IN COMMUNITIES OF COLOR WHERE THERE IS A DISTRUST OF RESEARCH TAKING IT TO THE NEXT STEP WOULD BE REALLY HELPFUL FOR US THANK YOU. >> FRANCIS S. COLLINS: GREAT SUGGESTION. DOCTOR IS NODDING WE WILL SEE WHAT WE CAN DO TO THE WEBSITE TO CREATE A HUMAN IMPACT IMPRESSION FOR DIVERSE AUDIENCES AMAZINGLY ENOUGH WE ARE AT 1217 AND SEEMED TO ACCOMPLISH MORNING'S EFFORTS WE NEED A PHOTOOF ACD MEMBERS AND PHOTOGRAPHER IS HERE. I'M NOT QUITE SURE. CHARLIE WHERE DO YOU WANT US UP THERE? LET'S TURN THE PROJECTOR OFF SO WE ARE NOT STANDING IN FRONT OF BLINDING WHITE LIGHTS AND GATHER UP THERE IF YOU WOULD FOR PHOTOGRAPH AND WE WILL ADJOURN FOR LUNCH AND RETURN AT 1:15. I HOPE YOU GOT A BRIEF BREAK THERE. YOU WILL NEED ALL OF THE ENERGY THAT THIS GROUP POSSESSES AS WE MOVE INTO THE AFTERNOON. WE HAVE SOME VERY IMPORTANT TOPICS BEGINNING RIGHT NOW WITH THE ACD WORKING GROUP ON DIVERSITY. THIS INCLUDES ROY WILSON AND HANNAH VALANTINE BUT ALSO A NUMBER OF OTHER MEMBERS WHO ARE WITH US. AT IT THIS POINT, I WILL TURN THE MEETING OVER TO HANNAH VALANTINE WHO CAN INTRODUCE SOME OF THE OTHER MEMBERS AND LEAD US THROUGH THE DISCUSSION. DR. VALANTINE. >> THANK YOU, FRANCIS. GOOD AFTERNOON, EVERYBODY. BEFORE I GET TO MY PRESENTATION, I WOULD LIKE TO TAKE A FEW MOMENTS TO ACKNOWLEDGE THE CURRENT ACD WORKING GROUP ON DIVERSITY WHICH IS A GROUP WITH EXTRAORDINARY TALENT AND LOTS OF HOURS AND WORK TO MAKE SURE WE ARE HEADED IN THE RIGHT DIRECTIONS NOT ONLY FOR IMPLEMENTING THE ORIGINAL ACD RECOMMENDATIONS BUT FOR LOOKING CRITICALLY AT WHAT WE ARE DOING IDENTIFYING GAPS AND MOVING FORWARD WE WERE ENGAGED IN A WONDERFUL HALF DAY BRAINSTORMING SESSION YET. WE HAVE TO GO BACK AND INGEST ALL IT THAT WE LEARNED. I WILL PRESENT THE DELIBERATIONS OF THOSE AT THE NEXT ACD MEETING. FOR THE MOMENT, I WOULD LIKE TO TAKE A MOMENT TO ACTUALLY RECOGNIZE THOSE THAT ARE HAD HERE. SO WOULD YOU MIND JUST STANDING WHEN I CALL YOUR NAME AND STAY STANDING AND WE WILL RECOGNIZE YOU. EDWIN BERERA RODRIGUEZ. FLOR ENSTEENA PAYTON STOOU WORT. GEORGE HILL. [INDISCERNIBLE] ALL THE WAY FROM HAWAII. WE PROMISED TO VISIT HER THERE. I TOLD HER THE FEDERAL POLICIES WOULD PROHIBIT THAT. HILDA HUTCHINSON AND RAY NISHI AFRND SHARON BLACKAND [INDISCERNIBLE] WES COT AND STEVE BERN ET AND TAL EEPA WILLIAMS. THANK YOU FOR YOUR SERVICE. >> AUDIENCE: [APPLAUSE] . >> PARTICULARLY THE WORK WE DO AND PARTICULARLY ALISON GAMY WHO RUNS THE DIVISION FOR WORKFORCE DIVERSITY AND IN THE OER MYCLOUER AND KATRINA PIERSON'S TEAM AND OF COURSE OURFAIRLESS MINITEAM WITHIN SCIENTIFIC WORKFORCE DIVERSITY SHARLENE DAI FEW AND [INDISCERNIBLE] THE PURPOSE OF THIS PRESENTATION, THE MAJOR PURPOSE OF THIS PRESENTATION IS TO PRESEN TO YOU DATA THAT ATTEMPTS TO ANSWER THE QUESTION HAS ANYTHING CHANGED? WHERE ARE WE? ARE WE SEEING ANY PROGRESS? THE WAY I WOULD LIKE TO DO THIS IS TO FIRST LAY OUT SOME OF THE RECOMMENDATIONS FOR THE ORIGINAL ACD GROUP IN 2012 THAT WILL SET THE STAGE AND IN PARTICULAR, I WILL SHOW YOU SOME OF THE RATHER ALARMING DATA THAT, THAT GROUP WAS LOOKING AT, AT THE TIME THAT LED THEM TO RECOMMEND THAT THIS OFFICE BE CREATED. IT IS TO DO WITH DATA AROUND THE APPLICATIONS AND THE NATIONAL DATA AND THE FUNDING, ET CETERA. I WILL SHOW YOU THAT. I WILL SHOW YOU WHERE WE ARE. I BELIEVE THAT IT IS GOOD NEWS. I HOPE I'M NOT BEING OVER OPTIMISTIC, BUT I WILL LET YOU BE THE JUDGE. I WILL TALK A LITTLE BIT ABOUT 2018 RECOMMENDATIONS IN WHERE WE ARE WITH IMPLEMENTING THOSE. SO HERE ARE SOME OF THOSE DATA THAT THE ORIGINAL ACD WERE LOOKING AT IN THE WAKE OF THE GIN THER REPORT. YOU WILL REMEMBER THE BEGIN THER REPORT THAT WAS PUBLISHED IN SCIENCE IN 2011 INDICATING THE PROBABILITY OF AN AFRICAN-AMERICAN SCIENTIST WHO WAS APPLYING FOR AN RO1 GRANT. THE PROBABILITY OF THAT PERSON GETTING THE GRANT WAS SIGNIFICANTLY LOWER THAN ANY OTHER GROUP. THE ACD CHARGED BY DR. COLLINS TOOK THIS EXTREMELY IMPORTANT VIEW AND THEY TOOK A MUCH BROADER VIEW INTO THE PROBLEM. HERE IS WHAT THEY WERE SEEING. NATIONAL DATA INDICATED VERY SMALL NUMBERS OF PHD RECIPIENTS IN STEM. IN FACT, THAT NUMBER OF 504 EACH YEAR IS SEERED IF IN THE MINDS OF MOST OF US. 504. THEY ALSO NOTED VERY CLEARLY THAT FOR RESEARCH GRANTS AND THIS WAS THE CONTENT OF THE GINTHER REPORT THAT THE PERCENTAGE OF APPLICATIONS COMING FROM AFRICAN-AMERICANS WAS MINISKUL, 1.3% OF THE THOUSANDS OF APPLICATIONS THAT COME IN EACH YEAR, SIMILARLY FROM HISPANIC INVESTIGATORS ONLY THREE.4. OF COURSE, AWARDS RATE SHOWN HERE WAS MINISKUL LESS THAN 1% AND LESS THAN 2.5% FOR HISPANIC AND THEY TOOK A DIVE INTO K AWARDS DEVELOPMENT AWARDS WHICH IS PENULTIMATE STAGE BEFORE YOU GET INTO THE INDEPENDENCE. THIS IS WHAT THEY WERE SEEING, AFRICAN-AMERICANS WERE ONLY 4% OF THOSE AWARDS. HISPANICS, ONLY 5% OF THOSE AWARDS. THEY LOOKED EVEN FURTHER INTO TRAINING AWARDS PREDOCTORAL AND DOCTORAL FELLOWSHIP OKAY AND I'M SURE YOU AGREE THIS IS ALARMING DATA TO BE LOOKING AT. OF COURSE THEY CAME UP WITH 13 RECOMMENDATIONS. IN ORDER TO PROPERLY IMPLEMENT THESE 13 RECOMMENDATIONS, THEY WERE GROUPED INTO FOUR DISTINCT BUCKETS, ACTIVITIES THAT WOULD ADDRESS THE PIPELINE AS LISTED HERE. ACTIVITIES THAT WERE PARTICULARLY FOCUSED ON MENTORING AND BEARING IN MIND THAT WE HAD ALL RECOGNIZE HOW IMPORTANT MENTORING IS PARTICULARLY IN THE CONTEXT OF DEVELOPING A SCIENTIFIC CAREER. A THIRD BUCKET THEY CALLED ATTENTION TO WAS PEER REVIEW AND MADE VERY SPECIFIC RECOMMENDATIONS THAT NIH NEEDED TO LOOK INTO THE PEER REVIEW AND ASCERTAIN WHETHER THERE IS OR WAS BIAS OR NOT. I WON'T SAY ANY OF THAT. I PRESENTED THAT MANY TIMES BEFORE. IT CAN COME UP IF IN THE QUESTION AND ANSWER SESSION. FINALLY, THEY MADE RECOMMENDATIONS INFRASTRUCTURE. REALLY, WHAT THIS IS, IS RECOMMENDATION THAT THERE ARE MANY INSTITUTIONS THAT ARE SEVERELY UNDERSERVED WHICH IS VERY PLACES THAT WE FIND STUDENTS FROM UNDER-REPRESENTED GROUPS. THAT IS WHY WE NEEDED TO INVEST IN INSTITUTIONS SO THEY CAN HAVE THE INFRASTRUCTURE THAT WILL ENABLE THEIR STUDENTS TO BE DEVELOPED IF INTO SUCCESSFUL SCIENCES. LET'S BEGIN TO LOOK AT SOME OF THIS DATA. HERE IS THE RO1 DATA. HERE, YOU WILL SEE THE ALARMING DATA THAT WAS THE CONTENT OF THE GINTHER REPORT WITH AFRICAN-AMERICAN FUNDING RATES OF 17.1% WHICH IS THE PROPORTION THAT IS FUNDED BY THE APPLICANTS. THIS GIVES US A DIFFERENTIAL SUCCESS RATE OF 0.58. WHAT THAT MEANS IS AN AFRICAN-AMERICAN INVESTIGATOR APPLYING FOR AN RO1 GRANT IS 0.58 TIMES AS LIKELY TO GET THAT AWARD. IF THEY WERE EQUALLY LIKELY, IT WOULD BE ONE. IN CONTRAST, WHAT WE SEE HERE IS THAT CURRENTLY IN A NEWER COHORT UP TO 2018, ALTHOUGH THE GAP IN THE FUNDING RATES STILL PERSIFT, IT IS SLIGHTLY NARROWED. NOW WE SEE THIS DIFFERENTIAL SUCCESS RATE IS .63. IF IT IS OR YOU CARE TO DO STATISTICS IT IS STATISTICALLY SIGNIFICANT. IT IS NOT ENOUGH FOR US. THAT GAP STILL PERSIFTS. WE HAVE TAKEN AN EVEN DEEPER DIVE INTO IT BEYOND THE KIND OF ANALYSIS THAT GOOD /* THAT GINFORD ARE THERE PLACES TO BE INTERVENING I DRAW TO YOUR ATTENTION THIS PUBLICATION THAT NOW INDICATES TO US THAT AT LEAST 30% OF THE RESIDUAL GAP IS ACTUALLY EXPLAINABLE BY APPLICANT AND REVIEWER TOPIC PREFERENCE. WE CAN DISCUSS THAT IN A MOMENT. LET'S TAKE A DEEP DIVE A LITTLE BIT INTO THE APPLICANTS AND THE FUNDING RATE FOR RO1 OR RO1 EQUIVALENCE. THE FIRST THING THAT I WOULD LIKE TO DRAW YOUR ATTENTION TO IS LET'S GO BACK ON THAT. IT IS THE MINISKUL NUMBERS OF THE APPLICANTS WHO ARE AFRICAN-AMERICAN SHOWN IN RED. SO IF YOU LOOK AT THE DATA FOR 2013, THERE WERE 425. OF COURSE, WE WANT TO CELEBRATE THAT, OF COURSE, NOW IN 2018, WE HAVE A WHOPPING 28.9% INCREASE TO 548. I WOULD JUST SAY THAT THE NUMBERS ARE STILL SMALL AND THERE IS A LOT OF WORK TO BE DONE IN THAT SPACE. NOW, LET'S LOOK AT THE FUNDING RATE WHICH IS WHAT GINTHER REPORTED. WHAT YOU CAN SEE HERE IS THAT IN 2013, SOON AFTER GINTHER, 12% OF THE APPLICATIONS FROM THE AFRICAN-AMERICANS WERE BEING FUNDED. NOW, WE HAVE 20.6% OF THEM. THAT IS IN THE CONTEXT THAT THE FUNDING RATE HAS GONE UP FOR EVERYBODY. HE DOES REPRESENT A MOVEMENT THAT I WOULD LIKE TO THINK TOWARDS CLOSING THE GAP. THAT PERCENT TO CHANGE IS ABOUT 70%. BECAUSE THE NUMBERS ARE SO SMALL, I WOULD LIKE TO LOOK AT THE ACTUAL NUMBERS. WHAT THAT MEANS IS SHOWN HERE FOR AFRICAN-AMERICAN HISPANIC AWARDEES FOR RO1 EQUIVALENCE. IN 2015, 52 FOR AFRICAN AMERICANS AND IN 2018, IT IS ACTUALLY 113. THAT REPRESENTS AN INCREASE OF OVER 100%. IF WE CONTINUE AT IT THAT RATE, I BELIEVE THAT WE CAN VERY QUICKLY CLOSE THE BACK GAP. LET. IF NOW, LET'S TURN OUR ATTENTION TO THE K SERIES OR THE MENTORED CAREER DEVELOPMENT AWARDS WHICH ARE THE PENULTIMATE STAGE AND NOT WITH STANDING WHAT WE ALREADY KNOW ABOUT THE FACT THAT NOT ALL KS TRANSITION TO R FOR ALL GROUPS LET'S LOOK AND SEE WHAT WE ARE SEEING THESE ARE THE CHANGES FROM 2013 TO 2018. AND, AGAIN, SHOWN IN RED 22% OF THOSE -- OF THE APPLICATIONS FROM AFRICAN-AMERICANS IN 2014 WERE BEING FUNDED. THIS IS THE FUNDING RATE. IN CONTRAST, IF YOU LOOK NOW AT 2018, WE SEE THAT 34% OF THOSE APPLICATIONS FROM AFRICAN-AMERICAN APPLICANTS ARE NOW BEING FUNDED. THAT IS A SIGNIFICANT INCREASE. WHEN YOU DO THE MATH COMPARING DIFFERENCE IN FUNDING RATE, THE 34% FOR AFRICAN-AMERICAN THESE ARE THE 37, IT IS NOT STATISTICALLY DIFFERENT. WE WOULD LIKE IT TO BE THE SAME. I POINT IT OUT TO -- I TAKE IT TO MEAN PROGRESS IS BEING MADE. NOW, LET'S LOOK AT THE ACTUAL NUMBERS. IN TWNT THE2013, IT WAS A WHOPPING 26 AWARDS WERE BEING MADE. NOW, IN 2018, THERE WERE 63. SIMILAR INCREASES FOR HISPANIC APPLICANTS FOR K AWARDS. I THINK THESE ARE REAL INCREASES. THE PIPELINE PATH GOES BEYOND THAT, DOESN'T IT? IT GOES BEYOND TO PREDOCTORAL AND POST DOCTORAL TRAINING GRANTS. WHAT I'M ATTEMPTING TO SHOW YOU HERE IS THAT THE AWARDS THE PROPORTION OF THE AWARDS IT THAT ARE BEING HELD BY UNDER-REPRESENTED GROUPS AS DEFINED HERE HAS INCREASED FROM 12% IN 2012 TO NOW CONSTITUTING 20%. NOT PERFECT. I THINK SOME HEADWAY IS BEING MADE. SIMILARLY, WHEN WE LOOK AT PREDOCTORAL FELLOWSHIPS AND POST DOCTORAL FELLOWSHIPS, WE SEE SIMILAR TRENDS. NOW THAT AMONG THOSE AWARDS, 14% ARE GOING TO TO -- ARE HELD BY UNDER-REPRESENTED GROUP OF INVESTIGATORS COMPARED TO ONLY 10% IN 2012. IT DOESN'T END THERE. THE PATHWAY EXTENDS BEYOND THAT. REMEMBER THE 500 NUMBER? THE INITIAL WORKING GROUP SAW AND NOW THIS IS FROM NSF SURVEY OF EARNED DOCTORATES WHAT YOU CAN SEE HERE THAT I WOULD LIKE TO HIGHLIGHT IT IS RECIPIENT OF PHD OF THE LIFE SCIENCES. YOU CAN SEE THE SIMILAR INCREASES THAT IS OCCURRING IN THAT GROUP. THIS INCREASES IN CHEMISTRY AND MATH THAT IS ALSO RELEVANT TO THE EXTENT THAT WE NOW KNOW THAT THE PHD RECIPIENT POOL EACH YEAR IS ABOUT -- IS IN DISCIPLINES TO NIH RESEARCH THAT IS ABOUT 14% URM. INTERESTING IN THE NUMBER, IT IS ABOUT 3,000. 3,000 PEOPLE AND 3,000 PHDS BEING AVAILABLE EACH YEAR. LET ME TURN MY ATTENTION TO WHAT WE HAVE DONE. I WANT TO SHOW ONE OF THE THINGS THAT CONSTITUTES THE FLAGSHIP PROGRAM FROM NIH THAT OCCURRED IN RESPONSE TO THE ACD RECOMMENDATIONS. THAT IS THE DIVERSITY, CONSORTIUM PROGRAM AND IMBEDDED IN IT WAS A RESPONSE FOR BETTER TRACK IING. >> I'M SORRY FOR THE INTERRUPTION YOUR CONFERENCE CONTAINS LESS THAN THREE PEOPLE AT THIS TIME. >> THAT IS TOO BAD. >> >> AUDIENCE: [LAUGHING]. >> SO DIVERSITY, THE DIVERSITY CONSORTIUM PROGRAM WAS LAUNCH IN 2014 JUST AFTER MY ARRIVAL HERE. I HAVE TO ADMITT I WAS A DEER IN THE HEADLIGHTS AT THE TIME HAVING TO GRAPPLE WITH ALL OF THIS. IT IS ESSENTIALLY AN EXTRAORDINARY INNOVATIVE APPROACH FOR DOING THIS WORK. IT SET OUT FOR US FOR THE FIRST TIME EVER TO DO THIS WORK, THESE INTERVENTIONS IN A DATA-DRIVEN WAY. AND IT ALSO INCORPORATED THAT IDEA THAT THESE AWARDS WERE GOING TO GO TO RELATIVELY UNDERSERVED INSTITUTIONS. SO TO GET A -- ONE OF THE BILLED AWARDS WHICH STANDS FOR BUILDING INFRASTRUCTURE LEADING TO DIVERSITY. INSTITUTION HAD TO HAVE RECEIVED LESS THAN $7.5 MILLION IN RESEARCH FUNDING AND HAVE 25% OF ITS STUDENTS PAL GRANT ELIGIBLE. WE ALSO ASKED THEM TO COME UP WITH SOME RIGOROUS DESIGN OF WHAT THEY WEE PROPOSING TO DO. YOU CAN SEE THE RANGE OF THE TYPES OF INSTITUTIONS THAT WERE FUNDED IN RECOGNITION OF THE FACT THAT CULTURE AND INSTITUTION MATTERED. ONE KIND OF PROGRAM FROM ONE INSTITUTION MAY NOT NECESSARILY WORK IN ANOTHER, BUT THEY HAD TO DESIGN THEIR INTERVENTIONS WITH CONTROL GROUPS RATHER THAN LIKE A CLINICAL TRIAL. HERE ARE THE LIST OF THE TEN INSTITUTIONS IT THAT WE HAVE TALKED ABOUT IT BEFORE IN THIS CONTEXT. HERE ARE SOME OF THE IDEAS AND THE FRAMEWORK OF THE RESEARCH OF WHAT THEY WERE GOING TO BE TESTING STEREOTYPE THREAD AND CRITICAL RACE THEORY AND OTHERS. SECOND COMPONENT OF THIS IS NATIONAL MENTORING NETWORK. IN THIS -- AND THEN THIRDLY, THE CENTER FOR EVALUATION AND COORDINATION. AND THE NATIONAL MENTORING NETWORKS WERE CRITICAL BECAUSE THEY CHALLENGE SOME ONGOING IDEAS OF MENTORING. FOR EXAMPLE, THE IDEA THAT JUST BECAUSE YOU ARE A SUCCESSFUL SCIENTIST, IT MEANS YOU ARE A GOOD MENTOR. THAT IDEA WAS CHALLENGED BECAUSE THEY CAME UP WITH WAYS OF TRAINING MENTORS IN A WAY THAT EVERYBODY WOULD BE ON THE SAME PAGE. IN ADDITION, I WOULD LIKE TO POINT OUT SOMETHING ELSE IT THAT WAS DONE THERE IS THESE PROGRAMS FOR EDUCATING AND COACHING PEOPLE TO BE ABLE TO WRITE A MORE COMPETITIVE GRANT AWARD. I WILL SHOW YOU SOME OF THE OUTCOMES OF THOSE IN A MINUTE. THE PROGRAM IS STRUCTURED IN TWO PHASES. IT IS SUPPORTED BY THE COMMON FUND ADMIRABLY FANTASTIC AND THE SECOND PHASE IS BEGINNING AS WE SPEAK. NOW, THIS IS A SNIPPET WHAT HAPPENED THERE UP TO DATE. I FIRSTLY WANT TO POINT OUT THE EXTRAORDINARY VISION THAT WENT INTO STRUCTURING WHAT IT IS THAT WE ARE ACTUALLY GOING TO MEASURE. THE IDEA HERE IS IT THAT WE WOULD HAVE OUTCOMES THAT ARE RELATED TO THE STUDENT. WE WOULD HAVE OUTCOMES RELATED TO THE FACULTY. VERY IMPORTANTLY, WE WANTED TO SEE INSTITUTIONAL CHANGE. THAT IS BEING MEASURED. OVERALL, WE CAN SEE THAT OVER 2,000 STUDENTS HAVE HAD THE FULL IMPACT OF THE BUILD AWARDS. THAT IS THEY HAVE ACTUALLY BEEN FUNDED AND THEY HAVE HAD THE MENTORING. I WOULD LIKE TO POINT OUT THAT MANY OTHER STUDENTS ARE ACTUALLY BEING TOUCHED BY THE BUILD PROGRAMS. HERE IS JUST TO SHOW YOU THE DEMOGRAPHIC DATA AROUND THE STUDENTS WHO HAVE HAD THE FULL BUILD EXPERIENCE. I SHOW YOU THIS BECAUSE THE DEFINITION FOR PARTICIPATION WAS NOT STRUCTURED AROUND ANY RACE IDENTITY. WE WILL COME BACK TO THAT. THE WAY IT THAT YOU STRUCTURE THESE PROGRAMS CAN ACTUALLY GET YOU TO WHERE YOU WANT TO WITH TERMS OF DIVERSITY. YOU CAN SEE HERE SOLID REPRESENTATION OF HISPANIC AND SOLID REPRESENTATION OF AFRICAN-AMERICAN. LET ME JUST MENTION BRIEFLY WHAT WE ARE SEEING FROM THOSE GRANT-WRITING AND COACHING SESSIONS. THEY ARE ACTUALLY 6 DIFFERENT PROGRAMS THAT VARY IN TERMS OF THEIR FOCUS AND WHAT THEY DO AND THE KINDS OF GRANTS THAT THEY DEAL WITH. OVER 500 PARTICIPANTS HAVE -- PEOPLE HAVE PARTICIPATED IN THESE PROGRAMS. WE ARE SEEING THAT MANY OF THEM HAVE BEEN AWARDEAWARDED. 89 OF THEM. I SHOULD PUT THEIR DEMOGRAPHIC DATA THERE. THE OVERALL AWARDS ARE 152. VERY IMPORTANTLY IS THAT THIS IS RESULTING IN QUITE SOME MORE FUNDING GOING TO THESE INDIVIDUALS. HERE IS A BREAKDOWN OF THIS. I WON'T READ IS IT TO YOU. IT IS IN YOUR PACKAGE TO SHOW YOU REALLY THAT THERE ARE DIFFERENT KINDS OF AWARDS THAT ARE BEING COACHED AND ARE BEING COACHED EFFECTIVELY TO WRITE THESE GRANTS AN TO BE SUCCESSFUL. HERE IS SOME OF THE DEMOGRAPHIC DATA IN THE RS. THERE IS AWARDS OF 45% OF URM. HERE IN THIS SLIDE, THERE IS A MORE DETAILED BREAKDOWN OF THE KINDS OF AWARDS. I WILL LET YOU MUSE OVER THAT IN DUE COURSE. THE IMPORTANT DATA IS OVER HERE THAT 89 HAVE RECEIVED AWARDS OF WHICH 70 HAVE GONE TO URM CANDIDATES THANKS TO ALISON GAMY AND JOHN [INDISCERNIBLE] HERE IS THE COMPLETED TIMELINE. WE COMPLETED PHASE I OF THIS WORK. YOU CAN SEE THERE IS TREMENDOUS RUN UP IN THE FIRST YEAR GETTING PEOPLE ON BOARD TO ACTUALLY DEVELOP THEIR PLANS AND TO IMPLEMENT. I THINK IT IS RATHER OPTIMISTIC TO BE SEEING ANY OUTCOMES AT THIS POINT EVEN THOUGH I KNOW FRANCIS AND LARRY ARE ALWAYS IMPATIENT AND ASK US CONTINUALLY WHAT IS IT SHOWING? WHAT IS IT SHOWING? >> AUDIENCE: [LAUGHING]. >> YES, YOU DO. >> AUDIENCE: [LAUGHING]. >> SORRY TO PUT YOU ON THE SPOT. >> AUDIENCE: [LAUGHING]. >> AND IN PHASE II, WE WILL SEE THE FRUITION OF ALL OF THIS. NOT ONLY WILL WE SEE WHAT HAS HAPPENED TO THOSE PEOPLE WHO WERE RECRUITED IN PHASE I, BUT I THINK EVEN MORE IMPORTANTLY, WE WILL SEE HOW THIS CAN BE DISEMANATED TO OTHER INSTITUTIONS. HERE IS SOME DATA THAT WE ARE BEGINNING TO SEE. I MENTION THAT IMBEDDED IN THIS PROGRAM IS THE CENTER FOR EVALUATION AND COORDINATION; OTHERWISE, CALLED THE CEC. WHAT THAT CENTER DOES IS TO PULL ALL OF THE DATA FROM ALL OF THE SITES DOING BUILD IN ADDITION TO PULLING DATA FROM NONBILLED SITES SO THEY CAN COMPARE SOME OUTCOME METRICS. THIS IS A SIMPLE ONE THAT IS CALLED SCIENCE IDENTITY. IT HAS BEEN KNOWN FOR A LONG TIME IN THE LITERATURE THAT YOU CAN ACTUALLY HAVE SURVEYS TO EVALUATE AN INDIVIDUAL SCIENCE IDENTITY. THE MORE OF THIS SCIENCE IDENTITY THAT YOU HAVE, THE MORE RESILIENT YOU WILL BE AND MORE LIKELY YOU WILL BE TO STAY IN SCIENCE. REALLY, ALL THIS IS SHOWING IS COMPARING BILL SIDES IN BLUE WITH NONBILL SIDES. YOU CAN SEE THE MEASURE OF SCIENCE IDENTITY BEING GREATER. THAT IS A QUICK READ-OUT THAT WE WILL BE SEEING A LOT MORE ABOUT THAT. LET ME TAKE THE LAST FEW MINUTES TO TALK A LITTLE BIT ABOUT THE -- GOING FORWARD AND THE 2018 RECOMMENDATIONS THAT HAS COME OUT OF THIS DISTINGUISHED GROUP THAT I INTRODUCED YOU TO WHO HAVE TAKEN A LOOK AT ALL OF THIS THAT WE HAVE BEEN DOING AND SAID, WELL, HERE ARE SOME REMAINING THINGS THAT WE SHOULD BE DOING. FIRST OF ALL, THEY IDENTIFIED TRACKING AN EVALUATION AS SOMETHING THAT IS CRITICALLY IMPORTANT AND THAT WE COULD BE DOING BETTER. THAT IS ABSOLUTELY CORRECT. WE HAVE ADOPTED OR WE ARE TRYING TO IMPLEMENT A SYSTEM WITHIN NIH CALLED RESULTS-BASED ACCOUNTABILITY IN WHICH YOU TRACK YOUR METRICS ON THREE LEVELS. THE FIRST IS ARE YOU ACTUALLY DOING WHAT YOU SAID YOU ARE DOING? HOW MANY OF THE TRAININGS ARE YOU DOING, ET CETERA? THE SECOND IS WHAT IS THE IMPACT OF THE INDIVIDUAL STRATEGY? FOR EXAMPLE, IMPLICIT BIAS AS THAT HAVING ANY IMPACT. THE THIRD IS WHEN YOU PUT IT ALL TOGETHER, IS IT ULTIMATELY EFFECTING THE DEMOGRAPHIC? THE BEAUTY OF THIS IS WE ARE CREATING A SHARED PLATFORM THAT INSTITUTES AND ULTIMATELY DIFFERENT INSTITUTIONS CAN USE TO BE ABLE TO BE TRANSPARENT ABOUT THEIR DATA AND HAVE SOME DIALOGUE AROUND IT. WATCH OUT FOR MORE TO COME. THE SECOND AREA THAT THIS GROUP POINTED OUT WAS TO THIS TRANSITION FROM A TRAINING INTO CAREER INDEPENDENCE AS BEING A CRITICALLY IMPORTANT AREA. THEY PUSHED US TO THINK ABOUT IT. WE HAVE COME UP WITH A PLAN THAT WE ARE CALLING THE FACULTY INSTITUTIONAL RECRUITMENT FOR SUSTAINABLE TRANSFORMATION OR FIRST AAPOLOGIESES I'M A CARDIOLOGIST AND WE LOVE ACRONYMS. THAT CAME UP. I'M WILLING TO CHANGE THAT. THEN THEY ALSO SUGGESTED IT WAS TIMELY AND THAT WE DO A NATIONAL CONFERENCE AND WE HAVING A MINI ONE OF THOSE LATER ON IN THIS MONTH THAT WILL SET THE STAGE FOR A LARGER ONE. FINALLY, THE DIVERSITY SUPPLEMENTS, WE TALKED A LITTLE ABOUT THAT THE LAST TIME. WE WILL GET BACK TO THAT. CREATING THESE IN A WAY THAT THE -- SO THAT THEY ARE MORE ORGANIZED MAY BE IMBEDDED COHORT MODELS WITHIN IT. AS IT TURNS OUT DIVERSITY PEOPLE ON DIVERSITY SUPPLEMENTS ARE DOING EXTREMELY WELL IN TERMS OF BEING RETAINED IN SCIENCE. I WANTED TO TAKE A MOMENT TO UNDERSCORE FOR YOU WHY IT IS THAT WE ARE FOCUSED ON THIS TRANSITION FROM THE TRAINING IF INTO THE CAREER AND WHY IT IS THAT WE ARE DEVELOPING THIS COHORT MODEL THAT WE HAVE REALLY BEEN PROMULGATING. WHAT YOU SEE HERE IS THE GROWTH IN THE PHD RECIPIENT POOL IN THE SOLID LINES FROM THE UNDER-REPRESENTED GROUPS TO [INDISCERNIBLE] -- PACIFIC ISLANDER. IN CONTRAST, LOOK AT THEIR HIRING IN THE DOTTED LINE INTO ASSISTANT PROFESSOR. A HUGE GAP THAT IS NOT PRESENT WHEN WE LOOK AT THE MAJORITY OF THE WELL-REPRESENTED GROUP THAT IS TO SAY CAUCASIAN AND ASIAN AMERICAN. IT IS AS THOUGH TWO SYSTEMS TRAINING AND HIRING ARE TOTALLY UNCOUPLED. I WILL POINT OUT TO YOU THIS DATA -- THIS RESEARCH WAS DONE BY KENNY GIBBBS WHO IS OUR COLLEAGUE HERE AT NIHS. THIS DATA, WE HAVE DONE SO FOR THE INTRAMURAL PROGRAM. LAST YEAR, WE LAUNCHED THE DISTINGUISHED SCHOLAR PROGRAM THAT IS A COHORT MODEL WHICH IS WHOSE GOALS ARE FOR INSTITUTIONAL TRANSFORMATION BY RECRUITING A SUBSTANTIAL NUMBER OF PRINCIPLE INVESTIGATORS WHO HAVE DEMONSTRATED COMMITMENT TO INCLUSIVE EXCELLENCE. NOTICE IT IS NOT GEARED FOR ANY IDENTITY GROUP IN PARTICULAR. BUT WHEN WE CALL IT OUT IN THAT WAY, THE POOL BECOMES ENRICHED FOR WOMEN AND UNDER-REPRESENTED GROUPS. MOREOVER, IT BYPASSES THAT RISK OF STIGMA THAT IS OFTEN ASSOCIATED WITH THIS CREATING OF A PROGRAM LIKE THIS. WHAT WE HOPE IS IT WILL CREATE A SELF-RE-ENFORCING COMMUNITY OF PIS COMMITTED TO DIVERSITY INCLUSION THAT IS CRITERIA AND PROVIDE PROFESSIONAL DEVELOPMENT THAT THEY GO THROUGH TOGETHER AS A COHORT. WE LEARNED HOW THAT WORKS, NETWORKING. HERE WE ARE WITH THE FIRST GROUP THE KICKO- UP WITH FRANCIS RIGHT IN THE MIDDLE THERE. MY GOD! I'M WEARING THE SAME DRESS! >> AUDIENCE: [LAUGHING]. >> FRANCIS S. COLLINS: AND I'M WEARING THE SAME TIE, SO IT IS OKAY. >> AUDIENCE: [LAUGHING]. >> OOPS. DENNIS, WHAT HAPPENED? HOW DID YOU LET ME LEAVE THE HOUSE LIKE THAT? >> AUDIENCE: [LAUGHING]. >> ANYWAY, WE THINK IT WILL SEND A MESS ATH THAT NIH REALLY VALUES COMMITMENT TO INCLUSIVE EXCELLENCE. HERE ARE FEATURES ABOUT THE PROGRAM. IT WILL ADDRESS THIS GAP. IT IS AN INTEGRATED APPROACH. THIS HAS TO BE CONDUCTED NOT IN ISOLATION, BUT WITH ALSO SOME STRATEGIC APPROACHES TO CHANGE THE CULTURE. I THINK IF YOU JUST DID THIS WITHOUT THE APPROACHES TO CHANGE THE CULTURE, YOU WON'T REALLY GET VERY FAR. YOU WILL GET THAT REVOLVING DOOR. THOSE ARE IMPORTANT AREAS THAT ARE IN RECRUITMENT AND IMPLEASITY BIAS, EDUCATION, ET CETERA. AND EQUITY. THIS IS WHAT IT WILL DO. I MENTIONED ALL THAT. FIRST, WE THINK IT WILL BE FIRST NATIONWIDE ATTEMPT INCLUSIVE EXCELLENCE THROUGH NIH FUNDED INSTITUTIONS. LET ME SUMMARIZE. I WILL LEAVE THE SLIDE UP. I TOLD YOU IN THE BEGINNING IT THAT THE MAJOR PURPOSE OF THE PRESENTATION WAS TO ANSWER THE QUESTION: IS PROGRESS BEING MADE? I SHOWED YOU DATA AROUND RESEARCH GRANTS AND HOW THERE IS A NARROWING OF THE GAP. I HAVE ACTUALLY POINTED OUT THERE IS A PERSISTING GAP. EVEN MORE IMPORTANTLY IS THAT THE NUMBERS THAT ARE APPLYING, THAT IS TO SAY THE NUMBERS WHO ARE FACULTY ARE NOT LARGE ENOUGH TO MAKE A BIG DIFFERENCE, HENCE THE COHORT MODEL. I ALSO TOLD YOU ABOUT MENTORED CAREER DEVELOPMENT AND PENULTIMATE STAGE WHERE WE ARE SEEING ALMOST COMPLETE NARROWING OF THE GAP AND WE ARE SEEING PROGRESS IN PREDOCTORAL AND POST DOCTORAL FELLOWSHIPS AND ON A NATIONAL SCHEDULE WE ARE SEEING CHANGES RAPID RISE NUMBER OF PEOPLE RECEIVING PHDS IN DISCIPLINES RELEVANT TO NIH RESEARCH. LET ME LEAVE YOU WITH THIS THOUGHT WHY DO WE DO ALL THIS? IT IS BECAUSE RATHER -- SUPPOSED TO THE USUAL ADAGE THAT GREAT MINDS THINK ALIKE WE ACTUALLY THINK GREAT MINDS THINK DIFFERENTLY. THANK YOU FOR YOUR ATTENTION. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: HANNAH, THANK YOU VERY MUCH FOR PRESENTATIONS. PR THERE IS PROGRESS THAT IS BEING MADE I WILL TURN TO ROY WHO IS CO-CHAIR TO SEE WHAT HE HAS TO CONTRIBUTE TO THIS. >> THANK YOU. WE HAD A VERY ROBUST MEETING YESTERDAY. IT IS NICE TO SEE LOTS OF THE NEW MEMBERS OF THE TASK FORCE. WE ALSO HAD A NUMBER OF MEMBERS FROM THE ORIGINAL TASK FORCE EITHER IN PERSON OR ON THE PHONE. . JOSE WAS ON THE PHONE AS WELL AS RAY TUXON AND THERE WERE ONE OR TWO OTHERS. BEING ONE OF THE -- IN FACT BEING THE ONLY PERSON ON THE ORIGINAL TASK FORCE AND ON THIS NEW ONE, I CAN CERTAINLY SENSE THE DIFFERENCE IN THE MOOD AND IN THE SENSE OF HOPEFULNESS SOMETHING IS HAPPENING. I THINK DATA BEARS OUT THERE CERTAINLY IS PROGRESS BEING MADE. ON THE OTHER HAND, THERE IS STILL WAY, WAY, WAY MORE TO DO. WE CAN'T GET COMPLACENT. THERE IS CERTAINLY ONE GROUP THAT SEEMS TO BE ABSOLUTELY NO PROGRESS BEING MADE ON IS AFRICAN AMERICAN MALES GOING INTO BOTH MEDICINE AND IN BIOMEDICAL RESEARCH. THERE IS SOME EXCITING DEVELOPMENTS THAT HANNAH AND I HAVE BEEN WORKING ON IF IN THAT REGARD, WHICH WE DID, THAT I PRESENTED YESTERDAY FOR THE GROUP, BUT DIDN'T THINK IT WAS WORTHY OF A PRESENTATION TO THIS GROUP, BUT IT CERTAINLY IS SOMETHING THAT YOU SHOULD KNOW ABOUT. AND -- AND THAT IS THAT ONE SOURCE OF BLACK MALES IS THE NCAA. THERE IS A LOT OF BLACK MALE STUDENT ATHLETES IN THE NCAA. FOR OVER A YEAR NOW, HANNAH AND SOME PEOPLE FROM AAMC AND NIH HAVE COME UP WITH A POTENTIAL PROGRAM THAT WOULD TARGET BOTH STUDENT ATHLETE IN TERMS OF INTERVENTIONS AND ALSO LOOK AT THE CULTURE OF ATHLETICS TO TRY TO MAKE CHANGES IN THE CULTURE OF ATHLETICS HAVING BEEN A STUDENT ATHLETE MYSELF MORE THAN 45 YEARS AGO, I MUST SAY. >> AUDIENCE: [LAUGHING]. >> I'M SURE SOME THINGS HAVE CHANGED, BUT I UNDERSTAND CERTAINLY THE DIFDIFFICULTY STUDENT ATHLETE HAS WHEN THEY THINK THEY WANT TO GO INTO MEDICINE. THIS PROGRAM IS A CONSORTIUM OR COLLABORATION BETWEEN THE THREE INSTITUTIONS, NCAA AND NIH AND AAMC. HANNAH MENTIONED THAT BOTH LARRY AND FRANCIS'S IMPATIENCE. WELL, I'M ALSO VERY IMPATIENT. ONE OF THE BARRIERS WE CAME UP ON IS THAT THE FUNDING MODEL WHERE THE FUNDING FROM THE NCAA BECAUSE OF WHEN FUNDING IS AVAILABLE IN THEIR CYCLE WOULDN'T BE AVAILABLE TO HELP FUND THIS INITIATIVE UNTIL NEXT YEAR. I THOUGHT WAITING A WHOLE YEAR AFTER EVERYTHING HAS BEEN KIND OF WORKED OUT AND PEOPLE ARE ENTHUSIASTIC ABOUT THIS IS PROBABLY NOT THE BEST THING TO DO. JUST LAST WEEK, I WAS ABLE TO TALK TO MY FELLOW COLLEGE PRESIDENTS IN THE -- OUR CONFERENCE GREATER LAKES INTERCOLLEGIATE ATHLETICS CONFERENCE AND CONVINCE THEM OUR CONFERENCE SHOULD BE A PILOT FOR THIS INITIATIVE. THEY AGREED. OUR CONFERENCE IS PROVIDING FUNDING FOR NA AAMC WHICH IS COMING UP WITH AT LEAST AN EQUIVALENT AMOUNT. HANNAH HAS BEEN TALKING ABOUT SOME OPPORTUNITIES TO HAVE THE STUDENTS COME TO NIH FOR SUMMER INTERNSHIP AND THINGS LIKE THAT. STARTING ACTUALLY IMMEDIATELY NEXT MONTH, WE WILL GET STARTED ON THIS WITH ONE CONFERENCE, OUR CONFERENCE. THE GOAL IS TO TRY TO WORK OUT ALL OF THE KINKS AND SEE IF WE CAN MAKE THIS A LARGER COLLABORATION THAT INVOLVED MANY MORE CONFERENCES AND INSTITUTIONS. WE WILL BE ABLE TO FIGURE OUT THE FUNDING MECHANISMS AND PRESENT MORE FORMALLY TO THIS GROUP AND JUST GO THROUGH PROCESSES AND NEED TO -- THAT WE NEED TO GO THROUGH BOTH HERE AT NIH AND AT THE NCAA LEVEL. I'M ENTHUSIASTIC ABOUT THIS. I THINK IT IS A POTENTIAL FOR SOME BIG CHANGES. BLACK MALES IN BOTH MEDICINE AND BIOMEDICAL SCIENCES I WENT TO MED SCHOOL BETWEEN 1986 AND 1980. I CAN TELL YOU THERE ARE MORE ABSOLUTE NUMBERS IN BLACK MALES AND MEDICINE AT THAT TIME THAN THERE WAS IN 2014. SINCE 2014, THERE HAS BEEN A SLIGHT TICK UP IN THE NUMBER OF AFRICAN-AMERICAN MALES, BUT IF YOU LOOK AT THERE HAS BEEN A GROWTH OVERALL SO WHEN YOU LOOK AT PERCENTAGES, THERE IS ABOUT 2.6 OR 2.8% OF MAT TRICK LANTS ARE BLACK MALES NOW VERSUS [INDISCERNIBLE] PERCENT IN 1988. I AM WILLING TO BET ANYTHING THOSE NUMBERS ARE WORSE FOR BIOMEDICAL SCIENCES. THIS IS A REAL PROBLEM NOT ISSUE OF UNDER-REPRESENTED GROUPS BUT UNDER-REPRESENTED AMONG UNDER-REPRESENTED GROUP. YOU WILL HEAR MORE ABOUT IT OVER THE YEAR OI WANT TO INTRODUCE THIS SINCE WE WILL START ON IT NEXT MONTH. >> THANK YOU, ROY. >> LINDA AND SPIROAND JOSE. >> BIG INCREASE IN PHDS I LIVE IN A BUBBLE PEOPLE ARE SUCKED IF INTO THE INDUSTRY LIKE THAT IT IS HARD FOR THEM TO CONSIDER CAREERS IN FACULTY IF THEY WANTED TO DO IT MONEY AND WORK/LIFE BALANCE AND ALL THOSE THINGS DO YOU HAVE A SENSE WHAT IS HAPPENING TO THE PEOPLE WHO ARE IN THAT INCREASE BUT NOT GOING INTO FACULTY? >> WE ACTUALLY DO. THEY ARE GOING INTO A RANGE OF CAREERS IS A BIG ONE POLICY IS ANOTHER AND SCIENCE WRITING IS ANOTHER WHEN THEY ARE DISTRIBUTED IN THAT WAY THEY END UP IN FIELDS THINKING IT WILL BE BETTER THERE IS STILL HUGE UNDERREPRESENTATION THERE. I WOULDN'T MAKE THE CASE THAT WE STOP WHAT WE ARE DOING IN A PIPELINE AT ALL. THIS IS ALMOST EXCUSE THE OTHER CARDIOLOGY ANALOGY THIS IS A PROXIMAL CORONARY STENOSIS. ONCE WE OPEN UP THAT BLOCKAGE WE WILL NEED THAT SUPPLY COMING THROUGH THE PIPELINE. YES. THEY ARE GOING TO A RANGE OF THINGS. LINDA, I WOULD LIKE TO POINT OUT THAT THE GAP IN THE TRANSITION TO ACADEMIA IS GREATER FOR WOMEN IF IN UNDER-REPRESENTED GROUPS SOME PEOPLE LIKE TO SAY WE ARE SMARTER WOMEN ARE SMARTER AND MAKING THE RIGHT CHOICES. >> PEOPLE DO SAY THAT. >> LEAVE THEM ALONE THEY ARE MAKING THE RIGHT CHOICES I REFUSE TO ACCEPT THAT UNTIL WE CHANGE THE CULTURES OFFACDEMIA. >> SECOND PART TO MY QUESTION IS YOU SHOW I WANT TO GET YOUR PREPRESENT ON 30% DISPARITIES BETWEEN AFRICAN-AMERICANS AND THE VIEWER. -- IS THIS MAYBE A CANARY IN THE COAL MINE MESSAGE SOME AREAS MAYBE NEED MORE FUNDING BECAUSE THESE FOLKS SEE PROBLEMS THAT DESERVE ATTENTION? I DON'T KNOW THE ANSWER TO THAT. I SIMPLY ASK THE QUESTION MAYBE THERE ARE AREAS THAT ARE UNDERFUNDED PEOPLE ARE SEEING A NEED FOR AND NEED MORE FUNDING. I DON'T KNOW. ANYTHING IN YOUR DATA THAT WOULD SUGGEST THAT? >> YES AND YES. OF COURSE THE AREAS IF YOU TAKE APPLICANT IDENTITY OUT OF THE EQUATION, THERE IS CERTAIN AREAS THAT ARE MORE LIKELY TO BE FUNDED THAN OTHERS. SO THIS IS A -- THIS IS AN ISSUE FOR NIH TO LOOK AT AND FIGURE OUT WHAT WE SHOULD BE DOING ABOUT IT. AS IT TURNS OUT AFRICAN-AMERICAN APPLICANTS TEND TO APPLY MORE OFTEN TO LOWER FUNDING AREAS. >> [INDISCERNIBLE]. >> HANNAH THANK YOU VERY MUCH FOR ALWAYS THESE INFORMATIVE PRESENTATIONS IT THAT GIVE US HOPE FOR PROGRESS ALONG THESE IT LINES FIRST OFF 30 OR 40 YEARS AGO WITH YOUR EXAMPLE OF SCHOLAR ATHLETE I WANT TO UNDERSCORE MORE RECENT EXAMPLES. WE DIRECT ONE MNRN COACHING GROUPS IN COLORADO WE HAD YOUNG AFRICAN-AMERICAN MALE ROBERT TURNER FORMER NFL FOOTBOIL PLAYER TRAINED AT DUKE AND SECURED FACULTY POSITION HIS WORK IS ON TBI AMONG NFL FOOTBALL PLAYERS I CAN'T TELL YOU HOW MUCH HE ENERGIZED THE DISCUSSION WITH GROUPS -- AND NOW HAS A FOLLOWING OF YOUNG AFRICAN-AMERICAN MALE STUDENTS UNDERGRADUATE AND GRADUATES WHO BELIEVE IN THE POTENTIAL FOR THAT LINE OF WORK AND ITS APPLICATION TO REAL-LIFE PROBLEMS. THE SECOND THING I WANT TO UNDERSCORE FOR THE WORKING GROUP AT THE -- PUBLISHED MAJOR REPORT ON MINORITY SERVING INSTITUTIONS IN CONTRIBUTION TO BIOMEDICAL SCIENCES PARTICULARLY. HANNAH, THERE ARE A NUMBER OF PARALLEL RECOMMENDATIONS FIRST THAT ALIGN NICELY WITH POINTS YOU MADE AT UNDERGRADUATE AND EARLY GRADUATE YEARS. THEY ALSO MAKE A VERY -- WE MAKE A VERY STRONG CASE FOR CONTRIBUTION TO BIOMEDICAL AND SCIENCES. THAT STRENGTHENS YOUR ARGUMENT I COMMEND YOU AS WELL. >> THIS PROGRAM HAVE PEOPLE LIKE YOU JUST MENTIONED REJEE TURNER WHO ARE OR WERE ATHLETES AND WENT INTO MEDICINE AS ROLE MODELS WE WOULD LOVE TO GET HIS NAME AND CONTACT INFORMATION AND TRY TO ENLIST HIM IN SOME WAY. >> [INDISCERNIBLE]. >> TWO COMMENTS, YOU MENTIONED INCREASE RO1 APPLICANTS 2012 AND 2013 AND 2018 AND MADE POINT THAT INCREASE IS ACROSS ALL GROUPS I WASN'T CLEAR IF INCREASE WAS RELATIVELY BETTER FOR MINORITIES IN WELL REPRESENTED GROUPS AND INCREASE FOR WHITE APPLICANTS WAS 11% AND 29% IN TERMS OF FUNDING RATES INCREASE 40% WHITE APPLICANTS AND 69%. >> CORRECT. >> NICE TO KNOW THE NUMBERS ARE STATISTICALLY SIGNIFICANTLY DIFFERENT IN HETERO-JENAETY TEST TO SEE EVERYBODY IS IMPROVING AND ONE RAISING HIGHER IS THAT WE NEED TO RISE HIGHER. THAT IS ONE COMMENT. SECOND COMMENT I HEARD OF THIS NCAA PROGRAM FOR THE FIRST TIME YESTERDAY. IT MADE ME THINK WHY IS HAPPENING? TO BE ABLE TO MAKE SOMETHING HAPPEN THAT POSTPONED FOR A YEAR -- THERE IS A LESSON THERE FOR COMPOSITION OF WORKING GROUPS -- DIFFERENCE BETWEEN SOMETHING THAT HAPPENS A YEAR EARLIER OR DOESN'T HAPPEN. IN TERMS HOW WE GO ABOUT MAKING SURE THAT PEOPLE THAT CAN REALLY EFFECT CHANGE IN PART OF THE WORKING GROUPS IS A EXAMPLE. >> THANKS. GREAT POINT. WE ARE LOOKING FOR RAIN MAKERS IN WORKING GROUPS AND WE HAVE BEEN PRETTY SUCCESSFUL. I HEAR DR. HILL HAS A COMMENT. >> CAN YOU HEAR ME. >> YES. WE CAN HEAR YOU THIS TIME. >> IT IS IMPORTANT TO KEEP IN MIND HOW DISCOURAGING IT IS FOR UNDER-REPRESENTED MINORITY STUDENTS POST DOCS AND IN MEETINGS AND SEE INDIVIDUALS WHO LOOK LIKE THEMSELVES WHO ARE SUCCESSFUL ON PANELS GIVING TALKS. I BELIEVE IT GOES BY INDIVIDUALS ACHIEVE IN STATUS AT TIME [INDISCERNIBLE] AND POST DOCS CHOOSING MEDICINE AND ACADEMIC BIOMEDICAL RESEARCH WILL CHANGE. I TALK TO LOTS OF STUDENTS WITH POST DOCS AND I HEAR THAT QUITE OFTEN IT IS DISCOURAGING GOING TO NATIONAL MEETINGS AND OTHER SETTINGS AND SEE PERSONS WHO ARE LEADING CONVERSATIONS AND SEE PEOPLE WHO LOOK LIKE THEMSELVES. I WANT TO CONGRATULATE YOU AND ON THE PROGRESS THAT HAS BEEN MADE. THERE WILL BE MOMENTUM THAT WILL BUILD UP AND TREND WILL CHANGE. THAT WAS THE POINT I WANT TO MAKE. THANK YOU. >> THANKS VERY MUCH. AGAIN, IT WAS PART OF THE STATEMENT I ISSUED YESTERDAY NOT ONLY ABOUT WOMEN HAVING PROMINENT ROLES IN SCIENTIFIC MEETINGS THAT YOU JUST REFERRED TO BUT MEMBERS OF UNDER REPRESENTED GROUPS THAT WE DON'T PUT OUT THERE IN A WAY IT THAT CAN BE ENCOURAGING TO TRAINEES WHO ARE LOOKING FOR ROLE MODELS WHICH IS ANOTHER PART IN WHY I WILL NOW LOOK CAREFULLY AT THOSE AGENDAS AND SEE WHETHER THAT DIVERSITY PLAYED AN IMPORTANT ROLE IN DECISION MAKING TO SEE IF OTHERS CAN DO THE SAME IT IS AN IMPORTANT POINT. THANKS DR. HILL. >> THANK YOU. >> CONGRATULATIONS. REMARKABLE PROGRESS IN A RELATIVELY SHORT PERIOD OF TIME. I WOULD ENCOURAGE US TO ALSO THINK ABOUT THE PIPELINE. MY OWN EXPERIENCE IN INNER CITY LOS ANGELES WAS I UNDERSTOOD THAT THE STUDENTS IN THE PROGRAM THAT I LED WERE REALLY STEM EDUCATION SURVIVORS AND THEY WERE A SURVIVAL COHORT THAT STAYED INTERESTED IN SCIENCE TECHNOLOGY AND MATH DESPITE THE EDUCATIONAL SYSTEM. WHEN WE WENT INTO NOT ONLY HIGH SCHOOLS BUT IN ELEMENTARY SCHOOLS AND ONE OF THEM BEING ONE OF THE 10 WORST PERFORMING ELEMENTARY SCHOOLS IN THE SECOND LARGEST SCHOOL DISTRICT IN THE COUNTRY WHICH GIVES YOU SOME RELATIVE MEASURE. I CAN TELL YOU DEFINITIVELY THAT BEING ECONOMICALLY IMPOVERISHED IS NOT THE SAME AS BEING INTELLECTUALLY DEAFISHENT. IN OUR PUBLIC SCHOOLS, THE POOR KIDS ARE OUR BRAIN TRUST. THEY ARE GENIUSES IN THE MAKING. AND THAT WE HAVE A REAL OPPORTUNITY TO LEAD THE WORLD IF WE WILL JUST EDUCATE THEM. >> MAY I RESPOND TO THAT? >> FRANCIS S. COLLINS: PLEASE. >> SAM SILVERSTEIN ON ORIGINAL ACD COMMITTEE REMINDED US YET AGAIN YESTERDAY ABOUT THE IMPORTANCE OF EDUCATING TEACHERS TO BE ABLE TO TEACH THE SCIENCE IN A NEW WAY THAT EMPOWERS THE STUDENTS. SO I COUNTED TO SAM MAYBE HE CAN IDENTIFY SOME OF THE TEACHERS THAT HAVE BEEN TRAINED. WE WILL PUT THEM ON THE BUSES WITH THE STUDENT ATHLETES GOING TO THEIR SPORTS PERFORMANCES TO GET THE TRAINING GOING AS THEY ED IN SCIENCE. >> FRANCIS S. COLLINS: CHRISTINA. >> THANK YOU VERY MUCH I WILL ADD MY THANKS ON THIS. WHEN TALKING ABOUT NC2A YOU WILL GO IN A DIFFERENT DIRECTION. IT MADE THEY THINK FOR A MOMENT WHEN I WAS AT STANFORD I WAS THERE EIGHT YEARS TWO WOMEN PROFESSORS ONE AT GRADUATE AND ONE UNDERGRADUATE LEVEL NONE IN STEM FIELDS I DIDN'T THINK I COULD BE A PROFESSOR THERE WEREN'T ANY IF YOU SEE IT YOU CAN BELIEVE IT AND BE IT. CLASSIC CIVIL RIGHTS QUOTE; RIGHT? -- PROD EDGY, SO WE ARE SETTING A GOAL FOR 10 YEARS AND HIRE 1,000 PROFESSORS? WHY TEN YEARS I THOUGHT YOU WERE GOING WAY WE NEED TO RECRUIT IN MY OPINION UNDER-REPRESENTED INDIVIDUALS INTO OUR FIELD IS DO WHAT COACHES IN EVERY SCHOOL IN AMERICA DO ATTRACT KIDS TIME THEY ARE IN ELEMENTARY SCHOOL AND JUNIOR HIGH SCHOOL IF YOU ARE PRODIGY THERE YOU WILL BE PROFESSOR OF THE FUTURE THAT IS WHAT WE NEED TO DO I THINK. I KNOW YOU KNOW THIS, ROY. WHAT IS IT THE COMMERCIAL THAT GOES ONLY TWO -- MOEFT OF US WON'T BE -- I WAS A STUDENT ATHLETE AS WELL FOLLOW UP A PROFESSIONAL CAREER IN SPORTS. AS YOU GO ALONG THESE KIDS THAT ALL DREAM TO BE AS WE ALL DID OLYMPIAN OR PROPLAYER IS TO HAVE PARALLEL TRACK WITH THEM WILL BE SO IMPORTANT I APPLAUD WHAT YOU ARE DOING WITH ANALYTICS AND DATA WE HAVE NOW PUT IT TOWARDS TRACKING KIDS AND INSPIRING THEM AND GETTING THEM WHEN THEY ARE YOUNG TO REALIZE IT IS THE BEST PROFESSION IN THE WORLD TO BE A STEM RESEARCHER OR SO I THINK ANYWAY. >> SO THERE IS NO SHORTAGE OF THINGS TO DO AND LOTS OF DIFFERENT APPROACHES TO GETTING AT THE PROBLEM. I THINK YOU ARE ABSOLUTELY RIGHT AND THE SOONER WE CAN GET THEM, THE BETTER IN. THAT IS WHAT THEY DO IN ATHLETICS THESE DAYS. ONE THING THAT I FORGOT TO MENTION WHICH IS IMPORTANT IS THAT WE ARE STARTING OFF WITH DIVISION 2. DIVISION TWO ATHLETES ARE NOT AS -- THEY ARE NOT THINKING THEY WILL GO INTO THE PROS. OKAY? DIVISION ONE A-TH LEETS IN FOOTBALL AND BASKETBALL ALL THINK THEY WILL MAKE THE PROS REGARDLESS HOW TALENTED THEY ARE OR NOT IS WHAT THEY THINK. DIVISION TWO IS A MORE APPROACHABLE FROM THE STANDPOINT OF TRYING TO MAKE SOME SORT OF CHANGE. IN DIVISION TWO THERE IS A LOT OF STUDENT ATHLETES AFRICAN AMERICAN WHO ARE MALE. THAT IS SOMETHING WE CAN DO IMMEDIATELY AND CONTINUE AND DO SOME OF THE OTHER APPROACHES TO REALLY MOVE THE NEEDLE. THANK YOU FOR THAT. >> LET ME JUST SAY THAT MOMENTUM -- THERE IS MOMENTUM IN THIS MOINT SINAI ARE HOSTING A MEETING NEXT WEEK TO ALSO BEGIN TO LAUNCH A PROGRAM THAT IS VERY SIMILAR TO WHAT ROY TALKS ABOUT. THEY WILL BE REACHING DOWN INTO HIGH SCHOOL AS WELL. A, YOUTH, IF YOU HAD ANY KIDS THAT PLAY THIS SPORT, THERE ON THE BUSES A LOT OF TIMES THERE CAN BE LOTS OF LEARNING GOING ON THERE PREPARING THEM FOR SATS AND ALL KINDS OF THINGS. THEY KNOW HOW TO DO THIS IN TERMS OF THEIR TIME AND FOCUS AND EVERYTHING. THEY NEED TO BE TOLD THEY CAN BE SCIENTISTS AS WELL. >> FRANCIS S. COLLINS: WELL, THANKS. THIS HAS BEEN A GOOD DISCUSSION AFTER AN INSPIRING PRESENTATION. WE CAN ALL AGREE THAT EVIDENCE OF PROGRESS IS TRULY GRATIFYING. I HAVE TO SAY FOR PRECEDING 20 OR 30 YEARS THERE WASN'T MUCH PROGRESS AT ALL TO SEE THE NUMBERS MOVING UPWARD ADMITTEDLY WITH LONG WAY TO GO IS GRATIFYING. HANNAH AND ROY THANK YOU BOTH FOR YOUR LEADERSHIP IN THIS EFFORT GETTING US WHERE WE ARE AND I KNOW ACD WILL CONTINUE TO WANT TO HEAR FROM YOU AS WE SEE THESE THINGS PLAY OUT OVER THE COURSE OF THE COMING YEARS. IT IS ENCOURAGING. WE DON'T OFTEN GET TO SAY IT IS ENCOURAGING WHEN WE TALK ABOUT DIVERSITY IN OUR WORKFORCE OFTEN TIMES WE SAY WE HAVE TO TRY HARDER THAT IS TRUE BUT IN THIS CASE IT IS STARTING TO WORK WHICH IS WONDERFUL NEWS. THANK YOU WE WILL TURN TO ACD WORKING GROUP ON HIGH RISK HIGH REWARD PROGRAMS THE FINAL REPORT AND TO PRESENT IT IS BRENDAN LEE. TAKE IT AWAY. >> THANK YOU. IT IS MY PLEASURE TO PRESENT THE HARVEY AWARD WORKING GROUP ON THE FINAL RECOMMENDATION AND ON TOP LEVEL SUMMARIZE THAT THIS GROUP IS COMING TOGETHER TO EVALUATE HR PROGRAMS WE WENT THROUGH PHASE OF REVIEW OF CURRENT PROGRAM IF IN TERMS OF PROCESS AND IN-DEPTH DATA ANALYSIS SHEP HARDED BY NIH STAFF AND WROE BUST DISCUSSION WHAT FUTURE WOULD HOLD. I'M DELIGHTED TO DO THIS. THIS IS IT FOCUSED ON HR, HR PROGRAMS THAT ARE UNIQUE ELEMENTS OF THE COMMON FUND AND THEY ARE IN FACT I THINK THE ONLY PROGRAMS IT THAT HAVE I GUESS HAVE GONE PAST THE SORT OF TENURE SUNSETTING CLAUSE AND SOME HAVE GONE ON NEAR CLOSE TO FIFTEEN YEARS. QUITE A BIT OF DATA AND ALL BEE IT THE SAMPLE SIZE IS STILL RATHER LIMITED. THE PROGRAMS ARE FOCUSED ON SUPPORTING INVESTIGATOR INITIATIVE SCIENTIFIC GOALS IDEA IS TO ENABLE INVESTIGATORS TO LAUNCH POTENTIALLY TRANSFORMATIVE PROJECTS AND NO SIGNIFICANT REQUIREMENT FOR PRELIMINARY DATA. AGAIN, QUITE DIFFERENT FROM A PRIMARY PORTFOLIO OF INVESTIGATIVE INITIATIVE RO ONES AND IDEA RISK INVOLVED IN SUCH PROGRAMS WOULD BE MITIGATED BY EMPHASIZING SUCH ACCOMPLISHMENTS IN THE REVIEW PROCESS AND IT WOULD AINVESTIGATORS TO CHANGE MIDSTREAM AS THIR SCIENCE WOULD TAKE THEM. THE AWARDS ARE IN GENERAL FIVE YEARS AND THIS HAS BEEN ALSO ANOTHER MECHANISM FOR PILOTING NOVEL APPLICATION AND REVIEW PROCESSES. THEY ARE NOT UNIQUE TO HR PROGRAMS AND HAVE OFTEN BEEN DONE BY DIFFERENT ICS WHICH THIS HAS ESPECIALLY BEEN A FEATURE OF THIS INCLUDES THINGS LIKE MULTIPHASE REVIEWS EDITORIAL REVIEWS AND INCLUSION OF REVIEWS IN SOME OF THE REVIEW PROCESSES. THERE ARE FOUR PRIMARY MECHANISMS IN H AND HR PORTFOLIOS THAT ARE FOCUSED ON FUNDING OUTSTANDING SCIENTISTS AT ALL CAREER STAGES. THERE IS THE PIONEER AWARD FOCUSEDED ON MORE PRIMARILY ESTABLISHED INVESTIGATORS AND NEW INNOVATOR AWARD FOCUSED ON EARLY INVESTIGATORS AND TRANSFORMATIVE RESEARCH AWARD THAT OVER THE YEARS INVOLVED TO PERHAPS INCORPORATE MORE TEAM-LIKE SCIENCE APPROACHES THAT IS NOT THE REQUIREMENT BUT THE FLAVOR AND EARLY INDEPENDENCE AWARD WHERE BASICALLY THERE IS A SUPPORT MECHANISM FOR GRADUATES THAT COMPLETE THEIR PHD AND RESIDENTS AND FOLLOWS THAT COMPLETE THEIR TRAINING AND AN INDEPENDENT STATE. I WANT TO -- THIS IS THE FINAL RECOMMENDATION. I DO WANT TO ACKNOWLEDGE THE WORKING GROUP PERSONALLY MOLLY CONS FROM THE UNIVERSI UNIVERSITY OF WISCONSIN AND JOHN KARN TER USC AND SPANS CAREER RANGE AND POST DOCTORATE FELLOW AND [INDISCERNIBLE] GRIF ROGERS DIRECTOR OF NIDDK AND SANDRA SCHMIDT [INDISCERNIBLE] AND SCOUT WHO IS FROM INDUSTRY GROUP AND JASON WHO IS EARLY CAREER INVESTIGATOR AND LARRY IS CO-CHAIR AND THANK ALL THESE GROUPS AND HANNAH VALANTINE. ELEMENTS OF OUR WORKING GROUP OVERLAP WITH THE TOPIC IN FACT THAT WE JUST HAD A VERY ROBUST DISCUSSION ON CHARGE TO WORKING GROUP IS TO REVIEW EFFECTIVENESS S TO HR RESEARCH PROGRAMS AND ANALYZE PARTICIPATION OF WOMEN AND OTHER UNDER-REPRESENTED GROUPS AND APPLICANT FINALIST LONGITUDINALLY ACROSS THE PROCESS AND IDENTIFY POSSIBLE CAUSES FOR UNDERREPRESENTATION IN EACH OF THE AREAS. ADDITIONALLY WE WANTED TO EXAMINE INSTITUTIONAL DIVERSITY AND DIVERSITY OF SCIENTIFIC TOPICS IN APPLICANT AND AWARDEE POOLS AND YOU SEE THERE ARE BIASES AT THAT LEVEL AND FINALLY PROPOSE STEPS NIH MIGHT TAKE TO -- AND AWARDEES OF HR AND HR PROGRAMS AND SUPPORTING BEST SIGNS PILLAR OF NIH IS MERIT AND PEER REVIEW. SO THIS IS NOT THE FIRST TIME THAT PROGRAMS HAVE BEEN REVIEWED. IN FACT NIH HAD ENGAGED A FORMAL EXTERNAL ANALYSIS OF TWO OF THE FOUR PROGRAMS. IT WAS A VERY DETAILED ANALYSIS AND THEY WERE FOCUSED ON PYONEAR AWARDS AND INNOVATOR THIS ANALYSIS INSTITUTE OF DEFENSE ANALYSIS THEY COMPARED RESEARCH OUTCOMES COHORT 33 PYONEAR AWARDS CAME FROM INITIAL THREE COHORTS THAT WERE COMPARED TO SIMILARLY QUALIFIED R01 INVESTIGATORS AND RANDOM SETS OF HHMI INVESTIGATORS AND THEIR APPROACH WAS TO EVALUATE SCIENTIFIC IMPACK AND INNOVATION AND TWO MAJOR ROUTES FOR DOING THAT WAS BASICALLY FOR EVERY BUILDING METRIC OUTCOME YOU CAN IMAGINE. THERE IS A WHOLE HOST OF THEM AS WELL AS EXPERT ANALYSIS WHO EVALUATION OF PORTFOLIO ARE OFTEN IN BLINDED FASHION. WHAT THEY FOUND BASICALLY AND REPORT IS AVAILABLE IN GREAT LENGTH WAS THAT PYONEAR FUNDED RESEARCH WAS MORE IMPACTFUL WHEN LOOKED AT THESE MEASURES AND RANDOM R01S AND IMPACT OF HHMI PORTFOLIO AND MORE INNOVATIVE THAN R01 INVESTIGATIVE RESEARCH AND SIMILARLY TO HHMI THESE TWO METRICS WHICH WE KNOW HAVE THEIR LIMITATIONS. THAT WAS THE OUTCOME OF THIS ANALYSIS, CERTAINLY. THIS EXTERNAL IN-DEPTH REVIEW LOOKED AT THE NEW INNOVATOR AWARD AND AGAIN WHAT YOU CAN SEE WITH ANALYSIS OF AWARDEES OF FIRST THREE COHORTS AND FOUND NEW INNOVATIVE RESEARCHER WOULD BE INNOVATIVE AND RISKY AND MORE IMPACT WHEN COMPARED TO THIS SITUATION EARLY STAGE INVESTIGATOR R01 RESEARCH. REWARDS DIDN'T HAVE A SIGNIFICANTLY MORE POSITIVE OR NEGATIVE IMPACT ON CAREERS OF AWARDEES THAN ESI RO1 IF YOU DID MORE HIGH RISK RESEARCH EARLY ON IT WOULD IMPACT LIKELIHOOD OF ACHIEVING FUNDING SUBSEQUENTLY. IT DIDN'T FIND THAT. LOOK AGAIN AT INDICATORS WE USE THIS IS PRIMARILY METRIC MARKERS LIKE AVERAGE CITATIONS FOR PUBLICATION AND GENERAL JOURNAL IMPACT FACTOR AND RELATIVE [INDISCERNIBLE] RATIO WHICH IS FIELD AND NORMALIZED AND SO FORTH AND H INDEX AND REVIEW FOUND NEW INNOVATOR AWARDEES GENERALLY HAD GREATER IMPACT THAN RSIEO ONES AND FURTHER IMPACT DOWNSTREAM AND NUMBER OF PUBLICATIONS COMING FROM THIS AWARD PERIOD AVERAGE ANNUAL PUBLICATIONS TIME TO FIRST PUBLICATIONED WHAT THEY FOUND WAS ESI RO ONES HAD A LARGER NUMBER COMPARED TO NEW INNOVATORS THIS PERHAPS REFLECTS HIGHER RISK NATURE OF NEW INNOVATOR AWARDEES. WHEN WE CAME TOGETHER TO DISCUSS HOW DO YOU MEASURE IMPACT AND THE METRIC IMPACT IS IMPORTANT. WE FOCUSED ALSO ON OTHER POTENTIAL OUTCOMES OR METRICS AND WE DISCUSS USING CLINICAL AND TECHNOLOGICAL IMPACT. CLINICAL IMPACT IN TERMS OF WHETHER AN AWARD LED TO CHANGE IN PRACTICE GUIDELINE OR AWARD LED TO IN FACT A CITATION ON A CLINICAL TRIAL SPECIFICALLY LET'S SAY A CLINICAL TRIAL THAT IS REGISTERED ON CLINICAL TRIAL.G OWE, V WITH RESULTS SIMILARLY IN TECHNOLOGICAL IMPACT AWARD IS CITED SPECIFICALLY BY PATENT OR SERIES OF DATA THAT CITED A SPECIFIC AWARD. THOSE WERE FURTHER INTEGRATED IN OWN ANALYSIS. THIS IS WHERE AGAIN I ACKNOWLEDGE NIH STAFF AND YOU ARE DOING ENORMOUS AMOUNT OF WORK GEORGE AND ANGELO FROM PORTFOLIO GROUP DID A [INDISCERNIBLE] JOB IN GENERATING THE DATA. YOU SEE IN TABLE ON LEFT LOOKED AT TRANSFORMATIVE AND PIONEER AWARD DZ AND EARLY INDEPENDENCE AND NEW INNOVATOR AWARDS NUMBER OF AWARDS AWARDS WITH CLINICAL IMPACT I DEFINED AS WELL AS AWARDS WITH TECHNOLOGICAL IMPACT. YOU SEE THESE ARE LIMITED NUMBERS. ONE HAS TO BE CAREFUL IN OVER-GENERALIZING THEM THEY ARE DATA WE HAD AT HAND. YOU SEE THERE WERE STATISTICALLY SIGNIFICANT DIFFERENCES WHEN WE COMPARED THEM TO OVERALL PORTFOLIO OF NIH R ONES AS WHAT WE FOUND IS THERE WERE NO - REAL DRAMATIC DIFFERENCES IN TERMS OF CLINICAL IMPACT. INNOVATOR AWARDS WERE LOWER COMPARED TO TRADITIONAL R01S THIS IS PROBABLY NOT SHOCKING GIVEN THESE ARE PRIMARY AWARDS TO EARLY STAGE INVESTIGATORS THERE WAS A HYPOTHESIS GOING FORWARD MANY OF THESE HHHR AWARDS ARE TECHNOLOGY-FOCUSED MANY REVIEWERS AND EXPERT OPINION COULD AGREE UPON THAT TECHNOLOGY COULD BROADLY IMPACT FIELDS THAT APPEARED TOE TO BE THE CASE. TECHNOLOGY IMPACT -- HAD A HIGHER IMPACT COMPARED TO THE OTHER GROUPS OF MECHANISM. WE MOVED ON AND BEGAN TO LOOK AT PARTICIPATION OF WOMEN AND N- OTHER UNDER-REPRESENTED GROUPS AND ASKED IF POSSIBLE CAUSES FOR UNDERREPRESENTATION WE SAW THIS AS YOU WOULD HAVE EXPECTED. THESE ARE DATA LOOKING AT THE EVOLUTION OF APPLICANTS IN BLUE FINALIST LAST STAGE OF MUMENTI PHASER REVIEW TO ACTUAL AWARDEES. PIONEER AWARDS OF ALMOST 15 YEARS BUT 14 YEARS AND EARLY INDEPENDENCE. WE SAW NO SIGNIFICANT DIFFERENCE ACROSS THE REVIEW PROCESS IN CASE OF THE PIONEER NOTICING THERE WAS SIGNIFICANT YEAR TO YEAR VARIATION GIVEN SMALL SAMPLE SIZES. WHAT DID BECOME APPARENT WAS SIGNIFICANT DECREASE FOR EARLY INDEPENDENCE AWARDS WITH WHERE YOU IS HAD SIGNIFICANT PERCENTAGE OF WOMEN WHO ENTERED IN TERMS OF APPLICATION PROCESS AND BECAME FINALISTS BUT SIGNIFICANT DROP AS A WHOLE WHEN YOU LOOK AT AGGREGATE DATA IN TERMS OF AWARDEES. I WOULD SAY THAT IN LAST YEAR OF THIS IT WAS IN FACT A CHANGE THAT WE RECOMMENDED AND NIH AND ACTUALLY EFFECTUATED EARLY WHICH WAS ELIMINATION OF THE INTERVIEW. THIS AND PIONEER AWARDS WAS THE ONLY TWO MECHANISMS THAT HAD A FINAL INTERVIEW STAGE. CURRENTLY EIAS HAVE ELIMINATED THE INTERVIEW COMPONENT. IF YOU LOOK AT THE TRANSFORMATIVE RESEARCH AWARDS AND NEW INNOVATOR AWARDS YOU SEE SIGNIFICANT VARIATION. WE DID NOT SEE A SIGNIFICANT INCREASE OR DECREASE IN EITHER OF THESE AS YOU PROGRESSED FROM APPLICANT FINALISTS TO AWARDEES IN TERMS OF PERCENTAGES. IF YOU LOOK AT SOME OF THESE, CERTAINLY THE ONES WHERE THERE IS A SINGLE PI, FOR EXAMPLE, FOR INNOVATORS 30% BENCHMARK IN GENERAL IS ABOUT WHAT IS THE CASE WITH THE GENERAL R01S AND WITH NEW INNOVATOR ONE WE SAW AN INCREASE THAT WAS SIGNIFICANT FROM THE APPLICANT TO THE AWARDEE STAGE IN TERMS OF PERCENT FEMALE AWARDEES. WE THEN MOVED ON TO ADDITIONALLY OTHER UNDER-REPRESENTED GROUPS ONE CHALLENGE IS NUMBERS ARE ENORMOUSLY SMALL REFLECTS WHAT HANNAH SHOWED PREDRIKT THIS WITH SMALLER SAMPLE SIZE WHEN COMING TO HHHR GROUPS. EFFECTED BY REVIEW PROCESS WE LOOKED AT THE REVIEW PROCESS AND TOPICAL EXPERTISE OF REVIEWERS. EXCEPTION OF COURSE IS WHAT I MENTIONED IN EARLY INDEPENDENCE AWARD PERCENTAGE OF FEMA APPLICANTS WAS HIGHER THAN AWARDEES IN 2018. THAT WAS ONE SITUATION WHERE REVIEW PROCESS WAS THEN CHANGED. ACROSS ALL AWARDS THERE WAS SIGNIFICANT YEAR TO YEAR VARIATION IN PERCENTAGE OF INVESTIGATORS AND LIMITING FACTOR OF ANALYSIS WAS SIGNIFICANT PERCENTAGES ANYWHERE RANGING FROM 5% TO AS HIGH AS 20% IN EACH YEAR WHERE APPLICANT DIDN'T IDENTIFY GENDER ETHNICITY AND RACE WHICH SOMETIMES MAKES IT MORE DIFFICULT FROM ANALYSIS. IRRESPECTIVE WE RECOGNIZE THE NUMBER OF APPLICANTS TO SUPPORT WOMEN OR URM'S INVESTIGATOR TO CONTINUE TO BE VERY LOW REMAINS TO BE CHALLENGE THROUGHOUT AND CERTAINLY MAGNIFIED IN H OR HR PROGRAMS. WE THEN ALSO WENT ON TO LOOK AT DIVERSITY OF SCIENTIFIC TOPICS THAT WAS ELUDED TO IN THE LAST DISCUSSION THAT SOME AREAS OF RESEARCH MAY IN FACT BE MORE SUCCESSFUL IN THIS MECHANISM OR ANY MECHANISM VERSUS OTHERS. THIS IS A HEAT MAP. AS SCIENTISTS WE LOVE HEAT MAPS OR I LOVE THIS ANALYSIS. RED IS OBVIOUSLY HOT. LOTS OF DATA POINTS AND GREEN IS COOL. BEFORE GETTING INTO THE DATA, I MEAN, CONCLUDING TAKE-HOME MESSAGE IS PERHAPS BOTH PERCENTAGE OF APPLICATIONS AND PERCENTAGE OF AWARDS MAKES FOR RELATIVELY NARROW RANGE OF TOPICS. IF YOU LOOK AT ALL HR AND HR PROGRAMS COMBINED THERE ARE 21 CLUSTERS OF TOPICS. 14% OF TOTAL 148 CLUSTERS IF IN FACT ACCOUNT FOR OVER HALF OF THE APPLICATIONS CLEARLY MOST APPLICATIONS ARE COMING FROM CERTAINLY VERY RESTRICTIVE AREA OF STUDY RANGE OF AWARD RATES OF CLUSTERS IS 1.8 TO 14.6% MEDIUM -- YOU CAN SORT OF LOOK AT THIS MORE CLEARLY IN THIS SORT OF RECOMMENDATION. I KNOW ON THE LEFT YOU CAN SEE THE TOPICS WITH MODEL ORGANISMS AND GENETICS UP HERE WITH NEURONAL CIRCUITS NOT SURPRISING PERHAPS OTHER HAND CLINICAL PRACTICE OR CLINICAL OUTCOMES SOFTWARE DEVELOPMENT AND THESE ARE TOPIC AWARDS AND THESE ARE ACTUAL APPLICATIONS. HERE YOU CAN SEE THE ACTUAL HEAT MAP IN TEFRMS OF THESE CLUSTERS PERCENTAGE OF ALL AWARDS PERCENTAGE OF ALL APPLICANTS AND AWARD RATE. PURELY SORT OF LOOKING AT CORRELATION, YOU GET A SENSE THAT IN FACT THERE IS SOME CELATION BETWEEN THIS TENDENCY TO CLUSTER THEM AMONG THESE TYPES OF TOPICS. WHEN WE LOOK AT DIVERSITY OF SCIENTIFIC TOPICS IN APPLICANT AND AWARD DEEP POOL TO SUMMARIZE THERE HAS BEEN A BIAS GEOGRAPHICALLY IN TERMS OF INSTITUTION THAT WAS PART OF THE CHARGE HR AND HR WORK PROGRAMS SEEMED TO BE BIASSED TOWARDS INSTITUTIONS AND ORGANIZATIONS WELL FUNDED AND WELL KNOWN BIOMEDICAL RESEARCH PROGRAMS OFFICE OF -- USING A DESCRIPTIVE AND MULTIVARIATE ANALYSIS AND PRODUCTIVITY TRENDS WE HAD LOTS OF DISCUSSIONS ABOUT THIS YOU CAN READ MORE ABOUT IT IN THE REPORT. I THINK THAT THE BOTTOM LINE CONCLUSIONS ARE THAT OVERALL QUALITY OF THE WORK RESULTING FROM AWARDS DIRECTED TO INSTITUTIONS AND ORGANIZATIONS WITH SMALLER PROGRAMS AND TOP TIER INSTITUTIONS THAT ARE NOT SIGNIFICANTLY DIFFERENT. ONE WAY TO THINK ABOUT IT IS CRéME OF ANY INSTITUTION IS PROBABLY CRéME FROM ANY INSTITUTION ALL BEE IT THE ABSOLUTE NUMBERS MAY BE DIFFERENT. END OF THE DAY NO REAL EVIDENCE TO SUGGEST THERE WAS DIFFERENCES IN PRODUCTIVITY AND QUALITY. THIS SORT OF REPRESENTS THE CLUSTERING IN AGAIN A SORT OF HEAT MAP WITH REGARDS TO INSTITUTIONAL DIVERSITY FOR HR AND HR PROGRAMS. ON THE LEFT ARE THE TOP FUNDED ORGANIZATIONS OR INSTITUTIONS AS MEASURED IF IN THE PREPERIOD PRY TO THIS ANALYSIS YOU LOOK AT ANNUALIZED R01 DOLLARS PER APPLICANT YOU SEE HIGHLY FUNDED RESEARCH INSTITUTION AND ON THE RIGHT YOU SEE THE AWARD RATES IN THIS SUBSEQUENT PERIOD FROM IF. Y11 TO 16 TO VARIOUS MECHANISMS COMPARED TO R01S. WHAT YOU CAN SEE ARE THAT -- JUST SO IT IS CLEAR THAT THE AWARD RATES HERE ARE CALCULATED BASED ON NUMBER OF AWARD DZ VERSUS NUMBER OF APPLICATIONS AND ANALYZED BY R01 DOLLARS PER APPLICANT. I WILL GO TO THE NEXT SLIDE. WHAT YOU SEE IS THAT THE TAKE-HOME MESSAGE ORGANIZATIONS WITH HIGHEST FUNDING LEVELS HAVE HIGHEST PERCENTAGE OF AWARDS AND HIGHEST RATE. AGAIN, NOT SHOCKING. THE QUESTION IS SHOULD WE INCLUDE INSTITUTIONAL DIVERSITY IN HR AND HR FUNDING ANNOUNCEMENTS AND ELEVATING IT AS A PROGRAMATIC PRIORITY. ANOTHER QUESTION RAISED IS RELATIVE MERITS OF INSTITUTIONAL CAPPING TO LIMIT NUMBER OF AWARDS THAT EACH INSTITUTE MAY SUBMIT. I SAY THAT AS A GROUP THERE WAS CONSENSUS AS WE GET TO RECOMMENDATIONS ON ALL OF THE POINTS AS YOU WILL SEE THIS AS YOU CAN IMAGINE ELUDED TO IN INTERIM REPORT HIGHEST CONTROVERSIAL AND ONE THAT ENGENDERED MOST DISCUSSION. END OF THE DAY WE ENDED WITH SUPER MAJORITY IN TERMS OF RECOMMENDATION. YOU CAN SEE THE RELATIVE SORT OF MERITS OF THEM OR DISCUSS THAT. HERE ARE RECOMMENDATIONS. I THINK THAT AS A WHOLE THERE IS CLEAR CONSENSUS THAT VALUE OF HR AND HR PROGRAMS IS HAD HIGH AND THAT THE AWARDS HAVE GREATER INFLUENCE ON CERTAIN SCIENTIFIC AREAS COMPARED TO TRADITIONAL R01S GIVEN MORE RESTRICTED RESEARCH TOPICS YOU REPRESENTED. I THINK WE RECOMMEND AND CONCLUDE THIS IS AN OVERALL VERY SUCCESSFUL PROGRAM WE SHOULD TRY TO EXPAND IT IF AT ALL POSSIBLE. THERE ARE POSITIVE ELEMENTS OF THIS MECHANISM. WE DO RECOMMEND THAT AS THEY ARE NOW SUFFICIENT DATA TO FORMALLY EVALUATE THE TRANSFORMATIVE RESEARCH AWARD MUCH LIKE THE PIONEER AND NEW INNOVATOR AWARD HAD GONE. THERE IS OUTREACH YOU CAN SEE IN TERMS OF UNDERREPRESENTATION BOTH IN WOMEN AND UNDER-REPRESENTED MINORITIES WE NEED TO OF COURSE AS WE DO IN GENERAL TRY TO ENCOURAGE MORE APPLICATIONS FROM THESE GROUPS. SO WE TALKED ABOUT INITIATING A SPECIAL HRHR PROGRAM THAT REQUIRES COLLABORATION BETWEEN [INDISCERNIBLE] INSTITUTION AND REINSTITUTION TO INCREASE DIVERSITY IN A BROADER SENSE I WOULD SAY QUALIFY THIS RECOMMENDATION WE WERE WORRIED WE DIDN'T WANT TO GET IN A SITUATION WHERE THERE WAS IMBALANCE OF [INDISCERNIBLE] WHERE THIS BECOMES MORE OF A TOKEN OR TOKENISM TYPE OF SITUATION WE ARE SENSITIVE TO THAT AND IT IS IMPORTANT IN MAKING THE RECOMMENDATION THAT YOU WANT TO STIMULATE AND ENSURE EQUAL PARTNERSHIP FROM APPLICANTS. WE WANTED TO ENCOURAGE REALLY MAINTAINING CAREER DEVELOPMENT PORTALS THAT CENTRALIZE GRANTS AND EFFORTS THESE ARE NOT DIRECTED AT THE EARLY CAREER STAGE CERTAINLY THE EARLY INDEPENDENCE AWARD AS ANY THINK INFORMING INDIVIDUALS AND REALLY EDUCATING THEM EARLY ABOUT THIS MECHANISM WILL IN FACT PERHAPS IMPROVE THE POOL AS THEY MOVE ON IN THEIR CAREERS NIH TO CONSIDER EXPANDING RESOURCES ALONG THIS WHOLE CAREER CONTINUIUM AND PROVIDING RESEARCHES TEMPLATES R01 APPLICATIONS PROVIDING TEMPLATES FOR TYPES OF APPLICATIONS THAT ARE QUITE DIFFERENT THAN STANDARD [INDISCERNIBLE] NIH HAS WORKSHOPS WHERE THEY TALK ABOUT HOW TO ENGAGE NIH AND APPLY PROGRESSING THE SYSTEM AND PERHAPS ALSO INCLUDING MECHANISMS OR TOPICS ON THE EARLY INDEPENDENCE AWARD SO THAT IN FACT INSTITUTIONS CAN SEND STUDENTS TO LEARN ABOUT THIS VERY UNIQUE CAREER ADVANCEMENT OPPORTUNITY. I MENTIONED THE IDEA OF HAVING WEBSITES WITH PROTOTYPE GRANTS THESE ARE DIFFERENT IN R01 AND K APPLICATIONS THAT WOULD BE VERY HELPFUL. WE TALKED ABOUT HR AND HR APPLICATION FEATURES PERHAPS AS A WHOLE COULD BE APPLIED MORE BROADLY TO OTHER NIH MECHANISMS AND OTHER ICS AGAIN HAVE INNOVATIVE REVIEW PROCESSES AND WE KNOW [INDISCERNIBLE] AND WE HAD DISCUSSIONS WITH THEM ON THEIR X02 MECHANISM AND NEW INNOVATIVE FEATURE SHOULD APPLY TO SPECIAL AWARD TYPE FOR EARLY INVESTIGATOR OR STAGE INVESTIGATOR SPECIFICALLY THAT MAY BE AGAIN RELEVANT TO MECHANISMS LIKE THE CATS AWARD. WITH REGARDS TO BIAS DIVERSITY OF APPLICANT AND AWARDEE POOL, THE AVERAGE REPRESENTATION OF FEMALE AND UNDER-REPRESENTED MINORITIES IN THE APPLICANT POOL IS REFLECTED IN THE POOL EVEN THOUGH THERE IS FLUCTUATION FROM YEAR TO YEAR AND THE ONLIACCEPTION WAS THE EARLY INVESTIGATOR TO EARLY INDEPENDENCE AWARD. WE AGAIN ENCOURAGE CONTINUED REVIEWER EDUCATION AND TRAINING. SO THAT THERE -- WE MINIMIZE BIAS AT THAT LEVEL. WE ALSO TALKED ABOUT THE IDEA OF PIONEER AND EARLY INDEPENDENCE AWARDS SPECIFICALLY THIS IDEA OF ANONYMOUS AWARD FOCUSED INITIALLY ON JUST SCIENTIFIC MERIT AND THEN A SCIENTIFIC APPROACH I WOULD SAY AND MOVING TO MORE THE PERSON OR INDIVIDUAL IN THE SECOND PHASE EDITORIAL TYPE OF LEVEL OF REVIEW. I THINK WITH REGARDS TO DIVERSITY OF REVIEWERS WE DIDN'T FLIEND WAS A MAJOR PROBLEM BUT CONTINUE TO IMPROVE RACIAL AND ETHNIC DIVERSITY IN THE REVIEW PANEL AND WE LOOKED AT THIS AND THEY SHOULD BE EXPERTS IN VARIOUS BACK GROUNDS TO REVIEW APPLICATIONS OF HR PROGRAMS AND WE SHOULD HAVE INSTITUTIONAL DIVERSITY FROM REVIEWERS WITH REGARDS TO DIFFERENT HOME INSTITUTIONS AND ORGANIZATIONS FROM HIGHLY RESOURCE VERSUS LESS WELL-RESOURCED ORGANIZATIONS. NOT ONLY SHOULD WE STIMULATE THE APPLICANT POOL BUT ENSURE REVIEWER POOL CONTINUES TO BE DIVERSE. THIS SHOULD BE TRIED. THIS IS HAPPENING AND WE SHOULD CONTINUE TO DO THIS. WITH REGARDS TO THE BIAS OF THE TOPIC, I THINK WE, AGAIN, ACKNOWLEDGE THERE IS BIAS IN TOPICS AWARDS BOTH IN TEFRMS OF APPLICATION AREAS AS WELL AS WHAT HAS BEEN AWARDED. NO QUESTION THAT CLINICAL STUDIES TEND TO BE UNDER-REPRESENTED AS BEHAVIOR SOCIUS YO LOGICAL AND [INDISCERNIBLE] TOPIC THAT ARE IMPORTANT TO THE MISSION OF NIH AND IS RELEVANT TO CONVERSATION WITH UNDER-REPRESENTED POPULATIONS. SO WE RECOMMEND A SPECIAL TRACK THAT IS SEPARATE HRHR PROGRAM THAT FOCUSES ON CLINICAL OUTCOMES WHICH COULD ALSO PERHAPS BE A SEPARATE REVIEW TRACK AND IMPORTANT IN FOAS THEMSELVES FOR CALL FOR HRHR AWARDS TO STRONGLY REITERATE ALL TOPICS ARE WELCOME AND UNDER-REPRESENTED TOPICS SPECIFICALLY WOULD BE HIGHLIGHTED IN FOAS, SORT OF THE OUTCOME OF THIS ANALYSIS. THEN TO CONTINUE TO ENSURE REVIEW EXPERTISE IN TOPICS UNDER-REPRESENTED IT GETS AT THE PROBLEM WHERE YOU HAVE AN OVERREPRESENTATION OF THE -- ONE TYPE OF WORK AND THAT MAY EFFECT REVIEW OF OTHER TYPES OF WORK THAT IS LESS WELL-REPRESENTED. FINALLY, I WOULD SAY THE HOT TOPIC OF GEOGRAPHIC AND INSTITUTIONAL DIVERSITY WHERE CURRENTLY HRHR AWARDEES PRIMARILY REPRESENT A SUBSET OF INSTITUTION AND WELL RESOURCE WE ULTIMATELY DECIDED TO MAKE THE RECOMMENDATION THAT WE ELEVATE INSTITUTIONAL DIVERSITY AS A PROGRAM PRIORITY TO ASK PROGRAM AT THAT LEVEL TO MAKE THIS A PRIMARY CONSIDERATION AS OPPOSED TO RECOMMENDING HARD CAP IF IN TERMS OF NUMBER OF APPLICANTS FROM INSTITUTION EITHER ABSOLUTELY OR CALIBRATED FOR SIZE OF THE INSTITUTION. THERE ARE MANY REASONS FOR THIS WHEN WE COULD CERTAINLY DISCUSS IT. ONE OF THE MAJOR I THINK POINTS THAT I THINK SWAYED THE GROUP WAS THAT IF YOU LOOKED AT THE HISTORY OF THE MECHANISMS FOR EXAMPLE HHMI HAD SUCH A CAP WHERE ONE INSTITUTION AND ONLY INSTITUTION COULD NOMINATE ONLY TWO MANY YEARS PRIOR TO THE OPEN SELF NOMINATION PROS THAES IS EFFECT TODAY THEY CAN BE BEYOND CONSEQUENCES IN TERMS OF REALLY HAVING THE OPPOSITE EFFECT IN TERMS OF DIVERSITY AT INSTITUTIONAL LEVEL THOSE OF US THAT REMEMBER THAT PERIOD OF TIME THERE WAS LOTS OF POLITICKING AND WHICH HAD NEG INFLUENCES ON THIS. WE TRIED TO REACH OUT TO THEM TO GET DATA AND HOW IT HAS BEEN SINCE THEY INITIATED THE OPEN NOMINATION PROCESS AND WE WEREN'T SUCCESSFUL IN GETTING THAT. >> CAN I SPEAK TO THAT. >> SURE. >> I TALKED TO ERIN YESTERDAY ABOUT THIS VERY THING. >> SURE. >> GEOGRAPHICAL DIVERSITY HAD GONE DOWNHILL SHE SAID AND EVERYTHING WAS GOING TO THE COAST NOW AS A RESULT OF THIS. >> OF THE OPEN NOMINATION. >> YEAH. >> THAT IS INTERESTING. >> IT HAD GOOD EFFECTS IN SOME WAYS AND I THINK THEY WILL STAY WITH IT BUT IT ALSO HAD SOME NOT SO GREAT EFFECTS THAT SPEAK TO THIS ISSUE. >> YEAH. I REACHED OUT TO HER. SHE DIDN'T PROVIDE THE DATA. IT WOULD BE INTERESTING TO SEE THE DATA. THAT IS THE ONLY SORT OF EXAMPLE WHERE THERE HAS BEEN THIS TRANSITION. >> THEY HAVE IT. >> YEAH. I'M SURE THEY DO. BUT RELEVANT TO THIS WE WERE COG NIZANT IN MAKING SUCH RECOMMENDATION WE WOULD HAVE IMPACT IN THE PROCESS AND BEING COG NIZANT WE WANT TO SUPPORT THE PILLAR OF NIH WHICH IS MERIT. THEREFORE, I THINK IT IS KEY TO REEVALUATE THIS ISSUE IN A SET PERIOD OF TIME. UNFORTUNATELY IT IS A LONG PERIOD OF TIME TO GET ENOUGH DATA FOR PROGRAMS THAT ARE RELATIVE WILL I SMALL IN SIZE TO GET A SENSE WHAT IS THE EFFECT OF THIS. ALSO, WE FELT WE WANTED TO MAKE A COMMENT AND WE APPRECIATE AND RECOGNIZE THIS WAS ALSO BEING DEALT WITH ANOTHER WORK GROUP. IT IS IMPORTANT TO ALSO ADDRESS THIS GIVEN THE CONTEXT OF THE CURRENT PROGRAM. REQUIRE HRHR GRANTEE ORGANIZATION TO PROVIDE [READING FROM TEXT] UP TO DATE POLICIES TO PRESERVE AND HOUSE FREE ENVIRONMENT AND THAT TOO IF A GRANTEE INSTITUTION WERE TO BECOME AWARE OF HARASSMENT FINDINGS RELATED TO HRHR GRANTEE ALERT AND WORK WITH NIH TO ARBITRATE THE SITUATION WE WILL HEAR MORE FROM THE OTHER WORK GROUP ON THIS I'M SURE. WITH THAT I WANT TO FINALLY ACKNOWLEDGE THE NIH GROUP. I THINK LARRY'S STAFF AND JESSICA MADZ RICK HAS BEEN AMAZING AND JIM ANDERSON'S WHOLE GROUP HAS BEEN GREAT IN PROVIDING ALL OF THE DATA. THANK YOU. >> AUDIENCE: [APPLAUSE]. >> FRANCIS S. COLLINS: THANK YOU FOR THE THOUGHTFUL PRESENTATION I KNOW THE HARD WORK THAT WENT INTO IT CH. I UNDERSTAND SANDRA SHA MITTS IS ON THE PHONE AND WELCOME ALSO IF SHE WOULD LIKE TO CONTRIBUTE TO SAY WORK ABOUT THIS PARTICULARLY REMARKABLE GROUP. AMY IS DECLINING. >> AUDIENCE: [LAUGHING]. >> FRANCIS S. COLLINS: SANDRA, ARE YOU THERE? NAME TAGS ARE UP. I WILL START WITH JUDITH AND WORK AROUND. >> CAN I MAKE A PLEA, BE RUDE AND TALK INTO THE MICROPHONE AND DON'T LOOK AT THE SPEAKER. >> I WILL TRY TO DO IT ALL. >> THANK YOU. >> I AM A HUGE PROPONENT OF HRHR PROGRAMS. I WOULD LOVE TO SEE THEM EXPANDED AND LOVE THAT RECOMMENDATION YOU HAVE. I AM CURIOUS ABOUT THEIR CURRENT SIZE. HOW MANY WERE AWARDED IF IN 2019 FOR EACH OF THESE, NO. 1. I KNOW SOME OF THEM ARE COMING OUT OF THE DIRECTORS COMMON FUND. WHAT ARE THE PROSPECTS FOR SPANNING THEM ACROSS THE DIFFERENT INSTITUTES? I KNOW THERE IS A NEW DP2 LIKE AWARDS COMING OUT IN DIFFERENT INSTITUTES. WHAT IS THE -- THIS MAY BE MORE OF A QUESTION FOR YOU FRANCIS OR LARRY BUT WHAT IS THE SORT OF LANDSCAPE AMONG THE INSTITUTES FOR PROPELLING THESE FORWARD. >> I CAN MAKE A COMMENT AND GIVE IT TO THE EXPERTS. WE DISCUSS THIS ISSUE NUMBERS IF YOU LOOK UP ALL FOUR PROGRAMS YOU ARE TALKING NUMBERS OF 20 TO 30 OR 40. WE ARE NOT -- I DON'T THINK -- RIGHT. I THINK THEY ARE COMING FROM THE COMMON FUND AND OPPORTUNITY FOR ICS TO TAKE ELEMENTS AND FUND THEM IS MY UNDERSTANDING BUT MATT PLEASE AND OTHERS. >> MAYBE MIKE LOUER CAN SUMMARIZE WHAT HAS BEEN HAPPENING INSTITUTES HAVE GOTTEN INTO ALL THIS IT IS CALLED R35. >> RIGHT. R35 AWARDS IS AWARDS FOCUSING ON PROGRAM AS OPPOSED TO SPECIFIC PROJECTS AND NIG [INDISCERNIBLE] HAS GONE FURTHEST WITH THOSE THERE IS IN ADDITION TO R354 ESTABLISHED INVESTIGATORS A RATHER LARGE R35 PROGRAM FOR EARLY STAGE INVESTIGATORS GIVING OUT ABOUT 100 AWARDS A YEAR. THAT IS FAIRLY -- THOSE ARE MIRRORS AND IT IS A SUBSTANTIAL PROGRAM AND THERE ARE ALSO OTHER [INDISCERNIBLE]. HRL HAS R35 FOR NHLBI HAS R35 FOR EARLIER CAREER INVESTIGATORS NOT NECESSARILY EARLY STAGE INVESTIGATORS I POINT OUT ALSO THE NGRI WORKING GROUP IS PART OF THEIR RECOMMENDATIONS SPECIFICALLY FOCUSED ON EARLY INEVATOR AWARD AND TALKED ABOUT EXPANDING IT TO R01 PROGRAM TO A LARGE EXTENT IT WOULD BE WHAT STEVE AND IRA CATS AWARD WOULD BE WE HAVE PEOPLE INVOLVED IN DEVELOPMENT OF THE PROGRAM HELPING US THINK THAT THROUGH. >> I HAD TWO SMALL QUESTIONS ONE RELATED TO THE LAST POINT WAS THERE ANY DISCUSSION ON NEWANCE HOW MUCH TO EXPAND THEM BY DOUBLING AND TRIP WILLING AND ALSO HOW TO DIFFERENTIATE BETWEEN THE -- YOU KNOW WAS THERE CLARITY WHICH OF THE FOUR PROGRAMS AND WHICH SUBSET WAS MORE SUCCESSFUL IN TERMS OF THINKING ABOUT EXPANSION? >> YEAH. WE DID NOT TALK ABOUT HOW TO EXPAND IT THAT IS PARTLY BECAUSE OF FUNDING AND SO FORTH. WE DIDN'T GET INTO THAT. LE I THINK SIMILARLY, WE WERE -- WE DIDN'T MAKE A SPECIFIC RECOMMENDATIONS OF WHICH ONE SHOULD EXPAND BUT THERE WAS A RECOMMENDATION ON CLINICALLY-FOCUSED AWARDS WHICH IS AN EXPANSION AND IT WOULD BE AN ADDED TRACK. I THINK THERE WAS CERTAINLY SUPPORT FOR ESPECIALLY NEW INNOVATOR AND EARLY INVESTIGATORS AGAIN OVERLAPPING WHAT IS DONE WITH MIXED GENERATION RESEARCHER INITIATIVE AND QUICK QUESTION ON INSTITUTIONAL DIVERSITY QUESTION OF CONCERN IS IT DOESN'T HAVE ANY TEETH. DOES THAT -- IS THAT THE RECOMMENDATION THAT WOULD IT BE IMPLEMENTED AT FRONT END YOU ARE ENCOURAGING MORE DIVERSE APPLICATIONS OR BACK END PROGRAM OFFICERS CAN GO IN ORDER TO FACILITATE OR TO DRIVE TO THAT END POINT. >> WE ARE FOCUSING ON THE BACK END AND CERTAINLY THE FRONT END WILL HAPPEN AS PART OF OUR ENGAGEMENT AND YOU KNOW ENGAGING COMMUNITY TO INCREASE APPLICATION POOL. I THINK THE SPECIFIC DISCUSSION ABOUT THE BACK END. WE HAD ROBUST DISCUSSIONS AND CONCERN WAS WELL YOU KNOW THAT IS CONSIDERED ANYWAY RIGHT NOW. IDEA IS TO REALLY ELEVATE IT AS A PRIMARY YOU KNOW METRIC IF IN CONSIDERATION BY PROGRAM. MY UNDERSTANDING IS THAT IS QUITE DIFFERENT THAN CURRENT CONSIDERATION OF GEOGRAPHIC DIVERSITY. LARRY DID YOU WANT TO ADD TO THAT? >> FRANCIS S. COLLINS: JUST RIGHT. IT IS BOTH. YOU HAVE TO DO BOTH. >> LET ME SAY IN REGARD TO EXPANDING PROGRAMS WHICH CLEARLY AS YOU SAW DATA INDICATES FOR AT LEAST A COUPLE OF THEM THAT HAD BEEN EVALUATED IN TERMS OF PRODUCTIVITY THESE ARE REAL AND WONDERFULLY PRODUCTIVE COMPARED TO GOLD STANDARD OF R01 PROBLEMS YOU ARE TALKING ABOUT IN THIS REVIW ARE PART OF THE COMMON FUND THESE FOUR INITIATIVES COMMON FUND HAS A FIXED BUDGET. EXPECTATION WOULD HAVE TO BE IF WE SEE SIGNIFICANT EXPANSION OF THESE THEY NEED TO SPILL OVER INTO SUPPORT FROM THE INSTITUTES AS IS HAPPENING WITH R35S THAT YOU HEARD ABOUT WHICH IN MANY WAYS ARE BUILT OFF SUCCESS OF PIONEER PROGRAMS WHICH ARE ONES THAT HAVE BEEN AROUND THE LONGEST. KEEPING IN MIND IN TERMS OF WHERE OUR FLEXIBILITIES ARE. THE AMOUNT THAT IS CURRENTLY GOING INTO THIS IN THE COMMON FUND WHAT PROPORTION IS THAT BETSY PART OF THE 1/3% OF IT GOES INTO COMMON FUND PROGRAMS SUPPORTING BIG INITIATIVES MICROBIOME AND 40 [INDISCERNIBLE] IT WOULD NEED A BROADER EMBRACE WHICH HAS BEEN HAPPENING BUT RECOMMENDATIONS ARE UNDOUBTEDLY BEING NOTICED BY INSTITUTE DIRECTORS AS WELLIST. I HAVE JOSE AND SHELLY AND JUDITH. >> TWO QUESTIONS GREAT PRESENTATION AND FANTASTIC NICE TO SHEE HOW IT OVERLAPS WITH WORKING GROUPS DIVERSITY AND G POOL AND FIRST ON POTENTIAL EFFECT OF DROPPING INTERVIEW ON SUCCESS OF WOMEN APPLICANTS EARLY INDEPENDENCE. SIMILAR SHIFT WAS FOR PIONEER AWARD IN SAME YEAR 2018 LARGER REPRESENTATION OF WOMEN. >> YOU SEE A SIMILAR TREND IN A DIFFERENT GROUP THAT DIDN'T DRAFT INTERVIEWS ONE EVENT AND ONE EVENT. >> YEAH. I THINK ISSUE WITH EARLY INDEPENDENCE IS THAT IS A STATISTICALLY SIGNIFICANCE IN THE DECREASE. THERE WAS QUITE A DRAMATIC CHANGE. THE NUMBER OF APPLICANTS WOMEN IF IN THE EIA WAS 40% AROUND THERE GIVE OR TAKE. IT DROPPED SIGNIFICANTLY TO THE AWARDEE. OTHERS STAYED ABOUT THE SAME ON AVERAGE 30% ALL THE WAY ACROSS. >> OKAY. SECOND QUESTION IS DO YOU REALLY THINK DROPPING BIOSKETCH? LOTS OF INFORMATION FROM APPLICANT I CAN GET -- PUBLICATION LIST AND INSTITUTION YOU CROSS THOSE TWO PRETTY MUCH. >> THAT IS A VALID POINT. I PARTICIPATED IN THE PIONEER PROCESS NOT PIONEER AWARD PROCESS XO2 REVIEW THAT [INDISCERNIBLE] INITIATED. WHAT I WOULD SAY IS THAT YOU ARE RIGHT. YOU ELIMINATED BIOSKETCH AND AUTO MIEZ IT AND TRY TO DO REVIEW OF THE APPROACH AND SCIENCE ON ITS OWN BUT YOU OFTEN CAN GUESS WHO IT IS. YOU DON'T WANT TO GET IN THE GAME OF GUESSING HOW YOU ACCEPT THAT YOU DON'T KNOW I WOULD ALSO ADD PERHAPS THAT IS MORE RESTRICTED TOPICAL AREA PERHAPS IN THE CONTEXT OF THE BROAD SWATH OF INFORMATION AND TOPICS COVERED BY THESE MECHANISMS MAY NOT BE SO MUCH THE CASE. I THINK WITHIN THE CONTEXT OF ONE INSTITUTE YOU KNOW PEOPLE ARE FAMILIAR WITH THE TYPE OF WORK GOING ON. THAT MAY BE LESS SO IN A MORE GENERAL TYPE OF REVIEW PROCESS BUT POINT IS WELL-TAKEN. >> FRANCIS S. COLLINS: SHELLY. >> I WONDERED IF YOU COULD EXPAND A LITTLE ON THE IDEA TO EXPAND THE CLINICAL AREA. I'M A HUGE FAN OF THIS MECHANISM AS WELL I FEEL HHMI CREATED A BIT AF HAVE AND HAVE NOT SITUATION FOR BASIC RESEARCH AND SUPPORT FOR BASIC RESEARCH. THIS MECHANISM IS PRETTY MUCH REALLY HELPED TO LEVEL THE PLAYING FIELD. I THINK THAT ESPECIALLY GIVEN WHAT JUDITH JUST SAID ABOUT THE HAD HHMI FUNDING, AGAIN, BEING CONCENTRATED ON THE COAST, I THINK THIS IS REALLY IMPORTANT TO MAINTAIN FUNDING FOR BASIC RESEARCH THROUGH THIS MECHANISM AND IF INDEED THERE WILL BE A CEILING TO THIS TYPE OF FUNDING. I THINK IT IS REALLY IMPORTANT TO CONSIDER HOW MUCH TO DEVOTE TO CLINICAL RESEARCH WHICH MY VIEW IS THERE IS LOTS OF MONEY GOING TO CLINICAL RESEARCH THROUGH NIH. I WONDER IF WE COULD HAVE A LITTLE DISCUSSION ABOUT THAT NOW. >> ABSOLUTELY THAT IS A FAIR STATEMENT. IF YOU LOOK AT THE TOPIC IN NATURE YOU ARE ABSOLUTELY CORRECT AND RIGHT IN TERMS OF CHARACTERIZATION THAT HAS BEEN MORE BASIC/TRANSLATIONAL IN -- IF YOU LOOK AT HEAT MA MAP AND SO FORTH IF YOU LOOK AT HOW -- I DON'T THINK A CLINICAL RESEARCH TRACK AND I'M SORT OF -- MY VIEW THIS IS MY VIEW AS OPPOSED TO THE COMMITTEES I DON'T THINK WE GOT INTO DISCUSSING WHETHER IT WOULD BE BAD. I THINK THE THOUGHT WAS TO ADD ADDITIONAL NOT TO -- I THINK THERE WAS NO DISCUSSION THAT WE WOULD CHANGE THE MIX NECESSARILY BUT TO ADD TO IT IN DISCUSSING RELATIVE MERITS IN THE RECOMMENDATION IT WOULD MEAN ADDED RESOURCE. LARRY? >> BEAUTY OF BEING ON ACD WORKING GROUP IS YOU DON'T HAVE TO WORRY ABOUT THE BALANCE AND FACT WE HAVE A FINITE RESOURCE DONE IT IS GOOD TO DO THOUGHT EXPERIMENT YOU HAVE INFINITE RESOURCES SO HOW WOULD YOU PROCEED? NOW ASSUMING RECOMMENDATIONS ARE CONCURRED WITH, THEN OF COURSE, YOU KNOW, NIH LEADERSHIP AND ULTIMATELY FRANCIS HAVE TO COME TO GRIPS WITH OVERLAY THEY ARE FINITE RESOURCES AND YOU HAVE A BALANCE. THE COMMITTEE NEVER CONSIDERED ONE PIT AGAINST THE OTHER. YOU HAVE TO KEEP THAT IN MIND. >> I THINK IT WAS CLEARLY NOTED IN OUR ANALYSIS TYPE OF RESEARCH FUNDEDINO VATOR AND PIONEER WASN'T CLINICAL IN NATURE THAT MIGHT BE MORE THE CASE FOR PERHAPS TRANSFORMATIVE. IF YOU GO LOOK AT ANALYSIS, INNOVATOR AWARD WAS LESS IMPACTFUL FROM A CLINICAL PERSPECTIVE. IT IS THE NATURE WHERE THESE GRANTEDS ARE AT THIS STAGE AND HIGH IMPACT AND THAT IS TECHNOLOGY FOCUS. >> ARE YOU REFERRING TO DATA YOU PRESENTED TECHNOLOGICAL AND CLINICAL IMPACT DATA. >> CORRECT. YEAH. >> SO I WAS THINKING ABOUT THAT. I THINK THE TIMELINE TO IMPACT INTO CLINICAL IMPACT IS SO LONG. >> YUP. >> WE KNOW WE CAN CITE KRIS PER IS A RECENT EXAMPLE MANY, MANY EXAMPLES OF THIS. IT IS IMPORTANT NOT TO USE THAT AS A METRIC FOR OVERALL YOU KNOW FUNDING IN MY OPINION. >> WE HEAR YOU. ABSOLUTELY. JUDITH? >> I WANTED TO COMMENT ON WHAT YOU BROUGHT UP, WHICH IS THIS QUESTION OF BASIC VERSUS CLINICAL. I'M DEFINITELY ON THE -- MY MAN THAT IS BASIC SCIENCE IS THE FOUNDATION FOR CLINICAL. I TALK TO EVERYBODY AND THEY AGREE WITH THAT. I'M DELIGHTED TO HEAR THAT. I WORRY IF WE HAVE SPECIAL CLINICALLY DRIVEN DV2S AND OPEN TO OTHER ICS WHICH WE HAVE TO DO TO GET THE MONEY THAT IS WHAT THEY WILL WANT TO DO AND IT WILL DRIVE THIS WHOLE PROGRAM TO A MORE CLINICAL LEVEL. I THINK THERE IS A CAUTIONARY NOTE THERE. THE OTHER QUESTION I HAD ABOUT THE -- YOU SAID A LOT OF THE SAME TOPICS WERE BEING FUNDED. I'M CURIOUS TO KNOW HOW THE REVIEW PROCESS IS GOING AND WHETHER OR IF NOT SELECTION OF THE REVIEWERS HAS ANYTHING TO DO WITH THE SELECTION OF WHO IS GETTING THESE AND I KNOW THAT SOME PEOPLE WHO I KNOW LOOK AND SAY THERE HAS NEVER BEEN A DP2 AWARDED IN MY FIELD I WON'T BOTHER IT IS A WASTE OF TIME. THOSE PEOPLE DON'T APPLY OR GET -- YOU DON'T GET REVIEWERS. I THINK THE QUESTION OF THE BREADTH OF REVIEW FOR THE SMALL PROGRAM IS A REAL ISSUE I'M CURIOUS ABOUT. >> WE LOOK VERY CAREFULLY INTO THAT AND HAVE LOTS OF DATA ON MATCHING OF THE KWLUFTER TOPIC OF REVIEWERS WE DIDN'T GET TO THE LEVEL OF LOOKING AT NAMES FOR LOTS OF PRIVACY REASONS FOR WHO WERE THE REVIEWERS AND CERTAINLY IN TERMS OF REPORTED DATA AND IN TERMS OF MATCHING EXPERTISE OF REVIEWERS WITH APPLICANT POOL THERE WAS NO DIFFERENCE WE COULD ASCERTAIN. >> AGAIN, SINCE R SINCE WE -- WE -- BETSY AND MYSELF AND TAIRA ALL OF UZ, WE ALL LOOK AT WHO THE REVIEWERS ARE. IT IS DRIVEN BY THE APPLICATION NOT THE REVERSE. YOU GET A CORPUS OF APPLICATIONS THAT IS THEN THAT YOU DECIDE WHO THE REVIEWERS SHOULD BE. WHAT YOU DO IS PUT THIS TOGETHER A CADRE OF REVIEWERS WITH SUFFICIENT BREADTH. >> AND UNDERSTOOD THE MALE REVIEW PHASE REVIEW ELEMENT IT IS VERY BROAD TO MATCH THE EXPERTISE SO SORT OF THAT TECHNICAL REVIEW THAT DOES ACCOMMODATE A BREADTH OF TOPICS. >> SO I ALSO WANTED TO JUST SAY THAT I -- IN THINKING ABOUT NIH AND REVIEW PROCESS I DECIDED TO GO AND REVIEW AND EXPERIENCE OTHER REVIEW PROCESSES I REVIEW ERC IN BRUSSELS AND I'M ON A WELCOME TRUST PANEL AND FIND IT VERY INTERESTING AND DIFFERENT. THEY USE INTERVIEWS HEAVILY. IT IS VERY PRODUCTIVE. SO JUST FOR WHAT IT IS WORTH. >> YEAH. I THINK WE CAN AGREE THAT INTERVIEWS CAN BE INCREDIBLY VALUABLE. 76 APPLICATIONS FOR -- IT IS A LITTLE UNIMAGINABLE. GEORGE HILL CAME TO THE MICROPHONE. >> THANK YOU VERY MUCH. MY NAME IS GEORGE HILL FROM VANDERBILT UNIVERSITY AND I HAVE BEEN THERE 15 YEARS AND JUST RETIRED AND AT HARRY FOR 19 YEARS. I HAD A COUPLE COMMENTS FOR FRANCIS THAT APPRECIATE THE OPPORTUNITY FIRST OF ALL IT IS VERY CLEAR OVER THE LAST THREE OR FOUR REPORTS THAT WE HAVE RECEIVED THAT THERE IS A THOUGHTFULNESS ABOUT HOW DO WE GET BROADER IMPACT AND BROADER REPRESENTATION AMONG INDIVIDUALS IN YOUR REPORT AND HANNAH'S REPORT AND REPORT ON AI IS QUITE DIFFERENT THAN 10 OR 15 YEARS AGO. IT IS -- IT IS -- IT IS JUST CLEAR WITHOUT ANY QUESTION. I COMPLEMENT FRANCIS AND DIRECTOR AND ALL OF YOU FOR THAT EFFORT. SECOND, IT IS CLEAR THAT IT IS A REAL CHALLENGE. IN HANNAH'S REPORT, IT WAS REALLY ENLIGHTENING WE ARE MAKING SOME PROGRESS. THAT IS VERY POSITIVE. I HAVE A COUPLE POINTS I WANTED TO SHARE. THE FIRST IS THROUGHOUT SOME OF THE REPORTS, S THERE IS A MESSAGE THAT SEEMS TO BE MIRRORED IN EXCELLENCE AND ARE CRITICALLY IMPORTANT AND THAT WE KEEP IT IN MIND AS WE INCREASE DIVERSITY AND REPRESENTATION. I THINK THAT IS A PRETTY BAD MESSAGE TO SEND BECAUSE IN AI REPORT I THOUGHT WAS FANTASTIC IN ONE OF THE SLIDES NOTED GREATER AND BROADER THE PARTICIPATION THE GREATER EXCELLENCE YOU HAVE. SO IT -- IT KIND OF -- IT CONCERNS ME THAT WHEN WE ARE TALKING ABOUT THESE TYPE OF TOPICS, WE HAVE TO REMIND EVERYONE THAT WE ARE INTERESTED IN MERIT AND EXCELLENCE. EVERYBODY IN THE ROOM IS. I HOPE THAT AS WE THINK ABOUT AND PARTICIPATE ON PANELS AT OUR INSTITUTIONS THAT WE KEEP THAT IN MIND. THEY ARE NOT EXCLUSIVE, OBVIOUSLY. INCLUSIVE SCOMPL EXCELLENCE IS EXACTLY WHAT IT SAYS. THE SECOND POINT IS IN SEVERAL OF THE PRESENTATIONS THERE WAS AN INTEREST IN PARTNERING. YOU TOUCHED ON IT IN OUR DISCUSSIONS YESTERDAY. HANNAH'S GROUP TOUCHED ON IT. THAT IS PARTNERING BETWEEN HIGH LIE RESOURCED INSTITUTIONS AND INSTITUTIONS WITH LIMITED RESOURCES WHICH IS A REALLY IMPORTANT POINT TO KEEP IN MIND AND MAY HELP TO ADDRESS SOME OF THE CHALLENGES YOU ARE SEEING AND THERE HAVE BEEN EXAMPLES INCLUDING MARY VANDERBILT WORKING TOGETHER THAT REALLY MAKE THAT POINT SO THAT IF WE ARE INTERESTED IN HAVING HIGH RISK AND HIGH REWARD AND HAVING A QUALIFICATION OR GUIDELINE THAT SAYS THERE NEEDS TO BE SOME TYPE OF TEAMING, THAT IS, YOU KNOW, VERY HELPFUL. IN FACT, WE DO THAT IN CTSAS WHICH HAS REALLY A VERY POSITIVE EFFECT. I THINK THAT CONSIDERATION IS IMPORTANT. THE LAST POINT I WOULD MAKE IS THAT YOU POINTED O OUT IN YOUR REALLY THOUGHTFUL REPORT MAYBE THERE COULD BE A MODEST SUGGESTION WITH REGARDS TO INCREASING NUMBER OF UNDER-REPRESENTED APPLICATIONS OR DOING SOMETHING ABOUT THAT AND EVALUATING IN 10 YEARS. MOST OF THE PEOPLE IN THE ROOM WON'T BE SCIENTISTS ANYMORE. >> AUDIENCE: [LAUGHING]. >> ONE SITTING ON THE TABLE. >> THAT WAS ABOUT INSTITUTIONAL DIVERSE IT I. >> YES. MY POINT IS SERIOUSLY THAT 10 YEARS IS A LONG TIME TO EVALUATE ANYTHING. >> AUDIENCE: [LAUGHING]. >> 10 YEARS IS A LONG TIME TO EVALUATE ANYTHING. I THINK IT IS REALLY IMPORTANT THAT WE REALLY, REALLY, REALLY INTENTIONAL AS WE HAVE BEEN SITTING AT THE OFFICE, ET CETERA, IN WHAT WE DO. AGAIN, I THANK YOU VERY MUCH. >> FRANCIS S. COLLINS: THANKS, GEORGE. >> WITH REGARD HE RAISED IT I WOULD BE CURIOUS BEN DAN IF YOU CAN SAY A WORD ABOUT THIS -- UNDERRESOURCE INSTITUTION AND RESOURCE INSTITUTION AND ADDRESSES DIVERSITY IN THE BROADER SENSE CAN YOU SAY SOMETHING MORE ABOUT THE DISCUSSION AROUND THAT PARTICULAR RECOMMENDATION. >> YEAH. AGAIN I THINK IT WENT BACK AND FORTH WE WERE WORRIED ABOUT THE IDEA THAT IN FACT WE PROPAGATE WELL RESOURCED AND UNDER RESOURCED IN TERMS OF HOW SHARING AND PARTNERSHIP WOULD WORK WE WERE VERY SENSITIVE TO THAT. WE VIEWED IT -- SUCH A PROGRAM WOULD HAVE TO HAVE EVIDENCE OF TRUE EQUAL PARTNERSHIP. WOW THINK IT WOULD BE OBVIOUS AND WE DID HAVE DISCUSSIONS ABOUT THAT ELEMENT AND WE THOUGHT IT WAS BROADER SENSE OF DIVERSITY AND WE THOUGHT IT WAS A GOOD MECHANISM TO NOT JUST ADDRESS POTENTIAL RESOURCE BUT AS YOU POINTED OUT POTENTIALLY ALSO UNDER-REPRESENTED GROUPS IT WAS A GENERAL APPROACH TO LOOK AT DIVERSITY BROADLY THAT WE HAD DISCUSSED AT EVERY LEVEL. IT WAS A STRATEGY. >> AMY, DID YOU WANT TO COMMENT? WAS THERE ANYTHING ELSE? >> I WOULD LIKE TO COMMENT ON IDEAS INCREASING SAY A CLINICAL MECHANISM. ONE OF THE CONCERNS THAT WAS RAISED IN THE GROUP WAS THAT MORE COMMUNITY FOCUSED OR COLLABORATIVE RESEARCH WASN'T BEING FUNDED UNDER THESE MECHANISMS WHICH COULD CONTRIBUTE TO REPRESENTATION OF UNDERREPRESENTATIONED GROUPS. >> SPERO. >> PERMITTED TO THE LAST POINT BRENDAN I THINK INSTITUTE OF -- HAS HAD A NUMBER OF LONGSTANDING FOAS AND INITIATIVES THAT REQUIRED THE KINDS OF PARTNERSHIPS YOU JUST DESCRIBED AND GEORGE WAS PROMOTING AND NUMBER OF LESSONS TO BE LEARNED FROM THAT THOSE PARTNERSHIPS HAVE BEEN CAREFULLY EVALUATED EMPIRICALLY RECENTLY AND THERE MAY BE IMPORTANT TAKEAWAYS FROM THAT PARTICULAR EFFORT IF THIS IS PURSUED IN THIS PARTICULAR EFFORT IT MIGHT BE VERY INSTRUCTIVE. >> FRANCIS S. COLLINS: ARE THERE OTHER COMMENTS ON THIS FINAL REPORT ON THE HRHR WORKING GROUP? >> THIS IS SANDRA SHA MITTS ONLINE I WAS INSPIRED TO PHONE IN AFTER WATCHING IT ON THE VIDEO. >> FRANCIS S. COLLINS: GOOD. THANK YOU. COMMENTS WOULD BE APPRECIATED IF YOU WOULD LIKE TO SAY. >> I WOULD LIKE TO UNDERSCORE WHAT BRENDAN SAID SEEMS A MAJOR CONCLUSION WAS THAT THE SUCCESS RATE WAS LARGELY PROPORTIONAL TO THE APPLICATION RATE IN TERMS OF DIVERSITY. AND THAT AN OUTREACH TO INSTITUTIONS ACROSS THE COUNTRY AND TO WOMEN AND MINORITIES WHEN YOU COME FROM AN INSTITUTION APPLYING FOR THE GRANTS AND SUCCESSFULLY GETTING THEM IN A PROPORTIONAL MANNER YOU CAN LOOK DOWN THE HALL AND FIND A SUCCESSFUL APPLICANT AND GET EXAMPLE OF SUCCESSFUL APPLICATION AND HAVE THOSE PEOPLE READ YOUR GRANT AND HELP YOU DO THE INTERVIEW PROCESS, ET CETERA, ET CETERA. SO A WAY TO DEM OK CATTIZE A LITTLE BIT THAT INSIDER INFORMATION AS THERE ARE A NUMBER OF GREAT WEBSITES AND N ICHLT H RESOURCES HOW TO WRITE AN R01 AND WHAT A GOOD ONE LOOKS LIKE AND ANNOTATED R01 PERHAPS SUCH RESOURCES FOR THE HRHR KINDS OF APPLICATIONS MIGHT INCREASE THE APPLICATIONS FROM GREATER DIVERSITY. >> GATT CHA. THANK YOU VERY MUCH. I UNDERSTAND DR. HILL DRETH HAS A QUESTION AS WELL. PLEASE. JAMES, WE ARE NOT HEARING YOU. WELL, MAYBE WE LOST THAT CONNECTION. >> [INDISCERNIBLE]. >> THERE YOU ARE. >> OKAY. I'M SORRY. I WOULD LIKE TO PROPOSE AN ALTERNATIVE TO THE IDEA OF MATCHING INVESTIGATOR AND WELL-RESOURCED INSTITUTION TO ONE THAT IS A RESOURCE INSTITUTION AND MODEL I HAVE IN MIND IS UNIVERSITY OF MARY LAND [INDISCERNIBLE] COUNTY WHO MIKE SUMMERS IS AMAZING [INDISCERNIBLE] INVESTIGATOR. I WAS BROUGHT THERE MANY YEARS AGO AND GIVEN THE RESOURCES HE NEEDED TO BE SUCCESSFUL. IMPACT IT HAD ON THE STUDENTS THERE PRIMARILY AFRICAN-AMERICAN IN TERMS OF GOING INTO MEDICAL RESEARCH HAS BEEN QUITE PROFOUND. OTHER THINGS THAT HAVE HAPPENED OF COURSE THAT I DO KNOW FOR A FACT THAT IS ONE OF THE THINGS THAT MAKES A HUGE DIFFERENCE. I WOULD SUGGEST THAT IS ANOTHER THING THAT MAYBE SHOULD BE CONSIDERED. IN ADDITION TO THESE MATCHING OF INVESTIGATORS AND TRYING TO FIND WAYS TO ENCOURAGE HIGH CALIBRATING INVESTIGATORS TO MAKE THE MOVE TO THOSE INSTITUTIONS. I THINK THAT WOULD BE A REAL EXCITING THING TO SEE. BASED ON THE MODEL THAT YOU AT NBC WOULD BE HIGHLY SUCCESSFUL. THAT IS MY COMMENT. THANK YOU. >> THANK YOU. NBC IS A REMARKABLE THING INDEED. HANNAH ISN'T THERE A MEETING COMING UP IN A COUPLE WEEKS WITH COMMENT JUST MADE WAYS THAT WE CAN REPLICATE THAT MODEL. >> YES. IN RESPONSE TO RECOMMENDATIONS BY ACD WORKING GROUP, WE PUT TOGETHER A SMALL MEETING IN WHICH WE WILL REALLY DIG DEEP IN TWO AREAS. ONE IS HOW -- WHAT ARE THE PROGRAMS THAT HAVE BEEN SUCCESSFUL FOR CREATING MORE PHDS IN THE [INDISCERNIBLE] RELEVANT TO NIH. OF COURSE, THE POSTER CHILD FOR THAT IS MEYER HOFF PROGRAM AND FREEMAN L. IS IN THAT MEETING BUT THERE ARE OTHERS AND SECOND AREA HAS TO DO WITH WHAT I TALKED ABOUT HAD HOW DO WE DO THE TRANSITION FROM THE POST DOC OR PHD TO THE INDEPENDENT ACADEMIC CAREERS. THERE ARE ACTUALLY SOME PROGRAMS OUT THERE. WE WILL DIG DEEP INTO THOSE THINGS THAT HAVE WORKED AND FIGURE OUT WHAT IS DISSEMINATING. ABOUT >> IS HANNAH GREY'S PROGRAM GOING TO BE DISCUSSED? >> I THINK IT HAS WE INVITED HHMI FOLKS. I CAN'T REMEMBER OFF THE TOP IT IS ONE OF THOSE THAT DOESN'T HAVE DEFINITIVE OUTCOMES YET IT HAS ONLY BEEN GOING FOR -- >> PEOPLE HAVE HAD FANTASTIC APPLICANTS AND THEY HAVE YOU KNOW HAD 15 WINNERS PER YEAR AND THEY WANTED TO HAVE 30 BUT DIDN'T HAVE MONEY FOR IT. IT IS CLEAR THAT THE PEOPLE ARE THERE AND IT IS VERY EXCITING. >> YES. THAT IS ABSOLUTELY -- I HEARD IT BEING PRESENTED. I THIS MANY OTHERS ARE LOOKING AT NEW PROGRAMS AND WE ARE LOOKING AT WHERE B IS THE EVIDENCE THAT SOMETHING IS ACTUALLY WORKING. SO -- >> [INDISCERNIBLE]. >> AUDIENCE: [LAUGHING]. >> NO. THERE CAN'T BE 10. GEORGE WON'T ALLOW 10. WELL, BRENDAN ANY FURTHER THINGS YOU WANT TO SAY BEFORE WE WIND THIS UP? AGAIN, MANY THANKS TO YOU. I DON'T THINK WE NEED A VOTE IN THIS SITUATION. WE HAVE SEEN A RECOMMENDATION FROM THE WORKING GROUP THEY ARRIVED AT AFTER MUCH DELIBERATION AND ACHIEVING FOR THE MOST PART CONSENSUS. YOU HEARD FROM LARRY IT IS NOW OUR JOB AND NOT AN EASY ONE TO TAKE WHAT IS A WONDERFUL SET OF RECOMMENDATIONS AND SEE IF WE CAN FIT IT WITHIN THE ENVELOPE OF RESOURCES THAT WE ACTUALLY HAVE. THIS HAS CLEARLY TURNED OUT TO BE A PROGRAM THAT HAS HAD REMARKABLE BENEFITS FOR SCIENCE AND BROUGHT NO OUR MIDST REAL TALENT WE WANT TO MAKE SURE AND LEARNED EVERYTHING WE CAN FROM THAT AND EXPANDED IT IN EVERY WAY WE SEE POSSIBILITY GIVEN REALITIES OF THE SITUATION. I'M GLAD WE ASKED THIS GROUP TO DO THIS HARD WORK AND HAD SUCH GOOD PEOPLE DOING IT THANKS BRENDAN AND LARRY AND SANDRA AND ANYBODY ELSE PART OF THIS THAT IS LISTENING TO THE VIDEO THIS HAS BEEN REALLY HELPFUL. WITH THAT WE ARE SOMEHOW BY MISTAKE GIVING YOU A LONG BREAK HERE UNTIL 3:45. MAYBE YOU NEED IT NOW TO TAKE CARE OF YOUR OTHER DAY JOBS IF YOU HAVE AN OPPORTUNITY TO MAKE PHONE CALLS OR E-MAILS WE WILL DO THAT I DON'T WANT TO START US SOONER THAN 3:45. PEOPLE HAVE SEEN THE SCHEDULE AND WATCHING BY VIDEO AND ARE INTERESTED IN THE NEXT SESSION STARTING PROMPTLY AT 3:45 WITH THE WORKING GROUP ON CHANGING THE CULTURE TO END SEXUAL HARASSMENT. WE ARE NOW GOING TO HEAR FROM CO-CHAIRS OF ACD WORKING GROUP ON CHANGING CULTURE TO END SEXUAL HARASSMENT IN THEIR INTERIM REPORT YOU WILL RECALL IF YOU HAVE PREVIOUSLY BEEN PART OF ACD THIS WAS A GROUP WE FELT STRONGLY WE NEED TODAY EMPOWER AND ASSEMBLE AND ADVISE US ABOUT ACTIONS WE NEED TO TAKE WITH REGARDING TO THIS REALLY VEXING AND UNACCEPTABLE SITUATION OF SEXUAL HARASSMENT IN THE SCIENTIFIC WORKFORCE. WE HAD A VERY VIGOROUS GROUP OF FOLKS. NOT WAITING UNTIL NEXT DECEMBER TO TELL US WHAT SOME THOUGHTS WERE WHILE THIS IS AN INTERIM REPORT YOU WILL HEAR SIGNIFICANT SUGGESTIONS AND MAKE SUGGESTIONS IS DOWNPLAYING A BIT INTENSETIVES WHICH THESE PARTICULAR PERSPECTIVES ARE BEING PUT FORWARD. WE HAVE GUN TO TAKE ACTION ON THINGS WE THOUGHT WERE MOST APPROPRIATE TO DO SO. IT IS A WORKING GROUP LIKE MANY OF THESE WE DON'T WAIT UNTIL THE END OF A PROCESS TO ACT WHEN WE SEE THINGS NEED TO BE ATTENDED TO. WE WILL HEAR FROM CARRIE WOLINETZ AS A CO-CHAIR AND FROM HANNAH VALANTINE ABOUT THE SESSION OF WORKPLACE RESULTS OF SURVEY WE GOT DATA BACK FROM NIH INTRAMURAL STAFF AND EMPLOYEES CONTRACTORS AND TRAINEES AND WE THINK YOU WILL FIND IT INTERESTING. I WILL KEEP AN EYE ON THE CLOCK. WHEN 5:15 OR SO I WILL TRY TO MAKE SURE WE SAVE TIME FOR THAT PRESENTATION. IT WILL ENGENDER LOTS OF DISCUSSION. WITH THAT INTRODUCTION AND MANY THANKS TO CARRIE AND FRANCIS AND CHRISTINA THAT WORKED HARD ON THIS GROUP, LET'S HEAR FROM CARRIE ABOUT WHERE WE ARE. >> THANKS FRANCIS. WE TRIED TO DIVIDE THIS BETWEEN CO-CHAIRS TO ROUGHLY A THIRD TO SEE HOW IT WORKS THIS IS A GOOD OPPORTUNITY TO EXTEND THANKS ON BEHALF OF US ALL DR. JENNIFER BLANK WHO IS IN THE AUDIENCE AS EXEC SEC IN THIS GROUP WE COULDN'T HAVE LIVED WITHOUT IT IS FAIR TO SAY AS WE HAVE DONE OUR WORK. I WANT TO START BY SAYING THAT THE ISSUES THAT ARE HANDED TO WORKING GROUPS OF ACD ARE NEVER EASY. WE REALLY DEPEND ON ALL OF YOU TO GIVE US THE BENEFITS OF YOUR DEEP THINKING ON LOTS OF THORNY ISSUES. THIS ONE IS ESPECIALLY HARD. IT IS HARD IN PART BECAUSE IT IS BARE LEGAL TO A BROADER SOCIETY CONVERSATION ABOUT THE ROLE OF WOMEN AND HOW THEY ARE TREATED. IT IS HARD BECAUSE IT BEGINS IT GET TO LOTS OF THE CULTURAL TOUCH STONES IN SCIENCE WE HOLD VERY NEAR AND DEAR AND IT IS HARD BECAUSE PEOPLE HAVE VERY STRONG VIEWS ON THIS SET OF TOPICS. AND BECAUSE CERTAINLY PEOPLE WHO WORK ON THIS ISSUE AND HAVE WORKED ON SEXUAL HARASSMENT FOR MANY YEARS AND EVERY SINGLE MEMBER OF OUR WORKING GROUP CARES DEEPLY ABOUT SOLVING PROBLEMS IDENTIFIED BY THE NATIONAL ACADEMY. IT IS HARD BECAUSE LOTS OF IT COMES TO HUMAN BEHAVIOR THAT WE KNOW IS TREMENDOUSLY DIFFICULT TO CHANGE. ALSO, BECAUSE IT LENDS ITSELF TO VERY DEEP INTROSPECTION ON A PERSONAL AND INSTITUTIONAL LEVEL AND SYSTEMIC LEVEL THAT GETS SOME UNCOMFORTABLE SPACE IN EACH OF US EXAMINING OUR OWN BEHAVIOR AND WHAT ROLE ALL OF US IS AS INDIVIDUALS AND INSTITUTIONS AND ORGANIZATIONS PLAY IN PERPETUATING THIS PROBLEM OF SEXUAL HARASSMENT NATIONAL ACADEMY DID AN EXTRAORDINARY JOB OF CONNECTING TO A DURTH OF WOMEN IN LEADERSHIP POSITIONS IN SCIENCE AND SIGNIFICANT OBSTACLES THAT IS KEEPING WOMEN FROM ACHIEVING RIGHTFUL PLACE IN SCIENCE. BOTTOM LINE IS DESPITE THE FACT THIS IS VERY HARD AND DIFFICULT WE CAN'T SHY AWAY EITHER FROM THE CONVERSATION OR THINKING THROUGH AND TACKLING ACTIONS THAT ARE NEEDED TO SOLVE THIS PROBLEM. NIH HAS BEEN TAKING A LOT OF ACTIONS IN THE SPACE. THE ICEBERG ANALOGY OF NATIONAL ACADEMIES IS IN MANY WAYS AND LEAST OF WHICH ACTIONS REPRESENT THE TIP OF THE ICEBERG OF WHAT NEEDS TO BE DONE. YOU HEARD PREVIOUS ACD MEETINGS ABOUT THE EFFORTS NIH HAS BEEN TAKING INTERNAL TO NIH FOR OWN STAFF OR INTRAMURAL SCIENTISTS THAT HAS BEEN LED BY DR. LARRY TABAK THAT CUT UP AN ACTIVE AND ENGAGED INTERNAL GROUP THAT TOOK A NUMBER OF ACTIONS DESCRIBED HERE BEFORE PUTTING NEW POLICIES IF IN PLACE DEVELOPING TOOLS AND RESOURCES DOING TRAINING AND KEEPING TRACK OF DATE AFRU CENTRALIZED REPORTING SYSTEM AS WELL AS BEING INVOLVED IN THE WORKPLACE CLIMATE SURVEY YOU WILL HEAR ABOUT AT THE END OF THE SESSION. NIH IS LOOKING OUTWARD AT EXTRAMURAL INSTITUTIONS TO -- PART OF THE PROBLEM OF PERPETUAL THIS ISSUE OF GENDER HARASSMENT AND SEXUAL HARASSMENT AND IT IS TIME TO BE PART OF THE SOLUTION AND IN RECOGNIZING WE HAVE BEEN PART OF THE PROBLEM APOLOGIZING TO WOMEN THAT HAVE BEEN EFFECTED BY OUR ACTIONS OR FAILURE TO TAKE ACTION. AND MAKING SURE WE RENEW OUR COMMITMENT TO MOVING THE NEEDLE ON THESE ISSUES A COUPLE ACTIONS DESCRIBED IN FEBRUARY 2 EIGHTH STATEMENT YOU MAY BE FAMILIAR WITH WE REACHED OUT TO ALL NIH FUND INSTITUTIONS TO REMIND THEM OF THEIR -- OUR EXPECTATIONS TO MAINTAIN A SAFE AND INCLUSIVE ENVIRONMENT AND ASKING FOR ASSISTANCE AND PARTNERING WITH US TO COMBAT SEXUAL HARASSMENT AND WE ESTABLISHED CONFIDENTIAL E-MAIL ADDRESS TO REPORT CONCERNS ABOUT NIH FUND INSTITUTIONS. ESSENTIAL WLI IN RECOGNIZING THAT SEXUAL HARASSMENT AND GENDER HARASSMENT IS BAD FOR -- NOT JUST FOR WOMEN BUT BAD FOR SCIENCE. WE WANTED MAKE IT CLEAR THAT WE CARE DEEPLY ABOUT THAT AND WANT TO KNOW IF THERE ARE THINGS GOING ON AT OUR INSTITUTIONS THAT ULTIMATELY EFFECT RESEARCH WE FUND. WE WANTED MAKE IT CLEAR IF ANYONE HAS SUCH INFORMATION THE AGENCY IS INTERESTED IN IT AND WOULD BE INTERESTED IN HEARING ABOUT THAT. WE ARE ABOUT TO LAUNCH A WEB-BASED PORTAL TO PROVIDE CONFIDENTIAL CHANNEL FOR PEOPLE TO PROVIDE INFORMATION TO AGENCY RELATIVE TO SEXUAL HARASSMENT. THE AGENCY HAS FELT STRONGLY THIS IS A THREAT IN THE CONVERSATIONS OF THE WORKING GROUP AS WELL. TRANSPARENCY AND ACCOUNTABILITY IS IMPORTANT IN BEGINNING TO IMPACT THE CULTURE AND ADDRESS THE ISSUE OF SEXUAL HARASSMENT. SO IN THAT FEBRUARY 2 EIGHTH STATEMENT FOR THE FIRST TIME, WE DESCRIBED THE CONSEQUENCES OF SOME OF THE ACTIONS WE ARE TAKING AND WE THINK THIS HAS A COUPLE OF EFFECTS. ONE, IT LENDS ITSELF TO TRANSPARENCY AND WE KNOW A MAJOR ISSUE IN SEXUAL HARASSMENT IS A RELUCTANCE TO REPORT AND BECAUSE PEOPLE FEEL THAT NOTHING WILL HAPPEN AND RELUCTANCE TO REPORT BECAUSE THEY FEEL THERE WILL BE RETALIATION AND RELUCTANCE TO REPORT BECAUSE PEOPLE FEEL THEY WON'T BE BELIEVED IN THAT SENSE MAKING IT CLEAR WE ACT ON INFORMATION SUBSTANTIATED AND TAKE -- WE HOPE WILL BE ENCOURAGEMENT FOR PEOPLE TO PROVIDE INFORMATION OR IN CASE OF EMPLOYEES TO REPORT INSTANCES THAT HAPPEN. ALSO, TO SERVE AS A DETERRENT TO THOSE THAT MIGHT BE INSTIGATING HARASSLMENTS AND KNOW ACTIONS IN FACT HAVE CONSEQUENCES. IT IS WORTH NOTING A SIGNIFICANT UPTICK THIS YEAR SINCE WE RELEASED THAT STATEMENT. LAST YEAR FOR ALL OF 2018 LOOKING EXTRAMURALLY FOR THE MOST, WE REVIEWED 28 INCIDENTS THAT ULTIMATELY ENDED UP IN RELACEMENT 14PIS ON FUNDED GRANTS AND INSTITUTIONAL LEVEL INTERDISCIPLINARY ACTIONS AND 21PIS AND PEOPLE REMOVED FROM PEER REVIEW IN FIRST HALF OF 2019, WE HAVE SEEN 3 INCREASE SO GREATER THAN THAT WE SAW ALL OF LAST YEAR INVOLVING 27 INVESTIGATORS AND WE HAD FIVE PIS REMOVED FROM NIH GRANTS AND THESE HAVE COME IN SINCE FEBRUARY STATEMENTS SO LOTS OF THESE ARE ONGOING AND PENDING INVESTIGATIONS AND I DON'T WANT TO LOSE SIGHT OF THE FACT INTERNALLY WE HAVE TAKEN A NUMBER OF ACTIONS AS WELL. THIS IS SOMETHING WE ARE TRYING TO ADDRESS THROUGHOUT THE ENTIRETY OF THE ENTERPRISE. SO THE WORKING GROUP, JUST TO BRIEFLY REVIEW THE CHARGE BEFORE I TURN IT OVER TO MY CO-CHAIRS TO TALK ABOUT THE WORK WE HAVE BEEN DOING HAD A PRETTY AMBITIOUS CHARGE TO SAY THE LEAST TO ASSESS THE CURRENT STATE OF SEXUAL HARASSMENT INVESTIGATIONS AND DISCIPLINARY PROCEDURES AT NIH FUNDED ORGANIZATIONS WHAT IS REALLY GOING ON AT THE GROUND ATED INSTITUTIONS THAT WE FUND TO ADVISE AND OVERSIGHT ACCOUNTABILITY AND REPORTING MEASURES FOR AWARDING INSTITUTIONS PREVENTION OF SEXUAL HARASSMENT AND BIOMEDICAL LABORATORIES THESE ARE INTERCONNECTED AND -- RESEARCH CONFERENCES WE KNOW FOR A FACT THAT A LOT OF INSTANCES OF SEXUAL HARASSMENT AND GENDER HARASSMENT TAKE PLACE AT RESEARCH CONFERENCES WHICH WAS DISCUSSED IN THE ACADEMIES REPORTS SUGGEST SYSTEMWIDE CHANGES TO CULTURE AND CLIMATE TO PREVENT DISCRIMINATION THROUGH DIFFUSION OF HIERARCHICAL -- STRONG AND DIVERSE LEADERSHIP. THIS IS THE INCREDIBLY DIFFICULT UNDER THE WATER LINE PIECE OF THE ICEBERG THAT IS ABSOLUTELY CRUCIALLY IMPORTANT FOR US TO ADDRESS AND SOLVE IN THE LONG TERM AND DEVELOP STRATEGIES -- POLICIES PROCEDURES AND TRAINING AND MEASURES AND EVALUATIONS OF EFFECTIVENESS. WE ARE COGNIZANT OF THE FACT THAT WE HEAR FROM ADVOCATES AND WOMEN AND ALLIES THEY DON'T WANT US TO CONTINUE TO STUDY THE ISSUE THEY ARE NOT LOOKING FOR NAVAL GAZES HERE AND RESTATEMENTS OF PROBLEMS WE KNOW IS SIGNIFICANT. THAT BEING SAID IT IS IMPORTANT THAT ACTIONS BE EVIDENCE-BASED AND NATIONAL ACADEMIES MADE A REPORT AS WELL WE NEED MORE RESEARCH INTO WHAT ARE ACTUALLY EFFECTIVE STRATEGIES AND INTERVENTIONS AND PREVENTION MEASURES THAT WORK TO SOLVE THIS PROBLEM. SO I'M QUITE HONORED TO BE APART OF THIS WORKING GROUP IT IS EXTRAORDINARY AND PASSIONATE GROUP OF PEOPLE. MEMBERS IN THE ROOM HANNAH VALANTINE AND PATTY BRENNAN. I WANT TO POINT TO THE THREE BOLDED NAMES THAT ARE NEW. RICHARD HOETIS DIRECTOR OF NATIONAL INSTITUTE OF AGING AND [INDISCERNIBLE] WHO YOU HEARD ABSKONDED TO THE FDA AND RICHARD HAS BNG A GREAT CONTRIBUTOR SINCE HE HAS JOINED AND I WANT PTD TO MENTION DR. A- LEASHIA DICKY AND [INDISERNIBLE] WHO CAME AND SHARED THEIR STORIES OF SURVIVING EGREGIOUS INCIDENTS OF SEXUAL HARASSMENT WITH THE WORKING GROUP AND CAME WITH REALLY POWERFUL INFORMATION AND CONCRETE SUGGESTIONS AND WORKING GROUP FEMENT IT IMPORTANT WE INCLUDE THE VOICES AT THE TABLE AND THEY HAVE AGREED TO JOIN. WITH THAT I'M GOING TO TURN IT OVER TO FRANCIS TO TALK A LITTLE ABOUT HOW WE HAVE BEEN SPENDING OUR TIME SINCE DECEMBER. >> GOOD AFTERNOON, EVERYONE. BRINGING TO THE ACD I THINK FOR YOUR FEEDBACK SOME CONCRETE PROPOSALS AND STUFF WE ARE WORKING ON WHICH DR. COLLINS MENTIONED EARLIER THIS IS AN INTERIM REPORT. CARRIE MENTIONED IT IS AN EXTREMELY BROAD [INDISCERNIBLE]. WHAT I DIDN'T KNOW UNTIL I SAT ON THE COMMITTEE IS THERE ARE 3,000 NIH FUNDED INSTITUTIONS WOMEN ARE ASSESSING THOSE THREE THOUSAND NUMB INSTITUTIONS. THAT IS IMPOSSIBLE TO DO THAT BUT IT IS A VERY IMPORTANT AREA. I THINK THOSE OF YOU WHO HAVE READ NATIONAL ACADEMY'S REPORT WILL SEE IT IS MAPPED OUR CHARGE VERY BROADLY IS MAPPED ABSOLUTELY ON TO THE NATIONAL AKAED MY'S RECOMMENDATIONS AND REPORT. I DON'T THINK IT IS A BAD THING. UNDERLYING OUR [INDISCERNIBE] WAS TO TAKE THAT REPORT. SEE IF IT MAKES SENSE IN THE CONTEXT IN THE NIH AND EXTRAMURAL PROGRAMS OF NIH WHICH IT DOES. THEN BRING IT AND MAKE IT RELEVANT TO THAT. WHAT YOU WILL HEAR HERE IS THE SPECIFICS AROUND THIS PARTICULAR CHALLENGE. THIS IS OUR VERY PASSIONATE AND COMMITTED AND EXPERIENCED AND DIVERSE WORKING GROUP WE ARE HERE WORKING IN THE BELLS OF THE NIH. IT IS A NICE CONFERENCE ROOM THAT IS DEEP IN THE BELLS. THE POINT I WOULD LIKE TO MAKE HERE IS THAT THERE WAS THIS DIVERSE IN MANY WAYS IT IS DIVERSED IN EXPERIENCE AND ALSO DIVERSE IN OPINIONS. WE SPENT A LOT OF TIME IN THE WORKING GROUP TRYING TO BRING FORWARD TO THE ACD WHAT WOULD BE A CHALLENGING SET OF RECOMMENDATIONS BUT THOSE THAT WE THINK IT IS POSSIBLE TO DO. IT MAYBE NOT EASY BUT POSSIBLE TO DO. WE SPENT A LOT OF TIME GETTING TO THAT POINT. WE HAD TWO, TWO-DAY MEETINGS IN PERSON. ONE IN FEBRUARY AND ONE IN MAY. WE DISCUSSED THE LANDSCAPE AND WE HAD THE ADVANTAGE OF HAVING THE NATIONAL ACADEMY'S REPORT WHICH IS COMPREHENSIVE AND VERY HELPFUL AND A NUMBER OF THINGS CAME UP THAT REALLY MAPPED ON TO WHAT THEY HAD ALREADY REPORTED OUT. WE HEARD FROM A NUMBER OF EXPERTS EXTERNALLY. IN PARTICULAR, WE HEARD ACTUALLY FROM THE CORPORATE WORLD SOME OF THE EXAMPLES IN BUSINESS THAT HAVE OBVIOUSLY BEEN DEALING WITH THIS CHALLENGE AND HOW THEY DEALT WITH IT. THERE HAS BEEN A RECENT SURVEY BY BCG ABOUT WHAT WORKS AND WHAT DOESN'T IN THE CORPORATE SPHERE. THAT WAS QUITE USEFUL. SOME IS QUITE RELEVANT TO WHAT IS GOING ON. I THINK IT IS FAIR TO SAY THAT THERE IS PROBABLY THE CORPORATE WORLD IS A LITTLE FURTHER ON THAN THE TOTALITY OF THE ACADEMIC INSTITUTIONS. I DO THINK THERE IS SOME THINGS TO LEARN FROM THERE. WE HELD PRIVATE AND PUBLIC LISTENING SESSIONS. WE HAD THE SURVIVORS OF SEXUAL HARASSMENT COME TO EVERY MEETING WE HAD FACE-TO-FACE. IT WAS VERY HARROWING AND VERY MOVING. I THINK IT GAVE US ALL PAUSE FOR THOUGHT. I KNOW THAT THE WORKING GROUP TOOK AWAY FROM IT A CALL TO ACTION. THEY FELT IT WAS SOMETHING THAT ALREADY WAS COMMENTED ON IF YOU WANT TO SEE ONE OF THE PUBLIC SESSIONS THERE IS A LYNCH THERE. IT IS -- I THINK IT IS WORTH WATCHING AT LEAST SOME OF IT. I THINK WHAT I TOOK AWAY A COUPLE OF THINGS. ONE WAS -- THESE ARE PERHAPS EXTREME EXAMPLES BUT PEOPLE THAT TESTIFIED OR PROVIDED TESTIMONY FOR US BASICALLY WERE VICTIMIZED TWICE. ONCE, THEY WERE VICTIMIZED BY THE HARASSER AND UNFORTUNATELY THEY WERE SUBSEQUENTLY VICTIMIZED AND FELT VICTIMIZED BY THE PROCESS WHICH I THINK IS ALMOST IN EVERY CASE OF THE PEOPLE WHO ARE MOST EFFECTED BY THIS. THAT IS SOMETHING THAT IS VERY UNFORTUNATE. THE OTHER THING IS I THINK WE WERE ALL LOOKING FOR ANALOGS THAT HAVE WORKED. YOU WILL HEAR ABOUT ONE IN A MOMENT WHICH IS AN ANALOG TO USING THE PROCESS OF RESEARCH AND MISCONDUCT. WE WILL TALK ABOUT THAT. I THINK BOTH CHRISTINE AND I WHO COME FROM A BACKGROUND OF MANAGING RESEARCH YOU KNOW CORPORATE ENVIRONMENT. WE -- WE WILL HEAR MORE ABOUT THIS TOO FROM CHRISTINA. IT STRUCK US THIS WAS A SAFETY ISSUE. IT WAS A SAFETY ISSUE IN THE SAME WAY IF YOU ARE RESPONSIBLE FOR LAB ORATORY SAFETY WHETHER IT IS HAVING HUMAN TISSUES AND RAID LOGICALS WHICH HAD CERTAIN ANALOGS FOR THAT. CERTAIN WAY OF LOOKING AT ANALOGS CAN IS YOU CAN THINK OF HOW WE DEAL WITH THESE ACKNOWLEDGING THE PROBLEM AROUND TRAINING AND SETTING GOALS AND MEASURING PERFORMANCE AROUND THOSE GOALS. SEEMS LIKE A CORPORATE TYPE OF THING AND IT HAS PROVEN AND WE HAVE TESTIMONY THAT HAS PROVEN IT TO BE EFFECTIVE IN THE CORPORATE ENVIRONMENT. THESE ARE THE MESSAGE THAT YOU COULD READ THEM YOURSELF. FIRST ONE IS A POTENTIAL PROBLEM OF BEING VICTIMIZED TWICE. RETALIATION SEEMS TO BE AN ISSUE BOTH EXPLICIT AND IMPLICIT. YOU WILL HEAR RECOMMENDATIONS AROUND RESTORATIVE JUSTICE. WE HEARD THIS FROM THE VICTIMS VERY MUCH. ACKNOWLEDGMENT AND HARM THAT IS BEING DONE TO THEM WOULD BE SOME PROCESS OF RESTORATIVE JUSTICE. THIS LAST ONE IS VERY IMPORTANT. IT IS BY APPEARING NOT TO BE EFFECTIVE IN THIS FEDERAL AGENCIES HAVING PERPETUATING THE PROBLEM. IT MAY NOT BE WHAT THEY WANT TO DO BUT IT IS THE ACTUAL OUTPUT AND GOING BACK TO THE WORKING GROUP'S DESIRE TO GIVE IN THIS CASE THE NIH A CHALLENGE HERE IS SAYING, YES. WE IF UNDERSTAND THERE IS ALL KINDS OF LEGAL AND STRUCTURAL CHALLENGES TO DOING STUFF BUT LET'S SEE HOW WE CAN BE -- LET'S SEE AND COME UP WITH SOME RECOMMENDATIONS TO SEE WHETHER THEY COULD BE TAKEN FORWARD. SO THE BASIS REALLY OF COMING TO YOU TODAY IS WITH SOME INTERIM RECOMMENDATIONS THAT THE WORKING GROUP FELT THEIR CALL TO ACTION WAS ABOUT REALLY ADDRESSING THE TIP OF THE ICEBERG OR SEXUAL HARASSMENT PART OF ICEBERG. WHAT THEY REALLY WANTED TO DO IS COME FORWARD WITH ACTION FOR IMMEDIATE RECOMMENDATIONS. THE -- THEY ACKNOWLEDGE AND WE ACKNOWLEDGE, OF COURSE, THAT THERE WAS 7/8S BENEATH THE SURFACE GENDER DISCRIMINATION AND ALL THAT STUFF YOU NEED TO CHANGE THE CULTURE TO DO THAT. I THINK MOST OF US WHO EVER TRIED TO CHANGE THE CULTURE AND INSTITUTION KNOW THAT IT HAS TO START AT THE TOP. IT IS AROUND LEADERSHIP AND IT HAS TO MEAN IT AND TAKE THE LEAD. THEN YOU REALLY HAVE TO PRODUCE THIS CYCLE OF SETTING GOALS. TRAINING PEOPLE TO CHANGE -- TO ACHIEVE THOSE GOALS AND MEASURING GOALS AND REWARDING OR NOT. THOSE TWO PROCESSES HAVE CORPORATE SPHERE AS I SAID. AGAIN, I WOULD COMPLIMENT DR. COLLINS ON TAKING THE LEAD QUITE PUBLICLY ON THE WAY TO THE TOP. THAT IS A GREAT START. WE ARE TALKING HERE NOT JUST ABOUT NIH BUT ABOUT THE OTHER 3,000 ORGANIZATIONS. I WANT TO MAKE THIS POINT THAT WHILE WE DID HEAR SOME PRETTY EGREGIOUS EXAMPLES FROM SURVIVORS THAT APPEARED THAT INSTITUTIONS INVOLVED WEREN'T VERY EFFECTIVE IN THEIR PROCESSES, WE ALSO HEARD SOME WONDERFUL EXAMPLES OF WHAT APPEARED TO BE WONDERFUL EXAMPLES WHERE INSTITUTIONS REALLY DID HAVE BEST PRACTICES. INEVITABLY IN THIS SITUATION YOU WILL HAVE A VERY -- A VERY DIFFERENT VIEW DEPENDING ON THE CIRCUMSTANCES AND SMALL NUMBER OF EXAMPLES WE WERE ABLE TO LISTEN TO. I WILL MOVE ON TO RECOMMENDATIONS. IT IS IMPORTANT WHEN WE TALK ABOUT DIVERSITY OF THE WORKING GROUP IN TERMS OF THEIR EXPERIENCE, WE DID HAVE VERY DISTINGUISHED EXPERIENCED SCIENTISTS AND WE HAD VERY EARLY TRAINEES AND JUNIOR SCIENTISTS PEOPLE FROM NIH AND FROM OUTSIDE, INTERNATIONAL AND US PEOPLE. AND WE DID HAVE REPRESENTATIVES OF UNDER-REPRESENTED GROUPS WHICH WAS A BROAD EXPERIENCE WHEN YOU SEE THE RECOMMENDATIONS THEY WILL NOT UNANIMOUS BUT BROADLY AGREE WITH THAT. HERE THEY ARE. FIRST ONE IS TO TREAT PROFESSIONAL MISCONDUCT INCLUDING SEXUAL HARASSMENTS AND MISCONDUCT RESEARCH. LOTS OF DEBATE ABOUT THIS. LY SAY UP FRONT THIS IS NOT SHOVELING SEXUAL HARASSMENT UNDER THE PROCESS OF RESEARCH MISCONDUCT IF ANYONE THINKS ABOUT WHAT PROVOKES THAT THAT IS NOT WHAT WAS BEING PROPOSED HERE BUT IT WAS ACKNOWLEDGMENT THAT RESEARCH MISCONDUCT HAS BEEN A VERY IMPORTANT ISSUE AND PROCESS SEEMS TO WORK PRETTY WELL AND THEREFORE COULD ONE USE AN ANALOGOUS SITUATION FOR WHAT ONE CALLS PROFESSIONAL MISCONDUCT. SECOND ONE IS SOME DEGREE OF ATTESTATION WHEN SUBMITTING GRANT APPLICATIONS AND PROGRESS REPORTS TO HOLD PEOPLE ACCOUNTABLE AND TO MAKE SURE THERE IS A DEGREE OF TRANSPARENCY WHICH FRANKLY WE DISCOVERED IS REALLY HARD FOR THE NIH TO FIND OUT WHAT IS GOING ON AND SOMETIMES YOU WILL READ ABOUT IT IN THE FRONT PAGE OF THE NEW YORK TIMES AND HOPEFULLY NOT SO MUCH NOWADAYS. THAT CERTAINLY DIDN'T HAPPEN. THIRD ONE IS IDEA OF ESTABLISHING RESTORATIVE JUSTICE FOR SURVIVORS AND IMPORTANT CODE HERE IS TO RECAPTURE LOST TALIENT. ONE OF THE NEW MEMBERS OF OUR WORKING GROUP AND ONE OF THE SURVIVORS YOU MIGHT HAVE SEEN THE NAME ASSOCIATED NEXT TO THEIR NAME. FISH AND I COULDN'T REMEMBER I LOOKED UP WHICHAC DEM INSTITUTION IS CALLED THAT IT IS NOT AN ACADEMIC INSTITUTION BUT A LAW FIRM. THIS YOUNG LADY UNFORTUNATELY ALTHOUGH HAVING A PROMISING CAREER IN FRONT OF HER IN SCIENCE DECIDED SHE COULDN'T -- SHE JUST COULDN'T LIVE IN ENVIRONMENT AND WENT TO THE GEORGIA LAW FIRM. STARK REMINDER THAT WE ARE LOSING TALENT. THE LAST ONE HERE IS TO DEVELOP NOVEL APPROACHES TO ADDRESS [INDISCERNIBLE] THIS IDEA OF DIF FUSING THE HIERARCHICAL STRUCTURE THAT INEVITABLY IS A HIGH RIFSHG AREA FOR SEXUAL AND GENDER DISCRIMINATION. I WILL TALK ABOUT THE OTHER TWO AND CHRISTINE WILL TAKE YOU THROUGH OTHER STUFF WE HAVEN'T YET COME TO BRING TO YOU TODAY BUT WILL BRING FORWARD AT THE END OF THE YEAR. SO. >> THE IDEA OF PREVENTING SEXUAL HARASSMENT SHOULD BE RA. IN THE NEAR TERM IT IS ABOUT REDUCING IT PARALLEL MECHANISMS FOR REPORTING -- PROFESSIONAL MISCONDUCT WOULD SHOW NIH INSTITUTIONS TAKE PROFESSIONAL MISCONDUCT SERIOUSLY. THAT IS A PERIL MECHANISM TO RESEARCH MISCONDUCT. PIS OR CO-PIS ON THE ACTIVE GRANTS. THIS IS WHAT SUGGESTION OF WORKING GROUP IS REPORT INVESTIGATIONS WITHIN ONE WEEK OF INITIATION AND REPORT MISCONDUCT OR OTHER DISPLENARY VIOLATIONS AND -- CONDUCT WITHIN ONE WEEK OF ISSUANCE OF FINDINGS AND CONSULT WITH N ICHLT H SDGS POSITION OF GRANT [INDISCERNIBLE] AND AFTER ADJUDICATION PROCESS AND VIOLATION SHOULD NO THE HAVE ANY INPUT INTO THE PROCESS. WE DID HEAR INSTANCES WHICH WERE VERY AWKWARD OF PIS WHO ALLEGEDLY HARRASED ONE OF THE PEOPLE ON THE GRANTS AND THEY WERE SUSPENDED BUT STILL HAD CONTACT THROUGH THE MAIL AND RUNNING THE TRIAL WITH THE HARASSEE. THAT IS ONE EXAMPLE WE HEARD BUT THERE ARE MANY OTHERS THIS WOULD HELP CLARIFY WHAT EXACTLY -- HOW THIS PROGRAM IS MOVING ON DURING THIS PERIOD. [READING FROM TEXT]. SO SPECIFICALLY A HOTLINE FOR THE EXTRAMURAL RESEARCH AND NIH SHOULD HAVE AN SOP TO RESPOND TO REPORTS INVESTIGATIONS OR FINDINGS OF SEXUAL HARASSMENT IN EXTRAMURALLY FUNDED LAB ORATORIES THAT SHOULD BE COORDINATED THROUGH OER. WE HEARD AND THERE WAS NO STANDARDIZATION HERE AT ALL. WHEN PEOPLE ASKED WHAT THEY SHOULD DO, IT WAS -- THEY DIDN'T ALWAYS GET THE SAME ANSWER. THIS IS A KEY POINT HERE. SHOULD ONE TAKE FOR THIS RECOMMENDATION. THIS WILL BE A CHALLENGE BUT ONCE WE STARTED TO TAKE EVIDENCE ON THIS IT APPEARS OTHER FEDERAL AGENCIES DO THING DZ DIFFERENTLY. AGAIN, IT IS A SOURCE OF ENORMOUS CONFUSION AND YOU NEED ONE SOP PREFERABLY MANY ACADEMIC INSTITUTIONS ARE TOLD DIFFERENT THINGS BY DIFFERENT FEDERAL AGENCIES. SO WORKING GROUP THOUGH DID APPRECIATE IN A PERFECT WORLD IT WOULD BE WHAT YOU WOULD WANT IT DO AFTER THE BOX. THERE ARE SOME CONSIDERATIONS TO SETTING THIS UP. IT TURNS OUT RESEARCH MISCONDUCT HAS A VERY SPECIFIC DEFINITION. AND THIS RECOMMENDATION IS ONE -- I WANT TO REEMPHASIZE THAT WE ARE NOT RECOMMENDING MESSING AT ALL WITH RESEARCH MISCONDUCT. THAT STAYS AS-IS. THIS IS ABOUT CREATING A PARALLEL PROCESS USING BITS THAT ARE APPROPRIATE AND ONES THAT WE CAN FOR PROFESSIONAL MISCONDUCT. WE ALSO ACKNOWLEDGE THAT THEY MIGHT HAVE TO BE RULE MAKING TO DO THIS AND OBVIOUSLY AS WE HAVE HEARD, THAT IS KIND OF DIFFICULT AT THE MOMENT. BUT, YOU KNOW, WE -- WE HAVE GREAT FAITH THAT HOPEFULLY THERE WILL BE A WAY FOUND TO DO THAT. I THINK HERE IS A VERY IMPORTANT POINT THAT NIH CAN ONLY DO SO MUCH AND CLEARLY THERE IS A PARTNERSHIP HERE. PARTICULARLY INSTITUTIONS OF GOOD WILL I WOULD SAY WHO MUST REALLY DEVELOP THEIR OWN ROBUST SYSTEMS AND THIS IS ABOUT MAKING SURE THEY CAN TALK EFFECTIVELY AND EFFICIENTLY WITH THE NIH. AGAIN, WE WOULD LIKE TO ENCOURAGE THEM IF THEY HAVE THAT CONVERSATION RATHER THAN TO JUST SIT ON THIS QUIETLY. INSTITUTION SHOULD DEVOTE EQUAL RESOURCES TO PROFESSIONAL MISCONDUCT INCLUDING SEXUAL HARASSMENT AND RESEARCH AND TAKE THEM SERIOUSLY AND MESSAGE FROM THE TOP THEY WILL BE TREATED EQUALLY CAREFULLY. LET ME I THINK WE SHOULD MAYBE STOP THERE AND TALK ABOUT IT OR GO THROUGH UNTIL THE END, FRANCIS? I DON'T KNOW WHAT IS THE BEST WAY. >> FRANCIS S. COLLINS: THESE ARE VERY SIGNIFICANT INTERIM RECOMMENDATIONS IT MIGHT BE GOOD TO STOP AFTER EACH. WE ALLOTTED A FAIR AMOUNT OF TIME FOR THIS SESSION AND SEE WHAT PEOPLE'S THOUGHTS ARE. I SEE LINDA HAS A THOUGHT. >> IT IS CORRECT RULE MAKING IS DIFFICULT AND DEFINITIONS ARE DIFFICULT WILL YOU BROACH -- YOU HAVE AN INCREDIBLY HARD JOB. THANK YOU FOR TACKLING IT ARE YOU BROACHING A SET OF DEFINITIONS TO GIVE ANYONE WHO MIGHT MAKE A COMPLAINT A SET OF GUIDELINES THIS IS IN THE RANGE WHAT EVERYBODY WOULD CONSIDER COMPLETELY UNACCEPTABLE AND HEAR THINGS IN A GRAY ZONE AND MIGHT BE INTERPRETED FOR EXAMPLE SEXUAL HARASSMENT AND BULLYING ARE SIBLINGS AND TWINS BULLYING CAN BE PERCEIVED AS SEXUAL HARASSMENT WHEN BULLIES ARE MEAN TO EVERYBODY. MAYBE -- IT IS SUPER HARD TO DO BUT HAVE YOU THOUGHT ABOUT CREATING A SET OF GUIDELINES AND PART OF IT MANY OF MY SENIOR COLLEAGUES IN MY GENERATION AND SO ON HAVE STARTED TO NOTICE THAT THE EXPERIENCES OF YOUNGER WOMEN IN OUR COMMUNITIES AND EVERY COMMUNITY IS DIFFERENT AND SOME HAVE DONE A GREAT JOB OF PUSHING DOWN THE MOST EGREGIOUS THINGS THEY NEVER SAW REALLY EGREGIOUS WHAT WE WOULD CALL 9 OR 10. THEIR BAR IS A 10 IS SOMEBODY WHO DOES SOMETHING LIKE ASK THEM OUT AND THEY COULD SAY NO AND NO WOULD BE ACCEPTED BUT STILL THEY GOT ASKED OUT. DO YOU HAVE SOME WAY OF MAYBE CREATING SOME KIND OF DEFINITIONS? PEOPLE EXIST IN DIFFERENT CULTURES THAT HAVE DIFFERENT LEVELS OF IT IS STILL GOING ON IN A HORRIBLE WAY HERE BUT THIS ENVIRONMENT IS GREAT AND WOMEN ARE LOOKING FOR IT SO THEY WILL REPORT ANYTHING. IS THERE SOME SORT OF LEVEL PLAYING FIELD YOU CAN CREATE IN DEFINITION SO YOU REALLY GET THE BAD STUFF BUT YOU DON'T TRAP PEOPLE WHO ARE JUST DOING SOME NORMAL INTERACTIONS? >> I WILL GIVE THIS TO CHRISTINE AH. I THINK I WOULD IMAGINE THERE ARE INSTITUTIONS THAT ARE ALREADY ADDRESSING THIS. YOUR POINT IS VERY WELL TAKEN. WE HAVEN'T HAD THE TIME FRANKLY TO SIT AND GET TO THE LEVEL OF DETAIL BUT I THINK THAT IS WHERE TRAINING BECOMES REALLY IMPORTANT. THAT IS A VERY IMPORTANT PART OF THIS. >> YEAH. >> IT IS JUST SAYING HERE ARE SOME RULES, YOU KNOW, JUST MAKE SURE YOU DON'T BREAK THEM. IT IS NOT VERY HELPFUL. IT IS AN INTERESTING PROCESS HELPING PEOPLE TO UNDERSTAND WHAT IS AND ISN'T RIGHT AND THERE IS A CULTURAL DIFFERENCE AND THERE IS INSTITUTION. I INSTITUTIONS PROBABLY WORKED. >> RIGHT. >> FIRST OF ALL, IT IS A VERY IMPORTANT POINT. I THINK THEY MAY BE SIBLINGS BUT NOT TWINS AND I WOULD STEP BACK A LITTLE BIT WHAT WE LOOK AT IN STATE UNIVERSITY OF NEW YORK IS SEXUAL HARASSMENT AND INTERPERSONAL VIOLENCE WHEN I THINK OF BULLYING AND IF YOU STEP UP ONE STEP HIGHER WHAT IS IT? REALLY IT IS PEOPLE USING POWER IN AN INAPPROPRIATE WAY FOR DETRIMENT OF INDIVIDUAL AND INSTITUTION. WE THINK ABOUT AT SOME LEVEL CAN WE AGREE THIS IS WRONG AND SOME RECOMMENDATIONS WE HAVE BEEN TALKING I KEEP THINKING INTERPERSONAL VIOLENCE AND HARASSMENT. IT CAN AND CANNOT BE SEXUAL THIS IS A GOOD POINT TO TAKE AWAY AND CHEW ON A LITTLE BIT IN A WORKING GROUP. I THINK IT BEARS FURTHER CONSIDERATION. I DON'T KNOW IF YOU WANT TO ADD ANYTHING, BROOK. >> COUPLE THINGS ONE IS INTRAMURAL MODEL IS SOMETHING TO LOOK AT THEY DELIBERATELY INTRAMURAL INTERNAL NIH RESEARCH EMMRIES DELIBERATELY PUT IN PLACE ANTIHARASSMENT POLICIES AS OPPOSED TO ANTISEXUAL HARASSMENT POLICIES DEFINES AND ADDRESSES RANGE OF BEHAVIORS NOTE WORKING GROUP FOCUSED NOT ON SEXUAL HARASSMENT BUT PROFESSIONAL MISCONDUCT RECOGNIZING THIS POINT THERE ARE A RANGE OF BEHAVIORS THAT ARE UNACCEPTABLE IN A WORKPLACE ENVIRONMENT THAT ARE INCLUSIVE AND NOT LIMITED TO SEXUAL HARASSMENT. FINAL POINT THAT MAKES THIS A DIFFICULT ISSUE TO TACKLE AND IT IS SORT OF HINTED AT IN THE SURVEY RESULTS WHICH I DON'T WANT TO [INDISCERNIBLE] YOU WILL HEAR ABOUT IS WHAT IS THE THRESHOLD OF REPORTING? WHAT IS THE THRESHOLD WHERE SOMETHING BECOMES BAD? I AGREE, SOMEONE -- A COLLEAGUE ASKING YOU OUT ON A DATE AND YOU SAYING NO AND THAT IS THE END OF IT SITUATIONS DEPENDING ON YOUR POWER DIFFERENTIAL THAT IS OKAY AND IT IS VERY SITUATIONAL-DEPENDENT. ONE INSTANCE IN AND OF ITSELF MIGHT BE DISMISSED NAGSLE ACADEMY REPORT IS ISSUE OF DEATH BY 1,000 CUTS IN GENDER HARASSMENT SPACE AND ONE THING WE HAVE CERTAINLY HEARD FROM TARGETS AND YOU WILL SEE IN THE SURVEY RESULTS IS THAT IS A DIFFICULT ISSUE TO DEAL WITH; RIGHT? YOU BLOW IT OFF ONCE AND BY THE 50TH TIME YOU START THINKING THIS IS GETTING RIDICULOUS IT IS TRICKY SPACE TO NAVIGATE AND DOES THEIR THINKING ABOUT BECAUSE IT IS HARD TO POLICY ARN THAT; RIGHT? IT IS HARD TO DEFINE IT IN AN ACTIONABLE WAY. >> DID YOU HAVE A COMMENT JUDITH RELATIVE TO RECOMMENDATION I? >> I WAS CURIOUS ABOUT THE PROCESS. YOU KNOW, I THINK IT IS VERY CLEAR THE PROCESS OF BEING ACCUSED AND RESEARCH MISCONDUCT AND FINDING EVIDENCE FOR RESEARCH MISCONDUCT IS THERE A SIMILAR PROCESS FOR PROFESSIONAL MISCONDUCT AND VALIDATION OF THE ACCUSATION? >> I THINK AS CARRIE MENTION INTRA MURAL AND EXTRAMURAL INSTITUTIONS EVERY UNIVERSITY SYSTEM HAS A PROCESS. I THINK A THING WE ARE TRYING TO GET AT IS VARIATIONS FRANCIS REFERRED TO IS STANDARD -- WE HEARD GREAT EXEMPLARS WHAT A TERRIFIC PROCESS LOOKS LIKE ONE THING WE WANT TO DO IS PROMULGATE PROCESSES AND GET PEOPLE TO THINK ABOUT IT TO A CERTAIN EXTENT PROCESS CAN ADDRESS WHAT YOU WERE LOOKING AT LINDA. AT THE END OF THE DAY WHAT IS CULTURE? IT IS A SYSTEM OF IDEAS WE AS A SOCIETY BUY INTO DEVELOPING THAT CULTURE AND CHANGE IN THAT CULTURE IS A PART WE ARE TRYING TO GET AT. >> DAVIED GLAZER? >> TWO PARTS ONE ON DATA BUT RELATIVELY SMALL BUT RELATES TO CONVERSATION WE ARE HAVING ON THRESHOLD. ONE RECOMMENDATION ON ONE SLIDE YOU TALKED ABOUT REQUIRED REPORTING INVESTIGATIONS AND FINDINGS. THAT AND STRIKES ME AS TWO VERY DIFFERENT THINGS. REQUIRING REPORTING OF INVESTIGATIONS MEANS THAT BEFORE YOU HAVE DONE THE LEVEL-SETTING AND WHATEVER ELSE, YOU NOW AUTOMATICALLY MADE A BIG DEAL BEFORE THE INSTITUTION HAS YET DONE ITS PROCESS. I'M CURIOUS HOW HARD YOU THOUGHT ABOUT THAT IAN. I SUSPECT YOU GET DIFFERENT REACTIONS TO FINDINGS THAN TO INVESTIGATIONS. >> YEAH. I THINK THAT IS A RESPONSE TO SOMETHING THAT WE HEARD HOW THIS IS PLAYING OUT ON THE GROUND RELATING TO ASSESSMENT WHAT IS GOING ON INVESTIGATIONS CAN TAKE A LONG TIME FAIR TO SAY WORKING GROUP WAS COGNIZANT OF DUE PROCESS YOU NOTE THEY ARE NOT RECOMMENDING THAT THE AGENCY TAKE ANY SPECIFIC ACTION. IT IS AN INFORMATIONAL CHANNEL. INVESTIGATIONS CAN GO ON A LONG TIME AND MORE EGREGIOUS CASES CREATES SITUATIONS WHERE PIS AS FRANCIS DESCRIBED ARE ESSENTIALLY IN SITUATIONS OF POWER AND AGENCY IS SORT OF UNAWARE OF IT WHILE THEY ARE BEING INVESTIGATED AND SO I THINK IT WAS AN ATTEMPT TO SORT OF ADDRESS THAT SITUATION. >> OKAY. >> JUST TO CLARIFY. >> YEAH. >> ALREADY, RULES ARE THAT INVESTIGATION INITIATED AND INVESTIGATIVE PRINCIPLE IS INSTITUTION LEAVE INSTITUTION IS REQUIRED TO TELL NIH HAVING THAT SCIENTIFIC PROJECT GO FORWARD THAT IS IN THERE AND IMPLIES THEN WE ONLY HEAR ABOUT IT THERE IS ADMINISTRATIVE LEAVE DECORATION. >> RELATED WHEN I LOOKED AT NUMBERS ON INTERNAL INTRAMURAL ACTIONS SO FAR -- MUCH HIGHER REPORTING RATE 40% REPORTS ACTED ON TO 20% OF REPORTS WERE ACTED ON. MAKES PERFECT SENSE WHEN YOU INCREASE AWARENESS AND GET MORE PEOPLE TO -- YOU INCREASE NUMBER OF TRUE POSITIVE SUPPORT. YOU LOWER THE BAR. IT FEEDS INTO EXACTLY WHAT WE WERE JUST SAYING YOU WANT PEOPLE TO FEEL FREE TO REPORT. IF THEY KNOW THAT A REPORT WILL LEAD TO WHAT WILL BE PERCEIVED AS A DISCIPLINARY ACTION IN PERMANENT FEDERAL RECORD. YOU ARE CREATING INTERESTING DYNAMICS. >> LARRY COMMENTED ON THIS WELL WE SHOULD NOTE THAT IS NEW DATA AND SOME OF THOSE REPORTS ARE WITH -- ARE IN THE PROCESS. THEY ARE ONGOING INVESTIGATIONS. >> THAT IS RIGHT. >> THEY MAY ULTIMATELY END UP IN ACTION BUT IT IS TOO SOON TO SAY. >> YEAH. >> MINDFUL OF THE FACT WE HAVE SEVERAL MORE RECOMMENDATIONS TO GO QUICKLY HEARING FROM DENA AND ROY DON'T NOT SPEAK BUT BE QUICK ABOUT IT, THANK YOU. >> MANY CASES OF SEXUAL HARASSMENT, THE INSTITUTION OR SYSTEM CONTRIBUTE BECAUSE IN MANY OF THE CASES THEY DON'T WANT BAD PUBLICITY. THAT -- LIKE EFFECT VICTIMS NEGATIVE -- VERY BADLY. SO ARE THERE IMPLICATIONS HERE FOR INSTITUTIONS AND SYSTEM AND PEOPLE RESPONSIBLE FOR THAT ON HOW THEY ACTED? >> YEAH. LET ME -- I THINK THAT IS TRUE. THERE IS ALL KINDS OF INTEREST IN THE PROCESS. WITHOUT BEING TOO NAìVE ABOUT IT, I'M BEING TOO GENERALIZED. THERE IS A GENERAL LACK OF TRANSPARENCY IN THIS PROCESS. WHILE UNDERSTANDING PRIVACY CONCERNS AND BY THE WAY PRIVACY CONCERNS CAN ACTUALLY BE A BAD THING IN TERMS OF SUPPORTING SOME OF THESE VICTIMS. IT BECOMES VERY CONVOLUTED. I THINK WHAT I HAVE HEARD, HAVING A STANDARD OPERATING PROCEDURE AND BRINGING UP MOST OF THE INSTITUTIONS TO THOSE WHO WE WOULD BELIEVE ARE ACTUALLY DOING A PRETTY DECENT JOB IS WHAT WE ARE SAYING. TO SOME EXTENT I DON'T KNOW IF YOU WANT TO COMMENT CHRISTINA BUT THERE IS A LOT OF THIS GOING ON THIS PROCESS A LOT OF THE TIME AND MORE HOW DO I PUT THIS. THE BEST INSTITUTIONS HAVE FOUND A WAY TO MANAGE INTERESTS AND THOSE OF THE VICTIM AND TRY TO SEE THERE IS DUE PROCESS TO GO FORWARD. >> I WANT TO MAKE SURE I UNDERSTAND THE QUESTION. I'M INTERPRETING IT MAYBE DIFFERENT THAN WHAT YOU ARE SAYING. LET ME SEE IF I CAN REPEAT IT. ARE YOU ASKING IF THERE IMPLICATIONS FOR THE INSTITUTION IF AN INVESTIGATOR IS FOUND COMPLICITY IF HAD SOME SORT OF SEXUAL HARASSMENT IS THAT WHAT YOU ARE ASKING FROM THE NIH OR MAYBE I'M MISSING IT. >> ALL THIS IS FROM THE NIH FROM MY UNDERSTANDING. >> YEAH. >> SO THERE ARE MULLIM CASES THE PUBLIC KNOWS ABOUT IN WHICH FOR EXAMPLE A UNIVERSITY OR A SUBSET OF THE PEOPLE WHO UNDER ADMINISTRATION WOULD NOT WANT BD PUBLICITY OR FORGOT IF REASONS ARE UNDERSTOOD AND NOT UNDERSTOOD SOMETIMES. JUARE SILENT AND CONTINUE TO BE SILENT FOR A LONG TIME AND HELP THE BAD BEHAVIOR CONTINUES. I'M ASKING WHETHER HOW THE SYSTEM OR THE RECOMMENDATIONS ARE GOING TO DEAL WITH THOSE INDIVIDUALS NOT JUST THE PERPETRATOR OF THE MISCONDUCT HIM OR HERSELF. >> I THINK I UNDERSTAND THE QUESTIONS SOME RECOMMENDATIONS WITH REGARDS TO TRANSPARENCY AND ACCOUNTABILITY IS TO BRING IT TO LIGHT WE ARE TALKING ABOUT RECORDING YOU WILL SEE IN RECOMMENDATIONS SPECIFIC REPORTING THAT COULD IN A WAY PROTECT THE INDIVIDUAL WHO HAS BEEN WRONGED WE WILL GET TO THAT A LITTLE LATER ON IF WE DON'T WOULD YOU BE SO KIND TO ASK AGAIN? >> ROY HOLD FOR THAT SOMEBODY IS WAITING AT THE MICROPHONE. >> WE WERE CONCERNED THERE WAS INCONSISTENT LANGUAGE FOR HARASSMENT IN THE VOLUMINOUS CANYON OF AMA POLICIES WE YESTERDAY AT THE END OF AMA MEETING OUR RESOLUTION WAS APPROVED TO HAVE A. MA STUDY WHAT OUR INTERNAL LANGUAGE IS COMPARED TO FEDERAL OR OTHER ORGANIZATIONAL DEFINITIONS TO COME UP WITH A STANDARD BEST PRACTICE DEFINITION. LINDA WE ARE WORKING ON IT. IT IS A RAY OF HOPE. >> GOOD TO KNOW. WE WILL WATCH CLOSELY AND SEE IF WE CAN BE OF SOME ASSISTANCE. SHOULD WE GO ON TO RECOMMENDATION 2? SFWL THANK YOU VERY MUCH FOR THAT FEEDBACK. >> OKAY. THE NEXT ONE IS, AGAIN, IN THE CONTEXT OF TRANSPARENCY AND ACCOUNTABILITY TO REQUIRE ALL PIS TO ATTEST THEY HAVE NOT VIOLATED AND WILL NOT VIOLATE THEIR INSTITUTIONAL CODE OF CONDUCT. JUSTIFICATION HERE IS NIH DOESN'T HAVE ANY MECHANISMS IT -- VIOLATION OF THEIR INSTITUTIONS FACULTY CODE OF CONDUCT. DATA WE HEARD IS SOME NIH INVESTIGATORS HAVE BEEN SANCTIONED BY THEIR INSTITUTION FOR SEXUAL HARASSMENT AND CONTINUED TO RECEIVE GRANT FUNDING. THAT OF COURSE SEEMS TO GO AGAINST THE FACT THIS IS AN IMPORTANT POTENTIALLY IMPORTANT PROFESSIONALLY MISCONDUCT AND DOESN'T PUT THE NIH IN A PARTICULARLY GOOD LIGHT. PIS IN -- THE SUGGESTION IS PIS AND CO-PIS ON NIH GRANTS MUST ATTEST NE HAVE NOT BEEN FOUND TO VIOLATE THEIR INSTITUTION'S CODE OF CONDUCT INCLUDING SEXUAL HARASSMENT. THIS WOULD INCLUDE WHAT WE TALKED ABOUT: BULLYING OR HARASSMENT MORE GENERALLY. INSTITUTIONAL SIGNING OFFICIALS MUST ALSO ATTEST THERE ARE NO FINDINGS OF PROFESSIONAL MISCONDUCT BY PI AND CO-PI AND INFORMATION DIRECTED TO NIH STAFF AND NOT STUDY SECTION WHICH IS AN IMPORTANT POINT. APPROACH PROPOSED BY WORKING GROUP IS A COUPLE RETROSPECTIVE QUESTIONS AND ONE PROSPECTIVE QUESTION. RETROSPECTIVE QUESTION IS MISCONDUCT OR SEXUAL HARASSMENT IN THE PAST SEVEN YEARS I WILL TALK ON THE NEXT SLIDE ABOUT WHY SEVEN YEARS HAVE YOU BEEN INVOLVED IN A SETTLEMENT REGARDING [READING FROM TEXT]. PROSPECTIVE QUESTION IS WILL YOU ABIDE BY YOUR INSTITUTIONS CODE OF CONDUCT AND POLICIES REGARDING -- SEXUAL HARASSMENT DURING THE GRANDGRANT PERIOD THIS IS HOLDING PEOPLE ACCOUNTABLE. THIS IS -- THIS WAS AS YOU CAN IMAGINE DISCUSSED AT LENGTH BY THE WORKING GROUP. THERE IS A FEELING YOU WANT TO MAKE SURE THERE IS DUE PROCESS HERE AS THERE IS IN THE CRIMINAL JUSTICE SYSTEM. FIRST OF ALL NIH FINDINGS AND MISCONDUCT SETTLEMENT WITH NONDISCLOSURE AGREEMENT. NIH DOESN'T PRECLUDE THIS REPORTING OR SHOULDN'T PRECLUDE THIS REPORTING. THIS WAS A LOT OF DEBATE HERE THIS IDEA YOU SHOULD BE ABLE TO BE REHABILITATED. WHAT IS THE APPROPRIATE TERM IF LIMITED CORRECTIVE ACTION HAS BEEN IN PLACE AND NO REPEATS? LET'S SOOE SAY SEVEN YEARS WASN'T ARBITRARY BUT ARRIVED AFTER SOME DISCUSSION. [READING FROM TEXT]. HERE IS THE POINT WHERE OBVIOUSLY IN THIS CASE, IT IS SEEN THAT YOU SHOULDN'T HAVE TO REPORT THIS AND ULTIMATELY YOU ARE FOUND IN VIOLATION OF PROFESSIONAL MISCONDUCT. THEN THERE WILL BE TIME OBVIOUSLY LATER TO DEAL WITH THAT. THIS IS VERY IMPORTANT. IN A SENSE, THERE SHOULD BE -- EACH CASE SHOULD BE TAKEN ON ITS OWN MERITS WHICH GETS TO THE IDEA OF THRESHOLDS. THERE SHOULD BE NO PREDETERMINED CONSEQUENCES AND NIH SHOULD EXAMINE EACH CASE PRESUMABLY AND IN CONTEXT OF LARGE CASES THEY SHOULD BE IN A GOOD POSITION TO DECIDE THE LEVEL OF SANK THAT MAY OR MAY NOT BE NECESSARY. I THINK THAT IS -- YES. THAT IS THE LAST ONE. >> LET'S OPEN THIS ONE UP FOR DISCUSSION. >> JOSE. >> OBVIOUSLY, THE GOAL IS TO MAKE SURE THIS SORT OF THING NEVER HAPPENS; RIGHT? THAT IS THE ULTIMATE GOAL AND WOMEN ARE NOT -- YOU KNOW, DRIVEN AWAY FROM MEDICAL SCIENCE BECAUSE OF THESE THINGS ASSUMPTION AND RECOMMENDATION IS THAT ONLY PIS AND CO-PIS DO THIS. THE POINT IS YOU CAN BE A PREDATOR AND THEN JUST HAVE 10% EFFORTS AS [INDISCERNIBLE] SOMEBODY ELSE'S GRANT AND YOU WOULD ESCAPE THIS DEDUCTION YOU CONTINUE TO HAVE NIH-FUNDED CAREER AS A PREDATOR THIS ONLY APPLIES TO PIS AND CO-PIS ANYWAY TO EXPAND RENLSZS SO IT APPLIES TO ALL PERSONNEL WHICH NIH HAS SUPERVISORY OR ANY FUNDING AUTHORITY? >> THANK YOU JOSE I DON'T THINK WE DID CONSIDER THAT. SO I THINK WE SHOULD GO BACK AND CONSIDER IT. I MEAN, WHAT COMES TO MIND AND WE WILL STILL GO BACK AND CONSIDER IT IS I DO THINK THIS IS WHERE INSTITUTION HAS A ROLE TO PLAY. >> YES. >> YOU KNOW, ALL OF THE WAY THROUGH THIS, NIH CAN'T SUBSTITUTE REALLY FOR INSTITUTION. INSTITUTION HAS TO HAVE -- I MEAN, PRESUME INSTITUTION WILL KNOW IF CO-PI IS A SERIAL PREDATOR. THERE MIGHT BE -- AM I BEING NAìVE? >> THIS KNOWS EXACTLY WHO IS BEING ON THE ROSTER. >> SORRY. >> [INDISCERNIBLE]. >> THIS ADDITION WILL KNOW ALL OF THE KEY PERSONNEL IN THE GRANT LYING INSTITUTIONAL OFFICIALS [INDISCERNIBLE] PI OR CO-PI IT SHOULD MAYBE BE EXPANDED TO EFSHG LISTENING. >> I WAS MAKING A DIFFERENT COMMENT THAT IS EVERYONE IS A PARTNER IN MAKING SURE THIS KIND OF SERIAL -- IT IS ABOUT PROFESSION LIFT CONDUCT AND PEOPLE ACKNOWLEDGING IT AND DEALING WITH IT. >> YEAH. GOOD POINT. >> THAT IS ALL I WAS DOING. I'M SAYING ON TOP OF THAT. >> IT IS A GOOD POINT. THE OTHER THING THAT MAY NOT BE OBVIOUS BUT IS WORTH POINTING OUT IS THAT YOU KNOW I THINK IT UNDERLIES A NUMBER OF RECOMMENDATIONS WE ARE TRYING TO FIX WE HEARD A LOT OFTHIS IS AT INSTITUTIONS NOT ALL BUT MANY THERE IS REMARKABLE DISCONNECT BETWEEN WHATEVER PORTION INSTITUTION THAT IS HAND ISSUES RELATED TO SEXUAL HARASSMENT AND PORTION INSTITUTION MANAGING RESEARCH AND SCIENCE. IT IS NOT UNCOMMON. I THINK, MIKE LOUER CAN ATTEST AND WE HEAR FROM SENIOR RESEARCH OFFICIALS VICE PRESIDENT FOR RESEARCH THEY HAD NO IDEA IT WAS BEING HANDLED IN GENERAL COUNCIL OR TITLE IX OFFICE IN SOME WAYS UNDERLYING RECOMMENDATIONS IS HOW CAN AGENCY USE INFLUENCE TO HELP MAKE CONNECTIONS ON GROUNDS LEVEL INSTITUTION SO THERE IS AN OVERALL AWARENESS WHAT IS GOING ON IN THE CONTEXT OF NIH FUNDED RESEAR RESEARCH. >> YOU HAD A QUESTION RELEVANT TO THIS? >> YES. THANK YOU. I LIKE THIS RECOMMENDATION. ONLY CONCERN I HAVE IS THERE IS NO STANDARD INSTITUTIONAL CODE OF CONDUCT THAT VARIES A LOT, PARTICULARLY ON PROFESSIONAL MISCONDUCT AND SEXUAL MISCONDUCT ALTHOUGH THAT IS BEGINNING TO CHANGE. I'M WONDERING AND SOME INSTITUTIONS HARDLY HAVE ANYTHING RELATED TO THE AREAS. ISN'T THERE SOME MINIMAL LEVEL OF EXPECTATION WE SHOULD HAVE AND NOT JUST LEAVE IT TO INSTITUTIONAL CODE OF CONDUCT SOME OF WHICH MAY NOT HAVE A WELL-DEVELOPED CODE? >> ROY, THAT IS A GREAT SUGGESTION AND IT DOVE-TAILS ON TOP OF WHAT CAREY SAID HOW NIH CAN HAVE INFLUENCE OF BEING ONE OF THE LARGEST FUNDING AGENCIES TO RECOMMEND SUGGEST THIS IS STANDARD OPERATING PROCEDURES AND STANDARD CODE OF CONDUCT AND YOU MAY WISH TO ADOPT THIS AND LEAD BY EXAMPLE. I THINK THAT IS WHAT YOUR POINT WAS CAREY. >> SHELLY AND THEN REBECCA? >> I HAVE A COUPLE QUESTIONS. ONE IS HOW DID YOU ARRIVE AT THE SEVEN YEAR TIMING FOR THE PAST 7 YEARS? I THINK SOME EXAMPLES WE KNOW OF IN THE PRESS ARE -- HAPPENED BEFORE THAT. THE PIS ARE STILL NIH FUNDED. EVEN WITHIN THE PURVIEW OF NIH, I'M CURIOUS HOW TO -- HOW THAT WILL BE. YOU KNOW, HOW YOU ARRIVED AT THE SEVEN-YEAR NUMBER OR SOMETHING LIKE SABBATICALS OR. >> YEAH. I MEAN, I DO THINK THAT THE -- THE -- ONE OF THE ARGUMENTS THAT CAME UP AGAINST pSORT OF, YOU KNOW, THE -- LET'S START WITH THE EXTREME EXAMPLE OF INFINITE HAPPENED AT ANY TIME. >> RIGHT. >> IS THIS NOTION OF DUE PROCESS AND RANGE OF BEHAVIORS AND IDEA THAT YOU COULD COMMIT SOMETHING THAT IS CLEARLY SEXUAL HARASSMENT AND PERHAPS FALLS AGAIN SEXUAL HARASSMENT IS A RANGE OF BAD BEHAVIORS THAT MIGHT FALL IN SOMETHING THAT IS IN LESS EGREGIOUS SPACE DESERVES CORRECTIVE ACTION WHICH IS UNDERTAKEN AND THAT PERSON NEVER DOES ANYTHING WRONG AGAIN. I THINK THERE WAS DEFINITELY A SENSE SOMEONE SHOULD NOT BE SORT OF BRANDED FOR LIFE AS IT WERE. THEN IF YOU WANT TO TALK A LITTLE MORE ABOUT YOU MENTIONED SEVEN YEARS IS SOMEWHAT ARBITRARY. >> I GUESS I WAS TALKING ABOUT WHEN SOMETHING HAS COME TO LIGHT THAT OCCURRED BEFORE YOU KNOW LONGER THAN SEVEN YEARS AGO. THAT PI IS STILL FUNDED. I'M JUST -- >> OH, YOU MEAN. >> THESE ARE TRICKY QUESTIONS. EVERYONE ACKNOWLEDGES THAT I'M JUST SOME EGREGIOUS EXAMPLES COME TO LIGHT LONGER THAN HAD HAPPENED BEFORE SECH YEARS. >> RIGHT. >> AND THEY ARE STILL NIH FUNDED. >> LET ME PLAY IT BACK. I THINK I UNDERSTAND. HOPEFULLY GOING FORWARD EVENTUALLY THERE WILL BE VERY FEW CASES IT THAT ARE HIDDEN OR JUST NEVER TALKED ABOUT OR GET THROUGH. THIS IS WHAT THIS IS. WHAT YOU ARE TALKING ABOUT IS HISTORICAL AND SEXUAL HARASSMENT. RIGHT? MORE THAN SEVEN YEARS AGO, WHAT HAPPENS? WE HADN'T CONSIDERED THAT TO BE HONEST. WE SHOULD GO BACK AND TALK ABOUT THAT. I LITERALLY DON'T HAVE AN ANSWER FOR YOU. >> DATA [INDISCERNIBLE] VERSUS DATE OF FIENTING DATE OF INCIDENT VERSUS DATES OF FINDING. >> THAT IS RIGHT, DAVID I WAS GOING TO RECOMMEND IT CERTAIN THINGS DON'T COME TO LIGHT AND I HAVE DEALT WITH A SITUATION LIKE THAT LOOK-BACK IS SEVEN YEARS FROM THE MOMENT OF FINDING. >> SHELLY, YOU HAD A QUESTION? >> YEAH. I HAD ONE OTHER POINT. WHAT WE ARE LEARNING IS THAT WHEN TRYING TO DISCUSS AWARENESS OF HARASSMENT THAT MANY -- I WILL SAY IT BLUNTLY. MANY MEN DON'T RECOGNIZE OR HAVE AN AWARENESS WHAT HARASSMENT IS TODAY IN CURRENT TIME WE ARE TALKING IN REAL-TIME NOW WHEN MEN ARE ATTENDING AWARENESS WORKSHOPS OR WHATEVER. IT IS REALLY CLEAR THERE IS A GAP IN UNDERSTANDING WHAT SEXUAL HARASSMENT IS. >> YEAH. >> I'M THINKING HOW ARE WE GOING TO CULTURALLY -- WHEN YOU HAVE THIS RECOMMENDATION TO ATTEST THEY HAVE NOT VIOLATED AND WON'T VIOLATE INSTITUTIONAL CODE OF CONDUCT I BELIEVE THERE HAS TO BE SOME MECHANISM TO SHOW THEY HAD SOME SORT OF AWARENESS BUILDING TOWARDS WHAT CONSTITUTES. YOU SEE WHAT I'M SAYING. >> YEAH. I WILL SAY ALTHOUGH. >> OTHERS DOING THIS IN INSTITUTIONS RECOGNIZE THAT THERE IS A GAP. >> I WILL SAY ALTHOUGH IT DIDN'T MAKE IT INTO OUR TOP TIER LIST OF RECOMMENDATIONS WE SPEND A LOT OF TIME TALKING ABOUT EXACTLY THAT ABOUT TRAINING AND AWARENESS BUILDING AND MORE EFFECTIVE TRAINING. I THINK ONE OF THE THINGS WE DISCUSSED AND THIS CERTAINLY IS COMING UP INTERNALLY AT NIH IS AGAIN TOUCHING ON CULTURE AND LOTS OF TIMES ONE OF THE ISSUES I HEARD A LOT ABOUT AS I HAVE GIVEN TALKS IS MANY SEXUAL HARASSMENT TRAINING EXPERIENCES ARE OFFICE-BASED AND OFFICES HAVE DIFFERENT CULTURES RESEARCH LABORATORIES AND ACADEMIC INSTITUTIONS AND PEOPLE DON'T SEE THEMSELVES IN THOSE EXAMPLES. HOW CAN WE CREATE BETTER TRAINING AND EDUCATION AND BETTER OUTREACH AND MECHANISMS MORE TAILORED FOR SCIENCE AND ALLOW PEOPLE TO SEE THEMSELVES IN, FOR EXAMPLE, THE INTERACTIONS THAT OCCUR BETWEEN A MENTOR AND TRAINEE AND THINGS PEOPLE MAY BELIEVE ARE JUST SORT OF YOU KNOW NORMAL BEHAVIORS AND THAT IN FACT DO CROSS THIS LINE AND CREATE CLEARER EXAMPLES AND SO THERE HAS BEEN A LOT OF DISCUSSION ABOUT THAT. >> REBECCA. >> THAT IS AN EXCELLENT POINT MANY UNIVERSITIES INCLUDING IN NEW YORK WE HAVE A LAW WHERE ANNUALLY EVERY SINGLE INDIVIDUAL WILL UNDERGO SEXUAL HARASSMENT TRAINING THAT IS BECOMING MORE OF THE TREND AND I THINK IT WILL HELP WITH THIS. >> THAT REALLY CAME OUT IN THE NAS REPORT. >> YEAH. THE OTHER THING TO BE A LITTLE FACETIOUS IS DOING ONLINE TRAINING AND SAYING YOU ARE DOING ONLINE TRAINING EVERY YEAR I LEARNED PROBABLY. >> YEAH. >> FOR LOTS OF PEOPLE IS NOT ENOUGH. GOES BACK TO THE POINT YOU WERE MAKING ABOUT MORE EXPERIENTIAL TYPE OF APPROACH. >> REBECCA? >> INAPPROPRIATE BEHAVIOR IN MANY SKIENGTIVIC COMMUNITIES HAPPENS AT CONFERENCES. IT IS NOT CLEAR TO ME FIN STUGSAL CODES OF CONDUCT HAVE SORT OF JURISDICTION OVER FACULTY BEHAVIOR AT CONFERENCES AND IN -- I WORK IN THREE SUBFIELDS TWO WHICH ARE GREAT FOR WOMEN AND ONE THAT HAS REALLY ENDEMIC PROBLEMS IN THIS AREA THAT I PERSONALLY EXPERIENCED. I THINK IF THERE WAS A WAY TO SORT OF -- I THINK NIH HAS THE POWER TO SORT OF USE LANGUAGE THAT SORT OF FORCES INSTITUTIONS TO COUNT SORT OF CONFERENCE BEHAVIOR AS FACULTY IN GENERAL. >> YOU BET. THAT IS SOMETHING WE HAD EXTENSIVE DISCUSSION WITH IN WORKING GROUPS AND YOU WILL SEE IN THE NEXT STEP THAT IS ITEMS WE WILL WORK AT. THANKS SO MUCH FOR BRINGING IT UP. I APPRECIATE IT. >> CODE OF CONDUCT DOES EXTEND WHEN YOU ARE IN A CONFERENCE. WE HAVE HAD CASES WHERE AN INDIVIDUAL HAS BEEN REPORTED TO HAVE DONE THINGS [INDISCERNIBLE] A CONFERENCE. THAT INDIVIDUAL'S BPR IS CON ACTED AND YOU CAN WORK THROUGH THE SYSTEM THAT WAY WHEN WE DO REPORT IT, YES. IT DOES EXTEND. >> HENCE ON THIS RECOMMENDATION. YES, HOEDZ A? SORRY. I DIDN'T SEE YOU. GOODNESS. I'M NOT LOOKING CAREFULLY. >> JUST AN OBSERVATION THAT NO UNIVERSITY WANTS TO COME TO THE ATTENTION OF NIH UNDER THE CIRCUMSTANCES. >> THAT IS VERY TRUE. >> DISCOVERY AND CURES, YES. THIS, NO. I WOULDN'TER TO WHAT EXTENT YOU MENTION CAREY A FAIR NUMBER OF AN ACTION THAT HAS BEEN TAKEN OVER THE PAST YEAR AND WHETHER THOSE ACTIONS ACTUALLY HAVE CHANGED CULTURE AT THE UNIVERSITY OR AT LEAST OVERSIGHT OF CULTURE AT THE UNIVERSITY? >> I HOPE SO. I THINK IT IS PROBABLY TOO SOON TO TELL. YOU KNOW, THIS IS AGAIN A SIGNIFICANT UPTICK TO A FAIRLY SMALL NUMBER OF CASES. I THINK IT IS FAIR TO SAY I'M LOOKING AT MYCTHAT INSTITUTIONS ARE CERTAINLY PAYING A LOT OF ATTENTION TO THIS. YOU KNOW, AT THE END OF THE DAY IT IS IMPORTANT TO THINK ABOUT WHAT IS THE CULTURE THAT WE ARE TRYING TO SHIFT HERE? LOTS OF IT COMES DOWN TO AS CHRISTINA SAID THE IDEAS AND PRINCIPLES AND BEHAVIORS PLAYING OUT IN WAYS AND THINKING ABOUT HOW WE IMPACT THEM. ONE THING WE HEARD IN STORIES OF TARGET HARASSMENT IS PERCEPTION THAT INSTITUTIONS PROTECT VERY-WELL-FUNDED PIS IT IS A PROBLEM DISINCENTIVE TO REPORT AND DISINCENTIVE TO TAKE ACTION IT ADDS TO THERE IS NO SENSE IN ME REPORTING THIS THING THAT HAPPEN TODAY ME THEY WILL NEVER BELIEVE HIS WORD OVER MINE. IS HE A VERY WELL-FUNDED SCIENTIST BY NIH. THAT PERCEPTION AND CULL BEHAVIOR IS ULTIMATELY WHAT WE WILL CHANGE AND IT WILL TAKE A LOT MORE ACTIONS TO BEGIN TO TURN THE TIDE ON THAT. HOPEFULLY ULTIMATELY THAT STRONG MESSAGE WILL BEGIN TO MOVE THE NEEDLE IN THAT SENSE. >> I WILL ADD YOUR APPROACH KIND OF LEVERAGING WHAT LESSONS LEARNED ON RESEARCH, YOU KNOW, MISCONDUCT AND FOLLOWING THAT PATH BECAUSE I CALLED YEARS AGO. THAT WAS AN INFLECTION POINT FOR THIS DISTRIBUTED MODEL OF RESEARCH. AND THAT WHAT YOU ARE APPROACHING HERE IS I THINK AND PARTICULARLY AROUND THAT PROFESSIONAL MISCONDUCT PIECE IS A REALLY GREAT WAY TO GO. >> YOU KNOW, JUST TO ECHOSOME OF THE TRAINEE MEMBERS OF OUR WORKING GROUP AND A POINT THAT THEY MADE VERY CLEARLY WHICH I THINK IS REALLY IMPORTANT IS THAT WE SOMETIMES TREAT ACADEMIC RESEARCH ENVIRONMENTS AS IF THEY ARE NOT PROFESSIONAL ENVIRONMENTS THERE IS A SENSE OF FAMILY AND SENSE OF YOU KNOW SOMETHING LESS THAN A PROFESSIONAL WORKPLACE AND IN SOME WAYS THAT IS VERY CLOSE TO WHAT WE VALUE ABOUT THAT EXPERIENCE LOTS OF PEOPLE TALK ABOUT THAT IN VERY FOND TERMS TRAINEE MEMBERS SAID VERY CLEARLY THIS IS MY WORK PLACE. YOU KNOW, I COME HERE AND GET A STIPEND. YOU KNOW, I HAVE -- THERE ARE EXPECT TATHSS FOR ME SHOWING UP AND DOING WORK AND THIS IS RELATED TO MY CAREER DEVELOPMENT. IT IS A PROFESSIONAL WORKPLACE. I SHOULD BE TREATED AS IF THIS IS A PROFESSIONAL WORKPLACE AND BEGINNING TO PROFESSIONLIZE THE ENTIRE RESEARCH ENTERPRISE AND CONNECT IT TO A PROFESSIONAL SET OF EXPECTATIONS AND CODE OF CON DUCT IS PART OF ENABLING THAT CULTURE CHANGE. >> LET'S HEAR FROM JOSE AND SHELLY AND PROBABLY MOVE ON. JOSE, YES, PLEASE. >> GOING BACK TO THE SEVEN-YEAR PROBATION PERIOD. I AGREE WITH THE NOTION THERE SHOULD BE A WINDOW FOR REDEMPTION YOU CAN'T CONDEMN SOMEONE IN PERPETUITY I RECOMMEND THE NATURE OF -- SEXUAL HARASSMENT WITH RESEARCH + CONDUCT LEADING AND FINDINGS OF RESEARCH MISCONDUCT MOST OF THE LIMITS THREE YEARS MOST -- THAT IS WHAT THEY USE IF YOU WANT TO USE THAT AS AT LEAST A REFERENCE A SEVEN YEAR WOULD ACTUALLY SIGNIFY GREATER SERIOUSNESS. MAYBE THAT IS A REFERENCE ONE CAN COME UP WITH TO USE AN A REFERENCE NUMBER. >> GREAT RANGE WE WILL CHEW ON THAT THANK YOU. >> THERE IS AN OCCASIONAL LIFETIME BAN. >> SHELLY. >> JUST A QUICK SONS TO ROBERTO ONE THING THAT CAME UP FROM NIS REPORT IS I LIKE ACTIONABLE IDEAS AND IN TERMS OF CONFLICT OF INTEREST OF INSTITUTION TO BRING TOGETHER GROUPS OF NIH-FUND INSTITUTIONS AND INCLUDE MENTIONED SOME ARE DOING IT WELL ISSUES COME UP TO THE REGIONAL LEVEL. IT IS NOT THE -- YOU KNOW, IT IS NOT ONLY INSTITUTION HAVING TO DECIDE WHETHER TO GO FORWARD. >> OKAY. THANK YOU. REBECCA, DID YOU HAVE A COMMENT OR WAS IT FROM BEFORE? >> SORRY. IT WAS FROM BEFORE. >> OKAY. SHALL WE GO TO RECOMMENDATION THREE? CHRISTINA. >> I WOULD LICK TO THANK MEMBERS OF WORKING GROUP AND MY CO-CHAIRS CARRIE AND FRANCIS AND DIRECTOR COLLINS AND PRINCIPAL DIRECTOR TABAK FOR YOUR COLLECT INPUT ON THIS ISSUE. RECOMMENDATION 3 RESTORATIVE JUSTICE FOR SURVIVORS AND RECAPTURING LOST TALENT. PRINCIPLE JUSTIFICATION FOR THIS RECOMMENDATION IS SURVIVORS OF SEXUAL HARASSMENT ARE LOST AFTER ENTERPRISE ENDURING SEXUAL HARASSMENT [INDISCERNIBLE] RETALIATION AND [INDISCERNIBLE] I WANT TO ECHO WHAT FRANCIS SAID ABOUT THE TOWN HALL MEETING AND HEARING FROM SEVERAL INDIVIDUALS THAT WERE HARASSED AND ONE THING I THINK WE NEED THAT I LEARNED IS THAT IT MAY NOT BE POSSIBLE TO RECAPTURE THIS TALENT UNLESS WE ACT QUICKLY. THESE RECOMMENDATIONS NEED TO HAVE INTERVENTION SOON OR WE WILL LOSE THE INDIVIDUALS AND THEY WON'T COME BACK AND WE SAW WITH INDIVIDUAL WHO WENT TO A LAW FIRM, PATENT LAW FIRM BUT NONETHELESS LAW FIRM. INDIVIDUAL LEVEL ANOTHER A-HA MOMENT I GUESS FOR SOME OF US IS THESE INDIVIDUALS ARE WRONGED AT LEAST TWICE AS FRANCIS SAID HARASSMENT HAPPENS AND PROCESS AND RETALIATION THAT RESULTS IN LOSING CAREER LIVELIHOOD AND SENSE OF SELF-WORTH. TWO THINGS IS ONE WHAT HAPPENS TO INDIVIDUAL WHICH IS IMPORTANT TO US ESPECIALLY WHEN WE ARE IN FAMILY ENVIRONMENT AS-IS ACADEMY AND WORKFORCE AND TALENT THAT HINDERS SCIENTIFIC DISCOVERIES DISCOVERIES WE DISCUSSED EARLIER TODAY. RECOMMENDATION IS TO ESTABLISH MECHANISMS TO REINTEGRATE SURVIVORS INTO RESEARCH WORKFORCE ALONG WITH SYSTEMIC CULTURE CHANGE WE TALKED A LITTLE ABOUT TO SUPPORT SUCCESSFUL REINTEGRATION OF SURVIVORS WHAT ARE SPECIFIC RECOMMENDATIONS AND POSSIBLE APPROACHES? YOU CAN SEE A THEME HERE: IMMEDIATE AND INTERMEDIATE ACTION AND LONG TERM ACTION. IMMEDIATE ACTION ISSUED NOTICE INDICATING NIH REENTRY SUPPLEMENT PROGRAM IS SEEKING APPLICATIONS OF INDIVIDUALS WHO FACE ISSUES OF SELF YOU'LL HARASSMENT. -- SURVIVORS OF SEXUAL HARASSMENT NOT DEPENDENT ON A SPECIFIC MENTOR WE HAD DISCUSSION AROUND THIS PARTICULAR RECOMMENDATION. YOU WILL SEE AS WE GO ON TO THE NEXT RECOMMENDATION ON 4 WE HAVE SPECIFIC IDEAS ON THAT. WE FOUND THAT IN ONE CASE INDIVIDUALS THAT TESTIFIED IN THE TOWN HALL WAS ACTUALLY RUNNING AN NIH FUNDED CLINICAL TRIAL PROTOCOL AND WAS NOT -- SHE WAS FORBIDDEN FROM TALKING TO THE MENTOR AND WHEN HER AND THE MENTOR HAD A DIFFERENCE IN OPINION WHAT WAS GOING FORWARD THE ACTUAL TRIAL WAS PUT AT RISK BECAUSE OF THE -- SHE WAS STILL DEPENDENT ON THE MENTOR FOR TRIAL AND COULDN'T TALK TO THE MENTOR IT DIDN'T SEEM TO BE IN THE BEST INTEREST OF ANYONE OR ANYTHING ANOTHER INTERMEDIATE TERM ACTION IS ATOR ALL -- ALLOW FOR REENTRY PATH FOR SURVIVORS AND SEXUAL HARASSMENT. WE THINK THIS WOULD BE A VERY GOOD RECOMMENDATION. I WILL GO BACK FOR A MINUTE. I NEED TO SEE IF THERE ARE QUESTIONS OR XHERNTS OR RECOMMENDATIONS YOU MIGHT HAVE ON THIS RECOMMENDATION 3. >> PLEASE, JOSE. >> OBVIOUSLY, I APPLAUD THE SPIRIT OF THE RECOMMENDATION. I THINK TRICKY PART MIGHT BE IN THE SPECIFICS I IMAGINE SUFFERED SEXUAL HARASSMENT AND WHAT IT MEANS TO THEIR OWN PERCEPTION AND CAREER AND GO TO SEEK VINDICATION AND PROCESS MISTREATS THEM AND THERE IS ALL THESE CONTINUOUS WOUNDS. HOW OFTEN CAN YOU TAKE THAT I IMAGINE MECHANISM GETS PROMULGATED AND PERSON COMES IN TO SEEK FINANCIAL SUPPORT TO RETURN TO SIGNS I WILL ASSUME THAT NOT EVERYBODY THAT SEEKS THAT WILL BE FUNDED. THERE WILL BE A FAILURE RATE ALSO WHAT KIND OF EVIDENCE DO THEY HAVE TO PROVIDE FOR SEXUAL HARASSMENT TO BE ISSUE AND EVIDENCE WOMAN HAS ACCESS TO VARIES ON CIRCUMSTANCES PART OF EVALUATION OR FUNDING IS NOT 100 PS IT IS A 4TH WOUNED THAT PERSON RECEIVES SO. >> GOOD POINT. >> A COUPLE OF THINGS. JENNINE CLAYTON WISHES TO TALK A LITTLE ABOUT ABOUT THE REENTRY PROGRAM AND EXISTS NOW AND COULD THEORETICALLY BE USED IN A WAY THAT HASN'T NECESSARILY BEEN FRAMED IN THAT SENSE. IT IS SORT OF REASON NEUTRAL IN WAYS CHECKING A BOX I HAVE ONE OF THE QUALIFYING REASONS WITHOUT GOING INTO A LOT OF DETAIL. I HAVE TO SAY IN TALKING WITH SURVIVORS, YOU KNOW, THESE ARE ALL -- THESE ARE ALL WOMEN WHO GOT INTO SCIENCE FOR THE SAME REASON WE ALL GOT INTO SCIENCE. THEY LOVE SCIENCE AND THEY WANTED A CAR AUTOER IN RESEARCH. WHAT IS MOST FRUSTRATING TO THEM IS THEY FEEL THEY HAVE LOST THE OPPORTUNITY MOST FRUSTRATING WHAT IS FRUSTRATING AMONG FRUSTRATIONS THEY FEEL THEY LOST THE OPPORTUNITY TO BE ON THE RESEARCH SCIENCE PATH BECAUSE OF THIS SORT OF PERPETUAL ASSOCIATION WITH A PARTICULAR MENTOR OR PARTICULAR AREA OF RESEARCH OR PARTICULAR INSTITUTION. THEY ARE SAVVY ENOUGH. THEY ARE NOT SAYING I WANT SOMETHING OUTSIDE OF THE COMPETITIVE PROCESS. THEY ARE SAYING I WANT A POSSIBILITY TO BE ABLE TO -- A FAIRFAIR SHOT TO GET BACK ON MY FEET AND REENTER SCIENTIFIC PATHWAY THEY UNDERSTAND IF THIS HADN'T HAPPENED TO THEM AND EVERYTHING WENT ALONG SWIMMINGLY THEY WILL BE IN A POSITION -- NIH GRANT THAT IS NATURE WHAT WE DO WHAT FEELS LIKE A COMPLETE LOSS OF OPPORTUNITY AT ALL THAT I THINK WE HEARD IS A COMMON THEME THAT PEOPLE SAY THERE IS JUST NOT A PLACE IN THE CURRENT ON-RAMP SYSTEM WORKS FOR ME HAVING HAD THIS DERAILING EXPERIENCE. >> IF I COULD ADD TO THAT THESE ARE GREAT COMMENTS DEVIL IS IN THE DETAILS I THINK. ONE THING TO BE STRAIGHTFORWARD IS WAS THERE A FINDING IF THERE IS A FINDING IT IS A BOX THAT IS ELIGIBLE FOR FUNDING MECHANISMS. CARRY IS RIGHT JUST THE FACT THERE IS A MECHANISM NOW. IT IS A LITTLE BIT NSF HAD A MID-CAREER FOR WOMEN A GRANT PRGRAM FOR A WHILE. NOT SURE IF THEY STILL DO. IT WAS VERY SUCCESSFUL NOT EVERYBODY WAS FUNDED IT WAS HELPFUL FOR PEOPLE TOOK TIME OUT PERSONAL CHILDREN WHATEVER THEY WANT IT DO COME BACK IN BRING THEM OUT TO THE SYSTEM BEST PRACTICES OUT THERE WORK WE LOOK AT THE NUMBERS AS WELL GREAT COMMENTS LAST THING TO SAY UNEXPECTED RESULTS RUN PROGRAM CALLED STUDENT EMERGENCY FUND BARE WITH ME A MOMENT LITTLE BITS OF FUNDING HELP A STUDENT IF NOT FOR THE FACT THEY GOT A FLAT TIRE AND DIDN'T GET TO THE FINAL OR GRADUATE PEOPLE TALK ABOUT THE FLAT TIRE FUND. THERE ARE 700 STUDENTS APPLY THROUGHOUT THE WHOLE SYSTEM ONLY HAD MONEY TO FUND 350. PERSISTENCE OF GRADUATION RESULTS IMPROVED FOR AULT OF THEM NOT JUST ONES THAT GOT MONEY BUT THOSE THAT CAME IN AND DID THE WORK AND GOT FUNDED RESULTS AND NOT FUNDING TO RUN LAB FOR FIVE YEARS BUT FUNDING TO GET BACK ON THE FEET TO INVESTIGATE IDEAS AND INVESTIGATE RESULTS TO GET THEM BACK ON THE PATH. GREAT COMMENTS AND THINGS WE HADN'T CONSIDERED YET BUT GREAT STUFF. >> FRANCIS S. COLLINS: [INDISCERNIBLE]. >> IT SEEMS TO ME THERE NEEDS TO INSTITUTIONAL ASSURANCES FOR THE SURVIVOR TO THAT THEY ARE IN A SAFE ENVIRONMENT AND RUNWAY WITH SUPPORT TO THE INSTITUTION TO GET BACK ON THEIR FEET. HAVING DOOR OPEN FROM NIH IS GREAT IDEA AND PARTNERSHIP WITH INSTOO USING TO MAKE SURE THAT PERSON WILL TUMLY GET BACK ON THEIR FEET AND BE A SUCCESSFUL INVESTIGATOR. >> GREAT. >> THAT WAS VERY MUCH BROUGHT UP IN THE WORKING GROUP. WE TALKED A LOT ABOUT SORT OF THE EQUIVALENT OF INSTITUTIONAL SAFE SPACE AND BEST PRACTICES THERE IS MODELS OUT THERE FOR THIS. THEY WOULD BE WORTH THINKING ABOUT AS INCUBATORS TO ENSURE PEOPLE DON'T END UP ON IT AN O- N RAMP AND HIGHWAY GOING IN THE WRONG DIRECTION. THERE WAS NOT ENOUGH TIME TO FLUSH IT OUT IN THE WORKING GROUP DISCUSSIONS BUT APART OF THIS CONVERSATION. >> TO BE CLEAR ARE YOU LIMITING THIS TO REENTRY TO INSTITUTION OR SUPPORTING PEOPLE TO MOVE TO A DIFFERENT LOCATION ENTIRELY. >> YES? SFWL GOOD. >> YEAH. I THINK INDEPENDENTLY. >> FRANCIS S. COLLINS: OKAY. SHOULD WE GO TO RECOMMENDATION 4. >> SURE. ABSOLUTELY. LAST RECOMMENDATION AND WE WILL TALK A LITTLE ABOUT NEXT STEPS. >> FRANCIS S. COLLINS: ROBERTA DID YOU HAVE A COMMENT I DENT SEE. >> [INDISCERNIBLE]. >> FRANCIS S. COLLINS: OKAY. GOOD. >> GREAT. APPROACHES TO ADDRESS INVESTIGATOR INDEPENDENCE FROM THEIR MENTORS. SO ONE OF THE THINGS WE TALKED ABOUT HIERARCHICAL RELATIONSHIP THOSE WITH HIGH DEPENDENCE FACULTY AND TRAINEE INCREASE RISK OF SEXUAL HARASSMENT. ONE THING BROUGHT UP NOTED PARTICULARLY INTERNATIONAL STUDENTS VULNERABLE WITHOUT FUNDING THEY HAVE TO LEAVE THE COUNTRY. THIS WAS THE PRINCIPLE OR JUSTIFICATION FOR THIS RECOMMENDATION. SOME OF THE APPROACHES THAT WE DISCUSSED AS A GROUP IS TO ADDRESS THIS INVESTIGATOR INDEPENDENCE USING CREATIVE MECHANISMS WHICH AWARDED DIRECTLY TO TRAINEES SUPPORT DEPENDENCE HIERARCHICAL RELATIONSHIPS SCIENCE FOUNDATION AURA THE RESEARCH TRAINING PROGRAM AT LEAST I HAD ONE OF THOSE WHEN I WAS AT COLORADO. THAT IS ONE RECOMMENDATION. SECOND IS TO CONSIDER EXISTING MODELS AS ALTERNATIVE APPROACHES TO ACHIEVE CAREER INDEPENDENCE SUCH AS CATS AWARD DOESN'T REQUIRE PRELIMINARY DATA WHEN CHANGING FIELDS OR INNOVATOR AWARDS RECOMMENDATIONS FROM APPLICANT'S ADVISOR. INTERMEDIATE TERM ACTION, [READING FROM TEXT] IN A LONGER TERM ACTION IS DEVELOP AN APPROACH TO ASSESS WHETHER INSTITUTIONS ARE ENSURING A SAFE AND INCLUSIVE ENVIRONMENT. DAIID THAT SPEAKS TO WHAT YOU WERE SAYING IN THE PREVIOUS RECOMMENDATION QUESTION. I WILL OPEN IT UP FOR QUESTIONS. >> FRANCIS S. COLLINS: ONE MORE SLIDE. >> YEAH. RIGHT. SORRY. THE LAST IS SOME THINGS WE CONSIDERED IS THE FACT THAT INTERNATIONAL STUDENTS ARE PARTICULARLY VULNERABLE AND SOMETIMES EFFORTS TO BRING SURVIVORS BACK TO SCIENTIFIC ENTERPRISE ARE DONE IN THE ABSENCE OF AGAIN THIS SPEAKS TO WHAT YOU WERE SAYING DAVID DEMONSTRATE ROBUST EFFORTS ON SIDE OF INSTITUTION AND CONSIDERATION IS SUPPORT SYSTEMS MAY INCLUDE BUT ARE NOT LIMITED TO BIAS TRAINING SAFE SPACES -- EMOTIONAL SUPPORT SERVICES AND LEGAL SERVICES INSTITUTIONS CAN PROVIDE. ON THAT I WILL SAY A LITTLE MORE ABOUT SOMETHING THAT FRANCIS MENTIONED HAVING BEEN IN INDUSTRY AND HAVING RUN A COMPANY THAT HAD A LOT OF HEAVY MACHINERY AND PEOPLE GET INJURIED WE TAKE SAFETY SERIOUS INSTITUTIONS COULD TAKE SEXUAL HARASSMENT INTERPERSONAL VIOLENCE AS A SAFETIU MUCH MORE STRONGLY. WHAT HAPPENS IN INDUSTRY SOMEONE GETS INJURED AND DEPENDING ON EXTEND OF IT YOU MIGHT HAVE STOP WORK. IF YOU THINK SOMETHING IS GOING ON PEOPLE COULD BE PUT AT RISK YOU HAVE YOU ARE EMPOWERED AS INDIVIDUAL TO STOP WORK. DON'T KNOW HOW IT WOULD TRANSLATE TO ACADEMIC ENVIRONMENT OR NIH ENVIRONMENT IS ONE THING AND SECOND THING IF SOMETHING HAPPENS WE DO ROUTE CAUSE ANALYSIS AND TRY TO EMPLOY PREDICTIVE ANALYTICS WE KNOW WHEN THESE THINGS MIGHT HAPPEN AND WE HAVE SOME OF THESE IN ACADEMIC WORLD AND THIRD THING AND ASK PEOPLE WHEN THEY VISIT DO YOU DO SAFETY WALKS YES I LOK FOR CEMENT SIDEWALKS THAT ARE CRACKED AND PEOPLE CAN TRIP DO YOU DO SAFETY WALKS FRIDAY NIGHT FRATERNITIES AND SEE WHAT IS GOING ON THIS IS SAFETY WALKS EVERYBODY BEING PRESENT AND SEEING WHAT IS GOING ON AND REPORTING IT I THINK THERE IS -- LAST REASON I'M SO PASSIONATE ABOUT THE SAFETY IS I FOUND COMPANIES THAT HAVE BEST SAFETY PRACTICES HAVE THE BEST PRODUCT AND BEST FINANCIAL RESULTS I WILL BET THAT WOULD BE THE SAME FOR THE REENVIRONMENT. THOSE ARE THINGS IN CONSIDERATIONS IN CONVERSATION I WANT TO GIVE YOU A FLAVOR FOR WHAT WE ARE TALKING ABOUT THROUGHOUT THE WORKING GROUP. >> COMMENTS ON RECOMMENDATION 4? ROBERTA YOU HAD A COMMENT. >> CHRISTINA THANGS FOR BRINGING UP THE SAFETY ISSUE I THINK WE ARE LOOKING A LOT AT POST REACTION WHERE I THINK THAT -- CARRIE BROUGHT THIS UP. IT IS THAT PEOPLE COME INTO THE LABORATORY AND THEY ASSUME SAFETY AND ASSUME IT IS A SAFE SPACE; RIGHT? IT IS ONLY WHEN IT IS NOT SAFE. >> RIGHT. >> THEY RECOGNIZE THAT THEY MADE AN ASSUMPTION. >> UH-HUH. >> WE DON'T TEACH MENTORS OR GRADUATE STUDENTS OR POST DOCKS HOW DO YOU BUILD A SAFE SPACE FOR A RESEARCH TEAM WHAT DOES THAT MEAN FOR YOU AS A LEADER LEADING A LABORATORY I THOUGHT ONE THING TO BE INTERESTING TO INCLUDE THAT IN OUR TRAINING GRANTS. SO WHAT DOES SUCCESSFUL MENTORSHIP LOOK LIKE? WHAT DOES BUILDING A SAFE HAVEN FOR DISCOVERY LOOK LIKE AND FEEL LIKE? PART OF THAT IS YOU START JUST TALKING ABOUT IT AND THEN WHAT HAPPENS IS YOU RAISE AWARENESS OF ALL PEOPLE ON THE TRAINING GRANT FACULTY AND TRAINEES AS WELL. WHEN YOU BEGIN TO HAVE THAT CONVERSATION, IT BEGINS TO BECOME CLEARER ABOUT WHAT ARE THE OBJECTIVE MEASURES OF A SAFE DISCOVERY SPACE? >> I WOULD ADD ANOTHER THEME EMERGED IN WORKING GROUP BUT WE ARE STILL WORKING THROUGH IS WE OFTEN POINT TO TRAINING GRANTS AS SORT OF THE FRAMEWORK ON WHICH WE SET THESE EXPECTATIONS BUT TRUTHFULLY THESE ARE NOT SUPPORTED BY TRAINING GRANTS BUT BY RESEARCH GRANTS. ONE OF THE CONVERSATIONS WE BEGUN TO HAVE IS WE HAVE A LOT OF EXPECTATIONS RELATED TO SCIENCE ON RESEARCH GRANTS BUT NOT LOTS OF EXPECTATIONS RELATED TO OTHER ACTIVITIES THAT WE FUND SORT OF THOSE RESEARCH GRANTS SUCH AS TRAINING AND WHETHER THERE IS SOMETHING MORE TO BE DONE IN THAT SPACE. >> SO I -- BUT I THINK TRAINING GRANTS ARE AN OPPORTUNITY TO BROADEN THE TRAINING. IF YOU DO IT FOR SIX YOU MIGHT AS WELL DO IT FOR HOWEVER MANY. >> YEAH. >> I THINK THAT WHAT I WAS SKIEDED ABOUT IS -- TALKING ABOUT TEAMS, RIGHT? WE ARE TALKING ABOUT TRYING TO GET FURTHER TOWARDS MANY MENTORS AND MANY STUDENTS. SO THAT WAY YOU LESSEN THE INFLUENCE OF ONE PARTICULAR PERSON WHO MAY BE A BAD ACTOR; RIGHT? SECOND THING IN THE REJSZ WE TALK ABOUT GRANTS TO GO TO TRAINEES WHO ARE DIRECTLY IF THEY CAN MOVE FROM LAB TO LAB AND IF THEY ARE NOT COMFORTABLE FOR WHATEVER REASON IN A LAB THAT WILL CHANGE BEHAVIOR OF INVESTIGATORS THEY DON'T WANT TO LOSE INDIVIDUALS EITHER ALL THOSE IS VERY INSIGHTFUL AND WRAPPED UP INTO THIS RECOMMENDATION. >> MINDFUL OF TIME I PROMISED WE WILL TRY TO GET TO SURVEY PRESENTATION BY 5:20. WE WON'T QUITE GET THERE. IF SPECIFIC PRESSING URGENT COMMENTS IF PEOPLE WOULD LIKE TO MAKE IF I HAVEN'T SDO DISCOURAGED YOU TOO MUCH BY WHAT I SAID 10 CARDS ARE STILL UP BRENDAN AND JUDITH YOURS IS UP ALSO WE WILL BE EFFICIENT. >> THIS POINT YOU MAKE ABOUT INTERNATIONAL STUDENTS THIS PROCESS IT IS AMAZING THIS FRAMEWORK YOU PROPOSED BUT IT IS PREDICATED ON REPORTING IF THERE IS NO REPORTING THIS IS MEANINGLESS. >> RIGHT. >> INTERNATIONAL STUDENTS ARE BEYOND JUST VULNERABLE. THEY WON'T REPORT THEIR VISA THAT IS INDEPENDENT OF ALL OF US IN THIS ROOM AND NIH IS GOVERNED BY A DIFFERENT SET OF RULES IT IS ESPECIALLY PROBLEMATIC IT COULD CONSTITUTE ARGUABLY 50% OF OUR WORKFORCE WE ARE WORRIED ABOUT DEPENDING ON INSTITUTION AND TRAINING ENVIRONMENT. THAT NEEDS -- I DON'T HAVE A SOLUTION. IT THAT REALLY HAS TO BE ADDRESSED OTHERWISE WE ARE BASICALLY IGNORING WHAT COULD BE AN ENORMOUS GROUP OF VULNERABLE INDIVIDUALS. >> GOOD POINT. THANK YOU. >> I WILL BE QUICK VUL IFNERABILITY ISSUE PART OF IT HIERARCHICAL STRUCTURE SINGLE MENTOR AND MEN TEES CAREER IS SO DEPENDENT WHAT WE WILL DO FOR THEM [INDISCERNIBLE] IS RIGHT FOR MANY, MANY YEARS IF I'M ALSO A DIVISION HEAD IT IS WORSE THEY HAVE NO RESOURCE OUTSIDE OF THAT IN OUR DIVISION INSTITUTED MENTORSHIP PROGRAM EVERYBODY IS PAIRED UP WITH A MIN TORE THAT IS A SECOND ONE AND THEY HAVE TO BE IN A DIFFERENT LINE OF REPORTING DIFFERENT UNIT AND DISCIPLINE AND DIF FUSES THAT TRAINEE HAS RESOURCE TO SOMEONE ELSE TO HELP THEIR CAREER TRAINING GRANTS AND CAREER DEVELOPMENT AWARDS REQUIRE SECOND MENTOR BE PROVIDED FOR EACH PERSON IS SIMPLE RECOMMENDATION [INDISCERNIBLE] DEBALTED ABOUT WHAT TO DO AND WHAT MENTORSHIP REQUIREMENTS PI ON R01 NEEDS TO PROVIDE WHEN HE OR SHE DECIDES TO HAVE POST DOC ON ROSTER LANGUAGE ON THAT REPORT MIGHT GUIDE IT. -- >> THAT IS GREAT. >> IT IS IMPORTANT TO NOTE TOO DEPENDENCE ON MENTOR GOES BEYOND AND ANOTHER CULTURAL TOUCH STONE GOES BEYOND TRAINING PERIOD; RIGHT? SCIENTIFIC LINEAGE GOES WITH YOU EVALUATED THROUGH PEER REVIEW AND PEOPLE WON'T ROCK THE BOAT IT WILL HAVE IMMEDIATE -- IT WILL FOLLOW THEM WITHIN THEIR DISCIPLINE OR FIELD SORT OF FOR ALL TIME. THAT FEAR IS A MAJOR DISINCENTIVE TO REPORT. >> COULD WE THEN -- THIS HAS BEEN A GREAT DISCUSSION ON ALL FOUR OF THE RECOMMENDATIONS. YOU ALSO WANTED TO PREVIEW A LITTLE BIT WHERE YOUR WORKING GROUP MAY BE GOING. YOU ARE ONLY HALF DONE WITH YOUR YEAR OF INTENSE ENTERPRISE CAN YOU WALK US THERE YOU THAT QUICKLY. >> CERTAINLY. I WROTE DOWN A FEW THINGS WE WILL LOOK AT LOOKING AT DURATION OF THREE TO SEVEN YEARS AND MULTIPLE MENTORS YOU MENTIONED JOSE AND SOMETHING I WROTE DOWN I CAN'T READ MY OWN WRITING I WILL FIND OUT AND WE WILL LOOK AT SAFETY. >> AUDIENCE: [LAUGHING]. >> FIETTURE TOPICS WE WILL CONTINUE NOT LIKE WE HAVEN'T DONE THESE WE WILL DO A LITTLE MORE WORK ON THAT IS IMPROVING CULTURE AND CLIMATE. RECOMMENDING SURVEYS YOU WILL HEAR ABOUT IN A MINUTE. -- MODIFYING NIH GRANTS POLICY AND BALANCING REQUIREMENTS BY TRAINEES SUPPORTED BY TRAINING GRANTS IN RESEARCH CONTRACTS AND RELATED TO SAFETY AND INCLUSION OF RESEARCHERS NIH GRANT -- DEMONSTRATION SIGNIFICANT GENDER DISPARITIES SUCH AS CENTER GRANTS AND SPI AWARDS THIS IS MY LAST SLIDE OR NEXT TO LAST SLIDE RESEARCH SUPPORTING INTERESTING ONE TOO SUPPORTING RESEARCH ON EVIDENCE-BASED INTERVENTIONS WHAT WILL WORK AND GET INDIVIDUALS BACK IN THE WORKFORCE IF THEY HAVE BEEN SUBSUBJECT TO HARASSMENT AND BULLYING AND WHAT CAN BE INTERVENED TO TAM P THIS DOWN AND GET RID OF IT CONFERENCES ARE GREAT WE WILL LOOK TO DEVELOP GUIDELINES TO PROMOTE SAFETY INCLUSIVITY AT NIH SUPPORTED CONFERENCES AND SOMETHING CARRIE SAID WHICH IS IMPORTANT IS HOW DOES NIH USE ITS INFLUENCE TO ENCOURAGE INSTITUTIONAL ACCOUNTABILITY FOR PRACTICES AND ENCOURAGING INSTITUTIONS JUSTICE FUNDING SURVIVOR COST AND COMMUNICATING IMPORTANCE OF PROCESSES AND SUPPORT OF BEST PRACTICES. NEXT STEPS FINAL REPORT AND RECOMMENDATIONS ARE AHEAD OF THE DECEMBER 2019ACD MEETING TO HAVE THE FINAL REPORT. WE APPRECIATE YOUR FEEDBACK. I MADE A BUNCH OF NOTES. I WILL TURN IT OVER AND SEE IF FRANCIS OR CARRIE HAVE ANY FINAL WORDS THANK YOU DIRECTOR. >> I WANT TO COMMENT WE HAVE SOME OF THE WORKING GROUP IN THE ROOM AND SOME ON THE PHONE BUT I DON'T KNOW ABOUT THAT PATTY BROWN HERE AND JANNINE CLAYTON AND HANNAH VAM AN TIEN AND RICH YAD OETIS SAY A BIG THANK YOU TO THEM AND MAKE A BIG POINT WHEN I SAY I HADN'T THOUGHT OF IT I CAN BET THEY HAD THOUGHT OF IT I OWN MY NONTHOUGHTS BUT THEY THOUGHT OF EVERYTHING. THANKS TO THEM. >> ANY COMMENTS YOU WOULD LIKE TO MAKE WE COULD TAKE A COUPLE MINUTES HERE AND IF MEMBERS OF WORKING GROUP THAT CALLED IN ON THE PHONE THAT HAVE SOMETHING THEY WOULD LIKE TO REALLY SHARE WITH THE GROUP WE CAN TAKE A COUPLE MINUTES TO DO THAT. COMMENTS, ANYONE? OKAY. THEY SEEM PLEASED WITH THE PRESENTATION. >> THIS IS THE FIRST TIME WE HAVE SEEN OUR WORKING GROUP MEMBERS WITH NOTHING TO SAY. >> AUDIENCE: [LAUGHING]. >> YEAH. RIGHT. THEY ARE CONCERNED ABOUT WHAT THEY MIGHT START OFF. WELL, REALLY MANY, MANY THANKS TO THE THREE OF YOU CO-CHAIRS AND ALL MEMBERS OF THE WORKING GROUP. THIS HAS BEEN A VERY, VERY INTENSE EXPERIENCE AND TOUGH CHARGE WE HAVE GIVEN YOU I WANT TO ASSURE YOU RECOMMENDATIONS YOU HAVE PUT FORWARD WE HAVE HEARD ABOUT THEM ALL ALONG AND TRACKING CLOSELY AND SOME WE HAVE BEGUN TO ACT ON NOT WAITING FOR FINAL RECOMMENDATIONS OF THE WORKING GROUP TO BE ABLE TO TAKE ACTION AND BE ABLE TO CONTINUE THAT BETWEEN NOW AND DECEMBER AND LOOK FORWARD TO FINAL RECOMMENDATIONS AT THAT POINT. WE WANT TO DO EVERYTHING THAT WE CAN TO ADDRESS THIS SITUATION COMING BACK TO WHERE WE STARTED OUT WITH THIS MAR PRESENTATION. WE ARE CONCERNED FEDERAL INSTITUTIONS INCLUDING NIH HAVE BEEN PART OF THE PROBLEM AND WE REALLY WANT TO BE PART OF THE SOLUTION. WE ARE SORRY FOR THE WAY IN WHICH WE HAVE NOT RESPONDED EFFECTIVELY IN THE PAST TO THIS SITUATION AND WE ARE DETERMINED TO DO MUCH BETTER. WITH THAT, I WANT INTRODUCE HANNAH VALENTINE AGAIN YOU HEARD FROM ONE TODAY ABOUT THE DIVERSITY WORKING GROUP TO TELL YOU ABOUT THE FRESH RESULTS FROM WORKPLACE CLIMATE AND HARASSMENT SURVEY WE HAVE DONE AT NIH. SOME SAID WHEN WE PROPOSED DOING THIS YOU KNOW FROM NATIONAL ACADEMY STUDY BACK LAST SUMMER THAT SEXUAL HARASSMENT IS RAMPANT IN ACADEMIC AND SCIENTIFIC -- A NUMBER OF WOMEN HAD THIS EXPERIENCE DURING A COURSE OF THEIR CAREER IS UTTER WILL I UNACCEPTABLE AND AS HIGH AS 50% OF MEDICAL STUDENTS. IT WOULD SEEM TO US A REALLY IMPORTANT THING IF WE DO INTERVENTIONS WHICH WE AIM IT DO HAVE A WAY OF ASSESSING INTERVENTIONS THAT ARE HAVING AN EFFECT. IF YOU WANT DATA YOU NEED PROSPECTIVE DATA AND HAVE IT DONE IN A HIGHLY SCIENTIFIC WAY. HANNAH AND HER COLLEAGUES SPENT A GREAT DEAL OF TIME WORKING WITH REAL EXPERTS TO DESIGN AN INSTRUMENT THAT COULD COLLECT DATA WE THINK WILL BE ABOVE REPROACH THERE IS ALWAYS REPROACH LIMITED REPROACH IN TERMS OF HOW QUESTIONS ARE POSED AND ABILITY OF DATA SHE WILL TELL YOU ABOUT THIS THOSE THAT COME FROM OTHER INSTITUTIONS WONDERING ABOUT THIS KIND OF OPPORTUNITY I HOPE YOU LOOK CLOSELY AT THIS PART OF INTENT TO COME UP WITH A SURVEY TO BE IMPLEMENTED IN MUSTLETIM PLACES CHANCE TO DO META ANALYSIS WE WOULD REALLY BENEFIT FROM AT THIS TIME. I WANT TO THANK HANNAH FOR PUTTING COUNTLESS HOURS ALONG WITH OTHER EXPERTS WITH THE DESIGN OF THIS AND SHE WILL NOW TELL US WHAT WE HAVE LEARNED. >> THANK YOU FRANCIS BEFORE I GIVE THE PRELIMINARY RESULTS I WANT TO RECOGNIZE THREE PEOPLE WHO CAME TO THE RESCUE ABOUT A YEAR AGO WHEN WE WERE IN SERIOUS THREAT OF HAVING NOTHING, NO SURVEY AND NOTHING TO SAY AS A CONSEQUENCE OF SOME ENORMOUS STAFF TURNOVERS IN MY OFFICE. THE FIRST PERSON I WOULD LIKE TO RECOGNIZE IS SHARLENE LA POE WHO IS OUR SENIOR ADVISOR AND WORKED DILIGENTLY MANY, MANY HOURS NAVIGATING ALL OF THE MULTIPLE CONTRACTS INVOLVED IN PULLING THIS OFF. THE SECOND IS BILL RILEY AND KATIE MORRIS FROM THE OFFICE OF BEHAVIORAL AND SOCIAL SCIENCES. THEY INJECTED THE KNOW-HOW SO THAT WE COULD PARLAY WITH THE CONTRACTORS AND GET US TO THIS STAGE. THANK YOU SO MUCH. WE WOULD HAVE NOTHING WITHOUT YOU. SO THIS SURVEY, THE [INDISCERNIBLE] WAS CALLED SPECIFICALLY THE WORKPLACE CLIMATE AND HARASSMENT SURVEY. NOTICE THE BROADER TERM AND TITLE OF THE SURVEY. WE WERE INTERESTED NOT ONLY IN SEXUAL HARASSMENT IN ITS MANY FORMS BUT OTHR FORMS OF SEXUAL HARASSMENT. I WILL SHOW YOU WHY WHEN WE PRESENT THE CONCEPTUAL FRAMEWORK. OVERALL, WE HAD A VERY STRONS RESPONSE RATE FROM OUR FEDERAL EMPLOYEES OF 56.2%. TO PUT IT IN CONTEXT WHEN THESE KINDS OF SURVEYS ARE DONE ELSEWHERE YOU ARE LUCKY TO GET TO 30% RESPONSE RATE HOWEVER I WILL SAY A SIMILAR SURVEY WAS PERFORMED AT MY LAST INSTITUTION, STANFORD, ABOUT THE SAME TIME LAST YEAR. THEY GOT A 60% RESPONSE RATE. I'M VERY COMPETITIVE FOR THOSE THAT KNOW ME. WE DIDN'T QUITE MAKE IT. >> AUDIENCE: [LAUGHING]. >> ALL OF THE NIH INTERNAL STAFF INCLUDING EMPLOYEES TRAINEES AND CONTRACTORS WERE INVITED TO PARTICIPATE IN THE SURVEY. IMPORTANTLY, IT WAS ADMINISTERED BY AN OUTSIDE CONTRACTOR BECAUSE WE WANTED TO ENSURE ANONYMITY FOR PEOPLE TAKING THE SURVEY. THE SURVEY FOCUSED ON EXPERIENCES OF SEXUAL HARASSMENT IN THE PAST 12 MONTHS. I EMPHASIZE THAT BECAUSE SOME OF THE RATES YOU WILL SEE ARE SLIGHTLY LOWER THAN HAVE BEEN DESCRIBED ELSEWHERE. I THINK THIS CONTAINMENT OF THE 12-MONTH INTERVAL CONTRIBUTED TO THAT. WE WANTED TO BE SURE WE COULD HAVE THIS AS A BASELINE TO GO ON FOR FURTHER SURVEYS. IN THE SURVEY WAS ADMINISTERED FOR EIGHT MONTHS CONCLUDING MARCH 2 FIFTH, '05. I WILL SAY A WORD ABOUT THE SURVEY DEVELOPMENT AND TESTING AND SHOW YOU WHAT IS REALLY A SIMPLIFIED VERSION OF THE CONCEPTUAL FRAMEWORK OF THIS KIND OF SURVEY THAT HAS BEEN PUT FORWARD BY SEXUAL HARASSMENT SCHOLARS IN THE FIELD FOR A LONG TIME INCLUDING THREE OF THEM WHO SERVED IN AN ADVISORY CAPACITY. WHAT THESE EXPERTS TALK ABOUT AND WAY THAT THEY LOOK AT IT IS A SORT OF INPUT INTO THE PROBLEM AND THE CONSEQUENCES OF THE PROBLEM. OF COURSE, CLEARLY AT THE HEART OF ALL OF THIS IS POINTED OUT AS BY NIH SURVEY IS THESE ORGANIZATIONAL CLIMATE IN WHICH WE LIVE WHERE THIS PHENOMENA HAS ITS ROOTS AND BREATHES. HOWEVER, WE DO KNOW THAT OTHER FORMS OF NONSEXUAL HARASSMENT CAN LEAD TO SEXUAL HARASSMENT INCLUDING INCIVILITY, BULLYING, ET CETERA. WE LOOK AT OUTCOMES SUCH AS WORKPLACE RESPONSES AND JOB WITHDRAWAL AND MENTAL AND PHYSICAL HEALTH OUTCOMES. ALL OF THESE THINGS WERE MEASURED. FOR MOST OF THEM WE DON'T HAVE THE DATA TODAY. I'M SHARING WITH YOU WHAT WE DO HAVE. AS I SAID, CONCEPTS WERE DRAWN FROM PREVIOUSLY DEVELOPED VALIDATED ITEMS. THIS IS ONE THING THAT IS NEW THAT HAS NOT BEEN DONE SURPRISINGLY A LOT IN THE PAST. TWO TYPES OF VALIDATION. THE FIRST IS COGNITIVE TESTING. I HAD NEVER HEARD OF COGNITIVE TESTING UNTIL TWO YEARS AGO AS A CARDIOLOGIST. WHAT IT IS, IS YOU DESIGN THESE QUESTIONS AND YOU NEED TO BE SURE THE RESPONDENT UNDERSTANDS THEM IN THE WAY THAT THEY WERE INTENDED. SO THERE IS A WHOLE PROCESS FOR DOING THAT. WE ACCOMPLISH THAT. THEN ONCE YOU HAVE YOUR SURVEY, THERE IS SLIGHTLY MODIFIED AND LITTLE DIFFERENT FROM BEFORE, YOU NEED TO TEST IT ON A BUNCH OF INDIVIDUALS WHICH WE DID 5,000 OF THEM TO TEST FOR VALIDITY. WHAT I WILL SHOW YOU AND I MUST UNDERSCORE THIS AND IT IS IN BIG WRITING ALL DATA TO BE CONSIDERED INTERIM AND MAY CHANGE IN THE FINAL REPORT. IT LOOKS OR SOUNDS LIKE WHEN YOU ARE BUYING SOMETHING FOR INSURANCE PURPOSES. IT IS THERE AND WE WANT TO KNOW OVERALL PREVALENCE RATES. OVERALL, 21.6% OF RESPONDENTS REPORTED THAT THEY HAD EXPERIENCED SOME TYPE OF HARASSMENT IN THE PAST 12 MONTHS. THAT NUMBER IS RATHER LOW. IT IS AN AGGREGATE OF BOTH MEN AND WOMEN AND WE KNOW WOMEN EXPERIENCE MORE I WILL SHOW YOU A LITTLE BREAKDOWN BY GENDER THAT WE HAVE. LET ME REMIND YOU THAT THE WAY THAT WE MEASURED THEM OR MEASURED HARASSMENT WAS ON SEVERAL DIMENSIONS. FIRSTLY, GENDER HARASSMENT AND UNWANTED SEXUAL ATTENTION AND SEXUAL COERCION. FOR EACH OF THESE RESULTS, WE HAVE AN ANALYSIS OF THE NUMBER AND THE PROPORTION OF RESPONDENTS THAT REPLIED THAT THEY HAD EXPERIENCED THESE RESPONSES. LET'S TAKE A LOOK AT THE CHARACTERISTICS OF THE INDIVIDUALS REPORTING THAT THEY HAD EXPERIENCED ANY -- BY GENDER. WAY THIS IS BROKEN UP IS TO SHOW YOU THE NUMBERS HERE SO YOU GET A SENSE WHAT THE SAMPLE SIZE IS AND WE LOOK AT ANY HARASSMENT AT ALL AND GENDER HARASSMENT AND UNWANTED SEXUAL ATTENTION AND TWO OR MORE EVENTS IN ANY COMBINATION. OF COURSE, THE FIRST THING TO NOTE IS THAT 26.9% OF THE NEARLY 8 -- 9,000 WOMEN RESPONDING HAD EXPERIENCED SOME FORM OF SEXUAL HARASSMENT. THIS IS IN CONTRAST TO ONLY 12% OF MEN. SOME MIGHT ACTUALLY ASK AND SAY THAT THIS 12% IS SURPRISINGLY HIGH. IT IS A REALITY. WE NEED TO DIG DEEP INTO IT. I WANT TO DRAW YOUR ATTENTION TO OTHER GENDER IDENTITIES THAT WHERE NUMBERS AND PERCENTAGE OF EXPERIENCES ARE PARTICULARLY HIGH. IF YOU TAKE A LOOK AT OTHER GENDER IDENTITY DEFINED AS WE HAD PEOPLE CHECK THE BOX TRANSGENDER MEN AND TRANSGENDER WOMEN AND GENDERQUEER, ET CETERA, HERE. YOU SEE 14 OR NEARLY 45% OF THEM RESPONDING TO HER EXPERIENCE OR SOMETHING LIKE THIS. OF COURSE, THERE IS ANOTHER BIG GROUP OF PEOPLE WHO DID NOT DISCLOSE AND WHO SIMILARLY ARE HAVING A HIGH PROPORTION OF THEM EXPERIENCING UNWANTED EXPERIENCES. THAT IS WHAT WE HAVE FOR CHARACTERISTICS BASED ON GENDER. NOW, THE NATIONAL ACADEMIES REPORT AND MANY OTHERS HAVE TAUGHT US THAT SEXUAL ORIENTATION, SEX AND GENDER MINORITIES, EXPERIENCE SEXUAL HARASSMENT TO A GREATER DEGREE. IF WE LOOK AT THE NIH SURVEY AND WHAT WE SEE THERE AGAIN IS THAT? CONTRAST TO PEOPLE WHO CHECK THE BOX AS HETEROSEXUAL GAY AND LESBIAN PEOPLE HAD A HIGHER [INDISCERNIBLE] OF COURSE IF YOU LOOK AT ALL OF THE OTHER PARAMETERS IT IS ALWAYS HIGHER FOR THIS GROUP. NOW, LOOK AT BISEXUAL. EVEN HIGHER. IT IS AT 41%. OTHER, DEFINED HERE, AT THE BOTTOM, AS ASEXUAL QUESTIONING AND HIGH THERE AND, AGAIN, THIS UNDISCLOSED GROUP OF NEARLY 1,000 PEOPLE WITH HIGHER RATES COMPARED TO THE HETEROSEXUAL GROUPS. THESE ARE GROUPS THAT ARE RELATIVELY HIGH RISK. WE ALSO KNOW FROM LITERATURE THAT THERE IS A RELATIONSHIP TO AGE, PARTICULARLY AGE OF THE PERSON EXPERIENCING UNWANTED EXPERIENCES. OF COURSE, THE DATA HERE SUPPORTS THAT YOU SEE HERE IN THE AGE GROUP OF 18 TO 24 AND 25 TO 34 THE RATES ARE CONSIDERABLY HIGHER THAN WHEN WE GET TO OLDER AGES A PARTICULARLY VULERABLE GROUP WE KNOW ARE TRAINEES THERE IS DATA ABOUT THE PROPORTION OF TRAINEES WHO WE ARE EXPERIENCING THIS, THESE BEHAVIORS COMPARED TO PEOPLE WHO ARE NOT TRAINEES AND OF COURSE THESE TRAINEES THAT WAS NEARLY 3,000 OF THEM IN THE SAMPLE. WHAT WE SEE IS THAT 31% OF THEM HAD EXPERIENCED SOME FORM OF SEXUAL HARASSMENT. NOW, THERE ARE OTHER CATEGORIES OF PEOPLE WHO HAD SIGNIFICANT BUT SMALLER ASSOCIATIONS BETWEEN ANY HARASSMENT EXPERIENCE IN THE LAST 12 MONTHS. FOR EXAMPLE, PEOPLE WHO CHECK THE BOX TO BE IN THE INTRAMURAL PROGRAM AS TO NOT INTRAMURAL, SLIGHTLY HIGHER. YEARS AT NIH AND MORE RECENT PEOPLE AND HIGHER PROPORTION THAN OTHERS AND EDUCATIONAL PEOPLE WHO IDENTIFIED THEMSELVES AS WHITE WHO HAD SLIGHTLY HIGHER PREVALENCE RATE COMPARED TO HERE FINALLY PEOPLE THAT ARE IDENTIFIED AS HISPANIC HAVING A HIGHER RATE AS WELL. NOW, CONSISTENT WITH BEST PRACTICES IN SURVEY DESIGN YOU ASK THE RESPONSES INDICATED ANY EXPERIENCE SEXUAL HARASSMENT IN THE PAST 12 MONTHS TO ANSWER SOME FOLLOW-UP QUESTIONS ABOUT THE UNWANTED EXPERIENCE THAT HAD THE GREATEST EFFECT UPON THEM. SO THE NEXT SET OF DATA IS THAT. WE WANTED TO FIND OUT ABOUT THE CONTEXT FOR HARASSMENT. WHERE DID IT HAPPEN. WHERE IS THE LOCATION. INTERESTING WILL I MAJORITY SPONED IT OCCURRED IN A BUILDING IN NIH AND INTERESTING WILL I DIDN'T OCCUR IN A CONFERENCE AND PERHAPS THIS IS A REFLECTION OF SAMPLE SIZE AND ALL OF THE PEOPLE RESPONDING HERE. IT DID NOT OCCUR AT A SOCIAL EVENT ATTENDED BY MULTIPLE NIH PERSONNEL. WE WANTED TO KNOW ABOUT THE PERPETRATOR MY EXTERNAL ADVISORS IN SEXUAL HARASSMENT RESEARCH THAT REFER TO THIS AS THE WHO DO IT AND WE ASK THE APPROPRIATE QUESTIONS. WHAT YOU ARE SEEING IS A MAJORITY 78% WAS NIH EMPLOYEE AND MAN AND SOMEONE WHO WORKS THE SAME UNIT AS THE RESPONDENT AND SOMEONE WHO SUPERVISED AND MANAGED THE RESPONDENTS WORK 35% AND WHOPPING 25%, A PERSON WHO COULD INFLUENCE WORK OPPORTUNITIES. IT IS VERY IMPORTANT DATA POINT. THEN WE WANTED TO NO HE WHAT DO PEOPLE DO IN RESPONSE TO HAVING THIS EXPERIENCE. SPECIFICALLY, WHO DO THEY TALK TO? WHAT YOU SEE HERE IS THAT 54% DID NOT REPORT OR TALK TO ANYTHING. 38% TALKED TO A CO-WORKER AND ONLY 15% TALKED TO A SUPERVISOR OR POINT OF CONTACT OR MANAGER. EVEN MORE IMPORTANTLY, THESE OFFICIAL REPORTING BODIES THAT ARE A VERY MINISCULE AMOUNT OF TALKING TO SOMEONE IN CIVIL AND SOMEONE FROM THE [INDISCERNIBLE] OFFICE, ET CETERA. A VERY IMPORTANT DATA POINT. IN ADDITION OF THOSE WHO DID NOT REPORT WHEN ASKED WHY THE VAST MAJORITY OF THEM REPORTED THEY DID NOT THINK THAT THE EXPERIENCE WAS SERIOUS ENOUGH TO REPORT NOW, WE WANTED TO KNOW ALSO WHAT THE PERCEIVED NIH RESPONSE TO THE HARASSMENT WAS. IN OTHER WORDS, RESPONDENT HOW DOES THE RESPONDENT FEEL NIH MIGHT RESPOND SHOULD NIH KNOW ABOUT THIS HAPPENING IN FACT 3/4 OF THE RESPONDENTS NIH IS DOING EXCELLENT JOB ENCOURAGING PEOPLE TO RESPOND IN THE PAST FEW MONTHS. CONVERSELY 3.4% BELIEVED THIS WAS EXTREMELY LIKELY THEY WOULD BE HARASSED IN THE NEXT 12 MONTHS. THIS FINDING CAUSED A LOT OF INTERNAL DISCUSSIONS ABOUT IT. I WILL LEAVE BILL RILELY TO COMMENT ON THAT LATER ON. UNFORTUNATELY WE DON'T HAVE LOTS OF CLIMATE DATA TO REPORT TODAY BUT WE HAVE SOME GLIMMERS INTO IT. ONE OF THE ORGANIZATIONAL CLIMATE PARAMETERS WE WANTED TO LOOK AT IS SUPERVISOR BEHAVIOR. RESPONDENTS WERE ASKED ABOUT THE LIKELIHOOD OF NIH ACTION IN RESPONSE TO SOME INAPPROPRIATE BEHAVIORS BY A SUPERVISOR, FOR EXAMPLE A SUPERVISOR EXHIBITING GENDER BIAS BY SAYING THAT WOMEN ARE TAKING JOBS AWAY FROM MEN, THAT SORT OF COMMENT. ANOTHER ONE MIGHT THAT WAS ASKED IS SUPERVISOR ENGAGING IN EXPLICIT SEXUAL TALK. AND ANOTHER EXAMPLE IS SEXUAL COERCION, FOR EXAMPLE, A SUPERVISOR SAYING THE WAY TO GET AHEAD PROFESSIONALLY IS TO DATE YOUR SUPERVISOR. INTERESTINGLY, THE RESPONDENTS WHO HAD BEEN HARASSED WERE MORE LIKELY TO SAY THAT NIH WOULD NOT TAKE ACTION AGAINST THE SUPERVISOR WITH THESE BEHAVIORS COMPARED TO RESPONDENTS WHO HAD NOT BEEN HARASSED. I SAY IT THAT WAY TO UNDERSCORE WE WILL DIG A LOT MORE INTO THIS TO FIGURE OUT WHAT THE ASSOCIATIONS ARE. BUT I THINK ONE ELEMENT OF MAYBE GOOD NEWS IS THAT MAJORITY OF RESPONDENTS WHETHER OR NOT HARASSED ANSWERED THAT NIH WAS LIKELY TO TAKE ACTION. EVEN THOSE SMALL PROPORTIONEDS THAT ARE RESPONDING IN THE WAYS IS NOT TOLERABLE FOR US. AS YOU KNOW WE ARE MOVING INTO AN ERA OF ZERO TOLERANCE. SO, AGAIN, DISCLOSURE OVER DATA TO BE CONSIDERED INTERIM AND MAY CHANGE IN THE FINAL REPORT WHICH WILL BE COMING AT THE END OF THE YEAR OR EARLY NEXT YEAR. IT WILL BE POSTED WIDELY FOR EVERYBODY TO SEE. NIH WILL CREATE INTERACTIVE TOOLS TO LOOK AT THE DATA AND NIH TO COMMUNICATE TO THE COMMUNITY AND TO ALL OF YOU ON ACD ABOUT THE RESULTS AND THE FINAL. WE CAN'T WAIT UNTIL OCTOBER. WE HAVE A VERY ACTIVE ANTIHARASSMENT-STEERING COMMITTEE THAT IS CHOMPING AT THE BITS TO GET GOING IN A DATA DRIVEN WAY TO ACT ON THESE FINDINGS WE HEAR THE KINDS OF THINGS WE ARE DISCUSSING. FIRSTLY A NEED TO INCREASE IC LEADERSHIP ENGAGING STAFF. FOR EXAMPLE, REQUIRING PLANS SPECIFIC TO THE ORGANIZATION AND TO ADDRESS THE CLIMATE AND HARASSMENT AND SECONDLY ENHANCING THE TRAINING AND NIH XHOOUT COMMUNITIES. FOR EXAMPLE, BYSTANDER TRAINING IS A VERY IMPORTANT ELEMENT THAT WE ARE LOOKING IN TO GETTING HELP TO DOING THAT AND CONTINUING CIVIL TRAINING THAT IS THERE AND MANDATORY UPDATED PREVENTION OF SEXUAL HARASSMENT OTHERWISE KNOWN AS POSH TRAINING AND IN ADDITION ONE LEFT OFF HERE IS SAFE ZONE TRAINING. ANOTHER APPROACH DISCUSSING IS TO SUPPORT STAFF AND SUPPORTING HARASSMENT SO DISCIPLINARY ACTION FOR CONFIRMED PERPETRATORS IS MORE CERTAIN. THIS CAME UP IN THE LAST PRESENTATION FOR PEOPLE TO KNOW WHAT IS ACTUALLY HAPPENING. TO CONDUCT ONGOING ASSESSMENTS TO ENSURE THAT PENALTIES ARE ACTUALLY BEING APPLIED AND THEY ARE BEING APPLIED CONSISTENTLY AND FINALLY TO MAKE NIH COMMUNITY AWARE OF DISCIPLINARY ACTIONS IN SOME REFORM OF COURSE AS A DETERRENT FOR SEXUAL HARASSMENT AND OF COURSE IN ACCORDANCE WITH OGC REMINDER THIS HAS TO BE DONE WITH ALL OF COMPLIANCE TO ALL OF THE PRIVACY REGULATIONS. THAT IS THE REPORT. I'M HAPPY TO TAKE QUESTIONS AND I WILL LEAVE THE SLIDE UP TO GUIDE DISCUSSION. THANK YOU. >> THANK YOU, HANNAH. THANK YOU. THIS IS NOW OPEN FOR DISCUSSIONS AND QUESTIONS. DAVID GLAZER. >> THANK YOU. IT IS GREAT TO SEE RIG OR AND DATA NOT SURE THIS IS YOUR FIRST SURVEY. >> AUDIENCE: [LAUGHING]. >> SO I FOUND MYSELF HAVING A BUNCH OF OH, DATA DRILL-DOWN QUESTIONS I WON'T ASK NOW. >> GOOD. >> AUDIENCE: [LAUGHING]. >> BUT, IT MADE ME THINK ABOUT THE PROCESS QUESTION OF WHAT ARE YOUR THOUGHTS TO DATE HOW YOU WILL USE THIS INFORMATION TO FUEL INTERNAL DISCUSSION? THERE IS A WHOLE -- YOU KNOW, I WILL GIVE A FEW SAMPLES OF THINGS I DON'T WANT TO DRILL INTO YOU SAID IN THE BEGINNING 26% IS SURPRISINGLY LOW. I DON'T THINK IT IS A UNIVERSALLY SHARED REACTION TO THE NUMBER I FOUND IT SURPRISINGLY HIGH AND HADN'T THOUGHT ABOUT IT MUCH. >> YOU HADN'T HEARD THE REPORT. >> THAT IS EXAMPLE THERE WOULD BE A VERY FRUIT INTERNAL DISCUSSION; RIGHT? ANOTHER EXAMPLE IS 42% OF THE REPORTS FIF 54% DIDN'T THINK IT WAS WORTH REPORTING I WILL MENTION IT ON THE SURVEY BECAUSE YOU ASKED ME BUT IT IS NOT WORTH REPORTING INTERESTING CONVERSATION ABOUT DOES THAT MEAN WE WERE ELICITING AND OVERREPORTING AND PEOPLE HAVE EXACTLY THE WRONG MODEL WHAT IS WORTH REPORTING OR BOTH? I THINK THE CONVERSATION ABOUT IT COULD BE REALLY FRUITFUL, BUT IT IS -- I THINK IT IS NOT OBVIOUS TO ME. I HAVE THOUGHTS HOW TO GET THAT RIGHT CONVERSATION TO HAPPEN AND AT WHAT LEVEL OF WORK GROUP AND WHAT LEVEL OF YOU KNOW IN THE ORGANIZATION IS THIS TOWN HALLS AND IS THIS EVERY MANAGER SITS DOWN WITH THEIR TEAM AND IS THAT -- RIGHT? I WILL TURN IT INTO A QUESTION. THE SPEECH IN THE MIDDLE WHAT ARE YOUR THOUGHTS ON WHAT YOU WILL DO WITH THIS DATA INTERNALLY NOT JUST IN TERMS OF NEW POLICIES BUT IN TERMS OF THE ORGANIZATION AND LOOKING AT ITSELF? >> GREAT POINT. FROM POINT OF VIEW OF OPENING UP THE DISCUSSION CRITICALLY IMPORTANT, WHAT I DIDN'T TELL YOU IS THAT WE WILL GET IC SPECIFIC DATA THAT WILL BE SHARED WITH ICS. >> GREAT. >> THAT WOULD HAVE TO BE LEVEL OF CONVERTSATION THAT BEGINS AT A VERY MINIMUM. OF COURSE, SOME OF THE LARGER ICS HAVE LARGE DIVISIONS AND CAN DO THAT AS WELL. THAT CONVERSATION BUT QUITE HONESTLY I THINK THE COMMUNITY IS TIRED OF TALK AND THEY WANT ACTION. I WILL BE WORKING IF IN THE STEERING COMMITTEE TO COME UP WITH TANGIBLE ACTION ITEMS THAT ARE PARTICULARLY FOCUSED AT CHANGING THE CULTURE. >> THANK YOU. >> OTHER COMMENTS? >> BILL RILEY. >> BILL, WOULD YOU LIKE TO CONTRIBUTE A LITTLE PERSPECTIVE HERE SINCE YOU HAVE BEEN BLAMED FOR BEING AN EXPERT. >> YES. I WILL TAKE SOME OF THE BLAME. HANNAH DID A BETTER JOB OF SURVEY DESIGN AND I WILL DO HEART TRANSPLANT RESEARCH. MUCH APPRECIATED. >> THAT IS NOT SAYING MUCH. >> I WILL SAY TO YOUR POINT DAVID WHICH IS IMPORTANT IF YOU TAKE A 10ZOITE EM SURVEY POSSIBLE COMBINATIONS OF ITEMS TO LOOK INTERACTION OF 1 TO THE OTHER WE HAVE TO BE THOUGHTFUL ANNA SAID THINKING OF QUESTIONS WE HAVE THAT HAVE POTENTIAL ACTIONS IN THEM WE GET TAUGHT ABOUT WHAT IS THIS AND WHAT IS THAT AND THIS OTHER THING AND THINK OF WHAT KIND OF FINDINGS WILL WE PULL FROM THIS DATA TO HAVE ACTIONABLE OUTPUT FROM AND DIDN'T THINK OF IT MOVING FORWARD AND HANNAH CUED ME UP IT CAME UP IN SDUTHSS WE HAD HOW IS IT 20 PS OF PEOPLE HAVE BEEN HARASSED IN LAST 12 MONTHS AND 3% THINK THEY WILL IN THE NEXT 12 MONTHS. INTERIM DATA WE DON'T KNOW WHY IT IS ATTRIBUTIONAL BIAS OR RESOURCE WHEN NEGATIVE EXPERIENCES HAPPEN WE TEND TO ATTRIBUTE THOSE CONTEXT TIME DEPENDENT LIMITED PHENOMENA. DI GAIN WEIGHT THIS YEAR YES DID I GAIN WEIGHT NEXTARY NO THIS BIAS FOOLING OURSELVES BUT PART OF WHY WE THINK THAT DIFFERENCE IS ACTUALLY THERE. >> THANK YOU. THAT IS GREAT. >> JOSE AND BRANDON. >> I WANT TO GO BACK TO THE NUMBERS AND PRESENTATION EARLIER INTRAMURAL ACTION. BY MY CALCULATIONS, THE PEOPLE WHO EXPERIENCED HARASSMENT DIDN'T THINK IT WAS SERIOUS ENOUGH -- NO. THEN THOUGHT IT WAS SERIOUS AND DECIDED NOT TO REPORT. THAT IS 389 PEOPLE. I LIKE IT IN ABSOLUTE NUMBERS 389 LIVES AND INDIVIDUALS OF PEOPLE WORKING HERE SERIOUS IN THEIR ESTIMATION AND DECIDED NOT TO REPORT I GO BACK TO NUMBERS WHERE NUMBER OF ALLEGATIONS HAVE SUBSTANTIAL INCREASE BETWEEN 2018 AND 201935 REVIEWED IN [INDISCERNIBLE] AND IN ONLY FIRST FIVE MONTHS. YET MAYBE THEY ARE STILL IN REVIEW DISCIPLINARY ACTION HAS BEEN TAKEN IN 7 AND 171. I WOULD LIKE TO KNOW HOW MANY OF 171 HAVE COMPLETED AND WHAT IS THE PERCENTAGE OF DISCIPLINARY ACTION I IMAGINE IF 389 PEOPLE ARE NOT THINKING IT IS WORTH REPORTING MAYBE NOT ENOUGH ACTION IS TAKEN. >> YES. >> JUST TO PREFACE A RESPONSE TO THAT, I SHOWED YOU DATA THAT PEOPLE DON'T -- A LOT DON'T THINK ANY ACTION WILL BE TAKEN ACTUALLY AGAINST THESE. >> THAT IS WHY WE NEED TO SHOW OUT OF 171 AT LEAST WHAT IS THE DENOMINATOR OF COMPLETED ALLEGATIONS AND DO WE HAVE INCREASED NUMBER OF DISCIPLINARY ACTION TO SHOW PEOPLE THAT WE ACTUALLY TOOK THIS SERIOUSLY? >> BETH, DO YOU HAVE THOSE NUMBERS? >> HI EVERYONE, IT IS A BIT OF A SURPRISE I'M BETH CHAND LETTER AND DEPUTY DIRECTOR OF OFFICE OF RESEARCH HERE AT NIH CIVIL PROGRAM YOU HEARD ABOUT AT THIS MEETING AND PREVIOUS MEETING IS HOUSED IN NIH OFFICE OF HUMAN RESOURCES AND CIVIL PROGRAM IS A PROGRAM THAT HAS BEEN ARN FOR MANY YEARS BUT WAS RELAUNCHED LAST YEAR IN EFFORT TO ADDRESS THE TOPIC WE ARE TALKING ABOUT RIGHT NOW. THIS INCLUDED NEW POLICIES AND THINGS LAKE THAT 38 NUMBER THAT YOU HEARD EARLIER WAS THE NUMBER AFTER THE RELAUNCH NOT THE FULL 2018. JUST TO CLARIFY THAT. THAT HAPPENED IN OCTOBER -- I BELIEVE OCTOBER 2018 WHICH WAS A SMALLER POTION OF THE YEAR NOT A FULL YEAR. I PULLED UP A COUPLE NUMBERS NOT EXACTLY UP TO DATE BUT I WOULD SAY MAJORITY OF THE INQUIRIES ARE STILL OPEN OF THE 171 AND THESE THINGS TAKE TIME THEY MAY BE OPEN BECAUSE INVESTIGATION IS STILL ONGOING OR BECAUSE THE INVESTIGATION MAY HAVE BEEN CLOSED BUT FINAL ACTION HASN'T BEEN TAKEN OR FINALIZED YET. I WOULD SAY THAT THERE ARE CURRENTLY ABOUT 100 INVESTIGATIONS STILL OPEN IN ONE PHASE OR ANOTHER OF THE 171 THAT IS A LITTLE OF A GUESSTIMATE THAT IS 10% 1 OF 70 IS CLOSED DISCIPLINARY ACTION IS TAKEN IN 7 OKAY. >> YES. >> MESSAGE CONVEYS 10% DISCIPLINARY ACTION FOR THING INVESTIGATED BECAUSE THRESHOLD NOW FOR REPORTING IS HIGHER BUT PREVIOUS TIME 10 ACTIONS FROM 35 ALLEGATIONS IS 30% RATE RATE WENT DOWN 30 TO 10% 389 PEOPLE WHO EXPERIENCE SERIOUS HARASSMENT AND IN THEIR ESTIMATION AND DID NOT REPORT WILL SAY LOOK WHAT HAPPENS WE REPORT AND THERE IS 10% ACTION. THAT IS A VERY -- THAT IS SOMETHING WE HAVE TO THINK SERIOUSLY ABOUT. >> I JUST HAVE TO INTERJECT HERE. DESPITE THE FACT I HAVE THIS PASSION FOR DATA AND ANALYSIS, I HAVE IT SAY WE SHOULD NOT BE ATTEMPTING REALLY TO LINK TWO DATAS WE GIVE ABSOLUTE PROMISE TO OUR COMMUNITY THAT WOULDN'T BE IDENTIFIED AND NO BACKTRACKING OR TREMENDOUS SUSPICIOUS THAT WITH DESTROYING IDENTIFIERS SMART STATISTICIAN COULD BACK CALCULATE AND FIGURE OUT WHO IS [INDISCERNIBLE]. I DON'T WANT THE MESSAGE TO GET OUT OF THIS ROOM TO SAY WE ARE SOMEHOW KIND OF KNOW OR MIGHT KNOW WHO THE PEOPLE OVER THERE WERE THE PEOPLE IN THE SURVEY. I KNOW THAT IS NOT WHAT YOU ARE SAYING BUT I HAD TO UNDERSCORE THAT. THAT IS THE ASSURANCE WE GAVE THE COMMUNITY IN TAKING THE SURVEY. >> WORRIED 389 PEMENT I FEEL TERRIBLE FOR AND THEY MAY LOOK BACK AT THIS AN SAY SEE THIS IS THE REASON I DIDN'T REPORT. >> I THINK THAT IS VERY GOOD ANALYSIS BUT I HAD TO SAY THAT. >> BRAND DEN. >> I HAD TO ASK ABOUT THE CONTRIBUTION BIAS AND TWO NUMBERS AND NOTICED THE DISPARITY STRIKING THAT ASKS A QUESTION OF WHAT IS THE REAL EFFECT SIZE OF THE BIOLOGICAL EFFECT SO-TO-SPEAK, I GUESS. ONE WAY PERHAPS IS LONGITUDINAL AND ASSUME YOU WILL REPEAT THIS AND WHETHER LONGITUDINAL DATA WILL BE ABLE TO SHED LIGHT ON THE ELEMENT. >> GOOD POINT. ONE CRITICAL POINT ABOUT THE SURVEY FOR US HANNAH SAID BASELINE MESH YAURMENT FOR US TO ASSESS PROGRESS OVER TIME AND ALLOWS US TO LOOK AT TRENDS OVER TIME AND THOSE ISSUES WE REALLY DON'T THAT WAS ONE CONJECTURE WHY SOME OF THAT MIGHT HAVE OCCURRED BUT OTHER THINGS TO LOOK AT MORE CLOSELY. >> I WOULD SAY ON THAT EXTERNAL EXPERTS URGED US WHEN WE TALKED TO THEM ABOUT THE RESULTS YESTERDAY NOT TO ATTEMPT TO COMPARE IT TO ANY OTHER DATA SETS BECAUSE THE DESIGN IS SPECIFIC AND A VERSION WHAT EVERYBODY DID IN THE PAST AND THEY REALLY UNDERSCORED THAT FOR US. >> LINDA AND THEN BRENDAN. >> IT IS FASCINATING TO ME IN AN ENVIRONMENT YOU HAVE AN OM BUDS MAN POMAN PERSON YOU SEE 3% EVERY TIME I HAVE A STICKY WICKED THING INCLUDING HARASSMENT OR WHATEVER I HAVE GONE TO HER OR HIM AND THINGS IT PERCOLATES IN SYSTEM IN REASONABLE WAY LISTENING TO THINGS I SENT MANY PEOPLE TO OUR OM BUDS PERSON ENVIRONMENT WHERE THAT PERSON IS KNOWN TO BE A COMPLETELY CONFIDENTIAL THING IT SEEMS STUFF DOES PERK PERCOLATE THROUGH AND GET DEALT WITH IN A WAY. I HAVE BEEN TO INSTITUTIONS THAT DON'T HAVE ONE. WHAT ARE YOUR THOUGHTS IT IS NOT A GREAT CULTURE DEALING WITH STUFF. CAN YOU COMMENT ON THE ROLE OF THE OM BUDS MAN PERSON IN ENVIRONMENT YOU ARE IN STUFF THAT GOES THERE IS SERIOUS AND GETS WORKED THROUGH IN MY UNIVERSE I'M CURIOUS HOW IT IS IN THE ONE THAT YOU ARE IN. >> I DON'T THINK THE SURVEY DATA CAN ANSWER THAT QUESTION, LINDA. I WILL SAY THIS. WE HAVE A FANTASTIC OM BUDS OFFICE AND WHAT THAT FEELS A HUGE AMOUNT OF ISSUES BEFORE THEY EVEN SEE THE LIGHT OF DAY OF OTHER GROUPS LIKE [INDISCERNIBLE] AND SO FORTH. BUT IN A WAY, THIS IS SUCH A DIFFICULT TOPIC THAT I'M NOT SURPRISED THAT PEOPLE ARE NOT GOING TO THE OM BUDS OFFICE OR RARELY TO FIRST BOARD OF CALL TO DISCUSS IT. >> I WONDER TO KIND OF BE THE COUNTER TO JOSE'S INSIGHTS MAYBE SOME OF THE PEOPLE THAT TOLD A CO-WORKER BUT DIDN'T REPORT AREN'T -- THEY FELT SOMEHOW MAYBE THEY GOT SOME KIND OF INFORMAL INTERACTION OUT OF IT, MAYBE. I DON'T KNOW. THERE IS TWO DIFFERENT OUTCOMES MAYBE BECAUSE OM BUDS PERSON P THERE ARE MECHANISMS SOME THINGS ARE DIFFUSED BEFORE IT BEFORE YOU FEEL YOU REALLY NEED TO REPORT IT YOU CAN INFORMALLY GET ACTION SOME OTHER WAY. I'M ASKING. IN MY ENVIRONMENT, THAT HAPPENS ALL THE TIME. IT DOESN'T ALWAYS GET TO THE OM BUDS PERSON BEFORE SOMEBODY WHO IS NOT -- YOU KNOW, YOU TELL A CO-WORKER AND THEY HELP YOU TAKE IT. I DON'T KNOW. I'M JUST CURIOUS. >> [INDISCERNIBLE] AND NOT TELL ANYONE OR DIDN'T REPORT TO THE OM BUDS PERSON. >> WE BROKE IT DOWN INTO VARIOUS CATEGORIES OF REPORTING. REPORT WE ARE TALKING REPORTING IS DIFFERENT FROM WHO DID YOU TALK TO. >> RIGHT. THESE PEOPLE DIDN'T TELL ANYONE, NOT A CO-WORKER OR OM BUDS PERSON OR SUPERVISOR OR CIVIL, YOU KNOW, NOT ANYONE. OF THOSE 389 THOUGHT IT WAS SERIOUS AND I'M TRYING TO BOUNCE IT OFF SOMEONE SERIOUS ENOUGH 389 PEOPLE BUT IT WAS SERIOUS THOSE 399 INDIVIDUAL HUMAN BEINGS NEED TO RECEIVE ASSURANCE THAT REPORTING WILL BE HELPFUL TO THEM. >> YEAH. >> I WAS QUITE SURE WITH THIS EXTREMELY NUMERRATE GROUP WE PUT DATA IN FRONT OF YOU AND WE WILL HAVE ALL KINDS OF INTERESTING DISCUSSIONS ABOUT WHAT CONCLUSIONS WILL BE DRAWN WE WILL CONTINUE TO DIG AS DEEP AS WE CAN INTO SURVEY RESULTS THIS IS INTERIM -- WE WILL HAVE MORE TIME NOW TO FIGURE OUT WHAT CAN BE LEARNED FROM IT YOU RAISED A NUMBER OF CRITICAL QUESTIONS TO PURSUE AND I'M HOPEFUL THIS IS A WELL-DESIGNED SURVEY AND SOMETHING OTHER INSTITUTIONS WOULD BE INTERESTED IN ALSO IN IMPLEMENTING AND CARRY THAT WORD ALONG WE ARE WILLING TO SHARE WE HAVE NO PRIDE OF OWNERSHIP. WE HOPE FOR THE OPPORTUNITIES TO DO CROSS INSTITUTIONAL COMPARISONS THAT AUGHT TO BE GOOD FOR ALL OF US. IT IS 601. NOT BAD YOU ALL FOR AN AGENDA LIKE THE ONE WE HAD TOED TO END UP EXACTLY ONE MINUTE LATE IS NOTHING SHORT OF HISTORIC AND AMAZING. >> AUDIENCE: [LAUGHING]. >> FOR THAT, YOU NOW GET A WHOLE 15 MINUTES OF A BREAK AND THEN THERE WILL BE A SHUTTLE BUS THAT APPEARS IN THE FRONT OF BUILDING 1 WHICH IS WHERE WE ARE TO CARRY YOU OFF TO LARRY AND ROBIN TABAK'S HOUSE YOU NOTICED THAT LARRY LEFT SLIGHTLY EARLY TO FIRE UP THE GRILL AND GET THINGS GOING WE WILL SEE YOU MEMBERS OF ACD AND IF YOU NIH STAFF THERE IN A LITTLE BIT AND HOPEFULLY WE WILL HAVE CHANCE TO DO RELAXING AFTER AN IF UL DAY YOU MAY LEAVE YOUR BOOKS IN THE ROOM THAT IS OKAY MAY NOT NECESSARILY LEAVE COMPUTERS BUT BOOKS AND SEE YOU AT 9 O'CLOCK TOMORROW MORNING.