I'M NEIL RAMBO, CHAIR OF THE BOARD OF REGENTS AND I CALL THE MEETING TO ORDER. [ GAVEL POUNDING ] >> LIKE TO BEGIN WITH A COUPLE OF ANNOUNCEMENTS. COUPLE OF HOUSEKEEPING DETAILS TO START WITH. MEMBERS OF THE MEDIA OPERATIONS TEAM WILL BE MONITORING THE CHAT WINDOW THROUGHOUT THE DAY AND ARE AVAILABLE TO PROVIDE ANY ASSISTANCE NEEDED. YOU CAN ALSO REACH THEM BY USING THE RAISED HAND FEATURE IN ZOOM OR VIA E-MAIL AT NOM MEDIA OPERATIONS TEAM AT NL M.NIH.GOV AND MAY I REMIND EVERYONE SITTING IN AND JOINING US TODAY, AS WE PROCEED TO PLEASE BE MINDFUL OF YOUR CAMERA AND MICROPHONE AND BE SURE TO MUTE YOURSELF WHEN NOT PRESENTING. MEMBERS OF OUR MEDIA OPERATIONS TEAM WILL BE ASSISTING BY SWITCHING OFF CAMERAS AND LIGHTS AS NEEDED TO MAINTAIN GOOD AUDIO IN THE EVENT OF BANDWIDTH RELATED DROPOUTS AND FREE OF DISTRACTING UNNECESSARY AUDIO. AGAIN LIKE TO WELCOME YOU TO THIS -- I THINK IT IS THE 188TH MEETING OF THE NL M BOARD OF REGENTS, THIS ONE VIRTUAL AND I AM JOINING YOU FROM MY BASEMENT IN SEATTLE LOOKING OUT AT A GLORIOUS SUNRISE THIS MORNING AND I HOPE YOU ARE ALL, WHEREVER YOU ARE, ACROSS VARIOUS TIME ZONES, ENJOYING A GOOD MORNING AS WELL. I WOULD LIKE TO BEGIN THIS PORTION OF THE MEETING BY WELCOMING OUR NEW MEMBERS WHO ARE ATTENDING THIS PARTICULAR MEETING AS CONSULTANTS AND WILL BE JOINING US AS BONAFIDE MEMBERS FOLLOWING THIS MEETING. FIRST WE HAVE Dr. JAMES CIMINO AND Dr. OGUNYEMI. JAMES CIMINO IS A BOARD CERTIFIED INTERNIST AND CLINICAL INFOMATICIAN WHO QUITE HIS TIME BETWEEN RESEARCH, TEACHING SYSTEMS OF INFO MATHEMATICS MEDICINE AND CARING FOR PATIENTS. AFTER INFO MATMATIC RESIDENCY AS A FIGURES AT MASSACHUSETTS GENERAL HOSPITAL, HE SPENT 20 YEARS AT COLUMBIA UNIVERSITY AS A PROFESSOR IN BIOINFOP.M. ATICS MEDICINE. IN 2015, HE BECAME THE INAUGURAL DIRECTOR OF THE INFOMATICS INSTITUTE AT THE UNIVERSITY OF ALABAMA AT BURLING HAM. HIS AREAS OF RESEARCH INCLUDE MOBILE AND WEB BASED CLINICAL SYSTEMS FOR PATIENTS, COMPLEX SYSTEM OF -- [INDISCERNIBLE] AND DATA WAREHOUSING SUPPORT AND REUSE OF HEALTH DATA. HE IS COEDITOR OF A LEADING TEXTBOOK ON BIOINFOMATICS. HONORS INCLUDE THE NEW YORK COLLEGE OF PHYSICIANS, ACADEMY OF SETS SIN AND COLLEGE OF INFOMATICS. AWARDS FROM UNIVERSITY OF AWARD, THE DONALD LINBERG AND PRESIDENT'S AWARD FOR BIOINFOMATICS, INCLUDING THE DIRECTOR AWARD DEVICE, DISTINGUISHED PROFESSOR AT UAB, INDUCTION INTO THE NATIONAL ACADEMY OF MEDICINE AND THE MORRIS F. COLIN AWARD FOR EXCELLENCE OF THE AMERICAN BIOINFOMAICS MEDICINE. WELCOME. Dr. OGUNYEMI IS A TEACHER, PROFESSOR OF MEDICINE AT CHARLES R. DREW UNIVERSITY OF MEDICINE AND SCIENCE IN LOS ANGELES, DIRECTOR OF THE CENTER FOR BIOMEDICAL INFOMATICS PROVIDING SOLUTIONS FOR UNDER SERVED COMMUNITIES. HER RESEARCH INTERESTS INCLUDE MEDICAL DECISION SUPPORT, TREATING GRAPHICS AND VISUALIZATION, MACHINE LEARNING AND TELEHEALTH. HER RECENT WORK INCLUDES THE NATIONAL LIBRARY OF MEDICINE FUNDED R01 GRANT TO EXPLORE DIABETIC RED NONE THEE DATA FOR MACHINE LEARNING STRATEGIES. A BIOINFOMATICS PROFESSOR AT WILLIAM'S HARVARD MEDICAL SCHOOL FROM 1999 TO 2007. ALSO A MEMBER OF THE AFFILIATED FACULTY OF THE HARVARD MIT DIVISION FROM 2007-2007. SHE HAS TAUGHT BIOMEDICAL INFOMATICS AT UCLA, CDU AND SHORT COURSES ON INFOMATICS AT THE UNIVERSITY OF McCALL, DURBIN, SOUTH AFRICA. SHE IS AN ELECTED FELLOW AT THE COLLEGE OF INFOMATICS, HOLD A UNDERGRADUATE YEAR FROM BARNHARD COLLEGE IN NEW YORK AND COMPUTER AND INFORMATION SCIENCE FROM THE UNIVERSITY OF PENNSYLVANIA AND I KNOW ALL OF OUR MEMBERS OF THE BOARD RELEVANT COME Dr. CIMINO AND Dr. OGUNYEMI TO OUR BRANCH. I WOULD ALSO LIKE TO WELCOME A NEW EX-OFFICIIO MEMBER, Dr. LAUREN MAGGIO.WHO WILL BE REPLACING THE POSSESSION OCCUPIED BY Dr. DALE SMITH AND Dr. MAGGIO, WE ARE GLAD TO HAVE YOU WITH US AS WELL. WITH THAT BEGINNING INTRODUCTIONS, I WOULD LIKE TO WELCOME OUR SPECIAL GUESTS THAT WE HAVE THIS MORNING, Dr. TEEB AL-SAMARAI FROM THE OFFICE OF THE SURGEON GENERAL. THANK YOU TO ARE JOINING US AND WELCOME. I THINK YOU ARE ON MUTE. >> HI, I UNMUTED MYSELF. THANK YOU SO MUCH, MR. RAMBO AND THANK YOU TO Dr. BRENNAN. I AM REALLY EXCITED AND GRATEFUL FOR THIS OPPORTUNITY TO REPORT ON THIS OFFICE AND LOOK FORWARD TO FURTHER CONVERSATION. SO I THINK BEFORE I START, I JUST, YOU FOE, WANT TO CONFESS HOW MUCH -- HOW SPECIAL THIS IS AND WHAT A SPECIAL PRIVILEGE IT IS, I AM A LIBRARIAN FROM VARIOUS INSTITUTIONS AND PEOPLE IN MY PERSONAL LIFE AND PROFESSIONAL LIFE -- [ INDISCERNIBLE ] -- AND LOVE THE BOARD AND HAVE ALWAYS IMAGINED -- [INDISCERNIBLE] AND I KNOW THE WORLD WE LIVE IN RIGHT NOW IS NOT QUITE A PARADISE DESPITE THE ABUNDANCE OF INFORMATION BUT I THINK THAT CONTINUES TO UNDERSCORE THE IMPORTANCE OF THE NATIONAL LIBRARY OF MEDICINE AND THE WORK THAT WE DO. YOU KNOW, WE SORT OF -- I KNOW I AM SPEAKING TO THE CHOIR WHEN I SAY WE LIVE IN A WORLD WITH AN ABUNDANCE OF INFORMATION -- [INDISCERNIBLE] AND BECOMES EVEN MORE CRITICAL THIS INSTITUTION INTEGRATE AND TRANSLATE INFORMATION IN A WAY THAT IS DIGESTIBLE AND COMPREHENSIBLE, NOT JUST IDENTIFYING THOSE FROM DIVERSE BACKGROUNDS -- [INDISCERNIBLE] SO THE WORK THAT YOU ALL DO IS EVEN MORE VITAL AND CRITICAL -- [INDISCERNIBLE] AND JUST GOING TO COMMENT ON OUR OFFICE'S RECENT WORK AND CODE OF RESPONSE AND EFFORTS AND PRIORITY IDENTIFIED BY THE SURGEON GENERAL SO AS YOU MAY RECALL FROM THE LAST UPDATE, THE MAIN FOCUS IS HELPING ACCESS TO INFORMATION THROUGH THE PANDEMIC. IN TERMS OF RESPONDING TO THE PANDEMIC, YOU KNOW, IT IS OBVIOUSLY HIGHLIGHTED A PROFOUND INEQUITY -- [ TRAILING OFF ] THE PRIMARY FOCUS OF OUR OFFICE IS, YOU KNOW, RESPONDING TO THE PANDEMIC BY INCREASING CONFIDENCE, INSURING SCHOOLS ARE SAFE AND DATA IS DEVELOPED IN THE AREA OF OUR COMMUNITIES AND HEALTH SYSTEMS. AND THIS, YOU KNOW, HOW WE DID THIS WAS A RANGE OF FORMS, FROM THE SURGEON GENERAL, WHITE HOUSE BRIEFINGS, SESSION EVENTS AND -- [INDISCERNIBLE] AND I WILL HIGHLIGHT A COUPLE OF SPECIFIC PROGRAMS LAUNCHED THAT YOU MAY ALREADY BE FAMILIAR WITH. AND THE FIRST IS THE COMMUNITY CORE WHICH STARTED WITH THE DEPARTMENT OF HEALTH AND HUMAN SERVICES. [INDISCERNIBLE] IT IS A NATIONWIDE GRASSROOTS NETWORK THAT LOCALIZES COMMUNITY LEADERS TO HELP GET NEIGHBORS VACCINATED. SO THIS GROUP STARTED WITH A 300-MEMBER FOUNDING GROUP AND GREW TO OVER 1000 MEMBERS. THE OFFICE OF THE SURGEON GENERAL HAS HELD REGULAR EVENTS TO HELP WITH MASKS, BOOSTER SHOTS AND VACCINES. FORMER PRESIDENT BARACK OBAMA WITH THE SURGEON GENERAL AND -- IN. [ IN -- INAUDIBLE ] -- WHILE IDENTIFYING SPECIFIC ORGANIZATIONS, MORE AGGRESSIVE ACTION. AS YOU ALL PROBABLY KNOW, WE HAVE RECEIVED A LOT OF MEDIA INCLUDING OUTLET MEDIA FEATURED -- [INDISCERNIBLE] AND THE SURGEON GENERAL CALLED ON THESE CRITICAL GROUPS TO REALLY STEP UP. JUST A WEEK AGO, A FEW WEEKS AGO -- [INAUDIBLE] SO SINCE THAT TIME OF THE REPORT, THE SURGEON GENERAL HAS CONTINUED TO SPEAK ABOUT INFORMATION AND THERE HAS BEEN DETAILS REGARDING END INDICATING PEOPLE ABOUT THE ROLE OF TECHNOLOGY COMPANIES AND NEIGHBORING SOLUTIONS, ROLE OF FRINGE PHYSICIANS IN PROMOTING TREATMENT AND THE DANGERS OF MISINFORMATION. OUR OFFICE HAS CONTINUED TO ENGAGE WITH A DIVERSE RANGE OF STAKEHOLDERS THAT WERE IDENTIFIED IN THE ADVISORY AND RECENTLY THE SURGEON GENERAL MET WITH COLLEGE LEADERS AND UNIVERSITY PHYSICIANS -- [INDISCERNIBLE] AND BOTH ADMINISTRATIVE FACULTY COMMUNITIES AND DURING THAT CALL, THE SURGEON GENERAL OUTLINED THE INVESTIGATION OF THE ADVISORY. ON THE SOCIAL MEDIA FRONT, TWITTER HAS ORGANIZED A PLATFORM FOR DATA PRANCE PAPERS SEE INCLUDING WEB ORDERS. MOST OF YOU ARE ALREADY ON THAT PLATFORM BUT THERE IS CLEARLY A LONG ROAD AHEAD FOR ALL OF US ON THIS. SO I WANTED TO SORT OF TAKE A MOMENT TO ACKNOWLEDGE HERE THAT I THINK THE NATIONAL LIBRARY OF MEDICINE HAS BEEN A LEADER IN THIS AREA AND REALLY IMPRESSIVE STRATEGIC DOCUMENT AND SEE YOU AS A CRITICAL STAKEHOLDER AND PARTNER IN ALL OF THESE EFFORTS TO COMBAT MISINFORMATION. I WAS PARTICULARLY STRUCK BY, YOU KNOW, ONE OF THE SENTENCES IN THE PLANNING DOCUMENT WHICH SORT OF RECOGNIZED THE IMPORTANCE OF PERSON-CENTRIC AND COMMUNITY DESIGN STRATEGY FOR THE NATIONAL LIBRARY -- [INDISCERNIBLE] AND THIS IS SOMETHING WE CONTINUE TO SEE AND THE IMPORTANCE OF REACHING PEOPLE ON AN INDIVIDUAL LEVEL OF WHERE THEY ARE. AND SO, YOU KNOW, ON THIS ISSUE, WE REALLY WOULD LOVE YOUR INSIGHT AND PARTNERSHIP ON OTHER STRATEGY TO ADDRESS MISINFORMATION -- [INDISCERNIBLE] AND THAT THIS ISSUE IS NOT STRICTLY -- WITH OTHER RESPONSES WITH COVID-19, DURING THE FALL, A COUPLE OF WEEKS IN PARTICULAR HAS BEEN FOCUSED ON BACK TO SCHOOL AS I AM SURE MANY OF YOU ARE PARENTS AND HEARING THIS. THERE IS A LOT OF ANXIETY ABOUT HOW WE KEEP TEACHERS AND EVERYONE SAFE. SO THE SURGEON GENERAL HAS PARTICIPATED IN DIVERSE -- [INDISCERNIBLE] , INTRODUCED FROM A VARIETY OF MEDIA OUTLETS AND REALLY TRYING TO FOCUS ON INCREASE IN VACCINATION, MASK SAFETY, RECENT MANDATES AND OUTLETS RANGE FROM FOX NEWS AND OTHERS FOR THE MESSAGING TO PARENTS -- [INDISCERNIBLE] SO I AM GOING TO SWITCH GEARS AND JUST REALLY BRIEFLY HIGHLIGHT THE U.S. PUBLIC HEALTH SERVICE MISSION CORE WHICH HAS BEEN A PART OF THE -- [INDISCERNIBLE] AND ARE AS YOU KNOW, MANY HAVE BEEN INVOLVED MONTH AFTER MONTH TO VARIOUS COMPLEX AND GOALS. THE MISSION OF PROVIDING PATIENT CARE, COVID-19 VACCINATIONS. ANTIBODY SOLUTIONS, PUBLIC HEALTH EDUCATION, OPERATIONAL METHODS. AS OF FEBRUARY 9TH, THERE HAS BEEN -- [INDISCERNIBLE] AND JUST SWITCHING GEARS HERE SORT OF AROUND THE EFFECTIVE PART OF THE MISSION, FOCUSED ON HOW WE HELP THE MISSION IN THE AREA OF ACTIVE ENGAGEMENT AND INFORMATION FROM THE OFFICE AND REALLY TO WANT USE THE FULL RANGE OF TOOLS AT OUR DISPOSAL SUCH AS THE ADVISORY CALL TO ACTION AND THE REALLY CREATIVE TOOLS -- [ INDISCERNIBLE ] -- AVAILABLE IN THE LAST YEAR AND A HALF. SO SOME OF THE AREAS WE'RE EXPLORING ARE MENTAL HEALTH. WE'RE GATHERING INFORMATION ABOUT MENTAL HEALTH BOTH PRIOR TO AND DURING THE PANDEMIC, ACTIVELY WITH THE U.S. G TO REALLY UNDERSTAND AND DEVELOP RECOMMENDATIONS ABOUT, YOU KNOW, WHAT THE UNDERLYING ISSUES ARE AND HOW WE CAN RESPOND. AND THE OTHER ISSUE THAT I ALSO DESCRIBE AS A CHRONIC PROBLEM IS HEALTH WORKER WELL-BEING. SO WE ARE ACTIVELY COLLABORATING IN MEDICINE, ACTION ON WELL-BEING AND RESILIENCE -- [INAUDIBLE]. THE SURGEON GENERAL AS CO-CHAIR OF THE ACTION COLLABORATIVE TO HELP TRANSLATE STRATEGIES ON -- [ INAUDIBLE]. AND EVERY DAY I THINK THERE IS A HEADLINE OUT REGARDING THE BURNOUT OF FRONTLINE WORKERS, NOT JUST CLINICIANS BUT NURSES AND HEALTH WORKERS IN RESPONDING TO THE PANDEMIC. AND THEN THE LAST PART THAT YOU MAY BE FAMILIAR WITH AND THIS IS INTERNAL -- [INDISCERNIBLE] FOCUS ON SOLUTIONS, HOW TO INCREASE THE MISSION AND THERE IS A UPCOMING PERSPECTIVE FROM THE SURGEON GENERAL IN PUBLIC HEALTH, THE PUBLIC HEALTH JOURNAL THAT WILL ADDRESS LONELINESS AND ISOLATION COMING OUT. AND THEN THE LAST SORT OF QUESTION OF, YOU KNOW, WHERE DO WE GO AFTER COVID-19. MANY PEOPLE ARE RECOGNIZING THERE IS A NATIONAL DIALOGUE ON THE PANDEMIC AND -- [INDISCERNIBLE] -- A PROFOUND RECOGNITION THAT THE NORMAL WE HAD BEFORE WAS NOT HELPING EVERYONE AND THERE IS MORE THAT WE CAN DO AS A SOCIETY TO BUILD. [INDISCERNIBLE] AND PROTECT THOSE MORE VULNERABLE. SO HOW DO WE AID EACH OTHER -- [INDISCERNIBLE] AND SO WE'RE THINKING ABOUT THE KIND OF DIALOGUE IN THE WORKPLACE AND WHAT KIND OF CONVERSATIONS -- [INAUDIBLE]. SO I WILL END WITH ANOTHER QUOTE FROM TS ELLIOT WHICH IS -- [INAUDIBLE] -- AND I THINK THIS SPEAKS TO THE CRITICAL WORK THAT YOU ALL DO IN OUR DIGITAL INFORMATION [INAUDIBLE] AND MAKING SENSE OF TECHNOLOGY. SO THANK YOU AGAIN TO DIRECTOR RAMBO AND Dr. BEN NAN FOR INVITING ME TO SPEAK TO YOU TODAY AND DOING ALL WE CAN FOR THE HEALTH ECOSYSTEM AND FINDING WAYS TO REACH DIVERSE AUDIENCE ALL AROUND THE WORLD. REALLY GRATEFUL AND WELCOME YOUR COMMENTS AND QUESTIONS ON OPPORTUNITIES. >> THANK YOU, Dr. AL-SAMARRAI FOR TAKING TIME TO BE WITH US AND PROVIDE A REPORT ON THE SURGEON GENERAL'S ACTIVITY IN YOUR OFFICE. ANY COMMENTS FROM BOARD MEMBERS? >> THIS IS SUE BOTKIN AND I TYPICALLY LIVE IN NEW YORK CITY SO THIS IS AN ODD QUESTION FOR ME BUT I AM NOW IN A -- I HAPPEN TO BE IN NORTH DAKOTA AND NO ONE IS WEARING MASKS, VERY LOW APPARENTLY VACCINATION RATES IN THIS STATE SIMILAR TO, I THINK, MISSISSIPPI. AND I AM JUST CURIOUS IF THERE ARE ANY SURGEON GENERAL ACTIVITIES THAT ARE SPECIFIC TO THE RURAL AREAS? >> YES. NO, IT IS A GOOD QUESTION AND -- [INAUDIBLE] BUT I WILL HAVE TO SORT OF SAY THAT THERE HAS BEEN WORK IN RURAL AREAS AND IT IS INCREDIBLY IMPORTANT. THE WHITE HOUSE HAS -- [ INDISCERNIBLE ] THE SURGEON GENERAL SPECIFICALLY ADDRESSING RURAL AREAS FOR VACCINATION. >> GREAT, OTHER COMMENTS OR QUESTIONS? >> NEIL, I HAVE A COMMENT. THIS IS GEORGIA. THANK YOU SO MUCH FOR YOUR PRESENTATION. I WAS JUST CURIOUS ABOUT ANY ACTIVITIES THAT MAY BE HAPPENING TO REACH OUT SPECIALLY TO, YOU KNOW, CHILDREN THAT ARE FROM RACIAL AND ETHNIC MINORITY GROUPS WHO ARE PARTICULARLY VULNERABLE AT THIS TIME AND IF THERE WAS ANY PARTICULAR TYPES OF ACTIVITIES THAT ARE HAPPENING, REACHING OUT TO THOSE POPULATIONS. -- LOURDE S. >> THAT IS AN EXCELLENT QUESTION AND WE ARE REACHING OUT TO THOSE AND -- [INDISCERNIBLE] ON THIS ISSUE OF HOW TO REACH THOSE MOST VULNERABLE BUT I CAN DEFINITELY GET BACK TO YOU ON MORE INFORMATION ON PRIORITIES. >> THANK YOU. >> OTHER QUESTIONS? WELL, THANK YOU AGAIN, Dr. AL-SAMARRAI FOR TAKING THE TIME AND FOR YOUR REPORT. WE GREATLY APPRECIATE YOUR BEING WITH US. >> Dr. AL-SAMARRAI, THANK YOU AGAIN. I WOULD LIKE TO INVITE YOU TO STAY AS LONG AS YOU CAN AND REALLY APPRECIATE YOU BEING WITH US. THE ELKS-OFFICIO MEMBERS OF ALL UNIFORMED SERVICES ARE PART OF OUR BOARD MEMBERS SO WE THANK YOU FOR BEING HERE. >> GREAT, NEXT ORDER OF BUSINESS IS TO CONSIDER AND APPROVE THE MINUTES FROM THE MAY 11, 2021 MEETING. IF I MAY HAVE A MOTION AND A SECOND TO APPROVE THE MINUTES? >> SUE, I MOVE TO APPROVE. >> THANK YOU, WE HAVE A SECOND. SO ALL IN FAVOR OF APPROVING THE MINUTES, PLEASE SAY AYE. [ CHORUS OF AYES ] >> ANY NOS? ALL IN FAVOR, THE MINUTES ARE APPROVED. ALSO BRING YOUR ATTENTION TO THE FUTURE MEETINGS OF THE BOARD OF REGENTS, THOSE LISTED BEFORE YOU HAVE BEEN CONFIRMED EXCEPT FOR THE ONE ADDITIONAL ONE FOR FALL OF 2023, SEPTEMBER 12 AND 13 AS A PROPOSED STATE. IF THERE ARE NO OBJECTIONS, WE WILL GO AHEAD AND ASSUME THAT IS A CONFIRMED DATE AS WELL. BRING TO YOUR ATTENTION ALSO FUTURE MEETING DATES FOR AFFILIATED ASSOCIATIONS, MEDICAL LIBRARY ASSOCIATION, ASSOCIATION OF AMERICAN MEDICAL COLLEGES AND ACADEMIA AND WITH THAT WE WILL HAVE A REPORT FROM THE NL M DIRECTOR. PATTI, GO AHEAD. >> THANKS VERY MUCH, APPRECIATE THE INTRODUCTION, NEIL. I WANT TO THANK ALL OF YOU FOR YOUR SERVICE TO THE BOARD OF MEDICINE AND YOUR COUNTRY ON THIS BOARD. I AM DELIGHTED TO BE HERE WITH YOU BUT SORRY WE ARE NOT IN THE SAME ROOM. WE HAVE NO GUIDANCE FROM THE NIH YET ABOUT WHETHER WE WILL BE JOINING TOGETHER IN FEBRUARY. SHOULD WE JOIN TOGETHER, WE WILL HAVE A TWO-DAY MEETING AND IF IT IS VIRTUAL, IT WILL BE A ONE-DAY MEETING AND WE WILL LET YOU KNOW AS TIME FOES ON. WE WELCOME ALL OF THOSE ON THE PUBLIC VIDEOCAST, WELCOME YOU ALL. I WANT TO WELCOME THE BOARD CHAIR, ASSISTANT DIRECTOR AND BOARD CONSULTANT AND WE WILL SEE JANE POPPING UP AT VARIOUS TIMES TODAY. AND I EXTEND MY CONGRATULATIONS TO THE NEWEST MEMBER OF THE BAND FROM FATHER GROUP, JIM BECAME GRANDFATHER TO ELI. WE HAVE A HUGE AGENDA TODAY AND MY FIRST PUBLIC ACTIVITY WAS TO HOST THIS MEETING FIVE YEARS AGO. WE HAVE COME A LONG WAY IN FIVE YEARS BUT EVEN A LONG WAY SINCE MAY. I WILL BE TALKING ABOUT THE PROGRESS OF THE STRATEGIC PLAN, TALKING ABOUT BUDGET AND PERSONNEL ISSUES, I WILL INTRODUCE YOU TO ARPA-H, WHICH YOU MAY HAVE SEEN DISCUSSIONS OF IN THE PAPER AND WE WILL HAVE TIME TO DISCUSS THAT. WE WILL HAVE A BRIEFING ON LEGISLATIVE AFFAIRS FROM OUR ASSISTANT DIRECTOR FOR POLICY PLANNING AND AT THE CLOSING, I HAVE A COUPLE OF ANNOUNCEMENTS. I WANT TO MOVE TO THE NEXT SLIDE, PLEASE, AND REMIND THOSE OF YOU WHO HAVE BEEN WITH US FOR A WHILE AND THOSE OF YOU WHO ARE ON THE VIDEOCAST AND NEW, THE NATIONAL LIBRARY OF MEDICINE IS GUIDED BY ENABLING INFORMATION SINCE 195 1976 AND EVERY -- [INAUDIBLE] -- AND CONTINUE TO BE DEVELOPING ALONG THESE LINES. THIS IS WHERE WE ARE INVESTING OUR KEY INNOVATION IN ACCELERATING DISCOVERY AND ADVANCED HEALTH THROUGH DATA DRIVEN RESEARCH, REACHING MORE PEOPLE THROUGH ENHANCED DISSEMINATION AND ENGAGEMENT AND BUILDING A WORKFORCE FOR DATA DRIVEN RESEARCH AND HEALTH. I WANT TO TALK ABOUT THE NL M SUPPORT FOR THE COVID-19 PANDEMIC RESPONSE AND WE ARE REALLY PROUD OF THE WORK WE HAVE BEEN DOING. THROUGH OUR WORK AT THE NL M, WE HAVE CREATED PHASE 2 OF THE VIDEOS SUPPORTING NIH COMMUNITY ENGAGEMENT ALIGNS OR CEAL. WE HAVE ENGAGED THEM IN TESTING FOR THE VACCINE AND OUR NATIONAL LIBRARY RESPONSE IS PARTICULARLY IMPORTANT BECAUSE WE ALREADY HAD 8000 COMMUNITIES ACROSS THE COUNTRY AND CONVERTED SCIENTIFIC SKILLS TO VISUAL INFORMATION AS WELL AS AUDIO AND PRESENTING THIS INFORMATION TO THE PUBLIC WITHIN THE FOCUS. IN RESEARCH, WE HAVE BEEN THROUGH Dr. KUNNEN WITH COMPUTATIONAL ASSESSMENT OF THE RISK AND FOUND A SMALL SET OF ESCAPE-ENHANCING MUTATIONS IDENTIFIED AND LIKELY TO BE A MAJORITY AND THIS IS GOOD NEWS ACCORDING TO Dr. KUNNEN, THE LIST OF MUTATIONS WE HAVE TO BE MINDFUL OF. THERE HAS BEEN WORK IN THE VSAC INITIATIVE AND ALSO THE FHIR V4 API TO FIND THE COMPUTATIONAL CODES FOR EXAMPLE, A PERSON WITH DIABETES OR RECOVERING FROM CARDIAC SURGERY. THEY HAVE EXTENDED THIS TO THE VSAC CODES FOR COVID-19 AND THE PROCESS WILL BE DONE IN THE NEXT FEW WEEKS. OUR TEAM HAS DONE TREMENDOUS WORK IN CODING COVID-GENOME SEQUENCE DATA. YOU MAY REMEMBER IN 2020 WE HAD THE FIRST GENOME FROM THE SARS VIRUS AND THIS PROVIDED A TREMENDOUS ASSET TO THE WORLD. SINCE THAT TIME, WE HAVE DONE A NUMBER OF THINGS WITH OUR RESOURCES BEING PUT TO WORK IN THE COMMUNITY OF RESEARCH, RIGHT NOW WE PROVIDE A WEEKLY REPORT OF SEQUENCE VARIATION SO THE ACTIV TEAMS BE BETTER POSITION DRUG REFOCUSING OR DRUG TARGETS. WE HAVE ENHANCED THE SARS COV2 DATA HUB AND THE DISPLAY ON THE DASHBOARD IS REALLY HELPFUL AND EXCITED TO SEE THAT WORK. WE HAVE RECEIVED A LOT OF PUBLIC INTEREST THIS SUMMER WITH THE SEQUENCE. WE FRANKLY LEARNED VERY LITTLE THAT WAS NEW BUT IT RAISED A LOT OF CONCERNS FROM THE PUBLIC AND CONGRESS ON HOW WE'RE MANAGING OUR SEQUENCE REPOSITORIES. I AM INCREDIBLY PROUD OF THE WORK OUR TEAM DID IN HELPING THE PUBLIC UNDERSTAND THE NATIONAL LIBRARY OF MEDICINE HAS A PRESERVATION APPROACH TO SEQUENCE MANAGEMENT AND YET WE RESPECT THE RIGHTS OF THE SEQUENCE SUBMITTER TO CONTROL ACTION TO THEIR SEQUENCE SO WE WALK A VERY FINE LINE HERE AND HELPING THE PUBLIC TO UNDERSTAND THIS LEVEL OF NUANCE AND JUDGMENT REQUIRED HAS TAKEN MANY HOURS OVER THE SUMMER AND I AM EXTREMELY PROUD TO THE TEAM FOR THEIR WORK HERE. NEXT SLIDE, PLEASE. WE HAVE BEEN CONTINUING TO INVEST ACROSS THE NATION. WE PROCESSED 43 NEW AWARDS FROM RESEARCH GRANTS TO SBIR TO INFO RESOURCES TO REDUCE DISPARITIES. WE HAVE DOUBLED THE NUMBER THAT EXISTED WHEN I ARRIVED FIVE YEARS AGO. THAT IS A LOT OF HARD WORK AND IT TOOK ADDITIONAL FUNDS TO REACH IN THIS DEVELOPMENT. WE RECEIVED AND REVIEWED APPLICATIONS FROM THE NATIONAL LIBRARY OF MEDICINE'S PRE- AND POST POSTDOCTORAL TRAINING PROGRAM. THIS IS IN UNIVERSITIES ACROSS THE COUNTRY, SOMETIMES IN COLLABORATIVE GROUPS SUCH AS TEXAS AND LOUISIANA WHERE GROUPS HAVE COME TOGETHER AND SOMETIMES FREE STANDING GROUPS SUCH AS UNIVERSITY OF NORTH CAROLINA AND STANFORD. WE WILL BE ANNOUNCING THOSE AWARDS IN OCTOBER OF THIS YEAR. IN ADDITION, THE NL M HAS USED ADDITIONAL RESOURCES TO SUPPORT FUTURE PROJECTS. DOCTORS MCDONALD AND DEMNER-FUSHMAN SERVED AS EXPERTS IN PLANNING THE AIM-AHEAD PROGRAM. BECAUSE OF THEIR PARTICIPATION BOTH IN UNDERSTANDING LARGE SCALE DATA SETS AS WELL AS ARTIFICIAL TELL DEFENSE, THESE NEW AWARDS WERE DESIGNED IN A WAY THAT REPRESENT THE MOST CRITICAL, MOST CURRENT THINKING IN THE AREA. WE SOLICITED NATIONAL ASSESSMENT OF THE CHALLENGES IN USING THE COMMON DATA ELEMENTS IN RESEARCH. COMMON DATA ELEMENTS IS PRODUCING -- [INDISCERNIBLE] BY CONCEPTS COMMON OR SHARED ACROSS MORE THAN ONE RESEARCH PROJECT ARE MEASURED IN THE SAME WAY USING THE SAME INSTRUMENTS. THIS IS A CHANGE FRANKLY FOR SOME RESEARCHERS AND HAVING THE NIH ASSERT YOU WILL USE THESE VARIABLES WHEN MEASURING DEPRESSION, AGE OR GENDER IS A NONSTARTER SO IT HAS REQUIRED HOURS OF CONSULTATION WITH THE PUBLIC AND UNDERSTANDING WHAT CHALLENGES THEY FACE IN ADDRESSING THESE ISSUES. I AM PARTICULARLY GRATEFUL FOR MY COLLEAGUES WHO WORK ON THE INITIATIVE FOR DIAGNOSTICS WHERE WE HAD A CONCERTED EFFORT OVER MONTHS TO IMPROVE AND UNDERSTANDING THE COMMON DATA ELEMENTS IN FOSTERING -- [INDISCERNIBLE] -- AND LEADING THE WAY. A FEW YEARS AGO, THE RESEARCH PROGRAM ESTABLISHED THE ADA LOVELACE LECTURE AND I AM DELIGHTED TO LET YOU KNOW THIS YEAR'S ADA LOVERLACE LECTURE IS ONE OF OUR NEW BOARD MEMBERS. LOLA OGUNYEMI WILL BE DELIVERING VIA NIH TELECAST ON OCTOBER 12TH AT 3:00 P.M. AND IT WILL FOCUS ON COMPUTATIONAL TOOLS TO IDENTIFY PATIENTS FROM AN UNDER REPRESENTED GROUP OF RISK FOR SEVERE GLAUCOMA MA TO HELP PATIENTS GET THE CARE THEY NEED. I HOPE THAT YOU WILL ATTEND THIS. NEXT SLIDE, PLEASE. LOOKING AT IMPROVING OUR OPERATIONS, WE HAVE INCREASED THE MEDIUM LINE AUTO INDEXING AND HAVE IMPROVED OVER 2020 BY 36 PERCENT THE CITATIONS WE ARE DOING THERE. WE HAVE IMPLEMENTED A COUPLE OF NEW SERVICE PLATFORMS, THE PRIMO VE. THEY WON'T BE ACCESSED BY THE PUBLIC BUT ARE CRITICAL FOR US TO SUSTAIN LIBRARY PREPARES. WE HAVE ESTABLISHED THE EVALUATION COORDINATING COMMITTEE FOR ACTIVITIES AND BRINGS EXPERT MEMBERS TO MAKE SURE WE ARE USING ASSESSMENT OF DATA. WE HAVE BEEN REPORTING FOR A COUPLE OF YEARS ABOUT THE WAY WE HAVE BEEN IMPROVING OUR STAFF'S ABILITY TO USE DATA SCIENCE AND DATA SCIENCE METHODS. THEY ARE ALSO ASSISTING US WITH EVALUATION OF THE PREPRINT PILOT AND I AM THANKFUL FOR DEVELOPMENT IN THAT AREA. WE HAVE ALSO IMPROVED TRAINEE ENGAGEMENT THROUGH STRUCTURED PLANNING AND EVALUATION WITH THE CLOUD. WE HAVE BEEN ABLE TO LEVERAGE SOME VERY IMPORTANT PARTNERSHIPS HERE SO OVER THE SUMMER, WE HAVE LEVERAGED THE AWS OPEN DATA SPONSORSHIP PROGRAM TO BRING TWO MORE OF OUR REPOSITORIES OUT IN THE OPEN AT NO COST. WE HAVE OVER FOUR MILLION MANUSCRIPTS MACED IN THE AWS OPEN DATA REGION AS HAS THE PUBLIC SEQUENCE READ ARCHIVE. THIS IS AN AMAZING EFFORT TO MAKE DATA ACCESSIBLE TO THE TRAINING INDUSTRY AND PROUD THAT NOT ONLY ARE OUR RESOURCES GETTING USED MORE WIDELY THIS WAY BUT ALSO THE TECHNICAL TEAMS AT NCI WHO DO THE HEAVY WORK OF WHAT THEY TELL ME IS THE LIFT AND SHIFT. FINALLY WITH THE GUIDANCE FROM LIBRARY OPERATIONS AND COMPUTER SYSTEMS, WE HAVE TRANSITIONED OUR LIBRARY SERVICES TO THE CLOUD SO AS YOU CAN SEE WE ARE MOVING MORE AND MORE OF OUR RESOURCES INTO COMMERCIAL CLOUD -- EXCUSE ME, COMMERCIAL CLOUD RESOURCES TO MAKE SURE THEY ARE SAFE, SECURE AND SUSTAINABLE AND THE STRATEGY FOR THIS REQUIRES COORDINATION FROM THE NATIONAL LIBRARY OF MEDICINE AND HAS BEEN VERY EFFECTIVE. I SEE LOLA, WE MAY HAVE MISSTATED WHAT YOUR SPECIALIZATION IS, WHICH IS DIABETIC RETINOPATHY, APOLOGIZE FOR THAT. NEXT, OUR DEM LAKES IS ALMOST COMPLETE AND YOU CAN SEE SOME OF THE WORK GOING ON RIGHT NOW. BUILDING 38 IS ALMOST COMPLETE. WHAT WAS VERY IMPORTANT IN THIS PROCESS IS TO MOVE ALL OF OUR PRECIOUS OBJECTS FROM THE HISTORY OF MEDICINE TO BE MOVED AND START AND ON THE RIGHTHAND PART OF THE SCREEN, YOU SEE LAURA HARTMAN PACKING UP RARE BOOKS FROM THE INCUNABULA ROOM. THESE BOOKS HAVE NOT BEEN MOVED SINCE 1960 AND MAKING SURE THEY ARE MOVED SAFELY TO A CONTROLLED ENVIRONMENT, WE'RE VERY PLEASED ABOUT THAT. THE DATACENTER WHICH YOU CAN'T SEE BECAUSE IT IS BEHIND EVERYTHING, IS PROGRESSING WELL. THE CHALLENGE THAT WE HAVE, THOSE OF YOU ON CAMPUS KNOWS THERE IS A LEAK BETWEEN BUILDING 38 AND DURING BAD RAINS WE HAVE HAD SIGNIFICANT CHALLENGES. WE HAVE BEEN WORKING VERY CLOSELY WITH THE OFFICE OF RESEARCH FACILITIES AS THERE IS A PLAN IN PLACE TO REPAIR AND SOLIDIFY THE PROBLEMS TO GET RID OF LEAKS BUT IT WILL TAKE TIME AS EVERYTHING DOES WITH GOVERNMENT. THE LAST THING I WANT TO POINT OUT TO YOU IS BUILDING 38A SPACE HAS BEEN UPGRADED AND WE HAVE MOVED THE OFFICE OF THE DIRECTOR AND OUR MEETING AREA TO THE FOURTH FLOOR. IF YOU LOOK AT THE CENTER OF YOUR SCREEN, THE PICTURE WITH THE BLUE SCENES ON IT, WE HAVE A BUILDING TO DO PRESENTATIONS AS WE HAD BEFORE AND I AM THANKFUL TO OSIS AND TECH STAFF FROM THE OFFICE OF COMMUNICATIONS TO PUT THIS IN PLACE SO QUICKLY. REMAIN 100 PERCENT TELEWORK, MOST OF OUR STAFF ARE WORKING FROM HOME. AS THE SECRETARY ANNOUNCED EARLIER THIS YEAR -- SORRY, EARLIER THIS MONTH, WE DO NOT EXPECT TO SEE A RETURN OF NIH STAFF TO THEIR OFFICES BEFORE NOVEMBER AT THE EARLIEST AND THERE IS NO PLAN IN PLACE RIGHT NOW AS FAR AS I AM AWARE. NEXT SLIDE, PLEASE. NOW THIS IS MY TIME TO SPEAK TO YOU ABOUT BUDGET AND THIS IS OUR FISCAL ACCOUNTABILITY AND NOTHING TO REALLY SAY OTHER THAN OUR BUDGET HAS BEEN MOVING UP. IT WAS $396 MILLION AND NOW IS $462. YOU WILL NOTICE A JUMP IN 2020 WHEN OUR BUDGET WENT UP TO 467 BECAUSE WE RECEIVED AN EXTRA $10 MILLION IN OUR BASE APPROPRIATION ONE-TIME ONLY TO INVEST IN OUR COVID RESPONSE. AS YOU LOOK AT THAT $462 MILLION, I WANT YOU TO KNOW WE HAVE 8 PERCENT MORE FUNDS MOVING THROUGH THE LIBRARY OF MEDICINE BECAUSE OF THE WORK WE DO WITH OTHER GOVERNMENTAL AGENCIES SO OUR ACTUAL FLOW-THROUGH IS HIGHER THAN YOU SEE ON THE SCREEN. THE PRESIDENT RECOMMENDED IT BE INCREASED. THE HOUSE HAS IT TARGETED TO BE AT $487 MILLION SO I AM SEEING HOPEFUL PROMISE THAT THIS STAYS WITH US. NEXT SLIDE, PLEASE. NOW A VERY MIXED EXPERIENCE, TALKING TO YOU ABOUT OUR PERSONNEL UPDATES. MANY OF YOU KNOW -- NO, BACK UP, PLEASE. MANY OF YOU KNOW FROM THE MEETING IN MAY THAT JERRY SHEHAN WAS GOING ON DETAIL TO THE OFFICE OF SCIENCE TECHNOLOGY POLICY AND JERRY HAS BEEN THERE NOW SINCE MIDWAY, WORKING OPEN SCIENCE BUT TOOK A BREAK TO -- [INDISCERNIBLE] IN ADDITION TO REPORTING TO THE BOARD, THE STAFF HAS STEPPED UP TO FILL IN WITH RESPONSIBILITIES BUT JERRY THERE IS A VERY BIG HOLE HERE. OVER THE SUMMER, I AM SAD TO SAY WE LOST A DEAR COLLEAGUE FROM THE INFORMATION ENGINEERING BRANCH OR NCBI. THE SCIENTIST WITH US FOR MANY YEARS, MUCH RESPECTED BY HIS COLLEAGUES AND AFTER A LONG ILLNESS, HE PASSED AWAY AND WE EXTEND OUR SADNESS FOR YOUR LOSS TO HIS FAMILY. A YOUNG SCIENTIST WHO WAS A GREAT CONTRIBUTOR TO OUR SYSTEM. A MOMENT OF SILENCE. THANK YOU. NOW WE WOULD LIKE TO MOVE TO OUR NEW HIRES. AS WE SAID WE HAVE INCREASED OUR STAFFING AND SUPPORT AND I AM HAPPY TO INTRODUCE MERYL SUFIAN, SUPERVISORY HEALTH SCIENTIST AND CHIEF OF THE PROGRAM IN THAT AREA. AMIE PARK, A PROGRAM ANALYST IN THE EXTRAMURAL PROGRAMS AREA. WE WELCOME THESE TWO STAFF MEMBERS TO STRENGTHEN OUR PROGRAM AND Dr. PALMER HAS DONE A GOOD JOB SUPPORTING THE INNOVATIONS IN THE PROGRAM. NEXT SLIDE, PLEASE. AS MANY EVER YOU KNOW, THE NIH SPONSORED A TRAINING PROGRAM WITH THE ACADEMIC LIBRARIES AND ARE THE ASSOCIATE FELLOWS FOR THIS YEAR ARE ON THE SCREEN IN FRONT OF YOU. THEY HAVE JOINED US FOR THIS YEAR. I GOT THE PRIVILEGE OF MEETING THEM AND TALKING ABOUT THEIR VISION AND GOALS. I WAS GLAD TO HEAR THERE IS A LITTLEREFINEING LANGUAGE BUT THESE YOUNG PEOPLE ARE WORKING IN STAFF ANALYTICS. AFTER THE ASSOCIATE FELLOWS COME MEET THEIR TRAININGS, WE SOMETIMES GO ON TO TRADITIONAL LIBRARIES AND WE USUALLY KEEP ONE ON STAFF HERE SO THANK YOU AND WELCOME TO OUR FELLOWS. I WOULD LIKE TO TURN YOUR ATTENTION TO A PROGRAM CALLED HERE AT THE NATIONAL INSTITUTES OF HEALTH, THE ARPA-H PROGRAM. IT WAS A PROGRAM THAT BEGAN DURING PRESIDENT BIDEN'S CAMPAIGN. IT IS GUIDED BY TARA SCHWETZ. THE SLIDES I AM SHOWING IS A PUBLIC SET OF SLIDES BUT THE PROCESS IS STILL UNDER DELIBERATION. NEXT SLIDE, PLEASE. THE CHALLENGE AND OPPORTUNITY THAT WE FACE RIGHT NOW AS A COUNTRY AND AS A WORLD IS THAT WE HAVE UNPRECEDENTED SCIENTIFIC PROGRESS -- PROM MISS, RATHER, OF CANCER IMMUNOTHERAPIES, HIGHLY EFFECTIVE COVID-19 VACCINES DEVELOPED AND APPROVED IN LESS THAN A YEAR BUT THERE ARE CHALLENGES THAT FACE US, HOW CAN WE ACCELERATE THE PACE OF BREAKTHROUGHS IN MEDICINE AND HEALTH, HOW CAN WE REVOLUTIONIZE PREVENTION TREATMENT AND CURE OF CANCER, INFECTIOUS DISEASES AND ALZHEIMER'S DISEASE. AND HOW CAN WE TRANSFORM HEALTHCARE ACCESS, EQUITY, QUALITY AND REDUCE HEALTH DISPARITIES? ARPA-H IS DESIGNED TO DO THIS. THE MISSION IS TO BENEFIT HEALTH OF ALL AMERICANS BY CALL LIESING HEALTH BREAKTHROUGHS THAT CANNOT READILY BE ACCOMPLISHED THROUGH TRADITIONAL RESEARCH AND COMMERCIAL ACTIVITY. THE APPROACH ARPA-H IS TAKING WILL RELY ON OTHER APPROACHES BY DARPA, BARDA, ARPA-E TO ADDRESS ENERGY AND ARPA-H TO ENVISION THE FUTURE OF INFORMATION. IARPA. WE ARE PLEASED TO SEE THIS HAPPENING AND WORKING CLOSELY WITH THE CONGRESS TO PROVIDE A VISION THAT WILL ADDRESS THE FUNDAMENTAL VIEW OF CATALYZING PROGRAMS. AT THE SAME TIME, TO DEVELOP WHAT IS NECESSARY TO HAVE A FAST TECH TURNOVER. NEXT SLIDE, PLEASE. NOW THE GUIDING PRINCIPLE UNDER ARPA-H IS TO CREATE A CULTURE OF INNOVATION. IT IS PROPOSED TO BE HOUSED WITHIN THE NIH BUT WILL BE DISTINCT FROM THE OTHER 22 INSTITUTES AND CENTERS. IT WILL DRAW ON THE VAST KNOWLEDGE AND EXPERTISE AND INFORMS BUT WILL REMAIN DISTINCT WITH UNIQUE CULTURE AND ORGANIZATION, INCLUDING FOR EXAMPLE, THE APPOINTMENT OF THE DIRECTOR OF ARPA-H WHICH WE ANTICIPATE WILL BE A PRESIDENTIAL APPOINTMENT AND. ARPA SEEKS INNOVATIVE IDEAS AND COLLABORATIVE AND DIVERSE PEOPLE, BE NIMBLE AND URGENT, TO BE OPEN, TRANSPARENT AND ENGAGE STAKEHOLDERS. ARPA-H WILL BE OPEN TO FAILING EARLY AS NOT EVERYTHING IS SUCCESSFUL AND TO BE ACCOUNTABLE YET INDEPENDENT. SO TO PREPARE THE JOURNEY, THE NIH AND ARPA-H HAVE LISTENED TO MANY PARTICIPANTS, OVER 5100 PARTICIPANTS AND 250 ORGANIZATIONS. 15 SESSIONS WERE HELD IN THE SUMMER AND SOME OF YOU MAY HAVE PARTICIPATED IN THEM. THE THEMES TO CAME OUT FROM OUR COLLEAGUES AND AROUND THE COUNTRY IS THAT IT HAVE A SCIENTIFIC PORTFOLIO AND COMPLIMENTARY TO NIH, THAT IT SHOULD INCLUDE HEALTH EQUITY AND NOT BE DISEASE SPECIFIC. IN ADDITION, THEY IDENTIFY CRITICAL PROCESS ELEMENTS INCLUDING LONG STAKEHOLDER IN ENGAGEMENT AS WELL AS MULTIDISCIPLINARY PARTNERSHIPS TO BRING THE BEST KNOWLEDGE AND PROCESS TO OUR ACTIVITIES. NOW THAT IS WHAT WE HAVE BEEN DOING. I NOW TURN TO A QUESTION THAT I HAVE TO YOU, THE BOARD OF REGENTS. NEXT SLIDE, PLEASE. IN 2019 THE BOARD OF REGENTS CONDUCTED A SELF-ASSESSMENT THAT RESULTED IN WORKING GROUPS TO HAVE DEEPER DISCUSSION OF KEY NL M ISSUES WITH NL M STAFF. SO WORKING BROOMS WERE SET UP AND WE CURRENTLY HAVE FOUR WORKING GROUPS. THEY ARE DISTINCT FROM THE INTERACTION COMMITTEE. THE GROUPS ARE WORKING WELL AND THE FIRST ONE IN MANY YEARS IS TO DEVELOP CLINICAL STRATEGIES FOR MODERNIZATION AND REALLY TO BECOME A FLAGSHIP FOR THE NIH BUT THERE HAVE BEEN ISSUES. OUR GROUPS ARE SMALL AND SOMETIMES ONLY ONE TO THREE BOARD MEMBERS ARE AVAILABLE AND SOMETIMES OUR STAFF OUTNUMBER BOARD MEMBERS AND THAT GETS TO BE CHALKING BUT ALSO THE TURNOVER EACH YEAR WITH BOARD MEMBERS, WE HAVE HAD TO SPEND A LOT OF TIME IN BASIC EDUCATION. THE LEADERSHIP HAS BEEN DISCUSSING THIS AND EVALUATING HOW TO GET BOARD MEMBERS IN THE DISCUSSIONS. NOW I AM ASKING NEIL RAMBO TO LEAD THE BOARD IN AN EVALUATION OVER THE YEARS AND ASK YOU WHAT IS THE BEST WAY TO ENGAGE AND MAKE USE OF TIME AND TALENT IN SUPPORT OF THE NATIONAL LIBRARIES OF MEDICINE. I WILL BE ASKING NEIL, AND HE WILL BE SUPPORTED BY OUR RESEARCH EVALUATION GROUP WITHIN THE STRATEGIC INITIATIVE TO PLAN SOME TIME IN OUR FEBRUARY MEETING WHERE YOU AS A BOARD CAN HAVE A PRIVATE DISCUSSION ABOUT SOME OF THESE ISSUES. AND IN ADDITION, WE WILL HAVE OTHER WORKING ACTIVITIES TO GO FORWARD. NOW MAY I PAUSE AND TURN TO TERESA TO GET OUR BOARD UPDATES. NEXT SLIDE, PLEASE. >> THANK YOU AND GOOD MORNING. I WANTED TO SHARE SOME POLICY UPDATES THIS MORNING AND AS ALWAYS, I ENCOURAGE YOU TO REVIEW THE SLIDES WE HAVE LEFT FOR YOU FOR MORE DETAILED INFORMATION. NEXT SLIDE, PLEASE. THE LEGISLATIVE POLICY AND BUDGET, THE PRESIDENT RELEASED HIS BUDGET PROPOSAL SHORTLY AFTER OUR MEETING IN MAY AND SINCE THEN, THE HOUSE HAS PASSED THE APPROPRIATIONS BILL INCLUDING INITIATIVES FOR HHS AND NIH. SUBSEQUENTLY, THE SENATE APPROVED THE BUDGET RESOLUTION PROVIDING INSTRUCTIONS FOR COMMITTEES TO DRAFT LEGISLATION WITHIN THE $3.5 TRILLION RESOLUTION PACKAGE AND THIS RESOLUTION WAS SUBSEQUENTLY ADOPTED BY THE HOUSE ON AUGUST 24TH. OF NOTE, I WANTED YOU TO BE AWARE THAT THIS PAST FRIDAY THE HOUSE ENERGY AND COMMERCE COMMITTEE RELEASED THEIR DRAFT LEGISLATION WHICH THEY ARE MARKING UP TODAY. ONE OF THE SUBTITLES TO THAT LEGISLATION, IS UP TITLE J FOCUSES ON PUBLIC HEALTH AND, AMONG MANY THINGS, PROPOSES APPROPRIATIONS AND AUTHORIZATION FOR ARPA-H. IN ADDITION TO THAT, IT APPROPRIATES FUNDS FOR THE CENTERS FOR DISEASE CONTROL AND PREVENTION, BARDA WHICH PATTI MENTIONED EARLIER AND THE ASSISTANT SECRETARY RESPONSE FOR PANDEMIC ACTIVITIES. THE HOUSE AND SENATE HAS SET A GOAL OF GETTING LEGISLATION FROM VARIOUS COMMITTEES SUBMITTED TO THE BUDGET COMMITTEE BY TOMORROW, SEPTEMBER 15TH AND ONCE THAT IS DONE, THE RECONCILIATION PACKAGE WILL BE READY TO MOVE TO THE FULL HOUSE AND SENATE FOR LEGISLATION. THERE IS ALSO ADDITIONAL ACTIVITY FOR NIH AND NL M, THE COMPETITION ACT OF 2021 WHICH PASSED IN EARLY JUNE. AMONG MANY OF THE SIGN-RELATED PROVISIONS, IT INCLUDES REQUIRING FEDERAL AGENCIES WITH A RESEARCH EXPENDITURE OF MORE THAN $100 MILLION TO DEVELOP A RESEARCH PUBLIC ACCESS POLICY. THE OTHER IS THE 2.0 CURES DISCUSSION DRAFT AND IN JUNE, REPRESENTATIVES RELEASED A DISCUSSION DRAFT FOR PEOPLE TO TAKE A LOOK AT AND COMMENT ON AND FOCUSES ON NEW DRUG DELIVERY AND TREATMENT THAT WOULD HAVE BEEN DROPPED UNDER THE 21ST CENTURY CURES ACT THAT PASSED IN 2016. WITH RESPECT TO POLICY ACTIVITIES, THERE HAVE BEEN SEVERAL ACTIVITIES AT OSTP OF INTEREST TO NIH AND OLM, PATTI ALLUDED TO ARPA-A ACTIVITIES AND I MENTIONED IN MAY DURING MY UPDATE, SINCE MAY THE WHITE HOUSE HAS DEVELOPED A TASK FORCE, PUBLISH RELATED REQUEST FOR INFORMATION AND LISTEDDED THREE RELATED TOPICS. NATIONAL ARTIFICIAL INTELLIGENCE RESEARCH RESOURCE. IN JUNE, OSTP AND NSF ANNOUNCED A TASK FORCE WHICH WILL HELP CREATE AND IMPLEMENT A BLUEPRINT FOR THIS RESOURCE. THE TASK REQUESTED INFORMATION AND THAT WAS RECENTLY EXTENDED TO OCTOBER 1ST SO THERE IS STILL AN OPPORTUNITY TO PROVIDE PUBLIC COMMENT. AND THE LAST THING I WANTED TO MENTION IS LATE LAST MONTH, THE ADMINISTRATION RELEASED A MEMO OUTLINING RESEARCH AND DEVELOPMENT PRIORITIES FOR FISCAL YEAR 2023. PRIORITIES INCLUDE PANDEMIC READINESS AND PREVENTION, ADDRESSING CLIMATE CHANGE, CATALYZING RESEARCH IN CRITICAL AND EMERGING AREAS SUCH AS ARTIFICIAL INTELLIGENCE, ADVANCED COMMUNICATION TECHNOLOGIES, HYPER FORM PRANCE COMPUTING. BIOINFOMATIC TECHNOLOGY AND WITH THAT I WILL TURN IT OVER TO PATTI. >> THANKS, TERESA. LATER IN THE SESSION WE WILL HAVE TIME FOR QUESTIONS SO IF YOU HAVE QUESTIONS OF HER, SHE WILL BE ABLE TO ASK THEM. AND NOW I WILL BE WRAPPING UP NOW. WE HAVE HAD STAFF MEMBERS HELPING ON BOARDS AND TO HELP RESETTLE AFGHANI REFUGEES. WE ALSO HAD 35 OR A LITTLE MORE THAN 35 DONORS IN THE NL M GIVES BACK, A BLOOD DRIVE WE HELD THIS SUMMER AND Test test test. 11 AP. (. EXCUSE ME, AT THE KENNEDY CENTER IN MAY, BETWEEN THE 22. MAY 17, BETWEEN THE 22. THAT'S THIS COMING MAY, 7:30 P.M. BOARD MEMBERS, NLM STAFF AND FRIENDS OF THE NATIONAL LIBRARY OF MEDICINE AT LARGE ARE ALL INVITED TO ATTEND. IF YOU WOULD LIKE TO HAVE A COMPLIMENTARY TICKET, CONTACT NL NLM COMMUNE OCCASIONS AND WE'LL ARRANGE FOR THAT FOR YOU. WE WERE ASKED TO GET A COUNT OF PEOPLE WHO WILL BE GETTING COMPLEMENTARY TICKETS WITHIN THE NEXT FEW WEEKS SO WE CAN DO SOMETHING FOR THE PLANNING. SO I WOULD ASK YOU, PLEASE, IF CAN YOU JOIN US THEN, I WILL BE VERY HAPPY. I'M REALLY PLEASED TO BE ABLE TO SAY THAT I WILL BE PROVIDING ONE OF THE EUOLOGIES FOR DR. CORN. THANK YOU. NEXT SLIDE PLEASE, SUMMARIZES OUR WORKING GROUPS ASSIGNMENTS FOR TODAY. OF COURSE, WE'LL ALL BE VIRTUAL, BUT NOW, WE HAVE ABOUT 15 MINUTES FOR QUESTIONS AND CONVERSATIONS. FOR OUR NEW MEMBERS, GENERALLY, A BOARD MEMBER OR TWO IS GOING TO START OFF THE CONVERSATION. BUTT DIRECTOR'S REPORT IS OPEN TO ANYONE FOR COMMENTS AND QUESTIONS. I'LL TURN IT BACK TO NEIL. THANK YOU VERY MUCH. >> NEIL: THANK YOU, PATTY AND WE ARE OPEN FOR QUESTIONS ABOUT ANY OF THE -- PATTY'S MATERIAL. I DO WANT TO MENTION THAT I THINK AS OF NOW, THE MEDIA OPERATIONS TEAM WILL LAUNCH BREAKOUT ROOMS FOR OUR WORKING GROUP SESSIONS, BUT YOU CAN WAIT TO JOIN YOUR ROOM UNTIL WE ARE READY TO MOVE IN ABOUT 15 MINUTES TO THAT. BUT YOU ARE A PRESENTER AND YOU NEED TO SET UP EARLY, YOU CAN JOIN NOW. AND YOU MIGHT SEE A ZOOM NOTICE ON YOUR SCREEN INVITING YOU TO JOIN A WORKING GROUP, AND YOU COULD SORT OF IGNORE THAT FOR NOW UNTIL WE FINISH OUR QUESTION AND ANSWER SESSIONS. SO QUESTIONS FROM THE BOARD FOR PATTY. DON'T BE SHY. PATTY, I HAD ONE ABOUT ARPA-H, BEING BASED AT NIH. IT SEEMS LIKE A GREAT OPPORTUNITY FOR NLM, TO BE AT FOREFRONT IN TERMS OF INNOVATION, AGILITY WITH, YOU KNOW, BIOINFORMATICS, STATE SCIENCE INITIATIVES, ALL SORT OF WAYS TO SORT OF LEAP FROG SOME OF THE STANDARD PROCESS. I'M SURE THERE'S BEEN DISCUSSION BEINGS THIS, BUT CAN YOU SHARE MORE ABOUT, YOU KNOW, WHAT SOME OF THE NLM LEADERSHIP THINKING IS ABOUT INVOLVEMENT WITH ARPA-H? >> PATTY: THANK YOU VERY MUCH, NEIL, AND I COMPLETELY AGREE WITH YOU WANT NOT ONLY DO I THINK WE HAVE A TRADITION OF INNOVATION AND AN KNOWING OF SOME OF BOTH FEASIBILITIES AND THE COMPLEXITIES OF DATA, BUT I ALSO THINK WE UNDERSTAND SCIENTIFIC COMMUNICATION, AND SCIENTIFIC COMMUNICATION IS GOING TO CHANGE UNDER ARPA-H. THERE'S GOING TO BE A MUCH CLEAR NEEDED DOCUMENTATION FOR PROTOCOLS AND PIPELINE AND AN IMPORTANT BALANCING OF PUBLIC INTEREST AND PRIVACY INTELLECTUAL DISCLOSURES. SO I THINK THE NLM WILL BE FRONT AND CENTER IN MUCH OF THE WORK THAT'S GOING ON WITH ARPA-H. I OF COURSE PRIVILEGED TO BE ONE OF THE 7 NIH DIRECTORS, WORKING VERY CLOSELY WITH DR. AT ABECK, IN CRAFTING AND WE'LL BE MEETING WITH THE REST OF OUR LEADERSHIP TEAM AND THE LEADERSHIP FORUM TO GET A BROADER PERSPECTIVE SO I DON'T WANT TO GET TOO FAR AHEAD OF THAT, BUT WHAT I WANT TO MAKE SURE IS CLEAR TO THOSE PRESENT IS THAT THE NATIONAL LIBRARY OF MEDICINE HAS BEEN BUILDING ITS REPRESENTATION FOR THE MANY, MANY, MANY YEARS AND IN PARTICULAR, HAS ACCELERATED UNDER THE COVID PANDEMIC AS BEING AN ENABLING PARTNER TO MANY OF THE CHALLENGES THAT NIH FACES. SO WE ARE WELL POSITIONED FOR THIS CONVERSATION. NOW, THERE IS, OF COURSE, AS YOU CAN IMAGINE AND WE HEARD THIS VERY LOUDLY IN OUR PUBLIC MEETING, WILL THIS TAKE AWAY FROM NIH'S MISSION? WILL THE A CPA-H IN SOME WAKE TAKE OVER THE NIH MISSION? AT THE PRESENT TIME, ARPA-H, PROPOSED IN THE HOUSE LANGUAGE AT ABOUT A $3 BILLION INVESTMENT. THAT'S A LOT BIGGER NOT THAT NATIONAL LIBRARY OF MEDICINE, ABOUT SIX OR SEVEN TIMES BIGGER. SO HOW DO WE WORK WITH A VERY LARGE PARTNER, WHO HAS A LOT INDEPENDENCE? AND THESE ARE QUESTIONS NA WE HAVE BEGUN TO DELIBERATE AND WE'LL CONTINUE TO DELIBERATE AND CERTAINLY, WHEN THE NEW DIRECTOR IS A POINT FORWARD ARPA-H, WE'LL BECOME A CRITICAL PART OF THE CONVERSATION. I ENVISION THREE THINGS. FIRST OF ALL, THE IDEAS THAT PERCOLATE THROUGH RESEARCH PROJECTS ORGANIZATIONS, WHETHER IT'S ARPAH-H OR CARPA, CAN COME FROM ANYWHERE SO OUR STAFF MAY BE SOME OF THE FRONT OF THESE VERY COOL IDEAS AND IDEAS THAT CAN BE EXPLORED IN A RESEARCH PROGRAM OR SYSTEMATIC BUILDING BLOCKS AND TESTING AND VALIDATION BECOME IMPORTANT. MIGHT BE RIGHT FOR ACCELERATION THROUGH INITIATIVES SUCH AS ARPA-H. SO I DO ENVISION THAT WE WILL HAVE SOME IDEAS PRESENTED TO (AUDIO DISTORTION) AND NLM STAFF. SECONDLY, NATION LIBRARY OF MEDICINE STAFF HAPPENEDS DISSEMINATION IN WAY THAT IS I THINK CAN BE LEVERAGED WELL BY ARPA-H. WHETHER IT'S UNDERSTANDING HOW TO COMMUNICATE WITH COMMUNITIES WHO ARE DIFFERENT THAN THEY NORMALLY ENVISION HEALTHCARE OR SERVICES OR HEALTH COMMUNITY. WE ARE ALREADY THERE AND WE HAVE OPPORTUNITIES TO SUPPORT THAT. FINALLY, THE NATIONAL LIBRARY OF MEDICINE HAS EXPERTISE IN THINKING ABOUT PRESERVATION AND WHEN YOU MOVE INTO AN AREA OF INNOVATION, YOU SOMETIMES RUN INTO A CONFLICT WITHIN INNOVATION AND PRESERVATION AND WANTING TO GET WORK DONE QUICKLY, RATHER THAN MAKE SURE THE WORK IS DOCUMENTED WELL. WE BELIEVE THAT OUR SKILL SET SCOUR HISTORY IN THIS AREA WILL TAKE US FORWARD AND ALLOW US TO PROVIDE TO ARPA-H, NECESSARY SKILLS AND PERHAPS EVEN NECESSARY REPOSITORIES BECAUSE IT WILL BE A PART OF NIH. THE ARPA-H WILL BE ACCOUNTABLE TO OUR PERSONAL ACTIONS, OUR MODELS, THE WAY OUR REFUNDS ARE SPENT. THEY WILL NOT BE FREE OF THE NIH AUTHORITY. THANKS. >> NIEL: THANK YOU. SOUNDS VERY EXCITING. GO AHEAD, NANCY. >> NANCY: HI, THANKS FOR THE UPDATES. I HAVE A QUESTION ON SOMETHING YOU MENTIONED LAST MEETING AND THEN AGAIN TODAY. REGARDING THE VALUE SET AUTHORITY CENTER INITIATIVE. AND I UNDERSTAND THAT IMPROVEMENT IS ONE OF THE AREAS OF FOCUS OF REINVESTMENT AND THE STRATEGIC PLAN. CAN YOU SAY JUST A LITTLE BIT MORE ABOUT THAT OR CAN WE POTENTIALLY CARVE OUT SOME TIME IN THE MIXTURE MEETING TO PERHAPS GO INTO DETAIL ON WHAT'S GOING ON WITH THAT? >> PATTY: I'M GOING TO ASK DIANE AND IVOR TO PLAN FOR NA SO WE CAN HAVE A DEEPER BRIEFING ABOUT WHAT IT IS AND WHAT ITS HISTORY IS. AT THE RISK OF MISPRONOUNCING OR MISDIRECTING AS I'VE DONE TWICE IN THE MEETING SO FAR. DIANNE, WOULD YOU LIKE TO MAKE A COMMENT ABOUT THIS OR GIVE US A LITTLE HISTORY OF THE BSAC OR IVOR IF YOU'RE ON THE CALL? >> AND, I GUESS ONE WANT QUESTIONS I HAVE IS SORT OF FORWARD-LOOKING, AS PART OF THE IMPROVEMENT INITIATIVE FOR AREAS OF IMPROVEMENT ARE YOU LOOKING TO ADDRESS. ARE THE FOCUS OF THE REINVESTMENT, EVEN A LITTLE BIT MORE SO THAN THE HISTORY. HISTORY IS ALWAYS IMPORTANT TO UNDERSTANDING WHERE YOU'RE GOING. >> THE REASON WHY THIS PIECE OF HISTORY IS IMPORTANT, WE DO THIS COLLABORATION WITH THE OFFICE OF COLLABORATION. SOME OF THE WORK IS DONE FROM A SERVICE MODEL. WE ALSO HAVE SIGNIFICANT PARTNERSHIPS WITH PROFESSIONAL SOCIETIES BECAUSE THE LIBRARY ITSELF DOES NOT CREATE THE VALUE SETTINGS. THE LIBRARY INDEXES THEM AND MAKES THEM AVAILABLE AND NOW USING THE FIRE API MAKES THEM MUCH MORE EASILY ACCESSIBLE. WE HAVE, I ENVISION, AS WE GO FORWARD, OBVIOUSLY, THE TECHNICAL PLATFORM SECURITY IS THE MOST IMPORTANT FEATURE WE ARE DEALING WITH AND THE OFFICE OF COMPUTER AND COMMUNE OCCASIONS SYSTEMS IS DEALING WITH THAT. BSAC IS USED IN A NUMBER OF DIFFERENT WAYS, FOR A NUMBER OF DIFFERENT PURPOSES. SO IT'S OFTEN USE FORWARD PAYMENT, BUT IT'S ALSO USED FOR QUALITY MONITORING. IT'S LARGE HEALTHCARE SYSTEMS, NOT SO MUCH CLINICAL CARE SYSTEMS. IT'S A WAY OF BRINGING TOGETHER, THE CODES THAT REFLECT SAY BLOOD SUGAR AND SELF-MANAGEMENT AND PERIPHERAL NEUROPATHY, TO DO AN APPRAISAL OF AN INDIVIDUAL WHO'S GOT, TO DETERMINE WHETHER THEIR DIABETES CARE IS IMPROVING OR STABILIZING. WE PROBABLY HAVE MORE CODES THAN NECESSARY NOW. AS I SAID, THE OVERSIGHT OF THE CODES IS WITH THEIR INSTITUTION -- I'M SORRY, WITH THE PROPOSING AUTHORITY. SO WE WILL BE WORKING WITH OUR PROPOSING AUTHORITIES TO REEVALUATE, TO UPDATE, TO EXAMINE THESE CODES. AND FINALLY, WE'RE WORKING VERY CLOSELY WITH OMC. OFFICE OF THE NATIONAL COORDINATION OF HEALTH. AND OFFICE OF MEDICATED SERVICES TO ISSUE SURE THAT THE WAY THE CODES ARE CHARACTERIZING PROBLEM ARE CHARACTERIZING THE PROBLEMS IN THE WAY IT MAKINGS MOST SENSE, FROM A INFERRING TECHNOLOGY STANDPOINT AND FROM A COST STANDPOINT. >> AND NANCY, I WAS WONDERING, IF YOU WOULDN'T MIND, SHARING YOUR THOUGHTS ON THIS TOP IRK. WE COULD PROBABLY USE THAT TO PREPARE FOLKS FOR THE NEXT BOARD MEETING. >> WE'LL BE HAPPY TO AND WE CAN DO NA OFFLINE. >> SUSAN, I BELIEVE YOU'RE NEXT IN LINE WITH A QUESTION. >> SUICIDAN: SUSAN: I JUST WANTED TO HEA R A LITTLE BIT MORE FROM TERESA AND EQUITY, AND HEAR HER PERSPECTIVE ON THAT A BIT MORE. >> THANKS. SO I PROVIDED AN UPDATE ON LEGISLATION IT WAS RELATED TO SCIENCE FOUNDATION, AND HAS SINCE BEEN EXPANDED TO INCLUDE SCIENCE PROVISIONS, INCLUDED SOME RELATED TO EQUITY, IN TERMS OF FUNDING, FOR EXAMPLE, HISTORICALLY, BLACK COLLEGES AND UNIVERSITIES. ALL OF THAT, THOUGH, FALLS UNDER THE NSF PROVISIONS. AND IN ADDITION TO THAT, I MENTIONED THE DISCUSSION DRAFT OF THE 2.0 ACT. AGAIN, THIS IS JUST A DISCUSSION DRAFT. NOTHING'S BEEN INTRODUCED ON EITHER THE HOUSEER THE SENATE SIDE. WAS THERE ANYTHING ELSE YOU HAD A QUESTION ON? DIMENSION THE ADMINISTRATION'S PRIORITIES FOR RESEARCH DEVELOPMENT, FOR 2023, WHICH INCLUDED EQUITY. >> THANK YOU FOR HIGHLIGHTING. I APPRECIATE IT. >> AND PAUL, YOU HAVE A QUESTION. >> PAUL: THANK YOU SO MUCH AND THANK YOU, PATTY, FOR THE PRESENTATION. I WAS WONDERING IF YOU HAD ANY INFORMATION ABOUT THE RFITHAT CAME OUT EARLIER THIS MONTH FOR USER EXPERIENCE FOR SCIENTIFIC DATA SOURCES AND TOOLS AND HOW THAT MIGHT FIT IN TO SOME OF THE WORK THAT'S GOING ON AT NLM AND NIH MORE BROADLY. THE LIST OF TOOLS TO PROVIDE FEEDBACK ON WAS QUITE DIVERSE AND NOT COMPLETELY INCLUSIVE. SO I WAS WONDERING IF YOU COULD SPEAK TO THAT A LITTLE BIT. >> TYRESE A I MIGHT ASK TO YOU WEIGH IN ON THIS ONE. I BELIEVE THIS WAS FROM THE OFFICE OF SCIENCE POLICY. AND TO BE VERY HONEST, FALL, HAVE I TO CONFESS TO NOT KNOWING VERY MUCH ABOUT IT. MY FOCUS THIS SUMMER HAS BEEN ON DATA SHARING AND ISSUES RELATED TO UNINTENDED IDENTIFICATION OF PARTICIPANTS THROUGH LEGITIMATE ACCESS TO CONTROLLED ACCESS DATA RESOURCES SO I'M NOT UP ON THIS ONE. TYRESE A ARE YOU FAMILIAR WITH IT? >> NO, I'M AFRAID NOT, BUT I CAN LOOK INTO IT AND FOLLOW UP LATER. >> IF YOU WOULD KINDLY SEND KNEE THE LINK, GNAW HAVE, FALL, I'LL FIND SOME MORE DETAIL FOR YOU. >> ALSO O. THANK YOU SO MUCH. >> WE HAVE A COUPLE MINUTES, DO WE HAVE ANY OTHER COMMENTS FOR PATTY, TERESA OR ANYONE ELSE ON THE NLM STAFF? I THINK A QUARTER FAST THE HOUR WANT SO JUST A COUPLE OF MINUTES FROM NOW WE WILL BE MOVING INTO OUR WORKING GROUP BREAK OUT SESSIONS. MEMBERS OF THE BOARD AND STAFF, KNOW WHAT YOUR ASSIGNMENTS ARE, I ASSUME. WE WILL BE MEETING THERE FOR THE NEXT HOUR, FROM 11 TIME TILE 15 TO 12:15 AND THEN THERE WILL BE A BREAK FROM 12:15 TO 12:30. DURING THIS TIME, RECORDINGS WILL BE STOPPED. BUT OUR TEAM WILL LEAVE THE BREAKOUT ROOMS OPEN FOR INFORMAL DISCUSSIONS. FOLLOWING THIS BREAK, ALL PARTICIPANTS WILL BE BROUGHT BACK INTO OUR MAIN SESSION. AND PLEASE BE SURE TO RETURN TO THE BEGIN BEING OF OUR AFTERNOON SESSION AT 12:30. >> DO WE HAVE A REPORT FROM STRAY JECTORY TEEMINGIC PLANNING? >> YES, THAT'S ME, NEAL. SO WE HAD AN EXCELLENT PRESENTATION ON THE NLM EFFORT UNDERWAY TO GATHER EVIDENCE. BOTH IN SUPPORT OF THE STRATEGIC PLAN AND TO COMPLY WITH VARIOUS NIH INFORMATION GATHERING. WE'VE SEEN THIS TOOL PREVIOUSLY SO I WILL NOT GO INTO A LOT OF DETAIL ABOUT THE TOOL ITSELF BUT TALK MORE ABOUT HOW IT'S BEING USED. AND HISTORICALLY WITHIN NLM, FACILITY VS DONE THEIR OWN DATA GATHERING WHICH IS FINE AND AN EFFORT TO BUILD THEIR EFFORTS BUT IT MAKINGS IT DIFFICULT TO COMPARE ACROSS DIVISIONS AND TO GET AN NLM WIDE PERSPECTIVE ON THE DATA THAT'S BEING GATHERED AND EVENOT WORK THAT'S BEING DONE AND THE WORK THAT'S BEING USED. SO IN PARTICULAR THERE IS A THING CALLED THE EVIDENCE ACT WHICH APPLIES TO FEDERAL AGENCIES. AND ALL AGENCIES ARE REQUIRED TO REPORT THEIR EVIDENCE BUILDING ACTIVITIES IN OTHER WORDS, SHOW HOW THEY KNOW THEY'RE MAKING THE RIGHT DECISION--AND 2 OF THE OSI STAFF ARE ON THAT COMMITTEE. THEY'RE BOTH TAKING NLM WACKER WHICH MANY TIMES HAS BECOME AN EXAMPLE FOR OTHER AGENCIES, TAKING THAT TO THE LARGER GROUP BUT ALSO BRINGING BACK INFORMATION ON WHAT THOSE AGENCIES USED AND WHAT THEIR BEST PRACTICES CAN BE AND HOW THOSE CAN BE USED AT NLM. BUT THE CHIEF INTERNAL REASON FOR NLM DATA GATHERING IS TO KNOW WHAT IT DOES, WHAT RESIEWRSS --RESOURCES IT IS USING AND WHO IT IS WORKING WITH. AND OBVIOUSLY YOU DO THIS TO MAXIMIZE THE EFFICIENCY OF YOUR RESOURCED USE, MAKE SURE THAT YOU'RE IN TUNE WITH YOUR STRATEGIC PLAN AND OVERALL DIRECTION. FOR EXAMPLE, WITH COVID-19, THESE TOOLS WERE PUT INTO PLACE TO TRACK NLM'S COVID-19 PORTFOLIO, SO WHEN A REQUEST COMES WHAT IS NLM DOING TOWARDS THE PANDEMIC? NLM CAN PULL UP EVERYTHING AND NOT ONLY HAVE AN ANSWER TO WHAT IT'S DOING AND WHO IT'S WORKING WITH AND WHAT RESOURCE IT'S USING BUT HOW THOSE PARTICULAR ACTIVITIES ARE IN FACT IN ALIGNMENT WITH NLM'S STRATEGIC PLAN WITH THE NIH STRATEGIC PLAN PARTICULARLY AROUND PLANS FOR NIH AND COVID ACTIVITIES. THERE ARE ALSO ADDITIONAL REPORTS SUCH AS GATHERING AROUND INTERMURAL RESEARCH AND THE EFFORT SPECIFICALLY GEARED TO STRATEGIC PLAN IMPLEMENTATION. ORIGINALLY WHEN OUR EARLIER PRESENTATIONS, WE'VE SEEN ON THIS NLM WAS TRACKING AT A VERY HIGH LEVEL. GENERALLY WHAT WAS BEING DONE, WHAT PROGRESS WAS BEING MADE AND NOW IT'S BORING DOWN INTO THE DETAILS. SOME OF THE REPORTING AT THIS POINT IS ANECDOTAL BUT IT'S FORMING THE BASIS, GIVING A PICTURE WHAT HAVE'S GOING ON, WHERE THERE ARE SYNERGYS, WHERE PEOPLE ARE WORKING TOGETHER, WHERE THERE ARE OVERLAPS AND PROVIDING INFORMATION FOR DECISION MAKING IN THAT WAY, EVEN THOUGH THE INFORMATION IN ALL CASES AND FOR ALL QUESTIONS IS NOT COMPREHENSIVE AND THERE WILL BE FURTHER MAPPING GOING ON AND CONTINUALLY UPDATING THE DATA. THERE IS A STRATEGIC PLAN IMPLEMENTATION COUNCIL AND AN EVALUATION COORDINATING COMMITTEE THAT ARE USING THIS DATA. AND AS I SAID EARLIER IT'S GREAT DATA TO HAVE WHEN AN NIH OR SOMEONE ELSE ASKS A QUESTION, IT'S SPECIFICALLY FOR THE EVALUATION COMMITTEE, INVENTORY OF EVALUATIONS AND INFORMATION ON WHO KNOWS HOW TO USE WHAT TOOLS OR HAS USED WHICH TOOLS. IT'S ALSO A RESOURCE FOR TRACKING WHO NLM WORKS WITH AND COLLABORATES WITH BOTH WITHIN THE FEDERAL GOVERNMENT AND OUTSIDE PARTNERS SUCH AS THE MEDICAL LIBRARY ASSOCIATION AND AMEA. SO THIS WILL BE AN ONGOING AND INCREASING EFFORT. THERE IS AS ALWAYS, AS WE ALL KNOW FROM OUR OWN WORKPLACES, EVERYBODY WANTS TO DO THEIR JOB AND NOBODY WANTS TO SPEND TIME REPORTING ON THEIR JOB. I EVEN USED AN EXAMPLE OF MYSELF, I WANTED DATA WHEN I WAS A MANAGER, I WANTED REPORTS FROM PEOPLE WHO WORK FOR ME, BUT I REALLY DIDN'T WANT TO HAVE TO DO THOSE REPORTS THAT MY BOSS WANTED FROM ME ON WHAT EVERYBODY WAS DOING. SO IT'S JUST HUMAN NATURE. WE HAD SOME DISCUSSION IN THE GROUP ABOUT DIFFERENT WAYS OF GETTING ACCEPTANCE AND BUY-IN MORE WIDELY. MIKE DID SAY THAT THEY WERE SEEING--BEGINNING TO SEE SOME TREND IN THAT DIRECTION BUT NOT AS MUCH AS THEY WOULD LIKE TO SEE INSTITUTION WIDE, NOT THE OPTIMUM AMOUNT YET AND SO WE TALKED ABOUT THAT, A LITTLE BIT ABOUT HOW SHOWING THE BENEFIT OF GATHERING THIS DATA, HOW USING COMMON SYSTEMS ACROSS DIVISIONS, HOW HAVING A GOAL, A VISION OF 1 NLM WORKING IN THE SAME DIRECTION RATHER THAN A SILOED PICTURE OF NLM IS BENEFICIAL TO THE ORGANIZATION AND WHAT BENEFITS THE ORGANIZATION COMES BACK TO BENEFIT INDIVIDUALS AND INDIVIDUAL DIVISIONS. WE DISCUSSED A LITTLE BIT THE IDEA OF SHOWING REWARDS FOR EVERYONE AND I THINK THAT--YES, AND OUR FINAL EXIT LINE FROM HEIDI WAS IT'S ALWAYS A CHALLENGE TO BALANCE DOING THE WORK AND GETTING THE INFORMATION AND THE REPORTS THAT SUPPORTS DOING THE WORK. SO ANY QUESTIONS? >> ANYBODY ELSE FROM THE WORKING GROUP OR ANY QUESTIONS FROM THE BOARD FOR JANE AND OTHER MEMBERS OF THE GROUP? LOOKS LIKE JOEL FRANCIS HAS A QUESTION. >> YES, THANK YOU FOR LETTING ME JOIN LATE, AND WHO THOUGHT A MEDICAL APPOINTMENT FOR AN HOUR WOULD LAST INTO NOON. THE ANAL OF COVID. I ADDED TO THE CHAT STREAM AN ARTICLE THAT CAUGHT MY ATTENTION A WEEK AGO IN ACADEMIA ABOUT THE NC3 OR N3 C COLLABORATIVE FOR COVID DATA SHARING. AND IT'S AN IMPRESSIVE WORK. I DIDN'T KNOW WHETHER THERE WAS ANY ENGAGEMENT FROM NLM OR THE LISTER HILL CENTER IN THIS, BUT IT STRIKES ME THAT YOU KNOW EVEN CREATING INFRASTRUCTURE LIKE THIS, THE WORK IN CREATING DATA MODELS THAT ALLOW FOR AGGREGATION OF RELEVANT FINDINGS ACROSS DIFFERENT ELECTRONIC HEALTH RECORD SYSTEMS WHICH IS WHAT THIS ARTICLE IS ALL ABOUT IS REALLY KEY AND FOUNDATIONAL TO EVIDENCE IN HEALTHCARE. I LEAVE THIS OUT THERE, IT MAY HAVE BEEN A COMLITELY DISCONNECTED EFFORT INVOLVING OTHER INSTITUTES BUT I THINK THAT IT IS AS IMPORTANT AS PUBMED IN TERMS OF SUPPORTING THE EVIDENCE GATHERING FOR THIS PANDEMIC. OVER. >> MIKE, I CAN SPEAK TO THAT IF YOU WANT. >> GO AHEAD, SO WE'RE CLOSELY WORKING WITH N3 C FOR A NUMBER OF DIFFERENT ARENAS, AND N3 C IS SPECIFICALLY DESIGNED TO EXTRACT CLINICAL INFORMATION, WHAT THEY CALL LIMITED CLINICAL DATA SET FROM ELECTRONIC HEALTH RECORDS, THEY HAVE A SAMPLING STRATEGY THAT BEGINS WITH AN INSTITUTION ADENTIFYING A PERSON WHO HAS DIAGNOSIS OF COVID, AND AS WE KNOW THAT'S A CHALLENGE IN ITSELF AND THEN THEY EXTRACT THAT PERSON'S DATA AND THEN 2, WHAT WE CONSIDER MATCH CONTROLS. SO THEY'RE BUILDING UP A REPOSITORY THAT'S GOT ABOUT A 30% POSITIVE COVID PROFILE IN IT. THE REPOSITORY HAS--SORRY LIMITED DATA PULL IS REQUIRED BECAUSE THEY'RE NOT GETTING INDIVIDUAL PATIENT CONSENT SO THE INFORMATION IS BEING EXTRACTED AND VERY, VERY TIGHTLY HELD. IT'S BEING HELD ON A VOLUNTEER PLATFORM AND DATA--USE THE PLATFORM TO GO TO THE PLATFORM TO USE. WE WORK WIDE THEM ON A NUMBER OF THINGS. THEY'VE DONE AN AMAZING JOB AT HARMONIZATION OF THE DATA. THEY HAVE A WELL-ESTABLISHED AND WELL VALIDATED PIPELINE FOR DATA HARMONIZATION, THEY'VE BEEN ENGAGING RESEARCHERS. SOME PAPERS ARE STARTING TO COME OUT FROM THIS--FROM THE DATA ON THE PLATFORM AND THAT'S VERY EXCITING IN PARTICULAR, THERE'S A VERY NICE THAT'S DUE TO BE OUT IN JAMMA ABOUT RURAL URBAN DIFFERENCES AND NOT ONLY THE EXPOSURE TO COVID BUT THE ACCESS TO SERVICES IN THE WAY PATIENTS ARE TREATED. IT REMAINS TO BE SEEN HOW SCALABLE THIS IS, IT'S ENORMOUSLY DIFFICULT TO PRESENT, WHY DOES THIS GO? HOW DO WE LEVERAGE IT? HOW DOES IT DO WHAT WE NEED IT TO DE. THE PRIMARY CONCERN HAS TO DO WITH DATA LINKAGES, 1 THE CHALLENGES WITH COVID IS MAKING SURE ABOUT ALL THE INFORMATION ABOUT A PERSON GETS PUT WITH THAT PERSON REGARDLESS OF WHERE THEY COME FROM. AND SINCE WE LACK A NATIONAL MEDICAL IDENTIFIER THERE ARE FEW WAYS TO DO HA AND WE'VE TRIED TO TAKE SOMETHING REFERRED TO AS PPRO, PRIVACY PRESERVING RECORD LINKAGES AND BECAUSE OF MY NIH LEVEL RESPONSIBILITIES WE ARE OVERSEEING THIS EFFORT AND LOOKING AT IT WITH A GREAT DEAL OF INTEREST. SO IT IS A TERRIFIC ARTICLE FOR ANYONE WHO HAS SUBMITTED IT. IT DESCRIBES AS OPERATION THAT'S QUITE IMPRESSIVE. THANK YOU. >> THANKY SO MUCH PATTY. I WOULD LOVE TO HEAR NOR ABOUT THIS AT A FUTURE BOR MEETING. >> I'M SURE WE WILL BE DISCUSSING IT. >> ANY OTHER QUESTIONS FOR THE STRATEGIC PLANNING GROUP OR OTHER COMMENTS? --THE CURRENT STATISTICS ON KIVERSITY IN THE TRAINING PROGRAMS AT VARIOUS LEVELS OF THE TRAINING PROGRAMS AND IN--SHOWED US THAT ALTHOUGH NOT AS DIFFICULT AS SOME THEY HAVE SUBSTANTIAL CHALLENGES IN ACHIEVING PREPONDERANCE AT ALL LEVELS AS WELL UNLESS WOMEN ARE SPECIFICALLY TARGETED. AND PROPOSALS, NAY HAVE NEW PROGRAMS THAT THEY'RE WORKING ON THAT THEY ASKED US TO HELP THEM TO THINK ABOUT AND ALSO TO THINK ABOUT MORE BROADLY HOW MIGHT THEY ADDRESS THESE CHALLENGES AND DIVERSITY EQUITY AND INCLOWGZ THAT ARE ALL OVER SIGNS, ALL OVER MEDICINE AS WELL. SO A NUMBER OF ISSUES CAME UP THAT ARE--WE DISCUSSED. SO 1 OF THE FIRST QUESTIONS WAS DO THEY HAVE A PROBLEM THEY SHOULD ADDRESS THROUGH TRYING TO CREATE TRAINING PROGRAMS THAT ARE MORE DIVERSE AND WE SAID ABSOLUTELY, THAT YOU PROBABLY MUST TRUST IN TERMS OF GENDER AND IN TERMS OF RACE ETHNICITY. IT SOUNDS LIKE THE PROBLEM IS EVEN MORE SEVERE FOR AFRICAN AMERICAN TRAINEES AND SO REALLY DOES NEED TO BE ADDRESSED ACTIVELY AND WE TALKED ABOUT SOME OF THE FRAMINGS, SO SOME OF THE COMMUNICATIONS TALK ABOUT HARASSMENT FREE WORKPLACE AND WE THOUGHT THAT THAT WAS SENDING A SIGNAL THAT THAT WAS SUCCESS WHEREAS THE FRAMING OUGHT TO BE THAT WE SUPPORT DIVERSITY EEQUITY AND INCLUSION NOT JUST BECAUSE IT'S THE RIGHT THING TO DO SOCIALLY OR TO MAKE UP FOR PAST SINS BUT BECAUSE IT MAKES US STRONGER. I WILL TURN THOSE INTO POSITIVE MESSAGES ABOUT IMPORTANCE OF TAPPING INTO CREATIVITY AND ALTERNATIVE VIEW POINTS AND IN ORDER TO COME UP WITH MORE EFFECTIVE SOLUTIONS FOR THE POPULATION. WE TALKED ABOUT HOW IMPORTANT IT IS TO DO THAT NOT JUST FROM A HIGH LEVEL IN TERMS OF POLICIES, BUT ALSO ON THE GROUND AS WELL. SO BOOTS ON THE GROUND, THINKING ABOUT HOW THAT GETS IMPLEMENTED ON A REGULAR BASIS AND THEN HOW EDUCATION, DEEPER KIND OF EDUCATION OF LEADERSHIP, NOT JUST OF THE TRAINEES IN THESE ISSUES CAN ALSO BE HELPFUL AND HAS BEEN AT SOME OF OUR INSTITUTIONS AND THERE ARE EXAMPLES OF KINDS OF EDUCATION, NOT JUST A 1 TIME SEMINAR ON RACISM IN AMERICA, BUT YOU KNOW BOOK CLUBS THAT GO ON FOR WEEKS AND MONTHS AND HAVE MORE ONGOING AND DEEP AND DIFFICULT CONVERSATIONS. WE THEN HAD A DISCUSSION ABOUT WHAT MIGHT WORK IN TERMS OF ENCOURAGING MORE DIVERSITY. ONE ISSUE WAS JUST IF YOU FOCUS ON PROGRAMS THAT DRAW INTEREST FROM DIVERSE CANDIDATES YOU'RE MORE LIKELY TO GAIN. SO FOCUSING ON HEALTH EQUITY IS A REALLY GREAT WAY TO INCREASE ENTHUSIASM FOR UNDER REPRESENTED FOLKS TO COME AND JOIN THE EFFORT. THE TRAJECTORIES ARE SET WAY BACK IN JUNIOR HIGH SCHOOL BUT IT'S UNLIKELY YOU WILL TAP AN MIDDLE SCHOOL KID FOR THEM TO BECOME AN NLM RESEARCHER 20 YEARS LATER BUT THERE'S A LOT OF COMMONALITY AND THE GOALS OF NLM AND NIH AND OTHER ORGANIZATIONS THAT ALSO NEED THIS PIPELINE TO BE ENRICHED. SO IS THERE A WAY THAT 1 COULD LOOK AT THE COMMONALITIES AND GOALS AND PARTNER WITH THESE OTHER ORGANIZATIONS TO FARTHER UP STREAM WHERE IT'S APPROPRIATE AND PIGGYBACK ON EXISTING PROGRAMS AND THE ANSWER WAS THAT YES, THERE APPARENTLY ARE A NUMBER OF DIFFERENT PROGRAMS UP THERE THAT MAY REPRESENT OPPORTUNITIES AND THIS HAS EXPERIENCE, NIGMS HAS EXPERIENCE AND THE CEPA PROGRAM WAS AN EXAMPLE OF 1 IN THAT SPACE. SO IS THAT A WAY TO CREATE, COMBINE WITH OTHERS TO CREATE A BIG FUNNEL AT THE END AND THEN PEOPLE OF COURSE ARE GOING TO ALL KINDS OF STEM-RELATED OR COMPUTATIONALLY RELATED PROGRAMMING RELATED FUTURES BUT YOU KNOW YOU START TO INFLUENCE WHAT'S HAPPENING AT THE TOP. AND THEN WE HAD A DISCUSSION ABOUT ACCOUNTABILITY AND MAKING GOALS RELATED TO THE TRAINING PROGRAMS BROADLY BUT ALSO DOWN TO INDIVIDUALS ACCOUNTABILITY RELATED TO ACHIEVEMENTS AND DIVERSITY EQUITY AND INCLUSION HAS PART OF THE ASSESSMENT OF INDIVIDUALS. SO YOU KNOW I I'M SURE I LEFT OUT A BUNCH OF IMPORTANT THINGS AND SOME MAYBE THEY SHOULDN'T HAVE SO I WILL ASK IF OTHERS IN MY COMMITTEE WANT TO FILL IN THE GAPS AND CORRECT ME. SO BRENT? >> YEAH, I WAS GOING TO PROJECTION NEURONS OR PIONS ON, I THINK YOU DID A GREAT JOB, THE ONLY THING I WOULD ADD TO THE CONVERSATION IS FROM NS PERSPECTIVE I OFFER TO LINK RICHARD AND VALENTINEDRY TO NSF THAT ARE DOING THE DIVERSITY INCLUSION THINGS AS FAR AS HOW WE MARTENER WITH ASSOCIATES THAT REPRESENT FOLKS AND GET STUDENTS IN AS INTERNS OR GET INFORMATION OUT TO THE COMMUNITIES. ALSO ON THE EVALUATION SIDE, I OFFERED TO MAKE CONNECTIONS THERE AS FAR AS FOLKS THAT ARE DOING THE EVALUATION WORK WITH RESPECT TO THE DIVERSITY EQUITY INCLUSIONS WORK AT NSF. >> GOOD. ANY OTHER QUESTIONS I CAN ANSWER. >> CLAYTON THIS IS SUE, I WAS GOING TO PIPE IN AS WELL AND WHEN WE TALK ABOUT PARTNERSHIPS WITH THE 1S MENTIONED BUT WE ALSO SPECIFICALLY TALKED A BIT ABOUT PROFESSIONAL ORGANIZATION PARTNERSHIPS FOR EXAMPLE, [INDISCERNIBLE] HAS THE HIGH SCHOOL SCHOLARS PROGRAM AND WOULD THERE BE A WAY THAT WOULD BE 1 EXAMPLE FOR PEOPLE WHO ARE MORE PUBLIC HEALTH OR CLINICALLY ORIENTED AND TO THINK ABOUT HOW THAT COULD BE CO BRANDED WITH NLM AND I WOULD THINK FOR OTHER MAIN AREAS REPRESENTED IN THE NLM MISSION THAT WOULD BE OTHER IMPORTANT PROFESSIONAL ASSOCIATIONS SINCE THERE'S TREMENDOUS EFFORTS GOING ON THERE AND WOULD THAT BE AN EFFICIENT WAY THROUGH COLLABORATION AND CO BRANDING RATHER THAN HAVING A MECHANISM BE DEPENDENT UPON THE T15 GRANT PROGRAM? >> GREAT. >> THANKS, SUE. ANY OTHER QUESTIONS FOR CLAY OR THE GROUP? HANK YOU FOR THAT REPORT. MOVING ON TO THE PUBLIC SERVICE WORKING GROUP. DO WE HAVE A REPORT FROM 1 OF YOU? >> THANK YOU NEIL, CAN I SHARE MY SCREEN? ARE YOU ABLE TO SEE MY SCREEN. OKAY, THANK YOU. SO I'M PLEASED TO REPORT ON THE PUBLIC SERVICE WORKING GROUP AND THE WORK THAT WE'VE BEEN FOCUSED ON ON CLINICALTRIALS.GOV. FIRST OF ALL HERE IS THE LIST OF OUR CURRENT BOARD MEMBERS INCLUDING WE WELCOME 2 NEW BOARD MEMBERS. AND IN ADDITION TO THAT, I AM PLEASED TO TELL YOU THAT ALL OF OUR BOARD MEMBERS HAVE RECOMMITTED TO STAYING ON BOARD THROUGH SEPTEMBER OF 2022 WHICH IS REALLY GREAT FOR THE CONTINUITY OF THIS EFFORT. WE HAD SEVERAL DISCUSSIONS AND I WANT TO POINT OUT THAT WE PRODUCED A REPORT WHICH YOU SHOULD HAVE RECEIVED AND SO IT SHOULD BE IN YOUR PACKET AND IT'S OUR SUMMARY REPORT THAT SUMMARIZES THE PROGRESS OF THE CLINICALTRIALS.GOV MODERNIZATION EFFORT. AND SOME OF THE HIGHLIGHTS ON THAT, I WILL GO THROUGH JUST A COUPLE OF ITEMS BUT I WANTED TO LET YOU KNOW THAT WE'VE BEEN TOLD THERE WILL BE SHARING THE REPORT WITH THE NIH LEADERSHIP. IT'S ALSO GOING TO BE POSTED ON THE BOARD OF REGENTS WEBSITE. AND THERE'S A POSSIBILITY THAT WILL BE ALSO PRODUCING A BRIEF PUBLICATION, EXCUSE ME, TO FURTHER DISSEMINATE THE INFORMATION. DURING OUR MEETING TODAY WE ALSO HAD A GREAT PRESENTATION FROM JIM [INDISCERNIBLE] TO MOVING TO NEW LIBRARY SERVICES AND DISCOVERING PLATFORM FROM VOYAGER TO ALMA AND 1 OF THE KEY THINGS WHICH SUMMARIZES IT ALL, IT WAS THE CLEANEST DATA MIGRATION THAT HAD BEEN EXPERIENCED AND SO I THINK THAT THAT TELLS A LOT ABOUT THE WORK THAT'S BEING DONE WITH THIS GROUP. IN TERMS OF MODERNIZATION, I WANT TO REMIND EVERYBODY THAT CLINICALTRIALS.GOV IS THE WORLD'S LARGEST REGISTRY OR DATABASE ON CLINICAL STUDY. AND THAT WE RELY ON INVESTIGATORS TO POPULATE THAT DATABASE AND THEREFORE WE'RE NOT NECESSARILY A GOVERNMENT KAWLT CONTROL DATABASE BUT 1 THAT REALLY PROVIDES THE INFORMATION TO EVERYTHING. THERE'S BEEN A TREMENDOUS AMOUNT OF WORK THAT'S HAPPENED BEHIND THE SCENES BY THE WORKING GROUP IN THE LAST 2 YEARS AND WE'VE ALSO RECEIVED EXTENSIVE INPUT NOT JUST FROM OUR WORKING GROUP MEMBERS BUT ALSO FROM OUR DIVERSE STAKEHOLDERS. WE'VE ADDRESSED SEVERAL CHALLENGES AND DISCUSSED SOME OF THAT, AS WELL AS SOME OF THE DIVERSE COMMUNITY NEEDS AND I WILL GO INTO IT IN A MOMENT. AND ALSO OUR BETA RELEASES, SO THOSE ARE GOING TO BE FORTH COMING AND WILL BE THE MECHANISMS BY WHICH WE INTRODUCE NEW TECHNOLOGIES. SO, THE KEY FINDINGS FROM OUR WORKING GROUP HAVE BEEN REALLY THE IMPORTANCE OF NLM'S ROLE AS A CENTRAL DATA AGGREGATOR, THE NEED TO SERVE ALL THE PRIMARY STAKEHOLDERS WHILE AT THE SAME TIME CLARIFYING WHERE NLM CAN EITHER DIRECTLY OR INDIRECTLY MEET OUR USERS NEEDS. AND ALSO, MANAGE USER EXPECTATIONS BY CLEARLY COMMUNICATING OUR SITE PURPOSES AND LIMITATIONS AND I WANT TO POINT OUT THAT YOU KNOW 1 OF THE DISCUSSIONS WE HAD IS ALSO THE DIVERSITY OF THE STAKEHOLDERS WHERE WE HAVE ANYWHERE FROM PATIENTS AND ADVOCATES TO DATA RESEARCHERS THAT ARE ACCESSING THE DATA AS WELL AS POLICY AND INFORMATION SPECIALISTS SO FOR THIS REASON WE HAD TO RECEIVE INPUT FROM MANY, MANY DIFFERENT DATA SOURCES AND PERSONS AND STAKEHOLDERS IN ORDER TO REALLY BE ABLE TO UNDERSTAND WHAT WERE THE NEEDS AND WHAT WERE THE CHALLENGES AND REALLY PRODUCE THE BEST ACTIVITIES AND OUTPUTS THAT WOULD NEED THE EXPECTED OUTCOMES. HERE'S A PRESENTATION OF OUR MODERNIZATION ROADMAP AND AS YOU CAN SEE THE FIRST PHASE WAS ON REQUESTING INFORMATION AND NOW WE'VE REALLY EMBARKED ON THIS MODERNIZATION EFFORT AND THEN WE WILL BE MOVING FORWARD TO THIS NEW BATTA SYSTEM AND PLATFORM DEVELOPMENT, AND SO, THE IMPORTANT THING ABOUT THIS IS THAT THERE'S GOING TO BE A LAUNCH COMING UP WITH SOME BETA TESTING IN THE FALL AND IT WILL BE AVAILABLE IN PARALLEL TO THE CURRENT SITE SO WE'RE NOT GOING TO MOVE IMMEDIATELY INTO A WHOLE NEW SYSTEM, BUT IT WILL BE AVAILABLE BOTH THE OLD SITE AND THE NEW SITE AT THE SAME TIME. AS WE LEARN MORE ABOUT WHAT THE NEEDS ARE, AND THEN EVENTUALLY WE'LL MIGRATE INTO THIS NEW SITE. WE ALSO DISCUSSED METRICS AND EVALUATION, CALLED COLLECTION OF BOTH QUALITATIVE AND QUANTITATIVE METRICS FOR ASSESSING THE MODERNIZATION EFFORT AND DISCUSS PASSIVE EVALUATION WHICH ARE LIKE THE SITE WEBSITE TOOLS, ANALYTICS AND THOSE ARE THE THINGS THAT PEOPLE CAN GIVE A THUMBS UP OR THUMBS DOWN SOME CURRENT AND WORKING GROUP TOPICS THAT CONTINUE ON THE METRICS AS WELL AS THAT OUTREACH TO STAKEHOLDERS CATERING TO USERS AND A COMMENT THAT WAS RAISED IS HOW WE CONTINUE TO LOOK INTO LITERACY AND NUMERACY AND WE DISCUSSED THE POSSIBILITY THAT WE MAY HAVE TO HAVE DIFFERENT KINDS OF RECORDS AVAILABLE FOR PEOPLE TO VIEW BASED ON THESE CHARACTER IEOF THETICS. ALSO OUTREACH TO EDUCATIONAL GROUPS, TAKING INTO ACCOUNT INDIVIDUALS WITH DISABILITIES. ALSO REALLY IMPORTANT. AS WE MOVE FORWARD, WE'RE REALLY LOOKING INTO THE USE OF MOBILE DEVICES AND HOW THOSE MOBILE DEVICES CAN--FOR EXAMPLE ACCESSING SOME OF THESE SERVICES RIGHT FROM YOUR CELL PHONE MIGHT BE REALLY, REALLY CRITICAL. AND THEN WE DISCUSS ALSO ISSUES RELATED TO CLOUD SECURITY AND RESILIENCY ON THE CLOUD AND SOME OF THE PRIVACY ISSUES RELATED TO THAT. SO THAT'S IN A NUT SHELL AND I INVITE ANY--I WILL STOP SHARING AND I INVITE ANY OF OUR OTHER MEMBERS TO PLEASE ADD OR COMMENT. >> THIS WAS OUR FIRST THIS PROJECT REPRESENTS OUR 50 PARTNERSHIP WITH NIH IN A SYSTEMATIC WEIGH TO SAY WE HAVE A RESOURCE, YOU GUYS YOU NEED THIS NOT JUST FOR GLOBAL SCIENTIFIC DEVELOPMENT BUT IT HELPS THE NIH MEET STATORY REQUIREMENTS THAT THE FDA HAD CREATED AND BY THE WAY IT WILL TAKE A WHILE AND BE EXPENSIVE TO DO THE DEVELOPMENT AND I THINK THERE A LITTLE SKEPTICISM THROUGHOUT THE BEGINNING BUT THROUGHOUT THE YEARS NOW, WE JUST COMPLETED OUR THIRD YEAR, BECKY AND HER TEAM HAVE CONS CYSTENTLY OVERDELIVERRED IN TERMS OF COMMUNITY ENGAGEMENT AND UNDERSTANDING WHAT THE NEEDS ARE IN TERMS OF DEMONSTRATING A SYSTEMATIC PROCESS SO THE TECH IN IICAL PLATFORM AND THE YOU HAD MANY INN GAUGEMENT PLATFORM ARE PROCEEDING IN PARALLEL AN EFFECTIVE WAY AND WE'VE JUST PASSED OUR THIRD REVIEW, BY THE WAY FOR THE PEOPLE WHO WERE IN THE DISCUSSION ON CIMRKS R, THIS IS THE SIMILAR PARTNERSHIP WITH CGR WHERE NIH ARE WRITING THE CHECKS AND SO WE'RE ACCOUNTABLE TO WHAT WE'RE DOING AND WE HAVE TO RENEW IT EVERY YEAR BECAUSE WE'RE ON AN ANNUAL BUDGET BUT THIS LAID THE GROUND FOOTWORK FOR NOT ONLY NLM'S PARTICIPATION BUT THE WORK THIS TEAM IS DOING IS BECOMING A MODEL FOR A LOT OF CAPITAL INVESTMENTS THAT ARE HAPPENING NOW AT N. I.T. AND THE NIH AND I COMMENT THE TEAM FOR THIS. AND WE COULD NOT DO THIS WITHOUT THE OVERSIGHT OF THE BOARD OF REGENTS BECAUSE THIS COMMITTEE HERE OR THE COMMITTEE THAT HAS BEEN EMPANELLED TO OVERSEE THE GENOMIC RESOURCE GIVES US THE STRATEGY FOR PUBLIC ENGAGEMENT AND ASSURANCE BY THE NIH THAT WE'RE LISTENING TO OUR STAKEHOLDERS THAT WE COULD NOT DO OTHERWISE SO I'M GRATEFUL FOR THIS WORK. >> THANK YOU P A TTI AND LOURDES AND BECKY AND THE ENTIRE GROUP. ANY QUESTIONS OR OTHER COMMENTS? WELL, THANK YOU AGAIN. WE'RE RUNNING WAY AHEAD OF SCHEDULE SO I GUESS I CAN GIVE ALL THE REMAINING TIME TO OUR COLLECTIONS WORKING GROUP. AND I DON'T KNOW WHO WE HAVE EVEN THOUGH I WAS IN THAT GROUP, I DON'T KNOW WHO IS ACTUALLY GOING TO BE REPORTING ON IT BUT PERHAPS DIANE? >> YEAH, THANK YOU NEIL. I WILL GO AHEAD AND PRESENT FOR THE WORKING GROUP. SO, ALL RIGHT. SO, WE HAD 3 PRESENTATIONS TODAY. ONE WAS MOSTLY AN UPDATE AND 2 ARE CONTINUATIONS OF THINKING ABOUT NLM DATA SETS AS PART OF OUR COLLECTIONS. SO THE FIRST PRESENTATION WE HAVE FROM DEAB RA[INDISCERNIBLE] WAS ON THE MED LINE 2022 INITIATIVE THAT WE'RE UNDERTAKING. SO FOR MANY OF YOU, YOU KNOW THAT INDEXING HAS PLAYED IN THE LONG STANDING HISTORY OF NLM--AT THE LAST MEETING, MEDLINE HIT THE 50th ANNIVERSARY SO WE'RE EXCITED ABOUT THAT. THAT BEING SAID EVERY YEAR THE AMOUNT OF CITATIONS THAT ARE IN THE MED LINE SUBSET INCREASES SO IT'S BECOMING UNSUSTAINABLE AT THIS RATE. SO WE'RE GOING TO CONTINUE TO APPLY MEDICAL SUBJECT HEADINGS, TO THE CITATIONS AND OUR OVER MILLION A YEAR MEDLINE CETACEANS THAT COME IN, WE WILL JUST SHIFT HOW WE DO IT TO AN AUTOMATED APPROACH AND THAT'S TAKING ADVANTAGE OF THE MEDICAL TEXT INDEXER AND THIS WAS A RESEARCH PROTOTYPE THAT WAS DEVELOPED IN OUR CENTER, SO WE'RE EXCITED TO PUT THIS INTO PRODUCTION. SO RIGHT NOW MEDLINE CITATIONS APPEAR IN PUBMED WHEN THE LITERATURE IS PUBLISHED THEY'RE SUBMITTED BY PUBLISHERS AND WE'VE BUILT UP A BIT OF A BACK LOG AND OUR INDEXING AND SO SOME CITATIONS ARE NOT INDEXED FOR ALMOST A YEAR. THE DIFFERENCE WITH THIS IS GOING TO BE THAT MESH WILL BE ADDED TO CITATIONS IN AS LITTLE AS 24 HOURS AND THIS IS SOMETHING THAT OUR USERS HAVE BEEN ASKING FOR. CAN YOU SPEED UP THE PRODUCTION CYCLE. SO, BY REMOVING THAL WILL ADD ADDITIONAL TIME TO OUR RESOURCES AND DATA POINTS AND HELP US TO INITIALLY IMPLEMENT THINGS SUCH AS CHEMICAL INDEXING AND GENE CURATION. AND FINALLY, WE'RE GOING TO WORK TOGETHER AS A UNIFIED TEAM TO TRAIN THE ALGORITHM ON NEW TERMINOLOGY WHEN IT COMES UP AND NOT UNDER ITS PERFORMANCE TO MAINAIN A MY QUALITY OUTPUT AND REINFORCE THE TRUST THAT WE'VE BUILT WITH THIS PRODUCT OVER THE YEARS. SO THERE'S A FEW STEPS THAT WE'RE UNDERTAKING TO GET THIS INTO A PRODUCTION CYCLE AND IT IS A CROSS-NLM EFFORT WITH THE LISTER HELL CENTER, LIBRARY OPERATIONS, OSIS, AND NCBI, AND WE'RE ALSO USING PRACTICE TO ALLOW US TO DEVELOPMENT, INTEGRATE AND TEST ELMETROPOLITANS AS WE NEED TO FULLY AUTOMATE MEDLINE AND WE'RE STARTING TO THINK ABOUT HOW TO APPLY THE CURATION TO CHEMICAL AND GENE INFORMATION, CONSOLIDATE OUR INDEXING AND MAINTENANCE COMPONENTS AND AUTOMATE DATA REVIEW. WE'VE ALSO ENGAGED, KRISTI I BELIEVE, BROUGHT UP HOW WE'RE WORKING THROUGH THE TRANSITION WITH OUR STAFF AND SO I'M HAPPY TO REPORT WE'VE ENGAGED IN A CHANGE MANAGEMENT, AND IN-PRODUCT MANAGEMENT CONSULTING GROUP TO HELP US NAVIGATE SOME OF THESE ISSUES AND TO BE MORE EFFECTIVE WITH THIS INITIATIVE. SO IT'S A WORK IN PROGRESS AND WE WILL BE PROVIDING MORE INFORMATION TO KEEP ALL OF OUR STAKEHOLDERS INFORMED. SO FOLLOWING THAT WE HAD A PRESENTATION ON NLM TERMINOLOGIES BY PATRICK Mc LAUGH LYNN AND NLM HAS BEEN INVOLVED IN TERMINOLOGY DEVELOPMENT GOING BACK TO THE 19th CENTURY WHEN THE INDEX CATAA LOG WAS PROVIDING SUBJECT HEADINGS. SO THERE'S A LONG HISTORY OF THIS. WE HAVE A COLLECTION OF TERMINOLOGY PRODUCTS AND SERVICES THAT ARE DEVELOPED AND MAINTAINED BY NLM. SO WE TALKED ABOUT MEDICAL SUBJECT HEADINGS, WITH OVER 30,000 HEADINGS, THE UNIFIED MEDICAL LANGUAGE SYSTEM, UMLS WITH OVER 220 TERMINOLOGIES, RX NORM WITH 13 TERMINOLOGIES INCORPORATED INTO THAT, AND SNOWMED CT WITH OVER 1.1 MILLION TERMS IN THERE. AND OVER 350,000 CONCEPTS SO EACH RESOURCE THAT WE CREATE OR MANAGE HAS SEVERAL ACCESS POINTS INCLUDING DOWNLOADABLE FILES, FILES, WEB BROWSERS AND APIs TO NAME A FEW. WE HAVE A UML S LICENSE WITH MAKES THE CONTENT FREELYY ACCESSIBLE TO OVER 24,000 LICENSEES AND WE HAVE AN ANNUAL REPORTING MECHANISM WHERE USERS CAN PROVIDE US FEEDBACK ON OUR RESOURCES AND WE CAN UNDERSTAND HOW THEY'RE ACTUALLY USING THE DAILY BASIS THEA AND IMPLEMENTING. SO WE HAVE A LOT OF IMPLEMENTATION OF OUR TERMINOLOGIES AND WITHIN NLM WE HAVE THE--YOU HEARD EARLY ABOUT THIS, THE VALUE AUTHORITY SENT TO VISA WHICH IS A TOOL FOR ACCESSING VALUE SETS OF TERMINOLOGY CONTENT, METAMAP WHICH IS A NATURAL LANGUAGE PROCESSING TIEWL FOR RECOGNIZING UMLS CONTEXT AND TEXTS, DAILY MED AND MEDLINE + CONNECT WHICH IS A WEB SERVICE FOR INTEGRATING PUBMED. AND OUR EXAMPLE, A COUPLE OF EXAMPLES OF OUR SAMPLES ELSEWHERE IS THE 2009 HIGH-TECH MEANINGFUL USE LEGISLATION THAT CAME UP THAT REQUIRED TERMINOLOGIES AND ELECTRONIC HEALTH RECORDS IN THE U.S. AND ANOTHER EXAMPLE IS OUR NIH COMMON DATA ELEMENTS REPOSITORY. SO THERE'S MANY STAKEHOLDERS THAT RELYOT TERMINOLOGIES WE COLLECT AND THE PRODUCT AND DOOLS WE CREATE AND SUPPORT. AND DURING OUR SESSION, DR. BRENNAN AN NOTED THAT EARLIER THIS YEAR, SEVERAL NLM STAFF HAVE BEEN WORKING TOGETHER TO DRAFT A VISION STATEMENT AND HIGH LEVEL GOALS FOR WHERE NLM SHOULD BE AND DATA STANDARDS AND OUR NEXT STEP IS TO FIGURE OUT HOW TO GET THERE AND WE'RE IN THE PROCESS OF DRAFTING A PLAN NOW. AND VALORY SNYDER GAVE US AN UPDATE ON THE COMPARATIVE GENOME RESOURCE UPDATE. SO THE BIGGEST THING TO NO WITH THIS IS YOU MIGHT BE MORE FURTHERMORE WITH IT AS THE ORGANISM DATA RESOURCE OR RODOR THAT WE HEARD ABOUT IN THE MAY OR FEBRUARY BOARD METING IT HAS NOW CHANGED THE NAME TO THE COMPARATIVE GENOMICS RESOURCE OR CGR. SO THAT THE PROJECT'S PURPOSE IS A BIT MORE APPARENT WHEN YOU'RE PERFORMING OUTREACH. SO IT'S ANOTHER ACRONYM WE'RE GOING TO HAVE TO GET INTO YOUR LONG-TERM MEMORY BANK. AS A REMINDER HERE, DR. KRISTI HOMES IS CHAIR OF THE OVERSIGHT COMMITTEE AND DR. MELANIE SNYDER WITH NCBI IS THE EXECUTIVE SECRETARY FOR THE DUKS OF THIS NEW RESOURCE. SO THIS IS A 5 YEAR INITIATIVE TO PROVIDE A CONSISTENTLY ANNOTATIVE CLOUD BASE RESEARCH DATA SOURCE FOR EUCARIOTIC GENOME FORM FOR COMPARISON AND ANALYSIS. IT'S DOING THIS VIA FOCUSED WEB PORTALS AND APIs THROUGH COMMUNITY ENGAGE EXPMENT PROVIDING PUBLIC CLOUD READY TOOLS TO SCREEN AND ANNOTATE ALL EUCARIOTIC GENOMES. SO IF A FEW HIGHLIGHTS OF THE WORK, SINCE THE LAST REPORTING SESSION WAS--THEY ARE GETTING THE ADMINISTRATIVE MATTERS HANDLED BY GOVERNANCE REFINE THE CGR STRATEGIC ROADMAP AND RELEASE PLAN. THEY'VE COMPLETED USER RESEARCH TO INFORM INITIAL RELEASE REQUIREMENTS FOR SEVERAL PRODUCTS INCLUDING CONTAMINATION SCREENING SOFTWARE, NEW DATABASES AND ORGANISM FOCUSED WEB HUB AND PROVIDING ACCESS TO GENOME RELATED DATA SO THE WORKING ON DELIVERING A FIRST VERSION OF WEB BASED RESOURCE PROVIDING WITH SUBMITTERS WITH ANNOTATION DATABASED QUALITY FOR GENOME ESTABLISHES. THE RELEASING BETA VERSION OF A TEXT-NATIONAL LIBRARY OF MEDICINIC ORGANISM WEB HUB AND STARTED DEVELOPMENT FOR SOFTWARE OF CLOUD-BASED TOOL FOR FOREIGN CONTAMINATION SCREENING OF EUCARIOTIC GENOMES. HOW HOW DOES ALL THIS TIE INTO THE WORKING GROUP, YOU MIGHT BE ASKING OUR NEXT STEP IS TO REVIEW AND UPDATE THE NLM COLLECTIONS PIPELINE ESPECIALLY THE SECTIONS ON DATA SET AND OUR RETENTION POLICY. WE WANT TO INSURE IT'S SUFFICIENTLY ENCOMPASSES AND SOLIDIFIED POLICIES AND WE WILL START WITH NLM DATA SETS FIRST AND MORE SPECIFICALLY CGR SINCE IT'S A NEW RESOURCE AND IT WILL SERVE AS OUR FIRST USE CASE. SO I THINK THAT SUMMARIZES EVERYTHING AND I WILL OPEN IT UP TO ANY QUESTIONS. IF NOT, AND TO THE OTHER WORKING GROUP MEMBERS THAT MIGHT ADD TO ANY OF MY COMMENTS. >> THANK YOU, DIANNE, AS A MEMBER OF THE WORKING GROUP, I WANT TO THANK AND YOU THE OTHER STAFF TODAY WHO UPDATED US ON THESE INITIATIVES AND I THINK IT'S PARTICULARLY EXCITING THAT THE WORKING GROUP GETS TO TAKE ON THIS NEXT CONSIDERATION OF DATA SET GUIDELINES BOTH FOR ACQUISITION, RETENTION, DEACQUISITION, THE WHOLE THING AND THAT THE COMPARATIVE DEGOMMICS RESOURCE IS PART OF THIS CONVERSATION. WE HAVE ABOUT A HALF AN HOUR THAT WE HAVE MADE UP ALL OF THE SUDDEN WITH THE REPORTS FROM THESE WORKING GROUPS. SO WE'VE GOT TIME. I'M NOT SURE WHAT ELSE WE WANT TO DO WITH THE TIME. SO PERHAPS THOSE OF YOU WHO HAVE THINGS TO BRING BEFORE US, IF NOT, QUESTIONS OR COMMENTS? , YOU CAN SUGGEST WHAT WE DO AT THIS POINT BUT WE'RE STILL ALSO OPEN FOR QUESTIONS OR OTHER COMMENTS. I DON'T SEE ANY HANDS WAVING. I DON'T SEE ANY QUESTIONS COMING UP. >> SO THIS IS THE POINT THAT I TELL PEOPLE THAT I USED TO TEACH FRESHMAN AND I COULD STARE FOR A REALLY LONG PERIOD OF TIME BUT I ACTUALLY HAVE SOMETHING THAT'S PRETTY NEEDY THAT I THINK THAT THE BOARD NEEDS TO DISCUSS AND I THINK IT IS A TIME FOR US TO HAVE--THIS IS KNOW OPEN SESSION DISCUSSION BY THE WAY, SO I NEED TO REMIND PEOPLE THAT THIS IS--WE'RE RECORDING AND WE'RE ALSO ON THE I BELIEVE WE'RE STILL ON THE VIDEO, NIH VIDEO. BUT 1 OF THE REASONS WHY IT'S EASY FOR THE BOARD OF REEJ EPTS TO UNDERSTAND POLICY AND GUIDANCE IS THAT WE MAKE DECISIONS ALL THE TIME ABOUT WHAT WE WILL ACCEPT, THAT IS WHAT IS WITHIN THE SCOPE OF OUR COLLECTION AND WHAT WE WILL RETAIN THAT IS HOW LONG WILL WE PRESERVE THIS BECAUSE EVERY PAPER THAT COMES TO THE DOOR HAS GOT TO BE PRESERVED FOR--I MEAN OUR PHILOSOPHY IS WE CALL A COLLECTION PERIODICALLY BUT WE DO OFTEN PRESERVE IN PERPETUITY AND WHO HAS THE RIGHT TO MAKE THOSE DECISIONS? OVER THE LAST COUPLE OF MONTHS WE'VE HAD MANY, MANY CONVERSATIONS HERE AT NLM ABOUT CHOICES AND DECISIONS TO MAKE. WE HAVE A--IT IS MUCH MORE FORMALIZED TO BRING INFORMATION IN FROM THE LITERATURE BECAUSE WE HAVE EXPLICIT MODELS OF CURATION AND RECOMMENDATION. THE JOURNALS AND PUBLISHERS ARE OUR PARTNERS AND WE GO THROUGH A REVIEW PROCESS TO MAKE SURE THE JOURNAL HAS A CERTAIN STANDARD. THE EDITORIAL BOARD DETERMINES THE QUALITY OF THE SCIENCE, WE DON'T DETERMINE THE QUALITY OF THE SCIENCE SO ONCE AN ARTICLE COMES TO US IT HAS HAD SEVERAL REVIEWS. SO THEREFORE OUR INTERACTIONS ABOUT WHAT ON DO WE RETAIN, WHAT GETS REMOVED FROM THE COLLECTION IS DONE IN PARTNERSHIP. AND AN EXAMPLE OF THIS IS WHEN THEY JOURNAL RETRACTS AN ARTICLE AND WE HAVE A STRATEGY, WE DEVELOP A STRATEGY WHERE WE MARK AND SO INDICATE THAT AN ARTICLE HAS BEEN RETRACTED BY THE JOURNAL. WE DO NOT REMOVE IT FROM OUR REPOSITORY BUT WE HAVE A MACHINE THAT'S READABLE AND THIS MATERIAL HAS BEEN MOVED. OUR RELATIONSHIP WITH THE OTHER COLLECTIONS THAT YOU'VE HEARD ABOUT TODAY, CLINICALTRIALS.GOV, OUR GENOMIC DATA COLLECTIONS HAVE A VERY DIFFERENT STRUCTURE AROUND THEM AND THOSE CASES WE RECEIVED DIRECT INPUT FROM THE INVESTIGATORS WHO EITHER GENERATED THIS SEQUENCE OR CONDUCTING THE STUDY, NOW THAT'S--THAT'S KIND OF A MISNOMER, I DON'T KNOW MANY PIs THAT SIT DOWN AND ACTUALLY TYPE THE INFORMATION INTO THE CLINICALTRIALS.GOV, THEY HAVE STAFF THAT DO THAT, THEY HAVE CLINICAL TRIALS AND NURSES THAT DO IT, THEY HAVE A RESEARCH FACILITATORS BUT EVERYONCE IN A WHILE THERE IS A PI WHO TRIES TO DO IT. WE SPEND A LOT OF OUR TIME MAKING SURE THAT WHAT'S IN CLINICALTRIALS.GOV IS ACCURATE. SO IF A STUDY SAYS THEY HAD 24 PEOPLE AND THERE WERE 12 MEN AND WOMEN, THERE WAS THE NUMBER 12 IN EACH GROUP OR IF THE STUDY WAS DONE AS 1 OF OUR FAMOUS STUDIES HAS TO DO WITH THE STUDY OF AN OPERATING GLOBALLY THAT WILL MODEL CITIZEN LOGICAL STUDY AND THERE WERE 37 EYEBALLS BUT 18 PEOPLE SO IT WAS UNCLEAR WHERE THAT EXTRA EYEBALL CAME FROM SO THOSE ARE TO ME ARE THE LOW HANGING FRUIT. THEY REQUIRE U MAN ENGAGEMENT, WE STILL HAVE TO HAVE AN INTERACTION ABOUT--WITH THE DEPOSITOR ABOUT THE QUALITY AND INTEGRITY AND IF BECKY IS STILL THERE, SHE CAN TELL YOU ABOUT THIS WHAT THIS CONVERSATIONS LOOK LOOK I. WHEN IT COMES TO SOMETHING THAT NOW IS COMPLICATED AS HIGH THROUGH PUT GENOME SEQUENCING,--DATA COMING IN DIFFERENTLY WHETHER IT'S COMING INTO SRA VERSUS DBGAP, WHERE DBGAP HAS A LOT OF HUMAN ENGAGEMENT SO I LAID THESE OUT, THE PATHWAYS TO DEPOSIT WAYS IN THE NATIONAL LIBRARY OF MEDICINE VARIES AND IT'S OUR RESPONSIBILITY TO PROTECT THE AUTHORITIES AND WE RECOGNIZE THE NEEDS WITH THE CLOSE INTERACTION WITH THE SUBMITTERS, ALL OF THIS IS WHAT WE SEE UNDER THE UMBRELLA OF THE COLLECTIONS POLICY AND THAT'S WHY WE'RE SPENDING SO MUCH TIME ON IT SO I WANT TO STOP THERE AND SEE IF I MADE IT REALLY CLEAR THAT YOU HAVE A PUBLIC ACCOUNTABILITY THAT WE'RE DOING THESE THINGS CORRECTLY AND I WANT TO BE SURE IF YOU NEED US TO UNDERSTAND AND EXPLAIN THEM MORE, PLEASE DO BECAUSE WHENEVER I GET ASKED FROM NIH LEADERSHIP ABOUT WHY DO YOU DO THIS? I SAY MY BOARD DIRECTED ME TO DO THIS. LET ME STOP THERE AND SEE IF THERE'S COMMENTS OR QUESTIONS. >> WELL, I THINK IT'S GREAT THAT AS MEMBERS OF THE BOARD - THAT WE CAN BE BRIEFED ON THESE ISSUES AND CAN ADVISE AND AFTER ALL THAT'S WHAT OUR JOB IS TO PROVIDE YOU WITH COUNCIL AND ADVICE AND YOU KNOW COVER IF NEED BE TO MAKE SOME OF THESE DECISIONS AND MOVE FORWARD ON IT. I THINK IT'S GREAT THAT YOU AND OTHER MEMBERS OF THE STAFF HAVE THE SORT OF THE VISIONARY VIEW OF USING THIS GROUP TO BRING FORTH THESE ISSUES. YOU KNOW WITH THE NEW 1 BEING THE COMPARATIVE GENOMICS RESOURCE ESPECIALLY BUT ALL OF THESE AS WELL. SO I THINK IT'S WHAT OUR JOB ACTUALLY IS AND I'M GLAD WE'RE SERVICING THAT THE WE'RE THE GROIP THAT THESE THINGS CAN BE BROUGHT TO AND THAT WE CAN WEIGH IN ON IT. PAUL, I THINK HAS A COMMENT? >> YEAH. >> YEAH, THANK YOU. P A TTI, A COUPLE THINGS THAT CAME TO MY MIND AS YOU WERE DISCUSSING THIS TOPIC IS THE RELATIONSHIP BETWEEN OTHER STATUTES, OTHER FEDERAL STATUES THAT RELATE TO THE TRANSMISSION OF DATA AND THE 1 THAT COMES TO MIND IS THE FEDERAL RECORDS ACT AND HOW THAT MAY HAVE COME UP IN THE INSTANCE THAT YOU TALKED ABOUT FROM THE SUMMER WITH THE GENOME SEQUENCE RELATED TO COVID. THE OTHER THING THAT COMES TO MIND IN THIS CONVERSATION THAT'S COLLECTION DEVELOPMENT RELATED IS WHAT ARE THE--IT KIND OF GOES TO THE SCOPE OF QUESTION THAT WE TALKED ABOUT IN A SUBGROUP AND THE CONNECTION BETWEEN BIOMEDICAL INFORMATION AND KIND OF OTHER ALLIED FIELDS. AND THE 1 THAT COMES TO MIND AS I MENTIONED IN OUR GROUP IS THE FOOD AND AGRICULTURE PIECE AND THE NUTRITION DATA AND HOW THATY RELATES TO THESE ISSUES AND I THINK THERE'S NEED TO FURTHER EXPLORE THOSE CONNECTIONS AND RESOURCES THAT ARE DEVELOPED IN OTHER DOMAINS THAT COULD AID AND SUPPORT THE WORK THAT'S BEING DONE AT NLM. SO THOSE ARE JUST A COUPLE OF MY QUICK THOUGHTS ON THIS AREA EMPLOY. >> WOW, QUICK AND NEAT. I STEVE SHERRY IS ON HERE, STEVE AND ACTING DIRECTOR FOR NYBI AND WE WORK VERY CLOSELY AROUND THE ISSUES OF SUBMISSION AND MODIFICATION OF GENOMIC SUBMISSION AND WITHDRAWAL WHICH IS AN EXTRAORDINARILY RARE EVENT. I THINK THAT IF I'M QUOTING THE NUMBERS CORRECTLY, STEVE, WE HAD OVER 2 MILLION SUBMISSIONS AND 1% HAD ANY KIND OF ACTION RELATED TO MODIFICATION WITHDRAW, SO IT'S REALLY RARE, BUT I HAVE TO CONFESS, I'M NOT SURE WE LOOKED AT THE RECORDS ACT DURING THE TIME. WE LOOKED TO THE POLICIES, YOU MAY WANT TO EXPLAIN OUR REP WITH INSTC, WE LOOK AT POLICIES THAT GOVERN THIS DATA, RECORDS, WE'VE BEEN KIND OF--NIH IN GENERAL, THE RECORDS ACT AND OUR RESPONSIBILITY FOR ARCHIVING IS FAIRLY RESTRICTED TO THE ACTUAL BUSINESS OF RUNNING THE ORGANIZATION AND NOT THE SCIENTIFIC DATA GENERATED BY IT BUT I THINK THAT'S PROBABLY WORTH A CONVERSATION. STEVE? >> YEAH, I WOULD JUST POINT OUT THAT AT LEAST THE SCIENTIFIC DATA MIGHT HAVE A DISTINCTION FROM THE LITERATURE, THE PUBLISHED LITERATURE IN THAT THERE'S NO ASSIGNMENT OF COPYRIGHT TO THE GOVERNMENT, NO SENSE OF OWNERSHIP, IDEALLY FOR QUALITY TO IMPROVE THEM AND TO WITHDRAW THEM IF IT'S DISCOVERED THEY'RE NOT FIT FOR PUBLIC REDISTRIBUTION. THEY MIGHT BE ABSENT CONSENT. THERE MIGHT BE FATAL QUALITY ERRORS, THERE ARE A COUPLE REASONS AND AS P A TTI ALLUDED TO WE DON'T DO THIS SOLO, WE DO THIS WITH 2 OTHER INTERNATIONAL GROUPS EXPW WE ROUND ROBIN THE DATA AND WE SHOW ALL OF THE DATA REGARDLESS WHERE IT'S SUBMITTED AND IF THEY HAVE IT WITHDRAWN, WE TAKE IT DOWN, NO QUESTIONS ASKED, WHY IT'S PART OF KEEPING IT SYNCHRONIZED ON A DAILY BASIS. AGAIN, THAT'S AN INFORM AT CHARTER, DOESN'T HAVE LIKE THE STATUTE OR RETT SYNDROMEY BEHIND IT, IT'S CONVENTION AND AN AGREEMENT OF COLLABORATORS SO I THINK PART OF THE COLLECTIONS REVIEW IS TRYING TO MAKE SURE THAT THOSE PRACTICES WHICH HAVE EVOLVED OVER 30 YEARS, YOU KNOW SINCE THE FOUNDATION OF GEN-BANK ARE MODERATE AND THAT THEY RECOGNIZE THE CURRENT STATE OF PLAY, THE GROWING IDEAS AROUND PRIVACY AND THE VALUE OF THE SEQUENCE DATA TO SOCIETY AND INDUSTRY. AND THERE MIGHT BE BE A QUESTION AND IT WAS RAISED TO ME BY REPORTS OVER THE SUMMER, IS THERE A CIRCUMSTANCE WHERE NATIONAL OR SOCIETAL INTERESTS ACTUALLY OUTWEIGH THE INDIVIDUAL ENROLLINGSHIP QUESTION AND SOMETHING THAT THEY MIGHT WANT TO HAVE WITHDRAWN? SOCIETY SAYS NO, IT'S TOO IMPORTANT. AND I THINK THAT'S A QUESTION WE'RE SILENT ON, WE DON'T HAVE INQUIRY ANSWERS AND WE DON'T HAVE A PLACE OR POLICY OR PROCEDURE FOR INJECT THAGOREAN KIND OF HIGHER LEVEL, YOU KNOW OUR STANDARD RIGHT NOW IS THE SUBMITTERS OF THE DATA AND WE HOLD IT IN TRUST AND DISTRIBUTE IT ON THEIR BEHALF. AND I THINK THAT'S SOMETHING WE WILL HAVE TO LOOK AT AND MAYBE BRING SOMETHING TO THE BOARD FOR REFLECTION AND COMMENTS IN THE NEXT COUPLE OF MONTHS AND I DON'T KNOW IF WILL BE THE FEBRUARY MEETING OR NEXT SUMMER. DIANNE, I THINK LITERATURE IS DIFFERENT IN THE SENSE THAT THERE'S INTELLECTUAL PROPERTY, IT'S AN ESTABLISHED ARTICLE, THINGS THEY OWN AND MICHELLE I DON'T KNOW IF THERE'S OTHER ANALOGUES TO LITERATURE OR DIFFERENCES BETWEEN THE SEQUENCE DATA AND ARTICLES. >> I AM GETTING A LOW BAND WIDTH MESSAGE, I WILL LET CLINT COMMENT. >> I CAN ASK A QUESTION? >> ABSOLUTELY. GO,A HEAD. >> WELL I WAS JUST WONDERING THIS IS IN THE CONTEXT OF ALL THE FUSSING NOW, YOU KNOW ABOUT THE RETRACTED SEQUENCE FROM CHINA AND I WAS WONDERING IF THERE'S ANY THOUGHT ABOUT YEAH, YOU CAN RETRACT IT BUT WE CAN TRACE. THAT'S TRUE IN A LOT OF SYSTEMS, YOU JUST KEEP TRACK OF WHAT IT WAS IN CASE EITHER YOU SCREWED IT UP OR WHATEVER. IS THERE ANY THOUGHT OF THAT? IT SEEMS LIKE, YOU KNOW THAT COULD SATISFY ALL SIDES IN THEORY? >> THAT IS OUR GENERAL PRACTICE. IN THIS CASE, I THINK IT WAS THE LACK OF PUBLIC VAIRMT OF THE DATA AND THE REASONING WHY BECAUSE THE REASONS GIVEN WERE NOT COMPLETELY ALIGNED WITH THE-- >> BUT YOU DO KEEP A TRACE OF WHAT IT WAS ANYWAY. >> THE ORIGINAL SUBMISSION FORMAT IS GENERALLY KEPT. >> NOW IN THIS PARTICULAR CIRCUMSTANCE, THAT SUBMISSION IS CAUGHT UP IN THE MIDDLE OF OUR TRANSITION FROM SUBMISSIONS TO BE PROCESS ON PRIM HERE AT THE LIBRARY TO THE CLOUD AS PART OF THIS BIG ACTION, THERE WAS A LOT OF CHURN WITH THAT IN MOVING THINGS IN BUCKETS AND LEARNING HOW TO RUN A COMPLETELY DIFFERENT SYSTEM AND A COUPLE RECORDS MIGHT HAVE BEEN TRAMPLED ON IN THE MOVEMENT AND OPTIMIZATION OF THAT BUT AS I UNDERSTAND EVERYTHING NOW, WE HAVE A ROBUST AND A RESILIENT SYSTEM, IT DOES DEPEND NOW ON CLOUD OPERATIONS, PERSISTENT BECAUSE THAT WILL BE THE DATA SET OF RECORD, IT NO LONGER KEPT IN ITS ORIGINAL FORM AT THE LIBRARY BECAUSE IT WAS JUST GROWING TOO BIG. SO THEY MIGHT BE GETTING BACK TO STORAGE AND THAT MIGHT BE A DIFFERENT ISSUE FOR THE BOARD ALSO TO THINK ABOUT THE FUTURE AND WHAT VERSION OF THE DATA IS PROPER FOR THIS STORAGE IN PERPETUITY AS P A TTI WAS SAYING. EVERYTHING'S GROWING EXPONENTIAL AND IN DECADES WE WON'T HAVE ENOUGH HARDWARE IN THE UNIVERSE TO STORE ALL THE DATA MACHINES WILL SPIT OUT MUCH LESS IN THE NLM BUDGET. WE HAVE TO MAKE DECISIONWHAT WE KEEP NOW AND THEN SMALLER SLICES THAT WE KEEP THAT'S VALUABLE A 50 OR HUNDRED YEARS FROM NOW. >> I NEED TO STEP IN AND SAY ALSO THE NOTORIOUS SITUATION WE HAD WAS THE JESSE BLUHEIM SITUATION, THIS IS NOT RESTRICTED TO THAT, THE WITHDRAW FROM THE REPOSITORY TOUCH A NUMBER OF DIFFERENT AREAS--HYBRID STORAGE, WE ARE MAKING VERY CAREFUL ARCHITECTURAL DECISIONS SO WE HAVE A TRACE, WE HAVE AN UNDERSTANDING OF WHAT IS WHERE, AND WE HAVE AN UNDERSTANDING OF WHAT ACTION AND WHAT PLATFORM PERPETUATES OR DOESN'T PERPETTIA UTR TO OTHERS AND SO THAT'S A POLICY AND THAT'S ABOUT THE TECHNICAL PIECES OF IT AND THEN THERE'S TECHNOLOGY I'LL TURN BACK TO NEIL TO RUN THE DISCUSSION. >> I THINK HEIDI HAS HER HAND UP AND THEN KRISTI AND PAUL? YOU HAVE A QUESTION? OKAY, HEIDI FIRST PLEASE. >> THIS IS AN INTERESTING ON TOPIC I GENERALLY AGREE WITH THE SORT OF PERSPECTS THAT ARE CURRENTLY BEING ADHERED TO, THE 1 CONCERN AND STEVE MENTIONED THIS IS, YOU KNOW WHAT IF DATA WAS SHARED AND THEN IT'S REALIZED THAT THE PATIENT DID NOT CONSENT TO THAT? YOU 99 GENERAL I AGREE WITH KEEPING A TRACE OF THINGS AND'S RECORD BECAUSE SOMEBODY COULD HAVE REFERENCED THAT AND YOU DON'T WANT THE REFERENCE TO DISAPPEAR BUT THE LACK OF PATIENT CONSENT, YOU KNOW AND THE ABSENCE OF A COMPELLING NATIONAL SECURITY REASON OR SOME OTHER HEGHT REASON THAT THAT DATA NEEDS TO SOMEHOW BE KEPT SOMEWHERE, THAT WOULD BE THE 1 CASE WHERE YOU I WOULD CONSIDER POTENTIALLY FULL REMOVAL. I DON'T KNOW. IS THAT PART OF--WHAT DO YOU DO STEVE IN THAT CASE? >> THAT IS 1 OF THE CONDITIONS FOR FULL REMOVAL OR WITHDRAWAL. IN DBGAP EVEN GOES FARTHER AND SO SOME OF OUR REPOSITORIES ARE REALLY FOCUSED ON HUMAN DATA WITH A LOT OF INTIMATE DETAIL AROUND PEDIGREES AND THINGS LIKE THAT, AND WHEN THEY FIND CASES OF DIRECT RISK OF HARM TO INVESTIGATORS, THAT'S COMPLETELY EXPUNGED FROM THE STUDY SO THEY REDACT THAT, EVEN ROWS OF DATA THROUGH THE WHOLE THING, IT'S DONE IN COLLABBATIONERATION WITH THE PIs AND MAKE SURE WE HAVE A PUBLIC DATA SET THAT WILL DO NO HARM. THAT'S THE HIGHEST CASE YOU KNOW OF IN TERMS OF LABOR TO DO IT, STEPPING DOWN IS THE ABSENCE OF CONSENT WHICH MY BE DISCOVERED LATER AND WE DO AWE WITHDRAWAL AND THEN WE TELL OUR ICNS PEERS TO TAKE IT DOWN. SO IT'S CLEAR FOR HUMAN. IT'S UNCLEAR WHEN WE START MOVING INTO HUMAN DERIVED LIKE MICROBIOME SAMPLES WHICH MAY HAVE CONTAMINATION, OTHER SIGNALS OF A HUMAN THAT ARE NOT CONSIDERED YOU KNOW PART OF HUMAN GENOME YET AND SO THE SCIENCE ON THIS WILL CHANGE. ALL I'M SAYING IS THE TECHNOLOGY CHANGES, THESE POLICIES HAVE TO BE CONSIDERED AND I THINK WE'RE DUE FOR 1, IT'S BEEN A DECADE OR MORE SINCE THE LAST TIME WE DID A SYSTEMATIC REVIEW. >> OKAY. >> OKAY, I WILL JUMP IN, THIS IS ACTUALLY A REALLY GOOD SEGUE TO MY QUESTION. SO I'M WONDERING, AND I THINK THIS QUESTION COULD PROBABLY BE ADDRESSED BY A COUPLE OF DIFFERENT PEOPLE AT NLM, JUST THINKING ABOUT HOW OUR CONCEPTUALIZATION OF WHAT A COLLECTION IS HAS EVOLVED OVER TIME. OBVIOUSLY WE'RE CONSIDERING DATA SETS AS AN IMPORTANT ASPECT OF THE COLLECTION. I'M WONDERING IF YOU CAN SHARE A LITTLE BIT ABOUT HOW THE NLM PROACTIVELY CONSIDERS CHANGES IN SCIENCE AND IN TECHNOLOGY. ARE THERE OPPORTUNITIES FOR ONGOING DISCUSSIONS OR DOES THAT HAPPEN AS MORE OF A, YOU KNOW I GUESS A MOMENT IN TIME WHERE THERE'S AN UNDERSTANDING THAT A CAREFUL DISCUSSION NEEDS TO HAPPEN. >> PERFECTLY LOGICAL THOUGHT FILLED AND WE DO IN ANTICIPATION OF ANY MAJOR CHANGE IN THE UNIVERSE. YOU DON'T BELIEVE ME. WE TRY NOT TO LET OUR PRACTICES GET TOO FAR AHEAD OF OUR POLICIES. WE TRY TO--THAT'S WHERE AGAIN, THE BOARD OF REGENTS IS INCREDIBLY IMPORTANT TO US BECAUSE YOUR INPUT ABOUT WHERE TRENDS ARE GOING IN THE FIELD IS REALLY ESSENTIAL AND HELPING US UNDERSTAND THINGS. WE USE PROFESSIONAL SOCIETIES AS A REALLY BIG INPUT, WE HAVE A--WE LISTEN TO OUR INTRAMURAL INVESTIGATORS WHO HELP US UNDERSTAND WHERE SCIENCE IS GOING. WE GET SUFFICIENT AND PERHAPS EXCESSIVE INPUT FROM COLLEAGUES ACROSS THE NIH ON A PRETTY REGULAR BASIS. STEVE IS A PARTY OF MANY, MANY HELPFUL COMMENTS. I THINK PEOPLE LIKE TO SHARE THEM. ANYBODY ELSE WANT TO TALK ABOUT--EITHER DIANNE OR STEVE, OR KIM, HOW WE ANTICIPATE WHERE THE PUCK IS MOVING TO? >> YOU KNOW WHAT ARE THEY? ARE THEY CONSIDERED PRESERVABLE? ARE THEY EFFEMMORRAL? THEY'RE NOT PEER REVIEWED YET. WHAT SHOULD THE POLICY BE AROUND THAT? WE STARTED DISTRIBUTING SOME FOR COVID RESOURCES AND DIANE MAYBE THIS IS ALL SOLVED AND ESTABLISHED AND I JUST AM NOT LECTURED ON THIS, SO PLEASE CORRECT ME. I THINK IN THOSE CASES WHERE THERE'S NEW CHANNELS OF COMMUNICATION COLLECTIONS MAY EMERGE. >> YEAH, IT'S COMPLETELY SOLID STATE. [LAUGHTER] NTHAT'S EXACTLY WHAT WE NEEDED TO HEAR. >> YEAH, WE TALK ABOUT THIS ALL OF THE TIME. IN FACT, LIBRARY OPERATIONS, WE'RE IN THE PROCESS OF PUTTING TOGETHER A 15 YEAR LONG RANGE PLAN AND 1 OF OUR FOCUS, OUR GOALS IS 1 COLLECTION. AND REALLY THINKING ABOUT WHAT DOES THAT MEAN, RIGHT NOW, EVERYTHING IS REALLY TRANSITIONING TO ELECTRONICS SO WE HAVE TO DEAL WITH, YOU KNOW WILL IT BE PRESERVED, WILL IT BE FINDABLE, WE'RE DEALING WITH ACCESS AND WE NOTICED THAT MUCH MORE OVER THE LAST 19 MONTHS DURING COVID SO THIS HAS BEEN--WE KNEW THAT WAS A THING BUT NOW WE'RE REALLY--IT'S AN ACTIONABLE ITEM TO REALLY INCREASE OUR DIGITIZATION, SO WHAT DOES THAT MEAN, THE COPY WRITE AND EVERYTHING ELSE INVOLVED WITH IT. AND THEN, YOU KNOW JUST ESPECIALLY THE COLLECTIONS WORKING GROUP, WE'VE SEEN A LOT OF DIFFERENT FLAVORS OF WHAT WE CONSIDER PART OF OUR COLLECTION AND WE'VE HISTORICALLY KIND OF, YOU KNOW HEDGED OUR POLICIES TOWARDS THE LITERATURE AND OTHER THINGS THAT ARE, YOU KNOW HISTORICALLY PART OF A LIBRARY'S COLLECTION BUT YOU KNOW WE'VE LOOKED AT SOFTWARE, HOW DO YOU PRESERVE SOFTWARE, WHAT VERSION? THERE ARE SO MANY THINGS INVOLVED WITH IT AND JUST IN OUR SMALLER DISCUSSIONS, IT'S JUST THINKING ABOUT, WE HAVE VERSIONS OF MESH FOR THE UMLS, THINGS LIKE THAT THAT GO BACK YEARS AND SO WHICH 1 IS THE 1 OF RECORD OR NOT? IS IT THE MOST RECENT VERSION? SO WE--THERE'S MORE QUESTIONS THAN ANSWERS, BUT WE'RE TRYING TO TACKLE THINGS 1 AT A TIME AND EVERY TIME WE THINK WE HAVE 1 WHACKA MOLE DOWN, 5 MORE POP UP, SO, IT'LL BE AN ONGOING PROCESS, I DON'T THINK IT WILL AGGREGATE MUCH BUT I THINK THAT'S JUST THE NATURE OF WHERE WE ARE WITH SCHOLARLY COMMUNICATIONS RIGHT NOW. >> RIGHT. THANK YOU DIANNE. PAUL AND WE HAVE A QUESTION AND THEN FROM LOLA, ALSO AND WE HAVE NOW ABOUT 5 MINUTES LEFT SO OF COURSE THINGS GET GOING WHEN WE NEED TO SORT OF HOLD THINGS UP A LITTLE BIT BUT PLEASE GO AHEAD PAUL. >> THANK YOU NEIL. THE OBSERVATION THAT I HAVE IS THAT A LOT OF THE STATUTES THAT GOVERN RECORDS AND INFORMATION AND LIBRARY ACTIVITIES DATE BACK IN SOME CASES TO THE 1950S AND THERE'S BEEN CARVE OUTS FORA TRADITIONAL LIBRARY MATERIALS AND I THINK THERE'S A NEED TO HAVE A CONVERSATION ABOUT HOW TO COVER SOME OF THESE--NOT SOME OF THESE, ALL OF THESE EMERGING TECHNOLOGIES AND THEIR OUTPUTS AND MAKE SURE THAT THEY'RE--THEY DON'T GET CAUGHT UP IN THESE ANACHRONNISTIC STATUES. I WOULD BE WILLING TO WORK MORE WITH THE COLLECTION GROUP. >> THAT WOULD BE GREAT. THANK YOU. LOLA? WELCOME. >> SO MY QUESTION HAD MORE TO DO WITH HANDLING MISINFORMATION WITH OUR INADVERTENT OR DELIBERATE ACTUALLY. SO WE'RE SEEING WITH PREPRINTS AS STEVEN MENTIONED AND OTHER KINDS OF COLLECTIONS, HOW DO YOU VET? SO I SERVED ON THE LISTER COMMITTEE AND THERE'S VERY CLEAR GUIDANCE AND THE EDITORIAL BOARDS ARE DOING PART OF THE BOARD FOR AND YOU THE COMMITTEE IS DOING ADDITIONAL VETTING BUT HOW, ESPECIALLY IN AIR SITUATION LIKE COVID WHERE THERE'S A LOT OF NEW INFORMATION FLOWING IN, HOW DO YOU VET, HOW DO YOU DECIDE WHAT BECOMES AVAILABLE AND HOW DO YOU RETRACT WHEN YOU REALIZE PEOPLE ARE MISREPRESENTING INFORMATION WHETHER IT'S DELIBERATE OR JUST BECAUSE THERE'S A RUSH. >> SO THIS IS AN ISSUE THAT'S VERY SIGNIFICANT WITHIN NIH RIGHT NOW. WE ARE HAVING A MEETING LATTER THIS WEEK WITH MIKE LAUERR WHO IS HEAD OF EXTRAMURAL NIH AND AND DIANE'S TEAM TO TALK ABOUT WHAT HAPPENS--FROM THE PAPERS FROM OUR REPOSITORIES BUT WE DON'T HAVE A PLAN SPECIFICALLY ABOUT DATA REMOVAL PRESIDENT DATA WERE GENERATED UNDER QUESTIONABLE CIRCUMSTANCES AND WE HAVE SOME STRATEGIC PLANENTLYYS AND WE HELP TO FINALIZE THEM AND I SEE KATIE'S READY TO SPEAK UP SO GO FOR IT KATIE. >> THANK YOU, P A TTI, A FEW THINGS THERE, ON PREPRINT FOR OUR COLLECTION STRATEGY WE ARE AS STEVE MENTIONED ONLY ACCEPTED COVID PREPRINTS AND WE FURTHER LIMITED IT TO THOSE WHO HAVE NIH DIRECT FUNDING SUPPORT AND THE SENSE HAS BEEN THAT IN LIEU OF THEIR BEING AN EDITORIAL BOARD OR EDITORIAL DECISION BEING MADE, THERE IS A PROGRAM OFFICER WHERE IF CONCERNS ARE RAISED ABOUT THE CONTENT-- >> WE JUST LOST YOUR SOUND. >> YEAH, KATIE WE'RE NOT HEARING YOU? I THINK HER CONNECTIONS BAD AND SHE'S GONE. >> ALL RIGHT. SORRY, I WANT TO THANK EVERYBODY FOR THIS, YOU MIGHT HAVE HOW THE YOU HAD AN HALF HOUR TO DO E-MAIL BUT NOT TODAY. LET ME TURN BACK TO NEIL, THANK YOU SO MUCH FOR YOUR HELP AND WE WILL BE COMING BACK TO THIS THEME A LOT. >> YEAH, THANK YOU ALL. WE HAD A HALF HOUR TO STARE AT EACH OTHER AND NOW WE HAVE TO CLOSE THAT OUT AND MOVE ON TO OUR NEXT ITEM. BUT IT WAS A DISCUSSION THAT I THINK WILL BE COMING BACK TO IN FUTURE MEETINGS AND LOOK FORWARD TO HEARING MORE AS WE WORK ON THIS SOME MORE. >> I MAY BE JUMPING THE GUN A LITTLE BIT BUT I'M TOLD OUR NEXT GUEST IS IN THE WINGS, SO PERHAPS I CAN SORT OF MOVE AHEAD WITH THIS. THIS IS SOMEBODY WHO'S JOINING US FROM OUTSIDE OF THE GROUP. SO I AM--I DON'T WANT TO DELAY TOO LONG. BUT I WOULD LIKE TO WELCOME JAMES ANDERSON FROM THE OFFICE OF THE DIRECTOR OF NIH. DR. ANDERSON IS DIRECTOR OF THE DIVISION OF PROGRAM ACCORD NATION PLANNING AND STRATEGIC INITIATIVES IN THE OFFICE OF THE DIRECTOR. DPC SI'S MISSION INN CLUEDS -I DENTIFYING EBE MERGING SCIENTIFIC OPPORTUNITIES, RISING PUBLIC HEALTH CHALLENGES AND SCIENTIFIC KNOWLEDGE GAPS THAT MERIT FURTHER RESEARCH. THIS DIVISION PLANS AND IMPLEMENTING TRANSNIH INITTIAIVE ITS SUPPORTED BY THE COMMON FUND AND COORDINATES RESEARCH RELATED TO AIDS, BEHAVIORAL AND SOCIAL SCIENCES, WOMEN'S HEALTH, DISEASE PREVENTION, DIETARY SUPPLEMENTS, SEXUAL AND GENDER MINORITIES, TRIBAL HEALTH AND RESEARCH INFRASTRUCTURE. DR. ANDERSON IS HERE TODAY TO PROVIDE US WITH AN UPDATE ON THE NIH STRATEGIC PLAN. WELCOME DR. ANDERSON. >> THANK YOU VERY MUCH. IT'S A PLEASURE TO BE WITH YOU HERE TO DESCRIBE OUR SECONDS NIH WIDE STRATEGIC PLAN, THIS 1 FOR YEARS 21-25 AND I MUST ASK AM I RUNNING THE SLIDES? OR IS SOMEONE ELSE GOING TO DO THAT? >> GREG WE NEED YOUR ADVICE HERE, HI, JIM, THANKS FOR COMING, WE ALSO CIRCULATED THE PLAN TO THE BOARD OF REGENTS NUMBERS. >> GREAT. >> GREG? WHO'S HERE FOR TECH RIGHT NOW? DEREK, YOU KNOW WHAT JIM IF YOU CAN GRAB THE SCREEN, I WOULD SAY GO AHEAD AND RUN YOUR SLIDES. >> I JUST TOOK CHARGE. THANK YOU SO MUCH. >> IT'S ALWAYS A PLEASURE. OKAY, I THINK WE HAVE THEM THERE. YOU WANT TO PUT IT IN PRESENTATION VIEW? YOU'RE STILL IN EDITING MODE? , WELL, I THOUGHT THIS-- >> HERE WE GO. >> GOT IT. OKAY, READY? >> YEAH. >> MY FIRST QUESTION IS WHY AM I DOING THIS. I'M IN THE OFFICE OF THE DIRECTOR WITH THE AREA TAKEN--THEY'S ENHANCING ACCORD NATION RESEARCH ACROSS NIH AND INCLUDED IN THAT IS A BETTER BEDDING OF HOW TO ANALYZE OUR RESEARCH PORTFOLIO, HOW TO EVALUATE THE RESEARCH THAT WE PRODUCE AND REPORT ON IT AND WITHIN THAT HAS BECOME STRATEGIC PLANNING SINCE WE HAVE BEEN ASKED BY CONGRESS TO DO THAT. SO WHAT IS A STRATEGIC PLAN. IT'S A PUBLIC STATEMENT OF OUR GOALS AND HOW WE'RE GOING TO ACCOMPLISH THEM. ENGAGE THE INSTITUTES THAT HAVE HAD STRATEGIC PLANS FOREVER, MANY OFFICES HAVE STRATEGIC PLANS FOR SPECIFIC DISEASES THAT COME ACROSS NIH BUT IN 2015 NIH CONGRESS FIRST ASKED US TO PRODUCE AN NIH WIDE DOCUMENT FOR WHAT WE INTEND TO DO AS AN AGENCY. SO OUR FIRST STRATEGIC PLAN COVERED THE YEARS 16-20. CONGRESS APPARENTLY THOUGHT THAT WAS SUCH A GOOD IDEA THAT IN THE CURES ACT WHICH I WILL SHOW YOU IN A SECOND HERE, THEY ADDED A REQUIREMENT THAT NIH PRODUCE AN NIH-WIDE PLAN EVERY--WITH A SET OF REQUIREMENTS FOR WHAT THEY WANTED TO SEE FROM US. AND I WILL GIVE YOU AN EXAMPLE OF SOME OF THESE. THEY REQUIRE A PLAN EVER 6 YEARS FOR THE AGENCY, SINCE ALL OF OUR OTHER PLANS ARE 5, WE CUT THIS TO 5, TO ALIGN WITH THE INSTITUTES AND THE REASON FOR THAT IS THAT CONGRESS ALSO REQUIRED THAT THE INSTITUTE STRATEGIC PLANNING BE INFORMED BY WHAT WE AGREED ON AS OUR NIH WIDE PRESENTATION. SO GOING FORWARD NOW THE NLM'S PLAN WILL HAVE TO REFLECT THEMES, GOALS OR CONTENT THAT ARE IN THE NIH WIDE PLAN. THEY ALSO ASKED SINCE OUR PLANS HAD MANY DIFFERENT FORMS, 1 INSTITUTE HISTORICALLY PUBLISHED A REVIEW ARTICLE AS ITS PLAN EVERY 5 YEARS. SO CONGRESS ALSO ASKED THAT THE AGENCY AGREE ON A COMMON TEMPLATE AND THEN EVERYONE USE THAT TEMPLATE AT LEAST FOR THE INSTITUTE LEVEL PLANS AND WE DID THAT THROUGH WORKING WITH ALL THE INSTITUTE DIRECTORS AND THEIR PLANNING AND EVALUATION. TEAMS WE CAME UP WITH A TEMPLATE WE ALL AGREED WE WOULD IN GENERAL USE. OKAY. SO LET ME BACK UP AND SAY VERY QUICKLY WHAT I INTEND TO DO IN THIS PRESENTATION. I NOTICED NLM IS ALSO INVOLVED IN TRANSLATIONAL RESEARCH STIGIC PLANNING CURRENTLY SOY WANT TO GIVE HISTORIC BACKGROUND TO HOW WE DEVELOP THE NIH PLAN AND ITS CONTEXT. WHAT ARE ITS OBJECTIVES HOW DO WE ORGANIZE THE DOCUMENT AND HOW WE EXPLAIN IT, AND THEN TO MAKE IT MORE CONCRETE, I WANT TO GIVE YOU EXAMPLES OF SOME OF THE NIH WIDE ACTIVITIES THAT WERE USED TO EXPLAIN WHAT WE DO HERE AT NIH WIDE. SO WHEN WE SET ABOUT THE PLAN FOR 21-26 WE AGREE WIDE THE INSTITUTE DIRECTORS THAT THIS PLAN WAS GOING TO ARTICULATE THE HIGHEST PRIORITIES OF NIH. SO IT WAS NOT GOING TO GO INTO THE SMALL PLANS, THAT WE WOULD STAY AT A HIGHER LEVEL. IT WILL ALSO DESCRAIB HOW WE PLAN TO ACHIEVE THOSE PRIORITIES. AND THEN AS WE WILL DO IN SUBSEQUENT. WE WILL NOT START OVER. WE ARE GOING TO INCLUDE THE ACCOMPLISHMENTS THAT ARE--THAT WE BASE OUR GOALS ON. AND HOW WE'RE PLANNING NEW INITIATIVES. SO WHAT IS IT NOT GOING TO BE? IT'S NOT GOING TO BE A COMPLETE REDO OF THE PAST PLANS. IT'S GOING TO BE--IT'S NOT GOING IT DESCRIBE EVERYTHING THAT WE DO. THE ISSUES THAT ARE MORE SPECIFIC TO INSTITUTES, WE'RE GOING TO LEAVE TO INSTITUTE CLIENTS AND THERE WILL BE A FOCUS ON THE THINGS WE ALL DO TOGETHER AS WELL AS ALL OF THE VALUES AND APPROACHES THAT WE SHARE AS AN AGENCY. SO VERY QUICKLY HOW DO WE GO ABOUT DEVELOPING THIS. THIS GOES BACK ALMOST 2 YEARS WE BEGAN BY AGREEING INTERNALLY WHAT THAT STRUCTURE, WHAT THE FORMAT WAS, VERY HIGH DETAILED LEVEL AND WE CHOSE TO STAY AT A HIGH LEVEL. AND THEN WHO WILL DO THE WORK INSIDE REPRESENTATIVES FROM WHICH INSTITUTE AND WE JUST GOT OURSELVES ORGANIZED TO DO THE WORK AND THEN FOR ABOUT A HALF A YEAR WE TOOK THIS OUT TO THE PUBLIC THROUGH VARIOUS FORMATS TO GET INPUT ON WHAT OUR VARIOUS STAKEHOLDERS THINK NIH SHOULD BE DOING AND HOW SHOULD WE DO IT. AND THEN FINALLY WE ORGANIZE THIS INTO THE DOCUMENT AND SAW APPROVALS THROUGH THE INSTITUTE DIRECTORS AND NIH DIRECTOR AND THEN THE DEPARTMENT. IT TOOK LONGER THAN WE EXPECTED, THERE WAS A BIT OF A HOLD UP WITH THE TRANSITION OF THE ADMINISTRATION BUT THEN, IN JULY 31st WE HAVE FINALLY PRODUCED OUR SECOND NIH WIDE STRATEGIC PLAN AND THIS 1 THAT FOLLOWS A FORMAT ORGANIZATION AND APPROACH THAT WILL USE FOR ALL SUBSEQUENT PLANS AND AS I SAID, IT'S SOMETHING THAT EXPECTS THE INSTITUTE TO BE ABLE TO THIS IS REALLY THE FRAMEWORK THAT WE HANG THE WORDS AND THE TEXT ON. WE CHOSE TO REPRESENT WHAT WE DO USING THE 3 THEMES THAT WE HAVE USED FOR DECADES TO EXPLAIN WHAT NIH DOES AND THOSE ARE WHAT IS THE RESEARCH THAT WE DO AND I'LL COME BACK TO THAT. HOW DO WE CREATE THE INFRASTRUCTURE AND WORKFORCE TO ACCOMPLISH THAT AND THEN THIRD EXTREMELY IMPORTANT FOR NIH PLAN IS HOW DO WE CONDUCT THE RESEARCH. SO GOING BACK TO THE RESEARCH AREAS, WE'RE ALL VERY FAMILIAR WITH EXPLAINING RESEARCH IN TERMS OF BASIC TO TRANSLATIONAL TO CLINICAL SO IT'S A VERY SIMILAR FORMAT, THE WAY WE DO IT IS WHAT'S THE FOUNDATIONAL SCIENCE THAT WE DO THAT'S NOT DIRECTED AT SPECIFIC DISEASE BUT CREATES THAT LEAK OF KNOWLEDGE THAT FOLKS CAN DIP INTO REGARDLESS OF THEIR DEC OR FOCUSED INSTITUTE AREA IS. SO ENHANCING IMAGING THAT SORT OF THING AND THEN ON TO DISEASE PREVENTION AND HEALTH PROMOTION. NOW THAT INVOLVES TRANSLATIONAL CLINICAL TRIALS AND SO ON BUT WE BREAK IT DOWN INTO PREVENTING AND PROMOTING HEALTH AND THEN FINALLY WHEN DISEASE AND CONDITIONS OCCUR, WHAT'S THE RESEARCH WE DO TO TREAT INTERVENTIONS AND CREATE CURES. SO THAT'S THE PIPELINE FOR BASIC RESEARCH THAT WE USE FOR THE PLAN. THE SECOND 1 IS RESEARCH CAPACITY AND WE LIKE TO POINT THIS OUT TO CONGRESS WHEN THEY ASK US HOW WE SPEND THE FUNDS BECAUSE GENERALLY NO 1 TRAINS OUR WORKFORCE, USHED GRADUATES GO TO COLLEGE, THEY GO TO GRADUATE SCHOOL BUT WE PAY FOR TRAINING GRANTS AND POST DOCTORAL TRAINING. IT'S VERY SPECIALIZED. PHARMA DOESN'T TRAIN OUR WORKFORCE SO WE HAVE A SPECIAL EMPHASIS ON HOW DO WE CREATE THE WORKERS TO DO NIH FUNDED RESEARCH. AND THEN HOW DO WE CREATE THE INFRASTRUCTURE THAT THEY NEED TO DO THE RESEARCH, WHETHER IT'S DATABASES, ACCESS TO, WHETHER IT'S INFRASTRUCTURE LIKE CONSTRUCTION GRANTS OR RESOURCES AS EXOTIC AS CENTERS FOR SNAKE VENOMS FOR RESEARCH OR NONHUMAN PRIMATE RESEARCH CENTERS OR DATA INFRASTRUCTURE, OR MICROSCOPES OR PET SCANNERS FOR RESEARCH SO WE HAVE TO ALSO FUND A CAPACITY TO DO THE RESEARCH AND THEN FINALLY AGAIN AS I SAID VERY SPECIFICALLY IMPORTANT FOR NIH WIDE EXPLANATION IS HOW DO WE CONDUCT RESEARCH SO HOW DO WE MAINTAIN THE HIGHEST LEVEL OF STEWARDSHIP AND USE OF THE TAXPAYERS DOLLARS, HOW DO WE OVERSEE OURSELVES AND HOLD OURSELVES ACCOUNTABLE? AND THEN WHAT PARTNERS DO WE USE? I'M TALKING ABOUT OTHER AGENCIES, PHARMACEUTICAL COMPANIES, OTHER COUNTRIES, AS WELL AS ALL OF THE INSTITUTIONS AND UNIVERSITIES THAT ARE PARTNERS WITH NIH IN THE WORK. AND THEN EXTREMELY IMPORTANT AGAIN FOR NIH WIDE EXPLANATION, WHAT WE DO IS ACCOUNTABILITY AND COMPETENCE, RIEGOR AND REPRODUCIBILITY, WE HOLD OURSELVES ACCOUNTABLE. WE EVALUATE WHAT WE DO AND WE CHANGE COURSE BASED ON SUCCESS OR NOT MPLET AND THEN THE FINAL ELEMENT IS MANAGEMENT OPERATIONS. NOW DOES NIH ITSELF OPERATE EFFICIENTLY AND EFFECTIVELY AS A STRUCTURE, AS AN AGENCY. OKAY. NOW, WE DECIDED IN THIS 5 YEAR INTERVAL TO IDENTIFY 5 CROSS CUTTING THEMES THAT THESE ARE EXTREMELY IMPORTANT NOW. THEY ALWAYS WILL BE BUT OUR PARTICULAR THEMES FOR THIS AND THEY ARE--THEY ARE THEMES THAT SHOW UP IN EACH OF THE OBJECTIVES FROM RESEARCH TO CONDUCT AND THEY ARE MINORITY HEALTH AND HEALTH DISPARITIES RESEARCH, THIS IS PARTICULARLY HIGHLIGHTED IN THE LAST COUPLE OF YEARS, NOT JUST BECAUSE OF ISSUES OF RECOGNITION OF STRUCTURAL RACISM AND IT'S CONTRIBUTION TO HEALTH DISPARITIES, BUT BECAUSE OF THE PANDEMIC AND THE REALIZATION OF HOW IT AFFECTS DIFFERENT POPULATIONS SO MINORITY HEALTH, HEALTH DISPARITIES 1 OF THOSE CROSS CUTTING THEMES IN EVERY PART OF DOCUMENT, WOMEN'S HEALTH, TOO, PUBLIC HEALTH CHALLENGES ACROSS THE LIFE SPAN AND AN EXCELLENT EXAMPLE I JUST CITED WOULD BE THE PANDEMIC. HOW DO WE PREPARE FOR AND RESPOND AS AN AGENCY TO THINGS LIKE PANDEMICS? COLLABORATIVE SCIENCE, THE RECOGNITION THAT SO MUCH OF WHAT WE DO REQUIRES TEAMS AND INTERDISCIPLINARY WORK. THAT--TO YOU DO WE CREATE MANAGE, HAVE ACCESS TO AND TAKE ADVANTAGE OF THE INFORMATION THAT'S IN DIGITAL DATA THAT'S A STRONG TEEM THROUGHOUT. SO THAT'S THE THAT'S THE FRAMEWORK IN WHICH ALL THE TEXT IS HUNG AND EXPLAINED. OKAY SO NOW TO MAKE IT MORE CONCRETE I WILL GIVE YOU EXAMPLES OF SPECIFIC PROGRAMS OR INITIATIVES THAT ARE CITED AND THE WAY WE EXPLICITLY THINK ABOUT IT IS WE DECIDED WE WOULD CITE ACCOMPLISHMENTS NOT JUST FORWARD LOOKING ACTIVITIES BUT THIS GIVES A GOOD SENSE OF WHAT THE AGENCY HAS DONE FOR THE PUBLIC. THEN PROGRAMS THAT ARE IN PROGRESS AND FUTURE GOALS SO THE PAST, THE PRESENT AND THE FUTURE AND IT'S ALL DIVIDED BY THE OBJECTIVES AND I WILL GIVE YOU EXAMPLES OF SOME OF THE HIGHLIGHTED CONTENT WITH A SPECIAL EMPHASIS ON NLM. SO DRIVING FOUNDATIONAL SCIENCES OR OBJECTIVE 1, WHOLE AREA OF ARTIFICIAL INTELLIGENCE, SO, NLM IS VERY MUCH INVOLVED IN THIS AS ARE MANY OF THE INSTITUTES BUT WHAT WE DESCRIBED HERE ARE SOME SPECIFIC DETAILS BUT THEN OUR OVERALL GENERAL APPROACH TO THE WORK ON ARTIFICIAL INTELLIGENCE AND IT'S OBVIOUS TO ALL OF YOU THAT ALL THE NEW TECHNOLOGIES ARE YIELDING DATA IN QUANTITIES AND AT A LEVEL OF COMPLEXITY THAT REQUIRE INCREASED CAPACITY FOR STORAGE MANAGEMENT AND ANALYSIS AND ARTIFICIAL INTELLIGENCE IS BEING USED ON LARGE DATA SETS TO UG MENTORSHIP SKILL HUMAN ABILITY TO DETECT PATTERNS AND PREDICT OUTCOMES. THUS SO IN THE DOCUMENT WE'VE EXPLAINED THAT IN ORDER TO TAKE ADVANTAGE OF THIS GLOBAL AREA, NIH AND WILL BUILD LARGE AND DIVERSE SETS OF PROGRAMS TO FOSTER MACHINE LEARNING, SUPPORT THE GENERATION AND MANAGEMENT OF LARGE DATA SETS THAT WE WILL CONVENE MULTIDISCIPLINARY TEAMS OF RESEARCHERS TO DO THIS AND WE WILL DEVELOP A SET OF ETHICAL PRINCIPLES FOR NIH FUNDED RESEARCHERS TO FOLLOW IN THE AI AREA. SO THIS LOCALLY DESCRIBES OUR APPROACH TO ALL OF THE AI PROGRAMS THAT WE WILL DO. NOW THIS--THE BRAIN INITIATIVE THIS IS A SPECIFIC PROGRAM, NOT A GLOBAL APPROACH TO WHAT WE DO BUT IT'S AN EXCELLENT EXAMPLE BECAUSE IT--WE'RE STILL ON THE OTHER SLIDE. >> ARE YOU? >> YEAH. >> OKAY I'VE GONE FORWARD. >> I THOUGHT YOU HAD BUT WE ARE NOT THERE WITH YOU. SO WE'RE STILL SEES THE OBJECTIVES IN THE CROSS CUTTING THEMES. DOES THAT DO IT? >> YOU'RE ADVANCING IN POWER POINT BUT NOT ADVANCING YOUR SLIDE SHOW. >> YOU HAVE TO BE--GO AHEAD GREG. ANY ADVICE ON HOW TO-- >> JUST CLICK ON THE SLIDE SHOW, CLICK YOUR MOUSE ON THERE, AND NOW HIT FORWARD, LIKE RIGHT OUT OF THERE ALL RIGHT, I'VE LOST SITE OF WHERE THAT IS JIM DO YOU THINK I HAVE YOUR SLIDES? >> I MIGHT BE ABLE TO TRY, I HAVE A MACINTOSH SO SOMETIMES THAT'S BETTER. CHRISTINE WHERE I WOULD I FIND THEM I'VE GOT RIGHT HERE. LET ME PULL IT UP JIM AND SEE IF I CAN ADVANCE FOR YOU. OKAY I RESTARTED THEM,. >> RIGHT. >> NOW IT'S LABORIOUS BUT I CAN FIX IT IF WE'RE GOING TO, THAT IS THE FRAMEWORK AND I AS I SAID I WILL GIVE YOU EXAMPLES FROM THE 3 OBJECTIVES OF OUR GLOBAL APPROACH TO AI RESEARCH AND THIS IS THE BRAIN INITIATIVE. THIS IS AN EXAMPLE OF--SINCE WE'RE TRYING TO REPRESENT WHAT ALL OF NIH DOES, WE'RE TRIED TO FIND EXAMPLES, MANY AND THERE ARE MANY PRESENTLIES THAT INVOLVE INTUITYS MOVING IT TOGETHER AND THE BRAIN INITIATIVE IS 1 SUCH PROGRAM. THIS IS REALLY--THE BRAIN BY WITH ACCELERATING NEW TECHNOLOGIES SO THE GOALS ARE TO MAP THE BRAIN CELL TYPES IN THEIR CONNECTIONS, DEVELOP TOOLS TO MONITOR MODULATE AND ANALYZE COMPLEX PATTERNS OF CIRCUIT ACTIVITY THAT WILL HELP EXPLAIN HOW THOUGHTS AND BEHAVIOR OCCURS AND IS CHANGED IN DISEASE SO THAT WE CAN RESTORE THESE CIRCUITS TO TREAT DISEASE. THIS INVOLVES MANY OF THE INSTITUTES, AS A CENTRAL MANAGEMENT AND JUST AN EXCELLENT EXAMPLE OF AN NIH WIDE COORDINATED PROGRAM. AS IS THIS 1. THE HEAL PROGRAM, THIS IS WAS LAUNCHED IN APRIL 18 AT THIS POINT SO IT'S ACCOMPLISHMENTS CURRENT AND FUTURE GOALS, THIS IS HELPING TO END ADDICTION LONG-TERM INITIATIVE, THIS IS BASED ON A VERY LARGE APPROPRIATE ARE APPROPRIATION FROM CONGRESS TO SPEED SCIENTIFIC CLIEWGZS TO STEM THE NATIONAL OPIOID PUBLIC HEALTH CRISIS. IT IS QUITE LARGE AND 2019 AWARDS OF GRANTS CONTRACTS COOPERATIVE AGREEMENTS WAS A LITTLE BIT OVER $945 MILLION ACROSS 41 STATES, SO, AGAIN, AN EXCELLENT EXAMPLE OF AN NIH WOOD COORDINATED PROGRAM. >> OKAY, I WILL MOVE ON TO NUMBER 2 SO THIS IS INFRASTRUCTURE, I ADVANCED AGAIN, YES, YOU DID. >> SO AGAIN THIS IS THE WORKFORCE AND PHYSICAL INFRASTRUCTURE THAT WE DEVELOP--THIS IS WHAT HAPPENS P A TTI WHEN YOU LET YOUR VISITORS TAKE OVER. >> I'M NOT GOING TO TELL ANYBODY, JIM. >> ALL RIGHT. IT'S RECORDED, I HEARD. THESE ARE A FEW EXAMPLES OF BOTH WORKFORCE AND INFRASTRUCTURE, AND THIS 1-TEXT IS CONTRIBUTED BY NLM, AND IS WHAT YOU FOLKS DO BUT IT'S A GOOD EXAMPLE OF HOW NIH WIDE WE IN CURE RESEARCH CAPACITY IN DATA SCIENCE. SO IT EXPLAINED HERE IS YOUR 16 UNIVERSITY WIDE, UNIVERSITY BASED PROGRAMS, YOUR PROGRAMS THAT WILL GO FROM HIGH SCHOOLS TO GRAD QUAT STUDENTS TO POST DOCS, YOU ARE SUPPORTING MORE THAN 200 Ph.D. AND POST DOC LEVEL TRAINEES. IN TRAINING AND WORKFORCE IN DATA SCIENCE WHICH IS AGAIN SOMETHING THAT NO 1 DOES FOR US. WHEN WE DEVELOP DATA SCIENCE STRUCTURE AND AGAIN NLM VERY MUCH INVOLVED IT'S OUR INTENTION TO USE THE FAIR PRINCIPLES OR TO MAKE THE DATA FINDABLE, ACCESSIBLE AND INTEROPEN MEETINGERABLE AND REUSABLE SO WHEN WE BUILD INFRASTRUCTURE FOR DATA THERE ARE 5 THEMES, HOW IS THE DATA INFRASTRUCTURE BUILT, WHY WE DO IT, STRATEGIES TO IMPROVE THE DATA ECOSYSTEM, THE TOOLS AND ANALYTICS THAT WE USE AND HOW THE COMMUNITIES ENGAGED AND WORKFORCE DEVELOPMENT BUT ALL OF THESE FOCUSED ON HOW TO MAKE DATA FAIR. ONE LAST EXAMPLE AND INFRASTRUCTURE, THIS IS THE FAVORITE FOR ME BECAUSE I'M RESPONSIBLE FOR THE COMMON FUND. THIS IS 1 OF OUR NEW PROGRAMS LAUNCHED IN 18, TRANSFORMATIVE HIGH RESOLUTION CRYO-EM. THIS ADDRESSING THE ISSUE THAT CRYO-EM HAS BECOME--HAS RAPIDLY BECOMES THE GOLD STANDARD FOR RAPID ATOMIC RESOLUTION OF STRUCTURES AND EVEN FOR TOMOGRAPHY OF STRUCTURES LIKE CELLS AND YET MOST OF OUR WORKFORCE WAS TRAINED TO DO X-RAY CRYSTALLOGRAPHY AND NMR BASED STRUCTURAL STUDIES, ALSO THE EQUIPMENT, THE INFRASTRUCTURE PHYSICALLY FOR THE WORK IS EXTREMELY EXPENSIVE AND SO IT'S NOT WIDELY DISTRIBUTED ACROSS THE COUNTRY SO AS A COMMON FUND PROGRAM WE TOOK ON DEVELOPING REGIONAL CAPACITY, INFRASTRUCTURE CAPACITY FOR DOING CRYO-EM AND TRAINING SO THAT WE CAN TRAIN THE WORKFORCE TO USE CRYOEM FINISH 1 OF THE MAIN STRUCTURAL APPROACHES SO THIS IS A BIT LIKE THE BEAM LINES AND WE HAVE CREATED CENTERS ACROSS THE COUNTRY ANDA A VERY ROBUST PRACTITIONER AND ALSO THEIR STUDENTS SO THIS IS A TRANSFORMING AN INFRASTRUCTURE APPROACH AND ALSO THE WAY WE DO SIGNINGS. AND THEN LAST OBJECTIVE AGAIN IS HOW DO WE PROMOTE THE HIGHEST LEVEL OF SCIENTIFIC IGF TEGGIC--STRATEGIC INTEGRITY AND PUBLIC ACCOUNTABILITY, AND SOCIAL RESPONSIBILITY IN THE CONDUCT OF SCIENCE. AND 1 OF MY IS PUBMED, YOU'RE WELL ACQUAINTED WITH THIS, THERE ARE CURRENTLY CONTAINS OVER 5.5 MILLION ARTICLES, MILLION ARTICLES, SUMMARIZE THE RESULTS OF NIH FUNDED FROM THE REST AROUND THE WORLD, WE COLLAB WAIT WITH 10 OTHER FEDERAL AGENCIES INCLUDING THEIR FUNDED RESEARCH IN PUBMED AND IT'S--IT'S CLEAR TO SAY, THE WORLD COULD NOT FUNCTION IN BIOMEDICAL RESEARCH WITHOUT PUBMED CENTRAL. SO THIS WE USE AS TRANSPARENCY, FOSTERING THE HIGHEST LEVEL OF REPRODUCIBILITY AND SCIENCE. ANOTHER 1 AGAIN FROM NLM, AN EXCELLENT EXAMPLE IS CLINICALTRIALS.GOV. AGAIN, THIS IS NOT NEW, IT'S AT LEAST A 20 YEAR-OLD PROGRAM BUT IT CO KNOW TIANYLS ALMOST A MILLION REGISTERED STUDIES. IT'S PUBLICLY AVAILABLE AND INCREASES TRANSPARENCY, ACCESSIBLE, PROVIDES DATA WE FUND AVAILABLE TO THE PUBLIC FOR THEIR KNOWLEDGE AND JUST AGAIN, LIKE PUBMED IS 1 OF THE GREAT EXAMPLES OF HOW WE FOSTER BIOMEDICAL RESEARCH AROUND THE WORLD. ANOTHER 2 QUICK EXAMPLES JUST IT GIVE YOU CONTEXT FOR WHAT WAS PUT IN TO EXPLAIN WHAT WE DO. PARTNERSHIPS, CONGRESS ASKEDITOUS EXPLAIN WHO WE PARTNER WITH, SO I'LL GIVE YOU 2 QUICK EXAMPLES OF PUBLIC PRIVATE PARTNERSHIPS, THIS 1 IS THE STRIDES INITIATIVE WHICH STRIDE STANDS FOR SUBSTANCE AND TECHNOLOGY WERE INFRASTRUCTURE FOR DISCOVERY, EXPERIMENTATION AND SUSTAINABILITY. THIS IS A PUBLIC-PRIVATE PARTNERSHIP WITH MANY OF THE CLOUD-SERVICE PROVIDER TO PROVIDE REDUCED COST ACCESS AND SOME RESEARCH TOOL ENHANCEMENTS ON THE CLOUD. SO WITH AN EFFORT OF TRYING TO MOVE PORE OF NIH'S DAT AND DATA ACCESSIBLE TO THE CLOUD, I WILL END WITH THIS EXAMPLE WHICH IS VERY CURRENT AND OTHER PRIVATE PARTNERSHIP IS ACTIVE, THIS IS ACCELERATING OSKT 19 THERAPEUTICS AND VACCINES, THIS IS A PUBLIC-PARTNERSHIP MANAGED BY THE FOUNDATION FOR NIH IT INVOLVES OVER 20 COMPANIES REPRESENTING WITH THE COMPANIES, CDC STAFF, FDA, DEPARTMENT OF DEFENSE, IT USED TO BE OPERATION WARP SPEED AND COLLECTIVELY AGREED ON HOW TO PRIORITIZE AGENTS TO MOVE INTO CLINICAL TRIALS FOR COVID-19 AND THEN HOW TO SUPPORT THEM AND HOW TO PRESENT THE DAILY BASIS AT TO THE PUBLIC, SO, YOU KNOW YOU SEE THIS IN THE NEWS BUT IT'S EASY TO FORGET THAT IN THE BACKGROUND IT'S A PRIVATE PUBLIC PARTNERSHIP THAT'S MOVING ALL OF THEM FORWARD FOR COVID-19 ANOTHER EXCELLENT EXAMPLE OF HOW WE PARTNER TO ACCOMPLISH THE WORK. AND THEN JUST FOR FUN IN THE LAST OR I WOULD SAY THE FIRST STRATEGIC PLAN WE DECIDED TO ADD BOLD PREDICTIONS. AND WE ADDED 14. I HAVE TO SAY WE HIT IT OUT OF THE PARK ON ABOUT A 7 AND PRETTY MUCH FLOPPED ON THE OTHER 7 SO THOSE WERE HIGH RISK. THIS WAS MET WITH SUCH ENTHUSIASM BY OUR INSTITUTE DIRECTORS BUT THERE ARE 34 BOLD PREDICTIONS IN THE CURRENT PLAN AND THEY RUN SORT OF A RANGE FROM FEASIBLE TO PROBABLY IMPOSSIBLE. CHOSEN A FEW HERE THAT ARE A LITTLE MORE DATA ORIENTED, JUST NOT ALL 34 BUT FOR EXAMPLE THE REGULAR USE OF GENOMIC INFORMATION FOR SO MAYBE WE WILL GET HALFWAY THERE IN THE NEXT 5 YEARS. NIH SUPPORT--WILL SUPPORT RESEARCH TO DEVELOP THE UNIVERSAL CORONAVIRUS VACCINE. THAT'S DEFINITELY NEEDED AND WILL SEE IF IT HAPPENS. SO AGAIN, JUST TO STIMULATE SOME INTEREST, CREATE SOME CONTROVERSY WE ENDED OUR PLAN WITH 34 BOLD PREDICTIONS. AND I JUST WANT TO TAKE THIS OPPORTUNITY TO THANK EVERYONE, OUR STAKEHOLDERS, FUNDED FOLKS, ADVOCACY GROUPS, SOCIETIES, CONGRESS FOR THEIR INPUT. WE HAD INPUT FROM MULTIPLE COUNCILS, THE INSTITUTE DIRECTORS, WHETHER THEY LIKED IT OR NOT THEY HAD TO LISTEN TO ME REGULARLY OVER A YEAR AND HALF AS WE DEVELOP THIS AND SOUGHT THEIR INPUT AND THEN THERE WAS A VERY LARGE NIH WIDE STRATEGIC PLANNING WORKING GROUP WITH SEVERAL FOLK FROM NLM THAT BROUGHT US TO THE COMPLETION, SO, I'M GOING TO LEAVE YOU WITH DAHLINGER AND SEE IF YOU HAVE ANY QUESTIONS. >> THANKS VERY MUCH, I WILL TURN IT BACK TO NEIL. >> SURE. >> THANK YOU. WE HAVE 2 BOARD RESPONDENTS THAT I WOULD LIKE TO INVITE TO HEAR FROM FIRST, PAUL WESTER AND CLAY JOHNSTON, IF YOU WANT TO GO AHEAD, PAUL OR CLAY, WE CAN HEAR FROM OTHER BOARD MEMBERS AS WELL. >> SO I CAN GO FIRST IF THAT'S OKAY, NEAL, THANK YOU FOR THE PRESENTATION, I DID WANT TO OBSERVE THERE WERE THRIVE OF THE BOLD PREDICTIONS AND THE 35th IS 1 OF MY FAVORITE WHICH IS IS NEW FORMS OF SCIENTIFIC COMMUNICATIONS SUCH AS PREPRINTS WILL SHORTIEN THE EVIDENCE TO PRACTICE CYCLE. >> YEAH, YEAH, YEAH. >> I DIDN'T WANT TO MAKE THAT OBSERVATION. THE OTHER THING I WANTED TO SAY IS I REALLY APPRECIATED HOW THE 3 MAIN PILLARS OF THE FRAMEWORK AND THE 5 CROSS CUTTING ITEMS REALLY HELP BRING TOGETHER ALL OF THE DIFFERENT ACTIVITIES ACROSS NIH AND ALSO GIVES A VERY GOOD OPPORTUNITY FOR NLM TO SHINE IN THE WAY THAT IT DOES, KIND OF HELPING DRIVE RESEARCH ACROSS THE INSTITUTES AND I REALLY APPRECIATE THAT AS SOMEONE WHO'S BEEN IN THE FEDERAL GOVERNMENT FOR OVER 30 YEARS AND INVOLVE WIDE STRATEGIC PLANNING EFFORTS WHERE EVERYONE'S FIGHTING WITH EACH OTHER AND MAKE SURE THEIR FACE IS SEEN IN THE PLAN, THE FRAMEWORK AND THE CROSS CUTTING ITEMS REALLY APPEAL TO ME AND HOW IT'S ORGANIZED. I JUST WANT TO SAY I REALLY APPRECIATE THE PRESENTATION AND ALLI BRINGS TOGETHER THE STRATEGIC DIRECTION OF THE INSTITUTES AND HOW NLM FIT INTOS IT. >> THANK YOU, PAUL. CLAY? >> YEAH, I ALSO, I THINK THE PRESENTATION WAS EXCELLENT. IT'S GREAT TO SEE THE STRATEGIC PLAN AND IT JUST REMINDS YOU ALL THE IMPORTANT WORK JUST SO CENTRAL TO LIFE IN THE U.S. ALL THAT HAPPENS AT THE NIEXPH SO NICE TO SEE IT DISTILLED DOWN INTO THE STRATEGIC PLAN AND I ALSO LOVE THE BOLD PREDICTIONS I THINK THEY'RE VERY INSPIRING AND THEY SHOW WHAT IT IS WHAT YOU ARE ALL ARE TRYING TO,A CHIEF AND YOU'RE HELPING TO GUIDE US IN DOING THAT, MY QUESTION HAS TO DO WITH WHAT'S IN BETWEEN THE BOLD PREDICTIONS IN THE PLAN AND HOW--WHAT THE NIH SEES ITS ROLE AS BEING AND THIS SITS UNDER YOU ALSO DR. ANDERSON, I'M SURE YOU THINK ABOUT THIS STUFF ALL THE TIME. YOU KNOW IT'S--IT'S, YOU KNOW ARE WE--HOW DO WE KNOW WE'RE SUCCESSFUL 5 YEARS FROM NOW. HOW DO WE KNOW WE'VE DELIVERED ON THESE OBJECTIVES AND YOU KNOW IT'S--1 OF THE THINGS ABOUT NIH AND THIS HAS BEEN WONDERFUL FOR US THAT EXTRAMURAL TO HNIH IS YOU ALL SAY, WELL WE NEED TO FIND THE RETIRED THINGS TO FUND AND THEN YOU ALL WILL DO THE GOOD WORK AND YOU KNOW WE LOVE THAT ON THE OUTSIDE BUT THE QUESTION IS, ARE YOU FUNDING THAT THE RIGHT WAY, ARE WE DOING THE RIGHT GOOD WORK, ARE WE DOING IT AS EFFECTIVELY AS WE DID, EFFICIENTLY AS WE CAN, AS RAPIDLY AS WE CAN WITHOUT WASTE AND YOU HAVE SOME AREAS IN THERE WHERE YOU TALK ABOUT NIEXPH ALSO YOU TALK ABOUT INFRASTRUCTURE AND SUPPORTING IT. BUT TO ME 1 OF THE QUESTIONS I KEPT ASKING IS, ARE YOU SUPPORTING IT THE RIGHT WAY, DO WE KNOW THAT, IS, YOU KNOW CRYOEM REALLY THE RIGHT INVESTMENT RIGHT NOW? A NUMBER OF TRIALS DONE ON A PLATFORM INVOLVING MULTIPLE SITES USING DDATABASE AT FOR THOSE TRIALS AND FOLLOW THEM UP. GOT AHEAD OF US BUT NOW WE'VE GOT WONDERFUL THINGS THAT WE'RE DOING IN A SIMILAR SPACE, ACTIVE N3 C ARPA-H, THOSE ARE GREAT EXAMPLES OF WHERE WE MAKE THE INFRASTRUCTURE EFFICIENT AND PRODUCTIVE AND WE CAN SHOW THAT IT LEADS TO MUCH MORE RAPID SCIENCE FOR THE BENEFIT OF SOCIETY. SO MY QUESTION IS THERE ARE OPPORTUNITIES TO BE EVEN MORE ACCOUNTABLE IN THESE AREAS, AND TO BUILD THAT INTO, WELL IT'S REALLY INTO YOUR OFFICE BUT MAYBE INTO A BIT OF THE STRATEGIC PLAN 5 YEARS FROM NOW. >> THAT IS A WIDE RANGING QUESTION. >> SORRY. >> [LAUGHTER] BECAUSE IT BASICALLY COVERS WHAT DO WE DECIDE TO DO AND HOW DO WE EVALUATE WHETHER IT WORKED. AND IT RUNS A WHOLE SPECTRUM FROM HOW DO WE DECIDE WHAT'S WORTH WORKING ON, AND IN SOME CASES WE USE THINGS LIKE WHAT IS THE BURDEN OF DISEASE AND SO THAT DRIVES INVESTMENTS MORE IN THAT DIRECTION. REMEMBERING THAT WE ALSO NEED TO FUND BASIC SCIENCE BECAUSE WE DON'T KNOW WHERE THE FUTURE INFORMATION IS GOING TO BE NEEDED TO SOLVE A PRACTICAL CLINICAL PROGRAM PROBLEM. SO HOW DO WE DECIDE WHAT WE'RE GOING TO DO RESEARCH ON. EACH INSTITUTE IS A LITTLE BIT DIFFERENT BUT THEY RELY ON THEIR STAKEHOLDERS BEST JUDGMENT, THEY RELY ON THINGS LIKE WHAT IS THE BURDEN OF DISEASE IN OUR AREA OF RESEARCH AND IT TURNS INTO PROGRAMS, FUNDED PROGRAMS THAT WE NEED TO EVALUATE THEIR SUCCESS AND THAT'S A WHOLE SPECTRUM, TOO, AT SOME END WE--1 END WE JUST ASKED, DID ANYTHING COME OUT OF IT. AND THAT'S AS SIMPLE AS HOW MANY PUBLICATIONS WERE PRODUCED BY THAT PORTFOLIO FUNDED WORK, WHAT'S THE IMPACT OR QUALITY OF THE WORK THAT CAME OUT BY SOME OBJECTIVE METRIC OR EXPERT OPINION AND THEN FURTHER DOWN, ALL WE REALLY CARE ABOUT IS WHERE DID IT IMPROVE HUMAN HEALTH? AND THAT TENDS TO BE DISTANT FROM MOST THINGS NIH DOES EXCEPT FOR DID WE DECREASE LENGTH AND LIFE SPAN OF A PARTICULAR LEUKEMIA OR DECREASED THE INCIDENCE OF A CANCER? DID CMS AGREE TO PICK UP THE FUNDING FOR SOME INTERVENTION THAT NIH DISCOVERED THROUGH OUR RESEARCH. SO, YOU HAVE ASKED THE--THE BIG QUESTION WHAT DO WE DECIDE TO INVEST IN HOW DO WE KNOW IT'S THE RIGHT THING? AND DO WE USE METRIC FIST ARE THAT? IT'S INTERESTING YOU BRING THAT UP BECAUSE CONGRESS INTRODUCED A COUPLE OF YEARS AGO WHAT THEY CALL THE EVIDENCE ACT WHERE WE'RE NOW IN THE PROCESS OF COLLECTING THE INFORMATION AND THE PUBLIC AND CONGRESS TO EXPLAIN, FOR WHAT'S THE DATA WE USE TO MAKE ALL OF THOSE DECISIONS. SO I THINK YOU AM SEE MORE ABOUT THAT IN COMING YEARS BUT THAT IS SUCH A GOOD QUESTION. >> THANK YOU. AND I THINK WE HAVE ANOTHER QUESTION FROM JIM. GO AHEAD. >> I THINK HE'S FROZEN. >> WE ARE HAVING MORE TECHNICAL DIFFICULTY TODAY THAN WE HAD PREVIOUSLY. >> YEAH. >> ARE THERE OTHER COMMENTS OR QUESTIONS? SO WHAT I WANTED TO BRING TO THE ATTENTION HERE IS NLM IS A LITTLE BIT OFFCYCLE, THE NIH STRATEGIC PLANNING PROCESS BECAUSE WE DID OURS IN 2017 AND AS JIM WAS ANNOUNCING THIS, REALLY IS CONSIDERED A 2021 ACTIVITY. SO WHEN WE DO OUR RENEWAL IN 20 TWEIVE, WE WILL BE RIGHT THERE WITH YOU, JIM. BUT IN THE MEAN TIME I WAS WONDERING ABOUT REPORTING MIDCYCLE, WE'VE BEEN SPENDING A LOT OF TIME IN OUR LEADERSHIP DISCUSSING HOW TO SHOW PROGRESS TOWARDS THE STRATEGIC PLAN AND YOU KNOW THAT LEE IN OUR GROUP HAS BEEN VERY ACTIVE IN THINKING ABOUT THE CONNECTION BETWEEN THE INSTITUTE AND THE NIH BUT DO HAVE YOU ANY GUIDANCE FOR US? THERE'S NO STANDARD WAY TO DO THAT AND NOT EVERYONE DOES A PEER REVIEW. MY--YOU MEET THE GOALS YOU SET. DID YOU ACCOMPLISH THEM? HOW FAR LONG ARE YOU? IT'S ALSO A GOOD OPPORTUNITY TO THINK ABOUT WHETHER YOU HAD THE RIGHT GOALS. >> YEAH OR WHETHER YOU WANT TO CHANGE SOMETHING NOW, OR DEVELOP THE INTENT THAT IT'S GOING TO CHANGE WHEN YOU HAVE YOUR NEXT STRATEGIC PLAN. THERE'S NOT A THIS IS NO SURPRISE TO YOU P A TTI, THERE'S NO NIH-WIDE WAY THEY DO THAT BUT MOST DO SOME MIDCOURSE LAB MEETING. >> YEAH,. >> ARE WE ON TRACK? >> YEAH, SO MIKE, I JUST WANT YOU TO REMEMBER WE SHOULD TALK ABOUTA THAT ISSUE DID WE SELECT THE RIGHT TARGETS, THAT'S THE CONVERSATION WE HAVEN'T HAD TOO OFTEN AND I WOULD LIKE TO COME BACK TO THAT. AND I SEE THE DOCTOR HAS JOINED US. >> SORRY, YOU KNOW THE 1 TIME I DECIDE TO OPEN MY MOUTH, THE INTERNET DECIDED I SHOULDN'T. SO THANK YOU FOR THE PRESENTATION, I'M JIM WITH THE UNIVERSITY OF ALABAMA FORMERLY NIH, AND AND MAYBE IT'S BECAUSE IEMG A BIOMEDICAL INFORMAITITION AND SO EVERY PROJECT AND PROGRAM THAT YOU PRESENTED TO ME, LOOKED LIKE AN INFORMATICS MAIL, YOU KNOW AND WE HAVE THE HAMMER, THE QUESTION IS DO YOU THINK THAT THE NLM TRAINING, SUPPORTING THE TRAINING OF 200 BIOMEDICAL INFORMAITITIONS AND DAILY BASIS THEA SCIENTIST SYSTEM ENOUGH? SORE SHOULD NIH EITHER THROUGH NLM OR OTHER INSTITUTES BE INVESTING MORE HEAVILY IN THIS TRAINING? >> I WILL TURN THAT OVER TO P A TTI. >> AS LONG AS YOU'RE GOING TO WRITE ME A CHECK, JIM, THAT'S FINE. WE TALKED A LOT ABOUT THIS JIM BECAUSE WE KNOW THE NLM DOESN'T HAVE THE CORNER ON THE MARKET OF DATA SCIENCE TRAINING AND YET WE KNOW THAT PROBLEM INSPIRED DAILY BASIS THEA SCIENCE METHODS, RARELY SCALE TO THE DIMENSION THAT THEY NEED TO AND MORE IMPORTANTLY, THAT SOME OF THE THINGS THAT ARE BASIC TENETS OF STANDARD NOMENCLATURE AND DEFINITIONS WOULD ENHANCE THE EXCHANGE OF BOTH MODELS AND THE RESULTS OF THE MODELS. I KNOW THAT LISA FEDERER FROM OUR GROUP HAS BEEN WORKING ACROSS THE NIH TO MAKE SURE THERE'S LANGUAGE IN THE DIFFERENT TRAINING PROGRAMS THAT SPEAKS TO THE NEED TO INTRODUCE CONCEPTS OF DATA SCIENCE, ANALYTICS AND INFORMATICS ACROSS ALL THE PROGRAMS AND YET AS JIM ANDERSON NOTED THERE IS NO HEAD NURSE AT NIH AND SO THERE'S NO WOON THAT SAYS THIS SHALL INCLUDE AND THIS IS WHAT THE COMPETENCIES WE WOULD EXPECT OF PEOPLE. SO IT'S KIND OF A JOURNEY. I WOULD BE OPEN TO YOUR THOUGHTS ESPECIALENTIALLY AS WE THINK ABOUT WHERE OUR--WHAT KINDS OF TRAINING BEYOND FORMAL DEGREE TRAINING WE SHOULD BE INVESTING IN. >> YEAH, YEAH, I WANT TO ADD THAT WHENEVER THERE'S AN NIH WIDE CONVERSATION NLM IS ALWAYS IN THE ROOM. >> YES, THAT'S TRUE. >> AND I LOOK THROUGH AS THE DEFAULT LEADERS IN WHATEVER THE FUTURE REQUIREMENTS NEED TO BE. >> I THANK YOU FOR POINTING THAT OUT AND THAT REFLECTS THE EFFORTS OF ALL THE LEADSHIP AND STAFF HERE, WEED MADE IT CLEAR WE'RE NOT TRYING TO TAKE IT OVER BUT WE ARE TRYING TO EN--STRATEGIES HANS-PETER AND ENRICH. >> ABSOLUTELY. >> JIM, ANYMORE TO ADD ABOUT THINGS WE COULD BE LOOKING INTO OR THINK BEING AS TRAINING GOES FORWARD? >> WELL, YOU KNOW PART OF IT IS PART OF THE APPROACH SHOULD CERTAINLY BE TO IPT GREATER CLUED POST DOCTORAL SUPPORT IN OTHER RESEARCH PROGRAMS BUT YOU HAVE THIS CHICKEN AND EGG PROGRAM, RIGHT PROBLEM BECAUSE YOU GET AN INFORMATICS POST DOC AND PUT THEM IN SOMEWHERE WHERE THERE'S NO MENTORSHIP AND IT REALLY ISN'T AN INFORNLATTICS TRAINING EXPERIENCE, SO IT REALLY IS, I THINK A NEED TO INVEST IN--I MEAN I WILL SAY IT, UAB, WE HAVE A DIRTH OF PEOPLE YOU WOULD CALL DATA SCIENTISTS AND WE WOULD LIKE TO RECRUIT SOME BUT IT'S, YOU KNOW HARD FINDINGS 1S THAT ARE PROPERLY TRAINED AND ARE COMING UP AND HAVE EXPERIENCE AND YOU KNOW I THINK THAT'S AN AREA THAT NEEDS TO BE LOOKED AT AS AN INVESTMENT IN THAT KIND OF FORMAL TRAINING BUT IN THIS. >> OUR DIVISION IS THE OFFICE OF DATA SCIENCE STRATEGY WHICH P A TTI OFTEN WORKS WITH AND THIS GROUP IS CHARGED WITH AT LEAST GETTING PEOPLE IN THE ROOM TO SOLVE SOME OF THE NIH-WIDE DATA PROBLEMS WE DEAL WITH. WE PRESENTED TO OUR COUNCIL A TRAINING INFORMATICS TRAINING PROGRAM CONCEPT AND THE COUNCIL DIDN'T APPROVE IT. AND THEIR CONCERN WAS THAT IT'S JUST WHAT YOU SAY, THAT WE DON'T KNOW HOW TO CONNECT INFORMATICS TRAINING WITH SPECIFIC DISCIPLINES LIKE PHYSIOLOGY OR BIOPHYSICS. THEY'RE NOT INTEGRAL AND PART OF THE TRAINING IN THOSE PROGRAMS. SO HOW DO YOU BRING 2 GROUPS TOGETHER TO BECOME PART OF A TRAINING PROGRAM WITHIN A STRUCTURE OF A UNIVERSITY THAT'S DIVIDED BY DEPARTMENTS, ET CETERA. I THINK THIS IS REALLY AS DEPARTMENT CHAIR, I THINK THIS IS REALLY CHALLENGING, TO BRING A FUNDAMENTAL SKILL LIKE INFORMATICS INTO DISCIPLINES. >> LYOU KNOW A LOT OF YRTS NOW HAVE DEPARTMENTS OR CENTERS OF INFORMATICS AND DATA SCIENCE AND THEY DON'T WORK IN ISOLATION. THEY DON'T JUST SIT THERE AND YOU KNOW, WRITE PROGRAMS AND MAKE SURE THEY RUN TO COMPLETION WITHOUT ERROR MESSAGES, THEY ARE WORKING WITH SCIENTISTS, BENCH SCIENTISTS, CLINICAL RESEARCHERS, PRACTITIONERS, NURSING PHYSICIANS AND SO ON, TO ADDRESS THEIR INFORMATION NEEDS AND THEIR INFORMATION CHALLENGES SO THAT AT THE SAME TIME THEY'RE APPLYING KNOWLEDGE FROM THE FIELD OF INFORMATICS TO A DOMAIN AND THEY'RE LEARNING FROM THE DOMAIN WHAT THE SPECIAL NEEDS ARE OF THOSE DOMAINS, SO, I THINK THAT IF YOU LOOK AT THE--FOR INSTANCE THE TRAINING, 16 TRAINING PROGRAMS THAT NLM IS FUNDING NOW, THEY ALL HAVE CROSS COLLABORATIONS WITH, YOU KNOW LOTS OF DEPARTMENTS AND THEN THERE ARE ALSO CENTERS AND INTUITYS, YOU KNOW NOT--THINGS THAT AREN'T FORMAL DEPARTMENTS THAT HAVE THAT CAPABILITY AS WELL. >> ONE OF MY JOBS IS KEEPING AN EYE ON THE CLOCK, AND WE ARE UPAND AGAINST A 15 MINUTE BREAK TIME. SO ANY ADDITIONAL COMMENTS OR QUESTIONS FOR DR. ANDERSON BUT GAIN, THANK YOU FOR JANING US AND THANK YOU FOR YOUR PRESENTATION. WE ARE GRATEFUL. >> THANK YOU VERY MUCH. SORRY ABOUT THE TECHNICAL PROBLEMS AND. >> YOU PERSEVERED. >> GOOD, THANK YOU. >> THANK YOU VERY MUCH FOR BEING HERE, JIM, AND I REALLY APPRECIATE IT AND THANK YOU FOR THE WORK YOU DID IN ORCHESTRATING THIS STRATEGIC PLAN, IT WAS QUITE PAINLESS FOR ALL OF US TO WORK ON SO WE REALLY PUT A GOOD PROCESS TOGETHER, THANK YOU. >> THANK YOU. >> BYE. >> AND WE'LL BE BACK AT 2:45 IS THAT CORRECT? >> THAT'S RIGHT. >> SO 15 MINUTES, BACK AT 2:45. WE HAVE ANOTHER GUEST TO WELCOME AT THIS POINT IN THE MEETING. AND I DON'T HAVE CONFIRMATION THAT THEY'RE HERE BUT I WILL ASSUME THAT SHE IS. THANK YOU KRISTI AND GO AHEAD AND INTRODUCE HER. DR. JESSICA ANCHOR IS VICE PRESIDENT OF AFFAIRS OF BIO-INFORMATICS AT VANDERBILT UNIVERSITY. DR. ANCHOR SUPER VISES THE VANTER BUILT A TRAINING PROGRAMS IN BIO-INFORMATICS AND SERVES AS NPI FOR THE T15 TRAINING PROGRAM. SHE EARNED HER DEGREE IN BIOSTATISTICS AND BIOINFORMATICS FROM COLUMBIA UNIVERSITY. HER CURRENT PROJECT ENTITLED MAKING NUMBERS MEANING EMPLOY AND PROPLOATING EVIDENCE-BASED COMMUNICATION OF NUMBERS IN HEALTH. IS SYNTHESIZING EVIDENCE ABOUT HOW TO EFFECTIVELY PRESENT HELT RELATED NUMBERS AND DAT TO INDIVIDUALS OF ALL LIT RASE MODEL SKPE BAKUGAN EDUCATIONAL LEVELS. WELCOME DR. ANC KER. >> THANK YOU SO MUCH FOR HAVING ME, I AM EXCITED TO HAVE OPPORTUNITY TO TALK TO EVERYBODY, I SEE MANY FAMILIAR NAMES SO I LOOK FORWARD TO DISCUSSION AFTERWARDS AS WELL. SO AM I SHARING THE RIGHT SCREEN HERE? CAN EVERYONE SEE? GREAT, THANKS SO MUCH, SO YES, THANKS SO MUCH FOR INVITING ME TO TALK ABOUT THE--THIS NATIONAL LIBRARY OF MEDICINE FUNDED PROJECT. I THINK WITH THIS AUDIENCE, EVERYONE'S QUITE FAMILIAR WITH THE LOW PREVALENCE OF LITERACY AND HEALTH LITERACY IN THIS COUNTRY AND WE'RE AWARE OF THE CHALLENGES THAT THAT POSES WHEN WE ARE DISSEMINATING HEALTH INFORMATION BUT IT MIGHT BE LESS FAMILIAR TO THIS AUDIENCE THAT LOW NUMERACY IS EVEN MORE COMMON THAN THROW LITERACY. THE 2 ARE CORRELATED, LOW UNIVERSITY IS MORE PREVENTIVE LEBT IN THE LOWER LITERACY LEVELS BUT IT'S STILL QUITE COMMON AMONG PEOPLE WITH HIGHER LEVELS OF EDUCATION AND LITERACY, SO WHAT THIS MEAN SYSTEM WE HAVE A SIGNIFICANT PROPORTION OF THE POPULATION WHO HAS DIFFICULTY ACCESSING NUMBERS IN INTERPRETING AND MOST IMPORTANTLY APPLYING THEM TO THEIR HEALTH MANAGEMENT AND PERSONAL HEALTH DECISIONS. AT THE SAME TIME OF COURSE, WE HAVE THIS EXPLOSION OF HEALTH DATA AND HEALTH NUMBERS AVAILABLE. WE'VE SEEN THE POWER OF THE PUBLIC HEALTH LEVEL DATA SO, WE'RE REALLY IN THIS EXPLOSION OR FIRE HOSE OF DATA AND NUMBERS, BUT WE'RE IN THE SITUATION WHERE THERE'S A PRETTY SIGNIFICANT PROPORTION OF PEOPLE WHO ARE NOT ACCESSING IT AND NOT APPLYING IT AT THE LEVEL THAT IT WOULD REALLY BE MOST HELPFUL. THIS IS A CONCERN TO US BECAUSE IT'S A REZONING PEE FOR WHAT WE CALL INTERVENTION GENERATED INEQUALITY. WHAT THAT MEANS IS WE'VE CREATED AN INTERVENTION, IN THIS CASE, THE ACCESS TO DATA AND NUMBERS. AND YET NOT EVERYBODY HAS THE ABILITY TO DEN FIT FROM THAT TO THE SAME DEGREE. AND IN PARTICULAR, THE PEOPLE WHO ARE NOT BENEFITING FROM IT, TO THE LEVEL THAT THEY COULD ARE ALSO THE PEOPLE WHO ARE DISADVANTAGED IN TERMS OF EDUCATION OR LITERACY. SO AN INTERVENTION-GENERATED INEQUALITY AND CREATED ORAX ESTIMATE THADER BAITED BY WHAT WE'RE TRYING TO DO WHICH IS DISSEMINATED INFORMATION. SO WHAT I WOULD LIKE TO TALK ABOUT TODAY IS WHAT CAN WE DO ABOUT THIS? AND I'D LIKE TO PRESENT THE BEGINNING HERE AS A LITTLE BIT OF A MYSTERY WITH CLUES. SO I WOULD LIKE TO PRESENT THE FIRST CLUE OF SOME OF THE RESEARCH THAT SET ME ON THIS TRACK. SO THIS CLUE IS A RESEARCH STUDY OF WOMEN IN THIS OBGYN WAITING CLINIC LIST AND THEY WERE ASKED WHICH OF THESE 2 RISK SYSTEM BIGGER, HALF OF THEM GOT THE VERSIONOT LEFT, HALF GOT THE VERSION ON THE RIGHT AND IT MIGHT NOT BE IMMEDIATELY APPARENT BUT IF YOU DO BEHIND THE SCENES CALCULATION YOU CAN SEE THEY'RE THE SAME. THAT IS 1 IN 3 IS THE SAME AS 2.6 PER THOUSAND AND 1 IN 12 IS THE SAME AS 8.9 PER THOUSAND. BUT ALTHOUGH THEY'RE MATHEMATICALLY EQUIVALENT, THEY'RE COGNITIVELY DIFFERENT. SO WHAT WE SEE IS THAT THE 1 AND X VERSION, THE VERSION ON THE LEFT, ONLY ABOUT MORE THAN HALF OF WOMEN GOT THAT ANSWER RIGHT THAT THEY CORRECTLY IDENTIFIED THAT 1 AND 112 IS BIGGER. MAZARA IN THE RATE FOR THOUSAND FORMULATIONOT RIGHT, MORE THAN 3-QUARTERS DID SO, SO MATHEMATICALLY EQUIVALENT COGNITIVELY VERY DIFFERENT. SECOND CLUE, VERY DIFFERENT TYPE OF NUMBER HERE, THIS IS MEDICATION INSTRUCTIONS SO THIS IS THE SORT OF THING THAT MIGHT BE ON ANYBODY'S PILL BOLGT. SOME PATIENTS WERE GIVEN THE INSTRUCTION VERY STANDARD, I THINK INSTRUCTION, TAKE 1 PILL BY MOUTH EVERY 12 HOURS, OTHERS WERE GIVEN THE SECOND FORMULATION THAT'S ACTUALLY 2 SENTENCES SO IT IS LONGER BUT IT SAYS TAKE 2 PILLS BY MOUTH EVERY DAY, TAKE 1 IN THE MORNING AND 1 IN THE EVENING. THE DIFFERENCE, THE COG NIPERFORMANCE DIFFERENCE IN THIS 1 IS REALLY SHOCKING AND IT SHOULD BE SHOCKING BECAUSE THE TOP 1 IS THE STANDARD APPROACH WE PUT ON PILL BOLGTS BUT ONLY A THIRD OF LITERACY PATIENTS WERE ABLE TO CORRECTLY DESCRIBE TO THE NURSE WHEN THEY WERE GOING TO TAKE THE DRUG WHEREAS IN THE SECOND FORMULATION, WITH WHAT WE CALL REALTIME ANCHORS MORE THAN 3-QUARTERS WERE ABLE TO DO SO. SO AGAIN ANOTHER EXAMPLE OF MATHEMATICAL EQUIVALENT COGNITIVELY VERY DIFFERENT. AND THE THIRD CLUE, I WILL NOW TAKE FROM A COMPLETELY DIFFERENT TYPE OF DATA, THIS IS THE TYPE OF DATA YOU MIGHT FIND IN YOUR ELECTRONIC PATIENT PORTAL ACCOUNT. VISIT BY MY COLLABORATOR AND MY CO INVESTIGATOR ON THIS PARTICULAR GRANT, FISHER FROM MICHIGAN, HERE'S A RESULT WE MIGHT FIND IN OUR PATIENT PORTAL THAT'S LIKELY TO BE UNFAMILIAR. A LOT OF PEOPLE WILL NOT KNOW WHAT PLATELET COUNTS ARE AT ALL AND THEY WILL NOT KNOW WHAT A GOOD VALUE IS OR A BAD VALUE. SO, BRIAN EXPERIMENTED WITH A NUMBER OF DIFFERENT NUMBER LINE VISUALIZATIONS PLACING THIS RESULT IN CONTEXT OF WHETHER IT WAS LOW, STANDARD, OR HIGH. AND AGAIN WE SAW ENOSH NORMOUS INCREASES IN THE PROPORTION OF PATIENT WHO IS COULD FIRST OF OF ALL CORRECTLY IDENTIFY THAT THE RESULT WAS OUT OF RANGE BUT ALSO I THINK VERY IMPORTANTLY FOR THE MEDICAL SYSTEM POINT OF VIEW, MORE PATIENTS WERE ABLE TO CORRECTLY IDENTIFY THIS AS A BORDER LINE RESULT, AND TO SAY THAT THEY WERE LESS CONCERNED BY THE BORDER LINE RESULT THAN THEY WOULD BE ABOUT AN EXTREME RESULT WHICH HAS VERY STRONGLY IMPLICATIONS FOR HOW PEOPLE ARE GOING TO REACT, WHETHER THEY CALL THEIR DOCTOR, ASK FOR CLRIFICATION OR EVEN TRY TO TAKE SOME SELF-MEDICATING TYPE APPROACH. SO, THESE ARE A FEW OF THE CLUES FROM THE LITERATURE SHOWING THAT HEALTH LITERACY AND NUMERACY IS NOT--SKILLS, KNOWLEDGE, EXPERIENCE, THEY BRING THEIR DESIRES AND NEEDS FOR INFORMATION TO THE TABLE. BUT THEY'RE NOT THE ONLY PLAYER HERE. THE PERSON PROVIDING THE INFORMATION IS BRINGING COMMUNICATION SKILLS AND THOSE COMMUNICATION SKILLS ARE INCREDIBLY IMPORTANT ABOUT WHETHER THE PATIENT IS ACTUALLY GOING TO BE ABLE TO INTERPRET AND APPLY THAT INFORMATION. AND THEN OF PARTICULAR INTEREST, I THINK IN TO THE NLM AND INFORMATICS IN GENERAL IS THE INFORMATION ARTIFACT, OFTEN COMMUNICATION IS MEDIATED BY OR CONDUCTED VIA SOME SORT OF ARTIFACT, SO IT COULD BE A PATIENT LEAFLET OR AN EDUCATIONAL BROCHURE, WEBSITE, AN APP, A DEVICE, ANY OF THESE THINGS ARE AN ACT FACT THROUGH WHICH INFORMATION IS PRESENTED TO THE PATIENT OR THE PATIENT INTERACTING WITH INFORMATION AND THE INFORMATION DESIGN OF THESE ARTIFACTS IS ALSO INCREDIBLY IMPORTANT. SO, WHAT WE SEE IS THAT WHEN THESE ARE ALIGNED, WHEN WE HAVE A HEALTHCARE SYSTEM AND A SOCIAL SYSTEM IN WHICH THESELY ELEMENTS ARE ALIGNED, PATIENTS BEGIN TO ACT IN LITERATE OR ENUMMER 8 WAITS THAT IS THEY MAKE PRODUCTIVE USE OF THE INFORMATION AND THEN WHEN THERE IS A MISALIGNMENT, THEY DON'T. SO, THERE'S BEEN A--SORT OF A PUSH IN HEALTH LITERACY WORLD TO REDEFINE HEALTH LIT RASE MODEL SKPE BAKUGAN HEALTH NUMERACY AS EMERGING PROPERTIES, RATHER THAN STATIC PROPERTIES OF A PATIENT, THEY ARE ACTIVITIES THAT EMERGE OUT OF THE SYSTEM AND WHAT I'M GOING TO BE FOCUSING ON TODAY ARE THESE TO ELEMENTS OF THE SYSTEM, THE INFORMATION PROVIDER AND THE INFORMATIONART FACTS RATHER THAN WORKING DIRECTLY WITH PATIENTS. THIS DEFINITION OF HEALTH LITERACY HAS INFORMED A NUMBER OF GOVERNMENTAL POLICIES, IN THE HEALTHY PEOPLE 2010 ITERATION. HEALTH LITERACY AS CAN YOU SEE HERE WAS DEFINED AS AN INDIVIDUAL CAPACITY OR SET OF SKILLS AND YET IN THE 2030 VERSION HEALTH LITERACY IS SEEN AS SOMETHING THAT OCCURs, AS AN ACTIVITY THAT OCCURS WHEN SOCIETY PROVIDES INFORMATION IN A WAY THAT PEOPLE CAN FIND IT, PEOPLE CAN UNDERSTAND IT AND PEOPLE CAN USE IT. SEE HOW DO WE HELP MAKE A HEALTH LITERATE SOCIETY, HOW DO WE MAKE THIS A ROALT? IF YOU'RE INTERESTED IN MAKING INFORMATION ACCESSIBLE TO PATIENTS, THERE'S ACTUALLY QUITE A LOT OF REALLY GREAT RESOURCES OUT THERE FOR TEXT, FOR PAMPHLETS, BROCHURES, WEBSITES AND THAT PROVIDES REALLY ACTIONABLE AND USEFUL GUIDANCE ABOUT HOW TO WRITE FOR MEMBERS OF THE PUBLIC AT DIFFERENT LITERACY LEVELS. BUT NONE OF THESE REALLY GO INTO MUCH DEPTH INTO NUMBERS. THEY ACKNOWLEDGE THE IMPORTANCE OF NUMBERS BUT THEY DON'T REALLY PROVIDE THE GUIDANCE YOU MIGHT NEED TO ACTUALLY DO THIS. AND THAT'S WHERE WE HOPE TO WIN. THIS PROJECT FUNDED THROUGH AN EXPRESS RO1 THROUGH NLM IS TO CREATE AN EVIDENCE-BASED ONLINE GUIDE FOR THE COMMUNICATOR, FOR THE PERSON WHO'S PROVIDING THE INFORMATION. THIS HAS 3 STEPS, WE BEGAN WITH THE SYSTEMATIC REVIEW, DEVELOPING THEN AN ONLINE DECISION SUPPORT SYSTEM FOR PROFESSIONAL COMMUNICATORS AND THEN FORMATIVE AND SELF-EVALUATION. SO WE BEGAN WITH THE SYSTEMATIC LITERATURE REVIEW FOLLOWING PRISMA PRINCE ARE PELES AND IT IS VERY BROAD, OUR PATIENT POPULATION WE'RE INTERESTED IN IS BASKLY INTB. WE EXCLUDED COMMUNICATION WITH MEDICAL PROFESSIONALS OR PEOPLE WITH HEALTH RELATED OR MEDICAL DEGREES BUT PRETTY MUCH ANYBODY ELSE WAS IN OUR SCOPE HERE. THE INTERVENTIONS WE WERE INTERESTED IN WERE ALSO QUITE BROAD, REALLY INTERESTING HAVING TO DO WITH NUMBERS, INCLUDING RISKS, LABS, PROs, AIR QUALITY INDICATORS, MEDICATION INSTRUCTIONS. AND THE--WE LIMITED THIS SEARCH TO STUDIES THAT DID HEAD-TO-HEAD COMPARISONS OF 2 DIFFERENT WAYS OF PRESENTING THE SAME QUANTITATIVE CONCEPT SO THAT MEANT WE DID NOT INCLUDE A LOT OF VERY GOOD RESEARCH THAT WAS MORE ABOUT PARTICIPATORY USER DESIGN OR USER CENTER DESIGN OF NOVEL MATERIALS, WE'RE REALLY LOOKING AT THE EVALUATION OF THOSE MATERIALS. AND THEN, WE INCLUDED A NUMBER OF DIFFERENT COMFYREHENS RELATED OUTCOMES AND THIS WAS REALLY BROAD AND THIS HAS BEEN A LARGE TEAM EFFORT, MY CO INVESTIGATORS ON THIS PROJECT ARE BRIAN ZIKMUND-FISHER AND OTHERS LISTED HERE. WE DID PAIR WISE SCREENING AND, VALENTINEDUATION AND RISK COMMRINESS AND QUALITY EVALUATION AND HIT EXTRACTION AND STANDARDIZED SYNTHESIS TOGETHER WITH A TEAM HERE AND HUGE ACKNOWLEDGMENT TO OUR LIBRARIAN TEAM DIANNA DELGADO AND MICHELLE [INDISCERNIBLE] AT CORNELL. I WILL GIVE AWE A FLAVOR OF OUR FIRST RESULTS. OUR FIRST RESULT PAPER IS ACTUALLY OUT. IT'S AHEAD OF PRINT SO IT'S ON THE VERGE OF BEING OUT. AND THIS 1 WAS WE SLICED OUT THE LITERATURE ON HOW PEOPLE INTERPRET VERBAL XREAGZS OF PROBABILITY SUCH AS RARE OR COMMENT OR LIKELY OR INLIKELY. SEE WE FOUND 33 PAPERS IN WHICH 145 DIFFERENT PROBABILITY IT IS TERMS WERE EVALUATED AND IN ALL OF THOSE STUDIES, PARTICIPANTS WERE INVITED TO PROVIDE SOME SORT OF ESTIMATE WHARKS' THAT MEAN TO YOU AND I HOPE PEOPLE HERE ARE ACTUALLY KIND OF SHOCKED BY THE RESULTS, WE DID A META-ANALYSIS OF THE RESULTS AND THE AVERAGE INTERPRETATIONS WERE FROM RARE TO 7-21%. AND COMMON RANGE FRIDAY 34-71%. I THINK IF YOU SPEAK TO MEDICAL PROFESSIONALS WHEN THEY USE THE WORD RARE, THEY ARE MOST LIKELY TALKING ABOUT SOMETHING MUCH SMALLER THAN 1% PROBABILITY, AND YET PATIENTS APPEAR TO BE HEARING THAT AS, YOU KNOW 10 OR TWEBT TIMES HIGHER OR MORE THAN WHAT THE PROVIDER ACTUALLY SAID. I'LL ALSO POINT OUT THAT THIS POINT THAT ABOUT A THIRD OF THESE ASKED PARTICIPANTS WHAT THEY PREFERRED, DID THEY PREFER NUMBERS OR WORD AND IT IS AND THE MAJORITY OF PEOPLE IN THOSE STUDIES SAID THEY PREFERRED NUMBERS USUALLY IN COMBINATION WITH FETTERILE LABELS, SO, THIS IS COMING OUT IN GENERAL--JOURNAL OF GENERAL INTERNAL MEDICINE AND I'LL CIRCULATE THE REFERENCES AND THE PAPER AFTERWARDS. SO THIS IS 1 EXAMPLE OF THE RESULTS AND I PUBLISHED THIS IN THE MEDICAL JOURNALS BECAUSE I WANT DOCTORS AND PROVIDERS TO HEAR THIS. SORRY HERE WE GO. BUT THIS IS 1 LITTLE SLICE OF WHAT WE FOUND AND IN ORDER FOR US TO CATEGORIZE AND REALLY SYNTHESIZE LITERATURE, WE HAD TO DEVELOP AN ONTOLOGY OR A CLASSIFICATION SYSTEM TO DESCRIBE WHAT IT WAS WE WERE FINDING AND MAKE IT MAKE SURE WE WERE COMPARING APPLES TO APPLES. THIS WAS A LONG 3 DIFFERENT DIMENSIONS, 1 WAS THE TYPE OF DATA SO FOR EXAMPLE, IT WAS A PROBABLE LYKES A RISK OR WAS IT INSTRUCTION LIKE MEDICATION INSTRUCTION OR WAS IT A LAB RESULT BUT EVEN WITHIN EACH OF THOSE WERE THERE NUANCES WAS THERE A TREND OVER TIME OR A TRADE OFF OR SOMETHING LIKE THAT SO THEREYA A NUMBER OF DIFFERENT TYPES OF DATA THAT PEOPLE HAVE STUDIED. INTERESTINGLY, A WIDE VARIETY OF DIFFERENT OUTCOMES WERE ASSESSED. SOME PEOPLE--SOME OF THE RESEARCHERS REALLY WANTED THE READER TO BE MORE WORRIED ABOUT SOMETHING. THOSE WERE PEOPLE IN PUBLIC HEALTH, THEY TENDED TO WANT READERS TO BE MORE CONCERNED ABOUT SOMETHING, IN OTHER SITUATIONS, MORE THE MEDICAL DECISION MAKING LITERATURE, IT WAS NOT CONSIDERED ETHICAL TO TRY TO RAISE PEOPLE'S CONCERNS ABOUT SOMETHING SO INSTEAD THEY WERE TRYING TO COMMUNICATE FOR EXAMPLE THE RISK BENEFIT RATIO BETWEEN SOMETHING. IN OTHER CASES THERE WAS HEALTH DEHAD A FEW LITERATURE WHERE COMMUNICATION WAS FOLLOWED ALL THE WAY UNTIL SOME ACTION. SO A NUMBER OF DIFFERENT OUTCOMES AND THEY DID NOT ALWAYS LEAD US TO THE SAME CONCLUSIONS. AND THEN FINALLY THE DATA PRESENTATION. WHAT WAS IT THAT WAS ACTUALLY BEING SHOWN TO THE PARTICIPANT? WHAT SORT OF NUMBER BUT ALSO WHAT SORT OF MEDIUM OR FORMAT INCLUDING VIDEO AND MULTIMEDIA AS WELL AS ELECTRONIC AND PAPER. IN THIS WE WERE ACTUALLY ASSISTED BY AN EXISTING ONTOLOGY CALLED THE INFORMATION ARTIFACT, ONTOLOGY WHICH HAS BEEN VERY HELPFUL. SO A PRODUCT OF THIS MEANS THAT AS WE'RE SYNTHESIZING THE EVIDENCE, WE CAN ANSWER A SERIES OF QUESTIONS THAT ARE PHRASED LIKE THIS, THE EFFECTS WHAT IS THE EFFECT OF FORM AT Y ON OUTCOME Z, AND I WILL GIVE YOU EXAMPLES OF A COUPLE OF THESE FINDINGS, SO FOR EXAMPLE, IF I AM TALKING ABOUT PROBABILITY, WHAT IS THE EFFECT OF 1 AND X FORMAT ON PERCEIVED RISK. SO THE 1 AND X FORMAT IS--READER THAN IF I SAY 10%. EVEN THOUGH AGAIN MATHEMATICALLY EQUIVALENT COGNITIVELY OR IN THIS CASE AFFECTIVELY QUITE DIFFERENT. ABOUT YOU 1 IN 10 FEELS MORE IMMEDIATE AND IT OFTEN FEELS LARGER AND THEN ACCORDING TO OUR EVIDENCE BASE, THIS IS ACTUALLY QUITE A STRONG FINDING THAT WE FIND IN A LARGE NUMBER OF ARTICLES THAT ALL AIMED IN THE SAME DIRECTION. HERE'S ANOTHER EXAMPLE. IF I AM TALKING ABOUT PROBABILITIES, WHAT'S THE EFFECT OF THAT 1 IN X FORMAT ON PEOPLE'S ABILITY TO COMPARE NUMBERS AND THIS IS FROM THE PAPER THAT I SHOWED YOU EARLIER. AGAIN THERE'S VERY STRONG EVIDENCE THAT IF I WANT PEOPLE TO COMPARE 2 NUMBERS, IT'S MUCH HARDER FOR THEM TO COMPARE 1 IN 20 WITH 1 AND 5 AND THAN IT IS TO COMPARE 1 IN 20. SO AGAIN, VERY STRONG EVIDENCE HERE. I'LL GIVE YOU A COUPLE OF EXAMPLES OF LESS STRONG EVIDENCE, IF I WANT TO TALK ABOUT PROBABILITIES, WHAT IS THE EFFECT OF THE ICON SHAPE ON RECALL AND SO, THIS IS A SERIES OF STUDIES AROUND WHAT WE'RE CALLING ICON ARRAYS BUT I'M SURE YOU'VE SEEN THESE CALLED DIFFERENT THINGS, THIS FIELD OF 100 PEOPLE. TURNS OUT IT LOOKS LIKE ICON SHAPE MATTERS. THAT WE FOUND SEVERAL STUDIES THAT IF YOU DESIGN YOUR ICON AWAY WITH HUMANOID SHAPES RATHER THAN JUST BLOCKS OR ASTERISKS OR SOMETHING LIKE THAT, IT IS MORE MEMORABLE. HOWEVER, THIS IS A MODERATE FINDING, THERE WERE NOT VERY MANY STUDIES AND THEY WERE, YOU KNOW FAIRLY GOOD QUALITY BUT CERTAINLY NOT ABOVE REPROACH. AND THEN, FINALLY, I WILL WILL GIVE YOU AN EXAMPLE OF A--SOMETHING WE WERE WERE NOT ABLE TO DETERMINE THE ANSWER AND IT'S A BIT SURPRISING. IF I'M TALKING ABOUT PROBABILITY, AND I WANT TO TELL YOU YOUR PROBABILITY OF THE DISEASE, WHAT'S THE EFFECT OF ADDING THE POPULATION AVERAGE TO THAT COMMUNICATION. SO IN OTHER WORDS IF I TELL YOU, YOU KNOW YOUR RISK IS 21%. DOES IT MATTER IF I ALSO TELL YOU THAT THE AVERAGE RISK FOR PEOPLE IN YOUR AGE AND SEX GROUP ARE--IS 24%. IT TURNS OUT THAT THERE ARE RELATIVELY FEW STUDIES THAT HAVE ACTUALLY ASSESSED THE IMPACT OF THIS UPON BEHAVIOR CHANGE. THERE ARE SEVERAL STUDIES THAT HAVE ASSESSED IMPACT ON PEOPLE'S PERCEPTIONS, BUT RELATIVELY FEW OF THEM HAVE FOLLOWED IT ALL THE WAY TO BEHAVIOR OR BEHAVIOR CHANGE. AND SO, AS A RESULT AND THOSE STUDIES WERE NOT CONSISTENT. SO, WE WERE UNABLE TO COME UP WITH AN EVIDENCE-BASED RECOMMENDATION HERE SO OUR GUIDELINE IS IT IS NOT CLEAR WHETHER ADDING THE POPULATION AVERAGE AFFECTS MOTIVATION FOR BEHAVIOR CHANGE. SORRY JUST CHECKING MY TIME HERE. >> BY CLASSIFYING THESE ACROSS THE DIFFERENT OUTCOMES, 1 THING THAT'S BECOMING REALLY CLEAR IS THAT WHAT PEOPLE LIKE IS NOT ALWAYS WHAT SUPPORTS THE BEST PERFORMANCE, SO IF WE DO A STUDY IN WHICH WE ASK PATIENTS DO YOU LIKE THIS ECONO ARRAY THING OR DO YOU LIKE SOMETHING LARGER, PEOPLE GENERALLY TEND TO PICK, THEY TEND TO SAY THEY LIKE SOMETHING THAT THEY'VE SEEN BEFORE, THEY LIKE SOMETHING THAT'S RELATIVELY SIMPLE, COLORFUL AND FAMILIAR, BUT THAT'S NOT NECESSARILY THE 1 THAT SUPPORTS THE PERFORMANCE ON SOME OF THESE OUTCOME MEASURES THAT IS ACTUALLY SOMETHING INTERESTING IN TERMS OF HOW WE CHOOSE TO GO ABOUT DESIGNING NEW MATERIALS FOR PATIENTS. AS WE HAVE BEEN CLASSIFYING THESE STUDIES, I JUST WANTED TO GIVE YOU A QUICK GLIMPSE OF SORT OF THE COMBINATORIAL PROBLEMS, EACH STUDY MOST OF THE PAPERS HAVE STUDIES IN THEM AND THEY OFFER DIFFERENT OUTCOMES AND IN THOSE CASES BECAUSE OF THE STUDIES WE HAD TO DIVIDE THEM UP. WHEN THE STUDIES ON THE TRICKIER PROBLEM OF SHOWING PEOPLE TIME FRIENDS AND SHOWING THEM WHAT THE TIME TREND NEEDS AND ALSO RELATIVELY FEW STUDIES ON THE COGNITIVELY VERY COMPLEX PROBLEM OF A TRADE OFF. ARE THAT THIS THERAPY HAS A CHANCE OF BENEFITING YOU AND HAS A CHANCE OF SIDE EFFECTS AND WHAT DO YOU WANT TO DO ABOUT THAT. THESE ARE VERY, YOU KNOW REALISTIC AND REALISTIC PROBLEMS WE ENCOUNTER ALL THE TIME AND IT'S NOTABLE THAT THERE'S BEEN SO MUCH LESS RESEARCH. LOTS OF EVIDENCE ABOUT WHY WE NEED AN ONTOLOGY HERE, WHY WE NEED A CLASSIFICATION SYSTEM THAT DISAMBIGUATES DIFFERENT CONCEPTS, SO THIS FIGURE, I SAID EARLIER, WE WERE CHOOSING TO CALL AN ICON ARRAY BUT HERE'S JUST A SELECTION OF THE ALMOST 40 SYNONYMS WE FOUND FOR THIS IMAGE IN THE DIFFERENT LITERATURE, I THINK MY LEAST FAVORITE 1 IS THE WALL OF WOMEN, 1 PAPER SAID THEY WERE DESCRIBING BREAST CANCER RISK WITH THE WALL OF WOMEN BUT I ALSO THINK SOME OF THESE THINGS LIKE THE PERSONA GRAPH WAS DIFFICULT BUT IT ALSO TELLS YOU HOW HARD IT IS TO ACCEPT THIS AND THE TERMS USED ARE ALSO AMBIGUOUS, ALL OF THESE CAN BE ICONS BUT CAN YOU SEE THAT BEING CARRIED COGNITIVELY FOR DIFFERENT IMPLICATIONS. ANOTHER TRICKY BIT WAS THIS CONCEPT OF COMPREHENSION, WHAT DOES IT MEAN TO COMPREHEND A MISCELLANEOUSAGE AND WE FOUND TREMENDOUS VARIETY IN WHAT DIFFERENT REMEMBER COVERED. SO IN THIS STUDY HERE BY MAR TOEAU, PATIENTS WERE RIGHTED RIGHT OR WRONG AND THE ANSWERS WERE UNLIKEEE AND THAT WAS CONSIDERED COMP PRERENGZ IN THIS PARTICULAR SCENARIO, WHEREAS DAVIS ASKED PATIENTS TO PRESCRIBE THEIR MEDICINE SO THAT'S DIFFERENT COMP HEHENSION, SOME PEOPLE ASSESSED WHAT WE CALLED AND THEY CALL TODAY COMPREHENSION AND SOME PEOPLE ASKED THEIR PARTICIPANTS TO DO CERTAIN CALCULATIONS WHICH I FIND A BIT PROBLEMATIC BUT AS A RESULT WE ENDED UP AVOIDING COMP PREHENSION AS A BEHAVIORAL CLASSISK OF THE SORTS OF OUTCOMES IN WHICH PERCEIVED RISK IS A PRECURSOR OF BEHAVIORAL INTENTION ANDA BEHAVIORAL INTENTION IS A PRECURSOR TO BEHAVIOR AND SO WE CAN CLASSIFY THE DIFFERENT STUDIES, YOU KNOW IN A MEANINGFUL WAY AND WE'RE DEVELOPING OUT THE PROTEGE OWL INSTRUMENT HERE AND HAVE 1 OF OUR PAPERS [INDISCERNIBLE] AT THE MOMENT. BUT OUR PRIMARY GOAL WE ARE SIMULTANEOUSLY DEVELOPING A WEB GUIDE, AN INTERACTIVE GUIDE AND PROFESSIONAL COMMUNICATORS PEOPLE WHO MIGHT BE DEVELOPING OR DEVELOPING MATERIALS FOR PATIENTS OR SELECTING AND EVALUATING PATIENT AND PUBLIC FACING MATERIALS. AS A RESULT WHAT WE'RE TRYING TO DO IS DEVELOP A STRUCTURED QUESTIONNAIRE THAT HELPS THE USER ELUCIDATE WHAT THEY'RE TRYING TO ACCOMPLISH ANDIST FIRST THING THEY'RE TRYING TO TELL US IS WHAT IS THEIR GOAL? DO THEY WANT THE READ TORE FEEL MORE CONCERNED ABOUT A NUMBER SORE DO THEY WANT PEOPLE TO UNDERSTAND AND RECOGNIZE THAT THEIR NUMBER FALLS IN A TOMORROW CATEGORY LIKE NORM ALOR ELEVATED AND DO THEY WANT THE READER TO BE OPERATING SOMETHING. SO THE FIRST SERIES OF QUESTIONS WE ARE TRY TO ASK THE COMMUNICATOR, WHAT DO YOU WANT THE PATIENT TO BE ABLE TO DO WITH THIS NUMBER? AND THE SECOND SERIES OF QUESTIONS IS WHAT THE IS ACTUAL NUMBER YOU'RE TRYING TO COMMUNICATE HERE? WE ARE HELPING OUT THE INTERACTION DESIGN AS YOU CAN PERHAPS SEE THE GRAPHIC DESIGNER AND WE HOPE THAT WE WILL HAVE A BETTER GRAPHIC DESIGN IN THE NEXT FEW WEEKS. DURING THIS DEVELOPMENT, WE'VE BEEN DOING EVALUATION AND QUITE A LOT OF ITERATION BETWEEN THE TERM WE DEVELOPED FOR OUR CLASSIFICATION SYSTEM AND OF COURSE THE TERMS THAT PEOPLE IN THESE PROFESSIONS ARE USED WHICH DOES NOT ALWAYS MAP WELL. SO AS WE LOOK FORWARD THE FINAL PRODUCTS OF THIS, OUR GOAL IS TO ADVANCE US TO THIS SITUATION WHERE PEOPLE CAN DRAW A MEANING FROM HEALTH NUMBERS AND THE WAY WE'RE ATTACKING THIS IS BY SEEKING TO INTERVENE WITH THE PROVIDER OF THE INFORMATION AND WITH THE INFORMATION ARTIFACT BY SYNTHESIZING THE EVIDENCE DEVELOPING AN OPEN ACCESS ZETAMIN EASY TO USE DECISION SUPPORT SYSTEM FOR THE COMMUNICATOR AND PUBLISHING NOT ONLY THE RESULTS OF PAPERS FOR THE LITERATURE REVIEW WHICH I THINK WOULD BE HELPFUL EDITIONS TO THE LITERATURE--A FEW OF THE CITATIONS HERE AND I WOULD BE HAPPY TO SHARE ANY OF THESE PAPERS THAT MIGHT BE INTERESTING TO ANYBODY AND I WILL JUST WRAP UP BY PROVIDING MY CONTACT INFORMATION AND A LITTLE SNAPSHOT OF ALL THE DIFFERENT TYPES OF NUMBERS THAT WE ARE HOPING THAT THE PUBLIC AND PATIENTS MIGHT BE ABLE TO USE. >> THANK YOU DR., IT'S A TOPIC THAT WAS DAILY BASISSER TO MOST OUR HEARTS AND IT'S GREAT TO HEAR ABOUT THE APPROACH YOU'RE TAKING WITH THESE ISSUES AND WHAT SEEMS TO WORK AND WHAT DOESN'T WORK AS WELL WITH THE PATIENTS AND PROVIDERS AS WELL. WE'VE GOT 2 RESPONDENTS, I THINK CUED UP AS WELL AS OTHER MEMBERS OF THE BOARD. WE HAVE A FEW, SUZANNE. >> YES, AS YOU KNOW I'VE BEEN WATCHING THE STUDENTS AT COLUMBIA, AND IT'S EXCITING TO SEE WHERE YOU ARE WITH THIS. FIRST A COUPLE OF COMMENTS LOOKING AT 99 WAS REALLY INTERESTING, WE USED THE NUMBER ON THE LEFT AS PART OF OUR RAD X INITIATIVE AND VISUALIZATION TOOL BOX THAT WE'RE DEVELOPING AND ABOUT ONE-THIRD OF OUR SAMPLE IS GETTING IT WRONG. SO I THINK THERE'S NO DOUBT THAT THIS IS--THIS IS INCREDIBLY IMPORTANT. I ALSO WANTED TO POINT OUT THAT THIS IS AN ISSUE THAT THIS IS INCREDIBLY IMPORTANT TO LAUNCH NIH INITIATIVES, BUT THINKING ABOUT ALL OF THIS, THIS HAS BEEN AN ACTIVE POINT OF CONVERSATION AMONG THE EMERGE NETWORK PARTICIPANTS AS WE'RE PREPARING THE GENETIC INFORMED RISK ASSESSMENT REPORT NOT ONLY FOR CLINICIANS BUT ALSO FOR PATIENTS TO RECEIVE AND SO WE HAD A VERY INTERESTING CONVERSATION ACTUALLY WITH BRIAN S IKMUND-FISHER OVER THESE GENOMIC REPORTS AND THE DIFFERENCE IN THINKING ABOUT MESSAGES INTENDED FOR POPULATIONS THAT MIGHT BE PERSUASIVE VERSUS INFORMATION, MESSAGES AND SOMETHING LIKE PRESENTING GENETICS RESULTS WHICH MIGHT BE MORE INFORMATIVE AS THE FOUNDATION FOR A SHARED DECISION MAKING PROCESS. SO I WOULD BE CURIOUS TO HEAR A LITTLE BIT MORE ABOUT HOW HAVE YOU THAT COMMUNICATION HAVE THAT PURPOSE BUILT INTO WHAT THEY'RE DOING. I HEARD THE BEGINNINGS OF IT IN YOUR TOOL. >> I CAN BE THE HEAR HER. >> LOOKS LIKE HER SCREEN IS FROZEN. >> LOOKS FROZEN TO ME. >> GREG CAN SOMEONE REACH IN THERE? I THINK SHE'S RECONNECTING. >> DROPPED OUT. HOPEFULLY SHE CAN GET BACK ON. >> WOULD YOU LOOK AT THE QUESTION THAT WAS PUT INTO THE CHAT AND MAYBE YOU CAN TALK A BIT ABOUT THIS BECAUSE I KNOW YOU AND JESSICA WORK TOGETHER ON A NUMBER OF THESE ISSUES? >> I'M SURE, I'M CERTAINLY AWARE AS IS JESSICA THE WORK OF EDWARD [INDISCERNIBLE] AND I CAN'T SAY EXACT LIEU HOW IT'S INFLUENCED THEIR WORK, I KNOW IN OUR OWN WORK 1 OF THE THINGS THAT WE--SO, WE HAVE A PAPER THAT'S CALLED SOMETIMES MORE AND MORE. SO EVEN THOUGH MUCH OF [INDISCERNIBLE] IS GETTING AS MINIMALIST AS POSSIBLE WE HAVE FOUND DECONTEXTUALIZE INFORMATION IS NOT NECESSARILY ATTENTION, DOESN'T GRAB ATTENTION OR MOTIVATE PEOPLE TOWARDS BEHAVIOR CHANGE. SO I THINK THE INFLUENCE OF THIS WILL DEPENDOT PURPOSE OF THE COMMUNICATION. DO WE HAVE JESSICA BACK ON? >> CHRISTINE COULD YOU TRY TO REACH DR. ANKER. >> YOU KNOW I WILL COMMENT, SOME OF YOU KNOW MY RESEARCH AREA, MANAGEMENT TOOLS FOR PEOPLE AND I THINK SUE'S COMMENT ABOUT DECONTEXTUALIZED INFORMATION IS REALLY IMPORTANT AND SOMETHING THAT I THINK WE AT NLM NEED TO BE THINKING MORE AND MORE ABOUT CLINICAL TRIALS TO MED.GOV LINE PLUS, PEOPLE ARE SITTING SOMEWHERE WHEN THEY'RE USING THOSE AND THERE'S SOMETHING GOING ON INTERNALLY AND EXTERNALLY, IT WOULD BE 1 OF MY DREAMS OF THE FUTURE IS TO HAVE THE ABILITY PRIVACY PROTECTED TO SORT OF GET A SENSE OF WHERE YOU ARE, ARE YOU ANXIOUS, UPSET, ALONE, WORRIED AS KIND OF A FILTERING DEVICE AT LEAST TO PUT IT THAT WAY WITH DIFFICULT INFORMATION THERE, 'S IMMEDIATELY A SENSE OF--AND YOU MAY WANT TO DO THIS NOW, LIKE TALK TO YOUR SISTER OR CALL YOUR CLINICIAN, AND SO I WONDERED IF LOURDES OR JENNY WILL TRY TO SPEAK ABOUT THIS AT ALL WHILE WE WAIT FOR JESSICA TO COME BACK. >> I THINK THAT IS AN INCREDIBLE IDEA, APPROXIMATE, ATTI, IT'S INTERESTING, I'M PART OF A GROUP WITH ENGINEERING WHOSE STARTING TO DEVELOP SORT OF LIKE AN INTELLIGENT TRANSLATOR AND WHAT WE DO IS THAT FOR EXAMPLE, IF A PATIENT AND A PHYSICIAN ARE HAVING AN ISHT ACTION AND THERE'S LIKE A COMPUTERIZED TRANSLATION OF IT, SOMETIMES A PATIENT MIGHT UTILIZE SOME LANGUAGE THAT IS VERY CULTURALLY SPECIFIC WITH CULTURALLY BOUND TYPES OF AILMENTS, SYMPTOMS, DISEASES AND THE PHYSICIAN MAY NOT EVEN BE FAMILIAR WITH SO THESE LITTLE POP UP WINDOWS COME UP WHERE THE SORT OF SYNDROME OR SYMPTOM OR CULTURALLY BOUND EXPRESSION HAS BEEN EXPLAINED IN A LITTLE POP UP WINDOW WHICH THEN HELPS FOR THE INTERACTION BETWEEN THE PHYSICIAN AND THE PATIENT. >> SOMETHING ALONG THOSE LINES WHICH WOULD BE JUST AMAZING. >> SO THIS IS MAKING COMEBTS, TOO. >> SURE, NO WORRIES. >> WELCOME BACK,. >> SORRY ABOUT THAT. >> GLAD TO HAVE YOU BACK. >> DO YOU HAVE ANY QUESTIONS FOR DR. ANKER. >> DID SHE HAVE THE OPPORTUNITY TO ANSWER THE-- >> HASS AN WAS ASKING WHETHER YOU BEEN ABLE TO MUSE OF THE USE OF EDWARD TUFTD,. >> GREAT QUESTION AND YOU PROBABLY CAN'T SEE BEHIND ME BUT IN BOOK CASES THEY'RE ALL THERE. YOU KNOW 1 THING THAT'S INTERESTING ABOUT TUFTD, IS THAT HENEVER ASSESSED THE IMPACT OF HIS CREATIVE DESIGNS SO HE DOES NOT HAVE QUANTITATIVE EVIDENCE ABOUT THE IMPACT ON THE READER SO NONE OF HIS WORK ACTUALLY MADE IT INTO LITERATURE REVIEW, ALTHOUGH I THINK HE'S BEEN AN INSPIRATION TO ALL OF US. >> HI, JESSICA, I'M JENNY LUCCA, I FOUND YOUR PRESENTATION TO BE SO INTERESTING, AND SO RELATABLE AND IT'S OVERWHELMING RESEARCH AND I GUESS WHATIME LEFT WITH IS I SEE THE TOOL YOU'RE CREATING HOW DO YOU REALLY WIDELY DISSEMINATE THIS TOOL? MY FIRST QUESTION, MY SECOND QUESTION, I MIGHT HAVE MISSED IT AT THE BEGINNING BUT I'M WONDERING WHAT FACTORS IMPACT NUMERACY? I UNDERSTAND HEALTH LITERACY, I UNDERSTAND REGULAR LITERACY AND I UNDERSTAND HOW THOSE IMPACT IT BUT EVEN THESE SEEN ONIOR SLIDES I CAN UNDERSTAND THE AVERAGE TO HIGH AVERAGE INTELLIGENT PERSON HAVING A HARD TIME AND ESPECIALLY--WE HAVE SOMETHING THAT WE'RE HAPPY WITH. WE WILL BE DOING A BIG PUSH TO SEE IF WE AND GET IT OUT THERE AND I THINK WE WILL TRY TO EMULATE WHAT'S BEEN DONE BY SOME OF THE OTHER DEVELOPERS LIKE FOR EXAMPLE, THE CDC INDEX OR SOME OTHER RESOURCES OUT THERE BUT YES THAT WOULD BA I GREAT CHALLENGE AND SUGGESTIONS WOULD BE WELCOME, TO YOUR SEBD POINT ABOUT NUMERACY, YOU SAID SOMETHING I REALLY AGREE WITH WHICH IS THAT ALL OF US WIN FACE WIDE AN EMOTIONALLY OVERWHELMING SITUATION, DO NOT PERFORM UP TO OUR POTENTIAL CAPABILITIES, RIGHT? WE ALL BECOME ILLITERATE AND ENUMERATE WHEN IF SOMEONE TELLS ME, YOU HAVE TO HAVE A BIOPSY, EVERYTHING GUESS OUT THE WINDOW, I CANNOT--I COULD BE THE PROCESS ANYMORE INFORMATION RIGHT THERE. AND I THINK WHAT WE'VE BEEN ADVOCATING IS WHAT WE CALL UNIVERSAL PRECAUTIONS APPROACH, SO UNIVERSAL PRECAUTIONS IN HEALTHCARE MEANS YOU ASSUME AND WITH PATIENTS REGARDLESS OF THEIR STATUS YOU TAKE UNIVERSAL PRECAUTIONS. >> WE'RE ADVOCATING SOMETHING SIMILAR IN TERMS OF LIT RASE MODEL SKPE BAKUGAN NUMERACY WHICH IS LET'S ASSUME THAT EVERYONE WILL HAVE DIFFICULTIES WITH THIS AND YOU KNOW DO OUR BEST IN IMPROVED CLARITY AND PROVIDE THE CONTEXTURAL INFORMATION AND PROVIDE THE VERBAL EXPLANATION, MAKE SURE IT'S AS EASY TO USE AS POSSIBLE BECAUSE, YOU KNOW WHEN YOU'RE IN THE MOST NEED OF IT IS WHEN YOU HAVE THE LEAST. >> YEAH, THAT'S RIGHT. >> TO DEAL WITH IT. >> THANK YOU. >> I THINK WE'RE OUT OF TIME BUT ARE THERE ANY OTHER QUICK QUESTIONS FOR DR. ANKER. >> SHE DIDN'T GET TO ANSWER MY QUESTION WHICH WAS HOW WE HAD AND WE HAD AN INTERESTING CONVERSATION WITH BRIAN FISHER ABOUT PERSUASION VERSUS INFORMATION AND THIS WAS IN THE CONTEXT OF RETURNING EMERGE GENETIC RESULTS WHICH ARE FOR SHARED DECISION MAKING SO I WAS JUST WONDERING, WANTING TO HEAR A BIT MORE ABOUT LIKE MESSAGE INTENT IN THE TOOL. >> YEAH, EXACTLY. RIGHT. AND WE--1 THING THAT WE FIND IS THAT RESEARCHERS ARE EXPERTS IN THIS TEND TO YELL AT EACH OTHER AND SAY MY WAY IS BEST AND IT'S OFTEN WRONG AND IT TURNS OUT IF YOU BREAK IT DOWN IT'S BECAUSE SOME PEOPLE ARE TRYING TO PERSUADE. WE WANT YOU TO QUIT SMOKING, WE WANT TO PERSUADE YOU TO QUIT SMOKING, OUR COMMUNICATION TECHNIQUES ARE AIMED AT MAKING SURE THAT YOU UNDERSTAND THE RISKS OF SMOKING. AS OPPOSE TO THIS OTHER GROUP OF PEOPLE WHO ARE AS YOU SAY, PROGENIC RESULTS MANY MEDICAL DECISIONS WERE ABLE TO BE CONSIDERED UNETHICAL TO TRY TO STEER PATIENTS TOWARD 1 OR THE OTHER. SOME--IN OTHER SITUATIONS, THE PATIENT THEMSELVES SHOULD, I'M GOING TO SAY SELF-T-REGGAGE AND DETERMINE WHAT THE RIGHT ACTION IS, SO AN EXAMPLE WOULD BE AIR QUALITY INDICATORS. WE WANT YOU TO KNOW WHAT THE AIR QUALITY INDEX IS TODAY AND IT MIGHT BE UP TO YOU, I HAVE ASTHMA, I SEE THAT THE AIR QUALITY IS IN THIS UNHEALTHY ZONE, I MIGHT DECIDE NOT TO TRY TO GO FOR MY JOG TODAY, WHEREAS ANOTHER PATIENT WHO MIGHT LOOK AT THAT AND NOT TAKE ANY ACTION AT ALL. SO THE NUMBERS, SOMETIMES WE HAD A STRONG PUBLIC HEALTH REASON, TO THINK EVERYONE SHOULD DO SOMETHING, IN OTHER CASES WE THINK PEOPLE SHOULD BE MAKING THEIR DECISIONS IN LIGHT OF THEIR OWN PREFERENCES, VALUES AND SITUATIONS AND VALUES. THAT'S WHY WE TRIED TO BREAK OUT THE LITERATURE INTO THOSE BUCKETS. WAWE'RE FINDING IS THAT IT'S SURPRISINGLY HARD TO ASK MEANINGFUL QUESTIONS FOR THE COMMUNICATOR TO GET THEM TO GET THEM TO ARTICULATE BECAUSE MANY ARE LIKE I'M JUST TRYING TO INFORM PEOPLE, BUT TURNS OUT THEY'RE REALLY TRYING TO PERSUADE PEOPLE AND THAT MIGHT BE OKAY, BUT I JUST WANT YOU TO BE UP FRONT ABOUT THE FACT THAT YOU HAVE A PERSUASIVE GOAL AND SO THAT'S A CHALLENGE RIGHT NOW IS WE'RE WORKING WITH MEDICAL WRITERS AND COMMUNICATORS IS HOW TO FIGURE OUT HOW TO HEPATITIS E THEM ARTICULATE WHAT THEY WANT THE PERSON TO DO WITH THAT INFORMATION. >> THANKS FOR REMINDING ME WE HADN'T GOTTEN AROUND TO THAT QUESTION AGAIN. >> THANK YOU. >> THANK YOU VERY MUCH IT IS NOW MY PLEASURE TO RECOGNIZE THE RECIPIENTS OF THE THIS YEAR'S REGENTS AWARD FOR SCHOLARSHIP OR TECHNICAL ACHIEVEMENT THIS AWARD WAS ESTABLISHED IN 19 SEIVET BY THE BOARD OF REGENTS TO RECOGNIZE AND STIMULATE INDEPENDENT CREATIVITY LEADING TO SCHOLARLY OR TECHNICAL ACHIEVEMENT THAT ENRICH BIOMEDICINE. EMPHASIS PLACED ON ORIGINALITY AND COMPLOSION OF A SCHOLARLY TREATUS AND A NEW PRODUCT OR METHODOLOGY THAT IMPROVES BIOMEDICAL KNOWLEDGE OR SERVICE. THE BOARD CONSIDERS THIS AWARD THE HIGHEST HONOR IT CAN GIVE TO A MEMBER OF THE STAFF. WE ARE PLEASED THIS YEAR TO PRESENT THE REGENTS AWARD TO 2 RECIPIENTS AND IN NO PARTICULAR ORDER OTHER THAN PERHAPS ALPHABETIC, THE AWARD IS PRESENTED TO DR. JAMES RODNEY BRISTER, HE IS A STAFF SCIENTIST WITH THE INFORMATION ENGINEERING BRANCH OF THE NATIONAL CENTER FOR BIOTECHNOLOGY INFORMATION. HE IS BEING RECOGNIZED FOR HIS TECHNICAL AND INTELLECTUAL EXCELLENCE FOR TWEPPING NEW AND EFFECTIVE SARS-COV-2,AINAL SIS WORK FLOWS AND DATA VISUALIZATION PRODUCTS THAT ARE INTEGRAL TO THE FEDERAL PANDEMIC RESPONSE, DR. BRISTER PLAYS A PIVOTAL ROLE TO THE COVID-19 GLOBAL CRISIS. LEADS INTELLECTUAL WORK IN DEVELOPING DATA VISUALIZATION TOOL TO TRACK AND UNDERSTAND KNOWN AND EMERGING SARS COV-2 VARIANTS IN SEQUENCE VARIATIONS. HE LED THE TEAMS EXPOSURE TO RADIATIONS IN REPORTING THESE FINDINGS WEEKLY AND ACCELERATING THE COVID-19 THERAPEUTICS AND TRACE REPORT, THE USE OF THIS SOFTWARE HAS ALLOWED THE GOVERNMENT TO SEE KEY DATA TRENDS IN THE TECH VULNERABILITIES ALLOWING A MORE ROBUST AND TIMELY RESPONSE TO THE PANDEMIC. HIS EFFORTS ALSO REPRESENT A NEW METHODOLOGY, WORKING IN THE CLOUD ENVIRONMENT, WHICH CAN BE USED FOR SURVEILLANCE AND OTHER VIRUSES TO PROMOTE WORLD WIDE PUBLIC HEALTH. DR. BRISTER'S EFFORTS HAVE ELEVATED NLM'S CONTRIBUTION IN THE COVID-19 RESPONSE AND FOSTERED EFFECTIVE RELATIONSHIPS BETWEEN NIH AND CDC COLLABORATORS. THE AWARD THIS YEAR IS ALSO PRESENTED TO MR. JAMES MORK, COMPUTER SCIENTIST AND THE ACTING CHIEF OF THE APPLIED INFORMATICS BRANCH IN THE LISTER HILL CENTER FOR BIOMEDICAL COMMONICATIONS, HE IS RECOGNIZED HEAR HIS EXCEPTIONAL TECHNICAL ACHIEVES IN THE EXPANSION OF AUTOMATED INDEXING AT NLM PROVIDING COST AND TIME SAVINGS TO MED LINE INITIATIVES MR. MORK IS THE LEAD SOFTWARE DIRECTOR OF MTI, A TECHNICAL PRODUCT THAT IS PROFOUNDLY TRANSFORMED INDEXING AND ABOUT WHICH WE HEARD MORE EARLIER IN THE MEETING. OVER THE PAST 4 YEARS MR. MORK'S TECHNICAL ABILITIES HAVE SIGNIFICANTLY IMPROVED NTI WHICH ALLOWED FULLY AUTOMATED INDEXING SINCE 2016 FOR COMMENTS IN 2019 NEAR JOURNALS. HIS MTI EFFORTS INCLUDE PERFORMANCE IMPROVEMENTS SUCH AS IMPROVING THE F1 PERFORMANCE SCORE MORE THAN 10% IN THE LAST 5 YEARS. EXPANSION OF AUTOMATED INDEXING TO IMPROVE FOREIGN LANGUAGE CITATIONS THAT WERE PREVIOUSLY EXCLUDE FRIDAY AUTOMATED INDEXING AND ABILITY TO INDEX MED LINE CITATIONS AT SCALE AND REALTIME ALLOWING NLM INDEXERS TO INDEX MORE THAN A MILLION ARTICLES A YEAR AND KREAGHTZ OF THE BIOMEDICAL CITATION OF THE SELECTOR SYSTEM THAT AUTOMATICALLY DETERMINED IF AN ARTICLE SHOULD BE INDEXED INTO PUBMED. HIS EFFORTS WILL ALLOW NLM TO MOVE FULLYOT MATED INDEXING IN THE 2022 RESULT NOTHING TREMENDOUS COST FOR SAVINGS FOR NLM AND FASTER ACCESS FOR PUBMED USERS TO MED LINE CITATIONS INDEXING WITH MEDICAL SUBJECT HEADINGS. I WOULD LIKE THE BOARD AND ALL OF US TO JOIN IN WARM CONGRATULATIONS TO DR. BRISTER AND MR. MORK FOR THEIR OUTSTANDING ACHIEVEMENTS. CONGRATULATIONS AND THANK YOU. WE HAVE A FEW HANDS UP FROM PEOPLE I DON'T KNOW IF WE HAVE TO MOVE ON BUT P A TTI, AND JIM? >> I'M APPLAUDING. >> APPLAUSE. >> IT'S APPLAUSE. >> OKAY, YES, OF COURSE, DIFFERENT CONTEXT, SO, THANK YOU. AT THIS POINT, I THINK THAT THIS MARKS THE END OF THE OPEN PORTION.