GOOD MORNING. FOR THOSE HAVE NOT MET ME BEFORE I'M LARRY TABAK AND THIS IS MY RETURN VISIT TO NIDC R AND PRIVILEGED TO SERVE AS 7th DIRECTOR PRIOR TO MARTHA SILVERMAN FOR A DECADE AN ON TO DOING INTERESTING THINGS BUILDING NO. 1 AND IT IS STILL MY DAY JOB AND PROUD TO BE BACK FOR THIS INTERIM ROLE. I EMPHASIZE INTERIM ROLE SO STAFF BECOME. IT IS GREAT TO WELCOME YOU TO WHAT IS THE 223RD NEATING OF NATIONAL -- LOOKING AROUND THE ROOM, I KNOW MOST OF THE MEMBERS OF COUNCIL, WE TYPICALLY ONLY CHOOSE PEOPLE WHO HAVE NOTHING ELSE TO DO. THANK YOU ALL FOR BEING HERE. WE KNOW HOW VERY, VERY BUSY YOU ARE AND HOW THIS TAKES A CHUNK OUT OF YOUR LIFE. WE ARE VERY APPRECIATIVE. WE HAVE STANDING ROOM ONLY HERE TODAY AND WE HAVE MANY PEOPLE ON THE VIDEO CAST AND THE CONFERENCE ROOMS YOU ARE USED TO ARE UNDER MUCH NEEDED RENOVATION IN BUILDING 31. THIS IS OUR TEMPORARY QUARTERS FOR THIS MEETING AND WE HAVE NO NEW MEMBERS OF COUNCIL AND NONE OF YOU ARE ESCAPING WHICH IS GREAT. WE HAVE YOU IN PLACE AND WE WILL GO AROUND THE ROOM NOW. ANYBODY WHO IS NOT AN NIH OR NIDCR EMPLOYEE, IF YOU WOULD STAND AND JUST IDENTIFY YOURSELF SO EVERYBODY ELSE KNOWS WHO YOU ARE. THAT WOULD BE WONDERFUL. WHY DON'T WE START ON THAT SIDE OF THE ROOM. I WILL LET YOU SELF-ASSEMBLE ANY WAY THAT YOU WANT OR NOT. OKAY. CHRIS, PEOPLE ARE SHY. WHY DON'T YOU START? >> CHRIS AND [INDISCERNIBLE]. >> OKAY. NOW, THAT WASN'T HARD. >> [INDISCERNIBLE]. >> GREAT. WELCOME. >> [INDISCERNIBLE]. >> ANYBODY ELSE ON THAT SIDE OF THE ROOM? >> [INDISCERNIBLE]. >> WELCOME. >> [INDISCERNIBLE]. >> GREAT. THANK YOU. >> [INDISCERNIBLE]. >> THANK YOU. >> UNIVERSITY OF MICHIGAN. >> I WILL SAY THAT ACOUSTICS IN THIS ROOM ARE HORRIBLE. I HAVE GOTTEN OLDER SO PLEASE YELL. >> [INDISCERNIBLE]. >> THANK YOU. >> [INDISCERNIBLE] AMERICAN DENTAL EDUCATION ASSOCIATION. >> OKAY. WE EXHAUSTED THAT ROOM. OKAY. THIS SIDE, ANYBODY WHO WOULD LIKE TO INTRODUCE THEMSELVES, PLEASE? HOW DID YOU ALL GET ON THAT SIDE OF THE ROOM? ALL RIGHT. WELL, THAT IS GREAT. THANK YOU ALL FOR BEING HERE THIS MORNING. SO WITH THAT, LET ME HAND IT OFF DR. ALICIA DOMBROSKI FOR COUNCIL BUSINESS. >> I WOULD LIKE TO WELCOME EVERYONE. SOME NOTICED COUNCIL MEMBERS THAT ROTATED OFF LAST FALL AND ARE BACK HERE IN THE ROOM TODAY AND GIVE EXTRA SPECIAL THANK YOU TO AGREE TO EXTEND THEIR TERMS WHILE WE ARE EXPERIENCING A LITTLE DELAY IN GETTING THEIR REPLACEMENTS APPOINTED. THAT IS DR. BAKER NELLAN AND [INDISCERNIBLE]. THANK YOU FOR JOINING US AGAIN. SOME DAY YOU WILL GET TO ACTUALLY BE DONE WITH THIS. LIKE LARRY SAID, WE ARE PROVIDING REMOTE ACCESS TO THE OPEN SESSION OF THE MEETING TODAY AND WOULD LIKE TO EXTEND AN ADDITIONAL WELCOME TO VIRTUAL PARTICIPANTS. IF SPEAKING SPEAK IN MICROPHONE SO WEBCAST MEMBERS CAN HEAR YOU. WE HAVE SEVERAL MEMBERS OF THE IT STAFF HERE TO HELP YOU. WE HAVE KEVIN RIGHT HERE AND JOHN WHO IS SOMEWHERE. JOHN RIGHT THERE AND ANDRE IN THE BACK CORNER. FLAG ONE OF THEM DOWN IF YOU NEED SOME HELP AND WE PROVIDED FOR COUNCIL MEMBERS AT YOUR SEATS TODAY ARE ANNUAL NEW INVESTIGATOR PROFILES BOOK, WHICH WE WILL GIVE YOU AN OVERVIEW OF NEW INVESTIGATORS WE FUNDED AND ADDITIONAL COPIES ARE ON THE SIGN-IN TABLE IF ANYONE WOULD LIKE TO LOOK AT THAT. FIRST ITEM OF BUSINESS IS APPROVAL OF MINUTES FROM THE PREVIOUS MEETING AND MINUTES FROM SEPTEMBER 2019 MEETING WERE MADE AVAILABLE TO COUNCIL MEMBERS FOR THEIR REVIEW. I WILL ASK IF THERE IS COMMENTS OR CORRECTIONS FOR SEPTEMBER COUNCIL MEETING MINUTES. IF NOT, WOULD A MEMBER OF COUNCIL LIKE TO MAKE A MOTION TO APPROVE THOSE MINUTES? SECOND. ALL IN FAVOR. ANY OPPOSED? THANK YOU. SECOND ITEM OF BUSINESS IS THE COUNCIL OPERATING PROCEDURES. EVERY YEAR, WE ARE REQUIRED TO REVIEW THE COUNCIL OPERATING PROCEDURES AND ALLOW COUNCIL TO MAKE RECOMMENDATIONS FOR REVISION AND STAFF TO MAKE RECOMMENDATIONS. THIS YEAR NIDCR IS NOT RECOMMENDING ANY CHANGES TO OPERATING PROCEDURES AND I WILL ASK IF COUNCIL MEMBERS HAVE ANY SUGGESTIONS FOR CHANGES OR COMMENTS ON THE OPERATING PROCEDURES. IF NOT, WE NEED TO VOTE TO APPROVE THE COUNCIL OPERATING PROCEDURES. WOULD SOMEONE LIKE TO MAKE A MOTION? SECOND? ALL IN FAVOR? ANY OPPOSED? OKAY. THANK YOU. NOW, I WILL TURN THE MEETING BACK OVER TO DR. LAWRENCE TABAK FOR THE REPORT OF THE DIRECTOR. >> THANK YOU, ALICIA. FIRST ORDER OF BUSINESS IS TO INTRODUCE TO YOU SOMEBODY I THINK YOU KNOW WHO IS DR. JONATHAN HORSFORD WHO CAME TO NIH IN 2005 AS A PROGRAM DIRECTOR AND AN ANALYST OF NEUROGENETICS IN NINDS. WE STOLE HIM BACK IN LATE 2006. FIRST, AS A SCIENTIFIC REVIEW OFFICER. I WAS HERE WHEN THAT HAPPENED. BLAME ME. THEN HE BECAME THE ACTING CHIEF OF THE SCIENTIFIC REVIEW BRANCH AND SUBSEQUENTLY HEALTH SCIENCE POLICY ANALYST. HE HAS SERVED FIRST AS ACTING BUT NOW AS THE PERMANENT DIRECTOR OF NIDCR'S OFFICE OF SCIENCE POLICY AND ANALYSIS. BECAUSE HE DIDN'T HAVE ENOUGH TO DO, DR. SUMERMAN NAMED HIM AS ACTING DEPUTY DIRECTOR IN OCTOBER. THAT IS WHY HE IS SEATED TO MY LEFT. HE AND I WILL SHARE THIS MORNING'S DIRECTOR'S REPORT. I PARACHUTED IN 29 DAYS AGO. HE WILL BE ABLE TO CATCH YOU UP ON ALL OF THE MANY NIDCR SPECIFIC THINGS. WITH THAT, WHY DON'T WE START WITH THE PRESENTATION NOW? IF I PUSH THIS BUTTON, WILL A MIRACLE HAPPEN OR WILL SOME -- NO. IT JUST BUZZED. SOMEBODY WILL DO THIS FOR ME. YES? OR NOT. >> AUDIENCE: [LAUGHING]. >> SHOULD I DO IT MYSELF? I KNOW HOW TO DO IT. YEAH. IF YOU COULD GO TO THE FIRST PRESENTATION, PLEASE. DO YOU WANT ME TO DO IT FROM HERE? >> NO. >> OKAY. >> NO. NEXT ONE. SAYS REPORT. THERE IS A POWERPOINT UNDER THE REPORT OF THE DIRECTOR. >> OKAY. THAT IS FINE. >> SEE, THE OTHER MAJOR PROBLEM IN ADDITION TO NOT HAVING A GAVEL IS THEY PUT A PC IN FRONT OF ME. I DON'T KNOW HOW THE DAMN THING WORKS. I DO HAVE MY MACINTOSH HERE. I WILL BE ABLE TO GET SOME WORK DONE. THANK YOU, FOLKS. THAT IS GREAT. LET ME. THAT IS THE RETIREMENT OF DR. SUMER MOIRN AND NIH HELD A CELEBRATION IN REGARDS TO MARTHA'S MANY ACCOMPLISHMENTS. YOU CAN SEE SOME OF THE PICTURES TAKEN ON THAT DAY. THE GUY ON THE FAR RIGHT, IN FACT, CERTIFY ENNADED MARTHA WITH A SONG WHICH WAS QUITE WONDERFUL, ACTUALLY. I THINK AS YOU KNOW MARTHA SERVED AS NIDCR DIRECTOR FOR NINE YEARS AROUND STEPPED DOWN AS DIRECTOR BUT IT WILL CONTINUE BOTH AS CHIEF OF THE LABORATORY OF ORAL CONNECTIVE TISSUE BIOLOGY IN NIMS AND SHE WILL ALSO REMAIN AS SENIOR ADVISOR TO JONATHAN AS WELL. LABORATORY OF ORAL CONNE CTIVE TISSUE BIOLOGY IN NIMS AND SHE WILL ALSO REMAIN AS SENIOR ADVISOR TO JONATHAN AS WELL. SHE WILL MAINTAIN ACTIVE LABORATORY AND ADVISORY ROLE TO INSTITUTE. MARTHA AND I HAVE KNOWN EACH OTHER FOR QUITE A WHILE AND KNOW VERY JUNIOR PEOPLE HERE IN THE INTERIM NIH PROGRAM. MARTHA WAS FIRST WOMAN TO SERVE AS DIRECTOR OF NIDCR. I THINK, YOU KNOW, OF THE MANY, MANY THINGS THAT I CAN, YOU KNOW, RELAY TO YOU ABOUT MARTHA, I THINK WHAT HAS BEEN SO CENTRAL TO HER ENTIRE PROFESSIONAL CAREER IS HER VISION WHERE DENTAL, ORAL, AND CRANIOFACIAL HEALTH AND PATHOLOGY ARE UNDERSTOOD CONTEXTUALLY AS PART OF THE ENTIRE BODY. SHE UNDERSTANDS THAT THIS IS A TAX TO THE REST OF THE BODY. I THINK THAT THIS IS CERTAINLY HIGHLIGHTED AND UNDER GERDS MUCH OF THE NICR2030 IN PARTICULAR AND FOCUSES ON SOMETHING SHE TERMED AUTO THERAPIES THAT IS PREVENTION AND TACTICS THAT ENABLE THE BODY'S ABILITY TO REPAIR AND REGENERATE ITSELF. IMMUNOLOGISTS HAVE TOLD US THAT FOR A LONG TIME BUT TRANCE EXTENDS IMMUNOLOGY. AND IN ADDITION SHE PUT IN PLACE THE DENIAL ORAL AND CRANIOFACIAL TISSUE REGENERATIVE CONSORTIUM THAT WILL TAKE ADVANTAGE OF THIS APPROACH AND PHILOSOPHY OF SCIENCE AND TAKES RESULTS AND TRANSLATES INTO TANGIBLES THAT HELP PATIENTS AND QUICKLY MOVE THEM INTO TREATMENT AND HAS BEEN A VOCAL ADVOCATE FOR IMPORTANCE OF PUBLIC AND PRIVATE COLLABORATIONS AND LIT ANY OF THINGS THAT COULD BE POINTED TO AND ESSENTIAL NEED FOR CLINICIANS TO BE PARTNERS IN SCIENTIFIC ENTERPRISE. SHE IS COMMITTED TO TRAINING NEXT GENERATION OF ORAL HEALTH RESEARCHERS IN 2019 SHE LAUNCH DZ THE POST DOC FELLOWSHIP PROGRAM TO ENHANCE DIVERSITY IN CRANIOFACIAL RESEARCH AND PYONEAR IN NIH TO INVESTIGATE TWEENERS AS WE CALL THEM TO REALLY HELP THEM WHEN SHE INITIATED NIDCH AWARD FOR SUSTAINING ACHIEVEMENT. ACRONYM IS SOAR BUT IN THIS CASE IT IS SOAR. SO, AGAIN, YOU KNOW, MARTHA HAS BEEN SO PART OF THE COMMUNITY AND HAS MADE SO MANY IMPORTANT CONTRIBUTIONS. SOME OF THIS WILL CULMINATE IN THE SURGEON GENERAL'S REPORT. MUCH OF YOU ARE ENGAGED IN. THIS IS A PRIORITY OF HERS TO UNDERSCORE THE NEED FOR ORAL HEALTH FOR THE NATION AND THE SURGEON GENERAL'S REPORT WE HOPE WILL BE RELEASED THIS CALENDAR YEAR AND ALL OF THIS IS A TESTAMENT TO HER EXTRAORDINARY CAREER AND EFFORTS. MARTHA COULDN'T BE HERE WITH US TODAY. ANYWAY, LET'S GIVE HER A ROUND OF APPLAUSE. >> AUDIENCE: [APPLAUSE]. >> I SUS INSPECT SHE WILL VISIT A WHILE IN THE FUTURE. WITH THAT, THIS IS THE SECOND MOST IMPORTANT THING I WILL TELL YOU THIS MORNING. THAT IS WE ARE ACTIVELY SEEKING A NEW PERMANENT DIRECTOR FOR THIS INSTITUTE MARTHA AGREE ON A LOT OF THINGS BUT MOST ON DIRECTOR OF NIDCR IS THE BEST JOB IN THE WORLD. I'M POSITIVE WE WOULD BOTH AGREE ON THAT STATEMENT. SO WHAT WE NEED TO FIND IS AN INDIVIDUAL, AS THE SLIDE DISPLAYS WHO HAS A TRUE COMMITMENT TO SCIENTIFIC EXCELLENCE AND HAS ENERGY, ENTHUSIASM, AND INNOVATIVE THINKING NECESSARY TO LEAD THIS AMAZING ORGANIZATION FORWARD. SO THE APPLICATIONS HAVE TO BE IN BY FEBRUARY 20TH. THIS IS A LITTLE BIT LIKE GRANTSMANSHIP. IF YOU DON'T APPLY FOR THE JOB, YOU WON'T GET IT. SO, AND I'M NOT GOING TO ACTUALLY POINT FINGERS AT SOME PEOPLE SEATED AROUND THE TABLE OR AROUND THE PERIPHERY OF THE ROOM, BUT, YOU KNOW, THERE ARE POTENTIAL CANDIDATES IN THIS ROOM. GET ON WITH IT AND PUT TOGETHER YOUR APPLICATIONS. I MEAN, ALL KIDDING ASIDE, THIS IS AN EXTRAORDINARY OPPORTUNITY FOR SOMEBODY. WE ARE OBVIOUSLY LOOKING FORWARD TO GOING THROUGH THE CHURCH PROCESS AND WELCOMING A NEW DIRECTOR AS SOON AS POSSIBLE, I MIGHT ADD, FROM A PERSONAL VIEWPOINT. OKAY. NOW, LET'S GET ON TO THE BUSINESS OF THE COUNCIL. THIS IS EXTRAORDINARY NEWS. THIS -- THIS IS ABSOLUTELY EXTRAORDINARY NEWS. THE CONGRESS HAS SO GENEROUSLY UNDERSCORED THEIR BELIEF AND THEIR SUPPORT FOR NIH. AS YOU KNOW, WE ONCE AGAIN ENJOYED A VERY SIGNIFICANT BUDGET INCREASE IN 2020. AND AS YOU LOOK AT THE TRAJECTORY OVER THE LAST SEVERAL YEARS IT IS REMARKABLE. WE ARE GRATEFUL TO THE CONGRESS AND ALL STAKEHOLDERS WHO HAVE MADE THIS HAPPEN. NOW, IT IS OUR JOB TO MAKE SURE THAT THESE RESOURCES ARE INVESTED IN THE WISEST POSSIBLE MANNER. THE ACTUAL NUMBERS ARE HERE. 2020 FINAL BUDGET OF $41.6 BILLION, WHICH REPRESENTS A -- JUST UNDER 6% INCREASE NIHWIDE. NIDCR NUMBERS ARE DISPLAYED BELOW AND JONATHAN WILL WALK YOU THROUGH THE SPECIFICITY OF NIDCR NUMBERS. AGAIN, I PARACHUTED IN AND THOUGHT IT WOULD BE BETTER FOR HIM TO DO THAT GIVEN HIS FAMILIARITY WITH THE GRANULAR THAT ARE INCLUDED IN THIS VERY - SUBSTANTIAL INCREASE FOR 2020 ARE THE FOLLOWING PROGRAMS RANGING FROM ALZHEIMER'S DISEASE TO ALL OF US. DOWN SYNDROME AND ACRONYM INCLUDE AND INVESTIGATIONS OF CHRONIC ACROSS THE LIFESPAN AND DOWN SYNDROME WHICH I HAVE BEEN ENGAGED WITH AND HEAL WHICH IS TO ADDRESS THE OPIOID CRISIS WE HAVE IN THIS NATION AS WELL AS THESE MANY OTHER THINGS. YOU CAN SEE THAT THIS IS SOME OF THE RESOURCES THAT HAVE BEEN DIRECTED TO THE VERY HIGH-PROFILE AND VERY IMPORTANT ACTIVITIES, MOST OF WHICH ARE TRANS-NIH OR TRANSNATIONAL IN NATURE LIKE FOR EXAMPLE CTSA PROGRAM WHICH PROBABLY TOUCHES EVERYBODY OF OUR OUTSIDE GUESTS. NOW, I WANTED TO JUST TAKE A QUICK MOMENT TO UPDATE YOU ON A COUPLE OF WORKING GROUPS OF THE ADVISORY COMMITTEE TO THE DIRECTOR. PART OF MY DAY JOB AS PRINCIPLE DEPUTY IS TO HELP BEKA CL COLLINS WITH WORKING GROUPS THAT FEED INTO HIS NATIONAL ADVISORY COUNCIL. ONE IS RELATED TO ARTIFICIAL INTELLIGENCE. BECAUSE THIS PARTICULAR MEETING TODAY IS DEVOTED, IN PART, TO DATA SCIENCE, WHICH IS WHY WE ARE SURE THAT ALL COMPUTERS WILL WORK TODAY. RIGHT, JOHN? RIGHT. OKAY. I WANTED TO RELAY TO YOU HIGH-LEVEL OUTPUT FROM ACD ADVISORY COMMITTEE TO THE DIRECTOR WORKING GROUP ON ARTIFICIAL INTELLIGENCE. IF YOU ARE STILL USING PAPER AND PENCIL, WHICH I AM DOING A LOT STILL, YOU MAY THINK THAT ARTIFICIAL INTELLIGENCE DOESN'T RELATE TO YOU. THIS DISPLAY IS TO JUST REMIND YOU THAT, THAT WON THE BE CORRECT. INDEED, EVERY SINGLE DAY, YOU ARE CONFRONTED WITH ENGAGED WITH OR INTERACTING WITH, WHETHER YOU KNOW IT OR NOT, THINGS THAT ARE DRIVEN BY ARTIFICIAL INTELLIGENCE. NOW, I WOULD LIKE TO TELL THE STORY THAT THIS THING, THE MOST IMPORTANT PART OF THIS THING IS GOOGLE MAPS AND WAZE. SO FOR THE FIRST ROUGHLY 64 YEARS OF MY LIFE, I NEVER KNEW WHERE I WAS. >> AUDIENCE: [LAUGHING]. >> EVER BECAUSE MY SENSE OF DIRECTION, THIS IS NORTH AND THIS IS SOUTH; RIGHT? THIS MIRACLE HAPPENED AND THIS NOW TELLS ME WHERE I CAN GO. MY WIFE HAS BEEN TELLING ME WHERE I CAN GO FOR A LONG TIME. THIS IS REMARKABLE AND ALL OF COURSE BASED ON ARTIFICIAL INTELLIGENCE. THERE ARE MANY, MANY OTHER EXAMPLES OF THIS. IT IS UBIQUITOUS AND ALL OVER THE PLACE. WE HAVE EXPERTS WHO WILL SPEAK TAO LATER AND THEY KNOW FAR MORE ABOUT THIS THAN I DO. FOR THE REST OF US, FOR THOSE THAT USE MACINTOSHES, WE WOULD LIKE TO GIVE YOU SOME BASIC NOMENCLATURE. OVERARKING THING IS ARTIFICIAL INTELLIGENCE WHICH IS A PROGRAM THAT SENSES AND REASONS AND ACTS AND ADAPTS. ADAPTING IS IMPORTANT AND MACHINE LEARNING IS A SUBSET OF THIS. HERE ALGORITHMS HAVE PERFORMANCE AS THEY IMPROVE AS THEY GOBBLE UP MORE AND MORE DATA. MORE DATA YOU FEED THEM, BETTER THEY GET. THERE IS A DEEP LEARNING SUBSET OF MACHINE LEARNING WHERE MULTILAYERED NETWORKS ABLE TO LEARN MORE RAPIDLY FROM VAST AMOUNTS OF DATA PROVIDED TO IT. I HAVE NO IDEA WHAT A NEURAL NETWORK IS BUT SURE THAT SOMEBODY WILL TELL US LATER THIS MORNING. OKAY? I THINK YOU ARE ALL AWARE EITHER FROM PRACTICE SETTINGS OR FROM YOUR -- YOU KNOW, RESEARCH ACTIVITIES OR JUST READING, YOU KNOW, A NEWSPAPER THAT THERE ARE EXTRAORDINARY OPPORTUNITIES IN BIOMEDICINE FOR ARTIFICIAL INTELLIGENCE AND ONE OF THE HOLY GRAILS IS TO BE ABLE TO EXTRACT THE INFORMATION THAT ARE CONTAINED WITHIN ELECTRONIC HEALTH RECORDS AND TEXT MINING AND OTHER FORMS OF DATA WHICH ARE OF COURSE DESPAIRED IN NATURE. GENOMICS HAS BEEN POWERED BY AND IN FACT BEEN A CATALYST FOR MANY OF THE AI APPROACHES AND THE JOKE AROUND TOWN IS THAT IF YOU ARE -- YOUR KID WANTS TO BECOME A RADIOLOGIST, MAKE SURE THEY GET A DEGREE IN COMPUTER SCIENCE FIRST. SO MUCH OF THAT IS NOW BEING INFORMED BY NOT BEING REPLACED BY BUT INFORMED BY ARTIFICIAL INTELLIGENCE APPROACHES. BUT THERE -- IT IS BEING USED IN LOTS OF CLEVER WAYS. FOR EXAMPLE, TO MONITOR PEOPLE WHO ARE ELDER WILL I OR INFORMED OR ILL TO MONITOR VITALS AT A DISTANCE TO PROVIDE INFORMATION TO CAREGIVERS OR PHYSICIANS OR NURSES AND SO FORTH AND MUCH LARGER LEVEL BEING USED IN SOME SYSTEMS TO DETERMINE WHICH CALLS TO CHILD WELFARE SYSTEMS WANT DEPLOYMENT TO RESOURCES TO PROTECT KIDS AT RISK. STAKES ARE VERY HIGH IN ALL THESE ARENAS, WHICH IS ALL OF THE MORE REASON WHY THIS WORKING GROUP SPENT A LOT OF TIME ON THE LEGAL AND ETHICAL CONSIDERATIONS OF THESE ISSUES. AND THEY ARE JUST SORT OF A SMATTERING OF SOME OF THE RECENT REPORTS ON THIS. A LOT OF IT WILL, YOU KNOW, REVOLVES AROUND CLEAR RULES FOR CONSENT FOR DATA USE WHICH IS A NEW GAME. UNDERSTANDABLY, AND I DON'T MEAN THIS PEJORATIVELY, PEOPLE WHO ARE USING ARTIFICIAL INTELLIGENCE SCRAPE DATA SOURCES THAT ARE SOMETIMES UNCONVENTIONAL, MEANING THEY GO ACROSS THE INTERNET AND OTHER PLACES AND GOBBLE UP WHATEVER DATA THEY CAN ACCESS. MAYBE WHEN YOU INCLUDE IN THAT DATA SET, YOU DIDN'T UNDERSTAND THAT IT MIGHT BE USED FOR SOME SECONDARY ORATOR SHEEARY OR QUATERNARY PURPOSE. THE BIAS POTENTIAL IF DATA SETS IS NOT APPROPRIATELY CONFIGURED IS ENORMOUS. THIS IS A RECENT PAPER FROM SCIENCE. IF YOU HAVE ANY INTEREST IN THIS AREA AND I HOPE YOU ALL DO. PLEASE READ THIS ARTICLE WHICH SHOWS HOW A BIAS IN ALGORITHM BEING USED TO PROVIDE HEALTH CARE LED TO AN UNEQUAL ACCESS FOR BLACK VERSUS WHITE PATIENT. IT IS ALL BECAUSE OF THE DATA SETS UPON WHICH ALGORITHMS WERE BUILT WERE NOT, YOU KNOW, ROBUST. SO, AGAIN, THESE ARE TOOLS THAT ARE EXTRAORDINARY AND YOU WILL HEAR SOME WONDERFUL EXAMPLES OF HOW THEY CAN BE USED. THIS IS THE CAUTIONARY TALE, SO WE HOPE THAT EVERYBODY CONSIDERS THAT. THIS WORKING GROUP SAID, LOOK. WE NEED A NEW DISCIPLINE. WHAT HAPPENS NOW AND MANY OF YOU PROBABLY EXPERIENCE THIS IS A BIO MEDICAL RESEARCHER DOES SOMETHING AND CALLS ON THEIR FRIENDLY MACHINE-LEARNING EXPERT AND SAYS MAKE US SOME ARTIFICIAL INTELLIGENCE TO SORT THROUGH ALL THIS MESS OR MAYBE IT IS A LITTLE LESS COMPLICATED THAN THAT. IT IS ALWAYS AFTER THE FACT. WHAT THE WORKING GROUP STRONGLY RECOMMENDED WAS THE DEVELOPMENT OF THE NEW DISCIPLINE. THEY CALLED IT ML BIO MED. I DON'T KNOW. I WILL LET YOU DECIDE IF YOU LIKE THAT OR NOT. THIS IS BIO MEDICAL EXPERIMENTS DESIGNED FOR MACHINE LEARNERS AND MACHINE LEARNERS THAT ARE DESIGNED FOR BIO MEDICAL EXPERIMENTS AND EVERYBODY GETTING TOGETHER AT ABSOLUTE INCEPTION OF THE PROJECT NOT IN FACT OR AT SEQUENCE BUT AT THE VERY INCEPTION IN THE SAME ROOM. AND SO A WHOLE SERIES OF RECOMMENDATION AND THE REPORT IS LISTED ON THE BOTTOM. YOU CAN INTERGATE THAT IF YOU ARE INTERESTED AND TOP ONE BEING SUPPORT FLAGSHIP GENERATION TO PROPEL THE PROGRESS OF THE SCIENTIFIC COMMUNITY AND YOU WILL SEE ISSUES RELATED TO THE ETHICAL USE OF THIS WORK. THE SECOND ACD WORKING GROUP REPORT I WOULD LIKE TO DRAW YOUR ATTENTION TO WAS ON REDRESSING THE CULTURE OF BIO MEDICAL RESEARCH TO PREVENT AND REDRESS HARASSMENT OF ALL FORMS BUT PARTICULARLY HARASSMENT OF WOMEN. I'M SURE YOU ARE ALL FAMILIAR WITH THE NATIONAL ACADEMY'S REPORT SEXUAL HARASSMENT OF WOMEN AND ICONIC FIGURE OF THAT REPORT THE ICEBERG IS DISPLAYED ON THIS SLIDE ON THE LEFT. IF YOU HAVE NOT YET SEEN THE REPORT, THE LINK IS BELOW THE FIGURE. I URGE YOU TO SPEND TIME REVIEWING THIS. FRANCIS HAS COMMUNICATED TO ALL STAKEHOLDERS THAT SEXUAL HARASSMENT IS MORALLY INDEFENSIBLE AND UNACCEPTABLE AND PREVENTS A MAJOR OBSTACLE THAT IS KEEPING WOMEN FROM THEIR RIGHTFUL PLACE IN SCIENCE. WE HAVE TO CHANGE THINGS. IT IS NOT JUST ABOUT THE TIP OF THE ICEBERG AND METAPHORICAL TIP WHICH IS A SORT OF OVERT SORT OF THINGS AND QUID PRO QUO AND SO FORTH BUT IT IS THE UNDERLYING BULK OF THE PROBLEM OF CREATING AN ENVIRONMENT THAT ENABLES THIS TYPE OF MISBEHAVIOR. SO THE OVERARCHING THEMES OF THIS REPORT ARE OUTLINED HERE TO INCREASE TRANSPARENCY ACCOUNTABILITY AND REPORTING AND PROFESSIONAL MISCONDUCT AND PEOPLE'S CAREERS ARE DERAILED AFTER THEY DO SOMETHING ABOUT IT ENSURE SAFE AND DIVERSE AND INCLUSIVE ENVIRONMENTS THAT MITIGATES AGAINST THIS FROM EVER HAPPENING AND OBVIOUSLY TO CREATE SYSTEMWIDE CHANGE TO ENSURE SAFE AND DIVERSE AND INCLUSIVE RESEARCH ENVIRONMENTS. AGAIN, IF YOU HAVEN'T READ THIS REPORT YET, PLEASE TAKE THE TIME TO DO IT. IT IS A SPECTACULAR WORKING GROUP REPORT. I WASN'T A MEMBER OF THE WORKING GROUP SO I CAN BRAG ABOUT IT AND NATIONAL ACADEMY IS EQUALLY OUTSTANDING. KEY DEFINITIONS WE KNOW WHAT RESEARCH MISCONDUCT S EVERYBODY CAN RECITE T YOU SIT THROUGH TRAINING EVERY YEAR FALSE FICTION AND PLAGIARISM AND WE CAN THINK OF APPROPRIATE BEHAVIORS AS PART OF PROFESSIONAL CONDUCT HARASSMENT AND SEXUAL HARASSMENT AND TYPES OF THIS FROM THE TIP OF THE ICEBERG UNWANTED SEXUAL ATTENTION INCLUDING ASSAULT TO GENDER HARASSMENT INCLUDING DISCRIMINATION AND EVERYTHING IN-BETWEEN. WE NOW HAVE TO PUT THIS AS PART OF OUR LEXICON. TO LEAVE YOU WITH A COUPLE INTROSPECTIVE POINTS, YOU KNOW, IS IT TIME TO RETHINK SOME OF THE VALUES THAT CERTAINLY I AS SOMEBODY WHO HAS BEEN RUNNING A LAB NOW FOR 40 + YEARS HAVE HELD DEAR. SCIENCES AND MERI TOCKCRACY THE LAB IS MY FAMILY. IT IS ACTUALLY NOT YOUR FAMILY BUT PLACE OF BUSINESS. SOMETIMES IT GETS CONFUSING. IT IS AN APPRENTICESHIP. WELL, SHOULD IT BE? A REALLY IMPORTANT POINT FOR ALL ADMINISTRATORS ARE WE TOO WILLING TO [INDISCERNIBLE] BAD BEHAVIOR BECAUSE THESE ARE GREAT SCIENTISTS. IF I HEAR THAT ONCE MORE, BUT HE IS A GREAT SCIENTIST, I WILL SCREAM. I DO SOME SCREAMING AROUND HERE. LET ME TELL YOU. HOW DOES THE WAY THAT WE FUND RESEARCH CONTRIBUTE TOT CULTURE THAT IS DRIVING WOMEN OUT OF SCIENCE? FRANKLY, AS A COUNCIL, THIS IS SOMETHING YOU HAVE TO GET YOUR ARMS AROUND; RIGHT? AS LEADERS IN YOUR RESPECTIVE COMMUNITIES, IT IS SOMETHING YOU HAVE TO GET YOUR OWN. HERE AT NIH WE ARE DOG A LARGE NUMBER OF THINGS AND THAT IS FOR PEOPLE WHO ARE EMPLOYEES AND IT IS A DIFFERENT SET OF RULES AND FEDERAL EMPLOYEES AND THEY ARE OUR EMPLOYEES AND ALL OF YOU WHO WE FUND EXTERNALLY OR NOT ARE OUR EMPLOYEES AND UNIVERSITIES ARE OUR GRANTEES AND A DIFFERENT TYPE OF RELATIONSHIP. WE SET UP A WHOLE RANGE OF EFFORT HERE INCLUDING OVERSIGHT OF A STEERING COMMITTEE I'M PRIVILEGED TO CO-CHAIR AND ROBUST COMMUNICATION INCLUDING ANONYMITY AND CHANGE OF POLICIES AND VERY STRONG PROGRAM IN PLACE FOR PEOPLE TO GO TO AND FOR HELP AND TRAINING AND TO TRY TO ADDRESS THINGS AND SO FORTH. WE DID A SURVEY OF OUR OWN STAFF TO ASSESS PREVALENCE IN THE WORKPLACE CLIMATE. AND WE ADMINISTERED IT FROM JANUARY TO MARCH. EVERYBODY WHO WORKS AT NIH WAS INVITED AND 444% TOTAL RESPONSE RATE EVERYBODY CONTRACTORS ET CETERA AND FEDS AND RESEARCH METHODOLOGY TELLS US THESE ARE VERY GOOD RESEARCH RESPONSES. WE WERE NOT SURPRISED TO LEARN RESPONDENTS WERE MORE LIKELY TO BE WOMEN AND MORE LIKELY TO BE YOUNGER WOMEN. HERE ARE THE KEY FINDINGS. 1 IN 5 RESPONDENTS HAD AT LEAST ONE INCIDENT OF SEXUAL HARASSMENT IN THE PAST 12 MONTHS WHICH IS A LITTLE LOWER THAN OTHER SURVEYS THAT HAVE BEEN PUBLISHED BUT OUR FRAMES WAS A SINGLE YEAR AND MANY POLICIES PUBLISHED MUCH LONGER TIMEFRAME AND SOME OTHERS AND EVER EXPERIENCED LONGER TIMEFRAME AND OURS WAS ONE YEAR ONLY AND NOT EXPECTEDLY AND NEED BASE LINE DATA THAT VULNERABLE POPULATIONS ARE WOMEN WHO ARE TRAINEES WHO ARE YOUNGER INDIVIDUALS FROM SEXUAL AND GENDER MINORITY COMMUNITIES FOR INDIVIDUALS WITH DISABILITIES. IF YOUR SUPERVISOR WON'T BE SUPPORTIVE, YOU ARE MORE LIKELY TO EXPERIENCE SEXUAL HARASSMENT AND THOSE EXPERIENCING BULLYING ARE LIKELY TO EXPERIENCE GENDER AND SEXUAL HARASSMENT AS WELL. BOTTOM LINE, IT IS TIME FOR CHANGE, ROSE. BIOLOGY LEADERSHIP SENT OUT THIS AND HOPE YOU CAN AGREE WE CAN DO BETTER AND MUST DO BETTER. WITH THAT, I WOULD LIKE TO TURN THIS OVER TO JONATHAN. HE WILL NOW GIVE YOU THE NIDCR PORTION OF THE DIRECTOR'S REPORT. >> THANK YOU. LARRY I WOULD LIKE TO ON BEHAD HALF OF THE NIDCR COMMUNITY THANK YOU FOR COMING BACK YOU MIGHT BE KIND OF BUSY. THANKS FOR TAKING TIME AND ENERGY TO LEAD US THROUGH THIS TRANSITION. SO SPEAKING OF TRANSITIONS, WE HAVE SOME STAFF UPDATES. IF STAFF IN THE ROOM MAYBE THEY CAN STAND SO WE INTRODUCE YOU. I WAS NAMED THE PROGRAM DIRECTOR OF OFFICE OF SCIENCE POLICY AND VERY HAPPY TO HAND IT OFF AGAIN TO ACTING DIRECTOR DR. DENISE FREDERICK AND DR. DEANNA FISHER ACTING IN THIS ROLE AND PROGRAM DIRECTOR IN CLINICAL TRIALS AND PRACTICE-BASED RESEARCH AND WELCOME DR. YUON KIM AND DR. KEVIN LIU OUR STADMAN STRAK INVESTIGATOR IN INTRAMURALS. WELCOME. >> THANK YOU. >> AUDIENCE: [APPLAUSE]. >> SO BEFORE DR. SUMMERMAN LEFT SHE WANTED TO DO A GRAND TOUR AND DO VISITS AND UPDATE PEOPLE. UPDATING PEOPLE ON GRATE VISITS WE HAD FIRST PICTURE ON THE LEFT IS HER MEETING WITH COMMITTEE MEMBERS AND THIS IS IN SEPTEMBER AND GREAT OPPORTUNITY FOR DR. SUMMERMAN TO ENGAGE WITH SOME OF OUR MEMBERS OF CONGRESS AND THERE AND HAPPY TO HEAR SOME CONVERSATIONS AROUND OPIOIDS AND SOME OF OUR WORK ON SPECIAL POPULATIONS AND THOSE WITH AUTISM AND DOWN SYNDROME AND IMPROVE CLINIC TO GET THEM BETTER ACCESS TO CARE AND SECOND PICTURE IS US MEETING WITH CANADIAN AND CHIEF DENTAL OFFICERS I WAS HAPPY WITH THIS ACROSS 49TH PARALLEL POW WOW TO DISCUSS OPPORTUNITIES AND TRADE STORIES OF DENTAL HEALTH IN CANADA VERSUS US. -- AND THIS INVOLVED THEM KIND OF MEETING AND THESE ARE FUTURE DENTAL FACULTY LEADERSHIP MEETING WITH SENIOR LEADERSHIP AND ALSO THEY GOT A TOUR OF ONE OF OUR LABS AND ALSO THE DENTAL CLINIC. FINALLY, WE WERE REALLY PROUD TO HOST A GRAND ROUNDS THAT CELEBRATED 35 YEARS OF CHILDREN'S SYNDROME AT NIH WHICH WAS FANTASTIC GATHERING IN PAST FUTURE OF SHOWING GRIN SYNDROME RESEARCH AND NIH -- I WILL FOCUS A LITTLE ON NIDCR BUDGET. JANUARY IS WHEN WE DO BUDGET. FY19 BOOKS ARE CLOSED. THIS IS OPPORTUNITY TO DO A DEEP DIVE. WE ARE THRILLED TO HAVE 3.4 INCREASE UP TO 4 SEVEN 7.4 MILLION FOR 2020 APPROPRIATIONS AND WANT TO ECHO HIS THANKS TO STAKEHOLDERS COMMITTED TO MISSION OF NIDCR TO HELP SUPPORT US TO HAVE HEALTHY INCREASES THAT FUND MORE RESEARCH. IF WE FOCUS ON FY2019 BOOK THAT IS CLOSED AND FOCUS ON -- WE FUND ABOUT 80% OF BUDGET TO EXTRAMURAL AND 15% GOES TO INTERRA MURAL AND SO I WANT TO REMIND PEOPLE THAT INTERRA MURAL BUDGET INCLUDES ESSENTIAL TAPS AND ASSESSMENTS AND WE ARE SUPPORTING TRANS-NIH ACTIVITIES LIKE PEER REVIEW AND CLINICAL CENTER AND THINGS LIKE THAT. I WILL DIVE A LITTLE DEEPER ON EXTRAMURAL RESEARCH IF YOU LOOK AT EXTRAMURAL BUDGET FOR 2019 YOU SEE IT WAS $361 MILLION AND ON LEFT WE REMAIN COMMITTED TO FUNDING RESEARCH PROJECT GRANTS AND REPRESENTS 80% OF EXTRAMURAL BUDGET AND WE HAVE OTHER IMPORTANT PROGRAMS LIKE SMALL BUSINESS PROGRAM AND TRAINING AND CAREER DEVELOPMENT THAT IS UP HERE. NOW, IF WE CONTINUE OUR DIFAND FOCUS ON THE RESEARCH PROJECT GRANTS, YOU CAN SEE THAT TOTAL RESEARCH GRANT FUNDING FOR FY19477% NONCOMPETING RPGS AND HEALTHY 23% OF FUNDING FOR NEW AWARDS AND TOTAL POT OF 19% WENT TO UNSOLICITED RPGS AND 4% WENT TO RFAS. WE OFTEN TALK ABOUT SUCCESS RATES IT THAT IS LOOKING AT RESEARCH PROJECT GRANT SUCCESS RATES OVER PAST 10 YEARS. NIDCR IS IN BLUE AND -- THANKS TO BUDGET INCREASES IN THE LAST COUPLE YEARS WE HAVE BEEN ABLE TO INCREASE SUCCESS RAITY TO CLOSE TO 24%. IN GENERAL, WE FOLLOW THE NIH TREND AND WE HAVE SLIGHTLY HIGHER SUCCESS RATES OVERALL. SUCCESS RATES IS A STANDARD MEASURE THAT WE USE THAT IS A WAY TO LOOK AT NUMBER OF AWARDS FUNDED IN GIVEN FISCAL YEAR TAKING INTO ACCOUNT PEOPLE WHO RESUBMIT. A COUPLE OTHER METRICS WON'T GET INTO DETAILS ON THEM LET YOU KNOW AS YOU HEAR ABOUT NIH ACTIVITIES AND WAYS WE MEASURE SUCCESSES AND METRICS WE USE OTHER METRICS. WON'T GO INTO TOO MANY DETAILS. SUCCESS RATE IS HERE IN THE MIDDLE WAY IT WORKS IS A NUMBER OF AWARDS DIVIDED BY NUMBER OF APPLICATIONS AND TAKING INTO ACCOUNT RESUBMISSIONS AWARD RATE IN BOTTOM LINE IS RAW NUMBER LOOKING AT APPLICATIONS COMING IN AND AWARDS GOING OUT AND ALLOWS FLEXIBILITY TO COME BY IN OTHER FISCAL YEARS ANOTHER METRIC. ANOTHER METRIC IS FUNDING RATE AT NIH THAT IS LOOKING AT PERSON INSTEAD OF APPLICATION IN TERMS OF MEASURE VALUABLE METRIC IT IS LESS IMPORTANT WHETHER AN INDIVIDUAL GOT AN AWARD VERSUS IF THEY ARE AWARDED IN GENERAL. ALWAYS WORRYING ABOUT DID WE FUND AN APPLICATION IS NOT AS PERHAPS POWERFUL AS ARE WE FUNDING PEOPLE. I INCLUDED FUNDING RATE HERE TO LET YOU KNOW FUNDING RATE ARE WE FUNDING PEOPLE IS SLIGHTLY HIGHER SUCCESS RATE AND 27% AND DEPENDING ON ANALYSIS AND METRIC AND WHAT WE TRY TO MEASURE YOU HEAR SLIGHTLY DIFFERENT METRICS OF SUCCESS. LY DO A LITTLE PAST, PRESENT, AND FUTURE TO LET YOU KNOW THAT EVERY TIME YOU COME TO COUNCIL YOU ARE OFTEN GIVING US FEEDBACK ON CONCEPTS THAT GET CLEARED BY COUNCIL AND WANT TO LET YOU KNOW WHAT HAPPENS TO CONCEPTS YOU CLEAR. IF WE LOOK BACK AT FY19 THESE ARE RFAS WE AWARDED AND YOU CAN SEE THE LIST HERE AND MECHANISM AND SEE THE NUMBER OF AWARDS. I WON'T GO INTO TOO MANY DETAILS AND WANT TO HIGHLIGHT A COUPLE OF THINGS TO LET YOU KNOW WHAT WE AWARDED AND KNOW YOU REMAIN COMMITTED TO PHASE BASE 3 AND FUNDED PHASE 3 OF DATA MANAGEMENT INTEGRATION HUB AND LARRY MENTIONED COMMITMENT TO SOAR AND INVESTIGATION AWARDS CONTINUE TO MAKE SOAR AWARDS AND PRACTICE-BASED RESEARCH NETWORK AWARDS PHASE 3 PRACTICE RESEARCH CENTER AND COORDINATING CENTER AND STARTING TO FUND HERE CLINICAL TRIAL AND OBSERVATION STUDY PLANNING AND IMPLEMENTATION AGREEMENT WHICH WE FUNDED IN 2019 AND WAS THE PATH. IF WE MOVE TO THE PRESENT WE ARE FUNDING AND PLANNING TO FUND IN FY2020 AND PREVIOUS COUNCILS YOU CLEARED SORRY PREVIOUS CONCEPTS YOU CLEARED AS A COUNCIL. PBRN WE CONTINUE TO INVEST AND SOAR AWART AND LARRY MENTIONED DENTAL ORAL FASHIO -- THIS IS FOR PHASE 3 AND WE WILL SUPPORT IN 2020NIDCR MENTORING NETWORK TO SUPPORT A DIVERSE RESEARCH FORCE. THIS IS THE PRESENT AND LOOKING TO FUTURE AND THESE ARE CONCEPTS YOU APPROVED IN THE PAST AND THEY ARE MOVING FORWARD INTO FUTURE FUNDING OPPORTUNITY ANNOUNCEMENTS AND RFAS. I WANTED TO LET YOU KNOW WHEN YOU GIVE US YOUR INPUT AND GIVE CONCEPTS YOU KNOW WE ARE R THESE THRILLED THEY MOVE FORWARD INTO FUNDING OPPORTUNITY ANNOUNCE MS. SO I WANTED TO DO A COUPLE OF OTHER UPDATES OF TOPICS OF INTEREST TO COUNCIL. FIRST IS NATIONAL ACADEMIES CONCENSUS STUDY ON TEMPOROMAN DIBULAR JOINT DISORDER AND THIS IS COMMITMENT OF NIDCR AND NIHD THIS IS TO MAKE PROG GREG GREYS ON DEBILITATING DISEASE AND 18-MONTH PROCESS AND PUT TOGETHER EXPERT PANEL AND HEARD FEEDBACK FROM STAKEHOLDERS AND WORKED DILIGENTLY TO PUT TOGETHER THIS REPORT. EXPANSIVE REPORT CHARGE TO COMMITTEE WAS VERY BROAD AND INCLUDED CLINICAL RESEARCH AND CARE AND ACCREDITATION AND INSURANCE AND WE WILL GET A FANTASTIC XREEND HENCESIVE REPORT THAT WILL PROBABLY COME OUT IN MARCH. I ANNOUNCE TODAY THAT I WANT TO WORK WITH ALL OF YOU ON THIS REPORT. WHAT WE REALLY WANT TO DO IS PULL OUT THE RESEARCH. WHAT ARE REAL RESEARCH OPPORTUNITIES COMING OUT OF THIS REPORT? I WANT REALLY THE EXPERTISE OF COUNCIL AS WE START LOOKING AT THE REPORT AND DEVELOPING NEXT STEPS AND ANNOUNCE TODAY WE WILL REACH OUT TO YOU FOR YOUR FEEDBACK AND AFTER THE REPORT IS RELEASED IN MARCH WE WILL START WORKING ON THAT. WE HAVEN'T DONE A COUNCIL GROUP IN A WHILE. UNIQUE OPPORTUNITY FOR US TO WORK ON THIS AND WILL REACH OUT TO OTHER INSTITUTES AND CENTERS AND RECOGNIZE THERE WILL BE LOTS OF EXPERTISE THAT DIFFERENT RESEARCH INSTITUTES AND CENTERS HAVE THAT CLASS IMPACT TMJ AND ALSO ENSURING THERE IS A TRANS-NIH PRESENCE ON THIS COMPLICATED DISEASE. A COUPLE OF OTHER UPDATES, SO AS MANY PEOPLE KNOW, FLURIDE IS IN THE NEWS AND NATIONAL TOXICOLOGY PROGRAM THAT IS SUPPORTED BY A SISTER ICS NICHS HAS COMPRISED A MONOGRAPH THAT IS A SYSTEMATIC REVIEW THAT FOCUSES ON ROLE AND HUMAN DEVELOPMENT AND THIS MONOGRAPH IS UNDERGOING PEER REVIEW AT NATIONAL ACADEMIES IMPORTANT ENOUGH REPORT THERE WAS SUPPORT FOR INDEPENDENT EXPERT PANEL TO LOOK AT IT FINALIZING PEER REVIEW RIGHT NOW AND DON'T HAVE UPDATE ON DATE AND WHEN IT WILL BE RELEASED IN THE PROCESS BUT WANT TO LET YOU KNOW WE ARE PART OF THE CONVERSATION AND LOOKING FORWARD TO PEER REVIEW AND FINDINGS TO FIGURE OUT WHAT RESEARCH OPPORTUNITIES DO WE NEED TO TARGET FOR FLORRIDE IN HUMAN DEVELOPMENT AND HOW CAN WE WORK WITH NIDHS AND WANT TO ANNOUNCE TO EVERYBODY THAT WE HAVE -- NIDCR HAS HAD A PROGRAM RESIDENCY IN-HOUSE AND DECIDED WE WON'T ACCEPT NEW APPLICATIONS FOR THIS PROGRAM AND WE OF COURSE WILL REMAIN COMMITTED TO RESIDENTS THAT ARE CURRENTLY IN THE PROGRAM AND WEARING MY POLICY HAT, I PRESENTED A COUNCIL A FEW ROUNDS AGO ABOUT STRATEGIC PLAN AND MADE FANTASTIC PROGRESS DEVELOPING GREAT FRAMEWORK AND GREAT IDEAS AND PRIORITIES AND IN CONVERSATION WITH LARRY WE WANTED TO PUT IT ON HOLD AND DIRECTOR TO HAVE A CHANCE TO LOOK AT FRAMEWORK WE DEVELOPED AND SEE IF THEY CAN ADD VISION TO IT AS WE MOVE FORWARD FOR INSTITUTE. THANK YOU FOR INPUT. IT IS THERE WE LOOK FORWARD TO LIKE LARRY HAPPY AND EXCITED TO GET A NEW DIRECTOR. LOOKING FORWARD TO THAT. I WANT TO CLOSE WITH ONE OR TWO LITTLE STORIES OR VIGNETTE AND AS WE MENTION DENTAL ORAL KRASHIO FACIAL -- MAJOR INITIATIVE IN THE INSTITUTE OF GOAL OF REALLY DEVELOPING TREATMENTS FOR PATIENTS IN TISSUE REGENERATION AND WE FUNDED A THREE-PHASE STRUCTURE FOR DR. C AND HAD A PLANNING PHASE AND RESOURCE CENTER PHASE AND NOW ENTERING PHASE 3 WHICH IS REALLY SUPPORTING IND AND IED ENABLING STUDIES AND BROAD DIVERSITY OF STUDIES CURRENTLY ENGAGED IN ENCOURAGING THEM TO MOVE FORWARD AND WANT TO HIGHLIGHT ONE I THINK IS KIND OF INTERESTING. WE HAVE A SMALL BUSINESS CALLED LAUNCH PAD MEDICAL THAT THEY DEVELOPED A BIO MATERIAL CALLED TETRA NITE WHICH IS BONE ADHESIVE NOT INJECT TIBL OR INVASIVE THEY ARE USING IT TO INJECT INTO BONE TO HELP HEAL FRACTURES AND ALSO FOR INTEGRATION WITH METAL PRODUCTS AND IT WOULD BE USEFUL FOR DENTAL IMPLANTS. THEY ARE DOING THAT AS PART OF DR. C INTERESTING AND INNOVATIVE APPROACH THEY RECEIVED ADDITIONAL -- THEY ARE ATTACHING PAIN RELIEVERS INTO BIO MATERIAL NOT ONLY IS IT DOING BONE REGENERATION AND GRAPHING BUT REDUCING PAIN AND USING NON-OPIOD PAIN MEDICATION SYNERGY OF TISSUE REGENERATION AS WELL AS PAIN MEDIATION. I WILL END WITH A SHAMELESS PLUG. THAT IS BASICALLY OUR COMMUNICATION SHOT DOES A FANTASTIC JOB OF WRITING UP WONDERFUL STORIES FOR OUR WEBSITE. THESE ARE ALL PUBLICLY AVAILABLE AND WORK CLOSELY WITH GRANTEES AND INTRAMURAL STAFF TO INCREASE VISIBILITY OF STORIES AND ENCOURAGE YOU TO SIGN UP FOR GOV DELIVERY AND COMMUNICATION TOOLS TO KEEP IN TOUCH WITH US AND I JUST HIGHLIGHTING TOO A STORY ON MENTORING AND NEW POST DOC WHO HAS JOINED AS PART OF OUR PARK MEMORIAL FELLOW WHO IS WORKING INTRAMURALLY IN SELF [INDISCERNIBLE] IN NEURAL QUEST THIS IS A GOOD VISUAL STORY IN MEDIA WE NEED LOTS OF GREAT VISUALS SALARY IS GO-TO FOR FANTASTIC VISUAL. SHAMELESS PLUG TO GO TO OUR WEBSITE AND CHECK OUT SOME OF OUR STORIES AND RESEARCH ADVANCES AS WE TRY TO COMMUNICATE WHAT WE ARE ACCOMPLISHING HERE. WITH THAT, I WOULD LIKE TO THANK EVERYBODY FOR THEIR TIME AND DR. TABAK AND I ARE HAPPY TO HAVE A CONVERSATION. >> THANKS, JONATHAN. WE ARE OPEN FOR DISCUSSION. IF YOU DON'T DISCUSS, I WILL START TO TELL YOU ABOUT THE KREB CYCLE AS AN INCENTIVE TO GET YOU TO SPEAK RATHER THAN ME. >> THAT IS WAY TOO SCARY. >> AUDIENCE: [LAUGHING]. >> IN YOUR SEARCH YOU WILL BE DOING, I SENT OUT AN E-MAIL ALREADY TO SOME FRIENDS AND HIGHLIGHTED THAT. SO HOW ARE YOU GOING TO BE DOING ACTUAL SEARCH PROCESS AND -- >> YEAH. SO I WILL PUT MY OTHER HAT ON NOW FOR A MOMENT BECAUSE AS PRINCIPAL DEPUTY I COORDINATE SEARCHES FOR THE AGENCY. WHAT WE DO IS WE HAVE A SEARCH COMMITTEE THAT SOLICITS NOMINATIONS FROM INDIVIDUALS OR SELF-NOMINATIONS OBVIOUSLY ARE ALSO APPROPRIATE. THEY WILL REVIEW THE -- THE APPLICATIONS CLOSE THE 20TH OF FEBRUARY. THEY WILL REVIEW SOMETIME IN MARCH THE ENTIRE CORPUS OF APPLICATIONS AND WILL DECIDE ON THE TOP WHATEVER THE NUMBER IS, INDIVIDUALS TO COME IN FOR AN INTERVIEW WITH THE SEARCH COMMITTEE WHICH IS A TYPICALLY FACE-TO-FACE MEETING. FROM THAT ENCOUNTER PLUS WHATEVER ELSE THEY HAVE LEARNED ABOUT THE INDIVIDUALS, THEY WILL THEN RECOMMEND TO DR. COLLINS A SUBSET OF THOSE INDIVIDUALS. ON BEHALF OF DR. COLLINS, I SET UP INTERVIEW OPPORTUNITIES FOR ALL OF THESE INDIVIDUALS THAT ARE HERE ON CAMPUS MEETING BOTH WITH OTHER INSTITUTE AND SENATOR DIRECTORS AND FUTURE COLLEAGUES, IF YOU WILL, AS WELL AS LEADERSHIP WITHIN THE OFFICE OF THE DIRECTOR. THEN AFTER WE GET THE FEEDBACK OF THAT SORT OF SECOND ROUND OF INTERVIEWS, IF YOU WILL, WE THEN WILL HAVE A CONVERSATION WITH, YOU KNOW, OD LEADERSHIP OFFICE OF DIRECTOR LEADERSHIP AND DR. COLLINS WILL DO ADDITIONAL DUE DILIGENCE ON WHATEVER THE SMALLER SUBSET IS AND ULTIMATELY MAKE A RECOMMENDATION. THESE ARE SECRETARIAL LEVEL APPOINTMENTS. WE WILL MAKE OUR RECOMMENDATION TO THE SECRETARY FOR HIS SELECTION OF THE NEXT DIRECTOR OF THE INSTITUTE. IT SOUNDS LIKE A LOT -- AN ELABORATE AND LABORIOUS PROCESS AND WORKS PRETTY WELL I THINK. I'M BIASSED BUT THINK IT WORKED PRETTY WELL AND OVER THE LAST SEVERAL YEARS, WE HAVE BEEN VERY FORTUNATE TO ATTRACT IN ALMOST EVERY CASE, OUR NO. 1 CANDIDATE. WE HAVE BEEN ABLE TO BRING ON, YOU KNOW, SPECTACULAR GROUP OF INSTITUTES AND DIRECTORS. WE WILL KEEP THAT GOING. >> WELL, PUT ON YOUR THINKING HATS AND EITHER DECIDE TO APPLY YOURSELF OR THAT WAS A SHAMELESS PLUG SPEAKING OF SHAMELESS PLUG. OR IF YOU HAVE COLLEAGUES YOU KNOW IT THAT WOULD BE POTENTIALLY GOOD IN THIS ROLE. I SHOULD ADD THAT THE PERSON THAT YOU WANT FOR THIS JOB IS NOT THE PERSON WHO YOU THINK REALLY DESPERATELY WANTS IT. THE PERSON YOU WANT FOR THIS JOB IS ENORMOUSLY SATISFIED AND SUCCESSFUL IN THEIR CURRENT ROLE. THE PERSON YOU WANT FOR THIS JOB IS THE -- IS THE PERSON WHO WOULD NEVER THINK TO, YOU KNOW, JUMP UP AND DOWN AND SAY: ME, ME, ME. IT IS LIKE WHEN YOU PICK A DEAN OR CHAIR AT YOUR INSTITUTION, YOU WANT INDIVIDUAL WHO WILL BE AN ENNLABLER AND PUT POSITIONS ABOVE THEMSELVES. YOU GET OUT IN FRONT AND ARE ON THE LINE AND REQUIRES A UNIQUE INDIVIDUAL THAT IS WILLING AND ABLE TO DO THAT. AGAIN, THESE FOLKS ARE NOT READING CHRONICLE OF HIGHER EDUCATION AND JOB ADVERTS AND NOT READING SCIENCE. WE DO ALL THAT STUFF. NO. THESE ARE YOUR COLLEAGUES AND NETWORK AND FOLKS YOU WOULD WANT TO SEE IN A POSITION THAT IS THIS IMPORTANT IS THE BEST THING THAT MEMBERS OF COUNCIL CAN DO. ROU YOU'LL? >> GREAT SUCCESS RATE AND FUNDING AND ACROSS NIH DOES IT MAKE IT LOOK LIKE AN EASIER PLACE TO GET MONEY AND EQUAL AMOUNTS OF INSTITUTES AND FUNDS ARE BEING EQUALLY APPORTIONED? >> I THINK THAT IS VIRTUALLY IMPOSSIBLE TO DO WHEN YOU HAVE SEEN ONE INSTITUTE OR CENTER YOU HAVE SEEN ONE INSTITUTE OR CENTER. SOME ARE STRUCTURED VERY DIFFERENTLY AND SOME INSTITUTES HAVE VERY LARGE CLINICAL TRIALS NETWORK AND END IS VERY DIFFERENT THAN IF YOU ARE DRIVEN MORE BY SMALLER RPGS. OTHERS MAKE EXTENSIVE USE OF CONTRACTS. IT IS BECAUSE OF THE NATURE OF THEIR MANDATE AND THEIR MISSION. AGAIN, THAT WILL TORQUE SUCCESS RATES IN A CERTAIN WAY. I THINK THAT FOR AN INSTITUTE THE SIZE OF NIDCR AND GIVEN THE SKA ORDINARY BREADTH OF RESEARCH THAT NEEDS TO BE SUPPORTED, THIS IS NOT AN UNREASONABLE MRAIS TO BE RELATIVE TO THE OTHER SIMILAR INSTITUTES. HISTORY TELLS US THAT THE OPTIMUM SUCCESS RAITY IS MORE LIKE 30 TO 33%. WE STILL DESPITE GREAT SUPPORT FROM THE CONGRESS ARE LEAVING GREAT STUFF UNSUPPORTED AND THERE IS ABSOLUTELY NO QUESTION ABOUT THAT. I THINK IF YOU LOOK AT HISTORY, YOU KNOW, THE TOP THIRD, THEY TEND TO BE THINGS YOU CAN REALLY GET BEHIND AND BE VERY, VERY COMFORTABLE. OBVIOUSLY, THERE ARE EXCEPTIONS. THAT IS USUALLY THE CASE. INSTITUTE THAT IS NIDCR'S SIZE AND GIVEN THE INCREDIBLE BREADTH OF WORK THAT THE INSTITUTE SUPPORTS, I THINK SIMILAR POSITIONED INSTITUTES BUT A VERY IMPORTANT THING TO THINK THROUGH AS, YOU KNOW, YOU DO PLANNING. OTHER QUESTIONS, PLEASE. >> JUST WONDERING IF SOMEONE COULD SPEAK TO THE RATIONAL BEHIND NIDCR PUBLIC HEALTH RESIDENCY PROGRAM AND DECISION TO NOT CONSIDER THAT. SOME MEMBERS IN GENERAL PUBLIC HEALTH COMMUNITY THAT VALUED THAT AND WISHED IT COULD CONTINUE. >> SPEAKING TO JONATHAN, IF I MAY. >> THIS IS SOMETHING WE THOUGHT ABOUT AND DID AN EVALUATION AND EXTERNAL EVALUATION ABOUT 4 YEARS AGO TO REALLY FIGURE OUT WHETHER IT WAS A GOOD FIT FOR NIDCR AND MISSION TO SUPPORT RESEARCH AND SMALL PROGRAM THAT HAD BEEN AROUND A LONG TIME. AS PART OF THE EVALUATION WE DECIDED TO DEVELOP A NEW PARTNERSHIP WITH LNM TO FOCUS ON ORAL PILOTS AND WE DID THAT FOR TWO YEARS AND LOOK AT PROGRAM AND OPPORTUNITIES AND SUCCESSES AND THINKING AND BALANCING WHAT ARE WE GETTING AND WHAT IS IMPACT WE ARE INVESTING WE STILL FELT IT WASN'T A REALLY USEFUL AND VALUABLE INVESTMENT GIVEN OUR IMPACT. WHAT WE WOULD LIKE TO DO SURGEON GENERAL REPORT IS COMING OUT IN THE FALL THAT WILL GIVE US LOTS OF OPPORTUNITIES TO IDENTIFY STRATEGIES AND OPPORTUNITIES TO MOVE PUBLIC HEALTH IF WE WANT TO MOVE PUBLIC HEALTH AND ARE A RESEARCH AGENCY WE THINK THINKING ABOUT THE NEXT GENERATION OF RESEARCHERS AND DENTAL AND PUBLIC HEALTH MOVING THE NEEDLE NOT PUTTING A PAUSE ON IT AND NOT ACCEPTING ANYBODY NEW AND WAITING TO SEE WHAT FUTURE HOLDS FOR SURGEON GENERAL REPORT WE FEEL THIS IS THE BEST INVESTMENT OF OUR DOLLARS. >> IF I CAN FOLLOW UP ON DAN'S COMMENT. >> YEAH. >> IN YOUR REFRAMING AND THINKING OF THE PROGRAM IN THE COMING YEAR, ONE WAY YOU MIGHT WANT TO CONSIDER IS A FELLOWSHIP IN RESEARCH IN POPULATION ORAL HEALTH SCIENCES. >> YEAH. >> WHERE IT IS FOCUSED ON SCIENCE AND POPULATION HEALTH. I THINK MY PERSPECTIVE IS A GAP PERHAPS IN THE INTRAMURAL PROGRAM AND SOMETHING THAT COULD BE STRENGTHENED PERHAPS AND FELLOW FROM OUTSIDE COULD HELP WITH THAT REGARD. PROGRAM, FELLOWSHIP PROGRAM AND SATISFY REQUIREMENTS SITTING ON THE BOARD OF PUBLIC HEALTH DOESN'T HAVE TO BE DESCRIBED AS DPA AGENCY AND ATTRIBUTES AND FOCUS ON HEALTH AND ALL ORAL CONTRIBUTIONS. >> I WILL JUMP IN HERE. OBVIOUSLY INFORMED BY THE SURGEON GENERAL'S REPORT. THE NEW PERMANENT DIRECTOR WILL YOU KNOW MAKE SOME DECISIONS BEING AN INTERIM DIRECTOR, YOU DON'T WANT TO CHANGE COURSES. IT IS JUST NOT APPROPRIATE. IT IS FUN TO THINK ABOUT SOMETHING YOU MIGHT WANT TO DO. THE WORK OF THIS TYPE WITHIN THE INTRAMURAL PROGRAM AND WE HAVE BEEN THERE AND DONE THAT MANY, MANY YEARS AGO AS SOME OF YOU MAY RECALL. IT IS COMPLICATED AND I DON'T WANT TO SPEAK FROM THAT. IT IS COMPLICATED BECAUSE UNLESS YOU HAVE A CRITICAL MASS OF INDIVIDUALS WHO ARE SIMILARLY THINKING ABOUT THINGS, IT BECOMES A LONELY EXISTENCE, YOU KNOW? THERE IS ALWAYS THIS BALANCE THAT NEEDS TO BE STRUCK. AS -- YOU KNOW, AGAIN, AS SORT OF A SMALLER IC, YOU HAVE TO BE A LITTLE SELECTIVE ABOUT WHAT YOU TAKE ON INTRAMURALLY FOR OBVIOUS REASONS. YOU KNOW, THE IDEA OF A FELLOWSHIP, THAT IS SOMETHING THAT OBVIOUSLY TALKING ABOUT INTERNALLY AND SHOULD BE CONSIDERED. WE WILL WAIT FOR THE CERTAIN -- THANK YOU. >> SO -- SO THIS MAY BE A LITTLE TOUGH QUESTION. YOU KNOW, THERE IS A GENERAL CONCEPT OF LIKE DENTAL INSTITUTE OR EYE INSTITUTE THAT ARE HISTORICALLY IMPORTANT BUT RIGHT NOW MAY NOT BE THAT MUCH IMPACTFUL. I UNDERSTAND ON HOW BRING CRANIOFACIAL AND YOU BRING NEW SALIVA AND TWIST TO MAKE IT IMPORTANT. WHAT IS FUTURE DIRECTOR GOING TO BE PUTTING BEST INSTITUTE IN VERY IMPORTANT POSITION IN NIH? >> YOU KNOW, I -- YEAH. SO LOOK. I THINK THAT IF WE START WITH A PREMISE THAT THIS IS ATAX TO THE REST OF THE BODY; RIGHT? THERE ARE EXTRAORDINARY OPPORTUNITIES FOR REGENERATIVE MEDICINE. WE ONLY SCRATCHED THE SURFACE. AREA OF BONE REGENERATION WHERE I THINK WE MADE PROBABLY THE MOST ADVANCED, WE STILL HAVE MUCH TO DO. THERE ARE ALL OTHER DENTAL ORAL AND CRANIOFACIAL STRUCTURES THAT, YOU KNOW, ARE AMENABLE TO WHAT WE HAVE NOT YET EXPLOITED THE LATEST CUTTING-EDGE SCIENCE TO -- TO WORK ON. WE TALK ABOUT BUILDING AN ARTIFICIAL TOOTH. WE ARE GOOD AT CROWNS. ROOTS ARE A LITTLE BIT HARDER. AT LEAST THE LAST TIME I CHECKED. OKAY? DESPITE ALL OF THE GOOD WORK IN THE FIELD, THEY ARE STILL HARD, THE ROOTS; RIGHT? CROWNS ARE EASY AND WE HAVE KNOWN HOW TO DO IT FOR A LONG TIME. THERE IS CERTAINLY THAT BUT BEYOND -- AGAIN, YOU KNOW, MY BRAIN GOES TO SORT OF BASIC TO TRANSLATIONAL STUFF. BEYOND THAT, THERE IS, YOU KNOW, DENTISTRY AS PART OF THIS SO-CALLED HEALTH CARE SPECTRUM WHICH IS CRUCIALLY IMPORTANT. I THINK MOST OF YOU KNOW THAT MANY TIMES AN INDIVIDUAL IS MORE LIKELY TO SEE A DENTIST OR DENTAL PROVIDER THAN THEY ARE A PHYSICIAN. YOU HAVE THIS ONE CONTACT AND WHAT DO YOU MAKE THE MOST OF DURING THAT ONE CONTACT? IT IS OPPORTUNITY LOST IF YOU DON'T CONSIDER, YOU KNOW, A BROADER RANGE OF THINGS. YOU CAN GO FROM THE VERY, VERY BASIC TO VERY, VERY CLINICAL. THEN FINALLY, TO -- YOU KNOW, TO THINK A LITTLE BIT ABOUT THE BROADER PICTURE AND THINK OF THE COMMUNITY AS AN ENITITENTITY. WE HAVE TOOLS NOW THAT TACKLE COMMUNITY-BASED IN A WHOLE NEW WAY. WE HAVE DATA ANALYTICS NOW THAT CAN DRIVE US TO DO THINGS WE NEVER THOUGHT OF BEFORE. DENTISTRY HAS TO BE ON THE TABLE FOR THOSE DISCUSSIONS AND THERE IS ENORMOUS OPPORTUNITY AND EXCITEMENT FOR THAT. TO THE CONTRARY, I THINK THAT THE INSTITUTE IS MORE RELEVANT TODAY THAN IT HAS EVER BEEN. WE CAN TAKE ADVANTAGES OF THE EXTRAORDINARY ADVANCES AND AS IMPORTANTLY, WE CAN CONTRIBUTE TO THOSE ADVANCES. RIGHT? SO IF YOU LOOK AT THE HISTORY OF WHERE SOME OF THE GREAT STUFF WE ARE DOING NOW CAME FROM, SO MY FAVORITE IS THE MICROBIOME. OKAY? SO EVERYBODY, EVERYBODY IS SO INCREDIBLY ENERGIZED BY STUDIES OF THE MICROBIOME. SO FIGURE THAT OUT A LONG TIME AGO. IT WAS CALLED DENTAL PLAQUE. HELLO. WE HAVE BEEN DEALING WITH A MICROBIOME FOR HOW MANY YEARS? IN MANY INDUSTRIES, DENTISTRY IS IN THE LEAD. WE DON'T -- FOR WHATEVER REASON, WE DON'T STAND UP AND SAY THAT WITH THE PRIDE IT DESERVES AND EMPHASIS THAT, YOU KNOW, IT SHOULD BE RECEIVING. THAT WAS A SETUP QUESTION, THANK YOU. >> AUDIENCE: [LAUGHING]. >> BECAUSE IT HAS NEVER BEEN BETTER. IT IS AN EXCITING, EXCITING TIME. YOU KNOW, TO A POINT WE WILL DISCUSS WITH ANOTHER COUNCIL, I'M SURE. TRAINING, HOW DO WE GET YOUNG DENTISTS TO EMBRACE THIS OPPORTUNITY? YOU KNOW, WE TALK ABOUT CHALLENGE AND CHALLENGE AND CHAL INGRES OF. HOW DO WE GET THEM TO EMBRACE AN EXTRAORDINARY SET OF OPPORTUNITIES TO PARTICIPATE IN A WAY AND FRANKLY ONLY IN A WAY THAT A CLINICIAN SCIENTIST CAN. THAT REMAINS FOR NOT ONLY NIDCR AND PHYSICIAN SCIENTISTS AND NURSING SCIENTISTS AS WELL. THAT STILL REMAINS A CHALLENGE AND HOW DO WE TURN THAT CORNER? THANK YOU. GOOD SOFT BALL. I LIKE THAT ONE. OTHER SOFTBALLS? >> YEAH, LARRY. I HAVE BEEN TRYING TO THINK AS YOU -- I HAVE BEEN TRYING TO THINK AS YOU ARE TALKING OF THE CREDENTIALS AND IDEAL CREDENTIALS. FOR EXAMPLE, COULD IT BE A DEAN? COULD IT BE A BUSINESS PERSON? COULD IT BE A FANTASTIC RESEARCH PERSON? I KNOW ALL OF THESE ARE, BUT IF YOU COULD FIND SOMEBODY AND IN MY CONTEXT SOMEONE LIKE MIKE ALFONO WHO CROSSED THE BORDERS OF RESEARCH AND DEVELOPMENT. >> SO, AGAIN, NOT SPEAKING TO ANY SPECIFIC CANDIDATE. YOU KNOW I LOVE MIKE VERY MUCH. >> YEAH. >> I UNDERSTAND. BUT AGAIN, EXPERTISE AND EXPERIENCE IN ALL OF THOSE DOMAINS ARE VERY, VERY GERMANE. I WILL TELL YOU AS WE LOOK AT CANDIDATES FOR INSTITUTE AND SENATOR DIRECTORSHIPS ACROSS NIH INCREASINGLY, WE DO SEE INDIVIDUALS WHO HAVE HAD NOT NECESSARILY THEIR OWN COMPANY OR DIRECT CORPORATE EXPERIENCE BUT CERTAINLY ENGAGEMENT IN A VERY REAL AND MEANINGFUL WAY WITH COMPANIES. >> YEAH. >> BECAUSE, AGAIN, WE ARE ALL ANXIOUS TO BE ABLE TO TRANSLATE THINGS INTO TANGIBLES AND GET THEM TO OUR PATIENTS AND SO FORTH. THAT LAST STEP, WHICH IS IN MANY WAYS, A VERY DIFFICULT STEP, COULD BE FACILITATED IF INDIVIDUALS HAVE A DEEPER UNDERSTANDING OF THAT, YOU KNOW, DOMAIN. THAT IS CERTAINLY REASONABLE. YOU KNOW, DEANS HAVE AN ADVANTAGE BECAUSE THEY DON'T UNDERSTAND THE ADMINISTRATIVE STUFF. TO ME, THE MOST IMPORTANT THING IS TO UNDERSTAND SCIENCE AND, TO ME, THAT IS THE SINGLE MOST IMPORTANT THING. NIH IS A SCIENCE ORGANIZATION AND WE SUPPORT SCIENCE AND TRAINING OF SCIENCE AND THAT TO ME IS SINGLE MOST IMPORTANT THING. I TOLD MEMBERS OF THE SEARCH COMMITTEE, YOU KNOW, YOU NEED NOT ONLY LOOK AT GRAY-HAIRED EMINENCES AND I REMINDED THEM I WAS 47 WHEN I TOOK THE JOB THE FIRST TIME. FRANCIS WAS 43. WE THINK DR. FOUCHER WAS LIKE 12 OR -- >> AUDIENCE: [LAUGHING]. >> POINT IS, YOU CAN START THESE JOBS EARLIER IN YOUR CAREER IF IT IS THE RIGHT PERSON. YOU KNOW? IT DOESN'T PRECLUDE PEOPLE WHO ARE MORE SENIOR IN THEIR CAREER BUT IT IS JUST FINDING THE RIGHT PERSON AND SOMEBODY WHO THINKS BROADLY. HE WAS EXCITED ABOUT THE UNBELIEVABLE OPPORTUNITIES. YOU KNOW? OKAY. ANYTHING ELSE? YES, SIR. PLEASE. >> MAR CELLO A CHIEF SCIENCE OFFICER. IS IT ON? >> I THINK IT IS BECAUSE YOU ARE TALL. >> OKAY. I'M HERE SPEAKING ON SCIENTIFIC COUNCIL AFFAIRS WHO MET IN LAST TWO DAYS AND ASKED ME TO RELAY MESSAGE TO YOU ON BEHAD HALF OF PUBLIC HEALTH COMMUNITY AND WE DISCUSSED THIS TODAY. THE COUNCIL EXPRESSED THEIR CONCERN WITH THE CLOSE -- PUBLIC -- DENTAL PUBLIC HEALTH RESIDENT PROGRAM IN NIDCR THEY CONSIDER THIS A PRIMARY SOURCE OF DEVELOPMENT AND PUBLIC HEALTH IS A SPECIALTY THAT IS RECOGNIZED BY ADA AND MAIN CONCERN IS IMPACT THIS MAY HAVE ON WORKFORCE. MORE AND MORE WE SEE LESS PEOPLE COMING OUT OF SCHOOLS WITH DEGREES AND HEAR ABOUT FELLOWSHIP AND IDEAS AND STILL NEED TO FIND SOLUTION WITH PEOPLE WITH A DEGREE IN THE END AROUND HOPE IN SURGEON GENERAL REPORT WE FIND A WAY AND SURE THAT TSA WILL BE HAPPY TO WORK WITH NIDCR. THANK YOU FOR THIS. >> THANK YOU SO MUCH. IF YOU HAVE A WRITTEN STATEMENT, WE CAN PUT IT AS PART OF THE RECORD. >> OKAY. >> OKAY. ANY FINAL COMMENTS BEFORE WE MOVE ON TO THE NEXT PART? OKAY. MY THREAT OF THE KREB CYCLE IS NOW WITHDRAWN. >> AUDIENCE: [LAUGHING]. >> I WAS REALLY GOOD AT THAT. YOU KNOW WHAT IS REALLY AMAZING ABOUT THE KREB CYCLE NOW? NOW IT IS REALLY INTERESTING. IT IS UNBELIEVABLE. >> [INDISCERNIBLE]. >> RIGHT. IT IS LIKE WE REDISCOVERED. OKAY. I WILL STOP NOW. WHO IS DOING THIS NOW? ARE YOU DOING THIS NOW? >> I'M DOING THIS NOW. >> ALL RIGHT. YOU ARE ON. >> OKAY. NEXT ON THE AGENDA WE HAVE ONE CONCEPT CLEARANCE. AS YOU KNOW WE ARE REQUIRED TO DOCUMENT CLEARANCE OF CONCEPTS BY PRESENTING PURPOSE AND SCOPE OF OBJECTIVES IN PUBLIC FORUM AND GIVING THE OPPORTUNITY TO COMMENT AND PRESENTATION BY NIDCR STAFF AND DESIGNATED COUNCIL MEMBERS WILL LEAVE THE DISCUSSION AND THERE WILL BE A VOTE FOR APPROVAL OF CONCEPT AS BASIS FOR DEVELOPING FUTURE FUNDING OPPORTUNITY ANNOUNCEMENTS. TODAY WE HAVE DR. ELISE RICE WHO IS PROGRAM OFFICER IN BEHAVIORAL SOCIAL SCIENCES BRANCH AND [INDISCERNIBLE] WILL LEAD GOOD MORNING, EVERYONE. I'M PLEASED TO SHARE A CONCEPT CALLED CHARACTERIZING CAUSAL MECHANISMS TO PREVENT DENTAL FEAR AND ANXIETY AND CONCEPT DEVELOPED IN RECOGNITION OF ENDURING CHALLENGE OF FEAR AND ANXIETY RELATED TO DENTAL CARE CAUSING UNNECESSARY DISTRESS AND AVOIDANCE OF DENTAL CARE AND INDIVIDUALS OF ALL AGES. IN FACT, AS MANY AS 10 TO 20% OF PEOPLE ACROSS THE LIFESPAN ARE ESTIMATED TO HAVE CLINICALLY SIGNIFICANT DENTAL FEAR. PREVIOUS RESEARCH DOCUMENTED NOTABLE VARIABILITY IN FORM OF PEOPLE'S FEARS THAT MAY INVOLVE DIFFUSE FEARS ABOUT DENTAL CARE IN GENERAL OR MAY FOCUS ON SPECIFIC SENSATIONS LIKE PAIN OR GAGGING AND SPECIFIC PROCEDURES LIKE HAVING A CLEANING OR INJECTION OR ROOT CANAL OR EXPERIENCES LIKE FEELING PHYSICALLY RESTRAINED OR FEELING JUDGED BY SOMEONE'S ORAL HYGIENE AND DENTAL FEAR MAY BECOME ESPECIALLY PERNICIOUS IF INITIATES CYCLE OF AVOIDANCE WHICH IS THOUGHT TO BE EVOLVED BEHAVIORAL RESPONSES THAT ELICIT FEAR AND ANXIETY. PEOPLE WHO ARE SUFFICIENTLY AFRAID OF ANYTHING HAVING TO DO WITH A DENTAL VISIT MAY AVOID GOING TO A CLINIC. HOWEVER, THAT DELAY IN DENTAL CARE MAY ALLOW DETERIORATION OF INDIVIDUAL'S ORAL HEALTH RESULTING IN GREATER PAIN OR MORE SEVERE CONDITIONS AND MORE INTENSIVE ARE COSTLY TREATMENT WHEN THEY CAN NO LONGER AVOID CARE AND NEEDLESSLY PAINFUL OR COMPLEX EXPERIENCE MAY RE-ENFORCE THE IDEA THAT DENTAL CARE IS AN AVERSIVE OR EYE DEAL PERPETUATING INDIVIDUAL'S FEAR THROUGH CYCLE THE DENTAL FEAR MAY INCLUDE -- POOR ORAL HEALTH AND HYGIENE AND NEED FOR MORE INTENSIVE AND COSTLY DENTAL TREATMENT. MOST WIDESPREAD PRACTICES CURRENTLY IN PLACE TO MANAGE DENTAL FEAR INVOLVE SEDATIVES OR ANALYTICS AND MEDICATIONS ARE HELPFUL IN ALLEVIATING IMMEDIATE SYMPTOMS OF FEAR AND ANXIETY AND DON'T ADDRESS UNDERLYING PROCESSES THAT MAY OCCUR OVER TIME AND ENFORCE NOTION THAT RECEIVING DENTAL CARE IS SO UP SETTING INDIVIDUAL NEEDS MEDICATION JUST TO GET THROUGH THE EXPERIENCE. INTERDISCIPLINARY RESEARCH TEAMS ARE WORKING TO ADAPT COGNITIVE BEHAVIORAL THERAPIES -- EXTENSIVE TRACK RECORD OF TREATING OTHER FORMS OF FEAR AND ANXIETY. WIDESPREAD IMPLEMENTATION OF EFFECTIVE TREATMENTS MOST PERSISTENTLY AVOIDANT PATIENTS MIGHT MISZ OUT ON CARE THEY NEED AND PLANS FOR DELIVERING EVIDENCE-BASED TREATMENTS FOR DENTAL ANXIETY BUT TO -- WITH THE CURRENT CONCEPT WE PROPOSE TO SUPPORT MECHANISTIC RESEARCH TO EXPLAIN IDEOLOGY OF DENTAL FEAR AND ANXIETY. BEHAVIORAL AND SOCIAL SCIENCE COMMUNITY DEMONSTRATED RELATIVELY ORGANIC MOMENTUM TOWARDS -- MUCH THIS CONCEPT COULD CAPITALIZE ON RECENT ADVANCES OF CAPACITY IN TREATMENT AND ADJACENT AND UNDERDEVELOPED DOMAIN OF PREVENTION AND CONCEPT ALIGNS WITH RECENT ACTIVITIES WITH NIDCR PROGRAM STAFF INCLUDING WORKSHOP ON DENTAL FEAR AND ANXIETY HELD IN JANUARY 2019 IN ATTENDANCE AT THE WORKSHOP WAS IMMENSE NEED. THIS CONCEPT ALSO COMPLEMENTS OTHER NIDCR INITIATIVES SUCH AS RECENTLY RELEASED FUNDING OPPORTUNITY AND IMPROVING ORAL HEALTH AND REDUCING HEALTH DISPARITIES AND ADOLESCENCE AND CONCEPT -- 2030 VISIONING INITIATIVE ESPECIALLY INTEGRATION OF ORAL AND OVERALL ORAL HEALTH AND ADVANCING PRECISION ORAL HEALTH AND OVERCOMING ORAL HEALTH DISPARITIES AND CORE TOPICS RELATED TO DENTAL FEAR AND ANXIETY MAY LINK LARGER CONCEPT. INITIATIVE IS FOCUSED ON -- INDIVIDUALS WITH DOWN SYNDROME WITH UNIQUE SUSCEPTIBILITIES TO DENTAL FEAR AND INITIATIVE AIMS TO SPEED SCIENTIFIC SOLUTIONS TO OPIOID CRISIS AND NOVEL INSIGHTS ON HOW PEOPLE PERCEIVE AND RESPOND TO PAIN THAT MAY BE RELEVANT TO PREVENTION OF DENTAL FEAR AND PROPOSED CONCEPT ENCOMPASSES BEHAVIORAL AND -- RELEVANT TO THE DEVELOPMENT OR PREVENTION OF DENTAL FEAR AND ANXIETY ACROSS THE LIFESPAN AND SPECIFIC TOPICS AND AREAS OF INTEREST INCLUDE FOR EXAMPLE PROCESSES ABOUT I WHICH AVERSIVE EXPERIENCES AND INDIVIDUAL TRAITS UNT ACT TO GENERATE OR PERPETUATE DENTAL FEAR OR ANXIETY AND ADDRESSING QUESTION OF WHY PATIENTS GET DENTAL FEAR AFTER CERTAIN EXPERIENCES AND OTHERS DON'T AND STRATEGY DENTAL CARE PROVIDERS MAY EXPERIENCE TO PATIENTS OF PAINFUL EXPERIENCES TO PREVENT DEVELOPMENT OF REOCCURRING FEAR OR ANXIETY AND SOCIAL INFLUENCES VARIOUS SOURCES PARENTS PEERS OR SOCIETY MAY GENERATE DENTAL FEAR OR ANXIETY AND DIRECT AVERSIVE EXPERIENCES AND CREATING POSITIVE OR MREZANT SXEERENCES IN DENIAL FACILITIES ON ANY SUBSEQUENT NEGATIVE EXPERIENCES THAT MIGHT OTHERWISE MOTIVATE AVOIDANCE. WITH THAT I THANK YOU FOR YOUR CONSIDERATION AND WILL TURN TO COUNCIL MEMBERS THAT REVIEWED THIS CONCEPT BEGINNING WITH DR. MCNEIL. >> THANKS, DR. RICE. IN PREPARATION FOR THE MEETING THERE WAS A HELPFUL CONFERENCE CALL WITH DR. STROM AND GARCIA AND DR. RICE AND DR. RIDDLE AND MY COMMENTS ARE BASED ON THOSE DISCUSSIONS BUT ANY ERRORS OR OMISSIONS ARE MY OWN. I'M VERY SUPPORTIVE OF THE CONCEPT AND BELIEVE IT IS TIMELY AND CRUCIAL IN TERMS OF MOVING THE FIELD FORWARD. DENTAL ANXIETY, DENTAL FEAR, AND DENTAL PHOBIA ARE SEPARATE BUT RELATED CONSTRUCTS IN CLINICAL CONDITIONS NEGATIVELY IMPACTING A SIGNIFICANT PROPORTION OF THE POPULATION OF OUR COUNTRY AND IN THE WORLD. DENTAL FEAR AND ANXIETY ARE DIMENSIONAL AND NOT CATEGORICALLY AND EXIST ALONG THE CONTINUUM AND ANXIETY DISORDERS IN ICD IN DIAGNOSTIC AND STATISTICAL MANUAL DISORDERS. OTHERS IN THE FIELD TERMED THIS SET OF PROBLEMS DENTAL CARE RELATED ANXIETY FEAR AND PHOBIA REFERRING TO THEM IN COMBINATION BECAUSE CURRENT MEASUREMENT STRATEGIES DON'T DIFFERENTIATE WELL AMONG THEM AND THIS CONCEPT COULD HELP MOVE THAT FORWARD. IMPORTANTLY, THE CONCEPT DOES FOCUS ON MECHANISMS INVOLVED IN DEVELOPMENT AND PERPETUATION AND EXACERBATION OF THE STATES. THERE IS GOOD EVIDENCE THERE ARE TRAJECTORIES YOU NEED OF DEVELOPMENT OF CONTINUATION OF DENTAL FEAR AND ANXIETY OVER THE LIFESPAN AND REVEALING DIFFERENT MECHANISMS MAY OPERATE IN VARIOUS POINTS IN LIFE AND IDEOLOGICAL ROUTES AND SOMETIMES DNTAL ANXIETY EMERGES IN CHILDHOOD AND APPEARS EVEN LATER IN LIFE AND ADULTHOOD AND IN OLDER ADULTS AND THEY ARE NOT CONCERNED WITH ROOT CANAL THERAPY OR PERIO THERAPY BUT OLDER ADULTS ARE FEAR 68 ABOUT THOSE SORTS OF PROCEDURES. SOMETIMES NOT A MAJORITY OF TIME DENTAL CARE RELATED TO ANXIETY AND FEAR ARE RELATED TO HISTORY OF TRAUMA MAY OR MAY NOT BE RELATED TO PRIOR DENTAL CARE. SEXUAL HARASSMENT IN EARLIER MEETING CAN CONTRIBUTE TO POWERLESSNESS AND SITUATION IN DENTAL SITUATION AND IMPACT NOT ONLY ON ORAL QUALITY OF LIFE BUT QUALITY OF LIFE GENERALLY AND STATES IMPAIRED UTILIZATION AND DISALLOWS OPPORTUNITY FOR PATIENTS TO GET NEEDED TIMELY CARE AND WORK WITH DENNISTS AND HYGIENISTS NOT ONLY ON HEALTH OF ORAL CAVITY BUT SYSTEMIC HEALTH AS WELL AND WORK WITH NUMEROUS PATIENTS TOO FEARFUL TO CROSS THRESHOLD OF DENTAL OFFICE OR CLINIC AND DENTAL NEGLECT EXPERIENCE IMPACTED THEIR LIVES GENERALLY INCLUDING RAMPANT ORAL DISEASE AND FAILURE TO ADVANCE PROFESSIONALLY IN JOB -- AS NOTED IN CONCEPT CLEARANCE WORKING WITH HIGHLY FEARFUL ANXIOUS PATIENTS IS STRESSFUL TO PRACTITIONERS TOO AND HAS IMPLICATIONS FOR DENTAL WORKFORCE AND ADDITION TO ENTHUSIASM FOR CONCEPTS I HAVE A FEW SUGGESTIONS. FIRST, TITLE SPEAKS SPECIFICALLY TO PREVENTION AND ADD WORD EMILIORATION OR INTERVENTION TO THE TITLE AND MAY BE MISPERCEIVED ONLY AS PRIMARY PREVENTION AND OF COURSE THERE IS SECONDARY AND TERTIARY PREVENTION WHICH COULD BE INCLUDED BUT MIGHT NOT BE AS SALIENT AS INCLUDING INTERVENTION. CONCEPT SECONDLY CONCEPT SPEAKS TO DENTAL FEAR AND ANXIETY AND RECOMMEND THAT DENTAL PHOBIA COULD BE INCLUDED IN TERMINOLOGY AND DESCRIPTION AS SPECIFIC CRITERIA FOR PHOBIA. THIRDLY, ROLE OF INDIVIDUAL DIFFERENCES ARE QUITE IMPORTANT AND RECOMMEND THEY BE MORE FULLY INCLUDED IN THE CONCEPT. INDIVIDUALS WITH HIGH LEVELS OF DENTAL FEAR AND ANXIETY ARE NOT A HIGH HOMOGENEOUS GROUPS SOMETIMES RELATED TO ISSUES IN CHILDHOOD OR THOSE WHO FAINT AND BLOOD ILLNESS PHOBIA AND SOMETIMES PEOPLE HAVE SPECIFIC FEARS OF PAIN AND THERE ALSO IS CLOSTER PHOBIA AND PANIC THAT IS APART OF THIS SCENARIO IN SOME PATIENTS AND FINALLY A MATTER OF CONSCIOUS ETHICS AND TRANSPARENCY SHARING THIS AREA OF DENTAL FEAR AND ANXIETY ONE IS A PRIMARY RESEARCH AREA FOR ME AND HAS BEEN EVER SINCE WAS NRD RESEARCH FELLOW MANY YEARS AGO. TRAINING IMPACT IS SOMETIMES DECADES LONG AND I SIT HERE TODAY AND DONE MY BEST TO TEMPER ENTHUSIASM AND ADVOCACY FOR CONCEPT WITH KEENEST AND SCIENTIFIC EYE THAT I CAN MUSTER. >> I WILL FOLLOW UP ON DAN'S COMMENT I HAVE NO BACKGROUND OR PROFESSIONAL INTEREST IN THIS AREA OF UNKNOWN KNOWLEDGE AND COMMENTS COME FROM MY EXPERIENCE AS CLINICIAN AND PERIO DONE TIFT DEALING WITH ADULTS AND WITH CHILDREN IN HOSPITAL IN BOSTON FOR TEN YEARS I RECOMMEND APPROVAL OF CONCEPT AND DR. O'NEIL'S COMMENTS AND PERHAPS WHAT HE NOTED WHAT ARE WE TALKING ABOUT? DEFINITION PERIO DONE TAL RESEARCHER RESEARCH IS NOT WELL-DEFINED IT IS NOT MEASURABLE. IF NOT MEASURABLE IT IS REALLY HARD TO DO SCIENTIFIC WORK ON IT AND MAKE SCIENTIFIC PROGRESS ON PREVENTION, ET CETERA. I DEMAND ATTENTION BE GIVEN TO CLOSE DEFINITION OF EXACTLY WHAT IT IS TO BE STUDIED GIVEN IT DOESN'T APPEAR TO BE A GOLD STANDARD MEASURE OF QUOTE DENTAL FEAR AND ANXIETY THERE HAS TO BE I THINK FOR SOME BASIC STANDARDS WHAT BOTH CLINICIANS AND INVESTIGATORS COULD ACCEPT AND MEASURES SUITABLE FOR CLINICAL SETTINGS DIAGNOSES MADE AND POPULATION ASSESSMENTS DEFINITELY FOR CLINICAL TRIALS CLEAR DEFINITIONS TO DEFINITIONS IS PORN AND OTHER ASPECT I HAVE CONCERNS ABOUT IS RETAIN A DENTIST OR DENTAL FOCUS ON THE CONCEPT, AGAIN, SPEAKING ONLY FROM MY CLINICAL EXPERIENCES IN THE CHILDREN'S SETTING WASN'T THE FEAR CHILDREN HAD BASED ON PRIOR DENTAL EXPERIENCES BUT CHILDREN WHO LIVED CHALLENGING LIVES MEDICALLY WITH FEARS OF MEDICAL PREVENTIONS OF BLOOD AND OTHER PROCEDURES AND DENTISTS PERHAPS COULD MAKE MAJOR IMPACT OF PREVENTION OF ANXIETY BY TARGETING DENTAL EXPERIENCES OF CHILDREN AND MAY WORK WITH SIGNIFICANT PORTION OF THOSE THAT WORK WITH ADULTS AND FOCUS ON DENNISS PREVENTION MAY BE SHORT-SIGHTED. OTHER ASPECT TO WHICH DENTAL FEAR AND ANXIETY IS COMORBID WITH PSYCHOLOGICAL AND PHOBIC DIAGNOSIES AND APPROACHED TARGETING DENTAL FEAR AND ANXIETY DOESN'T TAKE INTO CONSIDERATION OTHER POTENTIAL COMORBID ANXIETY THAT OTHER ADULTS MAY NOT HAVE AS GREAT SUCCESS AND ADVERSE CHILD EXPERIENCES THAT ARE NOT DENTAL RELATED COULD BE PRECURSOR FOR ADULT PHOBIC ANXIETY DISORDERS AND EXTENT ANY TRAUMA AND INFORMED CARE IN ABUSE OF MANAGEMENT WITH ADULTS AND FEAR AND ANXIETY AND OTHER INTERVENTIONS KNOWN TO BE EFFECTIVE IN TREATING ADULTS WITH MEDICAL RELATED FEAR OF ANXIETY TESTED INITIALLY INITIAL STEP IN TARGETING DENTAL FEAR AND ANXIETY SPECIFICALLY. THOSE ARE MY COMMENTS. >> MY EXPERIENCE COMES FROM 40 YEARS OF CLINICAL PRACTICE. YOU SEE WHY WE CHOSE DAN TO GO FIRST. EVEN THOUGH YOU FEEL YOU HAVE A CONFLICT OF INTEREST OF SOME SORT, YOUR UNDERSTANDING OF THE SCIENCE BEHIND IT AND RESEARCH IS TREMENDOUS. GOOD THING ABOUT GOING TO LAB IS I WON'T TAKE TOO MUCH OF YOUR TIME. THEY COVERED ALL WE DISCUSSED ON THE PHONE CALL. BY THE WAY, THE PHONE CALLS ARE EXTREMELY HELPFUL FOR ALL OF US. WE WERE ABLE TO GET THROUGH A BIT OF INFORMATION. WE WERE ON FOR ABOUT AN HOUR AND VERY HELPFUL FOR EVERYBODY I THINK THAT WAS INVOLVED AND I WANT TO UNDERSCORE THE POINT THAT FEAR AND ANXIETY, THEY ARE DEFINITELY TWO DIFFERENT ISSUES THERE THAT ARE RELATED AND CAME UP WITH SOMETHING I DIDN'T THINK ABOUT DR. O'NEIL THOUGHT ABOUT HOW DO YOU MEASURE THE DIFFERENCE THERE BETWEEN FEAR AND ANXIETY THAT GOES TO COMMENT IF YOU DO RESEARCH AND FIND OUT HOW WE CAN DEAL WITH THESE ISSUES. WE REALLY WOULD BE GREAT TO HAVE A WAY TO CIPHER OR LOOK BETWEEN THE TWO OF THOSE. SOME PEOPLE IN THE CLINICAL SETTING, YOU DEFINITELY HANDLE FEAR AND ANXIETY IN DIFFERENT MANNERS MOST OF THE TIME. WE ACTUALLY THOUGHT ABOUT ONE ASPECT OF THIS AREA WE MAY WANT TO LOOK INTO IS CAN WE DEVELOP A TEST THAT CAN HELP US UNDERSTAND THAT BETTER WHEN THE PATIENT COMES IN. ARE THEY -- IS IT A MATTER OF FEAR OR ANXIETY AND EXPERIENCE IN DENTAL SCHOOL ALL BE IT MANY YEARS AGO NO TRAINING ON THAT OTHER THAN USING WORDS THAT DIDN'T SEEM TO BE SO STRESSFUL TO THE PATIENT WHICH IS FINE AND GOOD. EVERY PATIENT KNOWS A NEEDLE IS A NEEDLE. YOU CAN CALL IT A POINT OR SOMETHING LIKE THAT. IT DOESN'T CHANGE AT THE END OF THE DAY. ANSIO LYTICS I FOUND SOME PEOPLE MISINTERPRET OR USE DIFFERENTLY I USE IT BEFORE AS A PATHWAY TO DESENSITIZE PATIENTS TO REDUCE THEIR FEAR. I DON'T -- I HAVEN'T USED THEM ALL THE TIME ON EVERY PATIENT. I HAVE USED THEM SELECTIVELY WHERE IT IS A STEP THERAPY, SO-TO-SPEAK. I THINK THERE IS ONE AREA OF RESEARCH YOU MAY WANT TO CONSIDER IS THAT, HOW CAN THAT BE USED EFFECTIVELY. MANY PATIENTS ARE. THEY CAN'T SIT IN THE CHAIR. HOW DO WE GET THEM THE FIRST TIME TO CONVINCE THEM THEY CAN GO THROUGH THE TREATMENT AND COME OUT THE OTHER SIDE AND STILL LIVING AND BREATHING AND NOT AS SCARED THE NEXT TIME. ALSO, I THINK, YOU KNOW, BASICALLY, THE ISSUE OF BEING A DENTIST, IT IS STRESSFUL AS IT IS. I CAN ATTEST TO AFTER 40 YEARS. IF YOU TAKE IN YOUR PATIENT'S FEAR AND ANXIETY AND REALLY WORK AT UNDERSTANDING IT AS IT IMPACTS YOU, WE HAVE TO MAKE SURE WE TURN THIS AROUND MAYBE IN ANOTHER CONCEPT CLEARANCE AND NEED TO UNDERSTAND WHAT HAPPENS TO THE DENTIST DAY IN AND DAY OUT AS A PERSONAL ASIDE. I HAVE IN MY OFFICE TYLENOL TABLETLES WHEN I HAVE A DAY I KNOW I WILL HAVE PATIENTS THAT ARE EXTREMELY STRESSED I ACTUALLY PRE-MED INDICATE AND TAKE A LITTLE BLOOD PRESSURE PILL. AT END OF THE DAY I PERSONALLY AM ABSOLUTELY WASTED EMOTIONALLY AND OTHERWISE AND KNOW MY BLOOD PRESSURE AND HEART RATE HAS GONE UP. I THINK THAT IS A VERY IMPORTANT PART OF BEING ABLE TO TREAT PATIENTS WE HAVE TO HAVE CLINICIANS THAT WILL ACTUALLY TREAT THE PATIENTS. MY COMMENTS AND A VERY HELPFUL PHONE CALL AND THANK YOU TO THE OTHER TWO DOCS ON THE PHONE CALL. >> OTHER COMMENTS OR QUESTIONS? >> JUST A QUESTION. >> CERTAINLY. >> IS THERE DEFINED DENTAL PHOBIA OR IS IT PEOPLE WHO HAVE FEARS OF EVERYTHING? DO THEY OVERLAP? BECAUSE IF IT IS JUST DENTAL, I THINK THERE ARE A NUMBER OF THINGS IN TERMS OF THE OFFICE AND HOW YOU TREAT THEM AND TOYS YOU GIVE THEM. BUT IF SOMEBODY IS AFRAID OF DRIVING A CAR OR GOING TO THE PHYSICIAN, THAT IS A WHOLE DIFFERENT BALL GAME. IS MOST OF THIS DENTAL PHOBIA ISOLATED? >> I WILL LET DR. MCKNEEL RESPOND TO THIS TOO. MY QUICK ANSWER IS I THINK IT IS BOTH. I THINK IT IS ALL OF THE ABOVE. DR. MCNEAL, WOULD YOU LIKE TO SAY MORE? >> THERE IS A MINORITY OF PATIENTS WHO HAVE GENERAL FEARS. FEARS ABOUT PANIC AND AGORO PHOBIA TYPE OF FEARS. THAT IS -- IT SPEAKS TO IDIOGRAPHIC NATURE OF IT BUT MORE INDIVIDUALS WHO HAVE THE AUTOISLATED KIND OF A DENTAL FEAR. QUESTION I ASK DENTAL STUDENTS WHEN LECTURE TO THEM WHAT IS THE SIMILARITY BETWEEN GETTING YOUR HAIRCUT, GOING IN FOR DENTAL CARE AND BRINGING YOUR CAR THROUGH A SELF-SERVE CAR WASH? ANSWER TO THAT IS THOSE ARE SITUATIONS PHOBIC TO PEOPLE WITH AGORO PHOBIA AND THEY CAN'T GET OUT OF A SITUATION EASILY. THAT IS JUST ONE TIME AND THERE ARE AS I SAID OTHERS WHO ARE, YOU KNOW, EVEN MORE WHO HAVE MORE ISOLATED FEARS. >> I WOULD JUST ADD THAT WE -- THE POINTS ABOUT INDIVIDUAL VARIABILITY ARE WELL-TAKEN AND ALL THIS FEEDBACK IS WELL-TAKEN AND DEEPLY APPRECIATED. WHEN YOU SPEAK ABOUT SHORTHAND AND FEAR AND ANXIETY THAT IS THE REFERENCE TO UNDERLYING EFFECTIVE EXPERIENCES THAT ARE COMMON TO PHOBIA OR SUBCLINICAL LEVELS AND THAT IS A SHORT-TERM -- A SHORTHAND TERMINOLOGY USING FOR PREVIOUSES OF BRIEF PRESENTATION. WE SPOKE AT LENGTH IN WORKSHOP HELD IN 2019 ON CONSIDERATIONS ABOUT MEASUREMENT LIMITATIONS AND OPPORTUNITIES TO EXPAND MEASUREMENT AND CONCEPTUALIZATION. THAT WILL BE AN IMPORTANT ELEMENT OF THIS CONCEPT. >> OKAY. I THINK WE NEED TO MOVE ON. SO WE WILL TAKE A VOTE ON APPROVAL OF THIS CONCEPT. WOULD SOMEONE LIKE TO MAKE A MOTION TO RECOMMEND APPROVAL? >> SO MOVED. >> ALL IN FAVOR? ANY OPPOSED? OKAY. THANK YOU. SO WE ARE BEHIND ON THE SCHEDULE. I NEED TO ASK DR. DR. SUSAN GREGURICK IF SHE PREFERS TO DO HER TALK NEXT OR TAKE A SHORT BREAK. I DON'T KNOW WHAT YOUR SCHEDULE IS. YOU ARE FINE? SHORT BREAK, FIVE MINUTES. SORRY ABOUT THAT. WE WILL GET RIGHT BACK TO IT. NEXT ON THE AGENDA WE HAVE A SPECIAL SESSION ON DATA SCIENCE AND WE ARE RUNNING BEHIND SO I ENCOURAGE SPEAKERS TO STAY WITHIN THE ALLOTTED TIME. FIRST SPEAKER IS DR. SUSAN GREGURICK WHO WAS APPOINTED AS ASSOCIATED DIRECTOR FOR DATA SCIENCE AND DIRECTOR OF OFFICE OF DATA SCIENCE STRATEGY AT NIH RECENTLY AND WAS DIVISION DIRECTOR FOR COMPUTATIONAL BIOSCIENCES AT INSTITUTE OF GENERAL MEDICAL SCIENCES AND PRIOR TO JOINING NIH IN 2013 SHE LED DATA SCIENCE AND DOE KNOWLEDGE BASE IN OFFICE OF BIOLOGICAL ENVIRONMENTAL RESEARCH IN DEPARTMENT OF ENERGY AND BEFORE BEGINNING CAREER IN GOVERNMENTAL SERVICE SHE WAS AT UNIVERSITY OF MARYLAND AND AREAS EVER SXEERT TEES ARE COMPUTATIONAL BIOLOGY AND HIGH PERFORMANCE COMPUTING NEUR ON SCATTERING AND BIOINFORMATICS. >> THANKS SO MUCH. PLEASURE TO BE HERE TODAY AND TALK TO ADVISORY COUNCIL OF NATIONAL INSTITUTE OF CINNIO FACIAL AND DENTAL RESEARCH COMMUNITY ABOUT THE WORK YOU ARE DOING AND CHALLENGES YOU FACE IN DATA SCIENCE AND I WILL SWITCH TO TELL YOU WHAT IF WE COULD SOLVE THE CHALLENGES WHAT WOULD THE WORK LOOK LIKE FOR RESEARCHERS AND THIRD PART HOW WILL WE GET THERE AND WHAT ARE THINGS DOING RIGHT NOW TO DATA SCIENCE TO IMPLEMENT SOLUTIONS TO SOLVE THE PROBLEMS AND GIVING SPECIAL THANKS TO COLLEAGUES AND NIDCR AND RESEARCHERS WHO HELPED ME FRAME QUESTIONS ABOUT WHAT IS CHALLENGES YOU FACE IN RELATION TO DATA SCIENCE. I HAVE BEEN IN THE DATA YOU SCIENCE BUSINESS A LONG TIME AND COULD BUILD YOU FANCY SOLUTIONS I MAY NEVER NEED OR WANT OR USE. FOR ME IT IS IMPORTANT TO UNDERSTAND WHAT ARE RESEARCH CHALLENGES YOU FACE SO I CAN ACTUALLY SOLVE THOSE PROBLEMS I APPRECIATE THE NICE BOOKLET YOU HAVE ON NEW INVESTIGATORS RESEARCH PROJECTS. I WAS READING THROUGH IT AND FOUND IT COMPLETELY FASCINATING. YOU ARE DOING A LOT OF BREADTH OF WORK IS AMAZING EVERYTHING FROM LOOKING AT GENOMICS TO TRANSCRIPTICS AND METHYLATION IN CELLS TO MODEL ORGANISMS MOSTLY MICE TO ALL KINDS OF MODELING OF BONE KINETICS AND BIOPHYSICS. IT IS A REALLY MULTIFACETED COMMUNITY. WHAT I HAVE HEARD FROM RESEARCHERS HERE IN DENTAL AND ORAL AND CRANIOFACIAL RESEARCH IS THERE ARE A FEW REALLY GRAND CHALLENGING PROBLEMS. SOME OF THE PROBLEMS ARE UNIQUE TO YOUR RESEARCHERS. FOR EXAMPLE LOTS OF WORK YOU ARE DOING RELIES ON IMAGES AND OF DENTAL AND FASHIO PATIENTS AND MODEL ORGANISMS HERE PATIENTS COULD BE IDENTIFIABLE AS IDENTIFIABLE AS A PERSON'S FINGERPRINTS YOUR PRIVACY FOR PRESERVING SCIENCE IS REALLY CRITICAL AND PROBABLY ONE OF THE UNIQUE FACETS OF YOUR ORGANIZATION. THOSE ARE REALLY HARD PROBLEMS TO SOLVE. ALSO, RESEARCHERS AND DENTAL AND ORAL AND CRANIOFACIAL RESEARCH WANT TO HAVE DATA SETS FROM WIDE VARIETY OF SOURCES INCLUDING BUT NOT LIMITED TO ELECTRONIC HEALTH CARE RECORDS AS FAR AS I KNOW THOSE TWO SYSTEMS DON'T TALK TO EACH OTHER AT ALL. IF THEY DID, YOU WOULD HAVE A RICH AMOUNT OF DATA AND PHENOTYPIC INFORMATION FOR WHICH PERHAPS WE COULD ALSO INTEGRATE OTHER TYPES OF BASIC AND CLINICAL RESEARCH DATA. I WILL TELL YOU WHAT WE ARE DOING IN THAT AREA. FINALLY, YOU WANT TO WORK WITH DATA SETS IN HUMANS AND YOU DO LOTS OF WORK IN MICE AND INTEGRATING RESEARCH ORGANISMS IN WITH HUMAN DATA SETS IS FASCINATING AND WOULD PROVIDE A RICH SET OF DATA FOR YOU BUT HARD TO FINED THE DATA AND HARDER TO INTEGRATE THEM. THESE ARE SOME OF THE PROBLEMS THAT I HAVE HEARD THAT ARE REALLY OF CRITICAL NEED FOR DENTAL ORAL AND CRANIOFACIAL RESEARCH AND THERE ARE OTHER PROBLEMS THAT I WILL TELL YOU A LITTLE ABOUT MACHINE LEARNING IN PARTICULAR FOR NIDCR. AS YOU KNOW AND HAVE HEARD FROM DR. TABAK SHE HAS GREAT POTENTIAL TO HELP A WIDE VARIETY OF PROBLEMS INCLUDING IDENTIFYING FEATURES AND IMAGES, PARTICULARLY DENTAL IMAGES. THE STORY IS THOSE WITH THE LARGEST DATA SETS WIN. THAT IS VERY TRUE. MACHINE LEARNING AND ARTIFICIAL INTELLIGENCE IS A REALLY LARGE ANALYTICS FOR DATA BUT HARD TO GET ALL OF THE DATA IN ONE PLACE. PARTICULARLY IF YOU HAVE TO MOVE DATA SETS TO THE CLOUD WHICH IS WHERE MACHINE LEARNING IS REALLY MOST POWERFUL IF WORKING IN A CLOUD ENVIRONMENT MOVING DATA TO THE CLOUD IS TIME CONSUMING AND CAN BE EXPENSIVE AND TRAINING FOR STAFF AND MACHINE LEARNING AND ARTIFICIAL INTELLIGENCE YOU HAVE HEARD IS CRITICAL AND A NEED WE HAVE TO ADDRESS RIGHT AWAY WE DON'T HAVE ENOUGH PEOPLE SAVVY IN BOTH DENTAL AND CINNIO RESEARCH ESPECIALLY IN MACHINE LEARNING. ADVANCED ALGORITHMS RUN ON SPECIALIZED MACHINE HARDWARE HAVING ACCESS TO THE HARDWARE SKRANSS YOUR WORK A BIT BUT TAKES A LOT TO GET ON TO THE MACHINES AND SYSTEMS AND THOSE ARE THINGS TO ADDRESS. FINALLY, MY LAST USER STORY I'M SURE YOU FOUND ABOUT FAIR DATA FINDABLE ACCESSIBLE INTEROPERABLE AND REUSABLE IF I TOLD YOU THAT, LET'S MAKE YOUR DATA FAIR IT IS PROBABLY REASONABLE WHAT YOU WILL SAY IS AND HOW WILL I DO THAT AND WHERE WILL IT GO? UNDERSTANDING HOW TO PRIORITIZE AND ANNOTATE AND CURATE DATA SETS YOU WANT TO SHARE AND SELECTING APPROPRIATE METADATAIZY AND FASCINATING FOR YOU APPROPRIATE RESEARCHERS THAT WILL REUSE YOUR DATA AND PUTTING THEM IN PLACES OTHER RESEARCHERS WILL FINED AND ACCESS THEM IS CRITICAL GIVE YOU MANDATE TO MAKE YOUR DATA FAIR I DON'T PROVIDE SOLUTIONS SO IT WON'T GO ANYWHERE. FEW USER STORIES COLLECTED FROM NIDCR AND THANK COLLEAGUES THAT HELPED ME A BIT IN UNDERSTANDING WHAT YOUR CRITICAL NEEDS ARE AS RESEARCHERS WHAT WOULD IT LOOK LIKE IF WE SAW SOME OF THE PROBLEMS AND WHAT WOULD RESEARCH LOOK LIKE IMAGINE YIN IF WE WERE ABLE TO LINK DATA ABOUT HEART CONDITIONS AND WITH A STUDY AND WITH DATA ABOUT AGING AND ALZHEIMER'S IN ORDER TO MAKE ASSOCIATIONS AND UNDERSTANDINGS OF CARDIOVASCULAR HEALTH OF AGING AND DEMENTIA AND HOW THEY RELATE TO DENTAL ISSUES COULD BE CRITICAL. THIS IS A STORY FROM MY OWN RESEARCH EXPERIENCE. YOU HEARD I WAS A MOLECULAR BIO PHYSICIST AND WORK WE DID WAS IN STRUCTURES OF VERY LARGE PROTEIN COMPLEXES AND STRUCTURE OF RODOPSON AND NEW TECHNOLOGY THAT GETS YOU FINALLY RESOLVED IN LARGE MACROMOLECULE STRUCTURES INTOIS TO SEE THE STRUCTURE AND FUNCTION TO INTD PLAY IN TERMS WHAT PROTEINS ACTUALLY DO AS YOU PROBABLY KNOW LOTS OF DIFFERENT EXPERIMENTAL TECHNIQUES TO UNDERSTAND HOW STRUCTURE IS DYNAMIC IN LIPID INTERFACE OR IN ITS ENVIRONMENT AND ABSORPTION SPECTRA I'M FOND OF IR AND NEUTRON SCATTERING INFORMATION AND HERE IT IS TAKEN FROM A PARTICULAR PAPER. IF I UNDERLIE THIS PARTICULAR SPECTRA WITH A STRUCTURE, I WILL UNDERSTAND HOW ALPHA HELISEIZE ARE CHANGING THAT PROTEIN. MOREOVER IF I LOOK AT ENERGETICS OF BINDING LIGANDS AND MUTATE PROTEIN PACKETS AND LOOK AT KINETICS AND BINDING ENERGETICS I WILL GET COMPREHENSIVE PICTURE WHAT PROTEIN IS DOING AND LIPID INTERACTING WITH DR. CHROMA FORS AND MOST OF THE DATA I'M SHOWING IS IN PAPERS YOU CAN'T ACCESS IT NO WAY TO FIND IT PULL INTO LAB AND USE IT. IT IS CONSIDERED DARK DATA. IF YOU ARE LUCKY YOU CAN WRITE TO THE PI AND MAYBE THEY WILL SEND YOU A COPY COULD BE LOCKED AWAY GRADUATE CENTER AND POST DOC DOCTORS RESEARCH LAB AND COMPUTER AND YOU MAY NEVER SEE THE DATA. IF WE CAN SOLVE THIS PROBLEM WE WILL GO A LONG WAY TO MAKING DATA FINDABLE ACCESSIBLE AND REUSABLE. INTEROPERABLE WILL BE HARDER I WILL TALK ABOUT IT IN A MINUTE. LASTLY, IMAGININ ABLE TO TAKE ELECTRONIC HEALTH CARE RECORDS AND NEED TO AUGMENT IMAGE OF DENTAL HEALTH CARE RECORDS AS WELL AND ABLE TO INTEGRATE KREB CYCLE OR OTHER METABOLIC PATHWAYS LOOKING AT METHYLATION SITES AND HOW GENES ARE EXPRESSIVE AND ABLE TO INTEGRATE STATE OF YOU AS YOU ARE RIGHT NOW FROM BIOPHYSICS COMPONENT WITH PHENOTYPIC ELECTRONIC HEALTH CARE AND DENTAL RECORDS AS WELL AS YOU AND YOUR ENVIRONMENT AND HOW YOU ARE LIVING AND BEHAVIORIAL AND BIOPHYSICS AND WHERE YOU ARE. I'M GOING TO HAVE A MUCH BETTER AND RICHER SET OF DATA THAT WOULD LINK ELECTRONIC HEALTH CARE RECORDS WITH PERSONAL AND CLINICAL RESEARCH DATA AND TELL YOU A LITTLE WHAT WE ARE DOING IN THIS FACET AS WELL. THESE ARE THREE END STORIES WE WANT TO GET TO. PROBLEMS AND THIS IS WHERE WE WANT TO GO AND NOW TELL YOU HOW WE WILL DO IT AND IT IS FRAMED AROUND STRATEGIC PLAN FOR DATA SCIENCE. THIS IS IT AS A FIGURE. I WILL WALK YOU THROUGH IT IN WAYS THAT TELL YOU ABOUT THE SOLUTIONS. JUST AS AN OVERVIEW, I WILL TELL YOU ABOUT DATA INFRASTRUCTURE WHICH WILL MOSTLY BE ABOUT CLOUD COMPUTING AND TELL YOU ABOUT DATA ECOSYSTEM AND ABOUT HOW WE ARE DOING DIFFERENT SOLUTIONS FOR FAIR DATA AND TELL YOU ABOUT DATA INTEROPERABLE AND MOSTLY FRAMED AROUND ELECTRONIC CARE INTEROPERABILITY AND TELL YOU ABOUT WORK WE HAVE DONE AND HYLIEKT A PARTICULAR STUDENT HERE LAST SUMMER AND LASTLY I WILL TELL YOU ABOUT POLICIES. YOU HEARD OF. THIS I TOLD YOU. JUST FOR REFERENCE HERE. MAKING SURE WE CAN FIND DATA THAT HAS UNIQUE IDENTIFIERS THAT IS ACCESSIBLE AND EITHER SECURELY THROUGH AUTHENTICATION AUTHORIZATION PROCEDURES AND OPEN DATA INTEROPERABLE IS SAME THING AND METADATA AND REUSABLE DATA. SO WE HAVE BEEN COMMITTED TO MAKING DATA FAIR FOR A VERY LONG TIME AND HAD A NUMBER OF POLICIES INCLUDING NIH DATA SHARING POLICY FOR LARGE AWARDS OVER $500,000 AND EXPECTING DATA TO BE SHARED IN THOSE AWARDS ARE NIH PUBLIC ACCESS POLICY FOR PUBLICATIONS AND GENOMICWIDE STUDIES AND IN 2015 WHICH SOME MAY BE INTERACTING WITH. OUR POLICY OF DISSEMINATION FUNDED NIH CLINICAL TRIALS AND INFORMATION AND ALL WELL-ESTABLISHED POLICIES THAT WE ARE NOW LOOKING AT A DATA POLICY FOR DATA MANAGEMENT AND SHARING. I'M SHOWING BRIEF TRAJECTORY OF POLICY SOLITIED COMMUNITY OUTPUT A YEAR AGO AND DEVELOPED POLICY AND RELEASED FOR DRAFT INPUT INPUT CLOSED JANUARY 10TH AND FINAL POLICY RELEASE SPRING OR SUMMER AND BASIC GIST OF THIS IS ALL RESEARCHERS IF R01 RESEARCHER OR R35 RESEARCHER OR SBR RESEARCHER OR INTERRA MURAL RESEARCHER A PLAN FOR HOW YOU WILL MANAGE pOF THE DATA YOU ANTICIPATE TO BE SHARED AND HOW YOU WILL SHARE IT. AGAIN, THE PLAN SHOULD EXPLAIN HOW SCIENTIFIC DATA GENERATED WILL BE MANAGED AND SHARED. THAT IS A HUGE ASK. NOW I NEED TO PROVIDE YOU WITH IDEAS OF SOLUTIONS TO THIS. THIS IS AN OVERVIEW OF EVERYTHING I WILL TALK ABOUT IN NEXT 5 TO 10 MINUTES. FIRST, WE STRONGLY ENCOURAGE RESEARCHERS TO USE OPEN ACCESS DATA SHARING REPOSITORIES FROM YOUR COMMUNITY. FOR EXAMPLE, FACE-BASED IS A COMMUNITY YOU CAN USE TO SHARE YOUR DATA AND SOMETHING AFFORDED BY THIS INSTITUTION. IT IS A PERFECT EXAMPLE OF A SHARING REPOSITORY BUT NOT EVERY DATA LIKE FOR EXAMPLE DARK DATA IN MY OWN RESEARCH CAN BE SHARED. THERE IS MANY TYPES OF DATA THAT HAVE NO REPOSITORIES. I WILL TELL YOU ABOUT THREE DIFFERENT OPTIONS FOR YOU TO SHARE YOUR DATA AND MAKE FINDABLE ACCESSIBLE TRACKABLE AND REUSABLE. WE STRONGLY ENCOURAGE YOU TO USE OPEN ACCESS DATA SHARING REPOSITORIES AND WE HAVE TWO FOAS OUT TO SUPPORT DATA REPOSITORIES COMMUNITY BASED AND DRIVEN BY THEIR COMMUNITY. I WANT TO GIVE ACKNOWLEDGMENT TO WORK THAT JERRY AND [INDISCERNIBLE] DID WORKING WITH OSTP TO DEVELOP A POLICY ADDRESSED DESIRABLE CHARACTERISTICS OF DATA REPOSITORIES THAT COULD BE USE TODAY LOCATE AND MANAGE DATA SHARE FROM FEDERALLY FUNDED RESEARCH. REPOSITORYIES AND MAKING SURE THEY SUPPORT COMMUNITIES AND PROVIDE SUFFICIENT AND EFFECTIVE USES FOR DATA MANAGEMENT AND THEY WORK WITH JOURNALS FROM APPROPRIATE COMMUNITIES. DEADLINE FOR RFI IS MARCH 6TH. I HOPE YOU LOOK AT DESIRABLE CHARACTERISTICS AND COMMENT. THERE ARE MANY DIFFERENT WAYS WHICH YOU CAN MAKE YOUR DATA FINDABLE, ACCESSIBLE, AND REUSABLE. IF YOU HAVE A RELATIVELY SMALL DATA SET YOU WOULD LIKE TO ASSOCIATE WITH YOUR PUBLICATION YOU CAN DO SO BY ASSOCIATING WITH SUPPLEMENTAL MATERIAL AND PUB MED PUBLICATION HERE. I'M LISTING ONE PARTICULAR EXAMPLE FROM MULTIPLE SKEROSIS MODELS DATA IS IN SUPPLEMENTAL MATERIAL AND GIVEN UNIQUE IDENTIFIER GUID SO YOU CAN ACTUALLY DOWNLOAD THE DATA AND USE IT AND SITE IT. THAT IS ONE SOLUTION IF PEOPLE COMING TO ARTICLE THEY CAN THEN LOOK AT DATA BUT NO WAY TO FIND DATA APRIORI. YOU HAVE TO GO THROUGH IT BY FINDING THE ARTICLE AND HOWEVER THERE ARE OTHER SOLUTIONS WE PROVIDE PILOT GENERAL REPOSITORY FOR FIXTURE AND INSTANCE FROM NIH FREE FOR ALL NIH-FUNDED RESEARCH EVERIES. YOU CAN UPLOAD YOUR DATA TO INSTANCE AND GIVEN A UNIQUE IDENTIFIER, DUI. YOU CAN LINK YOUR GRANT INFORMATION TO THAT DATA SET. WE CAN PULL IT INTO YOUR RPPR FOR YOUR YEARLY PROGRESS REPORT AND YOU CAN ASSIGN IT A PARTICULAR LICENSE IF YOU WANT TO SHARE IT BROADLY AND YOU CAN IMPLY AN EMBARGO IF YOU WANT TO SHARE IT ONLY AFTER A CERTAIN TIME. YOU CAN ALSO APPLY CERTAIN METADATA TO IT. WE PROVIDE TEMPLATES TO MAKE IT VERY EASY FOR YOU TO DO SO AND PROVIDE TRACKING AND INDEXING AND SEARCHED IN INDEX AND GOOGLE AND MANY OTHER SEARCH ENGINES THIS IS A WAY TO SHARE DATA IF NO REPOSITORY FOR IT TO GO INTO. JAMES FRAZIER WAS ONE OF THE FIRST PEOPLE TO USE OUR PARTICULAR INSTANCE FOR SMALL ANGLE SCATTERING DATA FOR WHICH THERE IS NO REALLY GOOD REPOSITORY AND ABLE TO SHARE DATA IN 15 MINUTES USING META DATA TEMPLATES IT WAS FAST AND WE CAN AND OTHERS CAN TRACK HIS DATA. THERE ARE WAYS TO SHARE YOUR DATA AND MAKE IT FAIR IF NO COMMUNITY REPOSITORY TO SHARE YOUR DATA DON'T WANT TO PUT IT IN THE ARTICLE BUT WANT IT FINDABLE TO A MUCH LARGER RESEARCH GROUP, THIS MIGHT BE A POSSIBILITY FOR YOU. THERE ARE SOME DATA SETS FOR WHICH MANY PEOPLE WILL WORK TOGETHER ON TOP MED FOR EXAMPLE AND GTEX FOR EXAMPL AND SOME CANCER COMMENTS RESEARCH DATA. PLATFORM-BASED DATA SETS ARE MOST USEFUL IN A CLOUD ENVIRONMENT SO MANY RESEARCHERS CAN WORK TOGETHER ON DATA SETS APPLY TOOLS AND WORKFLOWS AND SHARE TOOLS AND WORKFLOWS AND SHARE OTHER DATA ASSOCIATED WITH THAT. FOR THAT WE HAVE INITIATIVE CALLED SCIENCE TECH RESEARCH INFRASTRUCTURE FOR DISCOVERY IMPLEMENTATION AND IT PROVIDES GOOD PRICING POINTS FOR RESEARCHERS TO STORE DATA IN THE CLOUD AND COMPUTE ON DATA. THIS IS THROUGH ALL NIH FUNDED RESEARCH EVERIES AND STRIDES IS OFFERED THROUGH INSTITUTIONS AND YOU CAN PROVIDE INSTITUTIONAL SERVICES AND WHAT PROFESSIONAL SERVICE LZ DO IS ENHANCE YOUR CODE AND WORKFLOW AND FOR EXAMPLE TOP MED RESEARCH EVERIES HAVE NUMBER OF PIPELINE ANALYSIS TOOLS AND ABLE TO PROVIDE 10-FOLD INCREASE IN ABILITY OF WORKFLOWS WE CAN ENHANCE TOOLS YOU ALREADY HAVE IN THE CLOUD AND PROVIDE A NUMBER OF TRAINING OPPORTUNITIES HERE AT NIH AND GOING OUT TO INSTITUTIONS HOW TO USE TRAINING AND CLOUD CONCENSUS ON NUMBER OF POTENTIAL CLOUD ENGAGEMENTS WHICH THIS IS ONE OPPORTUNITY. THROUGH STRIDES, WE SO FAR MOVED OVER 30 PETA BYTES OF VERY LARGE DATA SITES TO BOTH GOOGLE AND AWS WHICH ARE OUR TWO STRIDES PARTNERS FRAMING OF HEART STUDIES I MENTIONED AND NCI'S COMMENTS DATA FRAMEWORK AND SEQUENCE ARCHIVE IN ITSELF 24 PETA BYTES OF DATA SPLIT EQUALLY BETWEEN GOOGLE AND AWS AND MANY MORE DATA SETS WE HAVE THE LARGEST BIOMEDICAL RESEARCH FOR RESEARCHERS AND THAT IS A LOT OF DATA THAT YOU NEED FOR REALLY ADVANCED AI ALGORITHMS. I THINK WE ARE GETTING THERE. BUT MANY OF THESE DATA PLATFORMS AND DATA SETS ARE THEMSELVES EXCELLENT AND USED BY THEIR COMMUNITIES BUT ARE ALSO FAIRLY SILOED. IT WOULD BE VERY DIFFICULT FOR YOU AS A RESEARCHER TO LOG INTO ANY ONE OF OUR PLATFORMS AND LOOK AT DATA OF PATIENTS ACROSS THESE PLATFORMS AND KNOW MANY PATIENTS CONTRIBUTE DATA TO DIFFERENT STUDIES COULD HAVE DATA CONTRIBUTED TO DIFFERENT CANCER STUDIES OR DIFFERENT PEDIATRIC STUDIES IF THERE ARE CHILDREN. IT WOULD BE INCREDIBLY DIFFICULT TO FIND SAMENT PATIENT DATA SPREAD OUT ACROSS NIH ENTERPRISE AND DIFFICULT TO FIND DATA OF CELL TYPES SPREAD ACROSS ENTERPRISE. WE KNOW FROM RESEARCHERS IF ANL TO PROVIDE ACCESS TO DATA PATIENT DATA FOR LARGER COHORT STUDIES OR CELLULAR DATA FOR CELLULAR DATA INTEGRATION YOU WOULD ADVANCE YOUR SCIENCE WHAT WE ARE DOING THIS SUMMER AND COMPLETELY SUMMER PHASE I IS TO PROVIDE SOMETHING REALLY BASIC AND SIMPLE IN PRINCIPLE YOU SIELO ONCE AND HAVE ACCESS TO ALL DATA YOU HAVE ACTUALLY BEEN GIVEN ACCESS TO YOU DON'T HAVE TO SIGN IN AND LOG IN TO EACH OF THE PLATFORMS AND AGGREGATE DATA YOURSELF IT WILL BE DONE FOR YOU IN SOMEWHAT SIMPLE AND FLEXIBLE TECHNOLOGY THAT IS MAKING USE OF INDUSTRY STANDARD AUTHENTICATION AUTHORIZATION TECHNOLOGIES. WE HIT OUR FIRST MILESTONE FOR THOSE THAT USE A LOT OF DATA ANALYTICS. YOU MIGHT BE FAMILIAR WITH GLOEFIS WHERE YOU CAN LOAD ON TO AND BE ACCESSING OTHER PLATFORMS AND TECHNOLOGIES AND OPEN ACCESS CONNECT FOR EXAMPLE TO SUPPORT LOGIN FROM GOOGLE OR.GOV OR MULTIUSER AUTHENTICATION. TECHNICAL DEEP DIVE BUT LOGIN ONCE AND ACCESS IS SIMPLEST WE CAN DO AND OTHER TECHNOLOGIES WE CAN BUILD ON TOP OF THAT BUT FIRST HAVE TO START HERE. WE TALKED ABOUT MAKING DATA FINDABLE AND ACCESSIBLE THROUGH PUB MED CENTRAL AND COMMUNITY REPOSITORIES LIKE FACE-SPACE OR GENERAL REPOSITORY. WE TALKED ABOUT MAKING DATA AVAILABLE THROUGH CLOUD COMPUTING ANALOGUING IN GETTING ACCESS TO ENTERPRISE DATA AND WANT TO TELL YOU MAKING DATA INTEROPERABLE AND GREATEST CHALLENGE AS DATA PERSON THAT WE WILL FACE AND WANT TO LEVERAGE SOMETHING THAT IS ALREADY HAPPENING IN THE PAYER AND HEALTHCARE SYSTEM IN TERMS OF FAST HEALTHCARE INTEROPERABLE RESOURCES. WHAT THIS DOES IS PROVIDES INTERFACE FOR OUR HEALTH CARE PROVIDERS AND INSURANCE PAYERS AND PATIENTS TO SHARE THEIR ELECTRONIC HEALTH CARE RECORDS THROUGH MOBILE DEVICES OR WEB BEB BASED APPLICATIONS OR THROUGH CLOUD SERVICES. THERE IS SOMETHING HERE WE CAN LEVERAGE. HOW IT WORKS IS A PRETTY SIMPLE CONCEPT THAT IS SOMEWHAT HARD TO IMPLEMENT. GO TO WEB BROWSER TOP LIKE TYPE IN HTML PAGE YOU TYPE IN WORD LIKE FIRE AND HIT RETURN. WHAT WILL COME BACK IS A BUNCH OF WORDS AND SYMBOLS WHICH IS ESSENTIALLY HAPPENING HERE. WE ARE BASICALLY DISCRETE UNITIZING INFORMATION INTO LITTLE PACKETS TO SHARE THAT INFORMATION ACROSS OUR HEALTH CARE SYSTEM. FOR EXAMPLE, WE PROVIDE COMPONENTS THAT TALK ABOUT DATA TYPES AND SECURITY AND PRIVACY ABOUT DATA TIME AND ABOUT THE PATIENT AND ABOUT HEALTH CARE ISSUES LIKE ALLERGIES OR CLINICAL REASONING SUCH AS MEASURES. IT IS A WAY TO SHARE INFORMATION THAT IS ABOUT A PATIENT OR RELATED PERSONS AND THEIR LOCATIONS AND LAB REPORTS AND TESTS AND SHARING WITH HEALTHCARE PROVIDER AND PAYER SO IF YOU GO TO THE EMERGENCY ROOM, YOUR ELECTRONIC CARE RECORDS CAN BE SHARED WITH THOSE PEOPLE IN THAT PARTICULAR HOSPITAL AND BACK TO YOUR PROVIDER AND YOUR PAYER. USING THAT CONCEPT WE HAVE TWO PILOTS. THE FIRST IS A WAY TO INTEGRATE INTO OUR ELECTRONIC HEALTHCARE RESOURCES PHENOTYPIC INFORMATION THAT IS COMING FROM PHENOTYPIC STUDIES OF RESEARCH USING METHOD CALLED PHENOPACKETS SUPPORTED BY G4GH. IN THIS WAY WE HOPE TO INTEGRATE ELECTRONIC HEALTH CARE RECORDS INTO BASIC PHENOTYPIC RESEARCH DATA AND SECOND PILOT IS EXTRACTING CLINICAL DATA INTO EHR SYSTEM TO MAP RESEARCH DATA INTO FIRE STANDARDS THAT MAP INTO ELECTRONIC HEALTHCARE STANDARDS WHICH THOSE ARE TWO PILOTS. IT IS CHALLENGING. WE HAVE MANY, MANY XHEN DATED ELEMENTS THAT HAVE BASIC CLINICAL RESEARCH AND MAPPING ON THEIR ONTOLOGIES IS TIME CONSUMING WE WANT TO DO THIS INTEGRATE ELECTRONIC HEALTHCARE DATA WITH PHENOTYPIC DATA AS WELL AS CLINICAL RESEARCH DATA. BY NEXT SUMMER I'M HOPING TO REPORT ON OUTCOMES OF THESE. TO LET YOU KNOW THERE ARE A NUMBER OF INSTITUTES WHO ARE ALSO LOOKING AT INTEGRATES FAST HEALTH CARE AND RESOURCES WITH THEIR OWN PARTICULAR DATA FOR NHGRI IS INTEGRATING FIRE WITH GENETIC TEST RESULTS AND FOR MCAT IT IS USING FIRE ACROSS CTSAS TO DEVELOP A SHARED INFRASTRUCTURE. MY LAST SEGMENT IS TO TELL YOU ABOUT THE WONDERFUL WORK THAT NINE UNDERGRADUATE COMPUTER SCIENCE MATHEMATICS AND MATH OR STATISTICS STUDENTS DID AT NIH THROUGH PROGRAM CALLED CODING IT FORWARD. LAST YEAR WE BROUGHT IN FELLOWS TO SPEND 10 WEEKS AT NIH TO GET HANDS ON EXPERIENCE IN PROGRAMATIC ANALYTIC WORK AT NIH. I WILL TELL YOU ABOUT ONE STUDENT WHO IS -- LET'S SEE IF I CAN -- HE IS I THINK THAT IS HIM. ISAAC ROBERTSON. HE IS AN UNDERGRADUATE COMPUTER SCIENCE AND MUSIC FELLOW AT YALE. IT IS ACTUALLY A MOVIE. YOU WILL BE ABLE TO WATCH THIS. DEVELOP MACHINE-LEARNING MODELS TO PREDICT THE MIGRATION PATHS AND MORPHOLOGISTS OF FIBRO BLASTS CELLS IN EXTRA CELLULAR MEDIUM. COLUMN SAYS REEL AND EACH FRAME TRAINED ALGORITHM TO PREDICT WHERE IS THE CELL GOING TO GO NEXT AND WHAT ARE IMPORTANT FEATURES A RESEARCHER WOULD WANT TO KNOW ABOUT THAT. THERE ARE SO MANY THINGS YOU CAN EXTRACT FROM IT. WHAT IS THE IMPORTANT FEATURE? HE DEVELOPED THESE ALGORITHMS IN THE CLOUD ENVIRONMENT IN STRIDES. THIS TYPE OF WORK IS APPLICABLE TO MANY DIFFERENT TYPES OF RESEARCHERS. IT IS NOT JUST IT IS APPLICABLE TO NIDCR BUT ALL RESEARCHERS AT NIH INCLUDING APPLICATIONS TO CANCER. I WANT TO THANK VERY MUCH JOHN PREW WHO WAS HIS MENTOR AND HOPE NEXT YEAR TO BRING ANOTHER COHORT OF UNDERGRADUATE FELLOWS OF COMPUTER SCIENCE AND MATHEMATICS TO NIH. AMAZING WORK AND THANK YOU SO MUCH FOR SUPPORT OF OUR PROGRAM. WE HAVE MANY DIFFERENT WAYS OF SUPPORTING IMPORTANT RESEARCH AND RESEARCHERS IN DATA SCIENCE. AN ANNOUNCEMENT I SUSPECT WILL COME OUT TODAY OR TOMORROW FINGERS CROSSED FOR TODAY. NATIONAL DATA AND TECHNOLOGY SERVICE SCHOLARS PROGRAM THAT IS A ONE OR TWO YEAR SABBATICAL FOR LEADING EXPERTS IN COMPUTER SCIENCE AND TECHNOLOGY AND MATHEMATICS AND PRIMARILY FROM THE INDUSTRY SECTOR TO COME TO NIH AND SPEND 1 TO 2 YEARS WORKING ON REALLY HARD PROBLEMS AND WE EXPECT TO BRING IN 5 OR 6 FELLOWS STARTING THIS SUMMER TO WORK ON A FEW REALLY GRAND CHALLENGING PROBLEMS I LISTED A FEW INCLUDING ADOPTION OF MACHINE LEARNING ALGORITHMS TO MEDICAL IMAGES WHICH I'M SURE WILL BE IMPORTANT FOR NIDCR. YOU ARE PRETTY UNIQUE CHALLENGES IN PROCESSING MEDICAL IMAGES BECAUSE THEY ARE SO IDENTIFIABLE THAT WE NEED MAYBE PARTICULAR -- OOPS. ENCRYPTION TECHNOLOGIES AND PRIVACY PRESERVING COMPUTING WE NEED WAYS TO ADDRESS YOUR PARTICULAR CHALLENGES AND WORK THEORIES AND BRAIN CIRCUITRY AND KNOWLEDGE AND INFERENCES AND SCIENTIFIC DATA INNOVATIONS IN AFRICA AND PLEASED TO ANNOUNCE THIS AND HOPE YOU HELP ME BY GETTING WORD OUT TO PEOPLE WHO YOU MAY KNOW WHO MIGHT WANT TO COME TO NIH TO WORK ON GRAND CHALLENGING PROBLEMS WHICH IS THE VISION AND HOPING I DON'T GO TOO FAR OVER TIME NOBODY WORKS ON THIS ALONE. TAKES A VERY LARGE GROUP OF PEOPLE AND THANKS TO ALL OF THEM AND COLLEAGUES AND OFFICE OF DATA SCIENCE TECHNOLOGY HAPPY TO TAKE QUESTIONS IF THERE IS TIME AND THANK YOU AGAIN. >> AUDIENCE: [APPLAUSE]. >> WE CAN TAKE A COUPLE OF QUESTIONS. YES? >> [INDISCERNIBLE]. >> THAT IS A GREAT QUESTION. I HAVE TO SAY WE HAVE BEEN TALKING NOT ONLY IN NIH BUT ACROSS FEDERAL GOVERNMENT ABOUT DIGITAL GOVERNANCE POLICIES PATIENTS CAN SIGN A NUMBER OF DIFFERENT CONSENTS FOR THEIR DATA. WE WILL RESPECT THAT CONSENT. IF THEY SIGN GENERALLY RESEARCH CONSENT WE CAN INTEGRATE WIDELY ACROSS MANY SYSTEMS IF SPECIFIC FOR A PARTICULAR DISEASE OR STUDY WE CANNOT INTEGRATE IT AND MUST OBEY WHAT THEY CONSENTED TO. NICE THING ABOUT THE SYSTEM WE ARE BILLING CALLED RESEARCHER AUTHENTICATION SERVICES WE CAN ELECTRONICALLY KEEP ABREAST OF HOW PATIENTS ARE -- IT THAT IS A BENEFIT WHAT WE ARE STANDING UP. SECOND QUESTION YOU HAVE IS SORT OF GOING BACKWARDS IN TIME WHEN PATIENTS DIDN'T REALIZE THEY COULD INTEGRATE ALL THIS DATA TOGETHER AND DIDN'T CONSENT TO WHAT DO WE DO? THERE ARE TWO OPTIONS. WE CAN GO BACK AND RECONSENT THAT WILL BE PROBABLY VERY INEFFICIENT OR GO FORWARD AND UNDERSTAND WE LIVE IN A NEW DATA-RICH WORLD AND DEVELOP DATA GOVERNANCE AND CONSENT THAT IS CLEAR TO PATIENTS AND EASY TO IMPLEMENT AND TALKED TO A NUMBER OF FOLKS BOTH AT MEDICAL AND RESEARCH COLLEGES ABOUT THIS. GENERAL CONCENSUS SEEMS TO GO FORWARD AND IT IS VERY DIFFICULT TO GO BACKWARDS AND HOPE THAT ADDRESSES YOUR QUESTION. YES? >> IT IS AMAZING YOU ARE DOING THOSE SYSTEMS IN THE PLATFORMS BUT ULTIMATE SUCCESS RELY ON PEOPLE THAT CAN PROVIDE YOU WELL CURATED DATA BUT UNFORTUNATE TLI THERE IS A DISCONNECTION HERE MOST GENERATING DATA IS NOT HYPOTHESIS DRIVEN EVENT NOT A GOOD MECHANISM SUPPORTING DATA GENERATED EVENT HOPING IT IS A GENERAL COMMENT AND WE WILL SEE IN FUTURE SOME CONCEPT CLEARANCE REALLY SUPPORTING THOSE KIND OF ACTIVITIES I MYSELF HAVE EXPERIENCED OR INSTITUTE HAVE A HUMAN ORAL MICROBIOME DATABASE YOU WANT TO PUT ON THE CROWD BUT NO MECHANISM OR FUNDING MECHANISM TO SUPPORTING SUCH ACTIVITY. >> THANK YOU. THAT IS A REALLY GREAT QUESTION AND THINK IT IS ALSO RAISED IN ACIDA REPORT AND UNDERSTAND IT IS HARD FOR RESEARCHERS NOW TO ANTICIPATE FIVE YEARS IN THE FIETTURE WHAT FORMAT AND DATA THAT PEOPLE WANT AND WAYS TO THINK ABOUT THAT NOW AND HARD PROBLEM THAT IS BROUGHT UP WELL IN ACDA WORKING GROUP WITH REPORT. >> DR. STANFORD? >> THANK YOU VERY MUCH. ONE THING I'M LEADING AS A DEAN AT MY SCHOOL LEADING DEAN OF LIBRARIES AND INTERESTING HOW ENTIRE LIBRARY WORLD MOVED INTO DATA MANAGEMENT AND ALL CHALLENGES AND NO. 1 QUESTION COMING UP I WANT TO ASK YOU AND THINK YOU HAVE SAID IT. MANY TIMES DATA, WE LIKE TO TALK ABOUT DATA. IF YOU PULLED UP A SPREADSHEET FROM FIVE YEARS AGO AND TRIED TO USE IT NOW IT WILL POTENTIALLY BE VERY CORRUPTED. QUESTION THAT COMES UP DATA ARCHIVE AND DATA RETRIEVAL WE HAVE TO TALK ABOUT TOOLS THAT MAY NOT BE PUBLICLY AVAILABLE 5 OR 10 OR 15 OR 20 YEARS FROM NOW AND DATA BECOMES USELESS IF WE DON'T TIE IT TO POTENTIALLY PROPRIETARY SOFTWARE AVAILABLE IN 1983. THAT IS -- IT IS A VERY INTERESTING QUESTION THAT WE CAN TALK ABOUT DATA RETRIEVAL AND OPEN SOURCE, BUT IF WE DON'T GIVE ALL OF THE INVESTIGATORS GLOBALLY TOOLS THAT WERE USED TO AT LEAST FOR THE ORIGINAL ANALYSIS AND TALK ABOUT REPRODUCIBILITY AND REPLICATION OF RESEARCH ANALYSIS, IT BECOMES A REAL CHALLENGE. >> IT DOES. YEAH. I'M FAMILIAR WITH THAT PROGRAM AND WAYS TO ADDRESS IT MAKING SURE METAYOU DATA ASSOCIATED WITH THAT DATA AS WELL AS ANY SOFTWARE USE TODAY GENERATE WITH THAT DATA IS AVAILABLE IN OPEN SOURCE FORMAT AND WAYS TO MAKE THAT POSSIBLE AND TRUE THAT 5 OR 10 YEARS AGO IT WASN'T NECESSARILY THE CASE AND ONE OF THE BENEFITS OF THE CLOUD ENVIRONMENT IS IT DOES ENHANCE THAT AND MAKES IT MUCH MORE EASIER TO SHARE THAT DATA AND METADATA AS WELL AS SOFTWARE TOOLS BUT IT IS ALSO A CHALLENGE GOING FORWARD THAT WE HOPE THAT FOAS IN DATA MANAGEMENT FOR REPOSITORIES AND KNOWLEDGE-BASES WILL START TO ADDRESS AND SEE THIS HAPPENING NOT ONLY IN NIH BUT IN COMMUNITY AT LARGE AND HENCE REQUEST FOR INFORMATION FROM LSTP ON THIS PARTICULAR TOPIC AND HOPE YOU LOOK AT THAT AND RESPOND. >> OKAY. ONE MORE AND WE HAVE TO MOVE ON. >> I THINK THAT THIS IS GOING TO BE A GAME-CHANGER SCIENTIFICALLY BECAUSE OFFAC CONSIDER ES TO DATA AND BEING ABLE TO MOVE FORWARD. THANKS SO MUCH FOR THAT. MOST OF WHAT YOU FOCUSED ON WAS INVESTIGATORS AND MENTIONED HUMAN RESEARCH PARTICIPANTS AND RECOMMEND THAT SOME FOCUS BE ON GOVERNANCE BODIES LIKE INSTITUTIONAL REVIEW BOARDS AND OFFICES THAT SPONSORED PROGRAMS BECAUSE THEY ALSO GOVERN WHAT INVESTIGATORS CAN DO AND THINK EDUCATION OF THOSE GROUPS WOULD BE VERY HELPFUL. >> THANK YOU. GREAT POINT. EXCELLENT. I WILL TAKE IT AS AN ACTION ITEM. ALL RIGHT. THANK YOU AGAIN VERY MUCH. WE WILL MOVE ON TO -- >> AUDIENCE: [APPLAUSE]. >> WE WILL MOVE TO DR. LARS VON BUCHHOLTZ WHO IS A STAFF SCIENTIST IN LABORATORY OF SENSORY BIOLOGY AND RECEIVED PHD IN NEUROSCIENCE AND NIDS- SINCE 2004 AND RESEARCH INTERESTS INCLUDE CELLULAR AND MOLECULAR BASIS OF CODING IN TASTE OF SEB ATTOSENSORY SYSTEMS. >> THANK YOU SO MUCH FOR THE INTRODUCTION AND FOR HAVING ME HERE. YOU CAN ALREADY GUESS FROM THE INTRODUCTION I'M NOT COMING FROM A COMPUTER SCIENCE BACKGROUND. I'M AN EXPERIMENTAL NEURAL BIOLOGIST AND COMING FROM THE WEB LAB. LAST THREE YEARS OR SO I TURNED MORE AND MORE TOWARDS DATA SCIENCE AND MACHINE LEARNING AND OBVIOUSLY ATTRACTED BY THE POWER IT HAS IN SO MANY PLACES IN OUR LIFE BUT ALSO PARTIALLY BECAUSE OVER THE LAST FEW YEARS THERE IS A NUMBER OF NEW TECHNIQUES IN THE LAB THAT GENERATE DATA SETS LARGE ENOUGH AND COMPLEX ENOUGH TO BENEFIT FROM THE SORT OF ANALYSI. ONE EXAMPLE OF TECHNOLOGY IS SINGLE CELL SEQUENCING YOU MIGHT KNOW IT IS TO TRANSCRIPTOR OF THOUSANDS OF CELLS SIMULTANEOUSLY AND INDIVIDUALLY AND MANY LABS OVER LAST FEW YEARS APPLIED TECHNIQUE OVER VAR TIETY OF TISSUES AND SPECIES NOT JUST ON THIS LITTLE CARTOON ON THE RIGHT AND A FEW PEOPLE HERE IN THE AUDIENCE MIGHT HAVE EXPERIENCED THAT. >> HOLD ON A SECOND. STAND CLOSER TO THE MICROPHONE OR USE THE HAND MIC. >> YES. SORRY. YES. ALSO A NUMBER OF PEOPLE IN THE AUDIENCE HAVE EXPERIENCE WITH THIS TECHNIQUE AND WOULD AGREE WITH ME POWERFUL EXPLORATORY NEW TOOL TO IDENTIFY NEW CELL CLASSES AND HAS A NUMBER OF DRAWBACKS. AS POWERFUL AS IT IS AT IDENTIFYING TRANSCRIPTIONAL CELL CLASSES BASED ON TRANSCRIPT TO THEM SAME TIME POWER AND CHARACTERIZING SINGLE GENE ON A CELLULAR LEVEL AND UNDERSAMPLING INHERENT IN THE TECHNIQUE LEADS TO FALSENERTIVES WE CALL DROPOUTS AND OFTEN HARD TO JUDGE IF GENE IS GOOD MARKET GENE FOR A CELL CLASS MEANING IF IT COVERS THE WHOLE CELL CLASS IS NOT SPORADICALLY EXPRESSED OUTSIDE. ANOTHER DRAWBACK WE OBSERVED IS DISTORTIONS IN CELL SIZES THAT SEEMS TO BE PARTICULARLY THE CASE IN SOME NEURONS SOME NEURONS SIMPLY SURVIVED THE PROCEDURE BETTER IS THAT USUALLY SPATIAL L THING - ANATOMICAL AND FUNCTIONAL INFORMATION IS LOST IN THIS PROCEDURE. AT TIME WE GET INFORMATION FROM THE CELLS THEY ARE LONG DEAD AND GONE. SO WHEN AWE NEED IS TO BRING BACK COMPREHENSIVE SINGLE CELL INFORMATION BACK INTO THE TISSUE FIRST OF ALL TO VALIDATE SINGLE CELL DATA AND CORRECT IT WHERE NECESSARY AND SECOND TO RESPOND TO IT IN A PHYSIOLOGICAL CONTEXT. AND TO THIS END WE HAVE DEVELOPED IN THE LAST YEAR A NOVEL APPROACH THAT COMBINES MULTIPLEX AND SUTURE HYBRIDIZATION WITH DEEP LEARNING ANALYSIS AND STRATEGY BRINGS BACK SINGLE CELL DATA BACK TO THE TISSUE AND APPLICABLE TO SINGLE CELL PROJECT TO MANY OF THEM IN THE OTHER LABS AND HOW DID I GET THERE IN THE FIRST PLACE? AS I -- SO I'M -- OUR LAB IS PRIMARILY INTERESTED IN HOW SENSATION WORKS AND SINCE WE ARE IN THE CRANIOFACIAL INSTITUTE WE ARE INTERESTED IN SENSATION IN THE HEAD. MOST SENSATION IN THE HEAD IS DETECTED BY TRIGENITAL SYSTEM AND NEURONS IN TRIGENITAL GANG LION HAVE SENSORY DIVERSE TISSUE IN THE HEAD AND DIVERSE MODALITIES DETECTED BY IT INCLUDING DETECTING TEMPERATURE HOT AND COLD AND SENSORY STIMULUS CLASSES AND WORKING ON MOUTH AND HERE WE SEE A VIEW OF THE CRANIAL CAVITY WITH TWO TRIGENITAL GANGLIA LOCATED HERE EACH OF THE GANGLIA HAVE 25,000 NEURONS AND SEQUENCING PROJECT OF TISSUE IDENTIFY ABOUT A DOZEN NEURONAL CRISIS DISPLAYED IN THIS HERE. THAT SORT OF REFLECTS FUNCTIONAL AND ANATOMICAL DIVERSITY WE SEE IN THIS TISSUE. BUT, AGAIN, ALL OF THESE CAVEATS THAT ARE MENTIONED BEFORE APPLY TO THAT KIND OF DATA AND WE WANT TO MOVE IT BACK INTO THE TISSUE. BASED ON THE EXPRESSION ANALYSIS OF THE SINGLE CELL DATA WE COULD IDENTIFY LIMITED SET OF 15 GENES THAT SHOULD BE ABLE TO DISCRIMINATE ALL TRIGEMINAL NEURON CLASSES GENERATING BINARY CODE YOU CAN SEE HERE AND THIS CODE IS COMBIN TORIAL. WE HAVE TO ADD UP MULTIPLE GENETIC MARKERS TO REALLY DEFINE A CLASS AND ONLY RARELY DOES A SINGLE MARKET GENE DEFINE A CELL CLASS. WHEN WE DO THESE EXPERIMENTS THIS IS HOW IT LOOKS LIKE AND SECTIONS THROUGH TRIGEMINAL HYBRIDIZED THROUGH EACH OF THESE PROBES AND EACH OF THE PROBES DETECT A SUBSET OF TRIGEMINAL GANGLION NEURONS IT IS NICE TO LOOK AT BUT DOESN'T TELL US MUCH AT THIS POINT. BETTER TO LOOK AT PAIRS OF THEM. HERE WE HAVE TWO PAIRS OVERLAID ON TOP OF EACH OTHER AND SEE EXPECTED OVERLAP PATTERNS LARGELY THAT WE WOULD EXPECT FROM SINGLE CELL SEQUENCING AND LOOKING AT RAW DATA IMAGE ON THIS LEVEL IS NOT ENOUGH OF COMPREHENSIONAL DATA OF THIS MODEL. EXTRACT INFORMATION FROM EACH OF THE CELLS TO DETERMINE THE CLASS AND BE ABLE TO PERFORM A HIGH LEVEL OF ANALYSIS IS WHAT WE HAVE TO DO. THAT IS WHAT WE DID. WE MANUALLY CIRCLED EACH OF THE CEMS AND EXTRACTED FLUORESCENCE ACROSS ALL CHANNELS FOR ALL CELLS REFLECTIVE OF GENE EXPRESSION FOR CELLS AND CLUSTER CELLS INTO DIFFERENT CELL CLASSES AND WE HAVE SPATIAL INFORMATION AND WE CAN BRING INFORMATION BACK AND WHERE EACH OF THE CELL CLASSES IS LOCATED IN THE TISSUE. YOU CAN IMAGININ THAT THIS PROCESS IS INCREDIBLY PROHIBITED AND LABOR INTENSETIVE THIS APPROACH. WE NEEDED A SMALLER SOLUTION FOR THAT AND WHERE MY RECENT INTEREST IN MACHINE LEARNING BECAME REALLY HANDY. WE WANTED A MACHINE-LEARNING MODEL THAT TAKES THESE IMAGES AS INPUT AND OUTPUT A MAP AND PREDICTS A MAP ON WHERE EACH CELL IS LOCATED. IT SHOULD AUTOMATICALLY SEGMENT CELLS IN OUTLINE AND SIMULTANEOUSLY DETERMINE THEIR CLASS. NOW, I COULD NOW GO ON AND TELL YOU ABOUT TECHNICAL DETAILS WE USED TO TRAIN THIS MODEL IT WOULD MOSTLY BE JARGON. I WANT TO INSTEAD INTRODUCE A FEW BASIC KEY PRINCIPLES IN MACHINE LEARNING IN GENERAL THAT SHOULD BE APPLICABLE TO OTHER TALKS YOU HEAR TODAY AND TIED BACK INTO WHAT WE ARE DOING WITH OUR DATA. FIRST OF ALL, IN A VERY ABSTRACT LEVEL, MACHINE LEARNING ALGORITHM CAN BE THOUGHT OF FOR TRANSFORMATION FUNCTION MATHEMATICAL TRANSFORMATION FUNCTION THAT TAKES TWO INPUTS. ONE IS OUR DATA IN OUR CASE IMAGES WHICH IS A BUNCH OF NUMBERS FOR EACH CHANNEL AND POSITION IN THAT IMAGE. SECOND INPUT IT TAKES IS A SET OF INTERNAL PARAMETERS AND I WILL GET LATER TO HOW WE GET THESE PARAMETERS. TRANSFORMATION FUNCTION TAKES INPUT AND MATHEMATICALLY COMBINED THEM TO CALCULATE A PREDICTION AND IN OUR CASE A MAP OF EACH CELL AND WHERE IT IS LOCATED. HOW DO WE GET THE MODEL TO GIVE US A GOOD PREDICTION? WE HAVE TO TEACH IT AND SHOW IT WHAT WE EXPECT FROM IT AND NEED GRAND TRUTH AND SEGMENTATION MAP ON HOW CELLS ARE DISTRIBUTED AT LEAST ON A TRAINING SET WE USE TO TRAIN ALGORITHM AND TECHNIQUE IS SUPERVISED LEARNING AND MAJOR PART OF MACHINE LEARNING. NEXT THING, WE GET THE SEGMENTATION MAP HERE BY MANUAL ANNOTATION I SHOWED YOU TWO SLIDES AGO. THE NEXT THING WE NEED IS A WAY TO QUANTIFY HOW WELL OUR PREDICTION TURLLY LOOKS LIKE. THAT IS DONE BY MATHEMATICAL FUNCTION THAT IS CALLED A LOSS FUNCTION AND THERE ARE SEVERAL VARIETIES OF THESE AND GIVES A WAY TO EXACTLY MEASURE HOW GOOD OR BAD OUR PREDICTION IS. WHAT WE WANT IS A SET OF MODEL PARAMETERS THAT GIVES BEST PREDICTION AND THEREFORE THE SMALLEST LOSS. HOW DO WE GET THOSE? FIRST STEP WE DO IS RANDOMLY INITIALIZE PARAMETERS AND ASSIGN RANDOM VALUES TO THESE PARAMETERS AND FEED INTO THE TRANSFORMATION FUNCTION WITH SAMPLE DATA AND CALCULATE THE PREDICTION THAT IS A PURE MATHEMATICAL OPERATION HERE. AS YOU CAN GET, SINCE WE RANDOMLY INITIALIZED THESE PARAMETERS, OUR PREDICTION IS REALLY, REALLY, REALLY BAD AND COMPLETE NONSENSE AT THIS POINT AND LOSS WILL BE HUGE IN THIS BEGINNING STEP. WHAT WE CAN DO NOW MATHEMATICALLY NOW IS WE WILL TRACE THE GRADIENT OF LOSS BACK TO THE PARAMETERS AND FIND OUT WHICH WAY DO WE HAVE TO NUDGE EACH OF THE PARAMETERS TO IMPROVE OUR LOSS FUNCTION JUST A TINY BIT. AND WHEN WE DO THAT AND REPEAT IT OVER AND OVER AGAIN WE KEEP REDUCING LOSS FUNCTION IMPROVING OUR PRODUCTION UNTIL WE REACH A MINIMUM IN THE LOSS FUNCTION WE KNOW WE ARE PREDICTING AS LONG AS OUR MODEL CAN ACHIEVE. AND ONE THING I WANT TO MENTION IS THE TRANSFORMATION FUNCTION IS A VERY ABSTRACT CONCEPT AT THIS POINT AND COULD BE SIMPLE LINEAR EQUATION FOR EXAMPLE OR A COMPLEX CHAIN OF OTHER MATHEMATICAL TRANSFORMATION. WHEN COMPLEX CHAIN, WE CALL IT DEEP LEARNING. AND A PARTICULARLY SUCCESSFUL DEEP LEARNING MODEL, ESPECIALLY WITH IMAGE DATA IS CALLED CONVOLUTIONAL NEURAL NETS AND SURE YOU WILL SEE LOTS MORE OF THOSE LATER CALLED CNS AND THEY ARE GOOD IMAGES AND USUALLY TAKE IMAGE AS INPUT AND TRANSFORM IT IN PARALLEL TO MULTIPLE DIFFERENT NEW IMAGES THAT ARE RATHER FEATURE MAPS AND REPEAT THE SAME THING AGAIN AND SO ON AND SO ON IN A CHAIN OF LAYERS. I WANT TO DRAW YOUR ATTENTION TO TWO DETAILS HERE. FIRST OF ALL, SIZE OF THE IMAGES GETS GRADUALLY SMALLER. WHEN WE LOOK AT WHAT KIND OF FEATURES ARE REPRESENTED WITH THEM, WE NOTICE THAT IN EARLY LAYERS, WE DETECT RELATIVELY CONCRETE THINGS SUCH AS EDGES AND COLORS AND FURTHER WE GO INTO THE NETWORK, THE MORE ABSTRACT PATTERNS ARE REPRESENTED IN THOSE AND ARE RECOGNIZED. WHAT THIS MODEL IS USUALLY USED FOR IS IMAGE CLASSIFICATION AND MEANS WE FEED IN AN IMAGE AND WE GET OUT WHAT THE IMAGE IS. IN THIS CASE, A CAT. WE COULD FEED IN TISSUE SECTION AND IT TELLS US IS THIS A TUMOR OR HEALTHY TISSUE WHICH IS A VERY USEFUL APPLICATION. WE DON'T WANT THAT FOR OUR PROBLEM, AN INTEGU TEAR INPUT. WE WANT THE INDIVIDUAL SIZE OF IMAGE AND SIZE OF CELLS. IN THE FIRST HALF YOU SEE IN ORANGE HERE IS WHAT WE HAD ON THE LAST SLIDE. A CHAIN OF TRANSFORMATION GETS SMALLER AND SMALLER AND MORE AND MORE ABSTRACT AND GO BACK AND REVERSE PROCESS AND GET LARGER AND LARGER AGAIN AND GAIN RESOLUTION AND COME OUT WITH A MAP OF OUR CELL CLASSES THAT WE TRAIN IT ON. OF COURSE, IT IS BASIC ARCHITECTURE THAT REQUIRES SOME TWEAKING AND YOU ESSENTIALLY TRY OUT A NUMBER OF DIFFERENT HYPERPARAMETERS AND SEE WHICH OF THOSE PERFORMS BEST ON YOUR PROBLEMS. HOW WELL DOES A MODEL LIKE THIS PERFORM OR MULTIPLEX [INDISCERNIBLE] DATA. THIS IS HOW PREDICTION FOR WHOLE TRIGEMINAL GANGLION LOOKS LIKE AND LOOKS REMARKABLY GOOD IN THIS CASE CELLS CAN BE EASILY SEGMENTED FROM THE PREDICTION MAP AND SURPRISES ME MORE IS REALLY WHAT LITTLE INFORMATION I NEEDED TO TRAIN THIS MODEL TO REALLY A GOOD LEVEL. WE ONLY NEEDED ABOUT 6,000 CELLS SO TISSUE SECTIONS THAT CONTAIN 6,000 CELLS TO TRAIN THIS MODEL AND REDUCE NUMBER OF PROBES THAT WE ACTUALLY NEEDED FROM ORIGINAL FIFTEEN DOWN TO 8 PROBES THAT ARE REQUIRED TO LIVELY PREDICT CELL CLASSES AND OUTLINES AND OF COURSE WE HAVE TO VALIDATE HOW WELL THE PREDICTION IS AND A REALLY IMPORTANT PART FROM MACHINE LEARNING IS THAT WE DON'T TEST IT ON ANY DATA THAT THE MODEL HAS ALREADY SEEN AND TRAINED ON. WE MIGHT TAKE UP NOISE AND LEARN THAT. WE WANT TO KNOW HOW WELL THIS MODEL GENERALIZED TO ANY FUTURE DATA THAT WE GIVE IT WE HAVE A HELP OUT TEST SET KNOW GROUND TRUTH BUT MODEL HASN'T SEEN DURING TRAINING WHICH IS REPRESENTED HERE IN SECOND COLUMN WHERE WE MEASURE ACCURACY FOR OUR MODEL THAT REACHES ACCURACY OF ABOUT 95% ON PIXEL LEVEL AND 85% ON A CELL CLASS LEVEL. SO WHAT CAN WE USE THIS MODEL FOR OR WHAT HAVE WE USED IT IN THE LAST YEAR OR SO? WE USED IT TO TEST HYPOTHESES FROM SINGLE-CELL DATA AND SEPARATE GOOD FROM BAD MARKER GENES AND CONFIRM WE ARE COVERING ALL OF THE NEURONS IN THE TISSUE WITH OUR MODEL AND WE COULD CORRECT FOR DISTORTIONS IN SINGLE CELL DATA IN POPULATION SIZES. WE COULD ALSO IMPROVE OUR GENE EXPRESSION ANALYSIS ON A QUALITATIVE AND QUANTITATIVE LEVEL AND DON'T DEAL WITH DROP-OUT PROBLEMS WE HAD IN SINGLE-CELL SEQUENCING. IF IN DOUBT, WE CAN ALWAYS GO BACK TO THE ORIGINAL IMAGE DATA. WE STILL HAVE THIS IMAGE WE STILL KNOW EXACTLY WHERE CELL IS LOCATED AND STILL POSITIVE IS A CERTAIN GENE EXPRESSED IN THAT CELL OR NOT? WE COULD ALSO ADD NORN GENETIC MARKERS TO REMIND YOU THAT WE ARE DEALING WITH PERIPHERAL NEURONS THAT PROJECT ALL OVER THE HEAD TO SUCH DIVERSE TISSUES AS THE EYE AND THE TOOTH AND MENINGES AND SKIN THAT COVERS THE BRAIN. WE COULD ASK WHICH OF THE CELL CLASSES PROJECT TO THE VARIOUS TARGET TISSUES BY INJECTING A NEURONAL TRACE ONTO THE TARGET TISSUES AND ANALYZE WHICH CELL CLASSES ARE ACTUALLY LABELED BY NEURONAL TRACER. PART THAT I'M MOST EXCITING -- EXCITED ABOUT THAT IS STILL ONGOING IS FUNCTIONALLY -- WE ARE NOT REALLY INTERESTED IN TRANSCRIPTIONAL IDENTITY OF THE CELLS PER-SE. WE ARE REALLY INTERESTED IN WHAT THEY DO AND WHAT IS THEIR FUNCTIONAL SIGNIFICANCE. WE ARE CURRENTLY FUNCTIONALLY CHARACTER THEIZING THESE CELLS BY COMBINING IN VIVO CALCIUM IMAGING FOLLOWED BY MULTIPLEX -- AND ANALYSIS I SHOWED YOU AND WE CAN MAP FUNCTIONAL ON TO TRANSCRIPTIONAL CLASSES AND WE ARE MAKING GREAT STRIDES IN THAT. IN SUMMARY, WE HAVE COMBINED MULTIPLEX -- DEEP LEARNING MODEL APPROACH AND IDENTIFY CELL CLASSES INSITU UNDERLYING CELL CLASSES THIS APPROACH SHOULD BE APPLICABLE TO MANY SINGLE CELLED PROJECT AND MULTILEVEL ANTIBODY STAINS SUCH AS SITE IMAGING FOR EXAMPLE AND COULD BE COMBINED WITH NEURONAL TRACES AND WITH FUNCTIONAL CUSTOM IMAGING AND WANT TO MENTION I'M CURRENTLY WORKING ON CONVERTING CODE I WORKED ON FOR THIS PROJECT INTO OPEN SOURCE PYTHON LIBRARY SO OTHERS CAN USE IT THAT WANT TO EXPAND IT AND SOFTWARE END OF THINGS IS ALREADY COVERED TO A LARGE END. AT THIS POINT, I WANT TO MENTION PEOPLE THAT ARE WORKING ON THIS AND OBVIOUSLY I'M COLLABORATING WITH PEOPLE IN THE GROUP THAT I'M IN WHICH IS RIVO LAB HERE AT NIDCR AND GREAT COLLABORATION WITH ALEX'S LAB AT NICH. AT THIS POINT, I WANT TO THANK YOU FOR YOUR ATTENTION AND HAPPY TO TAKE QUESTIONS. THANKS A LOT. >> AUDIENCE: [APPLAUSE]. >> ANY QUESTIONS? VERY NICE TALK. HAVE YOU -- WHEN YOU DID YOUR GOOD VERSUS BAD MARKER ANALYSIS, HOW DID THAT LOOK OR HOW DOES IT LOOK? >> SO IN GENERAL WE CHECKED INDIVIDUALLY IF A GOOD MARKER IS A MARKER THAT DRAWS THE LINE BETWEEN TWO SETS OF CELL CLASSES. TURNS OUT, ACTUALLY IN TRIGEMINAL GANGLION THAT LOTS OF THE CLASSIC MARKERS THAT PEOPLE HAVE USED FOR A LONG TIME ARE ACTUALLY PRETTY BAD MARKERS. ONE EXAMPLE I CAN GIVE IS IM CHANNEL TRIPPY I. ON A BROAD LEVEL YOU WOULD HAVE EXPECTED IT TO BE COVERING FOUR CELL CLASSES OR FOUR MAJOR CELL CLASSES. TURNS OUT IT ONLY COVERS TWO OF THOSE. TWO OTHERS ARE PATCHY. WE HAVE SPORADIC EXPRESSION IN SELECT OTHER CLASSES. >> ALL RIGHT. I'M SORRY. >> JUST ONE MORE QUESTION. HAVE YOU STARTED ANY ANALYSIS OF HUMAN TRIGEMINAL? >> NO. WE HAVE NOT STARTED HUMAN TRIGEMINAL. I DON'T THINK IT IS POSSIBLE TO GET THAT. WHAT WE HAVE STARTED OR WHAT WE HAVE STARTED IN THE LAB IS SEQUENCING HUMAN DNRGS AND A LOT OF SENSORY MODALITIES ARE BETWEEN TRIGEMINAL AND DORSAL GANGLIA IN THE REST OF THE BODY WHICH IS A REALLY EXCITING PROJECT IN THE MOMENT AND STAGE OF SEQUENCING AND SOME SIMILARITIES AND SOME NOTABLE DIFFERENCES AND SOME ARE ALREADY KNOWN. AND WE ARE GOING TO MOVE THAT INTO THAT LARGER CHANNEL IMAGING AS WELL IF WE GET ENOUGH GOOD TISSUE. >> LAST, CAN I ASK A QUICK QUESTION ABOUT ARE YOU TRAINING ALGORITHMS TO BE ABLE AS TECHNOLOGY IMPROVES, WE KNOW THE WHOLE NATURE OF SINGLE CELL RNAC IS GOING TO IMPROVE IN TERMS OF SENSITIVITY. YOU HIGHLIGHTED THAT ISSUE OF DROPOFF. AS PEOPLE START TO USE DIFFERENT TECHNOLOGIES TO USE THE SAME TECHNIQUE AND GET BETTER AND DEEPER COVERAGE WITHIN INDIVIDUAL CELLS, HOW DOES THAT WORK IN TERMS OF YOUR ALGORITHMS COMBINING OLDER DATA OR DATA COLLECTED BY DIFFERENT TYPES OF DIFFERENT TECHNIQUES OR DIFFERENT. >> REALLY, IT IS DIFFERENT KITS AT THE MOMENT. >> YEAH. >> ALGORITHM WORKS ON THE IMAGES NOT ON SINGLE-CELL DATA. >> DEEPER DATA WITH MORE INFORMATION AND. >> YEAH. BETTER TECHNIQUE GETS AND LESS ARTIFACTS THAT WE GET, THE LESS THESE ADDITIONAL STEPS ARE REQUIRED. WE DON'T -- IF WE KNOW OUR DATA IS FOOLPROOF WE DON'T REALLY NEED TO WORRY ABOUT IT ANYMORE. A FEW PROBLEMS JUST STAY WITH RELATION WITH NONGENETIC MARKERS AND ANATOMY IS EXACT SPATIAL AND UNLESS THERE IS TECHNIQUE THAT DISSOLVES THE CELLS RIGHT OUT OF THE TISSUES AND YOU RETAIN SPATIAL INFORMATION AND THEN PUT IT INTO A POT AND ANALYZE IT UNLESS SOMETHING LIKE THIS HAPPENS, I THINK THAT YOU NEED TO BRING IT BACK INTO THE TISSUE WITH A TECHNIQUE LIKE THIS. >> ALL RIGHT. THANK YOU. MOVING ON TO THE NEXT TALK. THANKS AGAIN, DR. LARS VON BUCHHOLTZ. NEXT UP DR. EMIR KHATIPOV. BIOINFORMATICS PROGRAM AT NIDCR AND EXTRA MUIR ALE RESEARCH AND WILL GIVE INTRODUCTION ON DATA SCIENCE AT NIDCR. >> COUNCIL MEMBERS AND GUESTS AND NIDCR STAFF THAT IS PRESENT HERE. NEXT TWO SPEAKERS WILL BE RESEARCHERS SUPPORTED BY NIDCR EXTRAMURAL PROGRAM BEFORE INTRODUCE SPEAKERS TO YOU I WOULD LIKE TO GIVE A BRIEF OVERVIEW OF EXTRAMURAL DATA SCIENCE AT NIDCR AND FOCUS ON THOSE PERTAINING TO -- AS THEY APPLY TO DATA SCIENCES AND NEED TO APPLY DATA SCIENCES AS WE ALL UNDERSTAND AND BIO MEDICAL RESEARCH IS NOT REFLECTION OF SPORADIC PARADIGM BUT RATHER NECESSITY ACCUMULATION OF VOLUME OF DATA OVER MANY YEARS OF RESEARCH COMBINED WITH ACCELERATED DEVELOPMENT HIGH THROUGHPUT TECHNOLOGIES GENERATE DATA WITH EVER INCREASING PAYS. PAVES WAY FOR US TO TACKLE COMPLEX AND MULTIDIMENSIONAL PROBLEMS CAN ONLY BE SOLVED IN ADVANTAGED COMPUTATIONAL APPROACHES INCLUDING ARTIFICIAL INTELLIGENCE TO KEEP UP WITH FAST-PACED DATA SCIENCE REMAIN DATA SCIENCE AT NIDCR FOCUS ON DEVELOPING TRENDS AND PARADIGMS IN DATA-DRIVEN RESEARCH TO DEVELOP A COMPREHENSIVE FUNDING STRATEGY. THE FOCUS OF OUR PROGRAM LIES IN TE FOLLOWING THREE MAIN AREAS. FIRST, WE FOCUS ON A FULL SPECTRUM OF DATA SCIENCE FROM GENERATION SHARING INTEGRATION ANALYSIS AND REUSE OF HIGH-QUALITY DATA FOR RESEARCH, TRAINING, AND CLINICAL APPLICATIONS TO DEVELOPMENT OF ADVANCE AND ROBUST TOOLS DATABASES AND KNOWLEDGE BASES WHILE SUPPORTING LARGER MORE COMPLEX AND MULTIDIMENSIONAL PROJECTS THAT EMPHASIZE VALIDATION WORK AS PART OF RESEARCH STRATEGY AND HIGHLY EQUAL COMPUTATION RESEARCH WORKFORCE IS CRITICAL ELEMENT FOR DEVELOP M OF STRONG DATA SCIENCE SYSTEM. WE ATTRACT MORE BIO[INDISCERNIBLE] AND DATA SCIENCES TO RESEARCH DOMAIN AND ENCOURAGE CLASSICAL BIO MEDICAL COMPUTATIONAL AND DATA SCIENCE APPROACHES IN THEIR WORK. NIHWIDE BIG DATA EFFORTS LEAD US TO ALSO MAINTAIN FOCUS ON COLLABORATIONS WITH OTHER NIH INSTITUTES AND OFFICES INCLUDING OFFICES OF DATA SCIENCE STRATEGY INTRODUCTORY DR. GREGORY GAVE A WONDERFUL PRESENTATION EARLIER TODAY. THESE COLLABORATION LZ AINSTITUTE CONTINUES CONTRIBUTING TO CREATION OF COHESIVE DATA SYSTEM AND TAKES FULL ADVANTAGE OF DEVELOPING INFRASTRUCTURE AND I WOULD LIKE TO DESCRIBE THE TYPES OF DATA AND TYPES OF RESEARCH THAT OUR PROGRAM AND THAT THE -- OUR RESEARCHERS GENERATE AND TYPES OF RESEARCH AND TOPICS THAT OUR PROGRAM FUNDS. NOW, THE TYPES OF DATA ARE KIND OF UNIQUE FOR OUR INSTITUTE BECAUSE THEY COMBINE SUCH THINGS AS MOLECULAR PHYSIOLOGICAL AND MORPHOLOGICAL AND MULTIGNOMICS DATA SUCH AS DNA AND RNA SEQUENCING EPIGENOMICS AND OTHER TYPES OF DATA THESE CONSTITUTE BULK OF WHAT FUNDED RESEARCHERS PRODUCE AND PHENOTYPICAL DATA ARE A SIZABLE PORTION THAT HAS BEEN PRODUCED WHICH IS IMAGING DATA ON PASHL DEVELOPMENT AND DISMORPHOLOGIES AND FACIAL LANDMARKING DATA MIKE ROSS COPY IMAGES AND IMAGING AND OTHER TYPES OF DATA INCLUDE CRITICAL AND HEALTH DATA AND BEHAVIORAL DATA AND WE HAVE AN INCREASED INFLUX OF BIOPHYSICAL DATA SUCH AS SPECK TROMTY HEART ISSUE CHARACTERIZATION AND PORTFOLIO INCLUDES FUNDED RESEARCH IN AREAS MULTIGNOMICS TO IDENTIFY RISK-GENETIC ALLELES AND COMBINATION ANALYSIS RELATED METADATA ELECTRONIC HEALTH AND DATA RECORDS TO IDENTIFY MOLECULAR PATHWAYS DENTAL ORAL AND CRANIOFACIAL. COMPUTATIONAL MODELING TO AIDE IN TREATMENT PLANNING AND OPTIMIZATION AND OUTCOME ASSESSMENT ARE AMONG PROJECTS THAT WE ARE FUNDING AND DEVELOPMENT OF DATA REPOSITORIES AND KNOWLEDGE-BASES IS ALSO A BIG AND SIZABLE EFFORT OF OUR PROGRAM. ONE OF THE PRIME EXAMPLES OF SUCH SYSTEMS AND REPOSITORIES IS PHASE-BASED THAT IS MENTIONED OR ORIGINATE AND COMPREHENSIVE CRANIOFACIAL DATA SOURCE CURRENTLY ENTERED ALREADY THIRD STAGE OF FUNDING WITH AUDACIOUS GOAL OF BECOMING PRIMARY AND TRUSTED DATA RESOURCE FOR CRANIOFACIAL RESEARCHERS NOT ONLY IN THIS COUNTRY BUT WORLDWIDE. TO RESPOND TO CURRENT NEEDS OF OUR CONSTITUENCY, WE ARE FOCUSING ONGOING EFFORTS ON DEVELOPING FUND WILLING INITIATIVES TARGET RESEARCH TOP IBLGS AS ANALYSIS OF EXISTING GENOMIC DATA AND ARE ALSO FUNDING OPPORTUNITY ANNOUNCEMENTS FOCUS ON SPECIFIC AREAS LIKE GENETIC ARCHITECTURE OF CANCER RISKS AND PEDIATRIC DISEASES AND CONDITIONS OR CALL LIKE THE LAST ONE FOR ANALYSIS OF ORAL HEALTH DATA AND DEVELOPMENT OF STATISTICAL METHODOLOGIES AND MANY FRAS ARE DEVELOPED IN COLLABORATION WITH OTHER NI INSTITUTES AND PUBLISH NOTICE SPECIAL INTEREST TO ATTRACT ATTENTION TO PARTICULAR AREAS OF DATA RESEARCH NRCS AS PRIORITY. TO PROMOTE WORKFORCE DEVELOPMENT WE FOUND TRAINING PROGRAMS AND WHETHER SUCH PROGRAMS DEVELOP IN COLLABORATION WITH HGRI AIMS AT SUPPORTING EDUCATIONAL ACTIVITY ENHANCE DIVERSITY OF BIO MEDICAL BEHAVIORIAL SOCIAL AND CLINICAL WORKFORCE IN GENOMICS AND OTHER SUPPORT SHORT TERM ENHANCEMENTS FROM KOREA AND OTHER CITY INVESTIGATORS GOAL OF INVESTIGATORS RESTRAINING IN SERIES TOOLS METHODS APPROACHES IN OTHER SCIENTIFIC AREAS SUCH AS GENOMICS AND GENETICS AND BIO FORMATICS AND COMPUTATIONAL BIOLOGY AS WELL. IMPORTANT FOCUS OF PROGRAMMER IS OF COURSE ETHICAL AND LEGAL AND SOCIAL IMPLICATIONS OF DATA SCIENCE RESEARCH. NIDCR COSIGNS ON RECENTLY PUBLISHED AND NOTICES SPECIAL INTEREST TO AIM SUPPLEMENTARY FUNDING RESEARCH AND BIO ETHICAL RESEARCH AND DEVELOP BASE THAT MAY INFORM FUTURE POLICY DIRECTIONS. INTEREST HERE IS PROTECTION OF PRIVACY CONFIDENTIALITY OF CLINICAL AND NONCLINICAL DATA PARTICULARLY FACIAL IMAGE DATA AND OMICS DATA. OVERALL, WE BELIEVE THAT THE OVERLOOK OF DATA SCIENCE AT NIDCR IS VERY BRIGHT AS WELL AS BRIGHT AND EXCITING AS WE CAN SEE FOR THE WHOLE NIH. WE ENVISION THAT THE TREND WE SEE IN OUR GRANTEES WITH MORE DATA SCIENCE IN THEIR RESEARCH WILL RESULT IN FAIR AND FRIENDLY DATA GENERATION AND ENHANCED RIG OR METHODOLOGIES AND REPRODUCIBILITY OF RESULTS AND RESEARCH PIPELINES ENHANCEMENT EFFICIENCY OF CLINICAL PRACTICE AND CONSEQUENTIALLY OVERALL QUALITY OF HEALTHCARE AND DEEPER DATA INTEGRATION AND IMPLEMENTATION OF STRONG AND ETHICAL AND LEGAL ETHICAL POLICIES PERTINENT TO DATA SCIENCES. WITHOUT FURTHER ADIEU, LET ME INTRODUCE TWO NIDCR-FUNDED RESEARCHERS FUNDED THROUGH THE EXTRAMURAL PROGRAM. OUR SPEAKERS HEAVILY EMPLOY DATA SCIENCE APPROACHES AND MACHINE LEARNING APPROACHES AND I'M SURE YOU WILL GREATLY ENJOY THEIR PRESENTATIONS. FIRST SPEAKER IS DR. ALEXANDER PEARSON WHO WILL TALK ABOUT HIS WORK ON APPLICATION OF DEEP LEARNING TO DETECT CLINICALLY [INDISCERNIBLE] PATHOLOGY FEATURES HE IS A RECIPIENT OF NIDCR'S MENTOR CLINICAL RESEARCH CAREER DEVELOPMENT KO8 AWARD AND QUANTITATIVE SCIENTISTS AND MEDICAL ONCOLOGIST DIRECTS HEAD OF PROGRAM UNIVERSITY OF CHICAGO DEPARTMENT OF MEDICINE AND MAIN FOCUS INTO MATHEMATICAL MODELING FRAMEWORKS AS WELL AS MACHINE LEARNING FOR HEAD AND NECK CHARACTERIZATION AND MANY ACCOLADES HE IS A RECIPIENT OF ACCF [INDISCERNIBLE] AWARD FOR AEARLY CAREER INVESTIGATORS AND NAMED A NEXT GENERATION INNOVATOR IN UNDER 40 CHICAGO SCIENTIST LAST YEAR. OUR SECOND SPEAKER IS DR. LUCIA CEVIDANES WHO WILL PRESENT ON RISK [INDISCERNIBLE] AND PROFESSOR OF DENTISTRY AND ASSOCIATE PROFESSOR OF ORTHODONTICS AT UNIVERSITY OF MICHIGAN AND PRACTICING CLIN ISHL PRODUCED OVER 1453D IMAGES AND ARTIFICIAL INTELLIGENCE AND MANY AWARDS INCLUDING [INDISCERNIBLE] FROM AMERICAN ACADEMY OF ORAL AND MAX ILLO FACIAL RAID YOOLG AND IN WORK STATISTICAL MODELING DATA ANALYSIS AND MACHINE LEARNING TO SOLVE PROBLEMS RELATED TO PATIENT -- RISK PREDICTION OF TMOJ AND NEW TREATMENT PROCEDURES AND WOULD LIKE TO WELCOME DR. PEARSON FIRST AND THEN DR. LUCIA CEVIDANES GOING FORWARD. >> THANKS. IT IS A GREAT HONOR TO BE HERE AND GRATEFUL FOR FUNDING THAT ALLOWED ME TO PRESENT RESEARCH I LOVE AND EXCITED TO SHARE IT WITH COUNCIL TODAY. ALL RIGHT. I HAVE NO CONFLICTS OF INTEREST TO DISCLOSE. CENTRAL HYPOTHESIS I HAVE BEEN WORKING ON IN THIS REALM OF MY RESEARCH IS PATTERNS OF CANCER CELL GROWTH CONTAIN A HUGE AMOUNT OF HIDDEN AND CLINICALLY ACTUAL INFORMATION ABOUT THIS TUMOR INCLUDING GERM LINE MUTATIONS VIRUS INVOLVEMENTS EPIGENETICS AND CLINICAL FEATURES TO BE DERLED RAPIDLY AND ACCURATELY WITH EMERGING DATA SCIENCE METHODS WHICH I WILL TALK ABOUT TODAY. WE WILL TALK -- YOU HEARD SOME OF THE JARGON. I WILL TRY TO DELINEATE SOME OF IT TO HAVE A MORE ACCURATE CONVERSATION WHAT IS DEEP LEARNING AND USING CON -- WHY IS THIS A HOT TOPIC NOW? WHAT ARE SOME DEEP LEARNING APPLICATIONS IN CANCER AND POTENTIALLY OPPORTUNITIES FOR ADDITIONAL COLLABORATION AND I WILL PIVOT A LITTLE TO TALK ABOUT EXPLAIN ABILITY FOR AI, ARTIFICIAL INTELLIGENCE IN ONCHOLOGY OR SO-CALLED OPENING THE BLACK BOX. MEDICAL ONCOLOGIST NAUSEATING TO MAKE TREATMENT ABOUT PATIENTS WITHOUT KNOWING WHAT IS GOING INTO TREATMENT DECISIONS AND TALK ABOUT HOW WE IMPLEMENT PUNITIVE ARTIFICIAL INTELLIGENCE PIPELINE IN MY LAB WITH EYE TOWARDS EVENTUAL CLINICAL APPLICATION WORKFLOW. SO JUST SOME JARGON YOU HEARD TERMS TODAY TO PROVIDE ADDITIONAL CONTEXT MACHINE LEARNING IS FIELD OF STUDY GIVES COMPUTERS ABILITY TO LEARN WITHOUT BEING EXPLICITLY PROGRAMMED. THIS IS A QUOTE THAT AVERAGERS CONCEPT OF MACHINE LEARNING DECADES AGO AND CERTAINLY HAS CONTEMPORARY APPLICATIONS AND NEURAL NETWORKS THAT WE WILL DISCUSS IN A LITTLE MORE DETAIL ARE WEBS OF MANY SIMPLE MATHEMATICAL EQUATIONS THATITIERTIVELY COMBINE AND DISTORT NEW INFORMATION FROM INPUT VARIABLES TO COME UP WITH NONINTUITIVE CATEGORIZING SITUATION AND DEEP LEARNING IS A TYPE OF MACHINE LEARNING THAT USES A SPECIAL CASE OF NEURAL NETWORKS CALLED DEEP NEURAL NETWORKS THAT MORE EFFECTIVELY PROCESS VERY LARGE VOLUME UPS EVER DATA. YOU HAVE SEEN IN TITLES OF TALKS AND ABSTRACTS THAT ARE AVAILABLE AND APPROACHING APPLICATIONS AND DIGITAL IMAGES DEEP LEARNING REFERS TO SPECIAL METHOD DEEP CONFIRMATIONAL TRANSFER LEARNING AND DEEP LEARNING IS SPECIAL [INDISCERNIBLE] CANCER LEARNING WHEN APPLIED TO IMAGE DATA. LOTS OF MIXED USE JARGON BUT TO SAY THERE ARE SPECIFIC DEFINITIONS UNDERLYING EACH OF THESE. ROOKS LIKE WE PICKED SIMILAR FIGURES TO SHOW AND TO SHOW ARTIFICIAL INTELLIGENCE NOT A NEW CONCEPT IS OVERARKING CLASS THAT INCLUDES BOTH MACHINE LEARNING AND DEEP LEARNING AND THIS IS AN EVOLVING FIELD. BLACK BOX WE TALKED ABOUT WITH NEURAL NETWORKS IS FILLED WITH SIMPLE AND FRIENDLY EQUATIONS NO NEED TO EXPLICITLY FEAR IT. COMPONENTS WHAT A NEURAL NETWORK IS YOU MIGHT HAVE SEEN A SCHEMATIC LIKE THIS IN FIGURE 2 IN NATURE MAGAZINE AND WHAT IS THIS REPRESENTING? I WANT TO DETAIL FOR THE AUDIENCE IF YOU ARE NOT FAMILIAR WITH MANIPULATING DEEP NETWORKS WHAT IS EXACTLY HAPPENING HERE. THERE IS AN INPUT LAYER WHICH IS -- OH, YEAH. THE INPUT LAYER THAT IS PART OF NEURAL NETWORK THAT TAKES IN UNDERSTANDING. OUTLIAR AS PART OF NEURAL NETWORK THAT CONTAINS THE THING YOU ARE TRYING TO FIT TO. HERE, WE HAVE AN EXAMPLE THAT A -- WE HAVE AN EXAMPLE WHERE THE -- FIGURE A HAND-WRITTEN FIGURE OF A NUMBER AND WE WANT TO TRY TO FIGURE OUT WHICH NUMBER IS REPRESENTED BETWEEN 1 AND 10. IN THIS SPECIFIC EXAMPLE, WE FED THE AMOUNT OF CONTRAST IN EACH OF THE PIXELS INDEPENDENTLY AS THE INPUT LAYER AND WE PASS THEM THROUGH A SET OF SINGLE EQUATIONS. EACH OF THE LINES REPRESENTS A SIMPLE EQUATION AND LOTS OF DIFFERENT EQUATIONS THAT COULD BE USED OR THINK OF SIGMOIDAL FUNCTION OR A LINE WITH A HINGE FUNCTION OFTEN TIMES WITH ONE SMALL INCREMENTAL VARIABLE THAT DISTORTS THE AMOUNT OF SIGNAL ON THAT PIXEL AND COMBINES IT IN WHAT IS CALLED A HIDDEN OR DEEP LAYER. WHERE -- WHICH TAKES IN INFORMATION FROM EACH OF THE 784 PIXELS POTENTIALLY AND COMBINES THAT THROUGH EACH OF THE FUNCTIONS COMBINES THE WEIGHTS AND HOLDS A NEW VALUE AND ITERATIVELY WE TALKED ABOUT ALGORITHM GRADIENT OF DESCENT WAS DESCRIBED EARLIER. AS WE FIT NEURAL NETWORK COEFFICIENTS DESIGN SIMPLE EQUATIONS ARE ITERATIVELY ADJUSTED AND WEIGHTS ASSIGNED TO EACH OF THE PIXELS ARE INTERTIVELY ADJUSTED AT SEQUENCE TO ONE OF THE NODES. THERE ARE AS YOU CAN IMAGININ THERE ARE MILLIONS OR BILLIONS OR TR TRILLIONS OF EQUATIONS THAT GO INTO FITTING EACH OF THE COEFFICIENTS UNDERLYING A NEURAL NETWORK. COEFFICIENTS ARE ON THE LINES AND WEIGHTS ON NODES AND EACH CIRCLE IS AN EPACK. CAN WE USE THIS CONCEPT OF A NEURAL NETWORK TO QUANTITATIVELY EVALUATE IMAGING DATA? IS THERE SOMETHING OR FEATURES WE CAN BREAK DOWN THE PROBLEM OF CALLING THIS A HOUSE INTO A SIMPLER PROBLEM? WE COULD. WE COULD IDENTIFY FEATURES MORE LIKELY TO BE A FISH OR MORE LIKELY TO BE A HOUSE BY LOOKING AT SMALL SUBPORTIONS OF THIS IMAGE AND THEREFORE SAYING THE BASE WEIGHTS ON NODES THAT DEFINE FEATURES HOUSE LIKE IN OUTLIARS IN THIS EXAMPLE AND EXAM DZ THAT MIGHT BE FISHLIKE IS HOW WE ARE TRYING TO APPLY DEEP LEARNING FOR VISUAL DATA FOR BIOMEDICAL APPLICATIONS. THE KEY WAY TO DO THAT IS TO USE THIS SPECIAL CASE OF NEURAL NETWORKS CONVOLUTIONAL DEEP NEURAL NETWORKS TO EXTRACT DATA ON A SPATIAL SCALE AS WELL AS ON A COMPLEXITY SCALE. BREAKING DOWN TO THE MOST SIMPLE CASE, WHAT WE ARE DOING IS INSTEAD OF APPLYING ONE OF THE SIMPLE EQUATIONS TO JUST ONE PIXEL INPUT AND WE ARE APPLYING AN EQUATION TO 3 BY 3 SQUARE PIXEL INPUT AND DISTILLING THE INFORMATION INTO ONE -- TO ONE DISTILLED COMPONENT FROM THE INPUT SQUARES AND EQUATIONS THAT ARE GOVERNING THE INPUT ARE THE KEY AND ARE FLEXIBLE. THIS MAY BE THE ABILITY FOR US TO WEIGHT THE DIFFERENT SQUARES IS ONE OF THE KEY FACTORS THAT WILL ALLOW US TO IDENTIFY VISUAL FEATURES WHICH YOU CAN SEE THIS IS A VERY SIMPLE EXAMPLE BUT YOU SAW A FIGURE LIKE THIS EARLIER WHERE THE COMPLEXITY OF WHAT THE ACTUAL -- YOU KNOW, WHAT THE NODES -- HOW MUCH INFORMATION IS CONTAINED IN NODES OF DIFFERENT LAYERS OF A DEEP CONVOLUTIONAL NEURAL NETWORK IS EXTENSIVE. THIS IS THE PROCESS, AGAIN, THAT IS ITERATIVELY BACK AND FORTH OPTIMIZED TO ALLOW US TO RECOGNIZE A WRITTEN THREE FROM A SERIES FROM OUTCOMES FROM THE NUMBERS 0 TO 9 USING A DEEP CONVOLUTIONAL NEURAL NETWORK. OKAY. SO A DIFFERENT LAYERS, WHAT IS THE TAKE-HOME AND WHAT IS THE COMPUTER ACTUALLY SEEING IN DIFFERENT LAYERS? IMAGINE THIS NETWORK I SHOWED WITH AN EARLY AND A LATE LAYER. EARLY LAYER ITERATIVELY NEURAL NETWORK IS COMING UP WITH PRETTY ABSTRACT FEATURES. THESE ARE LINES AND GRADIENTS AND MAY BE DIAGONAL SCALING. WHAT WE ARE DOING IS COMBINING THEM INTO MORE RECOGNIZABLE FEATURES. THESE ARE NODES AND EYE. I THINK YOU WOULD AGREE THEY ARE COMING INTO AN ANOTATION-SPECIFIC FEATURE COMPONENT TO FURTHER COMBINE THESE FEATURES AT A DIFFERENT AND DEEPER LAYER OF CONVOLUTIONAL NEURAL NETWORK AND THEREFORE WE SEE FACES RECONSTRUCTED. THIS IS INFORMATION CONTAINED IN DIFFERENT NEURAL NETWORKS TRAINED ON HUNDREDS OF FACES TAKEN FROM THE INTERNET. WE USE BASE COMPONENTS TO BUILD MORE SEQUENTIALLY MORE COMPLICATED REALIZATIONS OF FACIAL RECOGNITION. INDEED, WE CAN USE THE SAME ANALOGY TO BUILD ALL KINDS OF DIFFERENT THINGS AND USE SAME BASE FEATURES AND LINES AND SCALES AND SHADINGS TO BUILD FACES OR CARS OR ELEPHANTS OR CHAIRS AND IN THE CASE OF OUR RESEARCH, TUMORS. SO WITH A LITTLE CONTEXT ABOUT WHAT DEEP LEARNING IS AND HOW IT CAN BE APPLIED TO SPATIAL DATA WHY AM I SEEING AND SO BOOMING NOW WHY ARE THERE 850 ARTICLES IN 2019 ABOUT DEEP LEARNING IN CANCER AND IN 2016 THERE WERE 45? THE ANSWER IS FOUR-FOLD WE WILL DISCUSS. IT IS A PEAK CONFLUENCE OF PEOPLE THAT ASK QUESTIONS. FIRST SUSPECT IS APPLICABLE TO CANCER DATA THAT IS EXPLODING. EXPLODING SCALE YOU SEE WE ARE IN A BOOM TIME WHEN IN TERMS OF AMOUNT OF DATA BECOMING AVAILABLE TO RESEARCHERS LIKE ME FOR ANALYSIS. THE SECOND IS CONTEMPORARY MACHINE LEARNING TECHNIQUES LIKE DEEP LEARNING MAKE EFFICIENT USE OF LARGE SCALE DATA. AMOUNT OF DATA INCREASES DEEP LEARNING IS CAPABLE OF LEARNING AND SDOFTING AND COMING UP WITH SOLUTIONS THAT FIT DATA AND ARE PREVIOUS GENERATION METHODS AND THINK HARDWARE IS MENTIONED BEFORE AND INDEED GP OR GRAPHICAL PROCESSING UNIT IS TYPE OF HARDWARE AND ACTUAL PROCESSER THAT IS ABOUT THIS BIG AND IS CAPABLE OF FITTING A NEURAL NETWORK RAPIDLY AND AS CPU PERFORMANCE HAS PETERED OUT GPU PERFORMANCE PICKED UP NEURAL NETWORK APPLICATIONS AND CONTINUES TO GROW EXPONENTIALLY AND NEAR AND DEER TO MY HEART IS COST EFFECTIVENESS OF DOING DEEP LEARNING IN SMALL SCALE OPERATION LIKE IN ACADEMIC LAB HAS IMPROVED DRAMATICALLY AS COST OF THESE -- RELATIVE COST OF THE GPUS HAS COME DOWN AND ALLOWS HABS LIKE MINE TO ATOWARD TO BUY IN-LAB CUSTOM CODE AND BATCH OUT TO LARGER COMPUTE COLLABORATORS. YOU MAY HAVE SEEN I MENTIOED SOME OF THE EXPLOSIONS AND TRIED TO HIGHLIGHT SOME DEEP LEARNING APPLICATIONS PARTICULAR TO HEAD AND NECK CANCER AND IN MEDICINE IN GENERAL AND YOU MAY HAVE SEEN THIS GROUP FROM YALE WAS ANL TO IDENTIFY SOME OF THE POOR PROGNOSTIC INDICATORS PATHOLOGICALLY DEFINED IN CANCERS STRAIGHT DIRECTLY FROM DIAGNOSTIC CT SCANS AND YOU MAY HAVE SEEN THIS, ONE OF THE FIRST ARTICLES IN THE FIELD WAS ABLE TO IDENTIFY PATHOLOGIC GENE MUTATIONS IN LUNG CANCER AND OUR GROUP WAS ABLE TO IDENTIFY MICROSIDE LINE INSTABILITY IN GASTROINTESTINAL CANCERS AND THOMAS BUKES WHO IS PART OF PGI LEVERAGE MAJORITY OF MEM ORIAL DATABASE TO ACCURATELY TO FIND CANCER VERSUS NONCANCER AND DEEP LEARNING APPLIED TO IMAGING DATA AND LARGE-SCALE CLINICAL DATA DEEP-BASED PREDICTION ALGORITHM FOR TAKING IN LARGE AMOUNTS OF CLINICAL DATA AS IT FLOWS THROUGH HEALTH CARE SYSTEM TO PREDICT KIDNEY INJURY PATIENTS IN THE HOSPITAL. I WANT TO TALK ABOUT A HEAD/NECK SPECIFIC HEAD-NEK CANCER SPECIFIC VIGNETTE HPV DETECTION IT IS A RAPIDLY EXPANDING CANCER-CAUSING AGENT OR OBSERVERIN GEAL IS MOST COMMON HPV RELATED CANCER IN THE WORLD TOP 2 OF THE 3 MOST INCREASING CANCERS ARE POTENTIALLY HPV RELATED AND A NUMBER OF DIFFERENT WAYS TO CALL HPV POSITIVE HPV POSITIVE AND NATIONAL GUIDELINE USES THIS ONE AND IMMUNOCHEMISTRY METHOD P16 AS GOLD STANDARD CLINICALLY AND ACCURACY IS NOW PERFECT AND TAKES SOME ADDITIONAL TIME BUT THERE ARE ALSO OMICKS METHODS THAT SEEK TO CHARACTERIZE PRESENCE OF HPV IN A CANCER AND SHOULD SAY THAT HPV AND NECK CANCER REMAINS UNCLEAR AND WE WANTED TO KNOW CAN WE USE DEEP LEARNING TO IDENTIFY INSTANTANEOUSLY THOSE INDIVIDUALS OR CANCERS THAT ARE VIRALLY MEDIATED IN HEAD/NECK CANCER AND WORKFLOW SHOWN A LITTLE BIT OF THE WORKFLOW HERE AND IN OUR LAB WE CAN TAKE IN THE STANDARD DIAGNOSTIC HEMOTOX ILLIN AND EO STIN STAIN SLIDES AND USE DIGITAL SCANNER TO DIGITIZE GLASS SLIDE IMAGE AND ANNOTATE REGION OF INTEREST ON TUMOR ON SLIDE AND AUTOMATICALLY PARTITION REGION OF INTEREST INTO COMPUTATION ALLEY DIGESTIBLE SUBUNITS WE CALL TILES AND DEEP CONVOLUTIONARY NEURAL NETWORK FOR FUTURE EXTRACTION AND CATEGORIZATION AND ANALYZE THE DATA AND EFFECTIVELY USING THESE DEEP LEARNING FEATURES AS OMICS OF VISUAL DATA AND TRAINING CASE WE USED WAS A PUB KALELELY AVAILABLE BIOREPOSITORIES THAT IS [INDISCERNIBLE] AND USED 418 HEAD/NECK CANCER PATIENTS WITH GENOMICALLY DERIVED HPV STATUS WITH 256 MICROMETER ITALICIZE AND SHOW PERFORMANCE WE GOT WITH THREE-FOLD CROSS VALIDATION AND ANSWER IS THAT WE DID VERY WELL. SO HERE IS THE KIND OF OMIC GOLD STANDARD THAT IS HERE ON AN ROC CURVE THAT IS TRADEOFF BETWEEN SENSITIVITY AND SPECIFICITY ON ANY TEST AND FIRST PASS WAS 400 SAMPLES STRAINED. WE WERE ABLE TO GET .89 FOR EOCROC AND I WOULD SAY SOMETHING ON THE REALM OF .9 IS ALMOST SIGNAL AND APPROACHING CLINICAL APPLICABLE THE AND LOOKED AT THIS COMPARED TO JUST LOOKING AT CLINICAL FEATURES THAT MIGHT PREDICT HPV STATUS SUCH AS AGE AND NODAL CHARACTERISTICS AND WE WERE FAR SUPERIOR TO PERFORMANCE OF THAT AND OBVIOUSLY ANY BIOMARKER REQUIRES VALIDATION AND WORK ON THAT IS ONGOING. THE SO ONE OF THE -- THIS IS ALL WELL AND GOOD THAT WE CAN DETECT THIS IN HIGH ACCURACY AND CONTROLLED SETTINGS AND WE TALK TO OUR COLLEAGUES AND NEED TO KNOW WHAT IS THE MACHINE SEEING CALLING HP POSITIVE AND NEGATIVE AND SOMETHING PATHOLOGISTS AGREE WITH AND SURE IT IS NOT DUE TO DISTORTION AND DATA THAT HAS BEEN FED IN THAT IS A CLUE AND EXAMPLE OFTEN GIVEN IN MACHINE LEARNING IS MACHINE LEARNING TRAINS TO DO WOLVES AND DOGS C SNOW WHICH IS C SNOW IN BACKGROUND IS IDENTIFIABLE AS A WOLF NOT FACIAL MORPH OPTION IT IS CHEATING AND MACHINE ALGORITHMS ARE LAZY AND SEEING RIGHT THINGS AND NOT JUST CHEATING SOMEHO WITH DATA WE FED THEM AND CALL EXPLAIN ABILITY AND WORKING ON NUMBER OF WAYS TO EXTRACT INFORMATION BACK INTO DEEP LEARNING MODEL TO TALK TO PATHOLOGIST COLLEAGUES AND UPDATE THEIR UNDERSTANDING WHAT A CATEGORY IS AND THEY CAN TELL US IF WE ARE DOING WELL. ONE CONCEPT WE ARE USING IS AUTOMATED CONCEPT-BASED EXPLANATION THAT EXTRACTS REGIONS OF MOST INFLUENCES TILES OF DEEP LEARNING HERE ON BOTTOM AND HPV NEGATIVE AND POSITIVE CONCEPTS THAT WERE ACCURATELY DISCRIMINATED AND DIFFERENCE VISUALLY IN HPV NEGATIVE CANCERS COMPARED TO HPV POSITIVE CANCERED AND ANOTHER THING WE HAVE DONE IS TO TRY TO HAVE THE COMPUTER DRAW AS A PICTURE WHAT IT IS SEEING FROM MEMORY EFFECTIVELY GENERAL SHARING OF NEURAL NETWORKS AND THESE TWO THE LEFT AND RIGHT ARE NEURAL NETWORK TRAINED ON HPV DREW AND WHAT COMPUTER THINKS HPV NEGATIVE TUMOR MIGHT LOOK LIKE AND WE DIDN'T DO ANYTHING AND WE ASK IT AND FED IT NOISE. IT DREW US A PICTURE BASED ON THE NOISE AND WE WERE TICKLED BY THESE. THERE IS DEFINITELY SOME -- ONE OF THE THINGS WE TALK ABOUT PATHOLOGISTS ABOUT IN TERMS OF CARROTINIZATION OF THE TUMOR IS NOT WELL REPRESENTED IN THE MACHINE'S USE FOR RECOGNITION. FINALLY, WE USE THAT OMICS OF VISUAL DATA, THAT LAST LAYER OF THE NETWORK THAT MAY BE 2,000 FEATURES LONG, EACH OF THEM DESCRIBING A KIND OF ABSTRACT SIZE OF NODES FROM THE CELL PERSPECTIVE AS IT WERE. WE CAN ANALYZE THAT DATA AND EXAMPLE HERE ABILITY TO PROJECT THAT INFORMATION ON THESE 2 DOZEN IMAGES ON TWO DIMENSIONS AND THEN LOOK AT WHERE DIFFERENT MOLECULAR FEATURES CLUSTER JUST USING THE DATA FROM THE VISUAL SPACE AND INDEED SALIVARIY CANCERS AND THESE ARE FUSION 1 CLASSES AND YOU SEE THAT THE INDIVIDUALS AND DIFFERENT TYPES OF FUSIONS OR THE FUSION DETECTION OUTPUT CLUSTERS PRETTY WELL IN SOME OF THE RARE CANCERS AS DO OUTCOMES WHICH IS REALLY EXCITING AS A CLINICIAN IF WE CAN FIGURE OUT, YOU KNOW, VISUAL VIGNETTE WHICH CORRESPOND TO DIFFERENT OUTCOMES FOR CANCER SUBTYPES AND FINALLY WE CAN MAP THE WHOLE LANDSCAPE OF A CANCER. THIS IS [INDISCERNIBLE] CARCINOMA MAPPED ON THE VARIATION SPACE OF THE TUMOR OF THE POPULATION OF INDIVIDUALS WITH TUMOR. WE CAN SEE THIS IS REALLY THE LANDSCAPE OF A BUNCH OF DIFFERENT TUMORS SOME AREAS ARE HIGHLY GLANDULAR AND SOME ARE DENSED GLANDULAR POCKETS AND SOME WERE MISSED BY ONE OF OUR PATHOLOGISTS OR THE SUBREGION IS A LITTLE BIT OF A MISS AND DOESN'T HAVE A LOT OF CELLULAR TISSUE. WE CAN -- THIS IS WHAT THE MACHINE RECOGNIZES AS VARIATION SPACE AND LOOK AT FEEN OOR TYPES OVERLAID ON REGIONS OF THIS MAP AND FUTURE DIRECTIONS AS I COME TO A CLOSE HERE WE ARE -- ONE OF THE THINGS WE DO IS LEVERAGE DEEP LEARNING TO HELP UNDERSTAND A LITTLE MORE ABOUT RARE CANCERS AND SPECIFICALLY SALIVARIY GLAND CANCERS IS AREA OF MINE FROM POST DOC IN UNIVERSITY OF MICHIGAN'S DENTAL SCHOOL AND IN PROCESS OF BUILDING DATABASE WITH SAMPLES FROM ALL OVER THE WORLD WITH SUPPORT FROM [INDISCERNIBLE] RESEARCH FOUNDATION SO ALL OF THOSE DIGITAL SLIDES GET SENT TO US AND WE CAN PROCESS ALL KINDS OF ABSTRACTLY PROCESS CLINICAL ANNOTATIONS AND GENE EXPRESSIONS AND SO FORTH. IMAGINE THAT A WORKFLOW TAKES A DATA SET AND PAIR WITH A PIPELINE AND HYPERPARAMETER SPACE AND SIT TO AN OUTCOME AND MATCH IT WITH A SPECIFIC ANNOTATION TO UNDERSTAND, S FOR EXAMPLE, IN THIS PLACE, WHAT ARE FEATURES IN SALIVARY GLAND CANCER THAT INCREASED AISLE EXPRESSION CREATE RAPID ACCURATE DIGITAL PATHOLOGY OF CANCER BIOMARKERS IS OUR GOAL. IN MY LAB WE ARE BUILT FOR COLLABORATION WITH EYE TOWARDS THE FACT THAT COLLABORATION IS GOING TO BE THE KEY MOVING FORWARD. WHEN A CLINICAL AI CONCEPT COMES INTO OUR LAB WE MANUALLY SCAN DATA AND QUALITY CONTROL AND HARMONIZE ANNOTATIONS PAIRED WITH IT AND STORE IN A HIPAA COMPLIANT STORAGE AND SEEDED CANCER VERSE NONCANCER DETECTION AND GOOGLE AI AND ASK CLINICAL QUESTIONS AND TEEM OF PATHOLOGY MOON LIGHTERS THAT GET PAID TO ANNOTATE REGIONS OF INTEREST AND WE PAIR THE DATA THAT IS STORED ON STORAGE SYSTEM WITH OUR COMPUTE RESOURCES AND WE RUN INTO AIDSM FOR EACH OF THE PROJECTS WHICH IS SET UP SO CLINICIAN COLLABORATORS CAN COME AND SAY THIS IS WHAT WE THINK ARE THE PROBLEMS AND CLINICAL QUESTIONS WE THINK COULD BE BEST ANSWERED BY AI AND PHYSICALLY COLLOCATE IN AI LAB MEETING TO GET THE BEST INPUT. SO JUST ONE FINAL PLUG. I THINK THIS IS WE ARE AT A CRITICAL JUNK TOO YOU ARE THAT ACADEMICS MAINTAIN LEADERSHIP POSITION AS STAKEHOLDERS IN AI SO IT MAXIMALLY BENEFITS PATIENTS AND UNIQUELY SITUATED TO HAVE DOMAIN-SPECIFIC EXPERTISE IN MEDICINE THAT WILL GUIDE RIGHT QUESTIONS BEING ASKED BASED ON RECORD KEEPING IN MEDICAL CENTERS LARGE SWATHS OF DATA IT IS TOUGH BUT WORTH DOING TO HARMONIZE AND ANNOTATE AND COMPUTE RESOURCES GENERALLY AVAILABLE. THOUSANDS OF RESEARCHERS WE ARE OFTEN TIMES WORKING TOGETHER AND WE HAVE READY-MADE MACHINE LEARNING MAY NOT BE CONTEMPORARY AI BUT WE HAVE PERSONNEL THAT CAN HELP US WITH THIS. THERE IS -- I WANT TO MAKE SURE THAT THE LEADERSHIP AND AI RESEARCH IS NOT DONE BY INDUSTRY BUT SAID LED BY CONDUCTS. WITH, THAT I WILL CLOSE. IF WE HAVE TIME, I CAN ANSWER QUESTIONS IF THERE ARE ANY FROM THE COUNCIL. >> AUDIENCE: [APPLAUSE]. >> YES? >> SO I HAVE A QUESTION ABOUT THE WORK YOU HAVE DONE WITH EXPLAINABILITY. I'M EXCITED ABOUT THE POTENTIAL OF EXPLAINABILITY OF MACHINE LEARNING AND AI AS A TOOL TO IDENTIFY BIAS IN DATA SAMPLES. DO YOU SEE THAT AS A GREAT OPPORTUNITY YOURSELF? >> TO -- I MEAN, WE ARE AT A POINT. YOU KNOW, I THINK THIS FIELD IS REALLY NEW; RIGHT? LIKE IN MARCH, I WAS SITTING WITH A COLLABORATOR AND SAID SOMEONE WILL DO EVERY ALTERATION IN EVERY CANCER SOME DAY AND LIKE MAYBE WE SHOULD DO IT. THEN THERE ARE THREE CONTEMPORARY PREPRINTS OUT IN DECEMBER THAT DID JUST THAT INCLUDING OURS; RIGHT? THE FACT IS WE ARE SO NEW THAT WE ARE ONLY BASICALLY EVERYONE IS AT THE POINT WE ARE LEVERAGING THE SAME DATA SETS AND FACT WE ARE ALL ONLY USING ONE DATA SET. YOU KNOW, IT IS VERY HARD TO ASSESS BIAS BECAUSE WE HAVE ONLY ONE RESOURCE. AS WI BUILD IT, I THINK WE WILL BE -- YEAH. I THINK IT WILL BE ESSENTIAL AND CURRENTLY, YOU KNOW, THERE ARE NO -- TCJ HAS MANY KNOWN BIASES IN IT. RIGHT NOW ENTIRELY OVERREPRESENTED IN EVERY MODEL THAT IS PUBLISHED OUT THERE BECAUSE IT IS THE ONLY DATA YOU RESOURCE. THAT IS WHY BEING A CLINICIAN I HUSTLE TO TRY TO GET GOOD WELL-REPRESENTATIVE DATA SETS BUILT TO REEVALUATE AND DETERMINE WHAT IS THE TRUE REPRESENTATION RATHER THAN WHAT IS THE REPRESENTATION IN TCGA WHICH ARE SEPARATE THINGS. I THINK YOU ARE EXACTLY RIGHT. IT WILL EVENTUALLY BE REALLY HELPFUL TO UNDERSTAND THAT. RIGHT NOW, I THINK WE ARE TOO EARLY IN THE PROCESS TO BE ABLE TO GET AT THAT QUESTION. >> VERY INTERESTING PRESENTATION. MY QUESTION IS TO DO WITH THE REPRESENTATION OF THE TISSUE AND CANCERS ARE NOTORIOUSLY HETEROGENEROUS. HOW DO YOU ELIMINATE BIAS FROM INCISIONABLE DEMARK KADIAN AREA OF INTEREST OR REGION? >> I THINK THERE ARE A COUPLE ANSWERS TO THAT QUESTION. ONE IS WITH MORE DATA. FROM A DATA SCIENTIST IS ALWAYS WITH MORE DATA; RIGHT? AND I THINK IT WILL DEPEND ON -- WE WERE CONCERNED ABOUT THAT. I THINK THAT PARTICULARLY IN SOME SUBTYPES OF CANCER, INFORMATION ON WHETHER DISTORTION WAS UNIQUE TO FNA VERSUS CORE BIOPSY VERSUS EXCISIONAL BIOPSY AND RECISION WILL BE DETECTIBLE AND INFORMATIVE AND COMMON IN PATIENTS THAT HAVE METASTATIC CANCER AND YOU MIGHT CORRUPT YOUR PREDICTOR OF OUTCOME BASED ON TYPE OF CELL DISTORTION THAT BIOPSY HAS BEEN CAPTURED IN. I THINK THAT THERE ARE WAYS TO DO IT AND THEY WOULD BE WHEN YOU ARE CREATING AND GOING TO VALIDATION OF BIOMARKER YOU WANT TO MAKE SURE DATA YOU ARE FEEDING IN PREVAL DAHITION TO BIOMARKER ARE SAME AS YOU WILL RECAPTURE AND WE TRY TO CAREFULLY IN SOME OF THE WORK THAT WE HAVE UNDER CONSIDERATION CURRENTLY WE HAVE BEEN VERY CAREFUL TO VALIDATE IN SPECIFIC SUBTYPES. IF WE HAVE A PUNITIVE DIGITAL BIOMARKER WE LOCKED THE MODEL LOOKING AT VALIDATION WITH BIOPSY SAMPLES WE LOOK AT VALIDATION WITH SURGICAL SAM AND ECT TOPIC SAMPLES FOR EXAMPLE AND MAKE SURE PERFORMANCE DOESN'T FALL OFF A LOT IN EACH OF THE SETTINGS. DILIGENT USE BIOMARKER ON SALIVA AND TRY ON BLOOD HAS TO BE DONE PROSPECTIVELY AND CAREFULLY AND WON'T GET ARN TO SOME OF THE DILIGENT PIECES OF CLINICAL RESEARCH BECAUSE IT IS A NEW METHODS. >> ALL RIGHT. I THINK WE HAVE TO MOVE ON. THANK YOU AGAIN. >> THANK YOU SO VERY MUCH. FOR GUIDANCE PREPARING TO PRESENT TODAY, I WILL WORK ON DATA SCIENCE FOR TEMPOROMAN DIBULAR JOINT AND RISK PREDICTORS AND ARE GRATEFUL FOR OF COURSE THE NIDCR FUNDING. JUST A BRIEF BACKGROUND ON OUR AREA OF INTEREST, AND OUR WORK HAS BEEN CONDUCTED THANKS TO NIDCR RESEARCH ON TEMPOROMANDIBULAR JOINT DISORDERS THAT EFFECT 10 MILLION AMERICANS AND [INDISCERNIBLE] AND FIRST ACTS INVOLVE -- THE SECOND ONE INVOLVES DISPLACED DISCS AND DISLOCATED JAW IN CON DIAL AND DEGENERATIVE DISORDERS IN ARTHRITIS ALSO KNOWN AS ARTHRITIS AND WORK IS IN ALIGNMENT WITH NIDCR2030 GOALS AND INSTITUTE GOALS IN STRATEGIC PLAN TO SUPPORT RESEARCH AND PROCRIES CLASSIFICATION TREATMENT AND IN THIS CASE TEMPOROMANDIBULAR DISORDERS AND CRITERIA TO CLASSIFY THIS CONDITION STARTED WITH RESEARCH DIAGNOSTIC CRITERIA PUBLISHED BACK IN 1992 THAT CONSISTED INITIALLY OF CLINICAL DIAGNOSIS AS A CONTINUATION OF THOSE STUDIES DETAILED PUBLICATION OF THE MAJOR FINDINGS OF ADDITIONAL VALIDATION PROJECT THAT WAS PUBLISHED IN 2010 CULMINATING WITH PUBLICATION OF DR. SHIPMAN IN 2014 THAT CHANGED RESEARCH DIAGNOSTIC CRITERIA TO CLINICAL DIAGNOSTIC CRITERIA FOR TEMPOROMAN DIBULAR DISORDERS AND JOINT DISEASE YOU SEE WITH IMAGING BASED CLINICAL SENSITIVITY WAS .55 IN SPECIFICITY .61 AND WHY IMAGING WAS ADDED AS A CRITERIA WITH CIT OR CPC CRITERIA OF AT LEAST ONE OF THE FOLLOWING [INDISCERNIBLE] OSTEOPHYTES HOWEVER CRITERIA BASED ORN IMAGING DATA SETS THEY HAD CT SCANS OF 1MM THICKNESS. AND OUR RECENT STUDIES ON HIGH RESOLUTION ON CT IMAGING HAVE SHOWN EVEN ASYMPTOMATIC CONTROL SUBJECTS DATA THAT COMES FROM TWO EXPERT RADIOLOGISTS AND ASYMPTOMATIC CONTROL PATIENTS THEY CAN PRESENT OSTEOPHYTES SCLEROSIS AND ARE WE DIAGNOSING WITH IMAGES OR FACT THAT DIFFERENTLY OUR TRIED IS IN THE BIG JOINTS THAT GET MUCH LARGER PERCENTAGE OF FUNDING THAN TMJ ARTHRITIS DOES BUT BONE IN TMJ IS NOT COVERED ABOUT I THICK LAYER OF CARTILAGE THAT IS DIRECTLY BELOW ARTICULAR DISC AND MORE PROMINENT TO BONE CHANGES BUT WHEN ARE THE TMJS DEASYMPTOMATIC IS IT REALLY NOT A DISEASE JUST RADIOGRAPHIC CONDITION THAT WE DON'T NEED TO TREAT IN THE QUESTIONS ON HOW TO PRECISELY CLASSIFY AND PREVENT AND TREAT TMJ ARTHRITIS STILL REMAIN. UNDERSTANDING ARTHRITIS OF TMJ REQUIRES TO DIG DEEPER INTO CROSS-TALK OF PATHWAYS -- BONE OPPOSITION AND OR ABSORPTION AND WE THEN HAVE TO IDENTIFY AND INTEGRATE RISK PREDICTORS OF TEMPOROMANDIBULAR OSTEOARTHRITIS AND IN A PROJECT THAT WE JUST STARTED WHICH WE ARE VERY EXCITED FOR OUR PRELIMINARY WORK BUT PROJECT JUST STARTED LAST SEPTEMBER. AIM 1 IS ON DATA SCIENCE APPROACHED TO IDENTIFY BIOMARKERS FOR TMJ CLASSIFICATION AND FIRST STEP IS DATA ACQUISITION LABELING AND ANNOTATION AND PROPOSE TODAY DEVELOP A SECURE CLOUD STORAGE AND ROBUST COMPUTING WITH IMAGES TOGETHER WITH LABORATORY AND BIOLOGICAL SAMPLES AND CLINICAL EXAMS AND SURVEYS AND DEMOGRAPHIC INFORMATION FOR THE SUBJECTS AND THEY ARE STORED IN A WEB-BASED DATA MANAGEMENT SYSTEM WE CALLED DATA STORAGE FOR COMPUTATION AND INTEGRATION AND WE HAVE ALREADY PRELIMINARY SETUP OF THIS WEB-BASED SYSTEM THAT IS DEVELOPED BY OUR LAB CALLED DENTAL AND CRANIO -- EACH USER CAN CREATE A USER AND LOG IN AND HAVE ACCESS TO SPECIFIC PROJECTS THAT THEY ARE WORKING ON JUST TO SHOW SOME OF OUR PRELIMINARY WORK AND TESTS OF SECURE WEB SYSTEM PLATFORM TO STORE AND COMPUTE DATA ANALYSTIC OF CLINICAL RADIOONOMICS OF BIOMOLECULAR MARKERS. ABOVE HERE IS TAB FOR DIFFERENT PROJECTS AND TAB FOR DIFFERENT CLINICAL DATA THAT IS STORED WITH ALSO CAPABILITY FOR STORING THE DATA FROM MICRORAYS OR PROTEIN ANALYSIS IN SALIVA AND PLASMA FOR PATIENTS AND SAW TAB FOR CLINICAL DATA AND CHALLENGES IN EXTRACTING FEATURES AND RADIOONOMICS FROM EXAMPLE MS OF FEATURES WITH HE SAW ORN DEEP LEARNING BASED ON 2D IMAGES OR PHOTOGRAPHS AND 3D DATA WITH IN TERMS OF IMAGING PART AND 500 SLICES WITH HIGHER RESOLUTION IN THE MUCH LARGER NUMBER OF PIXELS AND WHAT NOT SHOULD BE ANALYZED. DATA PROCESS IN PART OF IMAGE PROCESSING PART CONSISTS FIRST IN ENHANCING THE IMAGING TO THEN SEGMENT BONE AND EXTRACT FEATURES ADDING 3D SHAPE ANALYSIS TO EXPECT TEXTURE FEATURE STATISTICAL FEATURES AND IN SHAPE FEATURES AND CLINICAL FEATURES INCLUDE DIAGNOSTIC CRITERIA FOR TEMPOROMANDIBULAR -- DATA CONSISTS OF CURRENTLY 17 PROTEINS FROM SALIVA IN PLASMA BASED IN PRIMARY WORK IN SYNOVIAL FLUID PUBLISHED IN 2014. FOR FEATURE EXTRACTION RADIIONOMIC DATA THIS IS PRELIMINARY WORK PUBLISHED INSTEAD OF HAVING SUBJECTIVE RADIOGRAPHIC INTERPRETATION FROM RADIOLOGIST TO ABSTRACT FEATURE FRZ GRAY-LEVEL IMAGES ONLY POSSIBLE DUE TO HIGHER RESOLUTION OF THESE SCANS AND THAT IS NOT POSSIBLE FROM LARGE IMAGE VIEW OF IMAGES WE HAD BEFORE THAT SIMPLY DIDN'T HAVE BONE TEXTURE AND THIS WORK WAS SUPPORTED FROM R21 FROM NIDCR AND DATA CAPTURE MANAGING DATA IN CLOUD SYSTEM AND PROCESS DATA NEXT STEP IS IN-DEPTH ANALYTICS. FEATURES ARE SELECTED THROUGH PROCESS OF CROSS-VALIDATION AND THEN WE TEST DIFFERENT MACHINE-LEARNING APPROACH PREDICTIVE ANALYSIS AND INTEGRATE DATA FOR QUANTITATIVE ASSESSMENT. NO THE TO GO INTO MORE DETAIL. SOME COLLEAGUES TALKED ABOUT FROM ARTIFICIAL AND MACHINE INTELLIGENCE IN DEEP NEURAL NETWORKS AND DEEP LEARNING AND CUT SLIDES UPLOADED IN BOX EARLIER. IT DOESN'T NECESSARILY MEAN DEEP LEARNING WILL REALLY GO DEEPER IN TERMS OF PROVIDING ADEQUATE ASSESSMENT OF OUR DATA AND QUESTIONS OF BIAS AND ARTIFICIAL INTELLIGENCE IS ONLY AS INTELLIGENT AS HUMAN CLINICIANS THAT TRAINED ARTIFICIAL INTELLIGENCE AND IF SOME CLINICAL QUESTIONS THAT WE HAVE, IT IS ARE THESE FEATURES BEING EXTRACTED BY A DEEP LEARNING REALLY ADVANCING UNDERSTANDING OF DISEASES WE ARE STUDYING? WE HAVE TO BE VERY CAREFUL ABOUT THAT. IN OUR WORK FOR THE CROSS- CROSS-POLLINATION PART WE EXPECTED 52 FEATURES AND TESTED 1326 INTERACTIONS AMONG THEM. IN DIFFERENT APPROACHES THAT ARE APPLIED BY FEATURE EXTRACTION AND FEATURE SELECTION, THESE ARE GRAPHIC PLOTS OF THE AREA UNDER THE CURVE TO SELECT THE FEATURES TO BE FED INTO THE MACHINE LEARNING APPROACHING AND ONLY AS TASK AND CROSS POLLINATION OF THIS STEP IS THAT WE WILL BE READY TO DEPLOY A MODEL. WE ARE CURRENTLY DOING DATA ANALYSIS AND DATA SCIENCE APPROACH FOLLOWS A SPECTRUM OF PROCEDURE FROM DATA CAPTURE, DATA PROCESSING IN A CLOUD-BASED SYSTEM THAT IS DSCI AND DATA ANALYTICS HERE IN AREA AND CURVE FOR A DIFFERENT PROCESS FOR THIS IS STATISTICAL FEATURE SELECTION WHICH DOESN'T NECESSARILY MEAN THAT THIS MACHINE-LEARNING APPROACHES IS REALLY ADVANCING SCIENCE AND WE ARE TESTING STATISTICAL AND CONVENTIONAL PROCEDURES THANKS TO STATISTIC MODELING EXPERTS IN OUR TEAM. FROM OUR PRELIMINARY STUDIES WE ARE CURRENTLY TESTING INTO MACHINE DIFFERENT MACHINE LEARNING APPROACHES 9 MARKERS AND INTERACTIONS BEFORE WE ARE ABLE TO REALLY BUILD THEM OUT OF. AIM 2 WHICH WE ATTACH PREDICTIVE MODEL OF TMJ OSTEOARTHRITIS PROGRESSION AND IN THE BOX HIGHLIGHTED IN BLUE ARE SURROGATE BIOMARKERS MEANING THOSE ARE MOST SIGNIFICANT FEATURES AND FEATURES FROM TEXTURAL FEATURES FROM IMAGING MARKERS AS WELL AS SHAPED FEATURES TOGETHER WITH CLINICAL MARKERS AND BIOLOGICAL MARKERS THAT HAVE BEEN INDICATED BY OUR PRELIMINARY STUDIES AT THIS POINT AS WE CONTINUE TO COLLECT BASELINE DATA AS WELL AS WE ARE COMPLETING OUR SET TO FOLLOWUP FOR ASSESSMENT AND LONGITUDINAL STUDIES AND AS WE ARE SEEING HERE IN PERFORMANCE CROSS-VALIDATION, YES. WE WILL BE TESTING THESE ARE ALL DIFFERENT MACHINE LEARNING APPROACHES AND DEEP LEARNING IS ONLY ONE OF THEM. WE WILL SELECT THE HIGHEST PERFORMANCE MACHINE LEARNING ALGORITHM HOPEFULLY WITHOUT BIAS. HOPEFULLY. IN THE LAST PART OF MY PRESENTATION I DISCUSSED WITH YOEL AN DAH AND LILIAN ON TELECONFERENCE TO TOUCH ON SIDE IN PERSPECTIVE DATA SCIENCE AND FORMATICS IN DENTISTRY AND EXCITING WORK DONE BY FACE-BASED MANY IMAGES CURRENTLY STORED IN THE DATABASE ARE ANIMAL MODELS AND HUMAN DATA IS PROTECTED HUMAN AND HUMAN DATA [INDISCERNIBLE] IS BASED ONLY ON 3D PHOTOGRAPHS AND 3D PHOTOGRAPHS AND LOTS OF CHALLENGES FROM IMAGE ANALYSIS TO BE OUTED BY FACIAL EXPRESSIONS AND DISTORTION TO HEAD POSTURE AND VARIABILITY AND FACIAL MORPHOLOGY PATTERNS TO POINT THE THIS IS STATISTICAL GROUP FROM FACE-BASED. THEY PUBLISHED THIS EXCITING WORK ON MODELING 3D FARNL SHAPE FROM DNA AND LOOK AT IT FROM A STATISTICAL MODELING PERSPECTIVE, I REALLY RESPECT THE WORK DR. HALGERSOM WAS SAYING AND BASED ON PAPER CHALLENGE IS ARE WE REALLY MODELING 3D SHAPE FROM DNA BASED ON 3D DATA AND PREDICTED SHAPE FROM DNA CAN BE TROUBLING AND DOING ALL THIS STATISTICAL MODELING TASK SIGNIFICANTLY AND STATISTICALLY GENES IN QUESTION THEY ARE BECAUSE GENE QUESTIONS ARE ALREADY KNOWN TO CONTRIBUTE TO HAVE DEVELOPMENT NO ADJUSTMENT FOR MULTIPLE COMPARISONS IS NECESSARY. THIS ASSUMPTION IS HIGHLY PROBLEMATIC AND THESE ASSUMPTIONS WERE BASED FROM COMPARING UP CLOSE TO 600 INDIVIDUALS WITH THOUSANDS AND THOUSANDS OF GENES. OUR WHOLE UNDERSTANDING OF ALL OF THE MATHEMATICS BEYOND ALL OF THE FASCINATING TECHNOLOGY NEEDS TO BE LOOKED AT VERY CAREFULLY AND GOAL IS TO NURTURE QUALITY OF THE PATIENT CARE WITH DIFFERENT TYPES AND CLINICAL AND BIOLOGICAL IMAGING INFORMATION WE HAVE. WITH REGARD TO IMAGING THAT CHALLENGES FOR EXAMPLE WE ARE TALKING ABOUT YES THERE IS A NEED INCREASED DATA SETS AND TEMPORAL MAN DIBULAR JOINT AND IMPLEMENTATION OF LARGE DATA SETS REQUIRED FROM ACQUISITION PARAMETERS FROM DIFFERENT CLINICAL CENTERS STARTED ESTABLISHING WITH ORGAN HEALTH SCIENCES AND NORTH CAROLINA AND ONE OF OUR INTERNS UNDER THE R1 THAT IS WORK -- STARTING TO WORK ON AUTOMATIC SEGMENTATION THAT COUPLE MS DEEP LEARNING WITH DIFFERENT TYPES OF FILTERS. AT THIS POINT, THERE IS NO AVAILABLE ALGORITHM THAT IS GENERALIZABLE AND EXAMPLES OF DIFFERENT PAPERS USING MACHINE LEARNING FOR SEGMENTATION AND THOSE ALGORITHMS WORK ONLY FOR SAMPLES FOR WHICH THEY WERE DEVELOPED. THEY ARE NOT GENERALIZABLE. NEW OPPORTUNITY FOR NEW COLLABORATION WITH US FOR MISH INSTITUTE OF DATA EXCISE FOR IDENTIFYING BIO MARKERS OF TMJ CLASSIFICATION FOR ADDING AUTOMATIC SEGMENT TOOLS THAT WILL UTILIZE NOT ONLY ACTIVE MODELING BUT ALSO DEEP LEARNING FOR THESE IMAGES BUT THAT ARE CHALLENGES BECAUSE CURRENTLY OUR TESTS ARE NOT WORKING WELL FOR LARGE IMAGE THAT HAVE LAST RESOLUTION. ALSO, OUR PREVIOUS WORK IN TERMS OF IMAGE ANALYSIS HAS EMPHASIZED IMPORTANCE OF REGISTRATION OF QUANTITY FICTION THAT IS UTILIZED WHILE OUR PREVIOUS WORK FOCUSED ON OPEN SOURCE TO DEVELOPMENT. THIS IS AN EXAMPLE OF VISUALIZATION OF 3D [INDISCERNIBLE] THAT ARE TOOLS THAT NEED TO BE LOCALLY INSTALLED AND ALL IMAGING PROCESSING APPROACHES AT THIS POINT ARE NOT AUTOMATED AND ARE VERY TIME CONSUMING AND NEED TO BE PERFORMED CASE BY CASE AS WELL AS FOR CLINICIANS WHICH THE MOST RELEVANT QUANTITY FICTION OF 3D CHANGES OVER TIME ARE STILL LANDMARK-BASED. WHEN WE TALK ABOUT SHAPE CORRESPONDENCE AND HAVE DONE WORK WITH AREA COLLABORATION IN GROUP IN NORTH-CAROLINE AH AND [INDISCERNIBLE] IT INCLUDES INTENSIVE COMPUTING AND VARIABILITY AND 3D-SHAPED BY OUR ALREADY PUBLISHED DEEP D LEARNING APPROACHES AND IMPLEMENTATION OF WEP-BASED IMAGE OF PROCESSING ANALYTICS AND INTEGRATION OF FEATURES IDENTIFIED AS DATA APPROACHES ARE -- WITH APPLICATIONS TO ORTHODONTICS IS THE INTEGRATION OF DIGITAL DENTAL MODELS TO ROOT CANAL IN ROOT MORPHOLOGY SEGMENTATIONS WHERE DENTAL ROOTS ARE CONTAINING VERY IMPORTANT INFORMATION THAT CANNOT BE DETECTED JUST BY CROWNS AND FOR EXAMPLE 3D PRINTING AND CLEAR LINERS TECHNOLOGY MIGHT APPEAR EXCITING AND SOME MIGHT HAVE SEEN SMILE DIRECT CLUB POPPING UP IN SOCIAL MEDIA CELL PHONES IF WE LOOK AT AUTOMATIC INFORMATION FROM FUTURE EXTRACTION FROM THE CROWNS THERE IS RISK CLINICIANS WILL MOVE ROOTS OUTSIDE OF THE BONES OR PLANNING INDIRECT POSITION OF IMPLANT PLACEMENT DEPENDING ON IMAGE ANALYSIS WE ARE USING THIS WORK IS POSSIBLE HERE HOPEFULLY WITH CHALLENGE OF TALKING FOR THIS WONDERFUL GROUP AND REPRESENTING ALL OF OUR TEAM THAT WORKS TOGETHER AND LAST MESSAGE IS YES WITH TECHNOLOGY WE CAN DO LOTS OF THINGS AND IS OUR DATA SCIENCE APPROACHES BIG DATA OR MACHINE LEARNING APPROACHES REALLY ADVANCING SCIENCE WE WANT TO DO IN DENTISTRY? MIGHT BE EASY CAN IMAGING TECHNIQUES OR TECHNOLOGY TO MORPH ONE PHASE INTO THE OTHER. DOES THAT ADVANCE OUR FIELD; RIGHT? WE CAN'T DO THAT. ANY QUESTIONS? >> AUDIENCE: [APPLAUSE]. >> THANK YOU. VERY INTERESTING. EMERGING IMAGING MODALITIES AND POSSIBILITIES OF IMAGE INFLAMMATION AND DO YOU THINK THOSE TYPE OF MODALITIES COULD BE USEFUL FOR INPUT INFORMATION? >> CERTAINLY. FUTURE OF IMAGING HAS EVOLVED LARGELY OVER LAST TEFRN TO 20 YEARS AND SOME IMAGING MODALITIES HAVE -- AT SOME POINT WE TALKED AND WOULD REVOLUTIONIZE THE FIELD WITH INFORMATION AT MICROSCOPIC LEVEL HAVE BEEN A CHALLENGE. THEY HAVE NOT HAD ENOUGH PENETRATION OR ABILITY TO IMAGE LARGER FIELDS OF VIEW. IT REMAINS TO BE SEEN WITH ALL OF THE NEW COILS FOR MAGNETIC RESONANCE IF THOSE TYPE OF INFORMATION WILL BE ADDED IN THE COST AND IN COST OF IMAGING OR IMAGING MODALITY WILL BE CHALLENGE TOO FOR APPLICATION IN DENTISTRY. WE HAVE TO WATCH FOR THESE NEW ADVANCES. >> ANY FINAL QUESTIONS? ALL RIGHT. THANK YOU VERY MUCH. I WANT TO THANK ALL OUR SPEAKERS THIS MORNING. IF WE CAN GIVE THEM A ROUND OF APPLAUSE AGAIN, PLEASE. >> AUDIENCE: [APPLAUSE]. >> SO AS OUR COUNCIL MEMBERS KNOW, THERE IS NO SUCH THING AS A FREE LUNCH. IN ADDITION TO IT NOT BEING FREE, IT WILL BE SHORTER. WE AIM TO KEEP TO TIME. SO THE COUNCIL MEMBERS ARE WELCOME TO RETIRE TO ROOM E FOR A SUMPTUOUS LUNCH YOU HAVE PURCHASED. IF YOU DID NOT PURCHASE IT, YOU MAY WANT TO VISIT THE CAFETERIA FIRST OR YOU CAN WATCH EVERYBODY ELSE EAT. FOR NIDCR STAFF, FOR THOSE INVOLVED IN THE CLOSED SESSION, WE DO AIM TO START AT 1.