WELCOME TO THE FRIDAY SESSION OF
THE OCTOBER 2022 OPEN LSTRC
SESSION.
AS A REMINDER THIS SESSION IS
BEING RECORDED.
WE HAVE THE FIRST OPPORTUNITY
THIS MORNING TO RECEIVE THE
DIRECTOR'S UPDATE FROM THE
ACTING DEPUTY DIRECTOR OF THE
INNOVATIONS OF NATIONAL LIBRARY
OF MEDICINE.
>>GOOD MORNING AND THANK YOU
FOR THIS MORNING AND PATTI SENDS
HER REGRETS FOR NOT BEING ABLE
TO BE HERE TODAY.
I ASSUME YOU CAN SEE MY SLIDES,
YES?
>>I CAN CONFIRM THAT.
>>I'M GOING TO TELL YOU ABOUT
THINGS AT NLM AND SOME ARE
ONGOING AND IMPORTANT ADVANCES
IN SOME OF THEM.
THIS IS OUR LEADERSHIP TEAM.
THE FULL TEAM HAS ABOUT A DOZEN
PEOPLE ON IT RIGHT NOW AND ALL
THE POSITIONS ARE HERE AND SOME
ARE IN ACTIVE POSITIONS SUCH AS
MYSELF AND I'LL GET TO THAT IN
JUST A MINUTE.
IN TERMS OF PEOPLE, WE HAVE
THREE NEW NOMINEES FOR THE NLM
BOARD OF REGENTS.
THIS IS OUR ADVISORY BOARD AND
THESE FOLKS WILL BE CONSULTANTS
UNTIL THEY'RE APPROVED AND ALL
THEIR PAPERWORK IS FINISH.
ANDREW CLARK PROFESSOR OF
DEPARTMENT OF MICROBIOLOGY AND
TOGETHERETICS AT CORNELL AND
MITCHELL KATZ AND PHILLIP WALKER
PERFECT THE ESKIND FAMILY
BIOMEDICAL LIBRARY AND WE HAVE
AMANDA WILSON THE NEW DEPUTY
ASSOCIATE DIRECTOR FOR
OPERATIONS AROUND DIANNA'S
RIGHT-HAND WOMAN AND WE HAVE
KEVIN BEING PROMOTED IN OSIS.
FINALLY, WE HAVE A NEW CADRE OF
NLM ASSOCIATE FELLOWS ALREADY
HARD AT WORK ON VARIOUS PROJECTS
ACROSS THE NATIONAL LIBRARY OF
MEDICINE AND WE WELCOME ALL OF
THESE.
I'LL TURN TO POLICY AND
LEGISLATION NEXT.
LIKE ALL PARTS OF THE FEDERAL
GOVERNMENT, THE NATIONAL LIBRARY
OF MEDICINE IS SUBJECT TO
POLICIES, REGULATIONS AND LAWS
FROM VARIOUS PARTS OF THE
EXECUTIVE BRANCH AS WELL AS FROM
CONGRESS AND THE WHITE HOUSE
ITSELF.
AND AT NLM SOME OF THESE THINGS
HAVE VERY SPECIFIC SWAY OVER
RESOURCES AND OPERATIONS FOR
EXAMPLE, CLINICALTRIALS.gov AND
PUB MED CENTRAL ALL HAVE A HEAVY
INFLUENCE OF POLICY AND LAW.
THE NATIONAL LIBRARY OF MEDICINE
ALSO HELPS SHAPE POLICY,
REGULATIONS AND SO FORTH ON
AREAS LIKE SCIENCE AND
COMMUNICATION AND CLINICAL DATA
AND OPEN SCIENCE.
VERY OFTEN, NLM WORKS HAND IN
HAND WITH THE NIH OFFICE OF
SCIENCE POLICY IN SHAPING THESE
THINGS.
BECAUSE OF OUR OUTSIZED ROLE WE
PLAY IN POLICY AND LEGISLATION,
THE NLM HAS CHOSEN TO ENHANCE
ITS PORTFOLIO IN THIS AREA.
WE'VE APPOINTED A DEPUTY
DIRECTOR FOR POLICY AND EXTERNAL
AFFAIRS TO FOCUS ON IMPORTANT
AREAS AND WE HAVE RIGHT NOW
PLANS FOR THE NEW OFFICE OF
POLICY AND LEGISLATIVE AFFAIRS
IN THE NATIONAL LIBRARY OF
MEDICINE POLICY OF THE DIRECTOR.
THE PLANS ARE AT NIH CENTRAL FOR
CONSIDERATION.
KEY POLICY TOPICS INCLUDE THE
SHARING PLAN POLICY IMPLEMENTED
IN JANUARY.
OF COURSE, NLM HAS BEEN WORKING
WITH OSB AND OTHER PARTS OF NIH
TO SHAPE THIS POLICY FOR MANY
YEARS NOW.
RIGHT NOW, FOR EXAMPLE, NLM IS
ENGAGING THE LIBRARY COMMUNITY
IN GETTING PREPARED FOR THEIR
HELP IN IMPLEMENTING THIS POLICY
AT UNIVERSITIES AROUND OTHER
RESEARCH INSTITUTIONS.
ANOTHER HOT AREA IN POLICY IS
DATA SHARING.
AGAIN, THIS IS AN AREA JERRY
SHEEHAN AND OTHERS HAVE BEEN
PLAYING A ROLE IN OVER THE YEARS
BUT RIGHT NOW NCBI IS LOOKING AT
INCREASING ITS GLOBAL ENGAGEMENT
IN THE AREA.
FINALLY, NLM HAS EXPANDED ACCESS
TO RESEARCH RESULTS IN RESPONSE
TO THE MONKEY POX OUTBREAK AND
COVID AND POLIO VIRUS AS WELL
AND WE'RE IN THE PROCESS OF
RESPONDING, NLM, IN CONCERT WITH
THE OFFICE OF POLICY TO THE OSTP
MEMOEN SURING FREE AND EQUITABLE
ACCESS TO FEDERALLY FUNDED
RESEARCH AND I BELIEVE THAT'S
WHAT JERRY WILL SPECIFICALLY
ADDRESS WHEN HE COMES UP ON THE
HOUR.
WE HAVE ALSO BEEN PREPARING FOR
NLM'S FUTURE IN SPECIFIC WAYS.
ONE IS PUTTING IN PLACE VERY
STRONG LEADERSHIP STRUCTURE WE
THINK NOW IS FINALIZED IN TERMS
OF STRUCTURE.
SO STEVE SHERRY WAS DIRECTED AS
DIRECTOR OF NCBI IN THE FIRST
ROLE THE DIRECTOR OF NCBI THE
FOCUS IS ON NCBI AND THE SECOND
ROLE AS AN ASSOCIATE DIRECTOR OF
NLM, THE FOCUS IS ON NLM AS A
WHOLE.
ONE NLM, IF YOU WILL.
RIGHT NOW ACTIVELY SEARCHING FOR
A SCIENTIFIC DIRECTOR.
THIS IS A UNIFIED SCIENTIFIC
DIRECTOR POSITION AS YOU
PROBABLY KNOW WE HAVE AN
INTRAMURAL RESEARCH PROGRAM AT
NCBI AND ONE AT LISTER HILL
CENTER AND HIS WILL OVERSEE BOTH
AND HELP UNIFIED THE PROGRAMS.
RIGHT NOW VALLEY FLORANCE IS
ACTING.
AND WE HAVE THE DIRECTOR OF
EXTRAMURAL PROGRAM AND LOOKING
FOR A DIRECTOR OF LISTER HILL
AND WE WILL BE ALSO SEARCH FOR
THE DEPUTY DIRECTOR OF
OPERATIONS AND INNOVATION, THE
ROLE IN WHICH I'M IN NOW.
AND THE LAST SEVERAL MONTHS WE
HAVE BEEN ADVANCING THE
DIVERSITY, EQUITY AND INCLUSION.
WE DEVELOPED AND SUBMITTED IN
RECORD TIME THE ETHNIC EQUITY
PLAN FOR OUR WORKFORCE, OUR
STRUCTURE AND SYSTEMS.
ENGAGED OVER 40 NLM STAFF TO
MAKE SURE THE TOPICS ARE
ADDRESSED IN OUR OPERATIONS AND
RESEARCH.
WE'VE ALSO HOSTED FIVE TERMS IN
OUR INTRAMURAL RESEARCH PROGRAM
AND CONTINUE TO ORGANIZE THE
ANNUAL NLM SCIENCE TECHNICAL AND
SOCIETY LECTURE SERIES THAT
ADDRESSES HOW DEIA INTERSECTS
WITH RESOURCES AND ACTIVITIES.
WE'RE ALSO INTERESTED IN
CREATING A CULTURE OF CONTINUOUS
INNOVATION AT NLM.
WE ENVISION A 9-12 MONTH
EXERCISE TO STRENGTHEN OUR
POSTURE FOR INNOVATION.
WE HAVE AN ARE RFI TO CONDUCT
MARKET RESEARCH TO INFORM US ON
WHAT'S OUT THERE AND HELP US
INTERNALLY.
IT WAS RELEASED IN BEGINNING OF
SEPTEMBER AND REVIEWED THE
RESPONSES AT THE END OF
SEPTEMBER AND ARE NOW TAKING
STEPS DOWN THIS ROAD.
NEXT I'D LIKE TO FOCUS ON
KEEPING OUR IMPLEMENTATION PLAN
EVERGREEN.
IT STRETCHES FROM 2017 TO 2027.
IT HAS THREE PILLARS ONE IS
RELATED TO RESEARCH AND
RESOURCES TO ADVANCE BIOMEDICAL
RESEARCH.
THE NEXT IS REALLY ABOUT
REACHING PEOPLE WITH OUR
RESOURCES, OPTIMIZING THE OF THE
RESOURCES AND OPTIMIZING OUR
ABILITY TO REACH THE PUBLIC.
AND FINALLY, THE FOCUS IS ON OUR
WORKFORCE.
IN 2016 TO 2017 IN PREPARATION
FOR WRITING THIS STRATEGIC PLAN,
WE HAD LOTS OF STAKEHOLDER
INPUT.
WE HAD A TWO-DAY WORKSHOP AND
HAD HUNDREDS AND HUNDREDS OF
RESPONSES TO FIVE RFIs.
WE DID A LOT, TOWN HALLS,
INTERNAL ANONYMOUS SUGGESTIONS,
ALL KINDS OF INPUT.
WE WERE PLEASED WITH THAT.
AND IN FACT THAT INPUT IS
TRANSLATED TO ABOUT 200
IMPLEMENTATION ACTIVITIES SINCE
2017 BOTH BIG AND SMALL THAT
ALIGN THE STRATEGIC GOALS AND
OBJECTIVES.
BUT SINCE 2017 THERE HAVE ALSO
BEEN SIGNIFICANT CHANGES IN THE
NLM MISSION STATEMENT.
WE WANT TO MAKE SURE GOING
FORWARD OUR IMPLEMENTATION PLAN
ARE ALIGNED WITH CONTEMPORANEOUS
ENVIRONMENT AND SO TO DO THAT WE
WANTED TO MAKE SURE IS THAT WE
HEARD FROM PEOPLE ON THE OUTSIDE
ABOUT MAJOR OPPORTUNITIES AND
CHALLENGES THAT HAVE ARISEN IN
THE LAST FIVE YEARS THAT WE
SHOULD PAY ATTENTION TO AS WE
PLAN NEW ACTIVITIES AS WELL AS
WHAT PEOPLE THOUGHT MIGHT BE ON
THE HORIZON.
WE GOT THE INPUT THROUGH A
FACILITATED SESSION OF OUR BOARD
OF REGENTS THESE ARE PEOPLE THAT
KNOW OUR SPACE AND VERY VALUABLE
AND RECEIVED INPUT FROM THE
PUBLIC.
WE WERE PLEASED TO SEE MUCH OF
THE DIVERSITY OF OUR
STAKEHOLDERS WERE REPRESENTED
AND THE RESPONSES WE RECEIVED
WITH 87 SUBMISSIONS WE PARSED
OVER TO 1,000 SPECIFIC COMMENTS
AND THE BIGGEST THREE
STAKEHOLDERS THAT SUBMITTED
RESPONSES WERE RESEARCHERS,
PROFESSIONAL SOCIETIES AND
LIBRARIANS.
AFTER A DEEP ANALYSIS FROM THE
OFFICE I LEAD BUT NOT ANY MORE
IN MY ACTING ROLE, WE BOILED
THIS DOWN TO A HANDFUL OF TOPICS
THAT ARE THE COMMENTS WE THOUGHT
WE SHOULD PAY ATTENTION TO AND
THESE ARE SPECIFIC COMMENTS.
THESE ARE JUST IS THE BIG
BUCKETS.
I'M PLEASED TO SAY, DIVERSITY,
EQUITY, INCLUSION AND
ACCESSIBILITY WERE EMPHASIZED IN
THE COMMENTS.
IT WAS REFRESHING TO SEE.
IT WAS TERRIFIC.
SO WE ARE NOW TAKING THIS
FORWARD TO THE NLM LEADERSHIP
TEAM.
HOPEFULLY IDENTIFYING BOLD NEW
ACTIVITIES.
WE ARE STARTING WITH THESE THREE
CATEGORIES TO BRAIN STORM
THROUGH AND THINK HOW WE MIGHT
BE ABLE TO ADDRESS THESE GOING
FORWARD.
ARTIFICIAL INTELLIGENCE AND
ALGORITHMS, FINDABILITY AND
DISCOVERABILITY, DIGITAL OBLTS,
SCHOLARSHIP AND RESEARCH AND
TRUSTWORTHINESS OF NLM RESOURCES
WHICH INCLUDE THINGS LIKE DATA
PRIVACY AND SUSTAINABILITY.
WE SEE IMPLEMENTATION ACTIVITIES
IN NLM'S ROLE AS AN EXEMPLAR.
IN OTHER WORDS, PUTTING THESE IN
OUR OPERATIONS.
IF YOU'RE TALKING ABOUT
TRANSPARENCY OF ALGORITHMS,
WHICH OF COURSE RELATES TO
THINGS LIKE BIAS AND SO FORTH,
POSSIBLY, WE WANT TO MAKE SURE
THE ALGORITHMS ARE TRANSPARENT
AND EXPLAINABLE, FOR EXAMPLE.
WE'RE ALSO LOOKING AT
IMPLEMENTING ACTIVITIES IN THE
TOPICS WITH NLM AS A RESEARCH
INSTITUTE FOR INTRAMURAL AND
EXTRAMURAL RESEARCH PROGRAMS AND
ALSO AS A CONVENER ACROSS
DISCIPLINES AND SECTORS TO
ADDRESS SPECIFIC CHALLENGES AND
SEE SPECIFIC OPPORTUNITIES THAT
MIGHT NOT OTHERWISE BE SEIZED OR
ADDRESSED WITHOUT THIS KIND OF
MULTI-SECTOR APPROACH.
AND AS WE THINK ABOUT THE
IMPLEMENTATION ACTIVITIES, WE'RE
ENCOURAGING ONE NLM PERSPECTIVE
ON THESE SO NOT PROGRAM BY
PROGRAM OR DIVISION BY DIVISION
BUT TRYING TO THINK ABOUT HOW
THEY CAN BE PUSHED FORWARD BY
NLM AS AN INSTITUTION.
IN TERMS OF RESEARCH, NLM
INVESTIGATORS HAVE BEEN AWARDED
THE NIH DIRECTOR'S PIONEER
AWARD.
AND INNOVATOR AWARD I'LL TALK
ABOUT IN A MINUTE.
THIS IS A VERY PRESTIGIOUS AWARD
AT THE NIH LEVEL GIVEN TO
SCIENTISTS WITH EXCEPTIONAL
CREATIVITY WITH PROJECTS THAT
ARE EXPECTED TO HAVE A BROAD
IMPACT AND AN NLM INVESTIGATOR
THAT WAS AWARDED ONE IS LOOKING
AT THE SOCIAL IMPACT ALGORITHMS
AND TO EVALUATE ALGORITHMS THAT
MIGHT NEGATIVITY -- NEGATIVELY
AFFECT PATIENTS BEFORE THE
ALGORITHM DEPLOYED.
WE HAVE THE NEW INNOVATOR AWARD
PROGRAM SIMILAR TO THE PIONEER
PROGRAM EXCEPT THIS IS FOR AN
EARLY-STAGE INVESTIGATOR AND
THIS IS MICHAEL BAYLOR FROM THE
UNIVERSITY OF SANTA BARBARA AND
LOOKING AT THE NEXT GENERATION
OF VISUAL PROSTHESIS.
IN ADDITION, IN THE LAST SEVERAL
MONTHS AT THE END OF THE FISCAL
YEAR, WE AWARDED 18
INSTITUTIONAL TRAINING AWARDS
FOR INFORMATICS AND DATA
SCIENCE.
THIS INCLUDES SOME 120 SLOTS AND
60 POST-DOCTORAL TRAINING SLOTS.
YOU CAN SEE THOSE HERE IN BLUE
DOTS ON THE MAP.
AND WHILE RESEARCH EDUCATION
AWARDS FOR ENHANCING DIVERSITY
AND DATA THROUGH AN R25
MECHANISM WHICH APPEAR IN
ORANGE, THE LATTER SET OF AWARDS
IS AIMED AT MASTER'S LEVEL AND
UNDERGRADUATES AND TRYING TO
DEVELOP A MORE DIVERSE SET OF
APPLICANTS ULTIMATELY FOR OUR
RESEARCH EXTRAMURAL RESEARCH
DOLLARS.
TI
FINALLY, IN OUR INTRAMURAL
PROGRAM WE HAVE TECHNICAL
ACHIEVEMENTS THAT ENRICH BIO
MEDICINE AND THE BOARD OF
REGENTS CROSS THIS AWARD THE
HIGHEST HONOR AND THE RECIPIENT
IS A RESEARCH FELLOW IN LISTER
HILL CENTER AND SHE WAS
RECOGNIZED FOR OUTSTANDING
EFFORTS IN DEVELOPING END TO END
ECHO CARDIOGRAPHY AND THIS WORK
IS HAVING IMPACT RIGHT NOW AND
IT'S MOVING FORWARD QUICKLY.
A WORD ABOUT OUR RESOURCES, WE
COULD PROBABLY HAVE 15 SLIDES OF
MAJOR THINGS THAT HAVE HAPPENED
IN THE LAST SEVERAL MONTHS.
THESE ARE JUST A FEW.
DATA SETS WERE MAPPED TO A
COMMON DATA MODEL FROM "ALL OF
US" FROM A NUMBER OF RESEARCH
INITIATIVES THAT GENERATE
CLINICAL DATA.
GEN BANK WAS INSTRUMENTAL IN
RELEASING GENOME SEQUENCES FROM
RECENT OUTBREAKS OF POLIO AND
MONKEY POX AND MESH WAS UPDATED
IN SUPPORT OF THE MONKEY POX
RESPONSE.
THE NIH COMPARATIVE GENOMES
RESOURCE LAUNCHED A NUMBER OF
FUNCTIONALITIES FOR SUBMISSIONS
TO GEN BANK.
AND CLINVAR HAS GENES THAT ARE
IN THE DATA RESOURCE THAT CAN BE
EXPLAINED QUICKLY.
CLINICALTRIALS.gov MODERNIZATION
TEAM HAS ISSUED A BETA WEBSITE
WHICH FEATURES AN ADVANCED
SEARCH TOOL AND A BIBLIOGRAPHY
IS IN RESPONSE TO THE ACTION
PLAN ON LONG COVID.
AND AGAIN SOMETHING THAT'S
EXCITING IS OUR READING ROOM IS
OPEN BY APPOINTMENT STARTING AT
THE BEGINNING OF THIS MONTH.
IN TERMS OF BUDGET, I'LL SAY
THINGS ARE LOOKING GOOD.
WE'RE KEEPING OUR FINGERS
CROSSED, OBVIOUSLY FY23 HAS NOT
PUT INTO LAW YET BUT IF YOU LOOK
AT OUR TRAJECTORY THE ACTUAL
BUDGETS ARE AT THE TOP THE
ORANGE LINE YOU CAN SEE WE'VE
HAD QUITE A GOOD INCREASE OVER
THE LAST FIVE OR SIX YEARS.
WITH THAT I THANK YOU FOR YOUR
ATTENTION AND WOULD BE HAPPY TO
ANSWER ANY QUESTIONS YOU HAVE.
>>THANK YOU, HUERRTA.
ARE THERE QUESTIONS FROM THE
LSTRC COMMITTEE?
I HAVE ONE.
YOU HAD MENTIONED A 9-12 MONTH
PERIOD OF CONTINUOUS INNOVATION.
I WONDER IF YOU MIGHT BE ABLE TO
GIVE US MORE DETAIL ABOUT THAT
AND WHAT THAT MIGHT MEAN OR LOOK
LIKE AT THE END OF THE 12
MONTHS.
>>WELL, I CAN TELL YOU THE
REASON WE'RE DOING THAT.
I CAN'T TELL YOU WHAT IT'S
REALLY GOING TO LOOK LIKE
BECAUSE WE'RE JUST GETTING IT
GOING.
WHAT WE'RE LOOKING TO DO IS TO
BRING IN THE EXTERNAL
CONSULTANTS TO HELP ON THIS.
OBVIOUSLY, WE'RE LOOKING TO DO
THIS BOTH WITH OUR RESEARCH HAT
AND OPERATIONS AND WORK.
I THINK THIS WILL ENGAGE
LEADERSHIP AND THE IDEA HERE IS
TO GET PEOPLE THINKING BEYOND
JUST THE NEXT STEP.
SO WE ALONG WITH EVERYBODY ELSE
HAVE LIMITED RESOURCES BUT THERE
ARE WAYS TO THINK ABOUT
INNOVATION IN TERMS OF
SUBSTITUTING PERHAPS THINGS THAT
YOUR DOING THAT YOU DON'T NEED
TO DO ANY MORE AND OFFSETTING
THAT WITH SOMETHING NEW.
WE'RE LOOKING THIS AT NOT SO
MUCH BRINGING SOMEBODY IN TO
TELL US WHAT TO DO BUT HOPEFULLY
DEVELOP FRAMEWORKS FOR
INNOVATION AND STRUCTURAL AND
PROCESS FRAME WORKS GOING
FORWARD.
>>THANK YOU.
ARE THERE OTHER QUESTIONS FROM
THE COMMITTEE?
ONE OF THE SLIDES YOU
WERE SHOWING YOU HAD THE THREE
PRIORITIES WE WERE THINKING
ABOUT GOING FORWARD FROM THE
RFI.
ONE OF THEM WAS ARTIFICIAL
INTELLIGENCE AND I THINK IT WAS
AUTOMATION.
CAN YOU TALK A LITTLE BIT ABOUT
SOME OF THE THINGS WE MIGHT PUT
FORWARD WITH THAT?
>>WELL, AS I SAID, THE IDEA
HERE IS TO THINK ABOUT THESE IN
TERMS OF NLM AS AN EXEMPLAR SO
IN OUR OPERATIONS AND RESEARCH
WHETHER INTRAMURAL OR
EXTRAMURAL.
THE PRECIPITARECIPIENT OF THE R
AWARD WAS IMPORTANT AND WE WANT
TO LOOK AT MAYBE ARTIFICIAL
INTELLIGENCE AND THAT'S ONE AREA
AND AN AREA HEATING UP ACROSS
THE FEDERAL.
SEARCH IN HHS RIGHT NOW NIH IS
LOOKING TO DEVELOP AN INVENTORY
OF ARTIFICIAL INTELLIGENCE
ACROSS NIH.
THAT'S SOMETHING I'M INVOLVED
WITH AND THEY WANT TO GET A
HANDLE ON WHAT'S BEING DONE.
THERE'S RIGHTS ISSUED BY THE
WHITE HOUSE ON ARTIFICIAL
INTELLIGENCE FOR ALL OF FEDERAL
GOVERNMENT.
THERE'S AN EXECUTIVE ORDER ON
ARTIFICIAL INTELLIGENCE PATTI IS
OVERSEEING IMPLEMENTATION OF
THAT AT NIH, FOR EXAMPLE.
IT'S A HOT AREA AND SHE'S AREAS
OF INNOVATION AND NEW
IMPLEMENTATION ACTIVITIES WE
HOPE WILL BE DEVELOPED BY THE
LEADERSHIP TEAM, NOT BY ME.
AND I'M VERY EXCITED ABOUT WHAT
WE SEE.
>>THANK YOU.
I THINK I CAN DIVE INTO THIS
MORE AND I THINK I TOLD THE
LSTRC ABOUT THIS BUT OVER THE
PAST YEAR WE FLIPPED TO FULLY
AUTOMATING OUR INDEXING OF MESH
TO TITLES AND IT'S EXCITING TO
SEE HOW THAT HAS TAKEN OUR
ACCESS TO THESE CITATIONS
BETWEEN 69 TO 80 DAYS OF BEING
IN THE QUEUE TO BE INDEXED TO
WITHIN 24 HOURS.
AND THE PRECISION AND RECALL ON
THE CITATIONS IS ALMOST AT 90%.
IT'S AMAZING HOW THAT'S HELPED
INCREASE ACCESS TO THESE
CITATIONS AND DISCOVERABILITY BY
ADDING THE MESH TO THEM IN SUCH
A RAPID WAY.
THAT'S A LITTLE BIT OF
AUTOMATION COMING IN THAT I
THINK HAS BEEN A BIG SUCCESS.
>>AND THERE'S BEEN A TALK AT
THE NIH BIOMEDICAL AND
INFORMATICS COORDINATING
COMMITTEE I CHAIR AND THAT HAD
REPRESENTATION ON INSTITUTES AND
CENTERS ON THIS TOPIC AND HE GOT
A LOT OF INTEREST.
HE'S FOLLOWING UP WITH LOTS OF
PEOPLE FROM ACROSS NIH ON THAT.
ONCE AGAIN, NLM IS THE LEADER IN
THIS AREA.
ANY OTHER QUESTIONS?
ALL RIGHT.
>>I DON'T SEE JERRY HAS JOINED
YET.
I DID SEND HIM AN E-MAIL BUT
MIKE, I WANTED TO SAY THANK YOU
FOR JOINING US AND I'LL LET
KELLY FILL THE VOID FOR A FEW
MINUTES.
I THINK WE CAN JUST PAUSE.
WE CAN COFFEE CUP OURSELVES
UNTIL JERRY JOINS.
>>SOUNDS GOOD.
>>WE'LL TAKE A THREE-MINUTE
PAUSE.
>>I THINK WE CAN GET STARTED
WITH JERRY'S PRESENTATION AND I
THINK THERE'LL BE A LOT OF
EXCITEMENT.
>>THANK YOU TO JERRY SHEEHAN
THE DEPUTY DIRECTOR OF POLICY
AND AFFAIRS AT THE NATIONAL
LIBRARY OF MEDICINE HERE TO TALK
ABOUT THE PUBLIC ACCESS RESPONSE
TO THE OSTP MEMO.
>>GREAT.
GOOD MORNING.
IT'S GOOD TO BE WITH EVERYONE
TODAY AND JUST START BY THANKING
YOU AGAIN FOR ALL THE WORK THAT
YOU IN LISTER DO TO KEEP THE
QUALITY AND INTEGRATE OF OUR
LITERATURE INFORMATION RESOURCES
AT SUCH A HIGH LEVEL TO GIVE US
A LOT OF CONFIDENCE IN THE WORK
WE DO.
I KNOW IT HELPS DIRECT THE
EFFORTS AROUND MEDLINE AND HENCE
CONTENT AVAILABLE TO THE PUBLIC
THROUGH PUB MED AND OTHER
SERVICES.
AND I APPRECIATE ALL THE TIME
AND EFFORT THAT YOU PUT INTO THE
INCREDIBLY CAREFUL REVIEW AND
ALL THE WORK THAT LISTER HAS
DONE STRENGTHENING THE PROCESS
AND REVIEW PROCEDURES.
IT'S APPRECIATED ACROSS THE NLM
LEADERSHIP.
I WANT TO CONVEY THAT BEFORE I
GO ON.
I DO HAVE SOME SLIDES I CAN SHOW
BUT MAYBE I'LL JUST START WITH
SOME COMMENTARY.
I KNOW YOU HEARD FROM MY
COLLEAGUE, MY LONGTIME COLLEAGUE
IN A NEW POSITION AS MY
CO-DEPUTY DIRECTOR AT NLM, I
THINK HE GAVE AN OVERVIEW OF THE
EFFORTS TAKING PLACE AT NLM NOW.
I'M GOING TO JUST FOCUS
SPECIFICALLY ON THE NEW OSTP
GUIDANCE THAT CAME OUT ABOUT TWO
MONTHS AGO NOW WHICH MEANS WE'RE
TWO MONTHS INTO A SIX-MONTH
SPRINT OR NIH AND OTHER AGENCIES
AND OUR PUBLIC ACCESS PLANS.
I CAN TELL YOU MAYBE MORE HOW
WE'RE PROCEEDINGS THAN WHERE WE
WILL END UP BECAUSE WE ARE IN
THE MIDST OF THE PLANNING
PROCESS.
I'M GOING TO ASSUME BUT IT'S
NEVER GOOD TO ASSUME THINGS THAT
YOU'RE FAMILIAR WITH THE MAIN
TENETS OR PROVISIONS OF THE NEW
OSTP GUIDANCE.
THE ONE THAT MAY BE OF MOST
INTEREST IS THE PUBLIC ACCESS
PIECE AND THE 12 MONTH EMBARGO
FOR PROVIDING ACCESS TO
PEER-REVIEWED PUBLICATION THAT
RESULT FROM AGENCY-FUNDED AND
NIH-FUNDED RESEARCH.
THE OTHER MAIN ELEMENTS OF THE
MEMO RELATE TO DATA MANAGEMENT
AND SHARING PLANS AND ALSO PUT
IN A PROVISION THAT WOULD
REQUIRE ACCESS TO DATA THAT
RELATES TO A PUBLICATION AT THE
SAME TIME THE PUBLICATION ITSELF
IS MADE AVAILABLE.
I THINK YOU CAN UNDERSTAND SOME
OF THE LOGIC BEHIND HAVING THE
DATA AVAILABLE AT THAT TIME WHEN
THE PUBLICATION'S MADE AVAILABLE
BY THE AGENCIES.
THERE ARE A SET OF OTHER
PROVISIONS, MAYBE TWO OTHER
SETS.
ONE IS UNDER THE RUBRIC OF
SCIENTIFIC INTEGRITY ENSURING
THE INTEGRITY OF THE RECORD AND
INFORMATION ABOUT AUTHORS AND
AROUND THE CONTRACTOR GRANT
UNDER WHICH RESEARCH WAS FUNDED
AS WELL AS SOME OF THE METADATA
AND FOR DIGITAL OBJECT
IDENTIFIERS RELATED TO ALL THE
ASSOCIATED RESEARCH OUTPUTS.
A COMMENT OF NOTE AS WELL IS THE
TIME LINE FOR MAKING PROGRESS ON
THOSE PROVISIONS IS A LITTLE BIT
LOWER THAN THE MAIN ELEMENTS
AROUND THE DATA ACCESS AND
PUBLICATIONS ACCESS.
THAT REFLECTS I THINK THE LOWER
DEGREE OF MATURITY AND CURRENT
AGENCY PRACTICES IN THOSE AREAS.
WE HAVE ALL BEEN IN THE FEDERAL
AGENCY SIDE WORKING ON PUBLIC
ACCESS TO PUBLICATIONS AND DATA.
ARGUABLY SINCE THE 2013 OSTP
MEMORANDUM AND AT THE NIH WE'VE
LOOKED AT THE PUBLIC ACCESS
POLICY IN PLACE SINCE 2008 AND
SINCE WE'VE HAD DATA SHARING
POLICIES IN ONE FORM OR ANOTHER
SINCE ABOUT 2003 OR 2004.
I SEE THERE'S A LINK TO THE OSTP
MEMO AND I CAN PULL UP SEVERAL
PROVISIONS FOR THAT.
THE OTHER ELEMENT I'LL CALL OUT
FROM THE MEMO IS ONE THAT WAS
TAKEN UP A GOOD PART OF OUR TIME
IS ON INTERAGENCY COORDINATION.
THE MEMO ITSELF LAYS OUT IN
ADDITION TO COORDINATING ON THE
IMPLEMENTATION OF PUBLICATIONS
DATA ACCESS AND IDENTIFIER
SCIENTIFIC INTEGRITY TYPES OF
ISSUES LAYS OUT A NUMBER OF
AREAS FOR AGENCIES TO WORK ON
AND THAT PROCESS IS ALSO
UNDERWAY.
THERE HAS BEEN IN ONE FORM OR
ANOTHER PROBABLY SINCE 2010,
2009, INTERAGENCY COLLABORATION
AROUND PUBLIC ACCESS POLICIES.
RECENTLY IN THE FORM OF A
SUBCOMMITTEE OF THE NATIONAL
SCIENCE AND TECHNOLOGY COUNCIL
WHICH BRINGS TOGETHER THE HEADS
OF ALL THE MAJOR RESEARCH
DEVELOPMENT FUNDING AGENCIES IN
THE U.S. GOVERNMENT.
THERE'S BEEN A SUBCOMMITTEE ON
OPEN SCIENCE THAT HAS BEEN IN
PLACE FOR A NUMBER OF YEARS NOW
AND HAS BEEN WORKING ON A
VARIETY OF DIFFERENT ELEMENTS
AROUND INTERAGENCY COORDINATION
AND THAT WOULD BE THE PLATFORM
THAT WE'LL USE FOR
IMPLEMENTATION EFFORTS NOW
RECOGNIZING THAT EVERY AGENCY
FUNDS DIFFERENT AREAS OF
RESEARCH AND HAS DIFFERENT LEGAL
AUTHORITIES AND STATUTORY
AUTHORITIES AND DIFFERENT
SYSTEMS IN PLACE AND BALANCES OF
EXTRAMURAL AND INTRAMURAL
RESEARCH AND WHILE WE EXPECT IT
TO BE TAILORED WE WANT TO TRY TO
BE AS CONSISTENT OR HARMONIOUS
AS WE CAN MOVING FORWARD IN THE
AREAS.
WE AT NIH ARE NOW IN THE PROCESS
OF DEVELOPING OUR PLAN THE OSTP
MEMO CALLS FOR AGENCIES SUBJECT
TO THE 2013 MEMO, THOSE THAT HAD
MORE THAN $100 MILLION IN R&D
EXPENDITURES, REQUIRES US WITHIN
SIX MONTHS TO UPDATE OUR PUBLIC
ACCESS PLANS THEN PROVIDES A
PERIOD OF TIME TO GO FROM THAT
PLAN TO ACTUALLY IMPLEMENTING,
UPDATING, REVISING POLICIES IN
PLACE TO IMPLEMENT THE PLAN WITH
THE NOTION THOSE POLICIES WOULD
TAKE AFFECT NO LATER THAN THE
END OF THE CALENDAR YEAR.
THAT'S 2025.
THE PROVISIONS AROUND
IDENTIFIERS FOR AUTHORS FOR
CONTRACTING GRANTS AND RESEARCH
OUTPUTS ARE FURTHER DELAYED
AGAIN AS I MENTIONED GIVEN THE
LESSER MATURITY AND CONSISTENCY
ACROSS GOVERNMENT AGENCIES IN
WHICH THEY HANDLE THOSE ISSUES.
SO WE ARE NOW WORKING ACROSS NIH
TO UPDATE OUR PLAN.
WE'RE TWO MONTHS INTO A
SIX-MONTH PROCESS.
WE'RE LOOKING AT THE DEGREE TO
WHICH WE NEED TO CHANGE
OPERATIONAL ISSUES AROUND THE
PUBLIC ACCESS POLICY AND THE WAY
THAT WE OPERATE PUB MED CENTRAL
WHICH HAS BEEN THE PLATFORM FOR
PUBLIC ACCESS POLICY NOW SINCE
EARLY DAYS AND I THINK THAT WILL
CONTINUE IT SERVE OUR PLATFORM
FOR POLICY MOVING FORWARD.
WE'RE LOOKING THE DATA
MANAGEMENT AND SHARING
REQUIREMENTS IN THE NEW MEMO.
NOTING AGAIN, LOOKING FOR PLACES
WHERE THEY VARY FROM THE POLICY
THAT IS GOING TO AFFECT AT NIH
STARTING IN JANUARY OF 2023
ANYWAY TO DO NIH DATA MANAGEMENT
AND SHARING POLICY WHICH DOES
INCLUDE GUIDANCE AROUND TIME
LINES FOR MAKING DATA AVAILABLE,
WHICH SEEM TO BE IN ACCORDANCE
WITH THE OSTP GUIDANCE AND DATA
SHOULD BE AVAILABLE AT TIME OF
PUBLICATION AND PROVIDE QUITE A
BIT OF GUIDANCE AROUND
IDENTIFYING DATA REPOSITORIES
THAT MEET CERTAIN
CHARACTERISTICS THAT WOULD
SUPPORT FAIR DATA AND
DISCOVERABILITY DATA AND
INTERONABILITY AND RE-USE OF THE
DATA AS WELL.
AND WE HAVE ANOTHER GROUP
LOOKING AT THE PERSISTENT
IDENTIFIER SECTIONS OF OUR PLAN
WHICH WILL BUILD ON SOME OF THE
WORK THAT THE NIH OFFICE OF
EXTRAMURAL RESEARCH HAS BEEN
DOING AROUND DIGITAL OBJECT
IDENTIFIERS FOR CONTRACTS AND
GRANTS.
WE'RE LOOKING AT SOME OF THE
GUIDANCE THAT CAME OUT FROM THE
WHITE HOUSE ABOUT 10 MONTHS AGO
AROUND AUTHOR IDENTIFIERS AND
WORK AROUND TRAINEES AND LOOK AT
OUR EXPERIENCES AROUND
IDENTIFIERS FOR SESSION I.D.s TO
MAJOR NIH AND NLM DATA
REPOSITORIES TRYING TO FIND MORE
CONSISTENT APPROACHES TO CARRY
THOSE FORWARD IN THE PLAN.
SO WHAT I CAN TELL YOU IS I
THINK WE HAVE A FAIRLY SOLID
BASIS FOR MOVING FORWARD WITH
OUR POLICIES IN THE PLAN.
WE ARE DOING MORE INFORMAL
CONSULTATIONS BETWEEN NOW AND
FEBRUARY WHEN THE PLANS ARE DUE
TO TRY TO TAKE INTO ACCOUNT,
STAKEHOLDER QUESTIONS AND
LOOKING AT FEEDBACK ON OUR
OPERATION TO THINK WHETHER WE
NEED TO MAKE ADJUSTMENTS MOVING
FORWARD WITH THE PLANNING
PROCESS.
MY EXPECTATION IS THE PLAN WILL
BE AVAILABLE FOR PUBLIC COMMENT
IN THE FEBRUARY TIME FRAME.
THAT WILL BE FOLLOWED ON BY MORE
FORMAL POLICY CHANGES AS
NECESSARY TO THE PROCEDURES FOR
PUBLIC FEEDBACK AND RESPONSE
BEFORE POLICY IS ISSUED.
THE MEMO ASKS FOR POLICY TO BE
ISSUED FOR PUBLICATION AND DATA
ELEMENTS BY THE END OF 2024 AND
AGAIN WITH THE EFFECTIVE DATE
FOR THOSE POLICIES BEING THE END
OF 2025.
ON THE PUBLICATION SIDE, WHICH
AGAIN HAS BEEN RECEIVING MOST
THE ATTENTION, RECEIVING QUITE A
BIT OF ATTENTION FROM US AT NIH
AS WELL.
WE NOTE UNDER THE PUBLIC ACCESS
POLICY WHICH HAS A MAXIMUM
12-MONTH EMBARGO PERIOD, WE'RE
ALREADY RECEIVING MORE THAN A
THIRD OF OUR CONTENT WITH NO
EMBARGO ON IT.
THE VAST MAJORITY OF THAT IS
ARTICLES PUBLISHED IN
OPEN-ACCESS JOURNALS BUT DIDN'T
ACCOUNT FOR ALL OF IT.
WE HAVE SOME SUBSCRIPTION
JOURNALS WITH NO EMBARGO PERIOD.
WE CURRENTLY RECEIVE ABOUT
50/50.
HALF THE ARTICLES THAT ARE
SUBJECT TO THE NIH PUBLIC ACCESS
POLICY ARE PROVIDED TO US BY
PUBLISHERS THE OTHER HALF FROM
AUTHORS THEMSELVES THROUGH THE
MANUSCRIPT SYSTEM AND THAT
SHIFTED TO MORE PUBLISHER
DEPOSITS OVER TIME.
WE'RE NOT SHOE -- SURE HOW IT
WILL CHANGE WHEN THE EMBARGO
PERIOD GOES IN EFFECT.
WE'RE IMPRESSED HOW WE'RE
RECEIVING ARTICLES IN ADVANCE
AND CURRENT NIH POLICY WHICH IS
SUBJECT NOT ONLY TO THE OSTP
GUIDANCE BUT WRITTEN INTO LAW
REQUIRES WE MAKE THEM AVAILABLE
AND WE HAVE PROCEDURES IN PLACE
FOR GETTING ARTICLES IN ADVANCE
OF PUBLICATION AND HAVE OTHER
AGREEMENTS WITH PUBLISHERS TO
TAKE ON CONTENT.
WHY DON'T I STOP THERE.
WE'LL DO FURTHER CONSULTATIONS
AS POLICY ROLLS OUT AND I CAN
COME BACK WITH A MORE DETAILED
PLAN ON WHAT WE AIM TO DO AND
TAKE YOUR FEEDBACK THEN BUT
HAPPY TO PAUSE NOW AND TAKE ANY
QUESTIONS YOU MAY HAVE EITHER
ABOUT THE NIH GUIDANCE, SORRY,
THE OSTP OR NIH IMPLEMENTATION
OR THE INTERAGENCY PROCESSES
THAT ARE ONGOING.
>>ARE THERE ANY QUESTIONS FROM
THE COMMITTEE FOR JERRY?
ARE THERE OVERRIDING THEMES FROM
THE PUBLIC YOU'VE GOTTEN OR WHAT
ARE AREAS THERE SEEMS TO BE THE
MOST ATTENTION ON THIS OR WHAT
IS THE PUBLIC SAYING?
>>FROM THE PUBLIC USER SIDE I
SENSE ENTHUSIASM FOR THE POLICY
CHANGES.
WE'VE BEEN SWITCHING TO NO
EMBARGO AND EUROPEAN FUNDERS
HAVE ALREADY MOVED TO NO
EMBARGO.
THERE'S A SENSE THAT IT'S ABOUT
TIME.
SOME QUESTIONS ARE ABOUT
PROCESS.
DOES IT MEAN EVERYBODY NEEDS TO
PUBLISH IN AN OPEN, ACCESS
JOURNAL AND SUBMIT MANUSCRIPTS
OPPOSED TO THE FINAL ARTICLES.
OUR PLAN IS NOT YET DONE BUT IF
WE LOOK AT THE EXPERIENCE WE'VE
HAD OVER THE LAST 15-PLUS YEARS
IT SEEMS LIKE IT WORKS TO BE
OPEN TO OPEN ACCESS AND JOURNAL
ARTICLES AND MANUSCRIPTS AS
WELL.
IT GIVES US AT NIH A GOOD BASIS
FOR MOVING FORWARD.
>>I HAVE A QUESTION ABOUT
JOURNAL ACCESS FEES AND
WONDERING IF YOU'RE ANTICIPATING
INCREASES IN THE FEES BASED ON
THE NEW MANDATE, WHICH I THINK
IS WONDERFUL.
ALSO, IS THERE ANY THOUGHT TO
CAPITATING THE PIECE CHARGED TO
A GRANT?
>>THAT'S A GREAT QUESTION.
IN FACT, I SHOULD ASK YOU ALL
THE FIRST PART.
THIS IS NOW A DYNAMIC PROCESS.
DO WE EXPECT CHARGES WILL GO UP?
DOWN?
I DON'T THINK WE KNOW.
OSTP DID ISSUE AN ECONOMIC
ANALYSIS ASSOCIATED WITH THE
MOVE TOWARDS IMMEDIATE ACCESS.
I THINK IT'S HARD TO ANTICIPATE
WHAT ALL THE CHANGES WILL BE.
WE HAVE SEEN OPEN ACCESS FEES
AND ONLY A FEW ARE EXCEEDINGLY
HIGH.
THERE'S A COMPETITIVE MARKET IN
THE JOURNAL SPACE WELL AND YOU
KNOW IT BETTER THAN I DO AND
WITHIN THE MEDLINE ITSELF,
HEALTH AND RELATES LITERATURE WE
HAVE OVER 6,000 JOURNALS THIS
ARE JUST PART OF MEDLINE AND
REVIEWED AND ACCEPTED AND
APPROVED.
SO SOMETIMES THE ECONOMIST IN ME
SAYS THERE'S A MARKET OUT THERE
AND SO WE'RE GOING TO SEE
ADJUSTMENTS IN PRICE BUT IT
DOESN'T MEAN EVERYBODY'S GOING
NECESSARILY GOING TO INCREASE
AND WE WILL HAVE PUBLISHERS
RESPONDING WITH PRICING AND
SECOND IS IN THE LIBRARY SIDE
WITHIN THE SUBSCRIPTION MODELS
IF MORE CONTENT IS AVAILABLE IN
A PLACE LIKE PUB MED CENTRAL OR
I DON'T KNOW HOW MANY KNOW THE
NAME OF THE NSF PUBLIC ACCESS
REPOSITORY, IF MORE CONTENT IS
AVAILABLE THERE WITH NO EMBARGO
WHICH DOESN'T NECESSARILY MEAN
ON THE DAY OF, WHAT'S GOING TO
HAPPEN TO LIBRARY SUBSCRIPTIONS
FOR JOURNALS AND SOCIETY
JOURNALS IN PARTICULAR ARE A
CONCERN BECAUSE IT SEEMS THERE
ARE MANY THAT WANT TO MAINTAIN
THEIR CURRENT SUBSCRIPTION MODEL
BUT I DON'T THINK WE KNOW YET
WHAT'S GOING TO HAPPEN IN TEMS
OF LIBRARY SUBSCRIPTION BEHAVIOR
AND I DON'T THINK WE REALLY KNOW
WHAT WILL HAPPEN IN TERMS OF
PUBLICATION BEHAVIOR.
I THINK WE'LL HAVE TO TAKE A
STEP FORWARD AND BE ATTENTIVE TO
CHANGES IN THE MARKET AND MAKE
ADJUSTMENTS IN THE TIME AND THE
DATA POLICY ISSUED 18 MONTH OR
SO AGO, WE CONTINUE TO PUBLISH
CERTAIN GUIDANCE HOW TO HANDLE
CERTAIN ASPECTS AND MAY BE THE
APPROACH WE NEED IT TAKE WITH
THE POLICIES AND THE EMBARGO
STARTING THIS DATE AND WILL WE
NEED COST CONTROLS AND OTHERS
AND WE'LL WATCH HOW THE REACTION
SHAKES OUT.
I KNOW WE'RE TIGHT ON TIME BUT
IF YOU ALL HAVE THOUGHTS OR
PERSPECTIVES I'D LOVE TO HEAR
FROM YOU BECAUSE I THINK HAVE
YOU A CLOSE EAR TO THE GROUND ON
HOW LIBRARIES AND PUBLISHERS
MIGHT REACT.
>>JERRY, I APPRECIATE YOUR
RESPONSE TO THE QUESTION AND ASK
COMMITTEE MEMBERS IF YOU HAVE
IDEAS AND QUESTIONS FOR JERRY,
WE'RE HAPPY TO COLLECT THOSE AND
SUBMIT THEM ON.
THANK YOU, JERRY FOR BEING HERE.
WE'RE MOVE TO OUR NEXT SPEAKER
WHO IS CHRISTINA ROBINSON.
SHE'LL GIVE US AN UPDATE IN THE
BETA VERSION OF
CLINICALTRIALS.gov I'LL TURN THE
TIME OVER TO CHRISTINA.
>>THANK YOU FOR THE
INTRODUCTION.
I'M REALLY GLAD TO BE HERE AND
EXCITED TO SHARE SOME
INFORMATION WITH YOU ABOUT OUR
PROGRESS.
AS YOU HEARD MY NAME I'M PRODUCT
OWNER FOR THE BETA
CLINICALTRIALS.gov AND THAT JUST
MEANS I'M LEADING THE TEAM DOING
ALL THE REALLY HARD WORK A QUICK
UPDATE ON MODERNIZATION.
SO THIS PROCESS STARTED IN THE
SECOND HALF OF 2019.
IT'S BEEN A VERY THOROUGH
PROCESS WITH A LOT OF PEOPLE
INVOLVED.
THE PRIMARY AIMS OF DOING SO ARE
REALLY TO IMPROVE THE USER
EXPERIENCE FOR ALL OF OUR USERS.
WE KNOW CLINICALTRIALS.gov HAS
MET THE NEED PRETTY WELL FOR
CERTAIN GROUPS OF USERS BUT NOT
AS MUCH AS SO FOR OUR PATIENTS.
SO WE'RE HOPING IN THE FUTURE
WE'LL MEET THE NEEDS OF ALL THE
USERS REALLY WELL.
WE'RE ALSO UPGRADING THE
TECHNICAL INFRASTRUCTURE.
WE'RE TRYING TO FUTURE-PROOF
OURSELVES AS TECHNOLOGIES
CONTINUE TO ADVANCE AND THE
SPEED AT WHICH THAT HAPPENS
CONTINUES TO INCREASE.
AND OF COURSE WE WANT TO
CONTINUE SUPPORTING EXISTING
LEGAL, REGULATORY AND POLICY
FRAMEWORK AS WE HAVE AND AS
WE'LL CONTINUE TO DO.
THIS IS AN OVERVIEW OF THE
MODERNIZATION EFFORT.
WE SPENT THE FIRST YEAR ENGAGING
STAKEHOLDERS AND USERS.
THE BOARD OF REGENTS NOW HAS A
DEAD DATED WORKING GROUP FOR THE
PROCESS AND HAVE DONE A REQUEST
FOR INFORMATION IN 2019 AND WE
REFER BACK TO THE RFI FREQUENTLY
BUT HAVE DONE ADDITIONAL USER
RESEARCH, INFORMATIVE RESEARCH
IN THE BEGINNING AND INTERVIEWS
AND USABILITY TESTING THROUGHOUT
THE PROCESS.
IN YEAR TWO WE SPENT DEVELOPING
THE FIRST VERSIONS OF OUR
PRODUCTS BOTH THE WEBSITE AND
OUR DATA SUBMISSION PORTAL
CALLED PRS.
IN THE THIRD YEAR, WE'VE
CONTINUED TO DO IMPROVEMENTS TO
THE THINGS WE HAD RELEASED WITH
THAT FIRST VERSION OF THE
WEBSITE BUT WE'RE CONTINUING TO
ADD NEW FEATURES AND IMPROVE THE
FUNCTIONALITY THAT'S ALREADY
THERE AND IN YEARS FOUR AND FIVE
WE'LL CONTINUE THE PROCESS.
I'LL TALK MORE ABOUT WHAT'S
COMING LATER IN MY TALK.
SO THERE IS THE SUMMARY PROGRESS
REPORT FOR THE FIRST TWO YEARS
OF THAT MODERNIZATION EFFORT.
THAT'S ALREADY AVAILABLE ON THE
CLINICALTRIALS.gov.
IN THE MODERNIZATION SECTION OF
THE WEBSITE.
WE DO HAVE A '21-'22 REPORT THAT
WILL BE AVAILABLE SHORTLY SO
KEEP AN EYE ON THE WEBSITE FOR
THAT.
SO HERE'S A QUICK OVERVIEW OF
THE WORK THAT WE'VE DONE OVER
THE LAST ROUGHLY 10 MONTHS TO
THE BETA WEBSITE.
WE RELEASED THE FIRST VERSION OF
THE WEBSITE IN DECEMBER OF LAST
YEAR AND HAD THREE RELEASES
SINCE THEN AND WILL CONTINUE TO
RELEASE TO THE FUTURE AND I'LL
GET IN THE TIME LINE MORE BUT WE
MADE IMPORTANT FEATURES
AVAILABLE.
WE HAVE WHAT WE'RE CALLING NOW
ENHANCED SEARCH.
YOU'LL SEE THAT IN A
DEMONSTRATION SHORTLY.
THE TABULAR VIEW OF THE SEARCH
RESULT WASN'T AVAILABLE WITH OUR
INITIAL LAUNCH OF THE WEBSITE.
WHAT WE PUT OUT WAS WHAT WE CALL
A MINIMAL VIABLE PRODUCT, AN
MVP, JUST THE BASIC
FUNCTIONALITY OF THE WEBSITE AND
CONDUCT A SEARCH AND SEE THE
SEARCH RESULTS AND DO A STUDY
RECORD AND NOW YOU CAN DO A
COMBINATION OF THE BASIC AND
ADVANCE SEARCH.
THE TABULAR VIEW WASN'T THERE
AND WE KNOW THAT'S IMPORTANT FOR
GENERAL EDITORS AND DATA
RESEARCHERS.
THE SEARCH RESULTS DOWNLOAD AND
WE CONTINUE TO MAKE IMPROVEMENTS
AND NOW WE HAVE THE PAGE WHERE
YOU CAN SEE WHAT'S BEEN CHANGED,
WHAT'S RELEASED AND WHAT'S BEEN
IMPROVED WITH EACH UPDATE TO THE
WEBSITE.
THIS IS THE PROCESS THAT WE'RE
FOLLOWING FOR DEVELOPMENT OF THE
BETA WEBSITE.
WE MADE THAT AVAILABLE AGAIN IN
DECEMBER OF LAST YEAR AND THAT
IS AVAILABLE IN PARALLEL TO THE
CLASSIC CLINICALTRIALS.gov.
AND WE'RE NOW IN THE SECOND
PHASE YOU SEE HERE.
WE'RE CONTINUING TO ADD FEATURES
TO THE BETA WEBSITE.
WE'RE GOING CONTINUE IMPROVING
UNTIL ALL THE FEATURES WE KNOW
USERS NEED ARE THERE.
THIS ISN'T ONE AND DONE.
MODERNIZATION IS JUST A REALLY
STRONG APPROACH TO IMPROVING THE
CLINICALTRIALS.gov.
WE'LL CONTINUE IMPROVING AND
ENHANCING AS WE HAVE SINCE
CLINICALTRIALS.gov WAS LAUNCHED.
WE'LL CONTINUE MAKING THOSE
IMPROVEMENTS AND A LOT OF THAT
IS BASED ON USER FEEDBACK AS IT
COMES IN ON THE USABILITY
TESTING I MENTIONED EARLIER.
THE FIRST PHASE WOULD BE TO MAKE
THE BETA WEBSITE PRIMARY AND
WHEN YOU CLICK IN BROWSER,
CLINICALTRIALS.gov, YOU'LL SEE
THE NEW CLINICALTRIALS.gov.
THE CLASSIC WEBSITE WILL STILL
BE AVAILABLE IN PARALLEL TO THE
NEW WEBSITE.
SO FOR USERS WHO AREN'T QUITE
COMFORTABLE USING THE NEW SYSTEM
YET, THEY CAN GO BACK TO THE OLD
SYSTEM.
AND WE WANT TO MAKE SURE THAT
THIS IS A PROCESS THAT WE GIVE
TIME TO USERS TO MAKE THAT
TRANSITION TO GET COMFORTABLE
WITH THE NEW WEBSITE.
WE WANT TO MAKE SURE THEY HAVE
THE MAJORITY OF THE
FUNCTIONALITY THEY NEED ON THE
NEW WEBSITE BEFORE THAT'S THE
ONLY WEBSITE THEY CAN USE.
AS YOU SEE, THE LAST STEP IN
MODERNIZATION WHICH IS QUITE A
BIT DOWN THE ROAD FROM THIS
POINT IN TIME IS TO ACTUALLY
RETIRE THE CLASSIC
CLINICALTRIALS.gov.
AND WITH THAT I WANT TO DO A
BRIEF DEMONSTRATION OF THE
WEBSITE SO I DID WANT TO JUST
SHOW QUICKLY THAT YOU CAN GO TO
THE CLASSICAL CLINICALTRIALS.gov
AND YOU'LL SEE A YELLOW BANNER
ACROSS THE TOP MEANT TO CAPTURE
USER'S ATTENTION AND WE'LL
CONTINUE TO MAKE CHANGES AS WELL
TO DRIVE MORE AND MORE TRAFFIC
TO THE BETA WEBSITE.
WE'D LOVE TO MAKE SURE THAT
USERS ARE SEEING IT.
THAT WE'RE GETTING LOTS OF
FEEDBACK AND THAT EVERYONE HAS
AMPLE OPPORTUNITY TO PROVIDE
INPUT.
WE WANT TO MEET USERS' NEEDS AS
BEST WE POSSIBLY CAN AND WANT TO
DO THE MAJORITY OF WORK TO
MODERNIZATION BEFORE IT'S
"THE" WEBSITE OR THE
"ONLY" WEBSITE AND VISIT
CLINICALTRIALS.gov AND ENCOURAGE
YOUR COMMUNITIES AND COLLEAGUES
TO DO SO AS WELL.
SO MOVING RIGHT ALONG, SO THIS
IS WHAT THE BAY -- BETA
CLINICALTRIALS.gov LOOKS LIKE.
YOU'VE SEEN SIGNIFICANT CHANGES
TO THE USER INTERFACE.
IT'S MEANT TO BE MORE
WELCOMINGS, -- WELCOMING AND
EASIER TO DIGEST AND WELCOMING
PEOPLE INTO THE EXPERIENCE.
AS YOU SCROLL DOWN, YOU COME TO
THE NEW SEARCH.
THIS IS PRETTY EXCITING.
IT IS FULLY CUSTOMIZABLE AND
ACROSS THE TOP WE HAVE WHAT WE
CALL AN ACTION BAR.
YOU CAN SELECT THE FIELD THAT
YOU WANT TO USE TO BUILD A
SPECIFIC QUERY.
YOU CAN ADD ALL THE FIELDS IF
YOU WANT TO EXPLORE WHAT'S
AVAILABLE OR RESET TO THE
DEFAULT WHICH IS WHAT YOU SEE
HERE AND THE SEARCH BUTTON IS
OUT TO THE RIGHT.
FOR THE PURPOSES OF THIS
DEMONSTRATION I WANT TO SHOW YOU
THAT ALL THE FIELD ARE
AVAILABLE, ALL THE FIELDS
AVAILABLE IN THE ADVANCE SEARCH
ON THE CLASSICAL
CLINICALTRIALS.gov AND A FEW
OTHERS.
FOR THE PURPOSES OF THIS
DEMONSTRATION I'M GOING TO LOOK
FOR STUDIES THAT HAVE RESULTS
AND THEN ARE FUNDED BY NIH.
IF YOU WANT TO CLOSE ANY OF
THOSE YOU CAN OUT HERE TO THE
RIGHT.
YOU'LL SEE AS YOU ENTER A SEARCH
YOU GET RECOMMENDATIONS.
WE HAVE OPERATORS ALREADY
AVAILABLE AS YOU CAN SEE HERE IN
OUR SAMPLES.
YOU'LL GET AUTOSUGGEST QUERIES
AS WELL.
YOU CAN PICK FROM THE LIST OF
RECOMMENDATIONS.
CURRENTLY THE INITIAL LIST OF
THE RESULTS IS THE CARD VIEW.
ONE OF THOSE OPPORTUNITIES TO
GIVE FEEDBACK AND YOU'LL SEE
HERE IN THE LEFT-HAND PANEL WE
HAVE ALL THE SAME FIELDS
AVAILABLE TO CONTINUE REFINING
YOUR SEARCH TO FIND EXACTLY THE
STUDIES THAT YOU'RE INTERESTED
IN.
WE AGAIN THE ACTION BAR ACROSS
THE TOP.
YOU'LL SEE THERE IS DOWNLOAD
FUNCTIONALITY.
IN CSB AND JASON AND YOU'LL SEE
THE MOST COMMONLY USED DATA
FIELD FOR DOWNLOAD AND YOU CAN
SELECT ALL THESE AND IN JASON
YOU CAN DOWNLOAD ALL PUBLICLY
AVAILABLE AND THOSE USED MOST
FREQUENTLY.
WHAT I WANT TO GO INTO IS SHOW
THE TABLE VIEW.
WE HAVE AN EDIT SEARCH AND
YOU'LL FIND THE SAME CRITERIA.
YOU CAN SELECT THESE TO SAVE THE
STUDIES OF INTEREST AND THIS HAS
A HORIZONTAL SWIRL.
WE DON'T CURRENTLY HAVE THE
ABILITY TO CUSTOMIZE WHICH
COLUMNS ARE VISIBLE BUT THAT'S
COMING SHORTLY.
SO, LET ME GO INTO A STUDY TO
SHOW A LITTLE BIT OF WHAT'S
AVAILABLE IN THE STUDY RECORD.
YOU'LL SEE THE OVERVIEW OF THE
STUDIES SUCH AS THE STATUS,
TITLE, RESPONSIBLE PARTY, THE
NCT NUMBER, CLINICAL TRIAL
IDENTIFIER AND BECAUSE WE KNOW
IT'S IMPORTANT FOR JOURNAL
EDITORS AND OTHER RESEARCHERS
AND DATA SUBMITTERS, WE HAVE
THAT ABOVE THE TABS OF THE STUDY
SO YOU CAN CONTINUE TO FIND THAT
INFORMATION REGARDLESS OF WHERE
IN THE STUDY RECORD YOU ARE.
THE LEFT SIDE WE PUT A LEFT-HAND
PANEL NAVIGATION.
WE HAVE THIS DOWNLOAD AND ACTION
BAR ACROSS THE TOP.
AGAIN, CSC, JSON AND WE HAVE
FIRE JSON AVAILABLE AND WE DID
THIS TO MAKE DATA
INTEROPERABILITY EASIER AND WE
ARE COLLECTING INPUT TO SEE IF
WE SHOULD CONTINUE DOWN THIS
MATH.
LET ME GO AND SHOW A LITTLE BIT
OF INFORMATION.
THIS IS ONE OF THE NEW FEATURES
IN THE BETA WEBSITE.
IF THE STUDY WERE STILL
RECRUITING YOU'D HAVE CONTACT
INFORMATION, A CENTRAL CONTRACT
AND/OR CONTACT INFORMATION FOR
THE ACTUAL STUDY SITE.
CLICKING ON A SITE IN THE LIST
WILL ADJUST THE MAP.
AND CLICKING HERE WILL TAKE YOU
TO THE LIST IF THERE WERE MANY
SITES AVAILABLE.
LET ME MOVE ON TO THE RESULTS.
I WANT TO SHOW QUICKLY SOME OF
WHAT WE HAVE AVAILABLE IN THE
RESULTS TAB.
SO YOU WILL SEE THAT WE HAVE
THESE AVAILABLE HERE.
AGAIN, YOU CAN DISMISINFORMATION
-- DISMISS INFORMATION THAT
MAY NOT BE HELPFUL AND GO
THROUGH THE RECORD.
IN THE BOTTOM RIGHT-HAND CORNER
THERE'S A BUTTON IT TAKE YOU TO
THE TOP OF THE PAGE IF YOU WANT
TO NAVIGATE TO ANOTHER RECORD OR
DIFFERENT PART OF THE WEBSITE.
AND I WILL GO BACK TO OUR TOP.
THIS IS A HIGH-LEVEL OVERVIEW OF
THE FEATURES WE HAVE EITHER
ALREADY COMPLETE FORD THE BETA
WEBSITE.
SOME WE HAVE IN PROGRESS YOU'LL
SEE HERE WE'RE MAKING SOME
CHANGES -- WE'LL MAKE AVAILABLE
A TABULAR VIEW OF THE STUDY
RECORD.
WE KNOW THAT'S IMPORTANT TO
JOURNAL EDITORS AND DATA ERS.
THE STUDY RECORD HISTORY.
THAT'S SOMETHING WE HEARD SO FAR
HAS REALLY MET USER'S NEEDS
WELL.
WE WANT TO START THERE AND BUILD
ON THAT PROGRESS AND HOPEFULLY
MAKE IT A BETTER EXPERIENCE.
WE'RE DOING CONTENT MIGRATION.
WE WILL BE DEVELOPING AND
MIGRATING SUPPORT MATERIALS FOR
USING THE SEARCH AND THEN A
LITTLE BIT DOWN THE ROAD WE'LL
MAKE AVAILABLE THE BETA VERSION
OF THE API DOWNLOAD TO XML
CONNECTIONS TO TRUSTED HEALTH
INFORMATION, NEXT STEPS TO JOIN
A STUDY AND ON FOR USERS.
CURRENTLY WE KNOW MANY USERS
DON'T COME TO THE HOME PAGE.
THEY'LL DO A VERBAL GOOGLE
SEARCH FOR A PARTICULAR DISEASE
STATE, ILLNESS, INJURY, WHAT
HAVE YOU AND LAND ON THE STUDY
RECORD PAGE.
WE WANT USERS TO KNOW REGARDLESS
OF HOW THEY COME TO THE WEBSITE,
WHERE THEY ARE AND WHAT THEY CAN
ACCOMPLISH HERE.
SO AS I SAID BEFORE, THIS IS A
PROCESS.
IT'S AN ITERATIVE PROCESS.
WE'RE GOING TO CONTINUE BUILDING
ON THE PROGRESS WE'VE MADE.
TO THAT END WE'RE LOOKING FOR
OUR OWN PARTICIPANTS TO HELP
IMPROVE THE BETA CLINICAL TRIALS
WEBSITES AND WE'RE LOOKING FOR
JOURNAL EDITORS AND DATA
SUBMITTERS AND ALL THE FOLKS YOU
SEE LISTED HERE TO HELP US
IMPROVE THE EXPERIENCE.
WE WANT TO MAKE SURE THAT THEY
CAN DO ALL THE THINGS THEY NEED
TO ACCOMPLISH ON THE WEBSITE.
THERE'S A VARIETY OF ACTIVITIES
THAT VOLUNTEERS CAN TAKE PART
IN.
SOME ARE ASYNCHRONOUS ACTIVITIES
THAT MAY TAKE 15 MINUTES.
SOME ARE INTERVIEWS THAT CAN
TAKE UP TO AN HOUR.
AND WE ENCOURAGE YOU TO
VOLUNTEER YOURSELF OR CERTAINLY
TO SHARE WITH YOUR COLLEAGUES
AND YOUR COMMUNITIES SO THAT IF
THEY'RE INTERESTED THEY CAN ALSO
PARTICIPATE AND I WILL SHARE
EXACTLY HOW TO DO THAT.
THROUGHOUT THE WEBSITE, YOU WILL
SEE A GREEN GIVE FEEDBACK
BUTTON.
FOR ANYONE INTERESTED IN
PARTICIPATING IN GIVING MORE
DETAILED INPUT, THEY CAN ENTER
IN THE COMMENT FORM THEIR
CONTACT INFORMATION AND LET US
KNOW THEY'RE INTERESTED IN
CONTRIBUTING.
FINALLY, WE'RE TRYING TO REALLY
GET THE WORD OUT THAT
CLINICALTRIALS.gov IS CHANGE.
WE DON'T WANT TO CATCH ANYONE BY
SURPRISE BUT WE DO TALK TO A
GROUP OF USERS.
WE LEARN SOMEONE DIDN'T KNOW
THAT MODERNIZATION WAS HAPPENING
OR MAYBE THEY DIDN'T KNOW THAT
WE MADE SOME OF THE CHANGES WE
HAVE.
SO WE'RE GOING TO CONTINUE
BUILDING AND GETTING THE WORD
OUT THERE SO THAT EVERYONE IS
COMFORTABLE AND READY TO USE THE
NEW CLINICALTRIALS.gov WHEN THAT
BECOMES THE PRIMARY WEBSITE.
AND WITH THAT, I WILL PAUSE AND
TAKE SOME QUESTIONS.
>>THANK YOU, VERY MUCH,
CHRISTINA.
THIS IS FANTASTIC WORK.
AS MY RESEARCHER COLLEAGUES AND
I REALLY APPRECIATE THE AMOUNT
OF CUSTOMIZATION AND FEATURES
OFFERED HERE IN THE BETA SIDE.
THANK YOU FOR THAT GOOD WORK.
ARE THERE ANY QUESTIONS FROM THE
COMMITTEE MEMBERS?
>>I HAVE A QUESTION.
I'M INTERESTED TO HERE WHAT THE
INTEROPERABILITY AND THE LINKING
BETWEEN PUB MED AND
CLINICALTRIALS.gov, IF YOU CAN
SPEAK TO THAT A LITTLE?
>>ABSOLUTELY.
CURRENTLY, THE JOURMS THAT ARE
AVAILABLE IN THE STUDY RECORD WE
HAVE THREE TYPES OF JOURNALS
AVAILABLE, MANUSCRIPTS, EXCUSE
ME, THEY'RE HYPERLINKED TO THE
PUB MED VERSION OF THE ARTICLE.
WE DID ALSO AUTOMATICALLY INDEX
TO ANYTHING THAT INCLUDES THE
NCT NUMBER AND WE HAVE GENERAL
PUBLICATIONS MADE AVAILABLE BY
THE DATA SUBMITTERS.
THEY CAN DESIGNATE PUBLICATIONS
RELATED TO RESULTS OF THE STUDY
AND THE WE AUTOMATICALLY INDEX
FROM PUB MED BASED ON THAT NCT
NUMBER.
>>WITH THE AUTOMATIC INDEXING
USING NCT NUMBERS, IS THERE ANY
OTHER AUTOMATIC INDEXING OR IS
THE INFORMATION COMING FROM THE
P.I.?
ARE YOU RELYING ON THE P.I. FOR
THAT INFORMATION?
>>YES, WE DO PRIMARILY RELY ON
THE DATA SUBMITTERS.
CURRENTLY THE NCT NUMBER IN PUB
MED IS THE ONLY AUTO-INDEXING
WE'RE DOING.
WE HADN'T TALKED ABOUT OTHER
POSSIBILITIES.
THERE'S A MACHINE-LEARNING
PORTION OF THE MODERNIZATION
PROCESS BUT THEY HAVEN'T GOTTEN
TO THAT POINT EITHER.
AS PART OF THE VALUE-ADD TO
BEING A MEDLINE TITLE IN PUB MED
WE DO HAVE A DATA REVIEW GROUP
THAT LOOKS FOR
CLINICALTRIALS.gov NUMBERS THAT
MAY HAVE BEEN MISSED IN THE
AUTOMATION OR SOME OF THE
SUBMISSIONS THAT MAYBE DIDN'T
HAVE IT.
SO WITH DO GO IN AND TRY TO MAKE
SURE WE'RE CAPTURING THAT FOR
THE INTEROPERABILITY.
>>I HAVE ANOTHER QUESTION.
DO YOU HAVE YOUR IDEA WHAT YOUR
USER GROUP LOOKS LIKE IF IT'S
PRIMARILY RESEARCHERS OR
PATIENTS LOOKING TO PARTICIPANT
IN A CLINICAL TRIAL?
DO YOU HAVE ANY IDEA?
>>I'M SORRY, I LAUGH A LITTLE
BIT BECAUSE IT'S SOMETHING WE'VE
KNOWN FOR A QUITE A WHILE AND
INTERESTING CHALLENGE TO TRY TO
MEET THE NEEDS OF THESE DIVERSE
GROUPS.
IT'S AN EVEN SPLIT WHEN THE
PATIENTS ON ONE HAND AND PATIENT
GROUPS, CAREGIVERS, PATIENT
ADVOCATES, MEMBERS OF THE PUBLIC
AND THEN ON THE OTHER HAND WE
HAVE THE DATA RESEARCHERS AND
DATA SUBMITTERS.
I'VE TAKEN MORE SO TO CALLING
THEM RECORD OWNERS DRIVING HOME
TO WE DON'T OWN THE DATA, WE'RE
PART OF A LIBRARY.
SO THE RECORD OWNERS IN THAT
CASE.
IT'S ALMOST AN EVEN SPLIT IN
TEMS OF THE TWO SIDES OF THAT
COIN.
AND SO IT'S INTERESTING -- IT'S
A REALLY INTERESTING CHALLENGE
AND THERE'S A LOT OF TENSION
BETWEEN THE NEEDS OF THOSE
GROUPS.
ON THE ONE HAND THE PATIENT
USERS WANT THE INFORMATION ABOUT
THE STUDY SITES.
WE KNOW THEY COME WANTING TO
JOIN A STUDY.
AND THEY FIND IT REALLY
DIFFICULT TO GET FROM --
DIFFICULT TO FIND A STUDY THAT
THEY'RE INTERESTED IN AND MIGHT
BE ELIGIBLE FOR AND THEN TO
ACTUALLY JOIN THE STUDY.
THAT'S A REALLY BIG HURDLE FOR
THEM TO OVERCOME.
MEANWHILE THE DATA SUBMITTERS
ARE LIKE GIVE ME AS MUCH AS
INFORMATION ABOUT AS MANY
STUDIES AS YOU CAN.
TRYING TO MEET THE NEEDS IS
TOUGH BUT IT'S BEEN A REALLY
INTERESTING AND FUND CHALLENGE
AND I THINK WE'RE HOPEFULLY
FINDING A GOOD BALANCE BETWEEN
THOSE NEEDS.
>>THANK YOU FOR THE QUESTION
AND RESPONSE.
DIANE HAS A QUESTION.
>>SO THANK YOU.
SO ONE OF THE THINGS YOU HAD
TALKED ABOUT WAS HOW AND WE FIND
THIS WITH ALL OF OUR PRODUCTS
THAT PEOPLE GO INTO A SEARCH
ENGINE AND THEY LAND INTO OUR
RESOURCES THAT WAY.
SOME OF THE COMMENTS THAT WE'VE
GOTTEN FROM SAY THE BOARD
WORKING GROUP WAS ARE YOU
CONSIDERING ANY TERMINOLOGY TO
HELP MAPPING ACROSS SOME OF OUR
RESOURCES TO HELP USERS WITH
DISCOVERABILITY OF OTHER
PRODUCTS AT NLM?
>>ABSOLUTELY.
WE DO MAKE AVAILABLE A COUPLE
THINGS I DIDN'T POINT OUT DURING
THE ACTUAL DEMONSTRATION.
SO IN THE STUDY RECORD WE DO
POINT TO MED LINE RESOURCES.
THAT'S ACTUALLY IN THE STUDY
OVERVIEW TOWARDS THE TOP OF THE
STUDY RECORD.
DOWN AT THE BOTTOM WE HAVE THE
MESH TERMS AS WELL.
THOSE AREN'T LINKED IN THE BETA
WEBSITE BUT HOPE TO DO THAT IN
OUR NEXT ROUND OF ENHANCEMENT TO
THE STUDY RECORD.
WE'RE POINTING TO SOME OF THOSE
OTHER NLM RESOURCES.
>>CHRISTINA, THANK YOU VERY
MUCH FOR COMING AND FOR YOUR
PRESENTATION.
AGAIN, IT'S EXCITING TO SEE THE
CHANGES AND THE PROGRESS AND TO
SERVE MULTIPLE STAKEHOLDER
GROUPS.
WE'LL MOVE TO WRAP UP AND I
BELIEVE DIANE HAS SOME
ANNOUNCEMENTS.
I'LL TURN THE TIME OVER TO YOU.
>>THANK YOU.
I WANT IT THANK OUR COMMITTEE
MEMBERS FOR YOUR ENGAGING
QUESTIONS AND FEEDBACK.
IT'S ALWAYS INTERESTING TO GET A
DIFFERENT PERSPECTIVE ESPECIALLY
FROM THIS COMMITTEE.
WE ALWAYS LOOK FORWARD TO
SHARING UPDATES WITH YOU AND WE
DO APPRECIATE THE FEEDBACK AND I
WANT TO THANK MY COLLEAGUES FOR
PROVIDING INFORMATIVE UPDATES TO
OUR COMMITTEE MEMBERS TODAY.
SO BEFORE WE CLOSE THIS OPEN
SESSION, I WANT TO ACKNOWLEDGE
THE RECEIPT OF A WRITTEN COMMENT
FOR THE LITERATURE SELECTION
TECHNICAL REVIEW COMMITTEE
SUBMITTED BY THE SCIENCE POLICY
PROGRAM MANAGER WITH THE
PHYSICIAN'S COMMITTEE FOR
RESPONSIBLE MEDICINE.
THE WRITTEN COMMENT WAS SHARED
WITH ALL THE COMMITTEE MEMBERS
THIS MORNING AND WILL BECOME
PART OF THE OFFICIAL MEETING
FILE.
THANK YOU FOR THE FEEDBACK AND
THE COMMENT SUBMISSION.
WITH THAT, I'M GOING TO TURN IT
BACK IT OUR CHAIR, DR. SANDBERG
AND I THINK WE CAN GO RIGHT INTO
OUR BREAK AND THEN INTO OUR NEXT
PART OF OUR CLOSED SESSION FOR
REVIEWS.
>>THAT SOUNDS GREAT.
THIS CONCLUDES THEN THE OPEN
SESSION OF THE OCTOBER 2022
LITERATURE SELECTION TECHNICAL
REVIEW COMMITTEE AND UNLESS
ANYONE HAS OBJECTION LET'S
REASSEMBLE AT 11:25.
IS THAT AMENABLE?
OKAY.
11:25.
THANK YOU.