GOOD EVENING. I AM JOSH DUBERMAN, AN INFORMATION AND RESEARCH LIBRARIAN HERE AT THE NIH LIBRARY IN THE CLINICAL CENTER. SOUTH ENTRANCE OF THE CLINICAL CENTER, WE ARE NOT THE NATIONAL LIBRARY OF MEDICINE. THE NATIONAL LIBRARY OF MEDICINE IS ONE OF THE 27 INSTITUTES AND CENTERS THAT COMPRISE THE NATIONAL INSTITUTES OF HEALTH. WE'RE THE STAFF LIBRARY. I'M SPEAKING ABOUT SOME OF THE PRODUCTS FROM THE NATIONAL LIBRARY OF MEDICINE LATER IN THIS LECTURE. INCOMPLETE LITERATURE SEARCH CAN HAVE DISASTROUS CONSEQUENCES IN CLINICAL RESEARCH. IN 11, A HEALTH -- 2001, A HEALTHY TECHNICIAN NAMED HELEN VOLUNTEERED AS A NORMAL RESEARCH SUBJECT IN A JOHNS HOPKINS UNIVERSITY STUDY. SHE VOLUNTEERED IN THE DEPARTMENT FOR WHICH HE WAS A TECHNICIAN. GIVEN HEX MA THEMIAN BY INHALATION TO PRODUCE BLOW AID AND SIMULATE ASTHMA. SHE DEVELOPS INCREASINGLY SEVERE LUNG PROBLEMS AND DIES. ED. HEXAMETHONIUM TOXICITY WASN'T UNCOVERED BY THE PRINCIPLE INVESTIGATORS LITERATURE SEARCH DESPITE WHAT THE JOHN HOPKINS INVESTIGATORS LATER SAID WAS A STANDARD PUBMED SEARCH, AND THEY CONSULTED THE -- THE INVESTIGATOR CONSULTED STANDARD CURRENT EDITIONS OF PHARMACOLOGY AND MEDICINE TEXT BOOKS. THE INTERNAL INVESTIGATION IS LISTED HERE AND I'M GOING TO BE QUOTING FROM SOME PIECES OF IT. ALSO HERE IS AN ARTICLE IN THE JOURNAL OF MEDICAL ETHICS THAT TALKED ABOUT THIS WHOLE DEBACLE. WHAT HAPPENED WAS THAT ALL RESEARCH WAS -- AT JOHNS HOPKINS, ONE OF THE LARGEST RESEARCH INSTITUTES IN THE UNITED STATES. IT WAS ALL SHUT DOWN FOR MORE THAN A MONTH, PROBABLY TWO MONTHS. WHEN THEY OPENED, AGAIN, THEY REQUIRED INCREASED RESEARCH OVER SOCIETY, THEY REQUIRED INVESTIGATORS TO COLLABORATE WITH A LIBRARIAN AND A PHARMACIST TO STRENGTHEN LITERATURE SEARCHES AND HELP SEARCH APPROPRIATE DATABASES FOR POTENTIAL SIDE EFFECTS. THEY WERE GUIDELINES ESTABLISHED AT JOHNS HOPKINS AND ELSE WHERE AND I HAVE A REFERENCE TO MT. SINAI SCHOOL OF MEDICINE GUIDELINES THAT IF WE HAVE TIME, I'LL TAKE A LOOK AT LATER IN THE LECTURE. THIS EVENING IN THIS LECTURE, I WANT TO PRESENT AN OVERVIEW OF CLINICAL INFORMATION RESOURCES WITH CAPABILITIES AND ILLNESS TO MORE INFORMATION. IT IS OLENGTHS TO MORE INFORMATION. CHARACTERISTICS, QUESTION TO ASK, AND I WANT TO TALK ABOUT PUBMED AND ALSO EMBASE. HOW MANY HEARD ABOUT EMBASE? AND OTHER DATABASES, FREE AND SUBSCRIPTION BASED. INTERNET SEARCH NINES AND OTHER INFORMATION RESOURCES, SEARCH TIPS AND ISSUES TO CONSIDER WHEN CONDUCTING OR REQUESTING A LITERATURE SEARCH. THE EXAMPLE HERE IS SEARCHING FOR ADVERSE EFFECTS IN PROTOCOL DEVELOPMENT. BUT IT'S APPLICABLE TO MANY OTHER TOPICS IN CLINICAL RESEARCH, AND I'VE LISTED SOME OF THE RELEVANT CHAPTERS IN THE TEXTBOOK, THE PRINCIPLES AND PRACTICE OF CLINICAL RESEARCH BY GALLIN AND OTHERS. CHAPTER 3, 10 IN PARTICULAR, I WOULD LIKE TO POINT OUT THIS IS AN UNANTICIPATED CLINICAL RESEARCH WHICH DESCRIBES A PROBLEMATIC CLINICAL RESEARCH -- CLINICAL TRIAL HERE AT THE NIH IN THE 1990s, I ALSO HAVE A LINK TO THE INSTITUTE OF MEDICINE'S WRITE UP OF REVIEW OF THAT PROBLEMATIC TRIAL. AND THEN CHAPTER 32, WRITING A PROTOCOL. I DON'T WANT TO GIVE YOU THE IMPRESSION THAT THE ONLY PROBLEMS ARE HOPKINS, OF COURSE ALL CLINICAL PROBLEMS CAN HAVE PROBLEMS. WHEN WE TALK ABOUT INFORMATION RESOURCES, THERE IS A NUMBER OF WAYS WE CAN CHARACTERIZE THEM. WE CAN TALK ABOUT -- WE CAN TALK ABOUT THE DISTANCE BETWEEN PRIMARY OBSERVATIONS, THE PROXIMITY TO THE SOURCE MATERIAL. ORIGINAL PUBLICATIONS AND DATA. WE CAN TALK ABOUT SECONDARY RESOURCES, ARTICLES, INDEXING, ABSTRACTING SERVICES, AND THEN, OF COURSE, TERRITORY SERVICES SUCH AS -- TEIXEIRA RARRY SERVICES, SUCHS A REVIEWS, REFERENCE WORKED THAT SYNTHESIZE INFORMATION AND ANALYZE IT. SO THAT'S A MORE CLASSIC VIEW. BUT VERY PRACTICALLY, WE TALK ABOUT THE CONTENT, WHAT IS IN EACH INFORMATION SOURCE. VERY OBVIOUSLY, WHAT IS THE SCOPE WHAT, SUBJECTS ARE COVERED, HOW FAR BACK DOES IT GO, HOW COMPREHENSIVE IS IT? AND FOR THAT, WHAT IS IN THE RECORD. IS IT FULL TEXT? DOES IT HAVE BIBLIOGRAPHY, ABSTRACTS? ARE THERE KEY WORDS ADDED? IF THERE ARE, ARE THEY FROM SOME KIND OF AN ORGANIZED LIST? A THEY SOREROUS, ONTOLOGY OF HIERARCHICAL TERMS, LARGER, NARROWER AND ASSOCIATED TERMS? THIS IS WHAT SOME INDEXING AND ABSTRACTING SERVICES TO. THEY CHOOSE FROM A LIST. ALSO WHAT ARE THE CAPABILITIES OF THE SEARCH ENGINE? CAN YOU -- WHAT IS THE INTERFACE, WHAT DOES IT LOOK LIKE? CAN YOU USE TRUNCATIONS, WILDCARDS, BOUILLON LOGIC WHERE YOU CAN COMBINE SETS AND BUILD YOUR SON ACCEPT ORDERED CHILDREN TOGETHER? AGAIN, THERE IS THE SOURCE SEARCHABLE? CAN YOU USE CITED REFERENCES? CAN YOU FIND SIMILAR TERMS AUTOMATICALLY? WHEN YOU THINK ABOUT THESE FROM AN INFORMATION CINCINNATI POINT OF VIEW, THESE ARE SOME OF THE ISSUES WE THINK ABOUT BUT ALSO CAN YOU GET ACCESS TO IT? IS IT FREE? IS IT FOR A FEE? BY THE WAY, WHAT DOES FREE MEAN? AT THIS POINT, I WOULD LIKE TO STATE THAT I HAVE NO FINANCIAL INTEREST OR ASSOCIATION WITH ANY OF THE ORGANIZATIONS THAT PUT OUT THESE DATABASES EXCEPT THAT I WORK FOR THE NIH AND THE NIH OVERALL, THE NATIONAL LIBRARY OF MEDICINE DOES PUT OUT SOME OF THESE. IS IT READ LIVEABLE TO YOU OR MUST IT BE ORDERED? DO YOU NEED TO GO SOMEWHERE TO GET IT? SO THE BUSINESS MODEL, WHO PAYS, AND THEN, OF COURSE, ARE YOU FAMILIAR WITH IT? HAS IT CHANGED SINCE THE LAST TIME YOU SAW IT? IS THE CAPABILITY STILL THE SAME, HAVE THERE BEEN UPDATES? AND HOW DO YOU FIND OUT ABOUT UPDATES? THIS IS THE HOME PAGE OF THE NIH LIBRARY HERE AS I MENTIONED IN THIS BUILD. AND I'D LIKE TO POINT OUT HERE THAT -- AND I'LL SPEAK MORE ABOUT THIS, THAT UPDATE THE DROP DOWN MENUS UNDER SERVICES AND TRAINING WE HAVE VARIOUS CLASSES. WE GIVE VARIOUS SERVICES. I'LL BE SPEAKING ABOUT SOME OF THESE LATER IN THE LENTOR. WE ALSO HAVE THE STANDARD NIH LIBRARY CATALOG HERE AT THE LOWER LEFT. IT'S SOMEWHAT LESS IMPORTANT THESE DAYS THAT WE STILL HAVE BOOKS BECAUSE MANY OF OUR JOURNALS, OVER 99% OF OUR 99.99 PROBABLY, OF OUR 9,000 JOURNALS ARE AVAILABLE ONLINE DIGITALLY, AND MANY VERY FAR BACK. POSSIBLE HEY THE ENTIRE RUN. WE HAVE MANY ELECTRONIC BOOKS AND MANY CAN BE SEARCHED IN FULL TEXT. WHEN WE GO TO SOME OF THE DATABASES THAT I'LL BE DISCUSSING HERE UNDER THE QUICK LINKS, WE HAVE PUBMED. I'LL SPEAK ABOUT THAT. BUT WE ASK PEOPLE WHO WORK FOR THE NIH TO GO TO THIS HOME PAGE, AND THEN CLICK THAT LINK SO THAT WHEN YOU GO THROUGH THIS LINK, YOU CAN GET ACCESS TO THE FULL TEXT OF THE ARTICLES TO WHICH WE SUNSCREEN. WE HAVE VERY GOOD SUBSCRIPTION SERVICE AND IF YOU'RE HERE ON CAMPUS, GO TO THIS LINK. YOU WILL GET THE FULL TEXT. I'LL SHOW YOU THE LINK TO THE FULL TEXT LATER. IF YOU'RE NOT ON CAMPUS AND YOU'RE A NIH STAFF MEMBER YOU CAN GET IN USING THE REMOTE ACCESS HERE AT THE LOWER RIGHT. YOU WOULD LOG IN WITH YOUR E-MAIL ADDRESS. PEOPLE WHO ARE NOT AT THE NIH, UNFORTUNATELY, THE NON NIH ACCESS HERE ON THE RIGHT IS NOT NECESSARILY FOR YOU. THAT'S FOR OTHER HHS AGENCIES WITH WHICH WE HAVE AN AGREEMENT BUT YOU FOLKS WHO ARE NOT AT THE NIH AND NOT AT OTHER NIH -- HHS AGENCIES SHOULD CONSIDER CHECKING WITH YOUR OWN INSTITUTIONS, I'LL BE SPEAKING ABOUT MANY FREE DATABASES, AND YOU CAN, OF COURSE, GET ACCESS TO THOSE, BUT NEED TO WITH YOUR OWN LIBRARIES AND CHECK WITH YOUR ACCESS. SOME OF THESE ARE VERY EXPENSIVE, SOME OF THEM ARE FREE. SO WE'LL BE SPEAKING MORE ABOUT THAT. IF YOU'RE HERE AT THE CLINICAL CENTER, YOU MAY HAVE ACCESS ON YOUR DESKTOP TO THE NIH CLINICAL RESEARCH INFORMATION SYSTEM, CRIS. HERE IS THE LINK THAT SHOWS THE CLINICAL SEARCH WHICH INCLUDES MANY DIRECT LINKS TO THE DATABASES I'M SPEAKING ABOUT TONIGHT. SO I'M SURE MOST OF YOU HAVE HEARD ABOUT PUBMED. PUBMED IS A NOW ALMOST 26 MILLION ARTICLES FROM OVER 5600 BIOMEDICAL JOURNALS AND 39 PAGES, AS IT SAYS ON THE SLIDE. AND NOW IT GOES BACK TO THE 1940 TO SEE THE PRESENT WITH SOME OLDER ITEMS. FREE ACCESS ONLINE AS I JUST SUBSCRIBED. ANYBODY IN THE WORLD CAN GO TO PUBMED.GOV, PAID FOR BY U.S. TAXPAYERS. HE'S A DATABASE WITH AUTHOR PROVIDED ABSTRACTS. ADDED INDEXING TERMS INCLUDE THE MEDICAL SUBJECT HEADINGS OR MESH THESAURUS, AND LINKS TO OTHER RESOURCES. YOU NED TO UNDERSTAND PUBMED TO GET COMPREHENSIVE RESULTS. THERE ARE SEARCHES AVAILABLE BY CLICKING HELP. THIS IS THE FRONT PAGE HERE AND HELP IS UNDER GETTING -- LET'S SEE. HELP IS ON THE RIGHT-HAND SIDE, GETTING STARTED ALSO HAS SOME MATERIAL HERE. USING PUBMED, THE QUICK START GUIDE. THIS IS TUTORIALS. THERE IS ONLINE TRAINING, WEBINARS, STRUCTURE MATERIALS AT THIS LINK. WE TALKED ABOUT MESH ALREADY. THESE ADDED SUBJECT HEADINGS CAN CHANGE OVER TIME. WE'LL SEE AN EXAMPLE IN A MINUTE. IF WE GO TO NCBI, SIGN IN TO MY NCBI, YOU CAN GET A FREE ACCOUNT. IF YOU GO THERE, IT WILL SAVE ALL YOUR SEARCHES AUTOMATICALLY AND YOU CAN GET UPDATES SO THAT IF THERE IS PUBMED GETS UPDATED REGULARLY, IF SOMETHING COMES IN IN YOUR SEARCH, IT WILL RUN THROUGH YOUR ALERTS AND YOU WILL GET NOTIFIED THAT THIS IS SOMETHING NEW IN YOUR FIELD. THE FILTERS ARE NOT ALWAYS OBVIOUS. CLINICAL TRIALS FILTER DOESN'T INCLUDE ALL OBSERVATIONAL STUDIES. SOME THINGS ARE NOT NECESSARILY OBVIOUSTEN THE FACE OF IT. IT'S IMPORTANT TO UNDERSTAND HOW TO USE IT. AND THEN USING THE ADVANCED SEARCH, THE SEARCH BUILDER HERE AT THE TOP, WE CAN ACTUALLY COMBINE SEVENS AND I'LL SHOW YOU AN EXAMPLE OF THAT BRIEFLY IN A MINUTE. WE CAN USE DOUBLE QUOTES FOR PHRASE OR STRING SEARCHES. THAT MEANS A BOUND PHRASE, EXACT STRING. HOW MANY PEOPLE HAVE NOT HEARD OF THE DOUBLE QUOTES? MOST PEOPLE HEARD ABOUT IT BY NOW. SO IN PUBMED THEY USE DOUBLE QUOTES. QUITE IMPORTANT. AND ALSO ANOTHER -- HERE AT THE BOTTOM OF THE BOOK SHELF I'LL BE TALKING ABOUT THAT. UP AT THE TOP, THIS DROP DOWN ARROW, THAT'S A WAY TO GET TO MANY OF THE OTHER DATABASES THAT NLM PRODUCES, THAT NCBI BRANCH OF PUBMED PRODUCES. THE JOHNS HOPKINS INTERNAL INVESTIGATION FOUND DIFFERENT PUBMED RESULTS DEPENDING ON THE TERM SEARCH, NOT SURPRISINGLY. PLEASE NOTE THEY DIFFERENTIATED BETWEEN THE NUMBER OF RESULTS FOUND HERE AND NUMBER OF USEFUL RESULTS FOUND HERE. WHEN THEY USED HEX AMATHENIUM LUNG -- THESE WERE NOT RESEARCHES, THIS IS NO QUOTES. THEY FOUND 3 RESULTS. TOXICITY, NO USEFUL RESULTS, SO WHY DID THEY GET DIFFERENT -- SUCH DIFFERENT RESULTS? HEX HEX THE WAY THAT SEARCH WORKS, TYPICALLY EVERY WORD IN THE RECORD IS INDEXED T INDEX IS SEARCHED, AND THE SUCCESS DEPENDS HOW WELL -- WELL, CERTAINLY, WHAT'S THE FILE CONTENT, THE SCOPE. MATERIAL THAT YOU'RE INTERESTED IN, IS IT IN THE FILE. AND THEN HAVE YOUR SEARCH TERMS MATCHED THE WORDS IN THE RECORD? AND BY THE WAY, THE ONLY THING IN THESE RECORDS ARE BIBLIOGRAPHIC INFORMATION, ABSTRACT IF IT'S AVAILABLE AND INDEXING AND KEY WORDS. THERE IS ALWAYS A PROBLEM OF CATEGORIES, OR GROUP NAMES. CLASSIFICATION SCHEMES, THAT'S HOW WE TRY TO SOLVE THAT PROBLEM. IN PUBMED, WE CAN TELL VERY CLEARLY WHAT IS BEING SEARCHED. WE CAN REPRODUCE IT. IT TELLS YOU, IT'S ALL CLEAR. AND WHETHER OR NOT THE ADDITIONAL SEARCH TERMS YOU'RE LOOKING FOR, WHETHER THEY'RE ADDED AUTOMATICALLY, WHETHER PLURALS ARE ADDED, CINNAMONS ARE ADDED, THESE ARE ALL QUESTIONS TO FIND OUT WHETHER OR NOT IT'S COVERED. AND EACH OF THESE INFORMATION RESOURCES YOU MIGHT WANT TO ADD -- MIGHT WANT TO SEARCH T WAY THAT PEOPLE WHO SEARCH A LOT TRY TO COVER A LOT OF THESE BASIS, THEY BUILD CONCEPT BASED SEARCHES. SO WE GO BROADLY FIRST BY GROUPING SIN OPRIME MINISTERS TOGETHER WITH. 0. , AND THEM WE NARROW IT BY ANDING THEM TOGETHER. SO IN THIS CASE, THE EXAMPLE I'D LIKE TO USE IS GANGLIONIC BLOCKERS OR HEXAMETHONIUM BY PARENS AND LUNG. HERE IS THE PUBMED RECORD FOR THE FIRST ARTICLE I SHOWED YOU, THE HEXAMETHONIUM ASTHMA STUDY AND THE DEATH OF A NORMAL VOLUNTEER RESEARCH FROM THE JOURNAL OF MEDICAL ETHICS. WELL, IF I HIT -- IF I EXPAND ON THE MESH TERMS HERE IN THE LOWER PART OF THE RECORD, THIS SHOWS YOU THE LIST. AND BY THE WAY, WHERE I JUST GOT THOSE TWO TERMS, IT SHOWS GANGLIONIC BLOCKERS HERE, AND HEXAMETHONIUM HERE. SO I'M [INDISCERNIBLE] THOSE 2 TERMS WITH MY LOGIC. PUBMED NOW COVERS BACK TO THE MID 1940s WITH EARLIER COVERAGEFUL JOHN HOPKINS INVESTIGATORS FOUND THAT THE VERSION, IN THIS CASE IT WAS MED LINE THAT THE INVESTIGATOR USED, MED LINE WAS THE DATABASE BEHIND PUBMED, THE OLDER DATABASE. IN THIS CASE, THAT DATABASE ONLY WENT BACK TO 1966. THERE WAS OLDER MATERIAL THAT WOULD HAVE GIVEN THE CLUE. YOU HEARD OF THIS ONE, THERE IS A REFERENCE AT THE BOTTOM, 1966 AND ALL THAT. WHEN IS A LITERATURE SEARCH DONE BY MCCLELLAN IN "THE LANCET." VERY UNFORTUNATE THE INVESTIGATOR DID NOT KNOW. HERE ARE SEVERAL ARTICLES THAT I'M GOING TO TALK ABOUT FROM 1954. THERE WAS A KEY ARTICLE WHICH HAD THE TOXICITY OR ADVERSE EFFECTS WERE NOT IN THE PUBMED RECORDS. THAT WOULD HAVE BEEN MAYBE DIFFICULT FOR THEM TO FIND. SO IT'S HYPERTENSION DIDN'T SAY TOXICITY. HEXAMETHONIUM LUNG, THE ACTUAL PHRASE, OCCURRED IN THE TITLES OF TWO ARTICLES FROM 1956 AND 1962, AND THEY'RE INDEXING DID INCLUDE TOXICITY BUT THE VERSION OF MED LINE THAT THE INVESTIGATORS SEARCHED ONLY WENT BACK TO 1966. THEY DIDN'T HAVE THE OLDER ARTICLES. YES, THERE ARE OTHER WAYS AROUND FINDING THESE OLDER ARTICLES. NEVER SEARCH ONE SOURCE WHEN IT'S IMPORTANT AND YOU WANT TO BE COMPREHENSIVE. THEY COULD HAVE USED CITED REFERENCE SEARCHING TO GO BACK TO THE OLDER ARTICLES. MORE RECENT ARTICLES REFER TO THE OLDER ARTICLES. SO HERE IS AN EXAMPLE THAT I TALKED ABOUT, HERE IS HEXAMETHONIUM AND LUNG. HERE ARE -- THE OLD FASHIONED, THE WAY WE DO IT. BUT IT'S JUST KIND OF A REMINDER OF WHAT'S GOING ON. NOTICE HERE, THE LOWER RIGHT, WE HAVE SEARCH DETAILS. IF I CLICK THE SEE MORE, I WILL SEE EXACTLY HOW THIS QUERY WAS TRANSLATED. AND WHICH TERMS WERE SEARCHED. SO GANGLIONIC HERE, ALL FIELDS. BLOCKERS, ALL FIELDS. OR GALLON LEE ONTIC BLOCKERS, ALL FIELD, PHARMACOLOGIC ACTION. IT TELLS ME EXACTRY HOW THESE TERMS ARE TREATED. HERE IS ANOTHER SEARCH, AGAIN, WITH THAT CONCEPT BASED LOGIC THAT I DESCRIBED. THIS IS HEXAMETHONIUM AND TOXICITY, OR ADVERSE EFFECTS, OR POISONING. STANDARD SUBHEADS THAT WE USE TO DESCRIBE, AGAIN, THE ILL EFFECTS IN MESH. AND HERE, AGAIN, EXPANDS ON THAT SEARCH DETAILS. TO GET EXACTLY HOW THESE WERE TREATED. THEN WE CLICK THAT ADVANCED BUTTON. AND HERE I SHOW YOU HOW YOU CAN BUILD, HOW I CAN COMBINE THESE TWO. IN THIS CASE, I CLICK THE SEARCH, ADD TO BUILD, NUMBER TWO AND ONE. I'VE COME UP WITH THIS SEARCH STRING HERE, THIS QUERY ON THE TOP WHICH GIVES ME 24, IN THIS CASE, WHEN I DID THIS, MADE THESE SCREEN SHOTS A YEAR AGO, WHEN I TRIED IT LAST WEEK THERE WAS A FEW MORE THAN THIS. I FOUND 24 ITEMS. WITHIN THOSE ITEMS, 1966, ALL, THAT WHEN IS THE LITERATURE SEARCH DONE THAT I SHOWED YOU, NOT SURPRISINGLY, THAT'S PARTLY HOW I BUILT THE QUERY. AS WELL AS THE 1962 ARTICLE AND 1956 ARTICLE. BUT -- AND BY THE WAY HERE IS THAT 1956 ARTICLE FROM THE JOURNAL OF OBSTETRICS AND GYNECOLOGY OF THE BRITISH EMPIRE. AND HERE IS THE 1954 ARTICLE. THIS 1954 ARTICLE WAS NOT IN THE 24 -- REMEMBER, I SAID IT DIDN'T SAY TOXICITY IN THE MESH TERMS. BUT NOTICE HERE ON THE RIGHT, IT DOES SAY THAT WE HAVE THE NIH LIBRARY FULL TEXT PLUS, THEREFORE, IT IS AVAILABLE. I SHOULD MAKE ONE NOTE, BY THE WAY, ABOUT THESE NICE LINKS THAT I TOLD YOU TO GO TO THE NIH LIBRARY HOME PAGE AND CLICK SO YOU CAN GET THESE LINKS. THERE IS A PROBLEM WITH SOME OF THESE LINKS. THEY DON'T ALWAYS WORK OFTEN THOUGHT SAYS WE HAVE FULL TEXT. WE MAY SUBSCRIBE TO THE ENTIRE RUN OF THE JOURNAL OR THERE MAY BE A PROBLEM. DATABASE BEHIND THE LINKS IS ONE OF THE MOST PROBLEMATIC BECAUSE IT HAS TO COVER MORE THAN 9,000 JOURNALS AND PUBLISHERS, AND IT CHANGES ALL THE TIME. SO IF YOU HAVE THAT PROBLEM, IF IT SAYS THERE IS FULL TEXT AND YOU CAN'T GET THE FULL TEXT, GO TO THE NIH LIBRARY CATALOG AND CHECK THE ACTUAL NAME OF THE JOURNAL. AS I SHOWED YOU, BEFORE YOU TRY TO ORDER THE DOCUMENT. YOU MAY FIND THAT WE HAVE IT BUT THE LINK DOESN'T NECESSARILY WORK. IT'S ONE OF OUR MOST FREQUENT QUESTIONS. OF COURSE PEOPLE WHO ARE NOT AT THE NIH LIBRARY, YOU MAY HAVE YOUR OWN SUBSCRIPTION DEPARTMENT, YOUR OWN LIBRARY OR MAY BE ABLE TO FIND THE ARTICLE ONLINE. WE TALKED WITHOUT HAVING MORE THAN ONE SOURCE. EXPENSIVE SEARCHES USUALLY REQUIRE MULTIPLE INFORMATION SO I UNDERSTANDS. THEY OFTEN WILL OVERLAP. THERE IS AREAS OF SPECIALIZATION. SOME SOURCES OF BETTER ADVANTAGES IN TERMS OF -- GO FURTHER BACK OR CONTENT, WHATEVER. HERE I'M GOING TO SHOW YOU SOME AB COMPARISONS, AND WE'LL TALK ABOUT A BUNCH OF OTHER, BOTH FREE AND FEE RESOURCES, BUT REALIZE, THERE ARE DIFFERENT VERSIONS. JOHNS HOPKINS INVESTIGATOR FOUND MED LINE ONLY WENT BACK TO 1966. YES, THERE WAS ANOTHER FILE THAT WENT BACK FURTHER, EVEN AT JOHNS HOPKINSITATE BUT THEY TINT KNOW ABOUT IT. AND THERE ARE DIFFERENT VERSIONS OF MANY OF THESE DATABASES. YOU NEED TO BE VERY SURE ABOUT WHICH VERSION YOU'RE SEARCHING. IN FACT, WHEN WE TALK ABOUT THOSE GUIDELINES, AGAIN, AT THE END OF THIS LECTURE, THERE IS A WAY TO TRACK YOUR SEARCHES AND YOU MIGHT WANT TO KEEP TRACK OF WHAT YOUR SEARCHES ARE AND WHAT YOUR RETRIEVAL IS. WE'RE TALK MORE ABOUT THAT BUT OTHER SOURCE MAY BE IMPORTANT FOR A GIVEN SEARCH, BESIDES THE ONES HERE. WE ONLY HAVE MORE THAN AN HOUR, HOUR AND 15 MINUTES HERE. I CAN'T GO OVER ALL OF THEM. BUT WE'LL GIVE YOU AN EXAMPLE. SO THE FIRST ONE I WANT TO TALK ABOUT IS M BASED. I ASKED HOW MANY HAVE HEARD OF THIS. M BASE IS ACTUALLY THE KIND OF LEADING OVERLAP CLINICAL DATABASE TO PUBMED OR MED LINE. IT'S PUT OUT BY ELSAVERE, THE INFORMATION INDUSTRY GIANT. IT HAS MORE ITEMS THAN PUBMED, OVER 29 MILLION ITEMS FROM HALF AS MANY JOURNALS. 8500 JOURNALS. IT'S MORE INTERNATIONAL. IT HAS 40 LANGUAGES. AND IT IS A SUBSCRIPTION DATABASE AND CAN BE EXPENSIVE. THE NIH FILE COFFERS FROM 1947 TO THE PRESENT, AND AGAIN, THE WAY TO GET TO IT IS THERE THE RESOURCES SECTION. THE ARTICLE DATABASES OR, I'M SORRY, THE QUICK ILLNESS, ALL DATABASES ON THE LOWER RIGHT THAT I SHOWED YOU. IT INCLUDES ALL OF MED LINE. NOW, REMEMBER, I SAID MED LINE IS THE DATABASE BEHIND PUBMED? PUBMED INCLUDES THINGS NOT IN MED LINE, FOR EXAMPLE, THINGS THAT HAVE NOT REALLY BEEN PUBLISHED YET EARLY PUBLICATIONS, EARLY NOTICES. BUT WHEN EMBASE COVERS THE MATERIAL IN MED LINE IT USES ITS OWN INDEXING. THEY USE M-FREE AND THERE ARE PROBABLY MANY -- ALMOST TWICE AS MANY M-TREE TERMS AS THERE ARE MESH TERMS SO IT'S A LOT MORE SPECIFIC. WE USE M BASE FOR DRUG -- ITS PRIMARY UTILITY, AGAIN, FOR OVERALL CLINICAL MEDICINE. BUT IT'S VERY GOOD ON DRUG SIDE EFFECTS, INTERACTIONS, TOXICOLOGY, BIOTECHNOLOGY, MEDICAL DEVICES, HEALTH POLICY, MANAGEMENT, PUBLIC, OCCUPATIONAL ENVIRONMENTAL HEALTH. YOU CAN READ FROM THE SLIDE BUT PARTICULARLY CONFERENCES. WHY ARE CONFERENCES IMPORTANT? WHEN YOU DO RESEARCH, ONE OF THE VERY EARLIEST THING YOU FIND OUT ABOUT ADVANCES FROM, ONE OF THE EARLIEST SOURCES, IS CONFERENCES. SO THE MORE CONFERENCES YOU CAN GET TO, MAY BE THE EARLIER YOU MIGHT GET OF SOME OF THE INNOVATIONS IN HEALTHCARE. AND ALSO COVERS ALTERNATE AND COMPLEMENTARY MEDICINE. I GIVE YOU LINKS TO GETTING STARTED IN SUPPORT HERE. WHEN WE COMPARE AB TEST, EMBASE AND PUBMED FOR SOME OF THE ARTICLES ALREADY DISCUSSED, THE 1954 BRITISH HEART JOURNAL ARTICLE, PUBMED DID NOT INCLUDE THE ABSTRACT. IT DIDN'T INCLUDE TOXICITY OR ADVERSE EFFECTS BUT THE EMBASE DID INCLUDE THE ABSTRACT AND DIDN'T INCLUDE TOXICITY OR ADVERSE EFFECTS. IT SAID DYSENEIA OR EDEMA AND IT USED THE BRITISH SPELLINGS AS WELL BECAUSE IT'S A EUROPEAN DATABASE. HEXAMETHONIUM LUNG REPORTED A CASE OF -- WITH PREGNANCY, 1956. PUBMED DIDN'T HAVE AN ABSTRACT BUT HAD VERY GOOD MESH INDEXING TERMS, THAT IS, ADVERSE EFFECTS. PLEASE NOTE THE STAR HERE, THAT MEANS IT'S A MAJOR PART, A MAJOR THEME OF THE ARTICLE, WAS THIS ADVERSE EFFECTS. M BASE INCLUDED, AGAIN, EDEMA IN THE ABSTRACT. IT DIDN'T INCLUDE ADVERSE EFFECTS. THE ABSTRACTED WAS DAMMING, THAT A WOMAN OF 37 DIED DURING HER 35th WEEK OF PREGNANCY. IT WAS AWFUL. THIS IS THE LATEST EMBASE SEARCH INTERFACE AVAILABLE TO US. WHEN I SAY LATEST, IT JUST CHANGED LAST MONTH. I THINK YOU'LL FIND A LOT OF THESE SEARCH SCREEN SHOTS THAT I SHOW YOU WILL HAVE CHANGED BY THE TIME YOU GET TO SEE THEM. I HOPE YOU HAVE THE GENERAL IDEA OF WHAT I'M TRYING TO SHOW. ONE THING I WANT TO SHOW, NOTICE THE EXAMPLE IN THE CHILDREN BAR. CANCER GENE THERAPY AS A STRING SEARCH. THEY ONLY USE SINGLE, NOT DOUBLE QUOTES. YOU HAVE TO CHECK THESE THINGS. THIS IS ONE DIFFERENCE BETWEEN EMBASE AND MANY OF THE OTHER SEARCH GAUGES. THERE IS SUPPORT AND HELP AVAILABLE HERE IN THE LOWER PART. THERE IS SEARCH TIPS ON THE RIGHT-HAND SIDE. THERE ARE DROP DOWN LISTS AVAILABLE FROM SEARCH. WE'LL TALK ABOUT PICO IN A SECOND. THEN YOU CAN BROWSE THE IM-TREE TERMS, JOURNALS AND AUTHORS. SO PICO, IN THIS CASE, THEY'RE SAYING POPULATION INTERVENTION COMPARISON AND OUTCOME. THIS IS AN IDEA -- THIS IS A WAY TO TRY TO BUILD YOUR CONCEPT RELATED SEARCH, TO ORGANIZE YOUR QUERY CONCEPTS AND TO FIND THE BEST TERM ON THE LEFT-HAND SIDE, LET'S TRY DIABETES, IT GOES INTO AN AUTOMATIC M-TREE LOOK UP LIKE MESH, AGAIN. SO HERE IS A RECORD, EMBASE RECORD. THIS IS THE 1954 ARTICLE SHOWING DYSENEIA AND EDEMA. AND HERE IS THE 1956 ARTICLE WITH THE DAMMING ABSTRACT. SO THESE ARE THE TWO MAIN CLINICAL MEDICINE DATABASES THAT YOU SHOULD KNOW ABOUT. YOU MIGHT KNOW ABOUT WEB OF SCIENCE AND SCOPE. THESE ARE THE TWO CITED REFERENCE DATABASES. THEY ALSO CAN BE VERY USEFUL IN OBTAINING CITATION RANKINGS OF AUTHORS' PUBPLICATIONS. WEB OF SCIENCE IS THE OLDER DATABASE. IT HAS OVER 12,000 JOURNALS FROM 1900 TO THE PRESENT. MANY LACK ABSTRACTS, MANY LACK INDEXING. BUT AGAIN, THEY'RE VERY GOOD BIBLIOGRAPHIC CITATIONS AND ON ALL THE REFERENCES. IF I HAVE AN ARTICLE FROM, LET'S TRY AN ARTICLE FROM 2006. AND IT REFERENCES THAT ARTICLE FROM 1956. I CAN GO BACK IN TIME, I CAN ALSO GO FROM THAT ARTICLE, FROM 1956, FORWARD IN TIME TO ANOTHER ARTICLE IN 2014 THAT ALSO REFERENCED THAT. THIS IS COCITATION ANALYSIS GOING BACKWARDS AROUND FORWARDS IN TIME USING YOUR REFERENCE CITATION. IT CAN BE VERY USEFUL AS A WAY TO GET AROUND DOING STRAIGHT SUBJECT SEARCHING. THESE DATABASES MAY NOT BE THAT GOOD OF A CHOICE FOR SUBJECT SEARCHING. THEY DON'T REALLY HAVE CONTROLLED VOCABULARY. JUST LIMITED TO THE TERMS -- WELL, IF THERE ARE ABSTRACTS. IN THE TITLES. ABSTRACTS IF THEIR ARE ANY. AGAIN, THE CITATIONS CAN BE VERY POWERFUL. ALSO, I HAVE TO TELL YOU THAT BOTH OF THEMING ARE TRYING VERY HARD TO INCLUDE CONFERENCES. CONFERENCE MATERIALS. SCOPIST IS THE [INDISCERNIBLE] PRODUCTS IT HAS COMPLETE CITATION COUNTS FROM 1996 TO THE PRESENT, COMPLETE CITATION COUNTS MEANING ALL THE RECORDS IN THEM HAVE THE CITATION. BUT BEFORE 1996, THEY MAY NOT HAVE THE CITATION, SO AGAIN, IF YOU'RE GOING FOR OLDER MATERIAL YOU'D WANT WEB OF SCIENCE. THEY HAVE MORE JOURNALS, THEY'RE BOTH BROAD SCIENCE, THEY GO PRETTY FAR BACK IN TIME. AND THEY'RE BOTH VERY USEFUL AND BOTH SUBSCRIPTION. SO PEOPLE WHO ARE NOT AT THE NIHTIOUS YOU MAY NEED TO GO TO A LIBRARY, CHECK OTHER LIBRARIES, SEE IF YOU HAVE ACCESS TO THESE VERY USEFUL DATABASES. HERE ARE 3 CLINICAL DECISION RESOURCES THAT ARE SUBSCRIPTION BASED. ONE OF THEM IS MICROMED X, MONOGRAPHS FOR WORLDWIDE MARKETED DRUGS. IT HAD LUNG TOXICITY, THE FIRST SIDE EFFECT OF HEXAMETHONIUM, THE JOHNS HOPKINS UNIVERSITY REPORT SAID. IT HAS VERY DETAILED DRUG DESCRIPTIONS, DOSING TOXICITY, POISON CONTROL CENTERS USE A SUBSET OF MICROMEDEX CALLED POISON DEX. WE HAD A QUESTION ABOUT HYPOGLYCEMIC DATA AS COMPARED WITH MED FORMAN, THIS WAS ONE OF THE BEST RESOURCES WE COULD FIND TO ANSWER THAT QUESTION. LEX COMP HAS DETAILED -- ALSO DETAILED DRUG MONOGRAPHS WHO ARE -- WHICH ARE RATHER AUTHORITATIVE BECAUSE THEY ACTUALLY COME FROM THE AMERICAN SOCIETY OF HEALTH PHARMACISTS. AND THE -- WHEN I SEE PEOPLE USING PDR, I NEED TO TELL THEM, GEE, THERE IS THIS OTHER RESOURCES THAT YOU MIGHT WANT TO KNOW ABOUT CALLED LESTI COMP. MUCH MORE DETAIL THAN AUTHORITATIVE INFORMATION. PDR ONLY LISTS THE INSERTS, FOR DRUGS, THE DRUG INSERTS THAT WERE PROVED BY THE FDA. WE ALSO HAVE UP TO DATE WHICH IS A CLINICAL DECISION SUPPORT SYSTEM FOR POINT OF CARE, IDEOLOGY DIAGNOSIS AND TREATMENT QUESTIONS, HE PEER REVIEWED TEXT. INCLUDES DRUG AND EVIDENCE BASED INFORMATION. THE CURRENCY ON THIS ONE VARIES. RETCHES HAVE LINKS TO THE NIH FULL TEXT SUBSCRIPTIONS BUT THERE IS A CAUTION ON HOW RECENT THE INFORMATION. YOU ALWAYS WANT TO BE CHECKING HOW RECENT YOUR REFERENCES ARE. WHEN WE TALK ABOUT EVIDENCE BASED INFORMATION, ONE OF THE FIRST NAMES THAT COMES UP IN COCHRAN. THE COCHRAN LIBRARY REGULARLY UPDATED SUBSCRIPTION BASED COLLECTION WITH SYSTEMATIC REVIEWS OF INTERVENTIONS, IT DOES HAVE EXTENSIVE ABSTRACTS AVAILABLE FOR PREFREE IN PUB MED. IF YOUR INSTITUTION DOES NOT HAVE A SUBEXCEPTION AS THE NIH DOES, YOU WILL BE ABLE TO SEE VERY SUBSTANTIVE INFORMATION IN THE ABSTRACTS AVAILABLE FOR FREE IN PUBMED. AND IT ALSO HAS CLINICAL TRIAL REPORTS PUBLISHED AND UNPUBLISHED, AND IN COUNTRIES IT'S FREE. YOU MAY WANT TO CHECK YOUR COUNTRY TO SEE IF IT'S AVAILABLE. AND WE HAVE THE SISTER AGENCY, AGENCY FOR HEALTHCARE RESEARCH AND QUALITY, AHRQ, FROM HHS THAT PUBLISHED PUBMED.GOV, CLEARINGHOUSE WITH EXTENSIVE FILTERING AND YOU CAN COMPARE SEVERAL GUIDELINES SIDE BY SIDE. HERE IS THE AHRQ SCREEN SHOT FRONT PAGE. THE REPORTS CAN BE VERY USEFUL COMPARISON, THE OUTPUT IS VERY HELPFUL. THAT'S SOMETHING THAT, AGAIN, WHEN WE TALK ABOUT ACCESS, WHAT KIND OF OUTPUT CAN YOU GET? HOW CAN YOU COMPARE YOUR RETRIEVAL FROM, SAY, PUBMED AND EMBASE? AND OTHERS? WELL, YOU'LL HAVE DUPLICATES. HOW DO YOU DEAL WITH IT? TALK ABOUT THAT BIBLIOGRAPHIC CITATION MANAGERS IN A FEW MINUTES. WHAT CLINICAL TRIAL INFORMATION IS AVAILABLE FROM CLINICAL TRIALS.GOV? WHICH IS A REGISTRY MAIN TAPED BY THE NIH AND NOT LIMITED TO NIH FUNDED RESEARCH. AND THIS IS WHAT THE FRONT PAGE LOOKS LIKE. THE QUERY PAGE FOR CLINICAL TRIALS.GOV. THERE IS ALSO THE INTERNATIONAL CLINICAL TRIALS REGISTRY PLATFORM. ICTRP. THERE IS ABOUT 20 REGISTRIES, I THINK THERE ARE 19, 20 LAST TIME I CHECKED, MAINTAINED BY THE WORLD HEALTH ORGANIZATION. WE ALREADY TALKED ABOUT THE COCHRAN LIBRARY, AND I WANT TO MENTION ANOTHER DATABASE THAT IS, AGAIN, A SUBSCRIPTION DATABASE CALLED PHARMA PROJECTS. PHARMA PROJECTS COVERS DRUGS IN DEVELOPMENT, ANYWHERE IN THE WORLD, FROM 1980 TO THE PRESENT. IT HAS DETAILED DRUG PROFILES, THERAPY, MECHANISM, BUYLOGICAL TARGETS, DEVELOPMENT HISTORY AND CLINICAL TRIAL INFORMATION. THEY SEND PEOPLE TO CONFERENCES. THEY WRITE UP ABSTRACTS. THEY INCLUDE IN THEIR DATABASE. THEY ALSO INCLUDE OTHER -- THEY HAVE OTHER DATABASES, WHAT WE DO NOT SUBSCRIBE TO. ONE CALLED TRIAL TROVE. BUT YOU CAN MINE THE PROFILES IN FACIALA PROJECTS FOR CLINICAL -- PHARMA PROJECTS FOR CLINICAL TRIAL INFORMATION WHICH IS BEYOND THAT IN CLINICAL TRIALS.GOVSO VERY USEFUL FOR MANY THINGS. DESPITE POLICY, SINCE 2005, I BELIEVE, MANY CLINICAL TRIALS WHILE THEY WERE SUPPOSED TO BE AND REQUIRED TO BE REGISTERED, THEY'RE NOT ALL REGISTERED. HERE ARE 3 STUDIES SHOWING SOME OF THE LACK OF RIGOR AND RESPECTING THOSE REGULATIONS FOR CLINICAL TRIAL REGISTRATION. THERE IS ALSO A TAKE AWAY, AGAIN, ABOUT OLDER INFORMATION. CAN COME FROM OLD AND NEW RESOURCES. HERE IS AN ARTICLE BY [INDISCERNIBLE] AND OTHERS ABOUT ANALYSIS OF 146 CONTRADICTED MEDICAL PRACTICES. SOME MAY STILL BE VALID, SOME HAY NOT BE. YOU HAVE TO READ THEM CRITICALLY AND CHECK. SO DIFFICULT TO FIND CLINICAL TRIALS. WE OFTEN ASK THESE QUESTIONS. HERE ARE SOME RESOURCES BUT REALIZE THAT NOT ALL OF THEM, EVEN IF WE HAD ALL THE RESOURCES IN THE WORLD, WELL, WE MAY NOT HAVE THE RESOURCES INSIDE THE DRUG COMPANY. THEY MAY NOT BE PUBLISHED. CLINICAL TRIALS.GOV. HERE ARE SOME OTHER RESOURCES THERE THE -- AGAIN, THE NATIONAL LIBRARY OF MEDICINE. WE HAVE A CLUSTER OF DATABASES CALLED TOXNET COVERING TOXICOLOGY, HAZARDOUS CHEMICALS AND RELATED AREAS. I HAVE A LIST OF THE FACT SHEETS AND HERE IS THE QUERY PAGE. THIS IS HEXAMETHONIUM SHOWING, AGAIN -- THESE ARE LISTS OF DATABASES, SO IN TOX LINE, WHICH IS A BUNCH OF DATABASES, UNDER TOXNET, IT HAS 2,210 RESULTS. THIS YEAR I BELIEVE IT HAS MORE THAN THAT. HERE WE HAVE DART. DIRECTORY OF REPROSPECTIVE TOXICOLOGY, I BELIEVE. HSTB IS A LIST OF DIFFERENT CHEMICALS, ALSO A KIND OF CHEMICAL DICTIONARY. SO WE ALWAYS AFTER TEXT AND REFERENCES. REMEMBER I SHOWED YOU THE BOOK SHELF UNDER THE PUBMED QUERY PAGE? THIS IS CALLED BOOKS, FREE ONLINE BOOKS AVAILABLE BY CLICKING THE DOWN ARROW NEXT TO THE PUBMED SEARCH WINDOW. YOU WOULD CLICK ON BOOKS. HERE IS HOW TO GET TO IT. YOU SEE THE DOWN ARROW FROM PUBMED. I CLICKED ON BOOKS. THAT'S HOW I GET TO THE -- THAT SEARCH PAGE. AND HEXAMETHONIUM TOXICITY WASN'T MENTIONED IN THE LAST 4 EDITIONS OF GOODMAN AND GILLMAN OR THE CURRENT EDITION OF FISHMAN'S PULMONARY MEDICINE BUT IT WAS INCLUDED IN THE PREVIOUS EDITION OF THE TEXT X THE JOHNS HOPKINS REPORT SAID. IMPORTANT TO THINK ABOUT THE OLDER MATERIAL. I WANT TO TALK MORE ABOUT SPECIALIZED SOURCES BEFORE I DO -- DOES ANYBODY HAVE ANY QUESTIONS IN THE AUDIENCE? NOT YET. OKAY. MOVING RIGHT ALONG. REGULATORY INFORMATION IS ALSO IMPORTANT, PARTICULARLY POST MARKETING SURVEILLANCE FROM PHARMACEUTICAL COMPANIES WHICH THEY MUST REPORT TO THE FDA. AND HERE IS A FRONT PAGE OF THE MED WATCH, THE SAFETY INFORMATION ADVERSE EVENT REPORTING INFORMATION. YOU COULD SUBSCRIBE TO IT, ANNIVERSARY AS I'VE CIRCLED HERE. THE NIH FUNDED RESEARCH GRANTS CAN BE SEARCHED IN REPORTER. REMEMBER, I SAID THAT THE FIRST NOTICE YOU WOULD HAVE OF INNOVATIONS ARE THE CONFERENCES? WELL, EVEN BEFORE THE CONFERENCES, YOU MIGHT BE ABLE TO FIND PEOPLE WHO ARE WORKING ON A SIMILAR TOPIC. OR IN SOME GENERAL AREA BY SEARCHING WHO HAS GOTTEN FUNDING TO WORK ON AN AREA. YOU WOULD DO THAT BY SEARCHING REPORT. AND THIS IS THE QUERY PAGE. PSYCH INFO IS A BEHAVIORAL AND HEALTH SCIENCE DATABASE, CITATIONS AND ABSTRACT. AVAILABLE FROM THE NIH LIBRARY. WE SUBSCRIBE. IT'S NOT VERY USEFUL AMONG OTHER THINGS. IT'S GOT VERY USEFUL INDEXING FOR AGE GROUPS, MORE DETAILED AGE GROUPS THAN PUBMED OR EMBASE HAS. SO WHILE THERE IS OVERLAPAROSCOPIC, A GREAT DEAL OF OVERLAP BETWEEN PSYCH INFO, PUBMED AND EMBASE, HOW WE SEARCH IT MAKES A LOT OF DIFFERENCE. IF YOU WORK ON DEVICES, I HAVEN'T SAID THAT MUCH SO FAR. I MEAN I SAID EMBASE COULD BE USEFUL FOR DEVICES. CERTAINLY THE CITATION RESEARCH DATABASES, WEB OF SCIENCE AND SCOPIST COULD BE HELPFUL BUT THEY'RE HARD TO SEARCH. THERE ARE TWO ENGINEERS DATABASES CALLED COMENDEX AND INSPEC. WE DO NOT HAVE SUBSCRIPTIONS FOR NIH STAFF. WE CAN SEARCH THEM IN THE REPUBLIC, BUT WE DO NOT HAVE A SUBSCRIPTION FOR NIH STAFF. THEY'RE AVAILABLE AT MANY PUBLIC UNIVERSITIES. IF YOU'RE NOT AT NIH YOU MAY WANT TO CHECK WITH YOUR OWN INSTITUTION. SCOPIST, COVERS MOST OF THE MATERIAL IN THE CONTEXT, BUT IT DOESN'T INCLUDE THE EXTENSIVE SUBJECTS SPECIFIC INDEXING. SO THEREFORE, IT'S A LITTLE BIT HARDER TO FIND THINGS. CHEMISTRY, THERE IS A MENU BASED FRONT END FOR CHEMICAL ABSTRACTS CALLED SCI FINDER. MANY SCHOOLS HAVE THIS. WE ALSO HERE AT THE NIH HAVE A VERSION OF SCI FINDER. YOU CAN REQUEST ACCESS FROM THE NIH LIBRARY, AGAIN, UNDER THOSE DATABASES. YOU GO TO S AND FILL OUT A FORM. THIS IS A KIND OF A SPECIAL DATABASE BECAUSE IN THIS CASE, WE, AT THIS POINT, CANNOT SEARCH SCI FINDER FOR YOU. LIBRARIANS CANNOT SEARCH IT. IT'S END USER SEARCHABLE ONLY. WE CAN ADVISE YOU, HELP YOU, YOU GET YOUR OWN ACCOUNT, AND DEPENDING ON THE INSTITUTE YOU'RE IN, THE ACCOUNT DOES NOT COST YOU ANYTHING. BUT BECAUSE YOU'RE INSTITUTE ALREADY PAYS FOR IT. SO IT'S A SPECIAL KIND OF EXEMPTION. THE -- IT'S A BUSINESS DECISION, THE BUSINESS CASE OF THE PROVIDERS THAT MAKES THESE RULES THAT WE HAVE TO SUBSCRIBE TO. MANY TIMES, PARTICULARLY WHEN YOU'RE INVOLVED IN INNOVATIONS AND NEW RESEARCH, IT'S NOT GOING TO BE INDEXED. IT'S NOT GOING TO BE IN THE TITLE. LET'S SAY YOU WANT TO FIND OUT IF THIS PARTICULAR INSTRUMENT, THE SEQUENCER, FOR EXAMPLE, HAS EVER BEEN USED IN THIS PARTICULAR APPLICATION. IT'S PROBABLY NOT GOING TO BE IN THE TITLE. IT'S PROBABLY NOT GOING TO BE IN THE ABSTRACT. IT WILL PROBABLY BE IN THE MATERIALS AND METHODS SECTION. AND THAT'S GOING TO BE THE FULL TEXT. SO YOU HAVE TO GET ACCESS TO THE FULL TEXT. WELL, THERE ARE MANY PLACES TO GET FULL TEXT. THIS IS INCREASINGRY PLACES. WE ACTUALLY HAVE A SUBSCRIPTION AT THE NIH LIBRARY TO A FULL TEXT MANAGER CALLED QUOSA, AND WE CAN GO INTO IT, OPEN A CHANNEL TO M BASE OR PUBMED, DO A SEARCH, AND THEN LET'S SAY I GET 9,000 ARTICLES FROM MY QUOSA SEARCH, I CAN HIT THE BUTTON AND GO AWAY, AND IF IT HASN'T HICCUPPED IN THE MIDDLE OF THE NIGHT AND I HAVE TO DO IT AGAIN THE NEXT DAY WHICH HAS HAPPENED, 18 OR 20 HOURS LATER, I CAN GET OF THOSE 9,000 ARTICLES, THE FULL TEXT FOR THOSE ARTICLES THAT WE SUNSCREEN TO IN MY COMPUTER, WHICH I CAN -- SUBSCRIBE TO, IN MY COMPUTER, WHICH I CAN SEARCH. IT'S VERY USEFUL DEVICE. OF THE 9,000 IN MY EXAMPLE, I GOT ABOUT 6500 IN FULL TEXT. IT'S VERY USEFUL. WE ALSO HAVE PUBMED CENTRAL WHICH IS A FREE DIGITAL BIOMEDICAL WEB SCIENCES JOURNAL LITERATURE ARCHIEF FROM THE NIH. IT HAS MORE THAN 14% OF THE PUBMED IN IT NOW. AGAIN, THERE IS A REQUIREMENT FOR PEOPLE WHO ARE FUNDED BY GOVERNMENT RESEARCH DOLLARS TO DEPOSIT THEIR RESEARCH IN PUBMED CENTRAL. THERE IS ALSO DIRECTORY OF OPEN ACCESS JOURNALS, AND, WELL, THERE IS ALSO CONSUMER HEALTH INFORMATION AVAILABLE FROM MED LINE PLUS. THAT'S KIND OF IMPORTANT BECAUSE MANY OF THE PATIENTS, THEY WILL HAVE ACCESS TO THIS AND MAY UNDERSTAND THIS INFORMATION MORE READILY THAN THEY CAN UNDERSTAND SOME OF THE MORE TECHNICAL INFORMATION IN PUBMED. SO HERE, AGAIN, IS HOW TO GET TO PUBMED CENTRAL. I CLICK THE DOWN ARROW NEXT TO THE QUERY BOX IN PUBMED SEARCH MED, AND I PULLED IT DOWN TO PUBMED CENTRAL. AS FOR THE BOOKS. SO SOMETHING WAS MISSING FROM THAT FULL TEXT. HOW MANY PEOPLE KNOW THIS? THE ABSENCE OF GOOGLE SCHOLAR? LET'S TALK ABOUT INTERNET SEARCH NAMINGS. THE JOHN -- ENGINES. THE FIRST EVIDENCE OF EXHEX PULMONARY TOXICITY WAS FOUND ON THE INTERNET. GOOGLE AND YAHOO FOUND THE HEXAMETHONIUM SIGHT BUT THE OTHER SEARCH ENGINES DIDN'T. HELEN WAS ALREADY HER WAY TO THE ICU AT THIS TIME. IT DID NOT HELP HER SITUATION BUT THERE WAS A SITE DEVOTED TO HEXAMETHONIUM RESEARCH THAT WAS FOUND BY THE INVESTIGATOR. CURRENTLY, AND I THINK THIS IS DATA, I THINK IT'S HIGHER THAN THIS NOW, ABOUT ONE IN EVERY 20 GOOGLE SEARCHES IS FOR A HEALTH RELATED TERM. THESE SEARCH ENGINES, ACCESS AND INCREASING AMOUNT OF INFORMATION. SOME OF IT, MUCH IS IN FULL TEXT. IT'S IMPORTANT TO LEARN HOW TO SEARCH USING ADVANCED SEARCH FEATURES. YOU CHANGE THE PREFERENCES TO SEE MORE WITH LESS WORK. AND YOU USE DIFFERENT SEARCH NIGERIAS TO TAKE -- ENGINES. SO WHO CAN TELL ME WHY THEY DOING THIS? WHAT IS THE BUSINESS MODEL. WHY IS GOOGLE GIVING YOU INFORMATION, WHAT ARE THEY DOING? >> I THINK THAT'S RIGHT. THEY'RE A BILLBOARD SERVICE ON THE INFORMATION HIGHWAY, SELLING AD SPACE TO OTHER PEOPLE SO THAT -- BASICA LLY SELLING YOUR EYEBALLS. SO IF THEY CAN FIGURE OUT WHAT YOU WANT SO YOU KEEP USING THEM THEY CAN KEEP SELLING THE AD SPACE. WHETHER THEY'RE INCENTIVES FOR ACCURACY AND COMPLETENESS, WELL, THEY WANT YOU TO KEEP COMING BACK. BUT THEY DON'T NECESSARILY INDICATOR TO RESEARCHERS PER SE, THEY CATER TO EVERY ONE. AND IT'S A BLACK BOX. THEY WON'T TELL YOU EXACTLY HOW THEY DO THEIR RANKING, BECAUSE THERE IS AN INDUSTRY NOW CALLED SEARCH ENGINE OPTIMIZATION. EXPLAINED IN THIS NEW YORK TIMES ARTICLE FROM 2011. SEARCH OPTIMIZATION, DIRTY LITTLE SECRECIES. COMPANIES HAVE MADE MILLIONS OF DOLLARS IN BEING HIGHER IN THE SEARCH ENGINE RANKS, BY BEING IN THE TOP TEN OF GOOGLE SEARCH RESULTS. GOOGLE FILLS IF THEY GIVE OUT THEIR SECRETS, PEOPLE GAME THE SYSTEM, BUT PEOPLE FIGURE OUT EXACTLY HOW GOOGLE DOES ITS RANKS BY DEDUCTION, BUT FIGURING OUT IF THIS WORKS, WHAT AM I -- HOW CAN I INCREASE MY RANKINGS? IT'S A PROMISING TECHNOLOGY. IT HAS INCREASINGLY POWERFUL CAPABILITIES BUT INDIFFERENT RESULTS, LACK OF SEARCH DOCUMENT ALLEGATION, LACK OF CONFIDENTIALLY. IT USED TO BE THAT GOOGLE WOULD EXTREME THE SEARCHES ACROSS THE SCREEN IN THEIR LOBBY. SO -- IN MOUNTAIN VIEW AT THE GOOGLE PLEX. HERE ARE LINKS TO HOW TO USE THE SEARCH -- ADVANCE SEARCH IN GOOGLE. GOOGLE WANTS YOU TO ONLY SEE TEN RESULTS. WE STRONGLY ADVISE YOU TO SEE 100 RESULTS. AND HERE IS HOW TO DO IT. SIMILAR FOR GOOGLE SCHOLAR, FULL TEXT JOURNAL ARTICLES, BOOKS, PATENTS,DISTER STATIONS, NOW CASE LAW CHANGED THE PREFERENCES. THIS IS ANOTHER PREFERENCE CHANGE YOU CAN DO FOR GOOGLE SCHOLAR. THAT IS, YOU CAN ACTUALLY SET UP A LIBRARY LINK FOR YOUR LIBRARY OR IN THIS CASE NIH. YOU CAN CHECK THE BOX FOR NIH LIBRARY FULL TEXT PLUS USING THESE DIRECTIONS. AND THAT MEANS WHEN YOU'RE AT HOME, YOU'VE GOT THE BOX CHECKED. YOU HAVE YOUR PREFERENCES SAVED. YOU HAVE TO ENABLE COOKIES TO DO IT. AND IT WILL SHOW YOU WHAT IS IN THE NIH LIBRARY HOLDINGS THAT YOU CAN GET ACCESS TO. AGAIN IT'S THE SAME TASTE BEHIND THE SCENES THAT I MENTIONED WITH THE JOURNAL PERIODICAL SUBSCRIPTIONS. WE HAVE GIVEN GOOGLE ACCESS TO IT SO THAT PEOPLE CAN ACTUALLY SEE AND NAVIGATE DIRECTLY TO OUR JOURNALS IF THEY'RE SIGNED IN USING THAT REMOTE. SO WE TALKED ABOUT PHRASE SEARCH WITHIN DOUBLE QUOTES. I'M SURE MOST OF YOU KNOW ABOUT THAT. HOW MANY OF HEARD ABOUT EXCLUDE? THAT MEANS SAY I'M LOOKING FOR VIRUSES BUT CONTINUE WANT COMPUTER VIRUSES, I WOULD SAY VIRUS SPACE MINUS WITHOUT A SPACE COMPUTER. SO VIRUS SPACE HYPHEN COMPUTER, I WOULD NOT GET ANY RESULTS THAT SAY COMPUTER IN THEM. OF COURSE I WOULDN'T GET A LIST OF COMPUTERIZED LIST OF VIRUSES, EITHER, BECAUSE IT SAYS COMPUTER IN IT. SO IT DOESN'T UNDERSTAND DOUBLE NEGATIVES. WE COULD ALSO SPECIFY DIFFERENT KINDS OF FILE TYPES. IF I'M LOOKING FOR VERY RECENT MATERIAL THAT SUMMARIZES A NEW RESEARCH METHOD, LET'S SAY COMPUTATIONAL PHOTOGRAPHER, I MIGHT SAY COMPUTABLE PHOTOGRAPHER, AND THEN SAY URL: EDU. I'M LOOKING FOR LECTURE NOTES FROM STANFORD, M.I.T., HARVARD. AVAILABLE FROM GOOGLE THAT TALKS ABOUT THIS NEW FIELD. SO AGAIN BEFORE THERE IS EVEN A REVIEW PUBLISHED. ONE OTHER LITTLE SEARCH NOTE, WHEN YOU SEARCH FOR A WORD OR FOR A WORD IN A WORD DOCUMENT, YOU WOULD TYPE CONTROL F. SAME THING FOR SEARCHING FOR A WORD IN A WEB PAGE. CONTROL F. VERY IMPORTANT. SO DOUBLE QUOTES. CONTROL F COULD SAVE YOU A LOT OF TIME. TO LEARN MORE ABOUT INTERNET SEARCHING WE HAVE AN NIH LIBRARY CLASS. THERE IS A LINK TO THE HANDOUTS HEAR. THE HANDOUT HAS BEEN UPDATES, HAS SOME DIRECTORIES. IT'S USEFUL, EVEN WITHOUT THE CLASS AND AVAILABLE TO EVERYONE, NOT JUST PEOPLE AT THE NIH. ALSO AVAILABLE TO EVERY ONE. WE HAD DANIEL RUSSELL OF GOOGLE AND DUANE FROM BING HERE A FEW YEARS AGO IN FEBRUARY, 2013. AND THERE IS A LINK TO THAT VIDEO CAST HERE ON THIS SLIDE. DANIEL RUSSELL HAD SOME INTERESTING QUESTIONS, HOW TO SOLVE IMPOSSIBLE PROBLEMS. IN THIS CASE, AND THIS IS AN EXAMPLE OF AN IMPOSSIBLE PROBLEM, THE QUESTION HERE FOR THIS PICTURE IS WHAT'S THE PHONE NUMBER OF THE OFFICE WHERE THIS PICTURE WAS SNAPPED? I'LL GIVE YOU A CLUE. THERE IS A LITTLE LOGO THAT CAN MAYBE HELP. I'M NOT GOING TO GIVE THE ANSWER AWAY. IF YOU WANT TO SEE THE ANSWER YOU CAN EITHER READ THE LINK, THE ARTICLE HERE ON THE BLOG IN THE LINK OR HERE HIM TALK ABOUT IT AT THE VIDEO CAST. HE HAS FREE SEARCHES, FREE COURSES, ONLINE COURSES FROM GOOGLE, BECOME A GOOGLE POWER SEARCHER. HE SPEAKS A LOT ABOUT GOOGLE SEARCH CAPABILITIES AND DETECTIVE LOGIC. VERY USEFUL CAST, AVAILABLE FREE. YOU PROBABLE HEY NEED A FREE GMAIL ACCOUNT TO USE THEM. BING, BING IS AVAILABLE FROM MICROSOFT. GOOGLE HAS ABOUT A 75% MARKET SHARE IN THE U.S. RIGHT NOW. AND BING HAS ABOUT 25% MARKET SHARE. AND INTERESTINGLY, THEY BOTH GIVE VERY USEFUL RESULTS. IT'S NOT CLEAR WHICH ONE HAS THE LARGER DATABASE OF WEB PAGES. THEY BOTH HAVE VERY LAWFIRM DATABASES BUT THEY -- LARGE DATABASES BUT THEY HAVE SLIGHTLY DIFFERENT RANKING ALGORITHMS. WHAT YOU'RE LOOKING FOR IS THOSE FIRST TEN OR FIRST 50 OR FIRST 100 RESULTS, AND THEN CLICK THE PAGE, SEE THE NEXT. SO HERE IS HOW TO CHARACTER THE PREFERENCES. IN BING, YOU CAN ONLY CHANGE FROM 10 TO 50. HERE IS THE ADVANCE. HEAR ARE TWO OTHER SEARCH ENGINES WITH NOT QUITE SO LARGE DATABASES, WEB PAGES, BUT OTHER USEFUL FEATURES. EXALEAD ALLOWS TRUE PROXIMITY SEARCHES, MEANS THIS WORD IS NEXT TO THIS WORD. MAYBE SOME ASSOCIATION BETWEEN THEM,CO ASSOCIATED VIRUSES, COMPUTER VIRUS. MAYBE -- RATHER THAN A PHRASE SEARCH, SOMEBODY ASKED ME -- IT USED TO HAVE FANATIC SEARCHING. PHONETIC SEARCHING. THERE WAS A NEW VACCINE CALLED -- NEW DRUG CALLED CELL CENTURY. THEY ASKED ME FOR INFORMATION. I SAID HOW DO YOU SPELL THAT? THEY SAID I DON'T KNOW, IT'S A DRUG. PROBABLY HAS A UNIQUE SPELLING. I LOOKED IT UP USING PHONETIC AND IT'S C, O-Z-R-E-N-T-R-I. I NEVER WOULD HAVE FIGURED THAT OUT. I FOUND IT RIGHT WEIGH. I BELIEVE THAT SINCE THEY DID IT, NOW GOOGLE AND BING HAVE INCORPORATED BEHIND THE SCENES PHONETIC SEARCHING INTO THEIR WRENCH SEARCH -- SEARCH RESULTS. THERE ARE MANY THINGS WE HAVE TO FIGURE OUT THAT ARE NOT WRISTED. IF I DO A SEARCH ON ONE TOPIC AND MY FRIEND IN CALIFORNIA DOES THE SAME TOPIC, IF WE'RE ON THE PHONE WE COULD HAVE DIFFERENT RESULTS. ONE OF THE ROPES IS MY PREVIOUS AND THEIR PREVIOUS WRENCHES ARE DIFFERENT, THEREFORE, THE PERSONALIZATION, AUTOMATIC PERSONALIZATION IMPOSED BY GOOGLE OFTEN, IF YOU'VE LOGGED IN, SIGNED IN, AND MANY DO WITHOUT REALIZING IT BECAUSE THEY HAVE A GMAIL ACCOUNT OPEN AT THE SAME TIME, HAS COLORED THE RESULTS THAT I WILL GET. THAT'S PERSONALIZATION. ANOTHER IS THAT THE TWO SEARCHES GO TO DIFFERENT SEARCH CENTERS. SO WE COULD GET DIFFERENT RESULTS. I TALKED ABOUT PRIVACY. DUCK DUCK GO ADVERTISES THAT THEY WILL NOT CAPTURE YOUR QUESTIONS. THEY WILL NOT PERSONALIZE SEARCH RESULTS. THEY WON'T TRACK YOUR QUERIES. SO THEY'VE GOTTEN A LOT OF -- LOT MORE MARKET SHARE. STILL VERY TINY SINCE RECENT REVELATIONS ABOUT PRIVACY. I WAS ASKED TO FIND STUDIES THAT USED THE 7 DAY DOSE FOR NON COMPLIANT PATIENT. AND RATHER THAN -- YES, I STARTED WITH PUBMED. I LOOKED AT REVIEWS. I SAID THIS IS TAKING TOO LONG. I DIDN'T EVEN USE THE NURL: OR THE -- OR INSIGHT: FOR NCBI. I LISTED IT HERE. I LOOKED FOR IT HERE AND THEN NCBI, BECAUSE I KNOW THAT THEY'RE BE VERY CLOSE, BECAUSE THIS IS WHERE ALL PUBMED SEARCHES -- RESULTS, THE URL FOR ALL PUBMED RESULTS. I FIND TWO VERY NICE RESULTS THAT I WAS ABLE TO SEND OFF TO THE PRACTITIONER. HEAR IS A SIMILAR SEARCH FROM GOOGLE, IN THIS CASE, BECAUSE OF THE BLOW UP I WAS ABLE TO SHOW THREE. BUT I DID FIND THOSE SAME THREE IN THE RESULTS FOR THE BING SEARCH AS WELL. THEY INDEXED MED LINE. YOU CAN FIND THEM USING THE APPROPRIATE LOGIC. VERY IMPORTANT, NOT NEGLECTED. ANOTHER THING VERY IMPORTANT, BIO INFORMATICS. IF YOU GO TO THE PUBMED WRENCH WINDOW AND GO TO ALL RESOURCES WHICH IS ABOVE THE WRENCH WINDOW MUCH -- SEARCH WINDOW, GO TO RESOURCES HERE, AND I CLICK ON OLDNESSES, THIS GIVES A LIST OF ALL THE NCBI, AND NC -- CBI IS A SUBCAN VISION OF THE NATIONAL -- AGAIN, WITH DESCRIPTIONS. AND THEY ARE ALL FREE. WE ACTUALLY HAVE BIO-INFORMATICS GROUP. WE HAVE DESCRIPTIONS FROM THE NIH LIBRARY HOME PAGE. YOU MAY WANT TO CHECK YOUR OWN PARENT INSTITUTIONS TO SEE IF YOU ALSO HAVE ANY OF THESE RESOURCES AVAILABLE TO YOU. KIND OF HARD THESE DAYS TO EVEN THINK ABOUT DOING CLINICAL MEDICINE WITHOUT SOME KIND OF ACCESS TO BIOINFORMATIC INFORMATION. HEAR IF I CLICKED ON THE NIH LIBRARY SERVICES, BIOFORMIC SUPPORT, HERE IS [INDISCERNIBLE] WHO ACTUALLY HAS SPOKEN IN THIS LAB PREVIOUS YEARS. RECEIVING AN AWARD, ONLINE TUTORIALS, CLASSROOM TRAINING. HERE IS THE ONLINE BIOINFORMATICS -- WHICH ARE AVAILABLE TO ALL USERS FOR FREE, AT LEAST THE LENGTHS ARE. WE MAY NOT HAVE -- LINKS R YOUR INSTITUTION MAY NOT HAVE THE SUBSCRIPTIONS TO SOME OF THESE BUT THESE TUTORIALS ARE AVAILABLE. HERE ARE SEVERAL RELATIVELY RECENT LECTURES ABOUT MINING NETWORKS OF DATA AND INFORMATION FOR DISCOVERY OF DISEASE. MECHANISMS AND NEW THERAPEUTICS. THE EMERGING NETWORK OF DATA FOR UNDERSTANDING THE INTERACTIONS OF DRUGS BY [INDISCERNIBLE]/STANFORD. KEVIN WHITE. AND ALSO [INDISCERNIBLE] WHO USED TO BE AT STANFORD, NOW UCSF. TRANSFORMING 300 BILLION POINTS OF DATA INTO DIAGNOSTIC THERAPEUTICS. THE NIH IS PARTICIPATING AND LEADING A PRECISION MEDICINE INITIATIVE, INCLUDING PLANS FOR A RESEARCH COHORT OF MORE THAN 1 MILLION VOLUNTEERS WILL SHARE GENETIC INFORMATION, BIOLOGICAL SAMPLES, DIET, LIFE STYLE INFORMATION. HERE IS A LINK TO THAT INITIATIVE. AND HERE IS A NICE SLIDE THAT I GOT FROM KEVIN WHITE ABOUT INTEGRATION AND BUILDING PREDICTIVE MODELS USING FROM THE BOTTOM LITERATURE AND TEXT MINING, GENE EXPRESSION DATA, ELECTRONIC MEDICAL RECORDS, METABOLOME, PROTEOME -- VERY IMPORTANT. ALSO IMPORTANT TO BE ABLE TO MANAGE YOUR DATA. EMERGING SUBJECT IN CLINICAL RESEARCH. WE HAVE A SERVICES GUIDE AT THE NIH LIBRARY WHICH, AGAIN, PEOPLE CAN ACCESS. THEY INCLUDE INTRODUCTION TO DATA MANAGEMENT, FINDING, REUSING SCIENTIFIC RESEARCH DATA, DESCRIPTIONS, ORGANIZATION, BREEZIERVATION, RETENTION, STORAGE, VISUALIZATION TOPICS, EXAMPLES. ONE SMALL EXAMPLE, LET'S TALK ABOUT A DATA LIFE CYCLE. YOU WANT TO START IN WRITING, YOU START THE PROJECT, COLLECT THE DATA. YOU ANALYZE THE DATA, MAYBE YOU DO IT MORE THAN ONCE. YOU REPURPOSE THE DATA. YOU SHARE THE DATA. THEN IT'S THE END OF THE PROJECT, YOU DEPOSIT THE DATA. THE DATA ARCHIVED AND THEN REUSE THE DATA FOR DISCOVERY. IT'S AN INTERACTIVE -- ITERATIVE PROCESS. IT'S NOT LINEAR. THERE IS A PREPROJECT DATA MANAGEMENT PLAN WHERE YOU CONSIDER WHAT KIND OF FORMATS, PRYORTRY VERSES OPEN FOREMANETS, COLLECTION. WHERE ARE YOU GOING TO PUT THESE DATA. HERE IS AN INTERESTING ARTICLE FROM 2007 THAT SHOWS THAT SHARING DETAILED RESEARCH DATA IS ASSOCIATED WITH INCREASED CITATION RATE. ABOUT THAT INCREASED CITATION RATE, PEOPLE, ESPECIALLY YOUNG SCIENTISTS AT THE BEGINNING OF THEIR CAREER AND MIDDLE OF THE CAREER AND LATER ON, ARE VERY INTERESTED IN HOW THEY'RE CITED. WHAT THEY'RE H INDEX S IMPACT FACTORS ARE. THIS WHOLE ISSUE IS CALLED [INDISCERNIBLE] METRICS, ANALYSIS OF PUBLICATIONS. USED TO MEASURE IMPACT OF AN AUTHOR, SUBJECT AREA, PORTFOLIO. WE HAVE SOBBINGLIO METIC SERVICES AT THE NIH LIBRARY DESCRIBED AT A URL. WE HAVE JOURNAL CITATION REPORTS FROM THE WEBB OF SCIENCE. WE SUBSCRIBING TO IT. YOUR INSTITUTION MAY ALSO. HERE IS AN EXAMPLE OF THE H INDEX. AGAIN, SCOPIST AND WEB OF SCIENCE GIVES YOU AN HIGHWAY INDEX. BRIEFLY, HIGHWAY INDEX IS HOW MANY PUBLICATIONS YOU'VE GOT AND HOW MANY CITATIONS THOSE POLITICIANS HAVE RECEIVED, SO IF YOU HAVE AN H INDEX OF 20 YOU'VE WRITTEN AT LEAST 20 PAPERS, EACH CITED AT LEAST 20 TIMES, H INDEX OF 20 IS QUITE GOOD BY THE WAY. IF YOU WANT TO GET SOME INFORMATION FREE, THERE IS A SITE CALLED PUBLISH OR PERISH, WHICH USES GOAL SCHOLAR AND MICROSOFT ACADEMIC SEARCH. MICROSOFT ACADEMIC SEARCH IS KIND OF THE BING EQUIVALENT OF GOOGLE SCHOLAR. AND IT IS ALWAYS QUITE INTERESTING, AS DIFFERENT INFORMATION IS WORTH TAKING A LOOK AT THIS WEBSITE. WE HAVE MORE INFORMATION OF THIS CAMPUS GUIDE. THIS IS GOOGLE SCHOLAR METRICS PRESCRIBED HERE MEASURING YOUR RESEARCH IMPACT. AND A SCHOLAR METER, A SOCIAL TOOL TO FACILITATE CITATION ANALYSIS. SO IT'S QUITE AN INTERESTING AND USEFUL TOPIC. NEXT, ASSUMING THERE IS A NEXT. DATA MANAGEMENT -- THERE IS A SPECIAL SUBSET THAT MEAN PEOPLE ARE INTERESTED IN WHERE YOU HAVE A VERY CLEARLY FORMULATED QUESTION USING SYSTEMATIC AND EXPLICIT METHODS TO FIND REVIEWS AND TO CHECK THE LITERATURE WITH AN INCLUSION AND ESCLUSION CRITERIA. AND VERY CAREFULLY DESCRIBED SYSTEM OF GOING THROUGH IT, SYSTEMATIC REVIEWS ARE GETTING TO BE THE GOLD STANDARD. WE HAVE -- WE ACTUALLY HAVE A -- ANOTHER WEB PAGE THAT HAS LINKS ALSO TO GOLD STANDARDS ORGANIZATION, LITERATURE SOURCES, GUIDES, DOCUMENTING YOUR WORK, PROTOCOLS AND PROTOCOL REGISTRIES, RESOURCES, AGAIN, AT THE NIH LIBRARY AVAILABLE TO ANYONE. THE PREFERRED REPORTING ITEMS FOR SYSTEMATIC REVIEWS META-ANALYSIS PAGE, CHECKLIST IS LISTED HERE. AND THERE IS A ALSO A LINK TO THE STANDARDS FOR SYSTEMATIC REVIEWS BY THE INSTITUTE OF MEDICINE NATIONAL ACADEMIES HERE AT THE BOTTOM OF THIS PAGE. WE'VE COVERED A LOT OF RESOURCES. KIND OF A LOT TO REMEMBER. I'VE GIVEN YOU SOMEWHAT EXTENSIVE NOTES. SO YOU WOULDN'T HAVE TO TAKE AS MANY NOTES. BUT HERE IS KIND OF AN OVERVIEW OF MANY OF THE RESOURCES I'VE MENTIONED WITH LITTLE NOTES TO HELP YOU REMEMBER IT. PUBMED. FREE. EMBASE IS NOT FREE. COCHRAN IS -- SOME IS FREE. THE REVIEWS IN PUBMED ARE FREE. THEY'RE FREE IF YOU'RE IN CERTAIN COUNTRIES. IT IS A SUBSCRIPTION DATABASE. GUIDELINE CLINICAL TRIALS ICTRP, ALL FREE. TOXNET, NCBI, MED WATCH, REPORTER, THESE ARE FREE. SOME NOT FREE. SO HAVE IS KIND OF A QUICK CHECK LIST TO HELP YOU REMEMBER. BUT I DID NOT INCLUDE ALL THE DATABASES THAT WE USE ROUTINELY BECAUSE, WELL, THIS IS ONLY AN HOUR, HOUR 15 MINUTE LECTURE. SO THERE ARE OTHERS BEYOND HERE. DEPENDING ON YOUR TOPIC. LET'S TALK ABOUT KIND OF A GENERAL MODEL FOR WRENCH STRATEGY. THIS IS A MODEL THAT I FRANKRY USE A LOT. IT'S A VERY USEFUL GENERAL MODEL. WE TALKED ABOUT BREAKING THE QUARRY INTO ESSENTIAL COP ACCEPTS. CONCEPTS, USING THE PICO METHOD, OR OTHER KINDS OF CONCEPT BASED SEARCHING. FINDING SINO PRIME MINISTERS OR ALTERNATIVE TERMS FOR EACH OF THE CONCEPTS. USE THE VOCABULARIES FOR THE CONCEPTS AND THEN EXPAND AND REDUCE THE RETRIEVAL. USING THE OR OR AND LOGIC. AND USES MANY INFORMATION RESOURCES AS NECESSARY. ANOTHER VERY POPULAR METHOD, VERY USEFUL METHOD IS TO SEARCH FOR INFORMATION TO FIND MORE INFORMATION. IF I CAN FIND SOME KEY CITATIONS, AND BY THE WAY, I HAVEN'T MENTIONED WIKIPEDIA YET. I CAN USE WIKIPEDIA TO FIND KEY CITATIONS IN THE FOOTNOTES. WIKIPEDIA IS WELL REVIEWED, PARTICULARLY THE FOOT NOTES. SO OFTEN THE FOUGHT KNOTS, MORE THAN WHAT IT SAYS IN THE CONTEXT iIN THE ACTUAL ARTICLE, CHECK THE FOUGHT NOTES. AND THEN -- OR GOOGLE OR BING. FIND KEY ARTICLES AND SEARCH FOR THESE KEY ARTICLES IN PUBMED, OR ELSE WHERE, TO FIND THE VOCABULARY TERMS USED TO DESCRIBE THEM AND THEN EXPAND YOUR LIST USING THAT. ALSO USE THESE KEY CITATIONS AND CITED REFERENCES SEARCHING. THAT IS SCOPIST OR WEB OF SCIENCE, GOOGLE SCHOLAR. REPEAT AS NECESSARY. AGAIN, ITERATIVE. KEEP TRACK OF ALL SEARCHES AND RETRIEVALS. THIS IS A LITTLE BIT DIFFICULT TO DESCRIBE. I COPY A SEPARATE WORD DOCUMENT WITH MY QUERIES. COPY AND PASTE. AND MY DATE. AND TO KNOW WHICH DATABASES I'VE SEARCHED, ON WHICH DATE, AND MAYBE SOME OF MY RETRIEVAL JUST TO KEEP TRACK. I DO AT -- DO A LOT OF SEARCHING. IT'S HARD TO REMEMBER. I CAN'T REMEMBER REALLY REMEMBER THE TOPIC BUT LET ME CHECK MY NOTES, OH, YES. AND THEN YOU WANT TO REMOVE YOUR DUPLICATE RETRIFLES. HOW? -- RETRIEVALS. HOW TO YOU DO THAT? WE HAVE AN NIH-WIDE SUBSCRIPTION TO N NOTE HERE, AND INNOTE IS A VERY USEFUL DATABASE SPECIALIZED FOR MANAGING CITATIONS. BUT IF YOU DON'T HAVE A SUBSCRIPTION, IF YOU'RE NOT AT THE NIH, THERE ARE FREE BIBLIOGRAPHIC LEO GRAPHIC CITATION MANAGERS, [INDISCERNIBLE]. SO HERE A WIKIPEDIA ARTICLE WITH A COMPARISON OF THE REFERENCE MANAGEMENT SOFTWARE. IF YOU CAN'T FIGURE OUT WHAT YOU'RE RETRIEVAL IS AND HOW YOU MOVE DUPLICATES YOU MIGHT BE WASTING A LOT OF YOUR TIME. BACK UP TO THE TOP OF THE SLIDE WE TALKED ABOUT THE PICO OUTLINE. INSTEAD OF POPULATION, IT COULD ALSO BE PATIENT OR PROBLEM. INTERVENTION. FOR THE EYE, COMPARISON CONTROL. OUTCOME OR EFFECTS. WE HAVE A LINK TO THE SEARCHING PROCESS PROTOCOL FOR RESEARCHERS, VERY NICE OUTLINE. AND AGAIN, AS I MENTIONED EARLIER, THAT YOU WANT TO CHECK YOUR RESEARCH UPDATE, SET YOUR SEARCHES TO REPEAT AUTOMATICALLY WHEN THE DATABASE IS UPDATED USING MY NCI IN PUBMED OR SIMILAR PROCESSES IN OTHER DATABASES. SO YOU'VE IDENTIFIED AND SEARCHED ALL REALLY RESOURCES. YOU UNDERSTAND THE SCOPE AND COVERAGE. YOU UNDERSTAND HOW EACH SEARCH ENGINE WORKS, WHAT IT SEARCHES, THE ASSUMPTION IT MAKES, WHETHER THE PLURALS ARE AUTOMATICALLY INCLUDE, BRITISH SPELLINGS. ,. THE SEARCH TERMS THAT ARE ORED WITH EACH OTHER. GOOGLE WEB SEARCH ENGINES, RESULTS MAY BE INCONSISTENT. THERE MAY BE MANY ASSUMPTIONS. YOU ALREADY KNOW YOUR KEY ARTICLES AND SEARCH RESULTS INCLUDE KNOWN RELEVANT ARTICLES. IF YOU ASK OTHER PEOPLE TO WRENCH, THEY'LL GIVE YOU KNOW NEW RELEVANT RESULTS. THESE ARE SOME KINDS OF CHECKS OF QUALITY. CAN YOU TRUST YOUR SEARCH RESULTS? WHEN IS THE SEARCH COMPETE? THESE VERY HARD QUESTIONS. AGAIN, THAT 19676 -- THAT ARTICLE ABOUT 1966, AND WHEN IS A SEARCH COMPLETE? EXPERIENCE, FOLLOWING UNDER THE GUIDELINES OF AT THISGESTION, VERIFYING THE STRATEGY. OH, YES, COLLABORATING WITH A REFERENCE LIBRARIAN. PHARMACIST WHO DO THIS KIND OF WORK ALL THE TIME, AND WOULD BE HAPPY TO HELP. HERE ARE SOME RESOURCES FOR CONDUCTING SEARCHES AND THE GUIDELINES FOR DETERMINING ADEQUATE AND COMPREHENSIVE LITERATURE SEARCH DRUG AND DEVISE SAFETY FOR USE BY INVESTIGATOR AND INSTITUTIONAL REVIEW BOTHERS, I MENTIONED FROM MT. SINAI SCHOOL OF MEDICINE. THE BEGINNING. IT'S GOT A VERY GOOD OVERVIEW, A SEARCH LOCK, SUMMARY AND BIBLIOGRAPHIC FORM, LIST OF SOURCES. A LITTLE BIT DATED FROM 2003, IT'S BRITISH, IT HAS SOME RESOURCES THAT WE DON'T HAVE. NEVERTHELESS IF THERE IS A SINGLE PIECE OF REFERENCE THAT I WOULD LIKE YOU TO TAKE A LOOK AT, IT'S THIS ONE. TAKE A LOOK. SEE HOW OTHERSDITE. THINK ABOUT ADAPTING IT TO YOUR OWN -- EVEN IF YOU'RE NOT GOING TO BE SEARCHING. MAYBE MORE IMPORTANTLY IF YOU'RE NOT SEARCHING ALL THE TIME. BECAUSE THEN YOU CAN TRACK IT. YOU CAN SEE WHAT YOU DID. THERE ALSO A GOOD CHECKLIST AT THE SECOND ONE LISTED HERE FROM YALE. FINAL NOTES. ANKMENTS. ACKNOWLEDGMENTS. WE HAVE AN NIH LIBRARY E-MAIL NEWS FOR NIH STAFF. YOU CAN SUBSCRIBE HERE. THERE IS A LINK AND IT'S ALSO FROM THE NIH LIBRARY HOME PAGE. I WOULD LIKE TO ACKNOWLEDGE NIH LIBRARY STAFF WHO HELP HE HAD ME WITH THIS PRESENT -- HELPED ME WITH THIS PRESENTATION. [LIST OF NAMES]. AND THE NIH OFFICE OF THE DIRECTOR, OFFICE OF RESEARCH SERVICES FOR WHICH I WORK. I HAVE A FAVOR TO ASK YOU. POLICE FILL OUT THE LECTURE EVALUATION. EVERY YEAR, WE TRY TO MAKE THESE LECTURES BETTER, TRY TO MAKE THEM AS GOOD AS WE CAN. AND ALSO, JUST A PERSONAL NOTE, I HAVE BEEN ASKED TO HELP WRITE A CHAPTER FOR THE UPDATED TEXTBOOK SO I COULD REALLY USE ANY FEEDBACK THAT YOU HAVE, ANY DISCUSSIONS. JUST A PERSONAL FAVOR, PLEASE, FILL OUT THE LECTURE EVALUATIONS. NOW, YOU CAN SEND ME QUESTIONS. HERE IS MY E-MAIL. BUT DO YOU HAVE ANY QUESTIONS THIS EVENING FOR ME HERE IN THE ROOM? QUESTIONS? I KNOW WE WENT FAST. 73 SLIDES IN 75 MINUTES. BUT MY QUESTION IS, WAS THERE ANYTHING NEW? WAS THERE ANY -- YES, THERE WERE SOME NEW THINGS. WAS THERE ANYTHING THAT YOU NEED A LITTLE BIT EXPLANATION? OR ARE YOU OVERWHELMED AND NEED TO GO BACK TO THE SLIDES AND CHECK IT OUT, PERHAPS? I'M A CHEMIST, AND I USED TO WORK IN THE LABORATORY. AND I NOTICED THAT WHAT I REALLY ENJOYED WAS GOING TO THE LIBRARY AND FINDING OUT ABOUT A NEW PROJECT. I MOVED DOWN THE HALL FROM THE LAB TO THE LIBRARY. I NEVER STOPPED BY A CHEMOTHERAPIST. I HAVE TO TELL YOU, I BRING THAT ANALYTICAL APPROACH TO SOME OF THE WAYS I THINK ABOUT SEARCH. I HOPE THIS HAS BEEN OF HELP TO YOU, KIND OF AN OVERALL ENGINEERING APPROACH. IT WOULD BE -- I COULDN'T EVEN EXPLAIN HOW MUCH TIME I'VE SAVED BY SOME OF THESE TRICKS THAT I'VE SHOWN YOU TONIGHT. CONTROL F, SOME PEOPLE DIDN'T KNOW ABOUT THAT. SOME OF THESE GOOGLE SEARCHES. THE EXAMPLES I SHOWED YOU ARE JUST KIND OF THE TIP OF THE ICEBERG. SO I THANK YOU VERY MUCH FOR YOUR ATTENTION, AGAIN, IF YOU HAVE ANY QUESTIONS PLEASE E-MAIL ME OR I'LL BE HERE FOR A FEW MORE MINUTES. THANK YOU AGAIN.