search this site.

091025P - ABSTRACTS FOR WORKSHOP ON ESSENTIALS OF EPIDEMIOLOGY IN PUBLIC HEALTH: MODULE OF DATA INTERPRETATION AND PRESENTATION

Print Friendly and PDFPrint Friendly


HEALTH STATUS

Presented at an Interactive Workshop on Essentials of Epidemiology in Public Health at the Department of Social and Preventive Medicine University Malaya Kuala Lumpur Malaysia 19-25 October 2009 by Professor Omar Hasan Kasule Sr MB ChB (MUK), MPH (Harvard), DrPH (Harvard) Professor King Fahad Medical College Riyadh; Professor of Epidemiology and Islamic Medicine Institute of Medicine University Brunei Darussalam, Visiting Professor of Epidemiology University of Malaya



HOSPITAL INFORMATION SYSTEMS
Medical records departments collect, store, and access information used for health care, financial or administrative reasons. Quality control is needed to eliminate inaccuracy and inconsistencies. Privacy and confidentiality are balanced against the need for timely information by caregivers. SOAPIE, the acronym for problem-oriented medical recording, stands for Subjective complaints, Objective complaints, Assessment, Plan, Intervention, and Evaluation. The electronic medical record (EMR) enables clinical data net-working, direct on-line data entry from terminals in wards, record linkage, and record integration. Hospital records are analyzed for process and outcome performance indicators, planning and projections, cost analysis, assessing access and affordability, and surveillance.

PUBLIC HEALTH INFORMATION SYSTEM

Health care information is used for decision making, problem solving, and planning. It is sourced from demographic data, morbidity data, morbidity data, health care utilization, hospital care records, outpatient treatment records, environmental monitoring, occupational monitoring, health care activities, needs assessment, disease registers, health surveys, injury and accident monitoring, and vital statistics.

DISEASE REGISTRIES WITH CANCER AS AN EXAMPLE
Cancer registration is continuing and systematic collection of data on reportable neoplasms. The data is comprehensive including socio-demographic, clinical, laboratory, radiological, and treatment variables. The hospital cancer registry helps physician in follow-up of patients, sends data to outside registries (community, regional, or national cancer registries), and is used for hospital-based epidemiological studies (incidence and prevalence, immediate causes of death, survival, and treatment). The hospital cancer registry is a good source of controls for case control studies of cancer etiology. Disease registries are also available for other diseases.

VITAL HEALTH STATISTICS INTERPRETATION
Vital statistics are from mandatory reporting. They generate hypotheses for further investigation. They are analyzed in conjunction with ecologic or environmental data. The following statistics can be computed from vital statistics. Crude Birth Rate (CBR) is births per 100,000 of mid-year population per year.  Premature Birth rate is births at gestation age 28-38 weeks per 1000 live births per year. Low birth weight rate is births < 2500 g per 1000 live births per year. Very low birth weight rate is births < 1500 g per 1000 live births per year. Crude Death Rate (CDR) is deaths in a year per 100,000 of mid-year population. Proportional Mortality Ratio (PMR) is deaths of a specified kind as a proportion of the total number of deaths. Case-fatality ratio is the proportion of deaths from persons with a specified disease condition. Fetal death rate is deaths >= 20 weeks per 1000 births (live births + still births) per year. Fetal death ratio is death =<20 weeks per 1000 1000 live births. The abortion ratio is number of induced abortions per 1000 live births. The Infant Mortality Rate (IMR), the most important indicator of community health, is deaths at ages 0-12 months per 1000 live births per year. The Total Neonatal Mortality Rate is deaths within 1-28 days of birth per 1000 live births. The Early Neonatal Mortality Rate is deaths within 7 d of birth per 1000 live births per year. The Late Neonatal Mortality Rate is deaths at age 7-28 days of birth per 1000 live births per year. Post Neonatal Mortality Rate is deaths aged 28days -1 year of birth per 1000 live births per year. Peri-natal Mortality Rate is deaths aged > 28 weeks up to 7 days of birth per 1000 total births (live births + stillbirths) per year. The perinatal mortality ratio is the number of fetal deaths >= 28 weeks + deaths within one week of birth per 1000 live births. Maternal Mortality Rate is deaths in pregnancy or within 42 days of delivery per 100,000 births. Marriage rate is marriages in a year per 1000 of population. The divorce rate is divorces in a year per 1000 or population or per 1000 marriages.

DEMOGRAPHIC ANALYSIS
Total Fertility Rate (TFR) is births per year 1000 women aged 15-44 in mid-year population. Gross reproductive rate is reproductive rate computed for girls only. The net reproductive rate is the proportion of girls surviving to the reproductive age out of 1000 live births. The replacement level is TFR of 2.1. Population is described by age, sex, race/ethnicity, marital status, education, and occupation. Population pyramids reflect both birth and death rates. They display population structure by age, and gender. Population structure and future projection are determined by fertility, mortality, and migration. Population pyramids have a narrow base and a wide top in industrial countries and a wide base and a narrow top in non-industrialized ones. Atypical pyramids are due to war, genocide, and migration. Demographic shift/transition is change in population structure with falling birth and death rates.  Life tables are current or cohort (generational); general or specific (for gender, race, and place); complete or for given ages; and full or abridged (by age groups). They are used for actuarial, pension, & annuities computations; assessing health services; determining life expectancy and survival; and computing Potential Years of Life Lost (PYLL). Life expectancy at birth, a sensitive indicator of the life of the community, indicates current death rates. It is lower at birth than at age 1 year due to high IMR in the first year of life.

Key Words and Terms: Demographic Life Table, Demographic Rates,Demographic Shift, Epidemiological Transition, Health Status Indicators, Hospital Morbidity, Hospital Bed Capacity, Hospital  Information System, Hospital  Mortality, Hospital  Planning, Hospital  Rates, Hospital  Records, Life Expectancy, Life Table (Abridged), Life Table (Cohort Or Generational, Life Table (Current), Life Table (Followup), Patient Discharge, Population Control, Population Density, Population Dynamics, Population Growth, Population Life Tables, Population Pyramid, Quality Assurance, Adjusted Rate, Birth Rate, Death Rate, Rate Density, Growth Rate, Hazard Rate, Incidence Rate, Morbidity Rate, Mortality Rate, Pregnancy Rate, Specific Rate, Standardized Rate, Vital Rate, Mortality Ratio, Odds Ratio, Risk Ratio, Vital Ratio, Record Linkage, Cancer Registration, Vital Statistics, Survival Rate



HEALTH SERVICES

Presented at an Interactive Workshop on Essentials of Epidemiology in Public Health at the Department of Social and Preventive Medicine University Malaya Kuala Lumpur Malaysia 19-25 October 2009 by Professor Omar Hasan Kasule Sr MB ChB (MUK), MPH (Harvard), DrPH (Harvard) Professor King Fahad Medical College Riyadh; Professor of Epidemiology and Islamic Medicine Institute of Medicine University Brunei Darussalam, Visiting Professor of Epidemiology University of Malaya


HEALTH ECONOMICS
Health economics, an integration of medicine and economics, is application of micro-economic tools to health. Economic concepts used in health economics are scarcity, production, efficiency, effectiveness, efficacy, utility, need, want, demand & supply, elasticity, input-output, competition, marginal values (marginal costs and marginal benefits), diagnosis related group (DRG), service capacity, utilization, equity, value of money (present and future), and compounding & Discounting. Economic analysis uses models and hypothesis testing. The assumptions of a free/competitive market is not always true in health care because of supplier-induced demand and government regulation. Measurements of production costs, health outcomes, the value of human life, and the quality of life are still controversial. The purpose of economic analysis is to evaluate projects regarding cost minimization, cost benefit analysis, cost effectiveness analysis, and cost utility. It also plays a role in decision analysis.

HEALTH POLICY
Health policies are framed within a context of 4 contrasting alternatives that remain un resolved: prevention vs cure, health promotion vs disease prevention, primary care vs specialty practice, physician decision making vs joint physician-patient decision making. Health policy is formulated to achieve specific objectives: ensuring adequate supply of services, ensuring accessibility of services, assuring equity, assuring technical and economic efficiency, assuring quality, and cost control. The main outstanding issues in health policy are: justice, needs (needs assessment, unmet needs, and prioritization of needs), rationing health care, centralization and decentralization, maximizing benefits, access and coverage, quality of care, and cost considerations. Health policy is regulated by laws and regulations. Public health laws have 5 functions: prohibition of injurious behaviour, authorization of services, allocation of resources, financing arrangements, and surveillance over the quality of care. Health policy varies by country and there are variations within the same country.

HEALTH PLANNING
Planning is a circular process that includes: situation analysis, prioritization, goal and objective definition, and choice of strategies, and evaluation. Objectives of health planning can be universal, national, or local. Rational planning is based on analysis of data, defining objectives, and formulating plans to achieve those objectives. In incremental planning plans evolve as problems arise and solutions are found for them. Mixed scanning is a judicious mixture of rational and incremental planning. The methodology of planning is defined by answering the questions about planning: how techniques), who (planning by specialists of the community or both), when (long term or short term), and where (place and whether centralized or decentralized). Planning can be for manpower, facilities, or services. Planning for a new program proceeds by identifying a problem, defining the problem, understanding the problem, planning an intervention, and evaluating the intervention. Needs assessment and prioritization are necessary preliminary steps in planning. Indicators of need are morbidity, mortality, and social deprivation. Needs assessment proceeds in 5 steps: determining present health status, assessing the environment, identifying and prioritizing existing programs, assessing service deficits in light of existing programs, dealing with the problems, and validating the needs. Prioritization considers: extent and seriousness of the problem, availability of effective cure or prevention, appropriateness and efficiency of the cure or prevention, and whether intervention will be at the level of the individual or the level of the community. The goals of public health intervention include: raising awareness of the health problem, increasing knowledge and health skills, changing of attitudes and behavior, increasing access to health care, reducing of risk, and finally improved health status. The following are the public health interventions: behavioral modification, environmental control, legislation, social engineering, biological measures, and screening for early detection and treatment of disease.

HEALTH CARE FINANCING
Expenditure on health is rising in all countries due to higher demand for care, higher wages of health care workers, more sophisticated and expensive medical technology. The traditional cost containment strategies included insurance deductibles, co-payments, and exclusion of certain services from coverage. The new cost containment procedures are prospective payments based on DRGs and managed care (pre admission review and certification, emergency room review, concurrent reviews to reduce hospital stay, discharge planning, second opinions, and gatekeepers to check referrals to specialists. HMOs have built-in incentives to control costs by curtailing hospitalization. Reimbursements based on DRGs control what care providers can charge for given services. The zeal to control costs can lead to inadequate or inappropriate care and decreased of access and equity. Health care finance can be from general taxation, social insurance, direct payments, and private insurance. Outstanding issues in health care financing are distributive justice (access, affordability, and quality) and allocation priorities (rural vs urban, curative vs preventive medicine, administrative costs vs actual care).

HEALTH CARE DELIVERY
The health care system can be described as resources, organization, and management. It is described according to availability, adequacy, accessibility, acceptability, appropriateness, assessibility, accountability, completeness, comprehensiveness, and continuity. It consists of institutions, human resources, information systems, finance, management, and organization, environmental support, and service delivery. Its nature is determined by demographic, cultural, political, social, and economic factors. Health care services include: preventive care, primary care, secondary care, tertiary care, restorative care, and continuing health care (for the elderly). Health care delivery systems can be classified by ownership (profit or not for profit and government or private), method of funding (public taxation, direct payment, or insurance), type of care (western, alternative, or traditional), and level of care (primary, secondary, or tertiary). Modes of health care delivery can be the physician office, a Health Maintenance Organizations (HMO), Preferred Provider Organizations (PPO), or ambulatory Care Centers. Health care personnel are classified as independent providers (physicians), limited care providers (eg dentists), nurses, allied health professionals, and public health professionals. Health care facilities are physician offices, hospitals, nursing homes, out-patient services (ambulatory services), emergency room services, Health care maintenance organizations (HMO), rehabilitation centers, and continuing care facilities. Primary health care (PHC) was defined by the World Health Organization in 1978 as essential health services universally accessible to individuals and families in the community by means acceptable to them through their full participation and at a cost that the community and the country can afford. It is the frontline or point of entry of an individual into the health care system. It is centered on the individual and not the organ system or disease. It is provided at physician offices, clinics, and other patient facilities. It is a comprehensive care for common diseases including prevention, screening, diagnosis, and treatment. It  rests on 8 elements: health education, food supply and proper nutrition, safe water and basic sanitation, maternal and child health services including family planning, immunization against major infectious diseases, prevention and control of locally endemic diseases, appropriate treatment of common diseases and injuries, and provision of essential drugs. Health promotion refers to activities that improve personal and public health such as health education, health protection, risk factor detection, health enhancement, and health maintenance. Health protection includes accident prevention, occupational safety and health, environmental health, food and drug safety, and oral health.Overall health status is assessed using mortality statistics, life expectancy, years of potential life lost (YPLL), Disability Adjusted Life years (DALY), and results of Nutritional and Health Surveys. Program evaluation is study of effectiveness, outcomes, efficiency, goals, and impact. Process evaluation: is evaluation of the processes involved in health care without reference to the output. Outcome evaluation focuses on results. The following are used as outcome measures: mortality, morbidity, patient satisfaction, quality of life, degree of disability or dependency, and any other specific end-points. Quality assurance (QA) is formal and systematic identification, monitoring, and overcoming problems in health care delivery. Quality indicators are mortality, morbidity, patient satisfaction, and various rates. Consensus guidelines, Good Clinical Practice guidelines, clinical protocols, and nursing guidelines are a bench-mark against which clinical performance can be evaluated. QA review may be concurrent or retrospective. The QA reviewers may be independent clinical auditors from outside or may be part of the health care team. QA in hospitals centers around review of the patient charts. The aim of QA review is to ascertain compliance with the given guidelines. If a deviation is found, it is documented as well as its surrounding circumstances. It is discussed at the departmental QA committee. The committee will suggest actions to be taken to alleviate the deficiency and map out an implementation plan. The QA review process is cyclical.

Key Words and Terms: Cost Benefit Analysis, Cost Effectiveness Analysis, Cost Utility Analysis, Long-Term Care, Managed Care, Community Diagnosis, Cost Of Event Averted, Opportunity Cost, Out Of Pocket Costs, Total Cost, Variable Cost, Fixed Costs, Indirect Costs, Direct Costs, Effectiveness, Efficiency, Efficacy, Productive Efficiency, Allocative Efficiency,  Elasticity Of Demand, Price Elasticity, Equity, Health Care Delivery System, Health Care Financing, Hierarchy Of Health Care, Health Facilities, Health Insurance, Health Maintenance, Organizations, Health Manpower, Health Planning, Health Policy, Health Promotion, Health Services Administration, Health Status Indicators, IPA, Prepaid Group Practice, Prepaid Practice Organization, Marginal Analysis, Medical Legislation, Medically Under-Served, Alternative Medicine, Biomedicine, Complementary Medicine, Needs Assessment, Payment, Per Capita, Payment, Per Diem, Payment, Third Party, Price Discrimination, Primary Health Care, Public Health Administration, Public Health Information System, Public Health Law, Quality Assurance, Quality Improvement, Total Quality Management, Fee For Service, 3rd Party Reimbursement, Concurrent Review, Utilization Review, Risk Pooling, Economies, Of Scale, Utility = Satisfaction, Bed-Days, Patient Days, Compounding, Discounting


READING and WRITING SCIENTIFIC LITERATURE

Presented at an Interactive Workshop on Essentials of Epidemiology in Public Health at the Department of Social and Preventive Medicine University Malaya Kuala Lumpur Malaysia 19-25 October 2009 by Professor Omar Hasan Kasule Sr MB ChB (MUK), MPH (Harvard), DrPH (Harvard) Professor King Fahad Medical College Riyadh; Professor of Epidemiology and Islamic Medicine Institute of Medicine University Brunei Darussalam, Visiting Professor of Epidemiology University of Malaya


LITERATURE SEARCH
A document is stored data in any form: paper, book, letter, message, image, e-mail, voice, and sound. Documents of medical importance are usually journal articles, books, technical reports, or theses. The sources of on-line documents are Medline, on-line journals, on-line books, on-line technical reports, on-line theses and dissertations. MEDLINE was established in 1971. Every year 400,000 articles from 3,700 journals are added and are indexed using medical subject headings (MESH). GRATEFUL MED is a query language used to search MEDLINE. Retrieval technology for formatted character documents is now quite sophisticated. It uses queries that are short documents used to retrieve larger documents by matching, mapping, or use of Boolean logic (AND, OR, NOT). In matching, the most common form of retrieval, the query is matched to the document being sought after determining what terms or expressions are important or significant. The search can be limited by subject matter, language, type of publication, and year of publication.

CRITICAL READING OF A JOURNAL ARTICLE
For critical reading of scientific literature, the reader must be equipped with tools to be able to analyze their methodology and data analysis critically before accepting their conclusions. Common problems in published studies are incomplete documentation, design deficiencies, improper significance testing and interpretation. The main problem of the title is irrelevance to the body of the article. Problems of the abstract are failure to show the focus of the study and to provide sufficient information to assess the study (design, analysis, and conclusions). Problems of the introduction are failures of the following: stating the reason for the study, reviewing previous studies, indicating potential contribution of the present study, giving the background and historical perspective, stating the study population, and stating the study hypothesis. Problems of study design are the following: going on a fishing expedition without a prior hypothesis, study design not appropriate for the hypothesis tested, lack of a comparison group, use of an inappropriate comparison group, the Berkson's fallacy, selection of cases and controls from different populations, and sample size not big enough to answer the research questions. The following terms are often confused with one another. ‘Measurement’ is using instruments. ‘Calculation’ deals with numbers and formulas. ‘Estimation’ is used in two senses as an approximation in measurements or as computation of statistical parameters. ‘Determination’ is a general term for getting to a conclusion by use of the 4 methods above. The term ‘study’ is generic and can be confused with experiment that refers to only some types of studies. Problems in data collection are: missing data due to incomplete coverage, loss of information due to censoring and loss to follow-up, poor documentation of data collection, and methods of data collection inappropriate to the study design. 

Problems of data analysis are failures in the following: stating type of hypothesis testing (p value or confidence interval), use of the wrong statistical tests, drawing inappropriate conclusions, use of parametric tests for non-normal data, multiple comparisons or multiple significance testing, assessment of errors, assessment of normality of data, using appropriate scales and tests, using the wrong statistical formula, and confusing continuous and discrete scales. Problems in reporting results are: selective reporting of favorable results, numerators without denominator, inappropriate denominators, numbers that do not add up, tables not labeled properly or completely, numerical inconsistency (rounding, decimals, and units), stating results as mean +/- 2SD for non-normal data, stating p values as inequalities instead of the exact values, missing degrees of freedom and confidence limits. Problems of the conclusion are failures in the following: repeating the results section, discussion of the consistency of conclusions with the data and the hypothesis, extrapolations beyond the data, discussing short-comings and limitations of the study, evaluation of statistical conclusions in view of testing errors, assessment of bias (misclassification, selection, and confounding), assessment of precision (lack of random error), and assessment of validity (lack of systematic error). Internal validity is achieved when the study is internally consistent and the results and conclusions reflect the data. External validity is generalizability (ie how far can the findings of the present study be applicable to other situations) and is achieved by several independent studies showing the same result. Inability to detect the outcome of interest due to insufficient period of follow-up, inadequate sample size, and inadequate power.

ABUSE or MISUSE OF STATISTICS
Statistics can be abused by incomplete and inaccurate documentation of results as well as selection of a favorable rate and ignoring unfavorable ones. This is done by 'playing' either with the numerator or the denominator. The scales of numerators and denominators can be made artificially wider or narrower giving false and misleading impressions. Statistical results are misleading in the following situations: (a) violating the principle of parsimony, (b) study objective unclear and not reflected in the study hypothesis (c) fuzzy, inconsistently, and subjective definitions (of cases, non-cases, the exposed, the non-exposed, comparison groups, exposure, method of measurement), (f) incomplete information on response rates and missing data.

SCIENTIFIC WRITING
The goal of scientific writing is clarity. The following must be observed about sentences: short concise sentences, use of personal pronouns, subject-verb agreement is a common mistake, using active and avoiding passive sentences, proper organization of parallel ideas, and proper use of parentheses. A paragraph must start with a short and simple topic sentence that is an overview of the message contained in that paragraph. Each paragraph should convey only one message. The sentences following the topic sentence provide details and support for the topic sentence. Ideas in a paragraph should be presented in the right order with no missing steps using one of the following alternatives: least to most important, most to least important, concise to the detailed, time chronological order, problem followed by solution, or solution followed by the problem. Links and transitions such as ‘which is’ should be used when moving from one group of ideas to another to ensure continuity in the paragraph. There must be consistency in the order in which information is mentioned. If certain objects were mentioned in a certain order in the introduction, they must be mentioned in the same order all through the writing. The writer should maintain a consistent viewpoint all through the paper and not appear to be jumping from point to point. Important messages must be given emphasis. The purpose of the title is to identify the main topic or message of the paper so as to attract readers. A good title is unambigous, concise, and contains important words. It should contain the following: independent variable(s), dependent variable(s), the study subjects or materials, and statement of the main message like ‘to study the effect of’, ‘to determine’ etc. The abstract is an overview of the report with a few significant details. It should be written to be read by both those who read the full paper and those who do not read the full paper. Normally the abstract should not exceed 250 words. The abstract should mirror the sections of the paper: introduction, materials & methods, results, and discussion. The present tense is used to state the research hypothesis and the answer. The past tense is used for the experiment. An abstract is accompanied by keywords that are used for indexing. The introduction should be short. It should start with stating the research question or research hypothesis and then go on to elaborate. The transition should be from the known to the unknown and from the big picture to the detail. The introduction should mention the type of study, the study subjects or materials (substances, animals, and persons). In some cases the introduction may briefly mention the proposed experimental approach to answering the research question. Results should not be mentioned in the introduction.  The introduction should state whether the work is new or original. The aim of the materials and methods section is to describe the experimental techniques in detail sufficient for another trained scientist to replicate the procedures. The order of presentation is different for animal and clinical studies. For animal studies the order is: materials and animals, preparation, study design, interventions, methods of measurement, calculations, and data analysis. For clinical studies the order is: study subjects, inclusion criteria, exclusion criteria, study design, interventions, method of measurement, calculations, and data analysis. Independent and dependent variables should be identified. Intermediate results can be put in the materials and methods section. Final results should be put only in the results section. Details of sample size determination should be provided. The results section presents the findings of the procedures carried out in the methods section. It should be brief and to the point. A distinction must be made between results and data. Result refers to summary information obtained from data analysis. Results of hypothesis-based studies should be in the past tense. Data of descriptive studies should be in the present tense. Data is the actual numerical information often presented in a summarized form. The result is presented followed by presentation of supporting data. Data are presented in the form of tables and diagrams (figures, bar diagrams, graphs, pie-charts, maps etc). Presentation of numerical data in text should be kept to a minimum. Only results relevant to the research hypothesis should be presented. Both negative and positive results are presented. It is considered scientific fraud to present only those results that the author thinks favor a particular hypothesis. The results section is written in chronological order. The most important results are presented before the least important. Magnitude of change should be presented as a summary statistic such as percentage change instead of presenting the raw data. Summary statistics normally used as the mean, the median, and the the proportion. The mean should be presented properly as mean +/- standard deviation or standard error of the mean (SD or SE) with units of measure indicated. Measures of effect are normally the chisquare and the t statistics. Actual p values should be given instead of indicating <0.05 or >0.05. When specifying the sample size the type of sample should be explained for example ‘the sample was 20 rats’ instead of the sample size was 20’. Emphasis can be put on some results and not others. Not all the data from the study need be reported. Citing data in the text takes less space but is more difficult to read. A topic sentence is used to give an overview. Important results are put first. Figures used to present results must have a strong visual impact and must be simple. The following types of figures are used: line graph, scattergram, bar graph, histogram, and the frequency polygon. The title of the figure should reflect its contents. It must be labeled correctly. Symbols must be defined. The names of variables and units of measurement must be labeled appropriately. Tables must be properly titled and column headings clearly indicated. Footnotes, subscripts, and superscripts can be used. The discussion section states the research hypothesis, answers it, and supports the answers using data from the current study and other studies. It provides reasons to show that the answer to the question is reasonable. It explores and explains possible sources of error and bias. It also identifies and explains differences between the study results and published results. As part of intellectual honesty it discusses the strengths as well as the weaknesses of the study and how they impact on the interpretation of the results. Issues of validity and precision are also addressed. Also discussed is whether the result is new and how important it is. References are used to acknowledge information obtained from others. The references must be the most recent and most easily available on the subject. Review articles are better than original articles. They may be journal articles, books, PhD theses, abstracts of meetings, or conference proceedings. The reference should be put immediately after the relevant text. If there are several references in a sentence, cite each reference at the relevant point and do not wait to put all of them at the end of the sentence. References should be written using the Vancouver style which is: Author. Title. Journal Year; Volume (number): starting page – ending page.

Key Words and Terms: Meta Analysis, Scientific Misconduct, Old Boy Network, Publication Bias, Data retrieval, Literature search, Data retrieval, Database searching, Data Retrieval.