advantages and disadvantages of literature review in research pdf

Dissertations - Skills Guide

• Where to start
• Research Proposal
• Ethics Form
• Primary Research

Literature Review

• Methodology
• Downloadable Resources
• Further Reading

What is it?

Literature reviews involve collecting information from literature that is already available, similar to a long essay. It is a written argument that builds a case from previous research (Machi and McEvoy, 2012). Every dissertation should include a literature review, but a dissertation as a whole can be a literature review. In this section we discuss literature reviews for the whole dissertation.

What are the benefits of a literature review?

There are advantages and disadvantages to any approach. The advantages of conducting a literature review include accessibility, deeper understanding of your chosen topic, identifying experts and current research within that area, and answering key questions about current research. The disadvantages might include not providing new information on the subject and, depending on the subject area, you may have to include information that is out of date.

How do I write it?

A literature review is often split into chapters, you can choose if these chapters have titles that represent the information within them, or call them chapter 1, chapter 2, ect. A regular format for a literature review is:

Introduction (including methodology)

This particular example is split into 6 sections, however it may be more or less depending on your topic.

Literature Reviews Further Reading

• << Previous: Primary Research
• Next: Methodology >>
• Last Updated: Oct 18, 2023 9:32 AM
• URL: https://libguides.derby.ac.uk/c.php?g=690330

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Family Med Prim Care
• v.2(1); Jan-Mar 2013

Systematic Reviews and Meta-analysis: Understanding the Best Evidence in Primary Healthcare

S. gopalakrishnan.

Department of Community Medicine, SRM Medical College, Hospital and Research Centre, Kattankulathur, Tamil Nadu, India

P. Ganeshkumar

Healthcare decisions for individual patients and for public health policies should be informed by the best available research evidence. The practice of evidence-based medicine is the integration of individual clinical expertise with the best available external clinical evidence from systematic research and patient's values and expectations. Primary care physicians need evidence for both clinical practice and for public health decision making. The evidence comes from good reviews which is a state-of-the-art synthesis of current evidence on a given research question. Given the explosion of medical literature, and the fact that time is always scarce, review articles play a vital role in decision making in evidence-based medical practice. Given that most clinicians and public health professionals do not have the time to track down all the original articles, critically read them, and obtain the evidence they need for their questions, systematic reviews and clinical practice guidelines may be their best source of evidence. Systematic reviews aim to identify, evaluate, and summarize the findings of all relevant individual studies over a health-related issue, thereby making the available evidence more accessible to decision makers. The objective of this article is to introduce the primary care physicians about the concept of systematic reviews and meta-analysis, outlining why they are important, describing their methods and terminologies used, and thereby helping them with the skills to recognize and understand a reliable review which will be helpful for their day-to-day clinical practice and research activities.

Introduction

Evidence-based healthcare is the integration of best research evidence with clinical expertise and patient values. Green denotes, “Using evidence from reliable research, to inform healthcare decisions, has the potential to ensure best practice and reduce variations in healthcare delivery.” However, incorporating research into practice is time consuming, and so we need methods of facilitating easy access to evidence for busy clinicians.[ 1 ] Ganeshkumar et al . mentioned that nearly half of the private practitioners in India were consulting more than 4 h per day in a locality,[ 2 ] which explains the difficulty of them in spending time in searching evidence during consultation. Ideally, clinical decision making ought to be based on the latest evidence available. However, to keep abreast with the continuously increasing number of publications in health research, a primary healthcare professional would need to read an insurmountable number of articles every day, covered in more than 13 million references and over 4800 biomedical and health journals in Medline alone. With the view to address this challenge, the systematic review method was developed. Systematic reviews aim to inform and facilitate this process through research synthesis of multiple studies, enabling increased and efficient access to evidence.[ 1 , 3 , 4 ]

Systematic reviews and meta-analyses have become increasingly important in healthcare settings. Clinicians read them to keep up-to-date with their field and they are often used as a starting point for developing clinical practice guidelines. Granting agencies may require a systematic review to ensure there is justification for further research and some healthcare journals are moving in this direction.[ 5 ]

This article is intended to provide an easy guide to understand the concept of systematic reviews and meta-analysis, which has been prepared with the aim of capacity building for general practitioners and other primary healthcare professionals in research methodology and day-to-day clinical practice.

The purpose of this article is to introduce readers to:

• The two approaches of evaluating all the available evidence on an issue i.e., systematic reviews and meta-analysis,
• Discuss the steps in doing a systematic review,
• Introduce the terms used in systematic reviews and meta-analysis,
• Interpret results of a meta-analysis, and
• The advantages and disadvantages of systematic review and meta-analysis.

Application

What is the effect of antiviral treatment in dengue fever? Most often a primary care physician needs to know convincing answers to questions like this in a primary care setting.

To find out the solutions or answers to a clinical question like this, one has to refer textbooks, ask a colleague, or search electronic database for reports of clinical trials. Doctors need reliable information on such problems and on the effectiveness of large number of therapeutic interventions, but the information sources are too many, i.e., nearly 20,000 journals publishing 2 million articles per year with unclear or confusing results. Because no study, regardless of its type, should be interpreted in isolation, a systematic review is generally the best form of evidence.[ 6 ] So, the preferred method is a good summary of research reports, i.e., systematic reviews and meta-analysis, which will give evidence-based answers to clinical situations.

There are two fundamental categories of research: Primary research and secondary research. Primary research is collecting data directly from patients or population, while secondary research is the analysis of data already collected through primary research. A review is an article that summarizes a number of primary studies and may draw conclusions on the topic of interest which can be traditional (unsystematic) or systematic.

Terminologies

Systematic review.

A systematic review is a summary of the medical literature that uses explicit and reproducible methods to systematically search, critically appraise, and synthesize on a specific issue. It synthesizes the results of multiple primary studies related to each other by using strategies that reduce biases and random errors.[ 7 ] To this end, systematic reviews may or may not include a statistical synthesis called meta-analysis, depending on whether the studies are similar enough so that combining their results is meaningful.[ 8 ] Systematic reviews are often called overviews.

The evidence-based practitioner, David Sackett, defines the following terminologies.[ 3 ]

• Review: The general term for all attempts to synthesize the results and conclusions of two or more publications on a given topic.
• Overview: When a review strives to comprehensively identify and track down all the literature on a given topic (also called “systematic literature review”).
• Meta-analysis: A specific statistical strategy for assembling the results of several studies into a single estimate.

Systematic reviews adhere to a strict scientific design based on explicit, pre-specified, and reproducible methods. Because of this, when carried out well, they provide reliable estimates about the effects of interventions so that conclusions are defensible. Systematic reviews can also demonstrate where knowledge is lacking. This can then be used to guide future research. Systematic reviews are usually carried out in the areas of clinical tests (diagnostic, screening, and prognostic), public health interventions, adverse (harm) effects, economic (cost) evaluations, and how and why interventions work.[ 9 ]

Cochrane reviews

Cochrane reviews are systematic reviews undertaken by members of the Cochrane Collaboration which is an international not-for-profit organization that aims to help people to make well-informed decisions about healthcare by preparing, maintaining, and promoting the accessibility of systematic reviews of the effects of healthcare interventions.

Cochrane Primary Health Care Field is a systematic review of primary healthcare research on prevention, treatment, rehabilitation, and diagnostic test accuracy. The overall aim and mission of the Primary Health Care Field is to promote the quality, quantity, dissemination, accessibility, applicability, and impact of Cochrane systematic reviews relevant to people who work in primary care and to ensure proper representation in the interests of primary care clinicians and consumers in Cochrane reviews and review groups, and in other entities. This field would serve to coordinate and promote the mission of the Cochrane Collaboration within the primary healthcare disciplines, as well as ensuring that primary care perspectives are adequately represented within the Collaboration.[ 10 ]

Meta-analysis

A meta-analysis is the combination of data from several independent primary studies that address the same question to produce a single estimate like the effect of treatment or risk factor. It is the statistical analysis of a large collection of analysis and results from individual studies for the purpose of integrating the findings.[ 11 ] The term meta-analysis has been used to denote the full range of quantitative methods for research reviews.[ 12 ] Meta-analyses are studies of studies.[ 13 ] Meta-analysis provides a logical framework to a research review where similar measures from comparable studies are listed systematically and the available effect measures are combined wherever possible.[ 14 ]

The fundamental rationale of meta-analysis is that it reduces the quantity of data by summarizing data from multiple resources and helps to plan research as well as to frame guidelines. It also helps to make efficient use of existing data, ensuring generalizability, helping to check consistency of relationships, explaining data inconsistency, and quantifies the data. It helps to improve the precision in estimating the risk by using explicit methods.

Therefore, “systematic review” will refer to the entire process of collecting, reviewing, and presenting all available evidence, while the term “meta-analysis” will refer to the statistical technique involved in extracting and combining data to produce a summary result.[ 15 ]

Steps in doing systematic reviews/meta-analysis

Following are the six fundamental essential steps while doing systematic review and meta-analysis.[ 16 ]

Define the question

This is the most important part of systematic reviews/meta-analysis. The research question for the systematic reviews may be related to a major public health problem or a controversial clinical situation which requires acceptable intervention as a possible solution to the present healthcare need of the community. This step is most important since the remaining steps will be based on this.

Reviewing the literature

This can be done by going through scientific resources such as electronic database, controlled clinical trials registers, other biomedical databases, non-English literatures, “gray literatures” (thesis, internal reports, non–peer-reviewed journals, pharmaceutical industry files), references listed in primary sources, raw data from published trials and other unpublished sources known to experts in the field. Among the available electronic scientific database, the popular ones are PUBMED, MEDLINE, and EMBASE.

Sift the studies to select relevant ones

To select the relevant studies from the searches, we need to sift through the studies thus identified. The first sift is pre-screening, i.e., to decide which studies to retrieve in full, and the second sift is selection which is to look again at these studies and decide which are to be included in the review. The next step is selecting the eligible studies based on similar study designs, year of publication, language, choice among multiple articles, sample size or follow-up issues, similarity of exposure, and or treatment and completeness of information.

It is necessary to ensure that the sifting includes all relevant studies like the unpublished studies (desk drawer problem), studies which came with negative conclusions or were published in non-English journals, and studies with small sample size.

Assess the quality of studies

The steps undertaken in evaluating the study quality are early definition of study quality and criteria, setting up a good scoring system, developing a standard form for assessment, calculating quality for each study, and finally using this for sensitivity analysis.

For example, the quality of a randomized controlled trial can be assessed by finding out the answers to the following questions:

• Was the assignment to the treatment groups really random?
• Was the treatment allocation concealed?
• Were the groups similar at baseline in terms of prognostic factors?
• Were the eligibility criteria specified?
• Were the assessors, the care provider, and the patient blinded?
• Were the point estimates and measure of variability presented for the primary outcome measure?
• Did the analyses include intention-to-treat analysis?

Calculate the outcome measures of each study and combine them

We need a standard measure of outcome which can be applied to each study on the basis of its effect size. Based on their type of outcome, following are the measures of outcome: Studies with binary outcomes (cured/not cured) have odds ratio, risk ratio; studies with continuous outcomes (blood pressure) have means, difference in means, standardized difference in means (effect sizes); and survival or time-to-event data have hazard ratios.

Combining studies

Homogeneity of different studies can be estimated at a glance from a forest plot (explained below). For example, if the lower confidence interval of every trial is below the upper of all the others, i.e., the lines all overlap to some extent, then the trials are homogeneous. If some lines do not overlap at all, these trials may be said to be heterogeneous.

The definitive test for assessing the heterogeneity of studies is a variant of Chi-square test (Mantel–Haenszel test). The final step is calculating the common estimate and its confidence interval with the original data or with the summary statistics from all the studies. The best estimate of treatment effect can be derived from the weighted summary statistics of all studies which will be based on weighting to sample size, standard errors, and other summary statistics. Log scale is used to combine the data to estimate the weighting.

Interpret results: Graph

The results of a meta-analysis are usually presented as a graph called forest plot because the typical forest plots appear as forest of lines. It provides a simple visual presentation of individual studies that went into the meta-analysis at a glance. It shows the variation between the studies and an estimate of the overall result of all the studies together.

Forest plot

Meta-analysis graphs can principally be divided into six columns [ Figure 1 ]. Individual study results are displayed in rows. The first column (“study”) lists the individual study IDs included in the meta-analysis; usually the first author and year are displayed. The second column relates to the intervention groups and the third column to the control groups. The fourth column visually displays the study results. The line in the middle is called “the line of no effect.” The weight (in %) in the fifth column indicates the weighting or influence of the study on the overall results of the meta-analysis of all included studies. The higher the percentage weight, the bigger the box, the more influence the study has on the overall results. The sixth column gives the numerical results for each study (e.g., odds ratio or relative risk and 95% confidence interval), which are identical to the graphical display in the fourth column. The diamond in the last row of the graph illustrates the overall result of the meta-analysis.[ 4 ]

Interpretation of meta-analysis[ 4 ]

Thus, the horizontal lines represent individual studies. Length of line is the confidence interval (usually 95%), squares on the line represent effect size (risk ratio) for the study, with area of the square being the study size (proportional to weight given) and position as point estimate (relative risk) of the study.[ 7 ]

For example, the forest plot of the effectiveness of dexamethasone compared with placebo in preventing the recurrence of acute severe migraine headache in adults is shown in Figure 2 .[ 17 ]

Forest plot of the effectiveness of dexamethasone compared with placebo in preventing the recurrence of acute severe migraine headache in adults[ 17 ]

The overall effect is shown as diamond where the position toward the center represents pooled point estimate, the width represents estimated 95% confidence interval for all studies, and the black plain line vertically in the middle of plot is the “line of no effect” (e.g., relative risk = 1).

Therefore, when examining the results of a systematic reviews/meta-analysis, the following questions should be kept in mind:

• Heterogeneity among studies may make any pooled estimate meaningless.
• The quality of a meta-analysis cannot be any better than the quality of the studies it is summarizing.
• An incomplete search of the literature can bias the findings of a meta-analysis.
• Make sure that the meta-analysis quantifies the size of the effect in units that you can understand.

Subgroup analysis and sensitivity analysis

Subgroup analysis looks at the results of different subgroups of trials, e.g., by considering trials on adults and children separately. This should be planned at the protocol stage itself which is based on good scientific reasoning and is to be kept to a minimum.

Sensitivity analysis is used to determine how results of a systematic review/meta-analysis change by fiddling with data, for example, what is the implication if the exclusion criteria or excluded unpublished studies or weightings are assigned differently. Thus, after the analysis, if changing makes little or no difference to the overall results, the reviewer's conclusions are robust. If the key findings disappear, then the conclusions need to be expressed more cautiously.

Advantages of Systematic Reviews

Systematic reviews have specific advantages because of using explicit methods which limit bias, draw reliable and accurate conclusions, easily deliver required information to healthcare providers, researchers, and policymakers, help to reduce the time delay in the research discoveries to implementation, improve the generalizability and consistency of results, generation of new hypotheses about subgroups of the study population, and overall they increase precision of the results.[ 18 ]

Limitations in Systematic Reviews/Meta-analysis

As with all research, the value of a systematic review depends on what was done, what was found, and the clarity of reporting. As with other publications, the reporting quality of systematic reviews varies, limiting readers’ ability to assess the strengths and weaknesses of those reviews.[ 5 ]

Even though systematic review and meta-analysis are considered the best evidence for getting a definitive answer to a research question, there are certain inherent flaws associated with it, such as the location and selection of studies, heterogeneity, loss of information on important outcomes, inappropriate subgroup analyses, conflict with new experimental data, and duplication of publication.

Publication Bias

Publication bias results in it being easier to find studies with a “positive” result.[ 19 ] This occurs particularly due to inappropriate sifting of the studies where there is always a tendency towards the studies with positive (significant) outcomes. This effect occurs more commonly in systematic reviews/meta-analysis which need to be eliminated.

The quality of reporting of systematic reviews is still not optimal. In a recent review of 300 systematic reviews, few authors reported assessing possible publication bias even though there is overwhelming evidence both for its existence and its impact on the results of systematic reviews. Even when the possibility of publication bias is assessed, there is no guarantee that systematic reviewers have assessed or interpreted it appropriately.[ 20 ]

To overcome certain limitations mentioned above, the Cochrane reviews are currently reported in a format where at the end of every review, findings are summarized in the author's point of view and also give an overall picture of the outcome by means of plain language summary. This is found to be much helpful to understand the existing evidence about the topic more easily by the reader.

A systematic review is an overview of primary studies which contains an explicit statement of objectives, materials, and methods, and has been conducted according to explicit and reproducible methodology. A meta-analysis is a mathematical synthesis of the results of two or more primary studies that addressed the same hypothesis in the same way. Although meta-analysis can increase the precision of a result, it is important to ensure that the methods used for the reviews were valid and reliable.

High-quality systematic reviews and meta-analyses take great care to find all relevant studies, critically assess each study, synthesize the findings from individual studies in an unbiased manner, and present balanced important summary of findings with due consideration of any flaws in the evidence. Systematic review and meta-analysis is a way of summarizing research evidence, which is generally the best form of evidence, and hence positioned at the top of the hierarchy of evidence.

Systematic reviews can be very useful decision-making tools for primary care/family physicians. They objectively summarize large amounts of information, identifying gaps in medical research, and identifying beneficial or harmful interventions which will be useful for clinicians, researchers, and even for public and policymakers.

Source of Support: Nil

Conflict of Interest: None declared.

Advantages and disadvantages of literature review

This comprehensive article explores some of the advantages and disadvantages of literature review in research. Reviewing relevant literature is a key area in research, and indeed, it is a research activity in itself. It helps researchers investigate a particular topic in detail. However, it has some limitations as well.

What is literature review?

In order to understand the advantages and disadvantages of literature review, it is important to understand what a literature review is and how it differs from other methods of research. According to Jones and Gratton (2009) a literature review essentially consists of critically reading, evaluating, and organising existing literature on a topic to assess the state of knowledge in the area. It is sometimes called critical review.

A literature review is a select analysis of existing research which is relevant to a researcher’s selected topic, showing how it relates to their investigation. It explains and justifies how their investigation may help answer some of the questions or gaps in the chosen area of study (University of Reading, 2022).

A literature review is a term used in the field of research to describe a systematic and methodical investigation of the relevant literature on a particular topic. In other words, it is an analysis of existing research on a topic in order to identify any relevant studies and draw conclusions about the topic.

A literature review is not the same as a bibliography or a database search. Rather than simply listing references to sources of information, a literature review involves critically evaluating and summarizing existing research on a topic. As such, it is a much more detailed and complex process than simply searching databases and websites, and it requires a lot of effort and skills.

Advantages of literature review

Information synthesis

A literature review is a very thorough and methodical exercise. It can be used to synthesize information and draw conclusions about a particular topic. Through a careful evaluation and critical summarization, researchers can draw a clear and comprehensive picture of the chosen topic.

Familiarity with the current knowledge

According to the University of Illinois (2022), literature reviews allow researchers to gain familiarity with the existing knowledge in their selected field, as well as the boundaries and limitations of that field.

Creation of new body of knowledge

One of the key advantages of literature review is that it creates new body of knowledge. Through careful evaluation and critical summarisation, researchers can create a new body of knowledge and enrich the field of study.

Answers to a range of questions

Literature reviews help researchers analyse the existing body of knowledge to determine the answers to a range of questions concerning a particular subject.

Disadvantages of literature review

Time consuming

As a literature review involves collecting and evaluating research and summarizing the findings, it requires a significant amount of time. To conduct a comprehensive review, researchers need to read many different articles and analyse a lot of data. This means that their review will take a long time to complete.

Lack of quality sources  

Researchers are expected to use a wide variety of sources of information to present a comprehensive review. However, it may sometimes be challenging for them to identify the quality sources because of the availability of huge numbers in their chosen field. It may also happen because of the lack of past empirical work, particularly if the selected topic is an unpopular one.

Descriptive writing

One of the major disadvantages of literature review is that instead of critical appreciation, some researchers end up developing reviews that are mostly descriptive. Their reviews are often more like summaries of the work of other writers and lack in criticality. It is worth noting that they must go beyond describing the literature.

Key features of literature review

Clear organisation

A literature review is typically a very critical and thorough process. Universities usually recommend students a particular structure to develop their reviews. Like all other academic writings, a review starts with an introduction and ends with a conclusion. Between the beginning and the end, researchers present the main body of the review containing the critical discussion of sources.

No obvious bias

A key feature of a literature review is that it should be very unbiased and objective. However, it should be mentioned that researchers may sometimes be influenced by their own opinions of the world.

Proper citation

One of the key features of literature review is that it must be properly cited. Researchers should include all the sources that they have used for information. They must do citations and provide a reference list by the end in line with a recognized referencing system such as Harvard.

To conclude this article, it can be said that a literature review is a type of research that seeks to examine and summarise existing research on a particular topic. It is an essential part of a dissertation/thesis. However, it is not an easy thing to handle by an inexperienced person. It also requires a lot of time and patience.

Hope you like this ‘Advantages and disadvantages of literature review’. Please share this with others to support our research work.

Other useful articles:

How to evaluate website content

Advantages and disadvantages of primary and secondary research

Advantages and disadvantages of simple random sampling

Last update: 08 May 2022

References:

Jones, I., & Gratton, C. (2009) Research Methods for Sports Shttps://www.howandwhat.net/new/evaluate-website-content/tudies, 2 nd edition, London: Routledge

University of Illinois (2022) Literature review, available at: https://www.uis.edu/learning-hub/writing-resources/handouts/learning-hub/literature-review (accessed 08 May 2022)

University of Reading (2022) Literature reviews, available at: https://libguides.reading.ac.uk/literaturereview/starting (accessed 07 May 2022)

Author: M Rahman

M Rahman writes extensively online and offline with an emphasis on business management, marketing, and tourism. He is a lecturer in Management and Marketing. He holds an MSc in Tourism & Hospitality from the University of Sunderland. Also, graduated from Leeds Metropolitan University with a BA in Business & Management Studies and completed a DTLLS (Diploma in Teaching in the Life-Long Learning Sector) from London South Bank University.

Related Posts

How to be a good team player, competitive advantage for tourist destinations, advantages and disadvantages of snowball sampling.

• Become Involved |
• Give to the Library |
• Staff Directory |
• UNF Library
• Thomas G. Carpenter Library

Conducting a Literature Review

Benefits of conducting a literature review.

• Steps in Conducting a Literature Review
• Summary of the Process
• Additional Resources
• Literature Review Tutorial by American University Library
• The Literature Review: A Few Tips On Conducting It by University of Toronto
• Write a Literature Review by UC Santa Cruz University Library

While there might be many reasons for conducting a literature review, following are four key outcomes of doing the review.

Assessment of the current state of research on a topic . This is probably the most obvious value of the literature review. Once a researcher has determined an area to work with for a research project, a search of relevant information sources will help determine what is already known about the topic and how extensively the topic has already been researched.

Identification of the experts on a particular topic . One of the additional benefits derived from doing the literature review is that it will quickly reveal which researchers have written the most on a particular topic and are, therefore, probably the experts on the topic. Someone who has written twenty articles on a topic or on related topics is more than likely more knowledgeable than someone who has written a single article. This same writer will likely turn up as a reference in most of the other articles written on the same topic. From the number of articles written by the author and the number of times the writer has been cited by other authors, a researcher will be able to assume that the particular author is an expert in the area and, thus, a key resource for consultation in the current research to be undertaken.

Identification of key questions about a topic that need further research . In many cases a researcher may discover new angles that need further exploration by reviewing what has already been written on a topic. For example, research may suggest that listening to music while studying might lead to better retention of ideas, but the research might not have assessed whether a particular style of music is more beneficial than another. A researcher who is interested in pursuing this topic would then do well to follow up existing studies with a new study, based on previous research, that tries to identify which styles of music are most beneficial to retention.

Determination of methodologies used in past studies of the same or similar topics.  It is often useful to review the types of studies that previous researchers have launched as a means of determining what approaches might be of most benefit in further developing a topic. By the same token, a review of previously conducted studies might lend itself to researchers determining a new angle for approaching research.

Upon completion of the literature review, a researcher should have a solid foundation of knowledge in the area and a good feel for the direction any new research should take. Should any additional questions arise during the course of the research, the researcher will know which experts to consult in order to quickly clear up those questions.

• << Previous: Home
• Next: Steps in Conducting a Literature Review >>
• Last Updated: Aug 29, 2022 8:54 AM
• URL: https://libguides.unf.edu/litreview

Advertisement

A literature review: efficacy of online learning courses for higher education institution using meta-analysis

• Published: 04 November 2019
• Volume 26 , pages 1367–1385, ( 2021 )

Cite this article

• Mayleen Dorcas B. Castro   ORCID: orcid.org/0000-0002-6618-6958 1 , 2 &
• Gilbert M. Tumibay 3  

20k Accesses

175 Citations

149 Altmetric

11 Mentions

Explore all metrics

The Internet has made online learning possible, and many educators and researchers are interested in online learning courses to enhance and improve the student learning outcomes while battling the shortage in resources, facilities and equipment particularly in higher education institution. Online learning has become popular because of its potential for providing more flexible access to content and instruction at any time, from any place. It is imperative that the researchers consider, and examine the efficacy of online learning in educating students. For this study, the researchers reviewed literature through meta-analysis as the method of research concerning the use of ADDIE (Analysis, Design, Development, Implementation and Evaluation) framework for designing and developing instructional materials that can provide wider access to quality higher education. This framework can be used to list generic processes that instructional designers and training developers use (Morrison et al., 2010 ). It represents a descriptive guideline for building effective training and performance support tools in five phases, as follows: 1.) Analysis, 2.) Design, 3.) Development, 4.) Implementation, and 5.) Evaluation. The researchers collected papers relating to online learning courses efficacy studies to provide a synthesis of scientifically rigorous knowledge in online learning courses, the researchers searched on ERIC (Education Resources Information Center), ProQuest databases, PubMed, Crossref, Scribd EBSCO, and Scopus. The researchers also conducted a manual search using Google Scholar. Based on the analysis, three main themes developed: 1.) comparison of online learning and traditional face-to-face setting, 2.) identification of important factors of online learning delivery, and 3.) factors of institutional adoption of online learning. Based on the results obtained 50 articles. The researchers examine each paper and found 30 articles that met the efficacy of online learning courses through having well-planned, well-designed courses and programs for higher education institution. Also, it highlights the importance of instructional design and the active role of institutions play in providing support structures for educators and students. Identification of different processes and activities in designing and developing an Online Learning Courses for Higher Education Institution will be the second phase of this study for which the researchers will consider using the theoretical aspect of the ADDIE framework.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price includes VAT (Russian Federation)

Instant access to the full article PDF.

Rent this article via DeepDyve

Institutional subscriptions

Similar content being viewed by others

Adoption of online mathematics learning in Ugandan government universities during the COVID-19 pandemic: pre-service teachers’ behavioural intention and challenges

Ethical Considerations of Conducting Systematic Reviews in Educational Research

Online learning in higher education: exploring advantages and disadvantages for engagement

Allen, E., & Seaman, J. (2010). Class Difference$: Online Education in the United States. http://sloanconsortium.org/publications/survey/class_differences

Alonso, F., Lopez, G., Manrique, D., & Vines, J. M. (2005). An instructional model for web-based e-learning education with a blended learning process approach. British Journal of Educational Technology, 36 (2), 217–235 http://www.fisme.science.uu.nl/publicaties/literatuur/2005_modelforwebbasedelearning.pdf .

Article   Google Scholar  

Arbaugh, J.B., Godfrey, M., Johnson, M., Pollack, BL., Niendorf, B., & Wresch, W., (2009). Research in online and blended learning in the business disciplines: Key findings and possible future directions. http://www.sciencedirect.com/science/article/pii/S1096751609000268 .

Bell, B. S., & Fedeman, J. E. (2013). E-learning in postsecondary education. The Future of Children, 23 (1), 165–185.

Chen, L., (2016). A Model for Effective Online Instructional Design. http://infonomics-society.org/wpcontent/uploads/licej/published-papers/volume-7-2016/A-Model-for-Effective-Online-Instructional-Design.pdf

Dick, W., Carey, L., & Carey, J. O. (2014). The systematic design of instruction (8th ed.). New Jersey: Pearson Education, Inc..

Google Scholar  

Finch, D., & Jacobs, K. (2012). Online education: Best practices to promote learning. Proceedings of the Human Factors and Ergonomics 56th Annual Meeting.

Gallagher, S., & LaBrie, J. (2012). Online learning 2.0: Strategies for a mature market. Continuing Higher Education Review, 76 , 65–73.

Intulogy. (2010) ADDIE Instructional Design Model. http://www.intulogy.com/addie/

Lorenzetti, J. (2013). Academic Administration - Running a MOOC: Secrets of the World’s Largest Distance Education Classes - Magna Publications.

McConnell, D. (2000). Implementing computer supported cooperative learning.

Morrison, G. R., Ross, S. M., Kemp, J. E., & Kalman, H. (2010). Designing effective instruction (6th ed.). Hoboken: Wiley.

Neuhauser, C., (2010). Learning Style and Effectiveness of Online and Face-to-Face Instruction. http://www.tandfonline.com/doi/abs/10.1207/S15389286AJDE1602_4

Pape, L. (2010). Blended Teaching & Learning. School Administrator, 67 (4), 16–21.

Parsad, B., & Lewis, L. (2008). Distance education at degree-granting Postsecondary Institutions: 2006–2007 (NCES 2009–044). National Center for Education Statistics, Institute of Education Sciences . Washington, DC: US Department of Education http://nces.ed.gov/pubs2009/2009044.pdf .

Patrick, S., & Powell, A., (2009). A Summary of Research on the Effectiveness of K-12 Online Learning. https://?id=ED/?id=ED509626

Quality Matters (2015). QM publisher rubric: https://www.qualitymatters.org/

Razali, S., Nadiyah, S.F., (2015). The Development of Online Project Based Collaborative Learning Using ADDIE Model. http://www.sciencedirect.com/science/article/pii/S1877042815038719 .

Roblyer, M. D. (2015). Introduction to systematic instructional design for traditional, online, and blended environments . New Jersey: Pearson Education, Inc..

Rubric for Online Instruction (2010). QOLT (Quality Online Teaching and Learning). http://courseredesign.csuprojects.org/wp/qolt/

Saba, F. (2012). A systems approach to the future of distance education in colleges and universities: Research, development, and implementation. Continuing Higher Education Review, 76 , 30–37.

Schmid, R. F., Bernard, R. M., Borokhovski, E., Tamim, R. M., Abrami, P. C., & Surkes, M. A. (2014). The effects of technology use in postsecondary education: A meta-analysis of classroom applications. Computers & Education, 72 , 271–291.

Serhat, K., (2017). ADDIE Model: Instructional Design. https://educationaltechnology.net/the-addie-modelinstructional-design/ .

Sherry, L. (1995). Issues in distance learning. International Journal of Educational Telecommunications, 1 (4), 337–365.

Siemens, G., Gasevic, D., & Dawson, S., (2015). Preparing for the Digital University: A review of the history and current state of distance, blended, and online learning. https://linkresearchlab.org/PreparingDigitalUniversity.pdf

Siragusa, L., Dixon, K. C., & Dixon, R., (2007). Designing quality e-learning environments in higher education. http://www.ascilite.org.au/conferences/singapore07/procs/siragusa.pdf

Zhang, D., (2010). Interactive Multimedia-Based E-Learning: A Study of Effectiveness. http://www.tandfonline.com/doi/abs/10.1207/s15389286ajde1903_3

Download references

Author information

Authors and affiliations.

DIT at Angeles University Foundation, Angeles City, Pampanga, Philippines

Mayleen Dorcas B. Castro

Faculty, BulSU Graduate School and College of Information & Communications Technology, Bulacan State University, Malolos, Bulacan, Philippines

ITE Program, Graduate School, Angeles University Foundation, Angeles City, Pampanga, Philippines

Gilbert M. Tumibay

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Mayleen Dorcas B. Castro .

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Castro, M.D.B., Tumibay, G.M. A literature review: efficacy of online learning courses for higher education institution using meta-analysis. Educ Inf Technol 26 , 1367–1385 (2021). https://doi.org/10.1007/s10639-019-10027-z

Download citation

Received : 16 April 2019

Accepted : 25 September 2019

Published : 04 November 2019

Issue Date : March 2021

DOI : https://doi.org/10.1007/s10639-019-10027-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Online learning courses
• ADDIE framework
• Efficacy and meta-analysis
• Find a journal
• Publish with us
• Track your research

Scrutinizing the Standards: A Literature Review of the Advantages and Disadvantages of Standardized Testing

Article sidebar.

Main Article Content

For schoolchildren in the twenty-first century, the weeks of standardized testing each year mean more than just hours of tedium and boredom; for some, they mean the difference between moving to the next grade with their peers or being held back, or whether they get placed in a gifted or ESL class. Those at the front of the room are not free from the scrutiny either as the assessment of teachers’ job performance has become more reliant on the testing results of their students, and schools are even shut down when students are consistently poor performers. As the pressure surrounding these tests has risen, so has the research exploring whether this is a beneficial change for education. Jennings and Lauen (2016), Kaufman et al. (2015), Toldson and McGee (2014), Laurito et al. (2019), and Jacob and Rothstein (2016) all explore this same topic from different perspectives with their research. In the literature, though the perspectives of the articles differ, similarities emerge regarding the issue of achievement gaps in testing, the dangers of tests being so high stakes for students and educators, and the importance of informing professionals in academia regarding how to best interpret test scores.

Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License .

Authors who publish with this journal agree to the following terms:

• Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a  Creative Commons Attribution License  that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.  
• Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See  The Effect of Open Access ).
• Student authors waive FERPA rights for only the publication of the author submitted works. Specifically: Students of Indiana University East voluntarily agree to submit their own works to The Journal of Student Research at Indiana University East , with full understanding of FERPA rights and in recognition that for this one, specific instance they understand that  The Journal of Student Research at Indiana University East is Public and Open Access. Additionally, the Journal is viewable via the Internet and searchable via Indiana University, Google, and Google-Scholar search engines.

Jacob, B., & Rothstein, J. (2016). The measurement of student ability in modern assessment systems. The Journal of Economic Perspectives, 30(3), 85–107. http://www.jstor.org/stable/43855702

Jennings, Jennifer L. & Lauen, Douglas L. (2016). Accountability, inequality, and achievement: The effects of the no child left behind act on multiple measures of student learning. RSF: The Russell Sage Foundation Journal of the Social Sciences, 2(5), 220–241. https://doi.org/10.7758/rsf.2016.2.5.11

Kaufman, J., Hamilton, L., Stecher, B., Naftel, S., Robbins, M., Garber, C., Ogletree, C., Faxon-Mills, S., & Opfer, D. (2015). What are teachersʹ and school leadersʹ major concerns about new K–12 state tests?: Findings from the American Teacher and American School Leader Panels. In What Are Teachers’ and School Leaders’ Major Concerns About New K–12 State Tests?: Findings from the American Teacher and American School Leader Panels, 1–8. RAND Corporation. http://www.jstor.org/stable/10.7249/j.ctt19w72c7.1

Laurito, A., Lacoe, J., Schwartz, A. E., Sharkey, P., & Ellen, I. G. (2019). School climate and the impact of neighborhood crime on test scores. RSF: The Russell Sage Foundation Journal of the Social Sciences, 5(2), 141–166. https://doi.org/10.7758/rsf.2019.5.2.08

Toldson, Ivory A. & McGee, Tyne. (2014). What the ACT and SAT mean for Black students’ higher education prospects (Editor’s Commentary). The Journal of Negro Education, 83(1), 1–4. https://doi.org/10.7709/jnegroeducation.83.1.0001

A Review on 3D Printing Technology: Literature, Components, Generic Process, Printing Categories, Associated Materials, Advantages, Disadvantages, and Research Gaps

• Md Nazmul Hasan Dipu

Remarkable advancements have been witnessed in the domain of 3D printing technology during the past few years. It is a technique that might enhance the manufacturing process by creating tiny layers of materials from digital three-dimensional designs that are built using modern CAD software. It has a myriad of applications and is already being applied in practically every aspect of life. Many industries, such as automotive, aerospace, healthcare, education, and art, have already embraced 3D printing technology for its power of customization, product’s weight reduction, waste minimization, and capacity to cope with sophisticatedly designed components. For these reasons, it may be speculated that 3D printing technology may have an extensive influence on the next industrial revolution. Therefore, the purpose of this article is to present an overview of 3D printing technology: literature, components, general 3D printing steps, 3D printing categories, related materials, advantages, disadvantages, and research needs.

Article activity feed

• Version published to 10.31224/3686 Apr 23, 2024

Related articles

Materials and methods for all-cellulose 3d printing in sustainable additive manufacturing.

• Isabel Albelo
• Rachel Raineri
• Sonja Salmon

Optimization of the Internal Structure of 3d-printed Components for Architectural Restoration

• Valentina Tomei
• Ernesto Grande
• Maura Imbimbo

Study of stress distribution in the various interfaces present in the 3D printing microelectronic systems: applies to boxes produced by additive manufacturing.

• mohamed houmimi
• Hamza Ait Benaissa
• Hamid Zaghar
• Nabil Moujibi
• Ismail Sossey-Alaoui
• Abderrazak Ziat