The effect of chronic caffeine supplementation on endurance performance has been studied extensively in different populations. However, concurrent research on the effects of acute supplementation of caffeine on cardiorespiratory responses during endurance exercise in hot and humid conditions is unavailable
Source: Ping, WC, Keong, CC & Bandyopadhyay, A 2010, ‘Effects of acute supplementation of caffeine on cardiorespiratory responses during endurance running in a hot and humid climate’, Indian Journal of Medical Research, vol. 132, pp. 36–41. Used under a CC-BY-NC-SA licence.
Step two of writing a literature review is synthesis.
Synthesis describes combining separate components or elements to form a connected whole.
You will use the results of your analysis to find themes to build your literature review around. Each of the themes identified will become a subheading within the body of your literature review.
A good place to start when identifying themes is with the dependent variables (results/findings) that were investigated in the research studies.
Because all of the research articles you are incorporating into your literature review are related to your topic, it is likely that they have similar study designs and have measured similar dependent variables. Review the ‘Results’ column of your analysis grid. You may like to collate the common themes in a synthesis grid (see, for example Table 7.4 ).
Step three of writing a literature review is evaluation, which can only be done after carefully analysing your research papers and synthesising the common themes (findings).
During the evaluation stage, you are making judgements on the themes presented in the research articles that you have read. This includes providing physiological explanations for the findings. It may be useful to refer to the discussion section of published original investigation research papers, or another literature review, where the authors may mention tested or hypothetical physiological mechanisms that may explain their findings.
When the findings of the investigations related to a particular theme are inconsistent (e.g., one study shows that caffeine effects performance and another study shows that caffeine had no effect on performance) you should attempt to provide explanations of why the results differ, including physiological explanations. A good place to start is by comparing the methodologies to determine if there are any differences that may explain the differences in the findings (see the ‘Experimental design’ column of your analysis grid). An example of evaluation is shown in the examples that follow in this section, under ‘Running performance’ and ‘RPE ratings’.
When the findings of the papers related to a particular theme are consistent (e.g., caffeine had no effect on oxygen uptake in both studies) an evaluation should include an explanation of why the results are similar. Once again, include physiological explanations. It is still a good idea to compare methodologies as a background to the evaluation. An example of evaluation is shown in the following under ‘Oxygen consumption’.
Once you have completed the analysis, and synthesis grids and written your evaluation of the research papers , you can combine synthesis and evaluation information to create a paragraph for a literature review ( Figure 7.4 ).
The following paragraphs are an example of combining the outcome of the synthesis and evaluation stages to produce a paragraph for a literature review.
Note that this is an example using only two papers – most literature reviews would be presenting information on many more papers than this ( (e.g., 106 papers in the review article by Bain and colleagues discussed later in this chapter). However, the same principle applies regardless of the number of papers reviewed.
The next part of this chapter looks at the each section of a literature review and explains how to write them by referring to a review article that was published in Frontiers in Physiology and shown in Figure 7.1. Each section from the published article is annotated to highlight important features of the format of the review article, and identifies the synthesis and evaluation information.
In the examination of each review article section we will point out examples of how the authors have presented certain information and where they display application of important cognitive processes; we will use the colour code shown below:
This should be one paragraph that accurately reflects the contents of the review article.
The introduction should establish the context and importance of the review
The reference section provides a list of the references that you cited in the body of your review article. The format will depend on the journal of publication as each journal has their own specific referencing format.
It is important to accurately cite references in research papers to acknowledge your sources and ensure credit is appropriately given to authors of work you have referred to. An accurate and comprehensive reference list also shows your readers that you are well-read in your topic area and are aware of the key papers that provide the context to your research.
It is important to keep track of your resources and to reference them consistently in the format required by the publication in which your work will appear. Most scientists will use reference management software to store details of all of the journal articles (and other sources) they use while writing their review article. This software also automates the process of adding in-text references and creating a reference list. In the review article by Bain et al. (2014) used as an example in this chapter, the reference list contains 106 items, so you can imagine how much help referencing software would be. Chapter 5 shows you how to use EndNote, one example of reference management software.
Click the drop down below to review the terms learned from this chapter.
Copyright note:
Bain, A.R., Morrison, S.A., & Ainslie, P.N. (2014). Cerebral oxygenation and hyperthermia. Frontiers in Physiology, 5 , 92.
Pautasso, M. (2013). Ten simple rules for writing a literature review. PLoS Computational Biology, 9 (7), e1003149.
How To Do Science Copyright © 2022 by University of Southern Queensland is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License , except where otherwise noted.
Writing-a-literature-review-six-steps-to-get-you-from-start-to-finish.
Tanya Golash-Boza, Associate Professor of Sociology, University of California
February 03, 2022
Writing a literature review is often the most daunting part of writing an article, book, thesis, or dissertation. “The literature” seems (and often is) massive. I have found it helpful to be as systematic as possible when completing this gargantuan task.
Sonja Foss and William Walters* describe an efficient and effective way of writing a literature review. Their system provides an excellent guide for getting through the massive amounts of literature for any purpose: in a dissertation, an M.A. thesis, or preparing a research article for publication in any field of study. Below is a summary of the steps they outline as well as a step-by-step method for writing a literature review.
Step One: Decide on your areas of research:
Before you begin to search for articles or books, decide beforehand what areas you are going to research. Make sure that you only get articles and books in those areas, even if you come across fascinating books in other areas. A literature review I am currently working on, for example, explores barriers to higher education for undocumented students.
Step Two: Search for the literature:
Conduct a comprehensive bibliographic search of books and articles in your area. Read the abstracts online and download and/or print those articles that pertain to your area of research. Find books in the library that are relevant and check them out. Set a specific time frame for how long you will search. It should not take more than two or three dedicated sessions.
Step Three: Find relevant excerpts in your books and articles:
Skim the contents of each book and article and look specifically for these five things:
1. Claims, conclusions, and findings about the constructs you are investigating
2. Definitions of terms
3. Calls for follow-up studies relevant to your project
4. Gaps you notice in the literature
5. Disagreement about the constructs you are investigating
When you find any of these five things, type the relevant excerpt directly into a Word document. Don’t summarize, as summarizing takes longer than simply typing the excerpt. Make sure to note the name of the author and the page number following each excerpt. Do this for each article and book that you have in your stack of literature. When you are done, print out your excerpts.
Step Four: Code the literature:
Get out a pair of scissors and cut each excerpt out. Now, sort the pieces of paper into similar topics. Figure out what the main themes are. Place each excerpt into a themed pile. Make sure each note goes into a pile. If there are excerpts that you can’t figure out where they belong, separate those and go over them again at the end to see if you need new categories. When you finish, place each stack of notes into an envelope labeled with the name of the theme.
Step Five: Create Your Conceptual Schema:
Type, in large font, the name of each of your coded themes. Print this out, and cut the titles into individual slips of paper. Take the slips of paper to a table or large workspace and figure out the best way to organize them. Are there ideas that go together or that are in dialogue with each other? Are there ideas that contradict each other? Move around the slips of paper until you come up with a way of organizing the codes that makes sense. Write the conceptual schema down before you forget or someone cleans up your slips of paper.
Step Six: Begin to Write Your Literature Review:
Choose any section of your conceptual schema to begin with. You can begin anywhere, because you already know the order. Find the envelope with the excerpts in them and lay them on the table in front of you. Figure out a mini-conceptual schema based on that theme by grouping together those excerpts that say the same thing. Use that mini-conceptual schema to write up your literature review based on the excerpts that you have in front of you. Don’t forget to include the citations as you write, so as not to lose track of who said what. Repeat this for each section of your literature review.
Once you complete these six steps, you will have a complete draft of your literature review. The great thing about this process is that it breaks down into manageable steps something that seems enormous: writing a literature review.
I think that Foss and Walter’s system for writing the literature review is ideal for a dissertation, because a Ph.D. candidate has already read widely in his or her field through graduate seminars and comprehensive exams.
It may be more challenging for M.A. students, unless you are already familiar with the literature. It is always hard to figure out how much you need to read for deep meaning, and how much you just need to know what others have said. That balance will depend on how much you already know.
For people writing literature reviews for articles or books, this system also could work, especially when you are writing in a field with which you are already familiar. The mere fact of having a system can make the literature review seem much less daunting, so I recommend this system for anyone who feels overwhelmed by the prospect of writing a literature review.
*Destination Dissertation: A Traveler's Guide to a Done Dissertation
Image Credit/Source: Goldmund Lukic/Getty Images
Please enter your Email Address
Please enter valid email address
Please Enter your First Name
Please enter your Last Name
Please enter your Questions or Comments.
Please enter the Privacy
Please enter the Terms & Conditions
Related articles.
User Experience (UX) Research is the process of discovering and understanding user requirements, motivations, and behaviours
Learn how Wiley partners with plagiarism detection services to support academic integrity around the world
Medical student Nicole Foley shares her top tips for writing and getting your work published.
Wiley and Lumina are working together to support the efforts of researchers at Harvard Medical School to develop and test new machine learning tools and artificial intelligence (AI) software that can
Learn more about our relationship with a company that helps scientists identify the right products to use in their research
What is ISBN? ISSN? DOI? Learn about some of the unique identifiers for book and journal content.
Learn how medical practitioners can easily access and search visual assets from our article portfolio
Explore free-to-use services that can help you discover new content
Watch this webinar to help you learn how to get published.
Atypon launches Scitrus, a personalized web app that allows users to create a customized feed of the latest research.
FOR INDIVIDUALS
FOR INSTITUTIONS & BUSINESSES
WILEY NETWORK
ABOUT WILEY
Corporate Responsibility
Corporate Governance
Leadership Team
Cookie Preferences
Copyright @ 2000-2024 by John Wiley & Sons, Inc., or related companies. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.
Rights & Permissions
Privacy Policy
Terms of Use
Manisha Bahl, A Step-by-Step Guide to Writing a Scientific Review Article, Journal of Breast Imaging , Volume 5, Issue 4, July/August 2023, Pages 480–485, https://doi.org/10.1093/jbi/wbad028
Scientific review articles are comprehensive, focused reviews of the scientific literature written by subject matter experts. The task of writing a scientific review article can seem overwhelming; however, it can be managed by using an organized approach and devoting sufficient time to the process. The process involves selecting a topic about which the authors are knowledgeable and enthusiastic, conducting a literature search and critical analysis of the literature, and writing the article, which is composed of an abstract, introduction, body, and conclusion, with accompanying tables and figures. This article, which focuses on the narrative or traditional literature review, is intended to serve as a guide with practical steps for new writers. Tips for success are also discussed, including selecting a focused topic, maintaining objectivity and balance while writing, avoiding tedious data presentation in a laundry list format, moving from descriptions of the literature to critical analysis, avoiding simplistic conclusions, and budgeting time for the overall process.
Personal account.
Sign in with a library card.
Access to content on Oxford Academic is often provided through institutional subscriptions and purchases. If you are a member of an institution with an active account, you may be able to access content in one of the following ways:
Typically, access is provided across an institutional network to a range of IP addresses. This authentication occurs automatically, and it is not possible to sign out of an IP authenticated account.
Choose this option to get remote access when outside your institution. Shibboleth/Open Athens technology is used to provide single sign-on between your institution’s website and Oxford Academic.
If your institution is not listed or you cannot sign in to your institution’s website, please contact your librarian or administrator.
Enter your library card number to sign in. If you cannot sign in, please contact your librarian.
Society member access to a journal is achieved in one of the following ways:
Many societies offer single sign-on between the society website and Oxford Academic. If you see ‘Sign in through society site’ in the sign in pane within a journal:
If you do not have a society account or have forgotten your username or password, please contact your society.
Some societies use Oxford Academic personal accounts to provide access to their members. See below.
A personal account can be used to get email alerts, save searches, purchase content, and activate subscriptions.
Some societies use Oxford Academic personal accounts to provide access to their members.
Click the account icon in the top right to:
Oxford Academic is home to a wide variety of products. The institutional subscription may not cover the content that you are trying to access. If you believe you should have access to that content, please contact your librarian.
For librarians and administrators, your personal account also provides access to institutional account management. Here you will find options to view and activate subscriptions, manage institutional settings and access options, access usage statistics, and more.
To purchase short-term access, please sign in to your personal account above.
Don't already have a personal account? Register
Month: | Total Views: |
---|---|
May 2023 | 171 |
June 2023 | 115 |
July 2023 | 113 |
August 2023 | 5,013 |
September 2023 | 1,500 |
October 2023 | 1,810 |
November 2023 | 3,849 |
December 2023 | 308 |
January 2024 | 401 |
February 2024 | 312 |
March 2024 | 415 |
April 2024 | 361 |
May 2024 | 306 |
June 2024 | 283 |
July 2024 | 309 |
August 2024 | 242 |
Citing articles via.
Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide
Sign In or Create an Account
This PDF is available to Subscribers Only
For full access to this pdf, sign in to an existing account, or purchase an annual subscription.
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .
Angela carrera-rivera.
a Faculty of Engineering, Mondragon University
Felix larrinaga.
b Design Innovation Center(DBZ), Mondragon University
Performing a literature review is a critical first step in research to understanding the state-of-the-art and identifying gaps and challenges in the field. A systematic literature review is a method which sets out a series of steps to methodically organize the review. In this paper, we present a guide designed for researchers and in particular early-stage researchers in the computer-science field. The contribution of the article is the following:
Specifications table
Subject area: | Computer-science |
More specific subject area: | Software engineering |
Name of your method: | Systematic literature review |
Name and reference of original method: | |
Resource availability: | Resources referred to in this article: ) ) |
A Systematic Literature Review (SLR) is a research methodology to collect, identify, and critically analyze the available research studies (e.g., articles, conference proceedings, books, dissertations) through a systematic procedure [12] . An SLR updates the reader with current literature about a subject [6] . The goal is to review critical points of current knowledge on a topic about research questions to suggest areas for further examination [5] . Defining an “Initial Idea” or interest in a subject to be studied is the first step before starting the SLR. An early search of the relevant literature can help determine whether the topic is too broad to adequately cover in the time frame and whether it is necessary to narrow the focus. Reading some articles can assist in setting the direction for a formal review., and formulating a potential research question (e.g., how is semantics involved in Industry 4.0?) can further facilitate this process. Once the focus has been established, an SLR can be undertaken to find more specific studies related to the variables in this question. Although there are multiple approaches for performing an SLR ( [5] , [26] , [27] ), this work aims to provide a step-by-step and practical guide while citing useful examples for computer-science research. The methodology presented in this paper comprises two main phases: “Planning” described in section 2, and “Conducting” described in section 3, following the depiction of the graphical abstract.
Defining the protocol is the first step of an SLR since it describes the procedures involved in the review and acts as a log of the activities to be performed. Obtaining opinions from peers while developing the protocol, is encouraged to ensure the review's consistency and validity, and helps identify when modifications are necessary [20] . One final goal of the protocol is to ensure the replicability of the review.
The PICOC (Population, Intervention, Comparison, Outcome, and Context) criteria break down the SLR's objectives into searchable keywords and help formulate research questions [ 27 ]. PICOC is widely used in the medical and social sciences fields to encourage researchers to consider the components of the research questions [14] . Kitchenham & Charters [6] compiled the list of PICOC elements and their corresponding terms in computer science, as presented in Table 1 , which includes keywords derived from the PICOC elements. From that point on, it is essential to think of synonyms or “alike” terms that later can be used for building queries in the selected digital libraries. For instance, the keyword “context awareness” can also be linked to “context-aware”.
Planning Step 1 “Defining PICOC keywords and synonyms”.
Description | Example (PICOC) | Example (Synonyms) | |
---|---|---|---|
Population | Can be a specific role, an application area, or an industry domain. | Smart Manufacturing | • Digital Factory • Digital Manufacturing • Smart Factory |
Intervention | The methodology, tool, or technology that addresses a specific issue. | Semantic Web | • Ontology • Semantic Reasoning |
Comparison | The methodology, tool, or technology in which the is being compared (if appropriate). | Machine Learning | • Supervised Learning • Unsupervised Learning |
Outcome | Factors of importance to practitioners and/or the results that could produce. | Context-Awareness | • Context-Aware • Context-Reasoning |
Context | The context in which the comparison takes place. Some systematic reviews might choose to exclude this element. | Business Process Management | • BPM • Business Process Modeling |
Clearly defined research question(s) are the key elements which set the focus for study identification and data extraction [21] . These questions are formulated based on the PICOC criteria as presented in the example in Table 2 (PICOC keywords are underlined).
Research questions examples.
Research Questions examples |
---|
• : What are the current challenges of context-aware systems that support the decision-making of business processes in smart manufacturing? • : Which technique is most appropriate to support decision-making for business process management in smart factories? • : In which scenarios are semantic web and machine learning used to provide context-awareness in business process management for smart manufacturing? |
The validity of a study will depend on the proper selection of a database since it must adequately cover the area under investigation [19] . The Web of Science (WoS) is an international and multidisciplinary tool for accessing literature in science, technology, biomedicine, and other disciplines. Scopus is a database that today indexes 40,562 peer-reviewed journals, compared to 24,831 for WoS. Thus, Scopus is currently the largest existing multidisciplinary database. However, it may also be necessary to include sources relevant to computer science, such as EI Compendex, IEEE Xplore, and ACM. Table 3 compares the area of expertise of a selection of databases.
Planning Step 3 “Select digital libraries”. Description of digital libraries in computer science and software engineering.
Database | Description | URL | Area | Advanced Search Y/N |
---|---|---|---|---|
Scopus | From Elsevier. sOne of the largest databases. Very user-friendly interface | Interdisciplinary | Y | |
Web of Science | From Clarivate. Multidisciplinary database with wide ranging content. | Interdisciplinary | Y | |
EI Compendex | From Elsevier. Focused on engineering literature. | Engineering | Y (Query view not available) | |
IEEE Digital Library | Contains scientific and technical articles published by IEEE and its publishing partners. | Engineering and Technology | Y | |
ACM Digital Library | Complete collection of ACM publications. | Computing and information technology | Y |
Authors should define the inclusion and exclusion criteria before conducting the review to prevent bias, although these can be adjusted later, if necessary. The selection of primary studies will depend on these criteria. Articles are included or excluded in this first selection based on abstract and primary bibliographic data. When unsure, the article is skimmed to further decide the relevance for the review. Table 4 sets out some criteria types with descriptions and examples.
Planning Step 4 “Define inclusion and exclusion criteria”. Examples of criteria type.
Criteria Type | Description | Example |
---|---|---|
Period | Articles can be selected based on the time period to review, e.g., reviewing the technology under study from the year it emerged, or reviewing progress in the field since the publication of a prior literature review. | : From 2015 to 2021 Articles prior 2015 |
Language | Articles can be excluded based on language. | : Articles not in English |
Type of Literature | Articles can be excluded if they are fall into the category of grey literature. | Reports, policy literature, working papers, newsletters, government documents, speeches |
Type of source | Articles can be included or excluded by the type of origin, i.e., conference or journal articles or books. | : Articles from Conferences or Journals Articles from books |
Impact Source | Articles can be excluded if the author limits the impact factor or quartile of the source. | Articles from Q1, and Q2 sources : Articles with a Journal Impact Score (JIS) lower than |
Accessibility | Not accessible in specific databases. | : Not accessible |
Relevance to research questions | Articles can be excluded if they are not relevant to a particular question or to “ ” number of research questions. | Not relevant to at least 2 research questions |
Assessing the quality of an article requires an artifact which describes how to perform a detailed assessment. A typical quality assessment is a checklist that contains multiple factors to evaluate. A numerical scale is used to assess the criteria and quantify the QA [22] . Zhou et al. [25] presented a detailed description of assessment criteria in software engineering, classified into four main aspects of study quality: Reporting, Rigor, Credibility, and Relevance. Each of these criteria can be evaluated using, for instance, a Likert-type scale [17] , as shown in Table 5 . It is essential to select the same scale for all criteria established on the quality assessment.
Planning Step 5 “Define QA assessment checklist”. Examples of QA scales and questions.
Do the researchers discuss any problems (limitations, threats) with the validity of their results (reliability)? | 1 – No, and not considered (Score: 0) 2 – Partially (Score: 0.5) 3 – Yes (Score: 1) |
Is there a clear definition/ description/ statement of the aims/ goals/ purposes/ motivations/ objectives/ questions of the research? | 1 – Disagree (Score: 1) 2 – Somewhat disagree (Score: 2) 3 – Neither agree nor disagree (Score: 3) 4 – Somewhat agree (Score: 4) 5 – Agree (Score: 5) |
The data extraction form represents the information necessary to answer the research questions established for the review. Synthesizing the articles is a crucial step when conducting research. Ramesh et al. [15] presented a classification scheme for computer science research, based on topics, research methods, and levels of analysis that can be used to categorize the articles selected. Classification methods and fields to consider when conducting a review are presented in Table 6 .
Planning Step 6 “Define data extraction form”. Examples of fields.
Classification and fields to consider for data extraction | Description and examples |
---|---|
Research type | • focuses on abstract ideas, concepts, and theories built on literature reviews . • uses scientific data or case studies for explorative, descriptive, explanatory, or measurable findings . an SLR on context-awareness for S-PSS and categorized the articles in theoretical and empirical research. |
By process phases, stages | When analyzing a process or series of processes, an effective way to structure the data is to find a well-established framework of reference or architecture. : • an SLR on self-adaptive systems uses the MAPE-K model to understand how the authors tackle each module stage. • presented a context-awareness survey using the stages of context-aware lifecycle to review different methods. |
By technology, framework, or platform | When analyzing a computer science topic, it is important to know the technology currently employed to understand trends, benefits, or limitations. : • an SLR on the big data ecosystem in the manufacturing field that includes frameworks, tools, and platforms for each stage of the big data ecosystem. |
By application field and/or industry domain | If the review is not limited to a specific “Context” or “Population" (industry domain), it can be useful to identify the field of application : • an SLR on adaptive training using virtual reality (VR). The review presents an extensive description of multiple application domains and examines related work. |
Gaps and challenges | Identifying gaps and challenges is important in reviews to determine the research needs and further establish research directions that can help scholars act on the topic. |
Findings in research | Research in computer science can deliver multiple types of findings, e.g.: |
Evaluation method | Case studies, experiments, surveys, mathematical demonstrations, and performance indicators. |
The data extraction must be relevant to the research questions, and the relationship to each of the questions should be included in the form. Kitchenham & Charters [6] presented more pertinent data that can be captured, such as conclusions, recommendations, strengths, and weaknesses. Although the data extraction form can be updated if more information is needed, this should be treated with caution since it can be time-consuming. It can therefore be helpful to first have a general background in the research topic to determine better data extraction criteria.
After defining the protocol, conducting the review requires following each of the steps previously described. Using tools can help simplify the performance of this task. Standard tools such as Excel or Google sheets allow multiple researchers to work collaboratively. Another online tool specifically designed for performing SLRs is Parsif.al 1 . This tool allows researchers, especially in the context of software engineering, to define goals and objectives, import articles using BibTeX files, eliminate duplicates, define selection criteria, and generate reports.
Search strings are built considering the PICOC elements and synonyms to execute the search in each database library. A search string should separate the synonyms with the boolean operator OR. In comparison, the PICOC elements are separated with parentheses and the boolean operator AND. An example is presented next:
(“Smart Manufacturing” OR “Digital Manufacturing” OR “Smart Factory”) AND (“Business Process Management” OR “BPEL” OR “BPM” OR “BPMN”) AND (“Semantic Web” OR “Ontology” OR “Semantic” OR “Semantic Web Service”) AND (“Framework” OR “Extension” OR “Plugin” OR “Tool”
Databases that feature advanced searches enable researchers to perform search queries based on titles, abstracts, and keywords, as well as for years or areas of research. Fig. 1 presents the example of an advanced search in Scopus, using titles, abstracts, and keywords (TITLE-ABS-KEY). Most of the databases allow the use of logical operators (i.e., AND, OR). In the example, the search is for “BIG DATA” and “USER EXPERIENCE” or “UX” as a synonym.
Example of Advanced search on Scopus.
In general, bibliometric data of articles can be exported from the databases as a comma-separated-value file (CSV) or BibTeX file, which is helpful for data extraction and quantitative and qualitative analysis. In addition, researchers should take advantage of reference-management software such as Zotero, Mendeley, Endnote, or Jabref, which import bibliographic information onto the software easily.
The first step in this stage is to identify any duplicates that appear in the different searches in the selected databases. Some automatic procedures, tools like Excel formulas, or programming languages (i.e., Python) can be convenient here.
In the second step, articles are included or excluded according to the selection criteria, mainly by reading titles and abstracts. Finally, the quality is assessed using the predefined scale. Fig. 2 shows an example of an article QA evaluation in Parsif.al, using a simple scale. In this scenario, the scoring procedure is the following YES= 1, PARTIALLY= 0.5, and NO or UNKNOWN = 0 . A cut-off score should be defined to filter those articles that do not pass the QA. The QA will require a light review of the full text of the article.
Performing quality assessment (QA) in Parsif.al.
Those articles that pass the study selection are then thoroughly and critically read. Next, the researcher completes the information required using the “data extraction” form, as illustrated in Fig. 3 , in this scenario using Parsif.al tool.
Example of data extraction form using Parsif.al.
The information required (study characteristics and findings) from each included study must be acquired and documented through careful reading. Data extraction is valuable, especially if the data requires manipulation or assumptions and inferences. Thus, information can be synthesized from the extracted data for qualitative or quantitative analysis [16] . This documentation supports clarity, precise reporting, and the ability to scrutinize and replicate the examination.
The analysis phase examines the synthesized data and extracts meaningful information from the selected articles [10] . There are two main goals in this phase.
The first goal is to analyze the literature in terms of leading authors, journals, countries, and organizations. Furthermore, it helps identify correlations among topic s . Even when not mandatory, this activity can be constructive for researchers to position their work, find trends, and find collaboration opportunities. Next, data from the selected articles can be analyzed using bibliometric analysis (BA). BA summarizes large amounts of bibliometric data to present the state of intellectual structure and emerging trends in a topic or field of research [4] . Table 7 sets out some of the most common bibliometric analysis representations.
Techniques for bibliometric analysis and examples.
Publication-related analysis | Description | Example |
---|---|---|
Years of publications | Determine interest in the research topic by years or the period established by the SLR, by quantifying the number of papers published. Using this information, it is also possible to forecast the growth rate of research interest. | [ ] identified the growth rate of research interest and the yearly publication trend. |
Top contribution journals/conferences | Identify the leading journals and conferences in which authors can share their current and future work. | , |
Top countries' or affiliation contributions | Examine the impacts of countries or affiliations leading the research topic. | [ , ] identified the most influential countries. |
Leading authors | Identify the most significant authors in a research field. | - |
Keyword correlation analysis | Explore existing relationships between topics in a research field based on the written content of the publication or related keywords established in the articles. | using keyword clustering analysis ( ). using frequency analysis. |
Total and average citation | Identify the most relevant publications in a research field. | Scatter plot citation scores and journal factor impact |
Several tools can perform this type of analysis, such as Excel and Google Sheets for statistical graphs or using programming languages such as Python that has available multiple data visualization libraries (i.e. Matplotlib, Seaborn). Cluster maps based on bibliographic data(i.e keywords, authors) can be developed in VosViewer which makes it easy to identify clusters of related items [18] . In Fig. 4 , node size is representative of the number of papers related to the keyword, and lines represent the links among keyword terms.
[1] Keyword co-relationship analysis using clusterization in vos viewer.
This second and most important goal is to answer the formulated research questions, which should include a quantitative and qualitative analysis. The quantitative analysis can make use of data categorized, labelled, or coded in the extraction form (see Section 1.6). This data can be transformed into numerical values to perform statistical analysis. One of the most widely employed method is frequency analysis, which shows the recurrence of an event, and can also represent the percental distribution of the population (i.e., percentage by technology type, frequency of use of different frameworks, etc.). Q ualitative analysis includes the narration of the results, the discussion indicating the way forward in future research work, and inferring a conclusion.
Finally, the literature review report should state the protocol to ensure others researchers can replicate the process and understand how the analysis was performed. In the protocol, it is essential to present the inclusion and exclusion criteria, quality assessment, and rationality beyond these aspects.
The presentation and reporting of results will depend on the structure of the review given by the researchers conducting the SLR, there is no one answer. This structure should tie the studies together into key themes, characteristics, or subgroups [ 28 ].
SLR can be an extensive and demanding task, however the results are beneficial in providing a comprehensive overview of the available evidence on a given topic. For this reason, researchers should keep in mind that the entire process of the SLR is tailored to answer the research question(s). This article has detailed a practical guide with the essential steps to conducting an SLR in the context of computer science and software engineering while citing multiple helpful examples and tools. It is envisaged that this method will assist researchers, and particularly early-stage researchers, in following an algorithmic approach to fulfill this task. Finally, a quick checklist is presented in Appendix A as a companion of this article.
Angela Carrera-Rivera: Conceptualization, Methodology, Writing-Original. William Ochoa-Agurto : Methodology, Writing-Original. Felix Larrinaga : Reviewing and Supervision Ganix Lasa: Reviewing and Supervision.
The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.
Funding : This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie Grant No. 814078.
Carrera-Rivera, A., Larrinaga, F., & Lasa, G. (2022). Context-awareness for the design of Smart-product service systems: Literature review. Computers in Industry, 142, 103730.
1 https://parsif.al/
Reference management. Clean and simple.
Where are systematic literature reviews used, what types of systematic literature reviews are there, how to write a systematic literature review, 1. decide on your team, 2. formulate your question, 3. plan your research protocol, 4. search for the literature, 5. screen the literature, 6. assess the quality of the studies, 7. extract the data, 8. analyze the results, 9. interpret and present the results, registering your systematic literature review, frequently asked questions about writing a systematic literature review, related articles.
A systematic literature review is a summary, analysis, and evaluation of all the existing research on a well-formulated and specific question.
Put simply, a systematic review is a study of studies that is popular in medical and healthcare research. In this guide, we will cover:
➡️ Visit our guide to the best research databases for medicine and health to find resources for your systematic review.
Systematic literature reviews can be utilized in various contexts, but they’re often relied on in clinical or healthcare settings.
Medical professionals read systematic literature reviews to stay up-to-date in their field, and granting agencies sometimes need them to make sure there’s justification for further research in an area. They can even be used as the starting point for developing clinical practice guidelines.
A classic systematic literature review can take different approaches:
Writing a systematic literature review can feel like an overwhelming undertaking. After all, they can often take 6 to 18 months to complete. Below we’ve prepared a step-by-step guide on how to write a systematic literature review.
When carrying out a systematic literature review, you should employ multiple reviewers in order to minimize bias and strengthen analysis. A minimum of two is a good rule of thumb, with a third to serve as a tiebreaker if needed.
You may also need to team up with a librarian to help with the search, literature screeners, a statistician to analyze the data, and the relevant subject experts.
Define your answerable question. Then ask yourself, “has someone written a systematic literature review on my question already?” If so, yours may not be needed. A librarian can help you answer this.
You should formulate a “well-built clinical question.” This is the process of generating a good search question. To do this, run through PICO:
Now you need a detailed strategy for how you’re going to search for and evaluate the studies relating to your question.
The protocol for your systematic literature review should include:
For a full guide on how to systematically develop your protocol, take a look at the PRISMA checklist . PRISMA has been designed primarily to improve the reporting of systematic literature reviews and meta-analyses.
When writing a systematic literature review, your goal is to find all of the relevant studies relating to your question, so you need to search thoroughly .
This is where your librarian will come in handy again. They should be able to help you formulate a detailed search strategy, and point you to all of the best databases for your topic.
➡️ Read more on on how to efficiently search research databases .
The places to consider in your search are electronic scientific databases (the most popular are PubMed , MEDLINE , and Embase ), controlled clinical trial registers, non-English literature, raw data from published trials, references listed in primary sources, and unpublished sources known to experts in the field.
➡️ Take a look at our list of the top academic research databases .
Tip: Don’t miss out on “gray literature.” You’ll improve the reliability of your findings by including it.
Don’t miss out on “gray literature” sources: those sources outside of the usual academic publishing environment. They include:
Gray literature sources are more likely to contain negative conclusions, so you’ll improve the reliability of your findings by including it. You should document details such as:
➡️ Read more about gray literature .
This should be performed by your two reviewers, using the criteria documented in your research protocol. The screening is done in two phases:
Make sure reviewers keep a log of which studies they exclude, with reasons why.
➡️ Visit our guide on what is an abstract?
Your reviewers should evaluate the methodological quality of your chosen full-text articles. Make an assessment checklist that closely aligns with your research protocol, including a consistent scoring system, calculations of the quality of each study, and sensitivity analysis.
The kinds of questions you'll come up with are:
Every step of the data extraction must be documented for transparency and replicability. Create a data extraction form and set your reviewers to work extracting data from the qualified studies.
Here’s a free detailed template for recording data extraction, from Dalhousie University. It should be adapted to your specific question.
Establish a standard measure of outcome which can be applied to each study on the basis of its effect size.
Measures of outcome for studies with:
Design a table and populate it with your data results. Draw this out into a forest plot , which provides a simple visual representation of variation between the studies.
Then analyze the data for issues. These can include heterogeneity, which is when studies’ lines within the forest plot don’t overlap with any other studies. Again, record any excluded studies here for reference.
Consider different factors when interpreting your results. These include limitations, strength of evidence, biases, applicability, economic effects, and implications for future practice or research.
Apply appropriate grading of your evidence and consider the strength of your recommendations.
It’s best to formulate a detailed plan for how you’ll present your systematic review results. Take a look at these guidelines for interpreting results from the Cochrane Institute.
Before writing your systematic literature review, you can register it with OSF for additional guidance along the way. You could also register your completed work with PROSPERO .
Systematic literature reviews are often found in clinical or healthcare settings. Medical professionals read systematic literature reviews to stay up-to-date in their field and granting agencies sometimes need them to make sure there’s justification for further research in an area.
The first stage in carrying out a systematic literature review is to put together your team. You should employ multiple reviewers in order to minimize bias and strengthen analysis. A minimum of two is a good rule of thumb, with a third to serve as a tiebreaker if needed.
Your systematic review should include the following details:
A literature review simply provides a summary of the literature available on a topic. A systematic review, on the other hand, is more than just a summary. It also includes an analysis and evaluation of existing research. Put simply, it's a study of studies.
The final stage of conducting a systematic literature review is interpreting and presenting the results. It’s best to formulate a detailed plan for how you’ll present your systematic review results, guidelines can be found for example from the Cochrane institute .
A literature review is a critical analysis and synthesis of existing research on a particular topic. It provides an overview of the current state of knowledge, identifies gaps, and highlights key findings in the literature. 1 The purpose of a literature review is to situate your own research within the context of existing scholarship, demonstrating your understanding of the topic and showing how your work contributes to the ongoing conversation in the field. Learning how to write a literature review is a critical tool for successful research. Your ability to summarize and synthesize prior research pertaining to a certain topic demonstrates your grasp on the topic of study, and assists in the learning process.
What is the purpose of literature review , a. habitat loss and species extinction: , b. range shifts and phenological changes: , c. ocean acidification and coral reefs: , d. adaptive strategies and conservation efforts: .
What is a literature review .
A well-conducted literature review demonstrates the researcher’s familiarity with the existing literature, establishes the context for their own research, and contributes to scholarly conversations on the topic. One of the purposes of a literature review is also to help researchers avoid duplicating previous work and ensure that their research is informed by and builds upon the existing body of knowledge.
A literature review serves several important purposes within academic and research contexts. Here are some key objectives and functions of a literature review: 2
1. Contextualizing the Research Problem: The literature review provides a background and context for the research problem under investigation. It helps to situate the study within the existing body of knowledge.
2. Identifying Gaps in Knowledge: By identifying gaps, contradictions, or areas requiring further research, the researcher can shape the research question and justify the significance of the study. This is crucial for ensuring that the new research contributes something novel to the field.
Find academic papers related to your research topic faster. Try Research on Paperpal
3. Understanding Theoretical and Conceptual Frameworks: Literature reviews help researchers gain an understanding of the theoretical and conceptual frameworks used in previous studies. This aids in the development of a theoretical framework for the current research.
4. Providing Methodological Insights: Another purpose of literature reviews is that it allows researchers to learn about the methodologies employed in previous studies. This can help in choosing appropriate research methods for the current study and avoiding pitfalls that others may have encountered.
5. Establishing Credibility: A well-conducted literature review demonstrates the researcher’s familiarity with existing scholarship, establishing their credibility and expertise in the field. It also helps in building a solid foundation for the new research.
6. Informing Hypotheses or Research Questions: The literature review guides the formulation of hypotheses or research questions by highlighting relevant findings and areas of uncertainty in existing literature.
Let’s delve deeper with a literature review example: Let’s say your literature review is about the impact of climate change on biodiversity. You might format your literature review into sections such as the effects of climate change on habitat loss and species extinction, phenological changes, and marine biodiversity. Each section would then summarize and analyze relevant studies in those areas, highlighting key findings and identifying gaps in the research. The review would conclude by emphasizing the need for further research on specific aspects of the relationship between climate change and biodiversity. The following literature review template provides a glimpse into the recommended literature review structure and content, demonstrating how research findings are organized around specific themes within a broader topic.
Climate change is a global phenomenon with far-reaching consequences, including significant impacts on biodiversity. This literature review synthesizes key findings from various studies:
Climate change-induced alterations in temperature and precipitation patterns contribute to habitat loss, affecting numerous species (Thomas et al., 2004). The review discusses how these changes increase the risk of extinction, particularly for species with specific habitat requirements.
Observations of range shifts and changes in the timing of biological events (phenology) are documented in response to changing climatic conditions (Parmesan & Yohe, 2003). These shifts affect ecosystems and may lead to mismatches between species and their resources.
The review explores the impact of climate change on marine biodiversity, emphasizing ocean acidification’s threat to coral reefs (Hoegh-Guldberg et al., 2007). Changes in pH levels negatively affect coral calcification, disrupting the delicate balance of marine ecosystems.
Recognizing the urgency of the situation, the literature review discusses various adaptive strategies adopted by species and conservation efforts aimed at mitigating the impacts of climate change on biodiversity (Hannah et al., 2007). It emphasizes the importance of interdisciplinary approaches for effective conservation planning.
Strengthen your literature review with factual insights. Try Research on Paperpal for free!
Writing a literature review involves summarizing and synthesizing existing research on a particular topic. A good literature review format should include the following elements.
Introduction: The introduction sets the stage for your literature review, providing context and introducing the main focus of your review.
Body: The body of the literature review is where you provide a comprehensive analysis of existing literature, grouping studies based on themes, methodologies, or other relevant criteria.
Write and Cite as yo u go with Paperpal Research. Start now for free!
Conclusion: The conclusion of your literature review should summarize the main findings, highlight the contributions of the review, and suggest avenues for future research.
Conducting a literature review is an essential step in research that involves reviewing and analyzing existing literature on a specific topic. It’s important to know how to do a literature review effectively, so here are the steps to follow: 1
Whether you’re exploring a new research field or finding new angles to develop an existing topic, sifting through hundreds of papers can take more time than you have to spare. But what if you could find science-backed insights with verified citations in seconds? That’s the power of Paperpal’s new Research feature!
Paperpal, an AI writing assistant, integrates powerful academic search capabilities within its writing platform. With the Research | Cite feature, you get 100% factual insights, with citations backed by 250M+ verified research articles, directly within your writing interface. It also allows you auto-cite references in 10,000+ styles and save relevant references in your Citation Library. By eliminating the need to switch tabs to find answers to all your research questions, Paperpal saves time and helps you stay focused on your writing.
Here’s how to use the Research feature:
The literature review sample and detailed advice on writing and conducting a review will help you produce a well-structured report. But remember that a good literature review is an ongoing process, and it may be necessary to revisit and update it as your research progresses. By combining effortless research with an easy citation process, Paperpal Research streamlines the literature review process and empowers you to write faster and with more confidence. Try Paperpal Research now and see for yourself.
A literature review is a critical and comprehensive analysis of existing literature (published and unpublished works) on a specific topic or research question and provides a synthesis of the current state of knowledge in a particular field. A well-conducted literature review is crucial for researchers to build upon existing knowledge, avoid duplication of efforts, and contribute to the advancement of their field. It also helps researchers situate their work within a broader context and facilitates the development of a sound theoretical and conceptual framework for their studies.
Literature review is a crucial component of research writing, providing a solid background for a research paper’s investigation. The aim is to keep professionals up to date by providing an understanding of ongoing developments within a specific field, including research methods, and experimental techniques used in that field, and present that knowledge in the form of a written report. Also, the depth and breadth of the literature review emphasizes the credibility of the scholar in his or her field.
Before writing a literature review, it’s essential to undertake several preparatory steps to ensure that your review is well-researched, organized, and focused. This includes choosing a topic of general interest to you and doing exploratory research on that topic, writing an annotated bibliography, and noting major points, especially those that relate to the position you have taken on the topic.
Literature reviews and academic research papers are essential components of scholarly work but serve different purposes within the academic realm. 3 A literature review aims to provide a foundation for understanding the current state of research on a particular topic, identify gaps or controversies, and lay the groundwork for future research. Therefore, it draws heavily from existing academic sources, including books, journal articles, and other scholarly publications. In contrast, an academic research paper aims to present new knowledge, contribute to the academic discourse, and advance the understanding of a specific research question. Therefore, it involves a mix of existing literature (in the introduction and literature review sections) and original data or findings obtained through research methods.
Literature reviews are essential components of academic and research papers, and various strategies can be employed to conduct them effectively. If you want to know how to write a literature review for a research paper, here are four common approaches that are often used by researchers. Chronological Review: This strategy involves organizing the literature based on the chronological order of publication. It helps to trace the development of a topic over time, showing how ideas, theories, and research have evolved. Thematic Review: Thematic reviews focus on identifying and analyzing themes or topics that cut across different studies. Instead of organizing the literature chronologically, it is grouped by key themes or concepts, allowing for a comprehensive exploration of various aspects of the topic. Methodological Review: This strategy involves organizing the literature based on the research methods employed in different studies. It helps to highlight the strengths and weaknesses of various methodologies and allows the reader to evaluate the reliability and validity of the research findings. Theoretical Review: A theoretical review examines the literature based on the theoretical frameworks used in different studies. This approach helps to identify the key theories that have been applied to the topic and assess their contributions to the understanding of the subject. It’s important to note that these strategies are not mutually exclusive, and a literature review may combine elements of more than one approach. The choice of strategy depends on the research question, the nature of the literature available, and the goals of the review. Additionally, other strategies, such as integrative reviews or systematic reviews, may be employed depending on the specific requirements of the research.
The literature review format can vary depending on the specific publication guidelines. However, there are some common elements and structures that are often followed. Here is a general guideline for the format of a literature review: Introduction: Provide an overview of the topic. Define the scope and purpose of the literature review. State the research question or objective. Body: Organize the literature by themes, concepts, or chronology. Critically analyze and evaluate each source. Discuss the strengths and weaknesses of the studies. Highlight any methodological limitations or biases. Identify patterns, connections, or contradictions in the existing research. Conclusion: Summarize the key points discussed in the literature review. Highlight the research gap. Address the research question or objective stated in the introduction. Highlight the contributions of the review and suggest directions for future research.
Both annotated bibliographies and literature reviews involve the examination of scholarly sources. While annotated bibliographies focus on individual sources with brief annotations, literature reviews provide a more in-depth, integrated, and comprehensive analysis of existing literature on a specific topic. The key differences are as follows:
Annotated Bibliography | Literature Review | |
Purpose | List of citations of books, articles, and other sources with a brief description (annotation) of each source. | Comprehensive and critical analysis of existing literature on a specific topic. |
Focus | Summary and evaluation of each source, including its relevance, methodology, and key findings. | Provides an overview of the current state of knowledge on a particular subject and identifies gaps, trends, and patterns in existing literature. |
Structure | Each citation is followed by a concise paragraph (annotation) that describes the source’s content, methodology, and its contribution to the topic. | The literature review is organized thematically or chronologically and involves a synthesis of the findings from different sources to build a narrative or argument. |
Length | Typically 100-200 words | Length of literature review ranges from a few pages to several chapters |
Independence | Each source is treated separately, with less emphasis on synthesizing the information across sources. | The writer synthesizes information from multiple sources to present a cohesive overview of the topic. |
References
Paperpal is a comprehensive AI writing toolkit that helps students and researchers achieve 2x the writing in half the time. It leverages 22+ years of STM experience and insights from millions of research articles to provide in-depth academic writing, language editing, and submission readiness support to help you write better, faster.
Get accurate academic translations, rewriting support, grammar checks, vocabulary suggestions, and generative AI assistance that delivers human precision at machine speed. Try for free or upgrade to Paperpal Prime starting at US$19 a month to access premium features, including consistency, plagiarism, and 30+ submission readiness checks to help you succeed.
Experience the future of academic writing – Sign up to Paperpal and start writing for free!
Self-plagiarism in research: what it is and how to avoid it, you may also like, academic integrity vs academic dishonesty: types & examples, dissertation printing and binding | types & comparison , what is a dissertation preface definition and examples , the ai revolution: authors’ role in upholding academic..., the future of academia: how ai tools are..., how to write a research proposal: (with examples..., how to write your research paper in apa..., how to choose a dissertation topic, how to write a phd research proposal, how to write an academic paragraph (step-by-step guide).
A literature review surveys prior research published in books, scholarly articles, and any other sources relevant to a particular issue, area of research, or theory, and by so doing, provides a description, summary, and critical evaluation of these works in relation to the research problem being investigated. Literature reviews are designed to provide an overview of sources you have used in researching a particular topic and to demonstrate to your readers how your research fits within existing scholarship about the topic.
Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . Fourth edition. Thousand Oaks, CA: SAGE, 2014.
A literature review may consist of simply a summary of key sources, but in the social sciences, a literature review usually has an organizational pattern and combines both summary and synthesis, often within specific conceptual categories . A summary is a recap of the important information of the source, but a synthesis is a re-organization, or a reshuffling, of that information in a way that informs how you are planning to investigate a research problem. The analytical features of a literature review might:
Given this, the purpose of a literature review is to:
Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper. 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . Los Angeles, CA: SAGE, 2011; Knopf, Jeffrey W. "Doing a Literature Review." PS: Political Science and Politics 39 (January 2006): 127-132; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012.
Types of Literature Reviews
It is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the primary studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally among scholars that become part of the body of epistemological traditions within the field.
In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews. Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are a number of approaches you could adopt depending upon the type of analysis underpinning your study.
Argumentative Review This form examines literature selectively in order to support or refute an argument, deeply embedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to make summary claims of the sort found in systematic reviews [see below].
Integrative Review Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses or research problems. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication. This is the most common form of review in the social sciences.
Historical Review Few things rest in isolation from historical precedent. Historical literature reviews focus on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.
Methodological Review A review does not always focus on what someone said [findings], but how they came about saying what they say [method of analysis]. Reviewing methods of analysis provides a framework of understanding at different levels [i.e. those of theory, substantive fields, research approaches, and data collection and analysis techniques], how researchers draw upon a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection, and data analysis. This approach helps highlight ethical issues which you should be aware of and consider as you go through your own study.
Systematic Review This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyze data from the studies that are included in the review. The goal is to deliberately document, critically evaluate, and summarize scientifically all of the research about a clearly defined research problem . Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?" This type of literature review is primarily applied to examining prior research studies in clinical medicine and allied health fields, but it is increasingly being used in the social sciences.
Theoretical Review The purpose of this form is to examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review helps to establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.
NOTE: Most often the literature review will incorporate some combination of types. For example, a review that examines literature supporting or refuting an argument, assumption, or philosophical problem related to the research problem will also need to include writing supported by sources that establish the history of these arguments in the literature.
Baumeister, Roy F. and Mark R. Leary. "Writing Narrative Literature Reviews." Review of General Psychology 1 (September 1997): 311-320; Mark R. Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Kennedy, Mary M. "Defining a Literature." Educational Researcher 36 (April 2007): 139-147; Petticrew, Mark and Helen Roberts. Systematic Reviews in the Social Sciences: A Practical Guide . Malden, MA: Blackwell Publishers, 2006; Torracro, Richard. "Writing Integrative Literature Reviews: Guidelines and Examples." Human Resource Development Review 4 (September 2005): 356-367; Rocco, Tonette S. and Maria S. Plakhotnik. "Literature Reviews, Conceptual Frameworks, and Theoretical Frameworks: Terms, Functions, and Distinctions." Human Ressource Development Review 8 (March 2008): 120-130; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.
I. Thinking About Your Literature Review
The structure of a literature review should include the following in support of understanding the research problem :
The critical evaluation of each work should consider :
II. Development of the Literature Review
Four Basic Stages of Writing 1. Problem formulation -- which topic or field is being examined and what are its component issues? 2. Literature search -- finding materials relevant to the subject being explored. 3. Data evaluation -- determining which literature makes a significant contribution to the understanding of the topic. 4. Analysis and interpretation -- discussing the findings and conclusions of pertinent literature.
Consider the following issues before writing the literature review: Clarify If your assignment is not specific about what form your literature review should take, seek clarification from your professor by asking these questions: 1. Roughly how many sources would be appropriate to include? 2. What types of sources should I review (books, journal articles, websites; scholarly versus popular sources)? 3. Should I summarize, synthesize, or critique sources by discussing a common theme or issue? 4. Should I evaluate the sources in any way beyond evaluating how they relate to understanding the research problem? 5. Should I provide subheadings and other background information, such as definitions and/or a history? Find Models Use the exercise of reviewing the literature to examine how authors in your discipline or area of interest have composed their literature review sections. Read them to get a sense of the types of themes you might want to look for in your own research or to identify ways to organize your final review. The bibliography or reference section of sources you've already read, such as required readings in the course syllabus, are also excellent entry points into your own research. Narrow the Topic The narrower your topic, the easier it will be to limit the number of sources you need to read in order to obtain a good survey of relevant resources. Your professor will probably not expect you to read everything that's available about the topic, but you'll make the act of reviewing easier if you first limit scope of the research problem. A good strategy is to begin by searching the USC Libraries Catalog for recent books about the topic and review the table of contents for chapters that focuses on specific issues. You can also review the indexes of books to find references to specific issues that can serve as the focus of your research. For example, a book surveying the history of the Israeli-Palestinian conflict may include a chapter on the role Egypt has played in mediating the conflict, or look in the index for the pages where Egypt is mentioned in the text. Consider Whether Your Sources are Current Some disciplines require that you use information that is as current as possible. This is particularly true in disciplines in medicine and the sciences where research conducted becomes obsolete very quickly as new discoveries are made. However, when writing a review in the social sciences, a survey of the history of the literature may be required. In other words, a complete understanding the research problem requires you to deliberately examine how knowledge and perspectives have changed over time. Sort through other current bibliographies or literature reviews in the field to get a sense of what your discipline expects. You can also use this method to explore what is considered by scholars to be a "hot topic" and what is not.
III. Ways to Organize Your Literature Review
Chronology of Events If your review follows the chronological method, you could write about the materials according to when they were published. This approach should only be followed if a clear path of research building on previous research can be identified and that these trends follow a clear chronological order of development. For example, a literature review that focuses on continuing research about the emergence of German economic power after the fall of the Soviet Union. By Publication Order your sources by publication chronology, then, only if the order demonstrates a more important trend. For instance, you could order a review of literature on environmental studies of brown fields if the progression revealed, for example, a change in the soil collection practices of the researchers who wrote and/or conducted the studies. Thematic [“conceptual categories”] A thematic literature review is the most common approach to summarizing prior research in the social and behavioral sciences. Thematic reviews are organized around a topic or issue, rather than the progression of time, although the progression of time may still be incorporated into a thematic review. For example, a review of the Internet’s impact on American presidential politics could focus on the development of online political satire. While the study focuses on one topic, the Internet’s impact on American presidential politics, it would still be organized chronologically reflecting technological developments in media. The difference in this example between a "chronological" and a "thematic" approach is what is emphasized the most: themes related to the role of the Internet in presidential politics. Note that more authentic thematic reviews tend to break away from chronological order. A review organized in this manner would shift between time periods within each section according to the point being made. Methodological A methodological approach focuses on the methods utilized by the researcher. For the Internet in American presidential politics project, one methodological approach would be to look at cultural differences between the portrayal of American presidents on American, British, and French websites. Or the review might focus on the fundraising impact of the Internet on a particular political party. A methodological scope will influence either the types of documents in the review or the way in which these documents are discussed.
Other Sections of Your Literature Review Once you've decided on the organizational method for your literature review, the sections you need to include in the paper should be easy to figure out because they arise from your organizational strategy. In other words, a chronological review would have subsections for each vital time period; a thematic review would have subtopics based upon factors that relate to the theme or issue. However, sometimes you may need to add additional sections that are necessary for your study, but do not fit in the organizational strategy of the body. What other sections you include in the body is up to you. However, only include what is necessary for the reader to locate your study within the larger scholarship about the research problem.
Here are examples of other sections, usually in the form of a single paragraph, you may need to include depending on the type of review you write:
IV. Writing Your Literature Review
Once you've settled on how to organize your literature review, you're ready to write each section. When writing your review, keep in mind these issues.
Use Evidence A literature review section is, in this sense, just like any other academic research paper. Your interpretation of the available sources must be backed up with evidence [citations] that demonstrates that what you are saying is valid. Be Selective Select only the most important points in each source to highlight in the review. The type of information you choose to mention should relate directly to the research problem, whether it is thematic, methodological, or chronological. Related items that provide additional information, but that are not key to understanding the research problem, can be included in a list of further readings . Use Quotes Sparingly Some short quotes are appropriate if you want to emphasize a point, or if what an author stated cannot be easily paraphrased. Sometimes you may need to quote certain terminology that was coined by the author, is not common knowledge, or taken directly from the study. Do not use extensive quotes as a substitute for using your own words in reviewing the literature. Summarize and Synthesize Remember to summarize and synthesize your sources within each thematic paragraph as well as throughout the review. Recapitulate important features of a research study, but then synthesize it by rephrasing the study's significance and relating it to your own work and the work of others. Keep Your Own Voice While the literature review presents others' ideas, your voice [the writer's] should remain front and center. For example, weave references to other sources into what you are writing but maintain your own voice by starting and ending the paragraph with your own ideas and wording. Use Caution When Paraphrasing When paraphrasing a source that is not your own, be sure to represent the author's information or opinions accurately and in your own words. Even when paraphrasing an author’s work, you still must provide a citation to that work.
V. Common Mistakes to Avoid
These are the most common mistakes made in reviewing social science research literature.
Cook, Kathleen E. and Elise Murowchick. “Do Literature Review Skills Transfer from One Course to Another?” Psychology Learning and Teaching 13 (March 2014): 3-11; Fink, Arlene. Conducting Research Literature Reviews: From the Internet to Paper . 2nd ed. Thousand Oaks, CA: Sage, 2005; Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1998; Jesson, Jill. Doing Your Literature Review: Traditional and Systematic Techniques . London: SAGE, 2011; Literature Review Handout. Online Writing Center. Liberty University; Literature Reviews. The Writing Center. University of North Carolina; Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: SAGE, 2016; Ridley, Diana. The Literature Review: A Step-by-Step Guide for Students . 2nd ed. Los Angeles, CA: SAGE, 2012; Randolph, Justus J. “A Guide to Writing the Dissertation Literature Review." Practical Assessment, Research, and Evaluation. vol. 14, June 2009; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016; Taylor, Dena. The Literature Review: A Few Tips On Conducting It. University College Writing Centre. University of Toronto; Writing a Literature Review. Academic Skills Centre. University of Canberra.
Break Out of Your Disciplinary Box!
Thinking interdisciplinarily about a research problem can be a rewarding exercise in applying new ideas, theories, or concepts to an old problem. For example, what might cultural anthropologists say about the continuing conflict in the Middle East? In what ways might geographers view the need for better distribution of social service agencies in large cities than how social workers might study the issue? You don’t want to substitute a thorough review of core research literature in your discipline for studies conducted in other fields of study. However, particularly in the social sciences, thinking about research problems from multiple vectors is a key strategy for finding new solutions to a problem or gaining a new perspective. Consult with a librarian about identifying research databases in other disciplines; almost every field of study has at least one comprehensive database devoted to indexing its research literature.
Frodeman, Robert. The Oxford Handbook of Interdisciplinarity . New York: Oxford University Press, 2010.
Don't Just Review for Content!
While conducting a review of the literature, maximize the time you devote to writing this part of your paper by thinking broadly about what you should be looking for and evaluating. Review not just what scholars are saying, but how are they saying it. Some questions to ask:
When you begin to write your literature review section, you'll be glad you dug deeper into how the research was designed and constructed because it establishes a means for developing more substantial analysis and interpretation of the research problem.
Hart, Chris. Doing a Literature Review: Releasing the Social Science Research Imagination . Thousand Oaks, CA: Sage Publications, 1 998.
When Do I Know I Can Stop Looking and Move On?
Here are several strategies you can utilize to assess whether you've thoroughly reviewed the literature:
Onwuegbuzie, Anthony J. and Rebecca Frels. Seven Steps to a Comprehensive Literature Review: A Multimodal and Cultural Approach . Los Angeles, CA: Sage, 2016; Sutton, Anthea. Systematic Approaches to a Successful Literature Review . Los Angeles, CA: Sage Publications, 2016.
A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question. That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.
A literature review may be a stand alone work or the introduction to a larger research paper, depending on the assignment. Rely heavily on the guidelines your instructor has given you.
Why is it important?
A literature review is important because it:
APA Style Blog - for those harder to find answers
Your literature review should be guided by your central research question. The literature represents background and research developments related to a specific research question, interpreted and analyzed by you in a synthesized way.
How many studies do you need to look at? How comprehensive should it be? How many years should it cover?
Make a list of the databases you will search.
Where to find databases:
Some questions to help you analyze the research:
Tips:
Nowadays, there is a huge demand for scientific literature reviews as they are especially appreciated by scholars or researchers when designing their research proposals. While finding information is less of a problem to them, discerning which paper or publication has enough quality has become one of the biggest issues. Literature reviews narrow the current knowledge on a certain field and examine the latest publications’ strengths and weaknesses. This way, they are priceless tools not only for those who are starting their research, but also for all those interested in recent publications. To be useful, literature reviews must be written in a professional way with a clear structure. The amount of work needed to write a scientific literature review must be considered before starting one since the tasks required can overwhelm many if the working method is not the best.
Writing a scientific review implies both researching for relevant academic content and writing , however, writing without having a clear objective is a common mistake. Sometimes, studying the situation and defining the work’s system is so important and takes equally as much time as that required in writing the final result. Therefore, we suggest that you divide your path into three steps.
Think about your target and narrow down your topic. If you don’t choose a well-defined topic, you can find yourself dealing with a wide subject and plenty of publications about it. Remember that researchers usually deal with really specific fields of study.
It is time to be a critic and locate only pertinent publications. While researching for content consider publications that were written 3 years ago at the most. Write notes and summarize the content of each paper as that will help you in the next step.
Check some literature review examples to decide how to start writing a good literature review . When your goals and structure are defined, begin writing without forgetting your target at any moment.
Related: Conducting a literature survey? Wish to learn more about scientific misconduct? Check out this resourceful infographic.
Here you have a to-do list to help you write your review :
Scholars and researchers are usually the best candidates to write scientific literature reviews, not only because they are experts in a certain field, but also because they know the exigencies and needs that researchers have while writing research proposals or looking for information among thousands of academic papers. Therefore, considering your experience as a researcher can help you understand how to write a scientific literature review.
Have you faced challenges while drafting your first literature review? How do you think can these tips help you in acing your next literature review? Let us know in the comments section below! You can also visit our Q&A forum for frequently asked questions related to copyrights answered by our team that comprises eminent researchers and publication experts.
Thank you for your information. It adds knowledge on critical review being a first time to do it, it helps a lot.
yes. i would like to ndertake the course Bio ststistics
Rate this article Cancel Reply
Your email address will not be published.
AI Assistance in Academia for Searching Credible Scholarly Sources
The journey of academia is a grand quest for knowledge, more specifically an adventure to…
Writing a Research Literature Review? — Here are tips to guide you through!
Literature review is both a process and a product. It involves searching within a defined…
Researcher 1: “It’s flooding articles every time I switch on my laptop!” Researcher 2: “Why…
How to Master at Literature Mapping: 5 Most Recommended Tools to Use
This article is also available in: Turkish, Spanish, Russian, and Portuguese
Types of literature reviews Tips for writing review articles Role of meta-analysis Reporting guidelines
How to Scan Through Millions of Articles and Still Cut Down on Your Reading Time —…
Sign-up to read more
Subscribe for free to get unrestricted access to all our resources on research writing and academic publishing including:
We hate spam too. We promise to protect your privacy and never spam you.
I am looking for Editing/ Proofreading services for my manuscript Tentative date of next journal submission:
In your opinion, what is the most effective way to improve integrity in the peer review process?
All Main Library and Weaver Library doors lock 15 minutes before closing.
What is a literature review.
A literature review is a summary of the published work in a field of study. This can be a section of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that you have examined the breadth of knowledge and can justify your thesis or research questions. They are also valuable tools for other researchers who need to find a summary of that field of knowledge.
Unlike an annotated bibliography, which is a list of sources with short descriptions, a literature review synthesizes sources into a summary that has a thesis or statement of purpose—stated or implied—at its core.
Step 1: define your research scope.
Ask us if you have questions about refining your topic, search methods, writing tips, or citation management.
Start by searching broadly. Literature for your review will typically be acquired through scholarly books, journal articles, and/or dissertations. Develop an understanding of what is out there, what terms are accurate and helpful, etc., and keep track of all of it with citation management tools . If you need help figuring out key terms and where to search, ask us .
Use citation searching to track how scholars interact with, and build upon, previous research:
Key to your literature review is a critical analysis of the literature collected around your topic. The analysis will explore relationships, major themes, and any critical gaps in the research expressed in the work. Read and summarize each source with an eye toward analyzing authority, currency, coverage, methodology, and relationship to other works. The University of Toronto's Writing Center provides a comprehensive list of questions you can use to analyze your sources.
Divide the available resources that pertain to your research into categories reflecting their roles in addressing your research question. Possible ways to categorize resources include organization by:
Regardless of the division, each category should be accompanied by thorough discussions and explanations of strengths and weaknesses, value to the overall survey, and comparisons with similar sources. You may have enough resources when:
Undergraduate student resources.
What is a literature review, traditional (narrative) literature review, integrative literature review, systematic reviews, meta-analysis, scoping review.
The health sciences library.
Call toll-free: (844) 352-7399 E-mail: Ask Us More contact information
A literature review provides an overview of what's been written about a specific topic. There are many different types of literature reviews. They vary in terms of comprehensiveness, types of study included, and purpose.
The other pages in this guide will cover some basic steps to consider when conducting a traditional health sciences literature review. See below for a quick look at some of the more popular types of literature reviews.
For additional information on a variety of review methods, the following article provides an excellent overview.
Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009 Jun;26(2):91-108. doi: 10.1111/j.1471-1842.2009.00848.x. Review. PubMed PMID: 19490148.
A traditional (narrative) literature review provides a quick overview of current studies. It helps explain why your study is important in the context of the literature, and can also help you identify areas that need further research. The rest of this guide will cover some basic steps to consider when conducting a traditional literature review. Click on the right thumbnail to see an excerpt from this type of literature review. |
|
Integrative reviews "synthesize findings from different approaches, like experimental and non-experimental studies" ( ). They may or may not be systematic reviews. Click on the right thumbnail to see an excerpt from this type of literature review. |
|
Systematic reviews synthesize high quality empirical information to answer a given research question ( ). Conducting a systematic review involves following rigorous, predefined protocols that "minimise bias and ensure transparency" ( ). See our for more information on what they are and how to conduct one. Click on the right thumbnail to see an excerpt from this type of literature review. |
Meta-analyses are "the statistical integration of separate studies" ( ). They involve identifying similar studies and pooling their data to obtain a more accurate estimate of true effect size. A systematic review can include a meta-analysis. Click on the right thumbnail to see an excerpt from this type of literature review. |
|
A scoping review involves a broad research question that explores the current evidence base ( ). It can help inform areas that are appropriate for a systematic review. Click on the right thumbnail to see an excerpt from this type of literature review. |
|
Loading metrics
Open Access
* E-mail: [email protected]
Affiliations Centre for Functional and Evolutionary Ecology (CEFE), CNRS, Montpellier, France, Centre for Biodiversity Synthesis and Analysis (CESAB), FRB, Aix-en-Provence, France
Published: July 18, 2013
Citation: Pautasso M (2013) Ten Simple Rules for Writing a Literature Review. PLoS Comput Biol 9(7): e1003149. https://doi.org/10.1371/journal.pcbi.1003149
Editor: Philip E. Bourne, University of California San Diego, United States of America
Copyright: © 2013 Marco Pautasso. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was funded by the French Foundation for Research on Biodiversity (FRB) through its Centre for Synthesis and Analysis of Biodiversity data (CESAB), as part of the NETSEED research project. The funders had no role in the preparation of the manuscript.
Competing interests: The author has declared that no competing interests exist.
Literature reviews are in great demand in most scientific fields. Their need stems from the ever-increasing output of scientific publications [1] . For example, compared to 1991, in 2008 three, eight, and forty times more papers were indexed in Web of Science on malaria, obesity, and biodiversity, respectively [2] . Given such mountains of papers, scientists cannot be expected to examine in detail every single new paper relevant to their interests [3] . Thus, it is both advantageous and necessary to rely on regular summaries of the recent literature. Although recognition for scientists mainly comes from primary research, timely literature reviews can lead to new synthetic insights and are often widely read [4] . For such summaries to be useful, however, they need to be compiled in a professional way [5] .
When starting from scratch, reviewing the literature can require a titanic amount of work. That is why researchers who have spent their career working on a certain research issue are in a perfect position to review that literature. Some graduate schools are now offering courses in reviewing the literature, given that most research students start their project by producing an overview of what has already been done on their research issue [6] . However, it is likely that most scientists have not thought in detail about how to approach and carry out a literature review.
Reviewing the literature requires the ability to juggle multiple tasks, from finding and evaluating relevant material to synthesising information from various sources, from critical thinking to paraphrasing, evaluating, and citation skills [7] . In this contribution, I share ten simple rules I learned working on about 25 literature reviews as a PhD and postdoctoral student. Ideas and insights also come from discussions with coauthors and colleagues, as well as feedback from reviewers and editors.
How to choose which topic to review? There are so many issues in contemporary science that you could spend a lifetime of attending conferences and reading the literature just pondering what to review. On the one hand, if you take several years to choose, several other people may have had the same idea in the meantime. On the other hand, only a well-considered topic is likely to lead to a brilliant literature review [8] . The topic must at least be:
Ideas for potential reviews may come from papers providing lists of key research questions to be answered [9] , but also from serendipitous moments during desultory reading and discussions. In addition to choosing your topic, you should also select a target audience. In many cases, the topic (e.g., web services in computational biology) will automatically define an audience (e.g., computational biologists), but that same topic may also be of interest to neighbouring fields (e.g., computer science, biology, etc.).
After having chosen your topic and audience, start by checking the literature and downloading relevant papers. Five pieces of advice here:
The chances are high that someone will already have published a literature review ( Figure 1 ), if not exactly on the issue you are planning to tackle, at least on a related topic. If there are already a few or several reviews of the literature on your issue, my advice is not to give up, but to carry on with your own literature review,
The bottom-right situation (many literature reviews but few research papers) is not just a theoretical situation; it applies, for example, to the study of the impacts of climate change on plant diseases, where there appear to be more literature reviews than research studies [33] .
https://doi.org/10.1371/journal.pcbi.1003149.g001
When searching the literature for pertinent papers and reviews, the usual rules apply:
If you read the papers first, and only afterwards start writing the review, you will need a very good memory to remember who wrote what, and what your impressions and associations were while reading each single paper. My advice is, while reading, to start writing down interesting pieces of information, insights about how to organize the review, and thoughts on what to write. This way, by the time you have read the literature you selected, you will already have a rough draft of the review.
Of course, this draft will still need much rewriting, restructuring, and rethinking to obtain a text with a coherent argument [11] , but you will have avoided the danger posed by staring at a blank document. Be careful when taking notes to use quotation marks if you are provisionally copying verbatim from the literature. It is advisable then to reformulate such quotes with your own words in the final draft. It is important to be careful in noting the references already at this stage, so as to avoid misattributions. Using referencing software from the very beginning of your endeavour will save you time.
After having taken notes while reading the literature, you will have a rough idea of the amount of material available for the review. This is probably a good time to decide whether to go for a mini- or a full review. Some journals are now favouring the publication of rather short reviews focusing on the last few years, with a limit on the number of words and citations. A mini-review is not necessarily a minor review: it may well attract more attention from busy readers, although it will inevitably simplify some issues and leave out some relevant material due to space limitations. A full review will have the advantage of more freedom to cover in detail the complexities of a particular scientific development, but may then be left in the pile of the very important papers “to be read” by readers with little time to spare for major monographs.
There is probably a continuum between mini- and full reviews. The same point applies to the dichotomy of descriptive vs. integrative reviews. While descriptive reviews focus on the methodology, findings, and interpretation of each reviewed study, integrative reviews attempt to find common ideas and concepts from the reviewed material [12] . A similar distinction exists between narrative and systematic reviews: while narrative reviews are qualitative, systematic reviews attempt to test a hypothesis based on the published evidence, which is gathered using a predefined protocol to reduce bias [13] , [14] . When systematic reviews analyse quantitative results in a quantitative way, they become meta-analyses. The choice between different review types will have to be made on a case-by-case basis, depending not just on the nature of the material found and the preferences of the target journal(s), but also on the time available to write the review and the number of coauthors [15] .
Whether your plan is to write a mini- or a full review, it is good advice to keep it focused 16 , 17 . Including material just for the sake of it can easily lead to reviews that are trying to do too many things at once. The need to keep a review focused can be problematic for interdisciplinary reviews, where the aim is to bridge the gap between fields [18] . If you are writing a review on, for example, how epidemiological approaches are used in modelling the spread of ideas, you may be inclined to include material from both parent fields, epidemiology and the study of cultural diffusion. This may be necessary to some extent, but in this case a focused review would only deal in detail with those studies at the interface between epidemiology and the spread of ideas.
While focus is an important feature of a successful review, this requirement has to be balanced with the need to make the review relevant to a broad audience. This square may be circled by discussing the wider implications of the reviewed topic for other disciplines.
Reviewing the literature is not stamp collecting. A good review does not just summarize the literature, but discusses it critically, identifies methodological problems, and points out research gaps [19] . After having read a review of the literature, a reader should have a rough idea of:
It is challenging to achieve a successful review on all these fronts. A solution can be to involve a set of complementary coauthors: some people are excellent at mapping what has been achieved, some others are very good at identifying dark clouds on the horizon, and some have instead a knack at predicting where solutions are going to come from. If your journal club has exactly this sort of team, then you should definitely write a review of the literature! In addition to critical thinking, a literature review needs consistency, for example in the choice of passive vs. active voice and present vs. past tense.
Like a well-baked cake, a good review has a number of telling features: it is worth the reader's time, timely, systematic, well written, focused, and critical. It also needs a good structure. With reviews, the usual subdivision of research papers into introduction, methods, results, and discussion does not work or is rarely used. However, a general introduction of the context and, toward the end, a recapitulation of the main points covered and take-home messages make sense also in the case of reviews. For systematic reviews, there is a trend towards including information about how the literature was searched (database, keywords, time limits) [20] .
How can you organize the flow of the main body of the review so that the reader will be drawn into and guided through it? It is generally helpful to draw a conceptual scheme of the review, e.g., with mind-mapping techniques. Such diagrams can help recognize a logical way to order and link the various sections of a review [21] . This is the case not just at the writing stage, but also for readers if the diagram is included in the review as a figure. A careful selection of diagrams and figures relevant to the reviewed topic can be very helpful to structure the text too [22] .
Reviews of the literature are normally peer-reviewed in the same way as research papers, and rightly so [23] . As a rule, incorporating feedback from reviewers greatly helps improve a review draft. Having read the review with a fresh mind, reviewers may spot inaccuracies, inconsistencies, and ambiguities that had not been noticed by the writers due to rereading the typescript too many times. It is however advisable to reread the draft one more time before submission, as a last-minute correction of typos, leaps, and muddled sentences may enable the reviewers to focus on providing advice on the content rather than the form.
Feedback is vital to writing a good review, and should be sought from a variety of colleagues, so as to obtain a diversity of views on the draft. This may lead in some cases to conflicting views on the merits of the paper, and on how to improve it, but such a situation is better than the absence of feedback. A diversity of feedback perspectives on a literature review can help identify where the consensus view stands in the landscape of the current scientific understanding of an issue [24] .
In many cases, reviewers of the literature will have published studies relevant to the review they are writing. This could create a conflict of interest: how can reviewers report objectively on their own work [25] ? Some scientists may be overly enthusiastic about what they have published, and thus risk giving too much importance to their own findings in the review. However, bias could also occur in the other direction: some scientists may be unduly dismissive of their own achievements, so that they will tend to downplay their contribution (if any) to a field when reviewing it.
In general, a review of the literature should neither be a public relations brochure nor an exercise in competitive self-denial. If a reviewer is up to the job of producing a well-organized and methodical review, which flows well and provides a service to the readership, then it should be possible to be objective in reviewing one's own relevant findings. In reviews written by multiple authors, this may be achieved by assigning the review of the results of a coauthor to different coauthors.
Given the progressive acceleration in the publication of scientific papers, today's reviews of the literature need awareness not just of the overall direction and achievements of a field of inquiry, but also of the latest studies, so as not to become out-of-date before they have been published. Ideally, a literature review should not identify as a major research gap an issue that has just been addressed in a series of papers in press (the same applies, of course, to older, overlooked studies (“sleeping beauties” [26] )). This implies that literature reviewers would do well to keep an eye on electronic lists of papers in press, given that it can take months before these appear in scientific databases. Some reviews declare that they have scanned the literature up to a certain point in time, but given that peer review can be a rather lengthy process, a full search for newly appeared literature at the revision stage may be worthwhile. Assessing the contribution of papers that have just appeared is particularly challenging, because there is little perspective with which to gauge their significance and impact on further research and society.
Inevitably, new papers on the reviewed topic (including independently written literature reviews) will appear from all quarters after the review has been published, so that there may soon be the need for an updated review. But this is the nature of science [27] – [32] . I wish everybody good luck with writing a review of the literature.
Many thanks to M. Barbosa, K. Dehnen-Schmutz, T. Döring, D. Fontaneto, M. Garbelotto, O. Holdenrieder, M. Jeger, D. Lonsdale, A. MacLeod, P. Mills, M. Moslonka-Lefebvre, G. Stancanelli, P. Weisberg, and X. Xu for insights and discussions, and to P. Bourne, T. Matoni, and D. Smith for helpful comments on a previous draft.
About this guide, what is a literature review, trials and tribulations of writing.
The guide instructs students on how to write the literature review in scientific research papers. It illustrates the principles and practices that enable students to write a cogent and relevant literature review that frames their research study in terms of structure, scope and content. Using steps delineated in this guide illustrates to the researcher the process of writing a literature review. It allows the reader, when reading the review, to understand the justification for the research study as supported through the literature..
The process of writing a literature review encompasses four phases:
1. P lanning the Review. Provides a strategic roadmap for the writing process.
2. Exploring the Literature. Searching the literature for relevant sources for addition into their review.
3. Managing the Literature. Compiling and evaluating relevant sources for inclusion into the review.
4. Organizing and Writing the Review. Involves outlining and writing the literature review.
A literature review surveys the scholarly literature for relevant sources that address the scope of a research topic. Neither an annotated bibliography, nor a systematic review, it lays the groundwork for justification of the research study by identifying the research problem, formulating the study’s research questions, and defining the objectives of the study.
There are two types of literature reviews. The first type, article literature review, provides a comprehensive coverage of a research topic, problem or area of interest. The second type is a chapter embedded within a research article, which cites relevant literature sources that support the research study findings and discussion. This libguide focuses on how to write a literature review for a research article.
1. Purpose and Scope
To help you develop a literature review, gather information on existing research, sub-topics, relevant research, and overlaps. Note initial thoughts on the topic - a mind map or list might be helpful - and avoid unfocused reading, collecting irrelevant content. A literature review serves to place your research within the context of existing knowledge. It demonstrates your understanding of the field and identifies gaps that your research aims to fill. This helps in justifying the relevance and necessity of your study.
To avoid over-reading, set a target word count for each section and limit reading time. Plan backwards from the deadline and move on to other parts of the investigation. Read major texts and explore up-to-date research. Check reference lists and citation indexes for common standard texts. Be guided by research questions and refocus on your topic when needed. Stop reading if you find similar viewpoints or if you're going off topic.
You can use a "Synthesis Matrix" to keep track of your reading notes. This concept map helps you to provide a summary of the literature and its connections is produced as a result of this study. Utilizing referencing software like RefWorks to obtain citations, you can construct the framework for composing your literature evaluation.
2. Source Selection
Focus on searching for academically authoritative texts such as academic books, journals, research reports, and government publications. These sources are critical for ensuring the credibility and reliability of your review.
3. Thematic Analysis
Instead of merely summarizing sources, identify and discuss key themes that emerge from the literature. This involves interpreting and evaluating how different authors have tackled similar issues and how their findings relate to your research.
4. Critical Evaluation
Adopt a critical attitude towards the sources you review. Scrutinize, question, and dissect the material to ensure that your review is not just descriptive but analytical. This helps in highlighting the significance of various sources and their relevance to your research.
Each work's critical assessment should take into account:
Provenance: What qualifications does the author have? Are the author's claims backed up by proof, such as first-hand accounts from history, case studies, stories, statistics, and current scientific discoveries? Methodology: Were the strategies employed to locate, collect, and evaluate the data suitable for tackling the study question? Was the sample size suitable? Were the findings properly reported and interpreted? Objectivity : Is the author's viewpoint impartial or biased? Does the author's thesis get supported by evidence that refutes it, or does it ignore certain important facts? Persuasiveness: Which of the author's arguments is the strongest or weakest in terms of persuasiveness? Value: Are the author's claims and deductions believable? Does the study ultimately advance our understanding of the issue in any meaningful way?
5. Categorization
Organize your literature review by grouping sources into categories based on themes, relevance to research questions, theoretical paradigms, or chronology. This helps in presenting your findings in a structured manner.
6. Source Validity
Ensure that the sources you include are valid and reliable. Classic texts may retain their authority over time, but for fields that evolve rapidly, prioritize the most recent research. Always check the credibility of the authors and the impact of their work in the field.
7. Synthesis and Findings
Synthesize the information from various sources to draw conclusions about the current state of knowledge. Identify trends, controversies, and gaps in the literature. Relate your findings to your research questions and suggest future directions for research.
Practical Tips
Brown University Library (2024) Organizing and Creating Information. Available at: https://libguides.brown.edu/organize/litreview (Accessed: 30 July 2024).
Pacheco-Vega, R. (2016) Synthesizing different bodies of work in your literature review: The Conceptual Synthesis Excel Dump (CSED) technique . Available at: http://www.raulpacheco.org/2016/06/synthesizing-different-bodies-of-work-in-your-literature-review-the-conceptual-synthesis-excel-dump-technique/ (Accessed: 30 July 2024).
Study Advice at the University of Reading (2024) Literature reviews . Available at: https://libguides.reading.ac.uk/literaturereview/developing (Accessed: 31 July 2024).
Further Reading
Frameworks for creating answerable (re)search questions How to Guide
Literature Searching How to Guide
An official website of the United States government
The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.
The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.
Email citation, add to collections.
Your saved search, create a file for external citation management software, your rss feed.
Affiliation.
Literature reviews are valuable resources for the scientific community. With research accelerating at an unprecedented speed in recent years and more and more original papers being published, review articles have become increasingly important as a means to keep up to date with developments in a particular area of research. A good review article provides readers with an in-depth understanding of a field and highlights key gaps and challenges to address with future research. Writing a review article also helps to expand the writer's knowledge of their specialist area and to develop their analytical and communication skills, amongst other benefits. Thus, the importance of building review-writing into a scientific career cannot be overstated. In this instalment of The FEBS Journal's Words of Advice series, I provide detailed guidance on planning and writing an informative and engaging literature review.
© 2022 Federation of European Biochemical Societies.
PubMed Disclaimer
Full text sources.
NCBI Literature Resources
MeSH PMC Bookshelf Disclaimer
The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.
20,000+ Professional Language Experts Ready to Help. Expertise in a variety of Niches.
API Solutions
Unmatched expertise at affordable rates tailored for your needs. Our services empower you to boost your productivity.
GoTranscript is the chosen service for top media organizations, universities, and Fortune 50 companies.
One of the Largest Online Transcription and Translation Agencies in the World. Founded in 2005.
Speaker 1: A literature review is an objective, concise, critical summary of published research literature relevant to a topic being researched in an article. A good literature review will order articles and books to focus on unresolved debates, inconsistencies, tensions, and questions in a research field. It will also summarize the most relevant, important aspects of scientific literature related to your area of research, and synthesize past and current research on the topic and show how your research fits in. One way to think about doing a literature review is to imagine building a bookshelf. You don't need to cut each piece by yourself, rather you can take the pieces that other researchers have made and put them together to build your project. The literature review provides an understanding of the background of the field, identifying which studies are important and which are not, to put together your bookshelf of a study. So what should the literature review include? Historical background for research. You should show what has been written about your field of research so that you can present something new and significant and contribute to the understanding of this field, even in a small way. This also demonstrates to other researchers and journal editors that you know how to read theoretical concepts and put them in your own words to show understanding. Include current research context in which your research is situated. This means discussion questions, issues, and debates in the field. You can contextualize your work by showing related work as both historical background and the modern state of research, showing the development and trends of research. Include relevant theories and concepts. For example, if you are researching the relationship between the ecological environment and human population in that environment, providing models and theories that focus on specific aspects of this connection will help contextualize your study. Introduce and define relevant terminology to show how terms fit into the context of your work. Add related research and show how your work expands or challenges this research, or works to fill in a gap in the work in this field. You can use the literature review as evidence of what works, what doesn't, and what is missing. Provide supporting evidence for a practical problem or issue that your research is addressing, showing its importance. Referencing related research establishes your area of research as reputable and shows you are building upon previous work that other researchers have deemed significant. Literature reviews range from the selective, a very narrow area of research or only a single work, to the comprehensive, or a larger amount or range of works. They can also exist as part of a larger work or stand on their own. A course assignment is an example of a selective, standalone work. It focuses on a small segment of the literature on a topic and makes up an entire work on its own. The literature review in a dissertation or thesis is both comprehensive and helps make up a larger work. A majority of journal articles start with a selective literature review to provide context for research reported in the manuscript, which is the broader work for which the literature gives context. The literature review is often included in the introduction. Some literature reviews are both comprehensive and stand as a separate work. The entire article analyzes the literature on a given topic. Thus, the literature review, while it has common applications across many kinds of documents, can serve slightly different purposes and take different forms. The two types of literature reviews found in journals are research articles, such as studies and surveys, and standalone literature analyses. They differ in their scope, length, and specific purpose. The literature review found at the beginning of a journal article is used to introduce the research related to the specific study and is found in the introduction section, usually near the end. It is shorter than standalone reviews because it must limit its scope to very specific studies and theories that are directly relevant to this study. It is also often used to set research precedent and support theory or methods. Here is an example of a review of the literature, accompanied by the heading, Related Research. This section is four paragraphs in length and cites four to five sources, or roughly one source per short paragraph. This is fairly standard for a literature review introducing an article or study. When a literature review exists as a part of an introduction to a study, it follows the structure of the introduction itself and moves from the general to the specific, presenting the broadest background information about a topic first and then moving to specific studies that support your study, finally leading to your hypothesis statement. The literature is often indistinguishable from the introduction itself, introducing the background and defining the gaps your study aims to fill. The standalone literature review published as its own article, on the other hand, presents and analyzes as much of the important text in an area of study as possible to provide background information and context for a current area of research or a specific study that is being conducted now or will be conducted in the future. This can be an excellent resource for researchers when they are first seeking out the most relevant information on an area of study. Such an article, thus, presents and analyzes as many relevant texts as necessary to give a full account of a research topic, approach, or theory. It is generally a bit broader in scope and extends further back in time. This means that sometimes a scientific literature review can be highly theoretical. In addition, it focuses on the results and methods of previous studies. It often has a more extended analysis and goes into greater detail. All of the sections of this kind of review refer to the literature rather than detailing a specific current study. In this example of a literature review in a journal, there are two features that distinguish it. First, the words literature review are contained in the title. While it is not necessary to include this exact term, many literature reviews do indicate the type of article in their title. The second feature one notices is the length of the text. It is much longer than the literature review that introduces a study. The headings indicate what kind of literature is being discussed and how it contributes to the topic. At the end of the review is a conclusion that once again explicitly ties all of these works together to show how this analysis is itself a contribution to the literature. So how do authors turn a network of articles into a coherent review of relevant literature? Writing the literature review is not usually a linear process. You will often need to go back and check the literature while reformulating your ideas. This means you will not be writing the literature review at any one time, but constantly working on it before, during, and after your study is complete. This process will apply more to standalone literature reviews, but can also be useful in understanding what to include to introduce your study. The first step is to choose a topic to write on, focus, and explore this topic. Choose a topic that you are familiar with and highly interested in analyzing, a topic your intended readers and researchers will find interesting and useful, and a topic that is current, well-established in the field, and about which there has been sufficient research conducted for a review. This will help you find the sweet spot for what to focus on. In a journal article introduction, this is the point where you might realize you need to adjust your scope depending on what you learn from the literature. Next, research and collect all of the scholarly information on that topic that might be pertinent to your study. Scholarly articles, books, academic conference speeches, dissertations and theses, and any other academic work related to your area of study is called the literature. Next, analyze the network of information that extends or responds to the major works in your area. Select the material that is most useful. Use thought maps and charts to identify intersections in the research and to outline important categories. Select the material that will be most useful for you to review. Following this, it's time to describe and summarize each article. Provide the essential information of the article that pertains to your study. Determine two to three important concepts, depending on the length of your article, that are discussed in the literature. Take notes about all of the important aspects of the study relevant to your topic being reviewed. For example, in a study of heart disease, perhaps some of the main concepts are arthrosclerosis, hypertension, and obesity. Note these concepts and then write a brief summary about how the article incorporates them. For instance, Yang's 1995 longitudinal study of obese patients attempts to measure the effects of chronic hypertension on arthrosclerosis. In reviews that introduce a study, these can be relatively short summaries. In standalone reviews, there may be significantly more text and concepts to review. After you've summarized each article, you want to demonstrate how these concepts in the literature relate to what you discovered in your study or how the literature connects the concepts or topics being discussed. In a literature intro for the article, this information might include a summary of the results or methods of previous studies that correspond or confirm to the sections in your own study. You might identify the missing parts in previous studies that your study addresses or highlight concepts that support your hypothesis, methods, results, or conclusions. In a standalone literature review, this may mean highlighting the concepts in each article and showing they strengthen a hypothesis or show a pattern. For example, you might identify any unaddressed issues in the previous studies. You can identify what is accurate and what is out of scope within these works. The final step in the literature review process is to identify relationships in the literature and develop and connect your own ideas to them. This is essentially the same as the previous step, but focus on the connections between the literature and the current study or guiding concepts or arguments in the paper, not only the connections between the works themselves. Examining these concepts is almost like doing a study in itself, pointing to the most important information from previous studies and drawing possible conclusions from the results of these works. Your hypothesis, argument, or guiding concept is the golden thread that will ultimately tie the works together and give them the importance they wouldn't have had outside of your literature review. Furthermore, your review will not only cover publications on your topics, but will include your own ideas and contributions. By following these steps, you will be telling the specific story that sets the background and shows the significance of your research, and you can turn a network of related works into a focused review of the literature. How long should a literature review be? The length of your literature review will be determined by how many sources you are reviewing and how many concepts you are exploring, as well as how much tension exists between these concepts. A stand-alone literature review can be anywhere from 2-3 pages to an entire book in length. For a separate article, this section is usually no more than 2-4 paragraphs maximum. How many sources should I review? The amount of articles you review will be heavily determined by how broad or narrow your topic is, how in-depth you want to explore an issue, and perhaps how much consensus or disagreement exists in this area. In a stand-alone review, the number of works reviewed might be anywhere from 5-15 and up to 30 or more in a full book of literature review, whereas a journal article usually has fewer than 5 sources and does not go into great depth, but often focuses on the most important points. Here are some tips for creating a stronger literature review. Always define your topic and audience before beginning your research. This will help later when deciding which works to ultimately include in the review. Read as many journal articles as you can, especially those that are in your area of interest. These will give you an excellent idea of how to structure and order your review. Focus on more current literature, especially when it comes to studies and articles. Using older theories is fine if they are fundamental and provide a stable foundation for work that hasn't changed over the years, but more current research will always be highly sought after by researchers and other readers. This might go without saying, but researchers should always take ample notes while they are researching the texts. Using note cards, tables, and computing programs like Microsoft Excel will help organize and index information and make it much easier to categorize later. Whatever you do, don't simply stack texts in the relevant pile without first writing down exactly what in the texts makes them relevant. For more resources on research writing and publication information, as well as a full list of academic editing services, visit wordvice.com.
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
You can also search for this author in PubMed Google Scholar
Credit: Moor Studio/Getty
Could science be fully automated? A team of machine-learning researchers has now tried.
‘AI Scientist’, created by a team at Tokyo company Sakana AI and at academic labs in Canada and the United Kingdom, performs the full cycle of research from reading the existing literature on a problem and formulating hypothesis for new developments to trying out solutions and writing a paper. AI Scientist even does some of the job of peer reviewers and evaluates its own results.
AI Scientist joins a slew of efforts to create AI agents that have automated at least parts of the scientific process. “To my knowledge, no one has yet done the total scientific community, all in one system,” says AI Scientist co-creator Cong Lu, a machine-learning researcher at the University of British Columbia in Vancouver, Canada. The results 1 were posted on the arXiv preprint server this month.
“It’s impressive that they’ve done this end-to-end,” says Jevin West, a computational social scientist at the University of Washington in Seattle. “And I think we should be playing around with these ideas, because there could be potential for helping science.”
The output is not earth-shattering so far, and the system can only do research in the field of machine learning itself. In particular, AI Scientist is lacking what most scientists would consider the crucial part of doing science — the ability to do laboratory work . “There’s still a lot of work to go from AI that makes a hypothesis to implementing that in a robot scientist,” says Gerbrand Ceder, a materials scientist at Lawrence Berkeley National Laboratory and the University of California, Berkeley. Still, Ceder adds, “If you look into the future, I have zero doubt in mind that this is where much of science will go.”
AI Scientist is based on a large language model (LLM). Using a paper that describes a machine learning algorithm as template, it starts from searching the literature for similar work. The team then employed the technique called evolutionary computation, which is inspired by the mutations and natural selection of Darwinian evolution. It proceeds in steps, applying small, random changes to an algorithm and selecting the ones that provide an improvement in efficiency.
To do so, AI Scientist conducts its own ‘experiments’ by running the algorithms and measuring how they perform. At the end, it produces a paper, and evaluates it in a sort of automated peer review. After ‘augmenting the literature’ this way, the algorithm can then start the cycle again, building on its own results.
The authors admit that the papers AI Scientists produced contained only incremental developments. Some other researchers were scathing in their comments on social media. “As an editor of a journal, I would likely desk-reject them. As a reviewer, I would reject them,” said one commenter on the website Hacker News.
West also says that the authors took a reductive view of how researchers learn about the current state of their field. A lot of what they know comes from other forms of communication, such as going to conferences or chatting to colleagues at the water cooler. “Science is more than a pile of papers,” says West. “You can have a 5-minute conversation that will be better than a 5-hour study of the literature.”
West’s colleague Shahan Memon agrees — but both West and Memon praise the authors for having made their code and results fully open. This has enabled them to analyze the AI Scientist’s results. They’ve found, for example, that it has a “popularity bias” in the choice of earlier papers it lists as references, skirting towards those with high citation counts. Memon and West say they are also looking into measuring whether AI Scientist’s choices were the most relevant ones.
AI Scientist is, of course, not the first attempt at automating at least various parts of the job of a researcher: the dream of automating scientific discovery is as old as artificial intelligence itself — dating back to the 1950s, says Tom Hope, a computer scientist at the Allen Institute for AI based in Jerusalem. Already a decade ago, for example, the Automatic Statistician 2 was able to analyse sets of data and write up its own papers. And Ceder and his colleagues have even automated some bench work: the ‘ robot chemist ’ they unveiled last year can synthesize new materials and experiment with them 3 .
Hope says that current LLMs “are not able to formulate novel and useful scientific directions beyond basic superficial combinations of buzzwords”. Still, Ceder says that even if AI won’t able to do the more creative part of the work any time soon, it could still automate a lot of the more repetitive aspects of research. “At the low level, you’re trying to analyse what something is, how something responds. That’s not the creative part of science, but it’s 90% of what we do.” Lu says he got a similar feedback from a lot of other researchers, too. “People will say, I have 100 ideas that I don’t have time for. Get the AI Scientist to do those.”
Lu says that to broaden AI Scientist’s capabilities — even to abstract fields beyond machine learning, such as pure mathematics — it might need to include other techniques beyond language models. Recent results on solving maths problems by Google Deep Mind, for example, have shown the power of combining LLMs with techniques of ‘symbolic’ AI, which build logical rules into a system rather than merely relying on it learning from statistical patterns in data. But the current iteration is but a start, he says. “We really believe this is the GPT-1 of AI science,” he says, referring to an early large language model by OpenAI in San Francisco, California.
The results feed into a debate that is at the top of many researchers’ concerns these days, says West. “All my colleagues in different sciences are trying to figure out, where does AI fit in in what we do? It does force us to think what is science in the twenty-first century — what it could be, what it is, what it is not,” he says.
doi: https://doi.org/10.1038/d41586-024-02842-3
Lu, C., Lu, C., Lange, R. T., Foerster, J., Clune, J. & Ha, D. Preprint at arXiv https://arxiv.org/abs/2408.06292 (2024).
Ghahramani, Z. Nature 521 , 452–459 (2015).
Google Scholar
Szymanski, N. J. et al. Nature 624 , 86–91 (2023).
Download references
Reprints and permissions
AI Copernicus ‘discovers’ that Earth orbits the Sun
‘Set it and forget it’: automated lab uses AI and robotics to improve proteins
LLMs produce racist output when prompted in African American English
News & Views 28 AUG 24
Urgently clarify how AI can be used in medicine under new EU law
Correspondence 27 AUG 24
AI firms must play fair when they use academic data in training
Editorial 27 AUG 24
Jointly sponsored by the Hangzhou Municipal People's Government and the University of Chinese Academy of Sciences.
Hangzhou, Zhejiang, China
Hangzhou Institute of Advanced Study, UCAS
Job Title: Associate or Senior Editor, Nature Energy Location: New York, Jersey City, Philadelphia or London — Hybrid Working Application Deadline:...
New York City, New York (US)
Springer Nature Ltd
IOP is the leading research institute in China in condensed matter physics and related fields. Through the steadfast efforts of generations of scie...
Beijing, China
Institute of Physics (IOP), Chinese Academy of Sciences (CAS)
FACULTY POSITION IN THE MOLECULAR BIOLOGY OF REPRODUCTION
Dallas, Texas (US)
The University of Texas Southwestern Medical Center (UT Southwestern Medical Center)
Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.
Here’s how you know
Acupuncture is a technique in which practitioners insert fine needles into the skin to treat health problems. The needles may be manipulated manually or stimulated with small electrical currents (electroacupuncture). Acupuncture has been in use in some form for at least 2,500 years. It originated from traditional Chinese medicine but has gained popularity worldwide since the 1970s.
According to the World Health Organization, acupuncture is used in 103 of 129 countries that reported data.
In the United States, data from the National Health Interview Survey show that the use of acupuncture by U.S. adults more than doubled between 2002 and 2022. In 2002, 1.0 percent of U.S. adults used acupuncture; in 2022, 2.2 percent used it.
National survey data indicate that in the United States, acupuncture is most commonly used for pain, such as back, joint, or neck pain.
How acupuncture works is not fully understood. However, there’s evidence that acupuncture may have effects on the nervous system, effects on other body tissues, and nonspecific (placebo) effects.
Research has shown that acupuncture may be helpful for several pain conditions, including back or neck pain, knee pain associated with osteoarthritis, and postoperative pain. It may also help relieve joint pain associated with the use of aromatase inhibitors, which are drugs used in people with breast cancer.
An analysis of data from 20 studies (6,376 participants) of people with painful conditions (back pain, osteoarthritis, neck pain, or headaches) showed that the beneficial effects of acupuncture continued for a year after the end of treatment for all conditions except neck pain.
For more information, see the NCCIH webpage on low-back pain .
For more information, see the NCCIH webpage on osteoarthritis .
For more information, see the NCCIH webpage on headache .
For more information, see the NCCIH webpage on irritable bowel syndrome .
For more information, see the NCCIH webpage on fibromyalgia .
In addition to pain conditions, acupuncture has also been studied for at least 50 other health problems. There is evidence that acupuncture may help relieve seasonal allergy symptoms, stress incontinence in women, and nausea and vomiting associated with cancer treatment. It may also help relieve symptoms and improve the quality of life in people with asthma, but it has not been shown to improve lung function.
For more information, see the NCCIH webpage on seasonal allergies .
For more information, see the NCCIH webpage on cancer .
For more information, see the NCCIH webpage on asthma .
For more information, see the NCCIH webpage on depression .
For more information, see the NCCIH webpage on quitting smoking .
For more information, see the NCCIH webpage on menopause .
NCCIH funds research to evaluate acupuncture’s effectiveness for various kinds of pain and other conditions and to further understand how the body responds to acupuncture and how acupuncture might work. Some recent NCCIH-supported studies involve:
Nccih clearinghouse.
The NCCIH Clearinghouse provides information on NCCIH and complementary and integrative health approaches, including publications and searches of Federal databases of scientific and medical literature. The Clearinghouse does not provide medical advice, treatment recommendations, or referrals to practitioners.
Toll-free in the U.S.: 1-888-644-6226
Telecommunications relay service (TRS): 7-1-1
Website: https://www.nccih.nih.gov
Email: [email protected] (link sends email)
NCCIH and the National Institutes of Health (NIH) provide tools to help you understand the basics and terminology of scientific research so you can make well-informed decisions about your health. Know the Science features a variety of materials, including interactive modules, quizzes, and videos, as well as links to informative content from Federal resources designed to help consumers make sense of health information.
Explaining How Research Works (NIH)
Know the Science: How To Make Sense of a Scientific Journal Article
Understanding Clinical Studies (NIH)
A service of the National Library of Medicine, PubMed® contains publication information and (in most cases) brief summaries of articles from scientific and medical journals. For guidance from NCCIH on using PubMed, see How To Find Information About Complementary Health Approaches on PubMed .
Website: https://pubmed.ncbi.nlm.nih.gov/
The National Institutes of Health (NIH) has created a website, NIH Clinical Research Trials and You, to help people learn about clinical trials, why they matter, and how to participate. The site includes questions and answers about clinical trials, guidance on how to find clinical trials through ClinicalTrials.gov and other resources, and stories about the personal experiences of clinical trial participants. Clinical trials are necessary to find better ways to prevent, diagnose, and treat diseases.
Website: https://www.nih.gov/health-information/nih-clinical-research-trials-you
RePORTER is a database of information on federally funded scientific and medical research projects being conducted at research institutions.
Website: https://reporter.nih.gov
NCCIH thanks Pete Murray, Ph.D., David Shurtleff, Ph.D., and Helene M. Langevin, M.D., NCCIH for their review of the 2022 update of this fact sheet.
This publication is not copyrighted and is in the public domain. Duplication is encouraged.
NCCIH has provided this material for your information. It is not intended to substitute for the medical expertise and advice of your health care provider(s). We encourage you to discuss any decisions about treatment or care with your health care provider. The mention of any product, service, or therapy is not an endorsement by NCCIH.
Related Topics
Pain: Considering Complementary Approaches (eBook)
For Consumers
6 Things To Know When Selecting a Complementary Health Practitioner
For Health Care Providers
Mind and Body Approaches for Chronic Pain
Complementary Psychological and/or Physical Approaches for Cancer Symptoms and Treatment Side Effects
Research Results
New Findings Suggest Acupuncture Stimulation Reduces Systemic Inflammation
How the Body and Brain Achieve Carpal Tunnel Pain Relief via Acupuncture
Related Fact Sheets
Low-Back Pain and Complementary Health Approaches: What You Need To Know
Osteoarthritis: In Depth
Cancer and Complementary Health Approaches: What You Need To Know
Chronic Pain and Complementary Health Approaches
Traditional Chinese Medicine: What You Need To Know
Credentialing, Licensing, and Education
Paying for Complementary and Integrative Health Approaches
IMAGES
VIDEO
COMMENTS
When searching the literature for pertinent papers and reviews, the usual rules apply: be thorough, use different keywords and database sources (e.g., DBLP, Google Scholar, ISI Proceedings, JSTOR Search, Medline, Scopus, Web of Science), and. look at who has cited past relevant papers and book chapters.
A literature review is a survey of scholarly knowledge on a topic. Our guide with examples, video, and templates can help you write yours.
7 Writing a Literature Review Hundreds of original investigation research articles on health science topics are published each year. It is becoming harder and harder to keep on top of all new findings in a topic area and - more importantly - to work out how they all fit together to determine our current understanding of a topic. This is where literature reviews come in.
INTRODUCTION Whatever stage you are at in your academic life, you will have to review the literature and write about it. You will be asked to do this as a student when you write essays, dissertations and theses. Later, whenever you write an academic paper, there will usually be some element of literature review in the introduction. And if you have to write a grant application, you will be ...
How to Write a Literature Review. Step One: Decide on your areas of research: Before you begin to search for articles or books, decide beforehand what areas you are going to research. Make sure that you only get articles and books in those areas, even if you come across fascinating books in other areas.
Abstract Scientific review articles are comprehensive, focused reviews of the scientific literature written by subject matter experts. The task of writing a scientific review article can seem overwhelming; however, it can be managed by using an organized approach and devoting sufficient time to the process. The process involves selecting a topic about which the authors are knowledgeable and ...
How do you write a good literature review? This step-by-step guide on how to write an excellent literature review covers all aspects of planning and writing literature reviews for academic papers and theses.
Performing a literature review is a critical first step in research to understanding the state-of-the-art and identifying gaps and challenges in the field. A systematic literature review is a method which sets out a series of steps to methodically organize the review. In this paper, we present a guide designed for researchers and in particular ...
Learn how to conduct and write a systematic literature review in nine steps with this guide from Paperpile. Find out the types, purposes, and best practices of systematic reviews.
A formal literature review is an evidence-based, in-depth analysis of a subject. There are many reasons for writing one and these will influence the length and style of your review, but in essence a literature review is a critical appraisal of the current collective knowledge on a subject. Rather than just being an exhaustive list of all that ...
A literature review is a comprehensive analysis of existing research on a topic, identifying trends, gaps, and insights to inform new scholarly contributions. Read this comprehensive article to learn how to write a literature review, with examples.
Offers detailed guidance on how to develop, organize, and write a college-level research paper in the social and behavioral sciences.
What is a literature review? A literature review is an integrated analysis -- not just a summary-- of scholarly writings and other relevant evidence related directly to your research question. That is, it represents a synthesis of the evidence that provides background information on your topic and shows a association between the evidence and your research question.
Here you have a to-do list to help you write your review: A scientific literature review usually includes a title, abstract, index, introduction, corpus, bibliography, and appendices (if needed). Present the problem clearly. Mention the paper's methodology, research methods, analysis, instruments, etc. Present literature review examples that ...
What is a literature review? A literature review is a summary of the published work in a field of study. This can be a section of a larger paper or article, or can be the focus of an entire paper. Literature reviews show that you have examined the breadth of knowledge and can justify your thesis or research questions. They are also valuable tools for other researchers who need to find a ...
Overview of how to get started writing a health sciences literature review.
Rule 1: Define a Topic and Audience How to choose which topic to review? There are so many issues in contemporary science that you could spend a lifetime of attending conferences and reading the literature just pondering what to review.
The literature review is an opportunity to discover and craft your scholarly identity through the kinds of questions you engage, the discussions you enter, the critiques you launch, and the research you advance.
About this guide The guide instructs students on how to write the literature review in scientific research papers. It illustrates the principles and practices that enable students to write a cogent and relevant literature review that frames their research study in terms of structure, scope and content.
Developing a Literature Review . 1. Purpose and Scope. To help you develop a literature review, gather information on existing research, sub-topics, relevant research, and overlaps. Note initial thoughts on the topic - a mind map or list might be helpful - and avoid unfocused reading, collecting irrelevant content.
In this article, through a systematic search on the methodology of literature review, we categorize a typology of literature reviews, discuss steps in conducting a systematic literature review, and provide suggestions on how to enhance rigor in literature reviews in planning education and research.
A systematic literature review is a method which sets out a series of steps to methodically organize the review. In this paper, we present a guide designed for researchers and in particular early-stage researchers in the computer-science field.
Literature reviews are valuable resources for the scientific community. With research accelerating at an unprecedented speed in recent years and more and more original papers being published, review articles have become increasingly important as a means to keep up to date with developments in a part …
Choose and narrow your topic. Do some exploration before committing! It can be frustrating if there's too little information on your topic. But the narrower the topic can be, the easier the review process. Pick a topic of interest. Pick a topic with an obvious need for further research (if your literature review relates to a research agenda)
Journal of Research in Science Teaching publishes reports for science education researchers and practitioners on issues of science teaching and education policy. ... The literature shows that one key aspect of decision-making is utilizing scientific and other information to grasp the potential outcomes of one's actions and to minimize ...
The literature review found at the beginning of a journal article is used to introduce the research related to the specific study and is found in the introduction section, usually near the end. It is shorter than standalone reviews because it must limit its scope to very specific studies and theories that are directly relevant to this study. It ...
At the end, it produces a paper, and evaluates it in a sort of automated peer review. After 'augmenting the literature' this way, the algorithm can then start the cycle again, building on its ...
Things to Consider When Developing a PIER Plan. Promoting Inclusive and Equitable Research (PIER) Plans should describe the activities and strategies applicants will incorporate to enhance the scientific and technical merit of the proposed research through efforts that foster inclusive research and learning environments and promote equitable access to research and research careers.
A review of 9 earlier studies (777 participants) showed that adding acupuncture to conventional asthma treatment improved symptoms but not lung function. ... including publications and searches of Federal databases of scientific and medical literature. The Clearinghouse does not provide medical advice, treatment recommendations, or referrals to ...