POOMS deploys a post-publication, relevance-optimized and open peer review model. In other words, peer reviews are mandatorily open and happen after the article has passed the pre-publication evaluation check and after it has been published. Upon publication of the article, a formal invitation is sent out to expert reviewers to begin the peer review process. To fully integrate relevance into the review process, POOMS peer reviews are carried out by expert reviewers from both academia and practice. Invited reviewers are requested to review the article within a specified time-frame through our fully open, transparent and relevance-optimized peer-review model.
Joining a growing number of publishers using an open reviews model and seeking to standardize peer review terminology for easy comparability, POOMS adopts the ANSI/NISO Standard Terminology for Peer Review as a means of summarily describing our peer review process.
• Identity transparency: All identities visible
• Reviewer interacts with: Editor, other reviewers, authors
• Review information published: Review reports, submitted manuscript, reviewer identities
• Post publication commenting: Open
Identity transparency: Since POOMS uses a post publication open peer review model, it follows that all peer reviews happen on a version of the article that is published making the author(s) names and affiliate institutions fully accessible to readers and reviewers. Therefore, reviewers get to know the identity(ies) of the author(s) and when the reviewers’ reviews are published, our mandatory open review model requires that reviewers’ full names and institutional affiliations are fully disclosed. Thus, authors get to know the reviewers.
Reviewer interacts with: POOMS editorial team interacts with peer reviewers at different stages of the review process. First of all, they first interact when the editorial team formally invites them to serve as reviewers for and secondly, during the review process when the editorial team provides peer reviewers support services. Moreover, Peer Reviewers interact with each other when they read each other's reviews on the same article when their first round of peer reviews are initially published, and can optionally comment on each other's reviews openly using the comment section if they choose to. Finally, while authors are required to respond to the review comments offered by the peer reviewers, they are required to respond while submitting a revised version of their article which will also be published openly alongside the latest version of the article; they can also optionally choose to respond by openly responding to peer-review reports by commenting on the corresponding report. Beside responding to the openly published review reports from reviewers while submitting corrected versions and optionally commenting on such reports using the comments section, it is against our policies for authors to contact reviewers directly, as this may lead to the invalidation of any reviews emanating after direct interactions. Authors and reviewers must also take into cognizance the fact that reviewers’ reports including their identities and affiliations are fully and openly published and the inherent level of rigor is publicly assessed by readers and the general public.
Review information published: Once a submission passes pre-publication evaluation checks, it is formally published kicking off the initial review process. During this stage, as peer review reports are received, members of the POOMS editorial team carry out an editorial check to ensure that the submitted review report complies with POOMS’ Peer Reviewer Code of Conduct, after which the report is published along with the full names and institutional affiliations of the reviewers. In compliance with POOMS commitment to open science, each published peer review report is assigned a DOI to empower it to be independently citable thereby enabling reviewers to receive credit for the effort put into the review process.
Post publication commenting: At POOMS, each publication (article, review reports and responses to review reports) comes with a comment section which facilitates open discussions of an academic and practice-oriented nature typically carried out between or among the authors, reviewers, scholarly or practitioner readers. Discussions carried out in the comments section must be about the article in question and can focus on the scientific content presented in the research article or on the practice implication content of the article.
The Role Of The Internal Editorial Staff And Authors In The Peer Review Of Manuscripts
While the POOMS editorial team works together with authors to identify, suggest and invite suitable reviewers who are expert scholars and practitioners in the field, they both have very clearly demarcated roles. It is the primary role of POOMS’ internal editorial team to identify, confirm and contact suitable peer reviewers. However, POOMS staff may request suggestions for potential peer reviewers from authors, in such cases authors can merely suggest but it is the primary responsibility of the internal editorial team to verify the eligibility of suggested reviewers and to approve/disapprove their inclusion as reviewers for the submission in question. Occasionally, and where necessary, the editorial team may coordinate with and complement the efforts of the authors in searching for and suggesting practitioner reviewers.
Typically, before the initial publication of a submission, the internal editorial team may identify (or request authors to provide) a list of 6 potential reviewers (4 expert scholars and 2 expert practitioners) who meet our core criteria for reviewers.
• In cases where they are requested to make these suggestions from their network, we provide a guide to aid authors in identifying potential scholarly experts - usually ones who have extensively published in the topic area the article is concerned with; as well as practitioners who are visibly acknowledged as experts in the domain either as a result of their long practice tenure within the domain area of the submitted research or as a result of related positions held in reputable organizations.
• Irrespective of the source of the suggested reviewers, authors are only allowed to make the suggestions to the editorial team. It is against our policies for authors to directly contact suggested/actual reviewers as this may lead to the invalidation of any reviews emanating after direct interactions.
A continuous search will be made by the editorial team while simultaneously, a continuous request to suggest potential reviewers will be made by the editorial staff to authors until at least four peer review reports (two scientific and two practice) have been received, checked by the editorial team and published.
Criteria For Selecting Peer & Practitioner Reviewers
At POOMS our criteria for identifying suitable reviewers reflects our core commitment to relevance in management research. As such, two separate criteria are provided to help editorial staff and authors identify suitable scientific reviewers as well as practitioner reviewers.
Editorial staff & authors must apply the following criteria when identifying and selecting scientific reviewers:
1. Scholarly domain expertise: potential scientific reviewers should (a) demonstrate verifiable domain expertise in the key domain(s), topic area(s) or deployed method(s) of the submitted research; (b) have published at least three articles as a single or main author within the domain of the study or on relevant topics topically near that of the submitted study.
2. Depth of scholarly domain experience: potential scientific reviewers must (a) have attained a substantial level of experience reflected in their scholarly qualifications - usually an Assistant Professorship and above; and (b) be formally employed at a recognized higher educational institution or research organization.
3. Relational Independence: potential scientific reviewers who work at the same institution as the authors, or are close collaborators, partners or research group members with the authors, or non-scholarly collaborators associated in other ways to the authors e.g, personally, financially or professionally are not eligible to serve as scientific peer reviewers for obvious conflict of interest reasons. A full disclosure of any conflicts of interest is a mandatory requirement that reviewers must provide on their review reports which, in line with our fully transparent peer review process, will be openly and fully published.
When identifying and selecting practitioner reviewers, editorial staff and authors are required to comply with the following criteria:
1. Practitioner’s domain expertise: potential practitioner reviewers should (a) demonstrate verifiable practice-based domain expertise in the key subject domain(s) or topic area(s) of the submitted research; OR (b) must be actively working as a management consultant within the corresponding management domain, and must have provided at least three consulting services within the past year to the practitioner group for whom the study in question is relevant to.
2. Depth of domain experience in practice: potential practitioner reviewers must (a) have occupied corporate managerial or leadership positions within the corresponding domain/topic area OR (b) have attained partnership at a recognized large and global management consultancy or have occupied the position of principal consultant for an active minimum of four years at a boutique private consulting establishment, and (c) be currently and formally employed at a recognized corporate organization or management consulting firm.
3. Relational Independence: potential practitioner reviewers who work at the same organization as the practitioner author(s) (in cases where a study is co-produced collaboratively by authors from academia and authors from practice), or are close collaborators, business partners or research group members with any of the authors; or non-practitioner collaborators associated in other ways to the authors e.g, personally, financially or professionally are not eligible to serve as practitioner peer reviewers for obvious conflict of interest reasons. A full disclosure of any conflicts of interest is a mandatory requirement that reviewers must provide on their review reports which, in line with our fully transparent peer review process, will be openly and fully published.
The Role Of Reviewers In The Peer Review Process
At POOMS, in line with recent best practices in scholarly peer reviews, reviewers are provided with review guidelines that are tailored to each specific type of research article. In essence, reviewers are asked to (a) determine the scientific soundness of the research and (b) confirm the relevance of the study and its findings to practitioners.
In determining the scientific soundness of a research, reviewers are required to determine:
1. if the study is well positioned theoretically within the context of the current literature
2. if the study's finding is generalizable
3. if the study's findings have been sufficiently and appropriately discussed within the context of extant and current literature
4. if the study provides sufficient information as well as source data to allow replicability and reproduction at every stage of the research
5. if the conclusions of the study are scientifically and where necessary, empirically supported by the findings.
In confirming the relevance of a research, reviewers are required to determine:
1. Descriptive relevance: whether the research question/problem is representative of a real life management situation and of importance to practitioners.
2. Currency relevance: Timeliness - whether the research topic/question/problem and its findings are current or trending in practitioner spheres and whether the study's findings are readily implementable/deployable by management practitioners in resolving the problem in question in real world management settings. Timelessness- whether the aim of the study is to merely stimulate critical thinking among practitioners or to synthesize extant scientific/practitioner literature for the evidential benefit of management practitioners.
3. Goal relevance: whether the dependent variable or focal variable is relevant to the outcome of interest to practitioners.
4. Operational validity: whether the set of independent variables contained in the study can be manipulated in organizational settings.
5. Non-obviousness: whether the results provide useful information or are mere common sense conclusions.
6. Actionable advice for practitioners: whether the study contains clear actionable advice for management practitioners in accordance with its findings.
7. Article readability: whether the manuscript is readable to management practitioners. At POOMS we prefer grade 8 readability levels especially for Poomslays.
Where the research type being reviewed are any of the following: Letters to the editor, Opinion articles or Case reports, peer-reviewers are only asked to review the facts and approaches deployed but will not be required to evaluate, agree or disagree with the author's stated opinion.
Upon conclusion of each review, reviewers are required to provide a review report clearly stating the reviewer's review decision by selecting any one of these three review decisions:
Approved: An approved decision means that the reviewer found the manuscript to be both scientifically rigorous and of adequate relevance to management practitioners. Scientific rigor is reflected in the adequacy and accuracy of the research design, methodology, statistical analysis, results; and that drawn conclusions are supported by analyzed data as reflected in the statistical analysis. Relevance to practitioners is reflected in the satisfaction of all seven relevance criteria mentioned in the preceding section.
Approved with Reservations: This means that while the reviewer judges the manuscript as having scientific and practitioner-relevance rigor and merits publication pending the conduct of certain minor or occasionally, major adjustments or revisions to the manuscript in question.
Not Approved: The reviewer judges the manuscript to be of poor scientific rigor and of low relevance to management practitioners. In other words, the poor scientific rigor results from serious flaws in the manuscript that significantly compromise the study's findings and conclusions; and/or the study's as a whole is not relevant to a management practitioner audience across all seven relevance criteria.
Reviewers especially those who have either awarded an ‘Approved with Reservation’ or ‘Not Approved’ decision are encouraged to review revised versions of the manuscripts submitted by authors in line with the reviewers’ comments to ascertain if the authors have adequately improved the manuscript to warrant a more favorable approval decision or if a ‘Not Approved’ decision should be a final review decision.
Handling Revisions And Article Updates
At POOMS, we deploy our pioneer innovative dual-output publication format which means that after pre-publication checks are completed for a submission, two outputs are published the concise practitioner-friendly format whose content, language, style and article format is relevance-optimized for easy consumption by our primary target: management practitioners; as well as an innovative and relevance-enhanced regular scientific article very similar to traditional scientific publication formats.
Therefore, when review reports are received for a submission, authors are required to address the issues raised by the reviewers on both manuscripts, by publishing revised versions for both. When necessary, authors can additionally respond to review reports using the article's comment section.
In-line with our commitment to the openness and transparency of the scientific process, we make all versions of our dual-output article publications publicly available, and independently citable. However, only the most recent versions of both output types will be displayed by default on the article's web page here on POOMS, with a summary section at the beginning of each new version displaying at a glance, a short history of the revisions and versions to keep readers up-to-speed on the article's development.
Similarly, in-line with recent developments in scholarly publishing, all articles published in POOMS journals are considered ‘living’ in the sense that long after the peer-review process has been successfully completed, authors can at anytime choose to update the information contained in the long finalized article as new significant developments occur within the corresponding field or topic area that have implications for the study's findings.
Key Takeaways About Our Post-Publication Open Reviews Process
• Our review process is open and gives equal priority to both relevance rigor and scientific rigor (based on our equal relevance & scientific rigor review framework)
• Our review process is post-publication to enable us meet the relevance requirement for timeliness.
• As our process is post-publication, open and accords equal priority to relevance rigor and scientific rigor, it demands high levels of transparency, so it is mandatorily open end-to-end (we believe that openness and transparency safeguards rigor).
• Our review process is not biased against negative or non-significant results. We are methods and article-type agnostic.
• Our open review process is not interfered with by an editor-in-chief, eliminating any opportunity for editorial/review bias. To avoid common issues of bias increasingly reported in traditional management research journals and publishers, our process makes it impossible for manuscripts to be discriminated against based on author nationality, race, institutional affiliation, country or region. All manuscripts are equally and transparently evaluated.
• Practitioners are included in our review teams (at least 2 practitioners, 2 academics).