Reviewer Responsibility

Hello Everyone,

Today I wanted to discuss how we see the responsibility of reviewers in science.  Peer-review is an integral component of the scientific community.  The ability to evaluate and critique the work of others is vitally important in science.  I’ve sort of touched on this before when talking about skepticism in science.  You can think of a scientific article as an argument that someone is presenting.  They need to present the argument as a hypothesis and to defend that hypothesis with their data.  At the same time, those reviewing the argument and the data need to be qualified enough to give an informative critique; they need to be peers.  I’ll describe what I see as the “modern” style of peer review and then move on to what I see as the “new” style.

The “modern” style of peer review as I would call it has been in use since at least the mid-20th century.  Scientific articles had been publish before this time, with editors themselves taking charge of reviewing manuscripts.  In the 1950’s and 1960’s academia had grown to such a point where there was both a demand that colleagues be able to review papers in their field before publication and enough qualified people to efficiently outsource the review process (1).  In this modern review process, the editor sends out the manuscript to individuals in the field.  How these individuals are selected is still somewhat of a mystery to the public at large and, in my opinion, to most of the scientific community as well.  Ideally, the reviewers are other scientists who have worked on the same topic or in the same scientific field.  The reason for this could be twofold.  For one you don’t need to provide as much background information to people already familiar with terms in the article under review, and for two you are much more likely to hold the attention and interests of people who can make connections to their own work.

There is, however, much of the criticism and concern surrounding modern peer-review.  In modern peer-review the article authors are not supposed to know their reviewers.  This sets up the perverse incentive for someone publishing a similar article to attack competing work unfairly or thwart it’s publication for their own interests.  Alternatively, a collaborator might provide very kind review if the paper’s publication might lead to publications for themselves down the line.  Most journals have mechanisms to prevent both of these from happening.  When submitting an article you are allowed to list a few scientists who “you would not like to be considered for review”.  The journal will also mention that you can submit “suggested reviewers” but they cannot be coauthors nor can they be individuals with whom you had professional dealing within the past 4-5 years (e.g. you didn’t write a grant together, you didn’t publish a paper together, you don’t co-advise students etc).  These, of course, are just suggestions.  The editor gets the final say on picking the reviewers, and they could send it to someone who will give a poor review no matter what.  You will not know who the reviewers are during the process and you might never know who reviewed your article.   I feel that this modern peer review style is becoming obsolete and that a new peer-review style is emerging.

Reading

There is a new style of peer-review emerging since the beginning of the 21st century: Open Review.  This type of review has been gaining more mainstream acceptance with the rise of Open-access journals and sites like Publons, which track reviews and reviewer records (2).  Under this type of review process everything is out in the open and accessible.  All communications between the reviewers and the authors are known and even the identities of the reviewers are known.  The content of the reviews will be available along with the article if it is accepted for publication.  Additionally there are “post-publication” reviewer, which critique the article after it has been accepted.  The goal of this type of review is to demystify the entire process and to facility better discussion about the scholarly merits of an article.  The downsides are obvious: there is the threat of collusion, but some studies have shown that there is very little difference in the quality of reviews or the outcome when using an open peer review process as opposed to the more traditional process (3).  By opening up the review process we can make the scientific merit of an article stand out even stronger and provide more confidence in the ability of the scientific community to promote good science.

The open peer-review process achieves what I believe should be the main goal of any reviewer: to help improve the scientific merit of an article.  The traditional or modern way of thinking about publishing is that it is a battle.  In this battle you have been “defeated” if you let a poor article be published so why not err on the side of caution and reject anything that seems even remotely suspect?  While I see the value in being a “gate-keeper” as a reviewer I personally feel that stopping there is lazy.  The reviewer is responsible for working with an author to improve their article and to strengthen the conclusion they have made about their hypothesis.  It would be better to put yourself on the side of the author, to have high standards for yourself, and to ask what your experience and expertise can add to this article to make it a valuable contribution to the journal.  With this in mind, open peer-review has to be the best method of fostering the author-reviewer relationship.  As a society we seem to be moving ever more and more towards a need for openness and transparency in institutions as well.  Having a clear, open review allows gives us confidence in the peer-review process and allows us to sniff out collusion or scientific misconduct.  I would encourage everyone to take a look at some articles that have been reviewed under “open peer-review” and to decide for themselves what makes the most sense.

 

Thank you all for reading!

Sincerely,

GRW

  1.  https://www.timeshighereducation.com/features/peer-review-not-old-you-might-think
  2. https://publons.com/home/

Van Rooyen S. et al. “Effect of open peer review on quality of reviews and on reviewers’ recommendations: a randomized trial” BMJ 1999;318:23

Why are People “Rallying Around Science”?

Hello Everyone,

I, like many other scientists, participated in the March for Science this past month.  Today I wanted to mention briefly my reasons for participating in the March.  There are some good questions being raised in the scientific community about whether or not scientists should be involved in politics or influencing public policy.  In my personal, humble, opinion people who think that science is “above politics” are full of themselves.  We are all human beings, we all have our own goals and we want to have input on public policy because, by its nature, it affects us.  I had the great opportunity last Friday to meet with Dr. Franklin Carrero-Martinez, the Deputy Science and Technology Adviser to the Secretary of State.  Dr. Carrero is a scientist by training and one who is now heavily involved in helping the State Department determine what to do with scientific information.  This does not mean hiding any information or presenting a biased view but it does mean forming an opinion and making a decision based on a fair reading of the facts.  That’s what I was marching for, a fair reading of the facts.  In the field of public policy, opinions should not be formed and then backed up with data after the fact.  All facts should be debated and an opinion should be formed from that debate.  Of course, new data can always help us to refine or even change our opinions.  In my mind, however, the failure to form an opinion and failure to take decisive action is a failure in leadership.  So again, I’ll call on everyone to please get involved in scientific research and to think about how it affects your daily life.

 

Thanks for reading,

GRW

Gaining more Flexibility in Science: Pursuing International Opportunities

Hello Everyone,

To add more flexibility to our platforms for conducting scientific research, perhaps it’s time that scientists here in the US take into consideration options abroad.  This thought was spurred on by a recent trip I took to China.  I had the opportunity to see some of the university system there and how it’s become quite international.  Not only can the environment be friendly, but there is also the fact that China is spending the second most total money on R&D behind only the US(1) and has been heavily investing in a computing power that might soon outpace the United States (2).  In a previous post I said scientific research is an inherently globalized enterprise.  I think as the reputation for quality research increases in Asia this fact will only become clearer.  Certainly there are some caveats to working abroad in a large bureaucracy such as China, namely greater amounts of corruption by some academics (3).  Still, this is no reason to completely discount the possibility of US students moving outside of the US to conduct their research.

For those seriously considering moving out of the US, it’s important to consider how you’ll be perceived by the scientific community.  Students from the US are, by and large, considered top tier in terms of academics.  This means students going from the US to, for example, Europe or Asia are very valuable.  These students will have some leverage getting a position as a research professor/post doc/grad student abroad.  There is always the question, however, of coming back to the United States, if that is the ultimate goal.  I haven’t heard much downside to people doing research abroad, especially at top tier universities such as Max Planck, Oxford, University of Tokyo, etc.  A person who goes to a smaller institute might be plagued with the same prestige-bias that students who attend smaller universities in the United States suffer.  This begs the question: if you want to study or do research at a smaller university, why not try moving abroad?

One last concern about researching abroad, however, is that the research funding systems might work drastically differently in other countries.  A labmate from Poland told me that in her country there are barely any postdoc positions available.  People either go straight from graduate school to being a professor or not at all.  I’ve heard from others that there are similar concerns in other countries in Europe.  Certain institutes use a model where the PI of the lab, rather than getting tenure, has a strict term limit for their time.  This might the window for what may seem like an ideal position very narrow.  Countries such as China strictly limit career movement from university to university.  This could cause a problem if the situation in a lab sours.  If you are considering moving from the US to another country to do research please do some research into how the academic system works in that country.

Thanks for reading this time.  I hope I’ve given you something to think about and maybe at least an interest in looking into how research works in other countries.  Regardless of what happens in the world, the pursuit of science will continue to happen all over the Earth.  I would encourage you to become a part of it wherever you can!

Sincerely,

GRW

  1. https://en.wikipedia.org/wiki/List_of_countries_by_research_and_development_spending
  2. https://www.wired.com/2016/06/fastest-supercomputer-sunway-taihulight/
  3. http://www.nature.com/news/scientists-caught-in-chinese-anti-corruption-sweep-1.16152

New Paper: Controlling Membrane Active Peptide Activity

Hello Everyone,

I’m happy to say that I was able to publish what was the bulk of my PhD thesis work in the Journal of the American Chemical Society and that it is finally available.  This work formed the initial basis of my ideas around Molecular Yoga, the ability to control the ways in which molecules can change conformation and activate certain functions.  In short, we created a combinatorial library based on the membrane active, toxic peptide Super-Melittin (derived from Melittin from honeybee venom).  This peptide has excellent antimicrobial and potent anti-cancer capabilities but it is very harmful to our own body’s cells as well.  I believe that by changing just a few of the amino acids we could create a peptide that would be inactive at neutral pH but could fold into an alpha-helix and activate at a low pH.  Low pH environments are often found in tumors and with fungi and bacteria, making it an good activating key for these peptides.  We’re currently working to develop a patent for these exact purposes and some of my colleagues, Sarah and Elmer are still working very hard to improve these peptides further.  Please give it a read and let me know what you think!

I have another announcement too.  I’ll be reporting next month as part of the 61st Biophysical Society Meeting blog in New Orleans.  I hope to use this as a way to bring science to the public and to help them to interact with the scientific community.  Look for updates along these lines in the next few weeks!  Thanks for reading!

Sincerely,

GRW

 

Paper:

pH-Triggered, Macromolecule-Sized Poration of Lipid Bilayers by Synthetically Evolved Peptides. Wiedman G, Kim SY, Zapata-Mercado E, Wimley WC, Hristova K. (2016)  JACS

http://pubs.acs.org/doi/abs/10.1021/jacs.6b11447

 

Skepticism versus Denial in Science

Hello Everyone,

Before the year is out I wanted to make one last post on a topic I feel is becoming increasingly more important in today’s academic climate.  That point is about the difference between skepticism and denial.  We hear a lot in the news (fake or real) about how different people are either “deniers” or “skeptics” of various ideas.  The utility of vaccines, climate change, AIDS, are just a few topics that come up with these labels on them.  Perhaps it would be best to have a discussion of the topic with, instead of politically charged rhetoric, a view towards science itself.

The reason that I’ve been thinking about this topic recently stems from a book I got as part of a Secret Santa gift: “Dancing Naked in the Minefield” by Kerry Mullis.  Kerry Mullis won a Nobel Prize for his part in developing Polymerase Chain Reaction synthesis of DNA.  He’s a man I deeply disagree with but whom I think has a good point nonetheless.  Mullis, in the early 1990’s challenged the prevailing wisdom that Autoimmune Deficiency Syndrome (AIDS) was caused by infection with the Human Immunodeficiency Virus (HIV).  By the mid-1990’s, however, there were several cases of isolated HIV accidentally being introduced to healthy individuals and these individuals eventually developing AIDS. These cases established a link between HIV and AIDS(1).    For his part, Mullis would describe himself as a “consummate skeptic” always questioning whether or not the scientific community has sufficiently tested and evaluated a hypothesis.  In a sense he’s right; as scientists we should always be skeptics, no matter how established the dogma in our field has become.  We can go back to Copernicus (and earlier Greeks) challenging the idea that everything revolved around the Earth or Louis Pasteur and others challenging the idea of Spontaneous Generation as examples.    There comes a point, however, where to make progress in a field we have to accept that our data point towards a scientific consensus on a topic. From this consensus we can test new hypotheses and create new ideas.

Then we reach what we would call “denial”.  Denial, in as non-political of terms as I can put it, is ignoring the scientific consensus and the data that support it and instead interpreting results based on your own biases and beliefs.  The correct way to do science is to make as objective observation as possible, create a hypothesis objectively, and then evaluate that hypothesis without presuming any specific outcome.  Contrary to popular belief, scientists actually really love to prove things wrong, especially well, established ideas.  You have to approach it though as if you don’t already know what is going to happen.  A really good scientist will know how to ask new questions regardless of the answer they get.  This then gets us into another discussion about transparency in science and the perils of a “results-driven scientific culture” but I’ll get back to that another day.  Overall there’s an important difference to highlight:  Not all skeptics are deniers but all deniers are bad skeptics.

Finally something to think about for 2017 for both scientists and non-scientists is how we view those in academia and who we look to for authority on a subject.  The best defense of the Liberal Arts I ever heard was from a man I greatly admire and respect: Dr. Phil Nichols a professor at the University of Pennsylvania who said (and I’m paraphrasing), “People who study history, language, culture, are the people we turn to when the world is in moral crisis”.  People who’ve studied an area very intensely are in unique position to help others understand the world around them.  Education is not something to lord over other people like some kind of medieval sale of Indulgences.  Rather, it’s a calling and a responsibility; it’s service to humanity at large.  Therefore, scientists have a responsibility very clearly communicate what we mean by skepticism and what we mean by scientific consensus.

On that note thank you for reading and have a Happy New Year!

Sincerely,

GRW

 

(1) O’Brien SJ, Goedert JJ, “HIV causes AIDS: Koch’s Postulates Fulfilled” Current Opinions in Immunology: 1996, 8(5) 613-618.

 

Science, Government, and Globalization

Hello Everyone!

I wanted to finally post something this month related to science now that the US election is over.  A fair warning, this will be another opinion piece of mine; I welcome the opportunity to discuss all manner of opinions.

I, as a scientist in the United States, like many other scientists, apply for funding from the US government.  This can come from a number of different places: The National Science Foundation, the National Institutes of Health, the US Department of Energy, US the Department of Defense and many other government sources.  There are also outside sources of funding: The Gates Foundation, MacArthur Fellows Program, and The Beckman Foundation all of which provide funding for projects with specific goals in mind.  This brings up the obvious question: what sort of bias does receiving funding from a given institute introduce into the scientific process?  To address this first point I want to highlight the fact that when scientists apply for a project grant they have already developed a project to fit a specific funding call.  From all I can tell faceless government organizations are not handing out projects to push political agendas.  Ideas are the currency of the scientific community; few people with good ideas rely on somebody else to pursue them!  As scientists we constantly look for new areas to expand the knowledge of the scientific community and we’re always willing to challenge our own views.  So while, yes, funding directives might limit the scope of scientific inquiry the scientific community will always look for ways to expand beyond just the easy funding opportunities.

Along this point as well, the scientific community is a global community that goes beyond nationalism.  There are nationalistic biases in research as well.  People may question the ethics of research done in certain parts of the world or whether or not the results produced there are reliable.  I’ve heard people say more than once to take authors’ papers from a particular part of the globe “with a grain of salt.”  Still that doesn’t mean that they should be shut out.  Their ideas should be put to the test like anyone else’s ideas and if they hold up to scrutiny then they hold up.  As scientists from the United States of America we can stick our heads in the sand and say that we are the best and we don’t trust work done outside of the US.  This ignores the fact, however, than many other countries are on par or even above our level of R&D spending in terms of per capita GDP. (1)  We ought to be proud of the excellent work done in the United States and of the universal respect that the world at large has for US academia.  This does not entitle us to narrow our view and miss out on ideas from other parts of the world.

Finally the question that’s been on my mind recently and that I want to discuss is: what is the way forward for the scientific community?  What does our global community do in the fact of increased isolationism and reactionary rhetoric throughout the world?  I’ll hark back to what I spoke about in previous posts: we need to increase scientific outreach and to help improve public scientific literacy.  People would benefit from a better understand of the role that the scientific method plays in their everyday life.  They can observe the world around them, make hypotheses about it, test their hypotheses, and analyze the results to come to a logical conclusion.  Then, in sharing their conclusions, they will perpetuate a global scientific discourse.  This requires all of us to donate our time to reaching out, to teaching the young and the old.  Not because we want recognition for it, not because we are afraid of what might happen if we don’t but because we have conviction to do so!

 

Move forward!  Find an opportunity and get involved!

Volunteer at a Children’s museum such as:

The Indianapolis Children’s Museum

https://www.childrensmuseum.org/content/volunteer

The Franklin Institute in Philadelphia

https://www.fi.edu/join-our-team/volunteer

The Maryland Science Center in Baltimore

http://www.mdsci.org/get-involved/volunteer/

Participate in Public Debates in your local municipality on science issues that are important to you!

 

Consider organizing a “Science Night” at a local restaurant to promote discussion!

 

Start a discussion club, invite people from your community to participate!

 

Do anything you can!  Move forward!

 

Sincerely,

 

GRW