Citations, altmetrics, and the impact factor

Metrics, metrics, everywhere. Not a day goes by in academia without some new metric being designed to measure research assessment, or a complaint about how crap another metric is. There are soooo many studies out there that look at things like how open access influences citation rates or altmetrics, or what the relationship between altmetrics and citations is.

But most of these are large-scale, so don’t really mean anything to the individual researcher. So I decided to have a look at the impact factors, citations, and Altmetric scores for each of my papers (not that many..) just to see what sort of relationships existed between them for any on a personal level.

Where’s the data from? Well, that part’s easy. The Internet.

Continue reading

The future of academic publishing and advice for young researchers

This was originally posted here.

This interview presents the perspectives of an early-career researcher who conducts research, publishes papers, attends academic conferences as part of his PhD, travels to different parts of the world to help educate researchers about open research and science policy, blogs actively, serves as a peer reviewer, and makes time for several other activities including this interview! Jonathan (Jon) Tennant dived head first into palaeontology research, i.e., his first love, even when it required him to change disciplines. And during this journey, he discovered his passion for all things related to scientific communication and policy, especially open science. He is among those researchers who realize the true potential of networking and utilize it to actively participate in dialogue on some of the most critical issues in academic research — all this alongside managing a demanding research schedule. I spoke to Jon about his interests both within and outside research. I particularly wanted to understand how he is able to pursue serious research as well as be involved in other activities, and learned that the primary driving force behind Jon’s work is his passion for science and the need to ensure that more and more people are informed about the most important developments in academic publishing.

Jon is currently a final year PhD (palaeontology) student at Imperial College London in theDepartment of Earth Science and Engineering. His research focuses on patterns of biodiversity and extinction in deep time and the biological and environmental drivers of these patterns. Jon is also passionate about science communication and strongly believes that science should be in the public domain. He takes a deep interest in following and talking about how current trends in open science impact science communication. He also maintains a blog, Green Tea and Velociraptors, and tweetsactively about topics close to his heart.

For this concluding segment of this interview series, I queried Jon about three things: 

  • What needs to change in the current academic publishing scenario
  • What the future of academic publishing looks like
  • What advice Jon has for researchers based on his experiences as a researcher and communicator.

Jon talks about the need to strengthen science policy to consider “the best interests of the commons” and for the whole academic community to embrace the concept of transparency in all aspects of research. He also feels that the current research assessment system needs major restructuring. But it’s not all bleak, according to Jon, for he has some optimistic predictions for the future of science communication. He concludes by sharing some valuable advice for early-career researchers.

If you could change three things about research communication/science policy, what would they be and why?

We often talk about “open” as if it has value in itself. This is only a half truth, and the real value comes from what openness gives you, which depends on the context. In science policy, I would love to see more transparency in the decision making process as a result of being more open. What evidence was used? Where? How was the conclusion reached? What conversations/meetings were had that haven’t reached the public record, and what was discussed at them? This is part of transparency for the sake of democratic accountability, and an important part of social policy making to me. For many, science policy is like reading the conclusions section of a paper, but the methods, material and discussion sections are all completely absent!

I would like to see more policymakers and funders acting in the best interests of the commons. For example, if you have a choice to make between preserving the unsustainable profit margins of some scholarly publishers or offering better value for money elsewhere, then you take the second choice. When you have some publishers making 40% profit margins of at least partial public funding, and largely through prohibiting public access to knowledge, you know something is massively wrong with your system. Changing this certainly includes the development of a robust scholarly communications infrastructure (which people like Björn Brembs and Geoffrey Bilder among others are great advocates for) — essentially crafting an efficient, default workflow for the entire research process, including communication. If governments fund this, we could save billions each year and re-inject it into research instead of wasting it on profiteering publishers, and the relatively low-value high-cost services that they offer.

Most of all, though, we need a complete and massive-scale overhaul of our assessment system. It is completely unacceptable that in the digital age we are still defaulting to lazy and inappropriate assessment criteria for whatever reason. This is actually related to the second point, in that if you build an infrastructure where communication of research (i.e., ~95% of the value) is decoupled from both the concept of journal prestige and the traditional publication process, then we should see a movement away from poor evaluation criteria (i.e., those which are journal-based). In almost every discussion I have with junior researchers, this is what it comes back to. Some are being put off doing science openly, or even correctly, because they fear they will be firstly punished by the publishing system, and then penalized by the research evaluation system. It is outrageous and bewildering that we haven’t managed to come up with a practical, systemic solution to this.

Where do you see academic publishing 20 years from now?

I suspect for one that we will see an almost totally decoupling or deconstruction of what “publishing” is. By that, I mean the process will be streamlined to such an extent that the legitimately valuable services such as copy editing or type-setting are automated or outsourced for incredibly low prices, as some journals are already showing (i.e., by embracing the power of the internet and technology). Peer review becomes an open, constructive, and transparent community-driven process, similar to how we see people use StackExchange. Paywalls are non-existent, and we lament that they even once existed. Traditional publishers still exist, but now offer overlay or data-oriented services, because we’ve created a system where the communication of research is entirely independent of publishing. Instead of publishers and journals picking which papers they should publish, they should be paying for the privilege of getting to publish that work. I see copyright reforming such that it is academics who retain ownership of their work, and not being used as an income-engineering tool for publishers. Evaluation is done by the community, for the community — for example, a simple system like StackExchange where the value of content is based on community-wide assessment and how that content is re-used and digested. Instead of researchers being forced to create crudely written papers, we see a decoupling of the “paper” itself – data collectors publish data; communicators define the context; statisticians analyse the data; machines perform massive-scale meta-analysis on the global knowledge corpus, and we ultimately create a platform or series of platforms that leverages what is eminently capable with modern technology.

Of course, none of this will probably happen, because academic culture is the definition of inertia. But we can and should be optimistic, and strive every day to make sure we are doing research for the good of the commons, and not to line the pockets of a few greedy corporations.

Would you like to offer any other advice to early-career researchers?

I can share some of the things I have learned as a young researcher:

  • Develop skills beyond being a researcher. Push your horizons, talk with people beyond academia, and take on as much experience and perspective from others as you can. Listening is so much more valuable than speaking.
  • Find something that is important to you, and dedicate your time to doing it. And if you love it, then give it your best!
  • Also, no matter what you do in academia, you will always end up getting on someone’s bad side. Usually this means that you’re just challenging the status quo, so don’t be afraid of rising to challenges or meeting resistance, but always be as diplomatic as possible.
  • Find existing networks who are working on similar things to your interests! Via social media, the power of communities within science has never been more visible, and there are always people out there for you to learn from, collaborate with, and help out if needed.
  • Never be afraid to ask questions: this is how we learn and collectively progress. If someone makes you feel stupid for asking an “obvious” question, that is the sort of arrogance that science could do without — we should all be fully aware that we never stop learning.
  • Finally, sometimes it does get a bit much alongside all the other things you have to do as a student, so the best piece of advice I can give is learn how to say “no,” and don’t bite off more than you can chew! Things will always get done eventually by someone, and grad students especially are always over-burdened and over-pressured, so you have to manage your time exceptionally well.

Thanks, Jon, for the insights! This was a fantastic conversation. Good luck with your research and writing. Let’s hope some of your predictions come true!

Other parts in the series

Plotting for the Earth. Sciences.

This was originally posted at: http://www.nature.com/scitable/blog/earthbound/plotting_for_the_earth_sciences

So a cool paper came out a while back about using plots when attempting to construct stories as a mode of communicating in Earth Science. I cannot, as always, emphasise my frustration when someone writes an article that’s supposed to be broadly educational, and sticks it behind a paywall. In this case, it might have reached the target audience of practising institutionalised Earth scientists (hello), but not the many who aren’t fortunate to have a subscription.

Continue reading

Social Media for Science Outreach – A Case Study: That social media thang

This was initially posted at: http://www.nature.com/spoton/2013/04/social-media-for-science-outreach-a-case-study-that-social-media-thang/ as part of a series of case studies exploring how academics use social media.

Jon began university life as a geologist, following this with a treacherous leap into the life sciences with a course in biodiversity and taxonomy. Now undertaking a PhD in tetrapod biodiversity and extinction at Imperial College London, there was a brief interlude were Jon was sucked into the world of science policy and communication. He blogs at http://blogs.egu.eu/palaeoblog/, tweets as Protohedgehog and co-runs an [infamous, probably] podcast series called Palaeocast. Jon can usually be found procrastinating in pubs, trying to exchange bad science, usually about dinosaurs, in exchange for food and beer.

Tell us a bit about you and your social media project

I’m currently a PhD student at Imperial College London, investigating the biodiversity patterns of tetrapods (anything with four limbs/wings/flippers) about 145 million years ago to see what we can figure out in a macroevolutionary sense, and whether we can find a ‘hidden’ mass extinction in the fossil record. I commit some of my time to 3 major social media platforms: bloggingtweeting, and podcasting, with a bit of Facebook, LinkedIn, Google+ and others on the side.  These activities are less of a project, per se, and more just stuff I do in parallel, and often with overlap, with my PhD research.

Continue reading

Why and how Master’s students should publish their research

This is an updated post from one I published a while back on my old blog at: http://wp.me/p22pR3-2F – as I’ve developed as a scientist, I thought it would be good to share these thoughts in the emergence of new information and experiences. The comments on the older post are worth a quick read. This was originally posted at: http://blogs.egu.eu/palaeoblog/2013/04/18/should-masters-students-publish-their-research/

In the UK, many if not most Master’s students do not publish their postgraduate research. I’ve been informed by several people that in US-based institutions, Master’s students are continuously encouraged to publish their material by their supervisors and institutions.

Two years ago, I undertook an MSc at the Natural History Museum in London. One of the requirements, as with most postgraduate courses, was to undertake a research-based thesis. Out of the 21 students, so far only a single person (Roland Sookias) has had their research published. I have been informed that from at least the previous two years, this is pretty much the normal rate of publication! In fact, during the entire year I studied there, not a single supervisor/lecturer even mentioned formal publication or how to even approach manuscript preparation. This is an essential skill that all students should be taught really, and at least in my academic experience has been mysteriously neglected, by both students and their respective supervisors and lecturers it seems. This is especially the case, I feel, for Master’s students who wish to progress in academia, particularly through PhD research. Papers are academic currency, and the sooner you start accumulating wealth, the better.

Continue reading