Dienstag, 1. Februar 2011

SEED Magazine: The scientific paper is becoming obsolete

SEED Magazine, a New York-based magazine on science culture, just published an interesting article about how science publishing is about to be transformed by the internet. You might think that this is an old hat, and in fact the idea that the internet revolutionizes the way we publish and access scientific results is not new. Indeed, "the Internet" was "invented" by scientists to share knowledge. Yet still, subscription costs rise, although the price of knowledge dissemination via the internet is much cheaper than in printed media. The market has obviously failed. Access to scientific results has become expensive, so expensive that the main funders of science (tax payers) only rarely can access to the knowledge which is produced using their money.

More importantly, limited access to scientific results directly harms scientific progress. It is not unusual that it takes about two years until a paper is published. By the time a scientific breakthrough is published, it often fails to make real impact, apart from discouraging other labs to work in that direction.

The tools to overcome the limitations are all there: Scientific results can be published on preprint servers (like arXiv or Nature Precedings) right after writing them up. The stream of information coming out of those servers can be filtered by the scientific community by writing blog posts, or by commenting on the preprint servers directly. So why are these tools still so rarely used in life science?

The answer is simple: Lack of incentive. Writing blog posts does not extend my contract, papers on preprint servers do not increase my university budget (opposed to papers in high-impact journals), and often the possibility to publish in popular journals is compromised by publication on a preprint server.

However, incentive will rise as more and more researchers get frustrated by the corporate science publishing machinery. As more and more university libraries drop out from subscriptions as publishers increase their fees, researchers focus on open access journals. As it is becoming more and more difficult to publish in high-ranking journals, researchers consider alternatives which enable them to spend more time on research and less on getting bashed in anonymous peer review.

For example, PLoS ONE is very successful with publishing papers reviewed for technical correctness, but leaving it to the reader to gauge it's scientific impact. Recently, even Nature publishing group picked up the idea and started it's own version of PLoS ONE, Scientific Reports.

While these journals make it easier to publish one's findings, it is up to the researcher to make an impact in terms of influencing the field. Doing good research takes you only half way. The other half consists of convincing other researchers about one's ideas. The great advantage is that this process takes place in public, while in anonymous peer review it is hidden from the largest part of the scientific community.

Donnerstag, 25. November 2010

Towards fast scientific python

Python seems to come of age in its role as an universal language for scientific computing. It already has a good standing in the computational neuroscience community. The Neural Ensemble project gathers some initiatives that use Python as the primary language for neuronal simulation and data analysis. Large simulator projects like Nest and NEURON adopted Python as their primary command language already a few years ago. The core of those simulators is still written in C/C++, which delivers good performance, but leads to interfacing issues with the command language. Those issues can be addressed by clever software design, but a pure-python implementation of a simulator is much more convenient regarding maintainability and extendibility. The problem is, that pure Python will lag behind the speed of compiled languages like C/C++ by an order of magnitude.

The Brian simulator is designed to be a simulator written entirely in python. To cope with the speed of C/C++-based simulators, Brian can generate compiled code from the python network model. This code can also be compiled for graphics processors (GPUs), which promise high speedups for computational problems that can be parallelized efficiently. The Brian developers describe how to do just that in their article on vectorized algorithms for neuronal simulations, which is one of my current favorite papers.

Today, and that was the initial motivation for this post, I came across the announcement for the new version of Theano, a compiler for evaluation mathematical expressions on CPUs and GPUs. I haven't tried it out yet, but it looks definitely promising. But the really interesting fact is that there is vivid development toward making Python not only an ubiquitous language for scientific computing (a goal which has largely been achieved already), but also an alternative in terms of performance to established software packages.

Without licence fees, and fully open source.

Dienstag, 23. November 2010

PNAS Editorial: Impact Factor corrupts science

The (ab)use of the impact factor to evaluate the scientific merit of individuals corrupts the way how scientists publish their findings, say Eve Marder, Helmut Kettenmann and Sten Grillner in their recent editorial to PNAS. Moreover, they state that the current practice to measure scientific achievement shifts the choice of research topic to potentially "great discoveries" (read: discoveries which will make it to Nature), although the most important findings in science were made serendipitously, and hence the eventual contribution to science could not be estimated beforehand.

However, in my opinion, the impact factor is only the tip of the iceberg. Even worse is the implicit role of author sequence on a paper. In life sciences, the first author typically is the one who did the work, and the last author is the supervisor or lab head. All authors in between are perceived to be "minor contributors". Of course, this rule leads to all kinds of problems. Fierce battles are fought over author sequence, since for PhD students, only first-author papers count, while for group leaders last-author papers are vital to demonstrate their scientific contribution.

But there can only be one author first, and one author last. Of course, there are "equal contribution" asterisks all over the place, but are they actually been taken into account? After all, how much sense does it make to refer to the deprecated, intransparent and inflexible rule of author sequence to indicate contribution? For example, it is completely unclear how to handle interdisciplinary collaborations, which involve typically at least two PhD students and two group leaders.

A completely fair and unbiased way to state individual contributions to a scientific publication would be to list the authors in alphabetical order and have an "Author contribution" section in the paper, where the individual contributions are described in detail. In fact, this is how many disciplines handle it, for example in social sciences.

Mittwoch, 4. August 2010

Paper on the honeybee brain atlas with 3D figures

Colleagues of mine published a paper on the three-dimensional atlas of the honeybee brain. This atlas is a collection of three-dimensional morphological data from honeybee neurons.

The honeybee brain atlas was first published in 2005 in the form of a conventional paper. It is extremely useful for research in a number of ways:
  • For physiological recordings, the atlas helps you identify the neurons that you record from.
  • The atlas gives you a common frame of reference to compare morphological studies from different animals, experimenters or even different labs.
  • It allows to put different neurons from different specimens in spatial relation, which is a prerequisite for reconstructing neuronal circuits in the honeybee brain.
The caveat is that in order to use the atlas, one needs the whole software stack on which it was developed. Only those who have seen it in action can really grasp its significance. In consequence, the atlas was always a bit of an insider's tip within the honeybee brain community.

In their recent publication, Jürgen Rybak and coworkers made full use of the capabilities of the PDF format and published three-dimensional figures. The reader can interact with the atlas and rotate the brain for better overview, hide and show parts of the brain or even specific neurons. Now everyone can examine the bee brain in a way that was before only accessible to a small group of scientists. And since the paper is open access, you don't even have to pay for it.

Thanks a lot for that great piece of science!

Donnerstag, 17. Juni 2010

Preprint servers vs. anonymous peer review

Recently, I got a manuscript rejected. There's nothing wrong with that, I consider rejection as a part of the publication process. Or more precisely, as a stop on the way to the publication of a manuscript.

But what really was annoying is that the reviewers did not even seem to read the manuscript until the end. They criticized the lack of a specific kind of information. But this information was explicitely elaborated upon in the discussion part. Even after pointing them to the exact paragraph where the information was given, they did not acknowledge it (let alone say whether this satisfies their criticism). And then it took them two months and several iterations back and forth to finally reach their conclusion to reject the article.

This experience goes along with what I hear from colleagues, namely that they seem to get more and more rude reviews. Constructive criticism appears to be a rare good in neuroscience nowadays. In addition, it is not uncommon that it takes a year or longer from the initial submission to the final publication of the manuscript.

One of my thoughts was that probably the concept of anonymous peer review poses a problem here. As the pressure to publish rises, so rises the number of journals. These journals require more reviewers, who get more papers to review. It becomes increasingly difficult to devote the necessary time and effort to judge a manuscript in its entirety. In addition, there is no way the reviewers' effort is honored when peer review is anonymous. Journals like the Frontiers in... series already act up by naming reviewers on the published manuscript, in order to get the reviewers' contributions noticed.

I would definitely welcome an open peer review process, where reviewers are named from the first revision on, and the reviews are made publicly accessible. Preprint servers like ArXiv are pretty much what I'd like to have in neuroscience. You put your paper there, you get comments, you revise the manuscript, and at some point a journal or a conference will accept it. Your knowledge is accessible right from the first upload on the server. Efficient exchange of scientific results favors the rapid advancement of the field. Moreover, it is much less likely that you get scooped during the review process, since you can always document when you published the paper for the first time.

I will evaluate possibilities for this kind of publication for the resubmission of my manuscript.

Mittwoch, 16. Juni 2010

One week with opensuse 11.3 Factory

Since my last post, I submitted a couple of bug reports. The most severe bug caused my external monitor to be unuseable on DVI. It turned out that my monitor is providing faulty EDID data, which confused the graphics driver. But Stefan Dirsch of novell pointed out a way to work around this. Cool.

Apart from that I'm really surprised how stable and useable OpenSuse 11.3 is already. This is going to be a great release!

Montag, 7. Juni 2010

Suse 11.3 M7 on Lenovo T410s

Today, I got my new shiny Lenovo T410s. First thing I did, throw that Windows 7 off the disk and install Linux! :)

So I downloaded the current milestone 7 of opensuse 11.3. Install from DVD went smoothly, as was expected: I chose to use the entire Harddisk (which is not a disk but rather an SSD ;) ). No exotic software configuration was chosen, either, just plain KDE4 desktop.

The only thing that crashed was firefox, but this is a known bug, with known remedy: update to the lates factory repository.

Another known bug with known workaround prevented me to have wifi out of the box. So installed the "Laptop" pattern, and the kernel-firmware package, and voila, wifi works. Like a charm.

The integrated camera worked straight out of the box.

The fingerprint reader seems not to work, as the proper driver is not included in openSUSE 11.3. More precisely, it is only in the current development version of libfprint that the driver is contained. But chances are that this version will become available for SUSE some time soon.

Check also the thinkwiki-page for the T410s, and the installation instructions for SUSE.