Why do big science? Wouldn’t it be better to just distribute the money to individual labs?
Neuroscience is at a critical juncture. We are fortunate to live in an era of powerful new approaches for collection and analysis of neural data. These tools will allow us to solve problems previous generations could only dream of. But the complexity of the solutions far exceeds the ability of individual labs to address them. Fully harnessing the power of modern tools requires expertise across a range of domains, and it is rare for neuroscientists in a single laboratory — let alone for a single scientist — to hold all the requisite skills. Moreover, because labs do not normally share raw data, the fruits of difficult experiments cannot be fully exploited by groups with complementary expertise.
In short, whereas a generation ago neuroscientists were largely limited by theory and tools, today a major bottleneck is how we as a community can effectively harness what is already available. This is the goal of IBL; we feel the time is right to launch a new experiment in collaborative neuroscience to address this challenge.
How did you decide on the size of IBL? I.e. why do you need 21 labs - wouldn’t it be better to start with say 5 labs and then enlarge if things work?
If a typical systems neuroscience project records from 1 or 2 brain areas in a given task, recording from ~100 areas in order to cover the entire brain — our scientific objective — in principle would take 50-100x the number of labs. However, we are using new technology that will make recordings more efficient and we will benefit from standardization and sharing of resources.
Beyond delivering a never-before-available data set from the entire brain, we aim to establish processes for merging experimental design, execution, and analysis across multiple laboratories spread throughout the world. These processes range from governance, decision-making and communication to data architectures and experimental standardization. This is a potentially game-changing deliverable in itself and has ramifications for critical issues such as reproducibility that has provoked crises in fields not so far from neuroscience.
Why not start even smaller and scale up?
Typical neuroscience collaborations of 2-5 labs either don’t encounter the issues of large-scale collaboration, or can split tasks in a way that avoids the need to tackle these issues. Twenty-one is a good compromise as it allows us to include experimental labs which collect data, labs which focus on analyzing data and integrating datasets, and theoretical labs — while being small enough to foster a community. Furthermore, we believe that if we succeed at 21, we will be able to grow to 50 or 100 using the same principles. We have planned for the possibility to expand potentially to much larger number of laboratories. Successful examples in science include the ATLAS project at CERN, where the number of labs involved is in the hundreds.
What is the incentive of a lab for joining IBL?
IBL was started from the ground up, by a group of scientists who were interested in doing neuroscience differently. Other labs have joined because they want to be part of this social and scientific experiment. Many of us have been frustrated by the lack of standardization in neuroscience, which makes comparisons of our results even to labs doing quite similar work very difficult. To be part of a team generating large scale data will advance each of our own scientific ideas at a far more rapid rate than we could do alone. Putting our heads together to tackle a big problem will not only be effective, it will be fun.
When is the next step in scaling up IBL? I.e. when are you adding new members?
In the long term we aim for IBL to become an open standard. Our behavior, experimental hardware, software, and data architecture will all be open source and we will encourage any and all to use them and contribute to the project.
In the short term, our ability to help new labs join the project is limited. We are still establishing our technical protocols and learning how to coordinate our current group. We have limited funding for the initial project phase, and although we may add one or two associated laboratories to help with specific scientific needs, we are unlikely to expand beyond the core group of 21 labs until we secure additional funding which we will seek toward the end of year two.
You currently have members from 5 different countries. Is IBL limited to these 5 countries already participating?
No, we anticipate bringing in people from many other countries.
WHY STUDY JUST ONE BEHAVIOR? AREN’T YOU CONCERNED THAT YOUR RESULTS WON’T GENERALIZE?
Large scale collaborations are more likely to succeed when focused on one common goal (e.g. the human genome, the Higgs boson). In our case, having multiple behaviors would diffuse the group’s efforts and would not allow us to fully benefit from standardizing the task, the recordings tools and the theoretical analysis.
We settled on decision making because making decisions is one of the core functions of the brain, which recruits a large fraction of the nervous system and which is remarkably adaptive. Moreover, there is a large theoretical background on decision making, including models that successfully fit data from humans, primates and rodents.
WHY STUDY MICE?
Mice have become a powerful genetic model system for neuroscience, and allow a wide range of experimental manipulations that are currently out of reach in most mammals (e.g. wide field calcium imaging, optogenetics), including rats. Moreover, their brains are small enough to allow relatively dense sampling of activity throughout the entire brain with Neuropixel probes.
YOUR TASK INVOLVES VISUAL CUES. DON’T YOU KNOW THAT MICE ARE NOT VISUAL ANIMALS?
Mice can see just fine. Although they lack a fovea, their vision is perfectly sufficient to let them perform our task. The human visual system is highly specialized compared to non-primates, but our goal is not to study vision per se but to study the neural basis of decision making. Any sensory stimulus would work for this purpose and using a visual stimulus has the further advantage that much is already known about how the mouse brain encodes stimuli of the type we will use in our experiment.
AREN’T MICE HARD TO TRAIN, WITH BEHAVIOUR THAT’S HARD TO REPRODUCE?
Several of the labs within IBL have already succeeded at training mice on discrimination tasks with performance comparable to what is typically observed in human or primate experiments: that is, stable, steep psychometric curves with low (<10%) lapse rates. There is no question however that replicating these results across 10 different labs on the same task will represents an unprecedented achievement in this field.