The Perilous State of Open Source Neuroscience Software: Addressing the Fragility of the Academic Open Source Ecosystem

Core Concepts

The academic incentive structure and lack of stable funding for scientific software development and maintenance have created a fragile open source ecosystem in neuroscience, which requires urgent action from the community to ensure a healthy growth of the software landscape.

Abstract

The content discusses the precarious state of the open source software ecosystem in neuroscience. It highlights the following key points:

The development and maintenance of open source scientific software is labor-intensive, but the survival of such software is often dependent on only 1-3 key maintainers (the "Truck Factor"), revealing the fragility of the academic open source system.

The academic incentive structure, which heavily rewards publications over software development, disincentivizes scientists from contributing to open source projects, especially after the initial software release. This leads to a proliferation of unmaintained software packages.

Lack of stable long-term funding for scientific software development and maintenance further stifles the growth of the open source ecosystem.

Structural barriers in academia, such as the "publish-or-perish" culture and lack of diversity, skew the demographics of open source contributors, hindering the inclusivity and sustainability of the ecosystem.
To address these issues, the content proposes several actions:

Professionalizing academic software development by providing stable funding and support for scientists engaged in software work.
Adopting new software citation practices to increase the valuation of open source contributions.
Recognizing open source software development as an important contribution to science, on par with research publications.
Improving training programs to increase programming literacy and software engineering skills among students and early-career researchers.

Implementing these changes can help create a more sustainable and inclusive open source ecosystem in neuroscience, benefiting the entire research community.

Stats

Most scientists need software to perform their research (Barker et al., 2020; Carver et al., 2022; Hettrick, 2014; Hettrick et al., 2014; Switters and Osimo, 2019).
Only 1.1-5.4% of open source developers are perceptible as or identify as women (Eghbal, 2016; Geiger, 2022; Ghosh et al., 2002; Nafus, 2012) and less than 17% are perceptible as Non-White (Nadri et al., 2021).

Quotes

"In spite of the vital role research software plays, it largely remains undervalued, with time spent in training or development seen as detracting from the 'real research'." (Davenport et al., 2020)
"open source work done by academics (in time they might otherwise use to do research) sustains other academics writing their papers (Merow et al., 2023) — which puts the software-developing academics behind in the publish-or-perish culture of academia."

Key Insights Distilled From

Cycling on the Freeway

by Britta U. We... at arxiv.org 03-29-2024

https://arxiv.org/pdf/2403.19394.pdf

Deeper Inquiries

How can the academic community foster a more collaborative and interdisciplinary approach to open source software development, where researchers from diverse backgrounds can contribute effectively?

To foster a more collaborative and interdisciplinary approach to open source software development in academia, several strategies can be implemented. Firstly, creating inclusive spaces and communities where researchers from diverse backgrounds feel welcome and valued is crucial. This can be achieved by promoting diversity and actively addressing issues of discrimination and bias within open source projects. Encouraging mentorship programs and providing support for underrepresented groups can also help in creating a more inclusive environment.
Additionally, organizing interdisciplinary workshops, hackathons, and collaborative projects can bring researchers from different fields together to work on common software development goals. This not only enhances cross-disciplinary collaboration but also promotes knowledge-sharing and skill development among participants. Moreover, establishing clear guidelines and best practices for collaborative software development can help streamline the process and ensure that contributions from diverse backgrounds are effectively integrated into the projects.

What alternative metrics or evaluation frameworks could be developed to accurately assess the impact and value of open source software contributions, beyond the traditional publication-based system?

To accurately assess the impact and value of open source software contributions, alternative metrics and evaluation frameworks can be developed. One approach is to focus on usage metrics, such as the number of downloads, citations of the software itself, and user feedback. Tracking the adoption and impact of the software in research projects can provide valuable insights into its significance and relevance in the academic community.
Furthermore, considering community engagement metrics, such as the number of contributors, diversity of contributors, and level of community support, can offer a more comprehensive view of the software's impact. Recognizing and rewarding contributions to documentation, user support, and community building can also be integrated into the evaluation framework to acknowledge the holistic value of open source software development.

Given the global nature of open source communities, how can international collaboration and knowledge-sharing be better facilitated to strengthen the sustainability of the open source ecosystem in neuroscience?

Facilitating international collaboration and knowledge-sharing in open source communities can be achieved through various strategies. Firstly, establishing communication channels and platforms that transcend geographical boundaries, such as online forums, virtual conferences, and collaborative tools, can enable researchers from different parts of the world to connect and collaborate effectively.
Moreover, promoting multilingual resources and documentation can enhance accessibility and participation from diverse linguistic backgrounds. Encouraging cultural sensitivity and awareness within the community can also foster a more inclusive and welcoming environment for international contributors.
Additionally, supporting exchange programs, joint research projects, and funding opportunities for international collaborations can incentivize researchers to engage in cross-border initiatives. Emphasizing the importance of diverse perspectives and global collaboration in the development of open source software can further strengthen the sustainability and impact of the open source ecosystem in neuroscience.