Seeking Enlightenment: Incorporating Evidence-Based Practice Techniques in Research Software Engineering Team

Core Concepts

Evidence-based practice techniques can benefit research software engineers by promoting career-long learning, professionalization, and better practices in scientific software development.

Abstract

The content discusses the application of evidence-based practice (EBP) techniques, specifically rapid reviews, within a research software engineering team. It highlights the strengths and limitations of rapid reviews, the challenges for RSEs to adopt EBP techniques, and strategies to address these challenges. The study emphasizes the importance of training, incomplete research in RSE contexts, and convincing others to adopt best practices. Recommendations are provided based on experiences and insights from other fields where EBP has been successfully adopted. Structure: Introduction to Evidence-Based Practice in Software Engineering Experience Report on Rapid Reviews in RSE Team Background on Research Software Engineering Movement Methodology of Rapid Review Approach Results on Strengths and Limitations of Rapid Reviews Challenges for RSEs to Adopt EBP Techniques Strategies to Address Adoption Challenges Discussion on Benefits of EBP for RSEs Threats to Validity Consideration Conclusion with Recommendations

Stats

"Each rapid review reported in this paper... required 12-20 hours of labor over the course of three to five days to complete." "Studies suggest that may stem in part from that a lack of shared clarity around roles and expertise."

Quotes

"Rapid reviews help us get unstuck... That kept us from hemming and hawing about it." - Anthony (RR4) "I found it very useful because you drew attention to papers and topic areas that I wasn’t necessarily aware of." - Henry (RR5) "If we wanted to explore containerization further... there’s no sense in rolling out a new technology until we’re confident that it’ll work." - Allen (RR4)

Key Insights Distilled From

Seeking Enlightenment

by Reed Milewic... at arxiv.org 03-26-2024

https://arxiv.org/pdf/2403.16827.pdf

Deeper Inquiries

How can the research gap be addressed to provide more tailored studies for Research Software Engineers?

To address the research gap and provide more tailored studies for Research Software Engineers (RSEs), collaboration between software engineering researchers and RSEs is crucial. Establishing closer working relationships through Practice-Based Research Networks (PBRNs) or facilitated networking by national RSE organizations can help bridge this divide. By fostering partnerships, researchers can gain access to sites where studies specific to RSE needs can be conducted, while practitioners benefit from exposure to leading experts who support improvement activities. Additionally, there is a need for increased dialogue and engagement between software engineering researchers and RSEs. This communication will help identify key areas where research evidence is lacking in the context of scientific software development. Professional societies within the field can also play a vital role in facilitating these collaborations by acting as liaisons and facilitators for developing evidence-based recommendations that cater specifically to the needs of RSEs.

What role can professional societies play in facilitating evidence-based recommendations within the RSE community?

Professional societies have a significant role to play in facilitating evidence-based recommendations within the Research Software Engineering (RSE) community. These societies serve as platforms for knowledge sharing, networking, and collaboration among professionals in the field. By leveraging their resources and expertise, professional societies can promote best practices based on empirical data within the RSE community. Professional societies can organize workshops, conferences, webinars, and other events focused on evidence-based practices in software engineering. These initiatives provide opportunities for RSEs to learn about new research findings, engage with experts in the field, and discuss how evidence-based approaches can enhance their work. Moreover, professional societies can establish guidelines or frameworks that encourage members to adopt evidence-based techniques in their daily operations. They may develop resources such as toolkits or training materials tailored specifically for RSEs interested in incorporating EBP into their practice. By creating a supportive environment that values data-driven decision-making processes, professional societies contribute significantly to advancing evidence-based recommendations within the RSE community.

How might multi-disciplinary teams improve shared understanding and collaboration regarding evidence-based practices?

Multi-disciplinary teams aiming to improve shared understanding and collaboration regarding evidence-based practices should focus on building clear roles clarity around expertise levels across team members' diverse backgrounds. 1- Establish Clear Roles: Define each team member's responsibilities clearly based on their expertise level so that everyone understands each other's contributions towards achieving common goals. 2- Encourage Dialogue: Foster open communication channels where team members feel comfortable discussing different perspectives related to implementing EBP techniques. 3- Promote Knowledge Sharing: Encourage sharing of insights from various disciplines related to software development which could lead towards innovative solutions grounded on both experience & empirical data. 4- Training & Development: Provide training sessions focusing not only on technical skills but also emphasizing EBP concepts so all team members are equipped with necessary tools & knowledge. 5- Regular Feedback Mechanisms: Implement feedback loops allowing team members an opportunity regularly assess progress made using EBP methods thus ensuring continuous improvement efforts are acknowledged & encouraged throughout projects By implementing these strategies effectively multi-disciplinary teams will foster an environment conducive towards enhancing shared understanding & successful implementation of Evidence-Based Practices amongst its diverse group of professionals contributing positively towards project outcomes