Integrating Systems Thinking into Threat Modeling Instruction and Assessment for Secure Software Development

Core Concepts

Incorporating systems thinking principles alongside the STRIDE threat modeling framework can help software engineering students identify and mitigate both component-level and system-level cybersecurity threats.

Abstract

This paper introduces a novel approach to teaching and assessing threat modeling competency in software engineering students by integrating systems thinking principles with the popular STRIDE threat modeling framework.
The key highlights are:

Current threat modeling frameworks like STRIDE tend to focus on component-level analysis rather than educating students to reason holistically about a system's cybersecurity. There is also a lack of rubrics for assessing students' threat modeling competency.

To address these gaps, the authors propose using systems thinking in conjunction with STRIDE for teaching and assessing threat modeling competency. Systems thinking can help students consider relationships between system components and identify emergent, system-level threats.

The authors developed two rubrics - one for assessing STRIDE threat modeling performance and another for assessing systems thinking performance during STRIDE. They piloted these rubrics on student projects in a software engineering course.

The results reveal that students who received both systems thinking and STRIDE instruction were able to identify and mitigate component-level as well as system-level threats. In contrast, students with only STRIDE instruction tended to focus more on component-level threats.

The work contributes to the engineering education community by: (1) describing a new rubric for assessing threat modeling based on systems thinking; (2) identifying trends and blindspots in students' threat modeling approach; and (3) envisioning the benefits of integrating systems thinking in threat modeling teaching and assessment.

Stats

"Cybersecurity is defined as the combination of technologies, resources, structure, and culture that is utilized to protect data in cyberspace and cyberspace-enabled systems from vulnerabilities, threats, exposure, and damages to ensure stability and sustenance."
"A survey by CSIS and McAfee in 2016 of IT decision-makers from eight countries indicates that 82% of employers felt that their workforce did not have the necessary cybersecurity skills and 71% believed that the skill gap caused measurable and direct damage to the security of their organizations."
"Almost 28% of cybersecurity jobs nationally are still vacant as of 2023, mainly due to a lack of training on cybersecurity fundamentals and hands-on experience."

Quotes

"Threat modeling is a crucial cybersecurity and secure software development skill that helps analyze the risks associated with the software architectures and identify strengths and risks early on."
"Systems thinking is a skill that focuses on understanding the systemic properties of a system while also accounting for emergent trends arising from the combination of the connected parts."

Key Insights Distilled From

Introducing Systems Thinking as a Framework for Teaching and Assessing Threat Modeling Competency

by Siddhant S. ... at arxiv.org 04-26-2024

https://arxiv.org/pdf/2404.16632.pdf

Deeper Inquiries

How can systems thinking be integrated into other secure software development frameworks beyond STRIDE, such as NIST Cybersecurity Framework or NIST Secure Software Development Framework?

Incorporating systems thinking into other secure software development frameworks like the NIST Cybersecurity Framework or NIST Secure Software Development Framework can enhance the overall approach to threat modeling and cybersecurity. Here are some ways to integrate systems thinking into these frameworks:

Holistic Risk Assessment: Systems thinking encourages a holistic view of the system and its interactions. By applying this approach to frameworks like NIST, organizations can conduct more comprehensive risk assessments that consider not only individual components but also the interdependencies and emergent properties of the system as a whole.

Identifying System-Level Threats: Systems thinking helps in identifying system-level threats that may arise from the relationships between components. Integrating this perspective into frameworks like NIST can help in uncovering vulnerabilities that stem from the systemic behavior of the software or infrastructure.

Scenario Planning: Systems thinking promotes scenario planning and considering multiple perspectives. By incorporating this mindset into frameworks like NIST, organizations can anticipate and prepare for a wider range of potential threats and vulnerabilities, leading to more robust security measures.

Continuous Improvement: Systems thinking emphasizes feedback loops and continuous improvement. By integrating this principle into frameworks like NIST, organizations can establish a culture of learning from security incidents, adapting their strategies, and continuously enhancing their cybersecurity posture.

Collaborative Approach: Systems thinking encourages collaboration and interdisciplinary perspectives. By fostering a collaborative approach within the framework implementation process, organizations can leverage diverse expertise to address complex cybersecurity challenges effectively.

What are the potential challenges and limitations of incorporating systems thinking into threat modeling instruction and assessment?

While incorporating systems thinking into threat modeling instruction and assessment can offer numerous benefits, there are also challenges and limitations to consider:

Complexity: Systems thinking adds a layer of complexity to threat modeling as it requires students to consider the interconnectedness of system components. This complexity may overwhelm students, especially those new to the concept.

Resource Intensive: Teaching systems thinking effectively may require additional resources, such as specialized training for instructors, updated curriculum materials, and tools to facilitate systems thinking exercises. This can pose challenges in terms of time and budget constraints.

Subjectivity: Systems thinking involves interpreting relationships and feedback loops, which can be subjective. Assessing students' systems thinking skills may be more challenging than evaluating technical knowledge, leading to potential inconsistencies in grading.

Integration with Existing Frameworks: Integrating systems thinking into established threat modeling frameworks like STRIDE or NIST may require careful alignment and adaptation of existing processes. Ensuring seamless integration without disrupting the current workflow can be a challenge.

Skill Development: Systems thinking is a skill that requires practice and experience to master. Students may struggle initially to apply systems thinking principles effectively in the context of threat modeling, requiring ongoing support and guidance.

How can the insights from this study on students' threat modeling blind spots be leveraged to improve cybersecurity education and training programs more broadly?

The insights from the study on students' threat modeling blind spots can be leveraged to enhance cybersecurity education and training programs in the following ways:

Curriculum Enhancement: Incorporate systems thinking modules into cybersecurity courses to help students develop a holistic understanding of security threats and vulnerabilities beyond individual components.

Hands-On Exercises: Design practical exercises that require students to apply systems thinking principles in threat modeling scenarios, allowing them to practice identifying system-level threats and interactions between components.

Feedback and Reflection: Provide feedback to students on their threat modeling exercises, highlighting blind spots related to system-level threats and encouraging reflection on how systems thinking can improve their analysis.

Interdisciplinary Collaboration: Encourage collaboration between cybersecurity students and professionals from other disciplines to promote diverse perspectives and systems thinking approaches in threat modeling.

Professional Development: Offer training and workshops for educators and cybersecurity professionals on integrating systems thinking into threat modeling instruction, ensuring they have the necessary skills to teach this approach effectively.

By leveraging these insights and implementing targeted strategies, cybersecurity education programs can better prepare students to address complex security challenges and develop a more comprehensive understanding of threat modeling.