Core Concepts
REVERSIM is a game-based environment that mimics real-world hardware reverse engineering processes, enabling cognitive studies in HRE.
Abstract
Steffen Becker and his team developed REVERSIM to simulate realistic HRE subprocesses and integrate cognitive tests. The game aims to study human aspects in HRE, providing insights into problem-solving strategies and cognitive factors. Two studies were conducted to evaluate the design and usability of REVERSIM. Experts praised the comparability of the game with real-world HRE problems, while non-experts found it engaging and informative.
Abstract:
Hardware Reverse Engineering (HRE) involves analyzing Integrated Circuits for security purposes.
REVERSIM is a game-based environment designed to mimic real-world HRE processes.
The game enables quantitative studies on cognitive factors relevant to HRE.
Introduction:
Understanding ICs through reverse engineering is crucial for security tasks.
Real-world HRE processes involve human interaction critical for successful execution.
Methodological Challenge:
Researchers face challenges in conducting empirical studies involving large realistic problem settings due to limited availability of HRE experts.
Methodological Approach:
REVERSIM was developed as a simplified lab environment to address the challenge of studying human aspects in HRE.
The game standardizes and reduces requirements for participants, focusing on important subprocesses of real-world netlist reverse engineering.
An Overview of REVERSIM:
The core elements include basic gates, obfuscated gates, gameplay mechanics, drawing tools, interactive tutorial, psychometric test integration, level design.
Interview Study Results:
Experts provided positive feedback on REVERSIM's design and structure.
Participants recognized elements from real-world netlist analysis but suggested improvements like additional gate types.
User Study Results:
Participants with low prior knowledge found the game enjoyable and easy to understand.
Most participants solved a mean of eight out of twelve tasks with varying numbers of attempts.
Stats
Experts employ Hardware Reverse Engineering (HRE) for security-critical tasks such as detecting Trojans or intellectual property violations. Conducting controlled experiments can open new avenues for hardware protection.
To evaluate the design of REVERSIM, two studies were conducted: semi-structured interviews with 14 professionals attesting to its comparability with real-world problems; an online user study with 109 participants demonstrating engagement even without domain-specific knowledge.
Participants enjoyed playing the game (M = 4.06), understood the rules well (M = 4.36), found drawing tools useful (M = 4.16), but were undecided about scoring motivation (M = 3.39).
Quotes
"Real-world HRE processes cannot be fully automated; human interaction is critical." - Article
"Participants acknowledged the comparability of REVERSIM with real-world netlist reverse engineering processes." - Interview participant