scholarly journals Assessing a Decision Support Tool for SOC Analysts

Author(s):  
Jassim Happa ◽  
Ioannis Agrafiotis ◽  
Martin Helmhout ◽  
Thomas Bashford-Rogers ◽  
Michael Goldsmith ◽  
...  

In recent years, many tools have been developed to understand attacks that make use of visualization, but few examples aims to predict real-world consequences. We have developed a visualization tool that aims to improve decision support during attacks. Our tool visualizes propagation of risks from IDS and AV-alert data by relating sensor alerts to Business Process (BP) tasks and machine assets: an important capability gap present in many Security Operation Centres (SOCs) today. In this paper we present a user study in which we evaluate the tool's usability and ability to deliver situational awareness to the analyst. Ten analysts from seven SOCs performed carefully designed tasks related to understanding risks and prioritising recovery decisions. The study was conducted in laboratory conditions, with simulated attacks, and used a mixed-method approach to collect data from questionnaires, eyetracking and voice-recorded interviews. The findings suggest that providing analysts with situational awareness relating to business priorities can help them prioritise response strategies. Finally, we provide an in-depth discussion on the wider questions related to user studies in similar conditions as well as lessons learned from our user study and developing a visualization tool of this type.

2021 ◽  
Author(s):  
Lluís Palma ◽  
Andrea Manrique ◽  
Llorenç Lledó ◽  
Andria Nicodemou ◽  
Pierre-Antoine Bretonnière ◽  
...  

<p>Under the context of the H2020 S2S4E project, industrial and research partners co-developed a fully-operational Decision Support Tool (DST) providing during 18 months near real-time subseasonal and seasonal  forecasts tailored to the specific needs of the renewable energy sector. The tool aimed to breach the last mile gap between climate information and the end-user by paying attention to the interaction with agents from the sector, already used to work with weather information, and willing to extend their forecasting horizon by incorporating climate predictions into their daily operations.</p><p>With this purpose, the tool gathered a heterogeneous dataset of seven different essential climate variables and nine energy indicators, providing for each of them bias-adjusted probabilistic information paired with a reference skill metric. To achieve this, data from state-of-the-art prediction systems and reanalysis needed to be downloaded and post-processed, fulfilling a set of quality requirements that ensure the proper functioning of the operational service. During the design, implementation, and testing phases, a wide range of scientific and technical choices had to be made, making clear the difficulties of transferring scientific research to a user-oriented real-time service. A brief showcase will be presented, exemplifying the different tools, methodologies, and best practices applied to the data workflow, together with a case study performed in Oracle’s cloud infrastructure. We expect that by making a clear description of the process and the problems encountered, we will provide a valuable experience for both, upcoming attempts of similar implementations, and the organizations providing data from climate models and reanalysis.</p>


2006 ◽  
Vol 5 (1) ◽  
pp. 1-14 ◽  
Author(s):  
John Cushing ◽  
Lecha Dawn Janssen ◽  
Stephen Allen ◽  
Stephanie Guerlain

Information visualization techniques such as overview + detail displays have traditionally been applied and studied in domains with static data sets supporting information retrieval tasks. This study examines how these techniques can be extended to the design of interfaces for decision support systems (DSSs). Specifically, we developed a computerized decision support tool to assist Naval Tomahawk Strike Coordinators in the complex process of assigning a set of planned missions to a set of available launch platforms based on a number of different constraints and objectives, and compared user performance on two realistic scenarios (a within-subjects factor) across two versions of this tool (a between-subjects factor). The first version of the Mission-to-Platform Assignment Tool provided users with only a set of detail displays when assigning missions, whereas the second version had an additional, abstracted ‘overview’ display that allowed users to see the effect of early decisions on later decisions. The results showed that subjects performing this planning task with the overview + details display version completed scenarios, on average, 21% faster, with 22% fewer errors and with 74% fewer required workspace navigation activities than a comparable group using just the detail displays version. Subjects in the former group also rated their situational awareness 14% higher than those subjects without the overview display.


2018 ◽  
Vol 25 (1) ◽  
pp. 1-6 ◽  
Author(s):  
Daisy Wiggins ◽  
Vanora A. Hundley ◽  
Carol Wilkins ◽  
Carol Bond ◽  
Gill Walton

BackgroundThe Maternity Review for England highlighted the need for more accessible information to support decisions. This study assesses the effect of a decision support tool (DST) on women’s decision-making regarding birthplace.MethodsA mixed method sequential exploratory design involving three phases and 169 women from a large UK maternity hospital. Phase one: A questionnaire survey pre and post-access to the DST examining knowledge level and stages of decision-making scale. Phase 2: Follow-up questionnaire at 28 weeks to enable the usefulness of Mybirthplace to be evaluated. Phase 3: Qualitative interviews with 10 purposely chosen women at 36 weeks gestation. Collection of data on actual birthplace.DiscussionThis study is the first to assess the effect of a DST in supporting women’s choice of place of birth.


2021 ◽  
Author(s):  
Sheila Saia ◽  
Natalie Nelson ◽  
Sierra Young ◽  
Stanton Parham ◽  
Micah Vandegrift

Growing interest in data-driven, decision-support tools across the life sciences and physical sciences has motivated development of web applications, also known as web apps. Web apps can help disseminate research findings and present research outputs in ways that are more accessible and meaningful to the general public--from individuals, to governments, to companies. Specifically, web apps enable exploration of scenario testing and policy analysis (i.e., to answer “what if?”) as well as co-evolution of scientific and public knowledge. However, the majority of researchers developing web apps receive little formal training or technical guidance on how to develop and evaluate the effectiveness of their web-based decision support tools. Take some of us for example. We (Saia and Nelson) are agricultural and environmental engineers with little experience in web app development, but we are interested in creating web apps to support sustainable aquaculture production in the Southeast. We had user (i.e., shellfish growers) interest, a goal in mind (i.e., develop a new forecast product and decision-support tool for shellfish aquaculturalists), and received funding to support this work. Yet, we experienced several unexpected hurdles from the start of our project that ended up being fairly common hiccups to the seasoned web app developers among us (Young, Parham). As a result, we share the following Ten Simple Rules, which highlight take home messages, including lessons learned and practical tips, of our experience as burgeoning web app developers. We hope researchers interested in developing web apps draw insights from our (in)experience as they set out on their decision support tool development journey.


2016 ◽  
pp. 173-190
Author(s):  
Greg Carbone ◽  
Jinyoung Rhee ◽  
Kirstin Dow ◽  
Jay Fowler ◽  
Gregg Garfin ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document