This project is protected

Enter the password to view this case study.

← Home

Microsoft Security · AI + Human oversight · 2024

Human in the Loop, a shift from Human Computer to Computer-Human Interaction

Designing the human oversight layer for AI-driven security workflows, ensuring analysts stay in control when automated systems flag critical decisions.

Role

Product Designer

Team

Design, Data Science, PM, Engineering

Area

AI + human review workflows

The 60-second version

What happened here, if you only have a minute

The context: before agents were everywhere, this was a design-led exploration into incorporating autonomous agents into Purview workflows. Imagining a security admin delegating risk monitoring to an agent, and what it takes for that to be trustworthy rather than terrifying.

The inquiry centred on three questions:

Question 01

How do we win customer trust with the right level of transparency around the agent's reasoning process?

Question 02

How do we design human–AI interactions that keep the human in control of outcomes?

Question 03

How can the human provide feedback to the agent for course correction?

The thesis: a human-in-the-loop approach enhances decision-making by reducing cognitive load and improving efficiency. Modernizing job-management workflows without removing human judgement from them.

My role: designed the end-to-end concept and narrative with my design manager, and presented it to Microsoft Security leadership.

Outcome: leadership aligned on the human-in-the-loop approach as the direction for agentic experiences. The transparency, control and feedback patterns explored here informed how agent experiences were framed in later work. The full walkthrough is below.

Human in the Loop, slide 2
Human in the Loop, slide 3
Human in the Loop, slide 4
Human in the Loop, slide 5
Human in the Loop, slide 6
Human in the Loop, slide 7
Human in the Loop, slide 8
Human in the Loop, slide 9
Human in the Loop, slide 10
Human in the Loop, slide 11
Human in the Loop, slide 12
Human in the Loop, slide 13
Human in the Loop, slide 14
Human in the Loop, slide 15
Human in the Loop, slide 16
Human in the Loop, slide 17
Human in the Loop, slide 18
Human in the Loop, slide 19
Human in the Loop, slide 20
Human in the Loop, slide 21
Human in the Loop, slide 22
Human in the Loop, slide 23
Human in the Loop, slide 24
Human in the Loop, slide 25
Human in the Loop, slide 26
Human in the Loop, slide 27
Human in the Loop, slide 28
Human in the Loop, slide 29
Human in the Loop, slide 30
Human in the Loop, slide 31
Human in the Loop, slide 32
Human in the Loop, slide 33
Human in the Loop, slide 34
Next project

Guided Response. Two security teams acting as one

→