Sandbox Escapes with Rubrik's Zero Labs, AI recorders eroding privacy, and the news - Joe Hladik - ESW #472

Interview with Joe Hladik - ChatMate

Imagine a user asks an LLM a question about a document. An attacker then gains an interactive prompt on the user's chat session, enabling the attacker to instruct the AI assistant to take actions on behalf of the victim. That is exactly the capability researchers at Rubrik Zero Labs were able to demonstrate in a recent study designed to test the bounds of LLM security.

Join Joe Hladik, Head of Rubrik Zero Labs, as he breaks down the discovery of "Remote Prompt Execution," a novel vulnerability class that enabled full takeovers of Microsoft Copilot sessions through sandbox escapes. He explores the technical journey behind the eight critical CVEs uncovered by Rubrik Zero Labs and discusses the broader implications for securing generative AI assistants within enterprise environments. This interview highlights the groundbreaking research that earned a $48,000 bounty and featured as a premier briefing at Black Hat USA.

Segment Resources:

• Find more research from Rubrik Zero Labs
• Rubrik Zero Labs' Black Hat session
• Demo of the ChatMate attack in action

This segment is sponsored by Rubrik. Visit https://securityweekly.com/rubrik to learn more about them!

Topic Segment - AI Notetakers and Recorders

AI notetakers are built into everything now, and hardware-based AI recorders are becoming mainstream as well. Is privacy over in the workplace? Adrian, Jackie, Katie, and Tyler discuss.

Questions enterprises should be asking:

1. Are employees recording or transcribing meetings?
2. Does this policy change if non-employees (external parties) are present?
3. Is consent asked for/given?
4. Is the context of the conversation taken into consideration?
5. Is the geographic/legal/political context of the external party taken into account?
6. Have you done your due diligence on third parties hosting/storing these recordings and transcriptions?
7. Was your due diligence a SOC 2, or real, actual evidence-based due diligence?
8. Do these third parties have an option to allow you to store/manage your own recordings in a place of your choosing, or does it have to be hosted by the AI recording/transcription company?

News Segment

Finally, in the enterprise security news,

1. we check the vibes
2. and the funding, and the acquisitions
3. seriously, don't mess with the wifi on planes
4. 181,000 meetings were left wide open
5. the sandbox escapes are getting ridiculous
6. research on how reliable AI-generated patches are
7. research on what attackers do after they get a shell
8. research on how cybercriminals are using AI agents
9. research on how vulnerable datacenters are
10. and finally, what's a "mouthpad"?
11. Stick around till the end of the news segment to find out!

All that and more, on this episode of Enterprise Security Weekly.

Show Notes: https://securityweekly.com/esw-472