ArchitectureArchitecture
Conference40min
BEGINNER

Fifty Shades of Caching and How LLMs Paint It Blαck

This talk explores how caching powers web speed and resilience, from CDNs to memory stores, while revealing how increasing LLM-driven traffic disrupts traditional caching systems. Using practical, open-source examples, it provides a structured, in-depth look at modern caching technologies, their mechanisms, and the new challenges they face.

effie mouzeli
effie mouzeliWikimedia Foundation

talkDetail.whenAndWhere

Saturday, April 25, 11:30-12:10
Banquet
talks.roomOccupancytalks.noOccupancyInfo
talks.description
Caching is the quiet workhorse of the web. It makes things faster. And mostly not broken. From edge CDNs to in-process memory stores, caching spoils end-users by accelerating content delivery and helping websites remain resilient under heavy traffic.

Sounds great. Until you try to explain it to someone.

This session offers a practical deep dive into industry-standard caching technologies and explores how the ongoing rise of the machines surge in LLM traffic is steadily sabotaging them. Structured around chapters and real-world, open-source examples, this talk covers both the underlying technology and the current challenges.
invalidation
caching
llms
cdn
talks.speakers
effie mouzeli

effie mouzeli

Wikimedia Foundation

Greece

Effie spent several years in small organisations. Currently an SRE at the Wikimedia Foundation, she is counting Wikipedia’s rabbit holes so you don’t have to. [citation needed]
She’s co-chaired SREcon23 and SREcon24 EMEA, and has been a long-time contributor. Her limited written work include a thesis no one read, a defunct Twitter account, and sneaking a couple of articles into "97 Things Every SRE Should Know".

talkDetail.rateThisTalk

talkDetail.poortalkDetail.excellent

talkDetail.ratingNotYetAvailable

talkDetail.ratingAvailableWhenStarted

talkDetail.signInRequired

talkDetail.signInToRateDescription

occupancy.title

occupancy.votingNotYetAvailable

occupancy.votingAvailableBeforeStart

talkDetail.signInRequired

occupancy.signInToVoteDescription

comments.title

comments.speakerNotEnabledComments