Data & AIConference45min
Count-Min Sketch, Bloom Filter, TopK: Efficient probabilistic data structures
This talk explores three probabilistic data structures—Count-Min Sketch, Bloom Filter, and TopK—that enhance data processing speed and scalability by trading some accuracy. It demonstrates their integration in building an efficient Trending Topics feature for Bluesky, highlighting their application in memory-efficient, real-world systems prioritizing speed.
Raphael De LioRedis
talkDetail.whenAndWhere
Wednesday, April 16, 15:40-16:25
Paris 242AB
A Count-Min Sketch, a Bloom Filter, and a TopK might sound fancy, but they’re just smart ways to work with huge amounts of data using very little memory.In this talk, we’ll explore three powerful probabilistic data structures that trade a bit of accuracy for a lot of speed and scalability. You’ll learn:What Count-Min Sketch, Bloom Filter, and TopK actually areHow each of them works under the hoodHow I used them together to build an efficient version of Trending Topics for BlueskyBy the end, you’ll see how these tools help you process large data streams without blowing up your memory, and how to apply them in real-world systems where being fast matters more than being perfect.
Raphael De Lio
Raphael De Lio is a passionate software engineer who loves to think about solutions and ways to improve anything he touches. With over seven years of experience across multiple roles, industries, and countries, he brings a rich perspective to solving technical challenges and connecting with developer communities.
Born in Brazil, Raphael lived in Portugal for six years before moving to the Netherlands in 2022. His main role was a Software Engineer, with expertise in Java, Kotlin, and scalable systems. He also served as the organizer and host of the Dutch Kotlin User Group, building a community for Kotlin enthusiasts in Amsterdam.
Currently, he serves as a Developer Advocate at Redis, where he combines his love for coding with his enthusiasm for empowering others through education, advocacy, and community engagement.
Born in Brazil, Raphael lived in Portugal for six years before moving to the Netherlands in 2022. His main role was a Software Engineer, with expertise in Java, Kotlin, and scalable systems. He also served as the organizer and host of the Dutch Kotlin User Group, building a community for Kotlin enthusiasts in Amsterdam.
Currently, he serves as a Developer Advocate at Redis, where he combines his love for coding with his enthusiasm for empowering others through education, advocacy, and community engagement.
comments.speakerNotEnabledComments