Ms. Madhushree Kumari

Intelligent Caching: Harnessing AI in Distributed Systems

Abstract:

As modern applications scale to handle large volumes of data and user requests, distributed caching has become a critical component in achieving low latency, high performance and resilient systems. This talk will explore the key concepts and techniques of distributed caching, explaining how data can be efficiently stored across multiple nodes to reduce database load and improve system responsiveness. We will cover common caching strategies including partitioned (sharded), replicated and hybrid caches and discuss practical approaches such as write through, write behind and near caching. The session will also highlight eviction policies, data persistence options and essential mechanisms like consistent hashing and gossip protocols that ensure scalability and fault tolerance.

In addition, we will examine how AI can enhance distributed caching systems by enabling smarter cache population strategies, dynamic eviction policies and real time data placement decisions. By leveraging AI to analyze access patterns and predict future data usage, systems can significantly increase cache hit rates and reduce latency. Real world examples from technologies such as Redis Cluster, Memcached, Hazelcast, Couchbase and Amazon ElastiCache will demonstrate how AI can be integrated into caching workflows to drive intelligent optimization and adaptability at scale.

Profile:

Madhushree Kumari is an accomplished technology leader with over 11 years of experience in architecting and delivering scalable distributed systems. She currently holds the role of Staff Software Engineer at Visa, where she contributes to the FX trading platform within the Clearance and Settlement (CAS) team. In this capacity, she leads a globally distributed team spanning the U.S., India and Poland, while also serving as a hands-on technical lead responsible for designing and implementing critical product features. Within the FXTI group, she oversees both microservices and micro frontend architectures, playing a pivotal role in driving high impact solutions.

Throughout her career, Madhushree has made significant contributions at leading technology firms including SAP, McAfee, IBM, and FIS. She brings deep technical expertise in Java, Spring, Microservices, Kubernetes and AWS.

She holds a Master’s degree in Computer Science from Georgia Tech and a Bachelor's degree in Electronics and Communication Engineering. A Senior Member of IEEE, she actively serves as Secretary of the IEEE Atlanta Young Professionals chapter and Chapter Oversight Chair for the IEEE Computational Intelligence Society (CIS) Atlanta Chapter. She is also a contributor to the IEEE Artificial Intelligence Policy Committee (AIPC), supporting efforts toward responsible AI governance.

Madhushree is a frequent keynote speaker, session chair and peer reviewer for IEEE conferences and renowned journals, and she has served as a judge for several hackathons. She is also a Fellow of the Soft Computing Research Society (SCRS) and a dedicated volunteer with IEEE, ACM and AnitaB.org, where she is committed to driving innovation, mentorship, and professional growth in the tech community.