Graceful Deletes: Queues, Tasks and Distributed State Management in Python

Chantelle Chan & Tanzim Mokammel

Questionable queues, distributed storage chaos, stateful steps, and race conditions galore! Come join us as we dive into the wild world of queues and tasks in Python to perform asynchronous jobs, and how we built a system to manage user deletion across distributed storage systems and application isolation layers. We'll explore the pros and cons of common task queueing systems, and expose gotchas and workarounds that will hopefully save you future headaches! We'll navigate the challenges of sequential deletion in distributed storage systems as a case study, and ultimately show how we went from problem statement to deployed in production.

About Chantelle Chan

Chantelle is a senior backend software engineer at Cohere working on North, Cohere's enterprise AI platform. She leads development of Northโ€™s My Drive feature, a file RAG solution enabling document storage, syncing, and retrieval. Her latest work focuses on optimizing RAG performance through prompt engineering and context management. Previously, Chantelle was a full-stack engineer at Multi (acquired by OpenAI). Chantelle combines product-minded engineering with a passion for AI-driven solutions, bridging technical innovation with user-centric design. Outside of work, Chantelle enjoys exploring food science experiments in her kitchen and training her cat to perform new tricks.

About Tanzim Mokammel

Experienced senior software engineer with a proven track record in full stack development and a strong focus on problem solving and software design. Proficient in technologies such as Typescript, Go, Python, NodeJS, and React, with a background in leading and mentoring development teams. Recognized for contributions in optimizing systems and driving innovative solutions.

Interests include technology, music, travel, photography, fitness, video games.