AI: Chroma Context One; S3 Conditional Writes

 Chroma and Agentic Retrieval - Software Engineering Daily

Chroma is a company building open source infrastructure for AI applications, best known for its widely used database of the same name. The company also published the influential Context Rot paper, which documented how model performance degrades as context window utilization increases, and recently released Context One, a 20 billion parameter retrieval sub-agent trained to do agentic search at frontier model quality but at an order of magnitude lower cost and higher speed.

The episode explores how AI data retrieval is evolving beyond traditional vector search to meet the demands of agentic AI systems—which execute rapid, complex, parallel queries that require higher speed and lower costs.

• Chroma's Infrastructure & Products: Discussion of Chroma's open-source database and their release of Context One, a 20-billion parameter retrieval sub-agent designed for agentic search at frontier-model quality with significantly faster speeds and lower costs.
  
  
• Context Rot: Insights from Chroma's research paper on "Context Rot," detailing how large language model performance degrades as utilization of the context window increases.
  
  
• Specialized Models vs. Frontier Models: Why a purpose-built, smaller model can match frontier LLMs on specialized search tasks.
  
  
• Chroma's Strategy: The philosophy behind Chroma's open-source approach and Hammad Bashir's vision for the future of AI data infrastructure.

info-graphic: Programming Languages History

 1972: Smalltalk