EN

DoorDash Uses Envoy and Valkey for a 1.5M RPS Proxy Cache with 99.99999% Availability

DoorDash has developed Entity Cache, a transparent proxy caching platform built on Envoy and Valkey to reduce redundant service-to-service requests ac…

Distributed CacheCloud ArchitectureService MeshEnvoyMicroservicesAlgorithmsPerformanceOptimizationBackend For FrontendAvailabilityService ReliabilitygRPCValkeyCachingHTTPDistributed SystemsReliabilityEvent Driven ArchitectureApache KafkaDevelopmentArchitecture & Designnews
InfoQ
EN

OpenAI Introduces Websocket-Based Execution Mode to Reduce Latency in Agentic Workflows

OpenAI introduces a WebSocket-based execution mode for its Responses API to improve agentic workflow performance in coding agents and real-time AI sys…

Large language modelsLow LatencyAPIWorkflow FoundationDistributed SystemsSDKRealtime APIOpenAIArtificial IntelligenceAI ArchitectureAgentsAI Assisted CodingWebSocketOrchestrationOptimizationAI, ML & Data EngineeringDevelopmentArchitecture & Designnews
InfoQ