This article explores the emerging category of AI-powered operations agents, comparing AI DevOps engineers and AI SRE agents, how cloud providers are responding, and what engineers should consider when evaluating these tools.
Late last year, startup Platform Engineering Labs made waves in the world of Infrastructure as Code (IaC) by introducing a new IaC platform, called Formae, available initially on Amazon Web Services. This week, Platform Engineering Labs‘ platform gets (beta) support from additional cloud platforms, including Google Cloud Platform, Microsoft Azure, Oracle Cloud Infrastructure, and OVHcloud. The company has also released new AI-enhanced software for managing infrastructure tooling, called the Platform for Infrastructure Builders.
AI is revolutionizing Infrastructure as Code (IaC), enhancing speed, intelligence, and responsiveness. However, human expertise remains crucial for understanding AI-generated outputs and ensuring proper system functionality.
K8S-native cluster-wide deployment for vLLM. Provides a reference implementation for building an inference stack on top of vLLM, enabling scaling, monitoring, request routing, and KV cache offloading with easy cloud deployment.
Microsoft has deployed GPT-4, a large language model, in an isolated, air-gapped Azure Government Top Secret cloud for use by the Department of Defense. Once accredited, Pentagon officials will be able to use the technology in a secure environment. The tool is expected to help DOD officials deal with vast amounts of data and simplify information sorting. Microsoft is a major investor in OpenAI, the maker of GPT-4 and the popular ChatGPT.
