klotz: software engineering*

0 bookmark(s) - Sort by: Date ↓ / Title / - Bookmarks from other users for this tag

  1. Supreeth Koundinya writes that Spotify has successfully reduced token consumption for its internal coding agent, Claude Code, by approximately 90% through a model routing approach. By using their "Portal" developer platform and "AiKA Modes," the company directs repetitive or I/O-intensive tasks—such as file reading and basic code generation—to cheaper models like Google's Gemini 2.5 Flash, reserving Anthropic's frontier Claude models for complex reasoning and debugging.

    - Routing is facilitated by a plugin called Shunt using PreToolUse hooks to intercept large file reads.
    - The system uses ephemeral runtimes via AiKA modes so developers don't have to manage infrastructure or API keys manually.
    - To prevent context bloat, Claude Code does not directly consume the output of generated code written by worker models to disk.
    - Current limitations include a 30-second invocation limit and potential loss of line-level detail during delegated analysis.
  2. Erik Thorelli and Erfan Al-Hossami evaluate OpenAI's GPT-6 Astra for its performance in code reviews, highlighting significant improvements in catching bugs within complex, cross-file contexts. While the model demonstrates superior reasoning capabilities compared to predecessors like Sol and Opus 5, it comes with a significantly higher API cost per task. The authors also explore how these advanced reasoning abilities might transfer to other tasks such as research synthesis or operational investigation, while addressing critical privacy considerations regarding data retention.

    - Astra caught 33% more actionable bugs in hard cross-file reviews than Opus 5.
    - Standard Astra API rates are $10 per million input tokens and $50 per million output tokens.
    - An illustrative task using 100k input/10k output tokens costs ~$1.50 on Astra, compared to only $0.60 for GPT-5.6 Sol.
    - CodeRabbit used Astra's autonomy to develop a complete action RPG titled NIGHTSHIFT in Godot.
  3. Yuhao Wu writes about HarnessDev, a benchmark that evaluates LLMs' ability to build and iteratively improve their own agent harness—the model-external execution infrastructure that wraps a model and shapes its task performance. The benchmark has two stages: Creation, where the agent builds a complete execution system from a minimal seed and a few cases, and Evolution, where it revises its own harness using downstream execution feedback. Generated harnesses substantially lag behind mature human-engineered references on code and search/research, while matching or exceeding them on writing and machine-learning experimentation, with large variation in execution cost.
    - Covers six creator LLMs across four domains and five downstream benchmarks (2,207 unique instances).
    - Hidden evaluation tasks are withheld from development to prevent overfitting.
    - Evolution gains are unstable and transfer only partially to held-out tasks.
    - Performance gains depend strongly on which model executes the harness, indicating limited cross-model transfer.
  4. Sara A. Metwalli writes that coding agents differ from basic autocomplete or assistants because they can interact with their environment by examining repositories, modifying files, and running tests in a loop. To use them effectively, developers should provide clear constraints and context rather than just long prompts, following a workflow of inspection, planning, implementation, testing, and review. Instead of delegating massive tasks like rewriting entire applications, users should break work into small, testable problems to maintain control over the architectural integrity and quality of the generated code.

    - Agents are best suited for exploratory or multi-step tasks such as finding/fixing bugs or investigating failing tests.
    - A recommended prompt structure includes a Goal, Context, Constraints, Acceptance Criteria, and Validation steps.
    - The developer's role shifts from writing raw code to directing, assessing, and coordinating complex code-generating systems.

    A successful agentic request should include five specific elements rather than just long prompts:
    ```text
    Goal: What you want to achieve »
    Context: Specific files or architecture to inspect »
    Constraints: Rules/boundaries the agent must follow »
    Acceptance criteria: The definition of a "finished" task, e.g., passing tests »
    Validation: How to verify success, e.g., run specific test commands »
    ```
  5. The Agentic Startup is a framework designed to transform Claude Code into an agile development team through spec-driven workflows. By providing specialized skills for specification creation, validation, and execution, the system allows users to move from high-level requirements to implemented code using structured decomposition tiers. It features parallel agent coordination, custom output styles like "The ScaleUp" for educational depth, and integrated quality gates to ensure project consistency throughout the development lifecycle.

    - Includes a terminal statusline that monitors context usage and session costs in real time.
    - Features an experimental Agent Teams mode designed for autonomous multi-agent collaboration on complex tasks.
    - Implements a code ownership mandate where agents are required to fix any tests they cause to fail.
    - Offers distinct output personalities, ranging from high-octane execution to calm, educational guidance.
  6. Fiona Fung from Anthropic explains how AI-native software engineering has significantly increased productivity, with engineers shipping eight times more code per quarter than in previous years. As the cost of generating code decreases, the focus for developers is shifting toward verification, observability, and testing to ensure output quality. This evolution is also dissolving traditional roles, as product managers and designers now contribute directly to codebases.
    - Engineering throughput has increased 8x through AI integration
    - Development bottlenecks are moving from coding to software verification and monitoring
    - Professional boundaries are blurring as non-engineers commit code directly
  7. This article explores how Meta's leadership has shifted its engineering culture toward an intense focus on large language model development, often at the expense of core stability and employee autonomy. The author details a series of controversial management decisions, including the forced reassignment of thousands of engineers to manual data labeling and reinforcement learning from human feedback tasks. These changes have allegedly led to invasive employee monitoring through keystroke tracking and created incentives for "tokenmaxxing," where developers use generative tools excessively just to boost performance metrics. Such organizational shifts are also linked to significant security lapses, including major Instagram account takeover incidents caused by reliance on automated code reviews and understaffed security teams.

    * Shift from engineering autonomy toward LLM-centricity
    * Reassignment of engineers to repetitive data labeling and RLHF work
    * Implementation of invasive keystroke and mouse tracking for training data collection
    * Performance metric distortion through excessive token usage inflation
    * Correlation between security team downsizing and major service outages
  8. This study provides a comprehensive architectural analysis of Claude Code, an agentic coding tool capable of executing shell commands, editing files, and interacting with external services. By examining the TypeScript source code and comparing it to the open-source OpenClaw system, the researchers identify how different deployment contexts influence design choices regarding safety, execution, and capability management.
    Key topics include:
    - Analysis of five core human values driving agent architecture: decision authority, safety, reliable execution, capability amplification, and contextual adaptability.
    - Breakdown of technical components such as permission systems with ML-based classification, context management pipelines, and extensibility mechanisms like MCP and plugins.
    - Comparative study between CLI-based agents and gateway-level personal assistant architectures.
    - Identification of six future design directions for the evolution of AI agent systems.
  9. As AI agents evolve from autocomplete tools to active contributors (opening PRs, managing infrastructure), DevOps must adapt. This playbook outlines the shift through these key strategic pillars:

    * **Foundational Prerequisites:** Robust CI/CD, automated testing, and Infrastructure as Code are essential for agentic workflows.
    * **Evolving Engineering Roles:** Engineers transition from code producers to system designers, agent operators, and quality stewards.
    * **Structured Collaboration:** Integration across IDEs, PRs, pipelines, and production environments is required.
    * **Repository Design:** Repositories must act as explicit interfaces using skill profiles and instruction files.
    * **Development Methodology:** Shift from ephemeral prompt engineering to durable, specification-driven development.
    * **Governance & Security:** Implement frameworks for custom agent consistency/auditability and transform CI/CD into active verifiers of semantic intent and security.
    * **New Success Metrics:** Move from volume-based productivity counts to outcome-based and trust-boundary measurements.
  10. The author distinguishes between vibe coding, a reckless approach where developers prompt and accept AI output without review, and agentic engineering, a disciplined professional workflow. While vibe coding is useful for rapid prototyping and MVPs, it lacks the rigor required for scalable or secure systems. Agentic engineering involves orchestrating AI agents under strict human oversight, treating them as fast but unreliable junior developers who require architectural direction and relentless testing.
    Key points:
    - Distinction between vibe coding (prototyping) and agentic engineering (professional discipline).
    - The importance of design docs, rigorous code reviews, and comprehensive test suites in AI workflows.
    - How AI-assisted development rewards strong engineering fundamentals rather than replacing them.
    - The risk of skill atrophy among junior developers who rely on prompting without understanding underlying principles.

Top of the page

First / Previous / Next / Last / Page 1 of 0 SemanticScuttle - klotz.me: Tags: software engineering

About - Propulsed by SemanticScuttle