SShortSingh.
Back to feed

AI 에이전트가 버그를 재현하지 못하면 수정하지 않는 자가 수정 파이프라인

0
·2 views

자가 수정 AI 에이전트는 버그 리포트를 실패하는 API 테스트로 먼저 재현하고, 재현되지 않으면 수정 없이 넘어가도록 설계된다. DeepSeek Harness 팀이 2026년 11월 1일 발표한 슈퍼 에이전트 설계 에세이에서 이 아이디어가 소개되었다. 파이프라인은 접수, 재현, 격리된 브랜치에서의 수정, 재실행, 전달의 단계로 이루어진다. 수정은 재현 테스트와 기존 테스트 스위트를 모두 통과해야 하며, 최종 병합은 여전히 사람이 담당한다. 해당 에세이는 아키텍처를 설명한 것으로, 공식 출시된 DeepSeek Harness 기능이 아니라고 저자들이 밝혔다.

Read the full story at DEV Community

This is an AI-generated summary. ShortSingh links to the original source for the complete article.

Discussion (0)

Log in to join the discussion and vote.

Log in

Related stories

0
ProgrammingDEV Community ·

Calibration-free top-k selector speeds MoE decoding without threshold tuning

A new top-k channel selector for Mixture-of-Experts models removes the need for offline score-threshold calibration while keeping accuracy and latency gains. Previously, thresholds fitted on held-out data were used to limit routed-expert reads, but this varied across inputs and could trigger repetition loops in models such as Gemma-4. The approach instead keeps each token's k highest-scoring channels, requiring no calibration data. In reported comparisons it matched or beat the threshold version in 40 of 43 cases at 13% and 18% budgets. The authors report retaining 98.1% of full-model accuracy at 17.8% of routed-expert reads on three post-trained MoE models, with Triton kernels running MoE blocks 1.60 to 1.90 times faster than optimized vLLM at batch size one. The evaluation is limited to those three checkpoints and Triton kernels, so generalization to other model families and hardware remains unconfirmed.

0
ProgrammingDEV Community ·

Two Models for AI-Powered BI: Dashboards with Agents vs. Agent-First Design

The author argues that the right AI-driven business intelligence design depends on data scope, user count, and how predictable questions are. For a narrow procurement project called SpendCube, built on Azure Databricks, Azure SQL Database, and Power BI, a dashboard paired with an AI agent is presented as practical. Power BI Copilot is cited as an example, with the key requirement being that the agent use the existing semantic model so its answers match dashboard KPIs. In contrast, BMW's Mobile Data Recorder collects over 10,000 signals from roughly 3,500 vehicles, making it impossible to anticipate every engineering question in advance. For such large, unpredictable datasets, the author favors an agent-first approach in which engineers describe what they want to investigate and the agent generates queries and visualizations.

0
ProgrammingDEV Community ·

Support FAQ bot invented 22 answers until grounding cut that to zero

A tester evaluated a small n8n support-FAQ workflow using a 1.8B-parameter model running locally, asking 20 questions across two prompt versions over 120 runs. The model answered all 30 known questions correctly but gave answers to 29 of 30 unanswerable questions, and 22 of those asserted facts absent from the knowledge base, such as denying a phone number or Slack integration. Prompt wording alone did not stop the fabrication, so the author required the model to cite a knowledge-base entry and a supporting quote. A Code node then verifies that evidence and falls back to a handover message when it is missing. The approach aims to reduce fabricated answers that could mislead customers into not buying.

0
ProgrammingDEV Community ·

Confluence Cloud Adds Native Page Approvals, With Limits on Multi-Approver Rules

Atlassian opened native page approvals in Confluence Cloud to open beta for Premium and Enterprise plans on 10 July 2026, ending years of users being told no approval workflow existed. In the author's test on a Cloud site, a page stayed In review until every named approver signed off, showing the all-or-nothing rule. The native feature cannot use groups as approvers or offer any-one or minimum-N thresholds, and Standard plans only have editable content statuses plus automation. The article offers a Standard-plan workaround using content status and automation, and a third-party app, Sentinel Vault, for more flexible multi-approver rules.