Skip to main content

Harness Acquires Codecov to Identify Untested Code

Harness this week acquired Codecov, a provider of a platform that analyzes the percentage of a codebase that has been tested, from Sentry.

Brad Rydzewski, a senior vice president and general manager for Harness, said Codecov makes it simpler for DevOps teams to track testing coverage at a time when the volume of code being created in the age of artificial intelligence is exponentially increasing.

Codecov is already widely used by enterprises and maintainers to automatically run tests on any code that for one reason or another was not tested earlier in the software development lifecycle (SDLC).

Going forward, Harness plans to integrate the data that Codecov generates in real time with the Harness Software Delivery Knowledge Graph to provide deeper insights across DevSecOps workflows as AI agents are integrated into workflows.

Ultimately, the goal is to automate testing as much as possible while maintaining separation of duties between AI agents that write code and AI agents that test code, said Rydzewski. Otherwise, an AI agent that writes code when presented with data informing it that its code failed a test might decide to rewrite the test rather than fix the code it created, he noted.

The issue is that while AI tools can usually be relied on to generate a test, there still needs to be human oversight to ensure that best testing practices that are largely deterministic are being consistently followed, added Rydzewski.

In general, the rise of AI coding will force many organizations to revisit their testing processes. Many of them are not following best practices for testing code, which in the AI era will inevitably lead to issues arising later on in production environments. While best practices for testing remain largely the same in the AI era, many DevOps teams will need to focus more on fundamentals to prevent issues from arising later on that could result in regressions, outages or a security incident, said Rydzewski.

The challenge, of course, is finding a way to apply AI to both coding and testing in a way that doesn’t increase the total cost of building and deploying software to a point where it becomes economically unsustainable.

Additionally, a recent Harness survey found that while 89% of software engineering teams have seen an improvement in productivity following the adoption of AI, there are metrics not being tracked that increase total costs. For example, 81% noted that the amount of time spent reviewing code has increased. However, just under a third of their day is now consumed by AI-related tasks that existing metrics don’t surface.

A full 94% also noted technical debt, validation time, and developer burnout are not being tracked by existing productivity metrics, including time spent reviewing AI code for accuracy (53%), fixing subtle bugs from AI code (52%), explaining AI code to teammates (48%) and context switching between tools (45%).

Regardless of the level of appreciation for testing, the one thing that is certain is that all it takes is one issue in a production environment to negate a large percentage of the return on investment (ROI) that was initially hoped for when software engineering teams decided to embrace AI in the first place.



from DevOps.com https://ift.tt/07aOpuf
Labels:

Comments

Post a Comment

Popular posts from this blog

Mistral Moves Coding Agents to the Cloud — and Gets Out of Your Way

For the past year or so, AI coding agents have been tethered to your local machine. You kick off a task, watch the terminal, and babysit every step. It works — but it’s not exactly hands-free. Mistral just changed that. On April 29, the Paris-based AI company announced remote coding agents for its Vibe platform, powered by a new model called Mistral Medium 3.5. The idea is simple: Instead of running coding sessions on your laptop, they now run in the cloud — asynchronously, in parallel, and without you watching over them. What’s Actually New Coding sessions can now work through long tasks while you’re away. Many can run in parallel, and you no longer become the bottleneck at every step the agent takes. That’s the core pitch. You start a task from the Mistral Vibe CLI or directly from Le Chat — Mistral’s AI assistant — and the agent handles the rest. When it’s done, it opens a pull request on GitHub and notifies you, so you review the result inste...
Post a Comment
Read more

Cursor’s New SDK Turns AI Coding Agents Into Deployable Infrastructure

For most of its life, Cursor has been an IDE. A very good one. But with the public beta of the Cursor SDK, the company is making a different kind of move — one that should get the attention of DevOps teams. The Cursor SDK is a TypeScript library that gives engineers programmatic access to the same runtime, models, and agent harness that power Cursor’s desktop app, CLI, and web interface. In short, the agents that used to live inside an editor can now be invoked from anywhere in your stack. That’s a meaningful shift in how AI coding tools fit into software delivery pipelines. From the Editor to the Pipeline If you’ve used Cursor before, the workflow is familiar — you interact with an agent in real time, asking it to write functions, fix bugs, or review code. The SDK breaks that dependency on interactive use. Now you can call those same agents programmatically, from a CI/CD trigger, a backend service, or embedded inside another tool. Getting started is a single inst...
Post a Comment
Read more

What to Know About Jamaal Bowman’s Bitter Democratic Primary Race

What to Know About Jamaal Bowman’s Bitter Democratic Primary Race By Claire Fahy from NYT New York https://ift.tt/FRksoDX Bowman, Jamaal, Latimer, George S, Primaries and Caucuses, Elections, House of Representatives, Israel-Gaza War (2023- ), United States Politics and Government, Political Advertising, AMERICAN ISRAEL PUBLIC AFFAIRS COMMITTEE, Democratic Party, New York State, House of Representatives
Post a Comment
Read more