I hadn’t heard of Dan Guido till a couple of months in the past, after I got here throughout the video of a chat he gave at [un]prompted, an AI safety practitioners’ convention. Dan is the CEO and cofounder of Path of Bits, a software program safety analysis and growth agency that works with firms in tech, protection, and finance. However Dan wasn’t speaking about safety. He was speaking about what it takes to make an organization AI native, which is near the middle of the bullseye for many people proper now.
We’ve been making an attempt to determine how to do this at O’Reilly, however till I got here throughout Dan’s speak, we didn’t have a structured course of. We’ve been constructing alongside the strains he laid out ever since. So for this episode of Stay with Tim I requested Dan to reprise the speak earlier than we bought to the dialog. He was imagined to take twenty minutes, like his authentic convention speak, however he took thirty-five, and I needed to minimize him off barely earlier than the tip to make room for questions. That was a tricky alternative, since all the things he needed to say was golden.
Dan opened by reminding us of the present state of play in enterprise AI adoption. In February, Fortune reported on a Nationwide Bureau of Financial Analysis research by which almost 90% of some 6,000 executives mentioned AI had produced no measurable change in employment or productiveness at their companies over three years. Folks began calling it the brand new Solow paradox, after Robert Solow’s 1987 line that “you’ll be able to see the pc age in every single place besides within the productiveness statistics.”
Dan’s perception is that this isn’t proof that AI doesn’t work. It’s proof that almost all firms are deploying AI fallacious. They hand out ChatGPT and Claude licenses, after which management waits for the magic to occur. It doesn’t.
Dan began out by describing three ranges of AI adoption.
- AI assisted is the place everybody begins: “You give folks entry to ChatGPT, it drafts emails, it summarizes paperwork. It’s only a productiveness instrument, and your group doesn’t change. Your workflows are the very same as they have been earlier than. You simply have just a little buddy that helps you with a few duties.”
- AI augmented is the place you begin redesigning workflows, in order that AI does the primary go on a code evaluate and a human does the second.
- AI native is structural: “That’s the place you’ve redesigned the corporate and its workflows from the bottom up, assuming the AI goes to be there and that it’s a core participant. That’s not likely a instrument. That’s extra excited about AI as teammates.”
In his framing, the primary of the three is a instrument and the final is an working system. For Path of Bits, he mentioned that “working system” has a selected objective:
“I would like our safety experience to compound as code. Each engagement we do, all the talents, the workflows, all the things that we construct makes the subsequent engagement quicker and higher.”
Worker resistance is the primary downside
Dan confessed how arduous it was to get began on the ladder from AI Assisted to AI Native:
“Once I introduced final 12 months that we have been all in on AI, that we have been going to be utilizing it throughout all of our workflows and redesigning the best way the corporate operates, I’d say solely about 5% of the corporate was with me. 95% was resistant.” About 20% was actively resisting. The opposite 75% have been resisting extra passively. “They’ll go together with it in public, however in course of they’ll sabotage it. They’ll hope that in the event that they maintain their head low, this can go over them, and that three months from now administration’s focus will change and it received’t be an issue anymore, and we will get again to doing what we have been doing. That’s the place the vast majority of folks land when these initiatives occur.”
Slightly than argue along with his workers, Dan studied the literature on why folks reject new know-how and determined he wanted to deal with 4 biases in opposition to AI: self-enhancing bias, id risk, opacity, and intolerance for imperfection.
Self-enhancing bias is the behavior of crediting your wins to your personal judgment and your losses to circumstance, which is a selected downside for senior people who find themselves strongly hooked up to the years of expertise and instinct that bought them to their current place. Opacity just isn’t with the ability to see how a choice bought made. Dan’s statement is that you simply don’t perceive your physician’s reasoning both, however in some way you belief the physician however get suspicious of the machine. Dan didn’t point out this work particularly, however intolerance for imperfection appears to check with Dietvorst, Simmons, and Massey’s work on algorithm aversion, which discovered that individuals abandon an algorithm after watching it err as soon as, even when it outperforms the human various. Their follow-up paper discovered that giving folks even a slight potential to change the algorithm’s output is sufficient to overcome the aversion.
Dan spent essentially the most time on id risk. He described a research by which the identical kitchen equipment was marketed in two methods: “On one hand, it does the cooking for you. Then again, it helps you prepare dinner higher. It’s the identical system. The individuals who recognized as cooks rejected the primary model and accepted the second.”
Most data work, Dan argued, and safety auditing specifically, is what he known as symbolic slightly than instrumental. That’s, it carries that means about who you’re. “So I’ve to border AI as one thing that makes you a extra harmful auditor,” he mentioned. “Not that it does the audit for you.”
In his work at Path of Bits, he intentionally constructed a countermeasure for every bias.
- Self-enhancing bias is addressed by “an AI maturity matrix” with seen ranges, as a result of you’ll be able to’t declare you’re already adequate when there’s a printed ladder that identifies a unique set of expertise as crucial.
- Identification risk will get expertise repositories, the place an engineer who writes a tough plugin will get credit score for encoding their experience. Hackathons additionally change the dynamic from resistance to exploration. I’m placing phrases in Dan’s mouth right here, however I believe he’d agree that when skilled builders are known as on as mentors in a hackathon, that additionally reduces their expertise of AI as an id risk.
- Intolerance for imperfection will get a curated market, sandboxing, and hardened defaults, so everybody’s first expertise of AI isn’t a catastrophe.
- Opacity will get a written AI handbook that clarifies the utilization coverage and the chance mannequin slightly than simply saying “belief us.”
Right here’s Dan’s slide on “the cures that truly labored”:
Returning to one in all my interest horses, it is a sort of mechanism design. In my current piece on the lacking mechanisms of the agentic economic system, I argued that we have to begin with desired outcomes and ask ourselves what mechanisms will assist to supply them. Dan’s method appears to be actually good at this. Most enterprises are treating AI adoption as a procurement downside or a communications downside. Dan handled it as a query of what incentives, defaults, and standing ladders produce the habits you need, given how folks truly reply.
The final treatment on Dan’s checklist is that the CEO has to guide by instance. He famous, “I used to be the primary particular person via the door. My voice because the CEO issues much more than folks assume. The passive 50% of the corporate that isn’t positive if this initiative goes to achieve success, they’re watching to see what management truly does, not what it says.”
A ladder, not a mandate
Path of Bits already tracked about 50 engineering expertise for efficiency evaluate, issues like Python, git, Rust, and numerous safety auditing capabilities. Dan pulled AI expertise out into their very own matrix, with 4 ranges, from not engaged via succesful and adoptive to transformative. Every of those ranges is detailed individually and extra particularly for assurance, engineering, gross sales, and challenge administration.
He famous that “The very best stage of the maturity matrix just isn’t any individual who makes use of AI essentially the most. It’s any individual who invents new methods to work and builds instruments with AI. So the id of the knowledgeable shifts from ‘I don’t want AI’ to ‘I’m the one who makes AI helpful for the corporate.’” This was his first essential design alternative.
The second is what stage zero means. He mentioned “Should you’re at stage zero, in the event you’re not engaged, which means you’re preventing again in opposition to the corporate. Should you dismiss AI as hype, in the event you refuse to make use of AI for safety work, it is a disagreement on ideas, not on expertise. For individuals who have been caught within the not engaged class, we had arduous conversations, and there have been individuals who left the corporate.” Ranges one via three are a ability difficulty, and the treatment is time with the instruments.
Whereas the slide describing the aptitude matrix is proven within the previous video clip, right here’s the place you will discover the complete deck so you’ll be able to research it in additional element.
Driving adoption and expertise with hackathons
Top-of-the-line methods Path of Bits developed to maneuver folks up the ladder was to carry a hackathon each two months. Dan runs them with clear targets slightly than as a free-for-all. The main focus space and studying targets are outlined prematurely and introduced per week forward, with separate directions for engineers and non-engineers. Folks work in pairs so all the things will get reviewed. There’s a demo session on the finish, after which follow-through. (It’s an essential a part of Dan’s huge thought, that it’s important to construct a system by which, in his phrases, organizational data and functionality compounds.) He famous that “Within the days afterward we maintain one or two folks round, and so they accumulate all of the reusable artifacts, construction them, and put them into the locations they should be.”
I requested what folks outdoors of product and engineering truly work on, for the reason that reply for an accountant at a hackathon was not apparent. Dan’s response is that the hackathon isn’t measured in artifacts shipped however in the place folks sit on the aptitude ladder the next week. Basically, he’s operating a coaching program that occurs to supply helpful output, slightly than a manufacturing dash that occurs to show folks one thing.
The primary hackathon, he informed me, was the equal of a seaside cleanup: “It’s like these firms that ship all people to the seaside with a giant stick and say, let’s go decide up a bunch of trash and put it away, and you then get the large workforce photograph after with all of the contractor luggage of rubbish. That’s what we did with our public supply code repositories.”
He picked it as a result of open supply upkeep is the a part of the job that seems like a grind. No new options, simply closing points and rancid dependencies on public code the place nothing was in danger. “As an open supply maintainer, you simply get overwhelmed down by the general public. This doesn’t work, I can’t use it, this factor sucks. Dozens of points mentioning flaws you already knew about. It feels burdensome. We needed folks to see that adopting AI would relieve burden.”
The second hackathon was about delivery impactful product updates, but it surely was additionally designed to maneuver everybody up the aptitude ladder by giving up management. Engineers needed to run Claude Code in bypass permissions mode, absolutely autonomous, on public repositories, inside sandboxes the corporate had ready prematurely. The one they’re operating now could be about persistent background brokers that may be handed a job throughout an audit and are available again with a proof of idea exploit or a draft discovering.
Right here’s a take a look at Dan’s slack message asserting the hackathon:
All the things the hackathons produce will get harvested into artifacts.
Path of Bits runs three expertise repositories: an inner one for firm workflows, a public one that anybody can use, and a curated one that vets third-party expertise earlier than they’re allowed in.
Publishing expertise to the general public repository isn’t just a advertising and marketing train. “It retains us trustworthy, and it forces us to write down issues that different folks can use, not simply folks outdoors the corporate however inside too,” Dan mentioned. “It actually helps us take into consideration the tribal data that’s baked into the instrument.”
The curated repository exists as a result of Path of Bits is aware of how unhealthy the provision chain is. They’ve revealed analysis on the way to write malicious expertise, and so Dan just isn’t going to inform 130 workers to start out downloading code from strangers and operating it on their laptops. “If you need adoption, you want a secure provide chain.”
Turning scar tissue into infrastructure
Maybe much more essential than the talents repository is, as Dan put it, “turning scar tissue into infrastructure.”
“Each single time Claude Code didn’t do one thing we needed, we’d bake it right into a set of worldwide, copy-pasteable defaults. Identified good settings, advisable patterns. I name it scar tissue. If I rent any individual new tomorrow, I don’t need them to must undergo the complete discovery strategy of the final 12 months of Path of Bits to determine the way to use the instrument.”
The configuration repository, claude-code-config, is the place the amassed classes reside.
Dan constructed the primary model himself after which opened it to tug requests from the entire firm, assigning somebody after every hackathon to go accumulate what folks hadn’t contributed on their very own. “It’s simpler to place out one thing that’s unpolished than it’s to get it good on the primary attempt.”
Briefly, a giant a part of the Path of Bits “enterprise AI working system” method is a set of standardized instruments and hardened defaults. Standardization isn’t a straitjacket. It’s a basis.
On sandboxing, Path of Bits intentionally didn’t decide a single most popular resolution. There’s a devcontainer for builders, dropkit for disposable DigitalOcean droplets, COOP for remoted VMs, and the sandboxing now constructed into Claude Code for informal customers. “The purpose isn’t that everyone makes use of the identical sandbox,” Dan mentioned. “The purpose is that everybody has a secure sandbox to make use of, and that it’s simple for them to do it.”
One other of the hardened defaults is procedural. Path of Bits enforces a seven day cooldown on each bundle their builders set up:
“There are dozens of safety firms scanning the web looking for a brand new cool weblog submit they’ll write about malicious code hiding on PyPI or npm, and so they normally determine on the market’s a provide chain difficulty inside hours. So we simply delay all of the packages that Path of Bits makes use of. Usually the malicious stuff will get picked up earlier than we ever get an opportunity to run it.”
That’s free-riding on a aggressive marketplace for safety analysis, and given the pace of in the present day’s market, it’s a sublime resolution. There’s an entire class of defenses like this ready to be discovered, the place the mechanism just isn’t a technical system however a well-chosen delay.
Knowledge, and DJ Patil’s “Tidy Home”
The issue we run into most frequently as we construct AI workflows at O’Reilly isn’t the mannequin or the tooling. It’s information. Who has entry to which system, which system does that information reside in, and who do I ask? In a 500 particular person firm that’s annoying. I’m wondering what it’s like at an organization with 50,000 workers.
I informed Dan about DJ Patil’s Tidy Home framing. He agreed that information entry for AI is a giant downside. His reply begins with permissions:
“The permissions debt is invisible till an agent hits it. Making information agent legible is a pressured permission audit. You must truly undergo and determine who can entry what…. It additionally raises the stakes for permissions errors. Should you overshare data, now an agent inside your organization goes to seek out it immediately. There are numerous these technical debt form of issues the place, with brokers, all of it’s changing into due on the similar time.”
Each shortcut a corporation took with its information over the previous twenty years is being known as without delay, and the businesses that may run the audit, make quick choices about boundaries, after which truly share their information are those that may get a drive multiplier.
Dan is in opposition to letting a thousand flowers bloom, as a result of uncoordinated groups create overlap slightly than compounding. He’d slightly have one centralized basis, with innovation occurring on high of that. He advised a helpful metric for making that work throughout workforce boundaries is what fraction of your workforce’s information did you make reusable for everybody else, and the way a lot of it’s being utilized by groups outdoors your personal.
What post-AI jobs appear like
Earlier than the primary hackathon, Path of Bits ran hands-on periods to show its operations and go-to-market workers the fundamentals of git and the command line. Not mastery, simply sufficient to be a client of the factor. Right here we’re fifty years into my profession and the Unix command line nonetheless issues. Dan’s non-technical workers largely work inside Claude Cowork or Codex Desktop now, however he thinks the command line expertise was value it as a result of they know what’s occurring below the hood.
What occurs to a job when the instrument can do numerous what people used to do? Dan gave the instance of his personal technical editors. His editors used the hackathons to construct the instruments that bought them out of line modifying, together with one which turns a public presentation right into a weblog submit within the firm’s voice. What the writers do now could be seek the advice of on the way to body a narrative so it’s efficient with a selected viewers.
I agree. Human jobs aren’t going away any time quickly. This will get heard as optimism when it’s actually simply statement. AI goes to switch numerous what we used to do, however it’s also going handy us a considerable amount of new work, and far of that work hasn’t been understood but. High quality assurance for agent techniques is without doubt one of the new jobs. So is expertise product administration, which is a job that didn’t exist eighteen months in the past and now has a headcount at a 130 particular person safety agency.
I requested a query in direction of the tip about how we’re going to know which expertise and brokers are any good. What Dan has thus far is telemetry pulled from builders’ dot recordsdata via the corporate’s system administration system, which tells him what will get used and what breaks, plus one AI techniques engineer whose job is product administration for the talents repository, reviewing incoming pull requests and deprecating overlapping expertise.
What Dan thinks comes subsequent is analysis. He says: “When you make investments quite a bit into these agent techniques, you want proof that they do the job. The way in which you do that’s you give all people a efficiency evaluate. You give them an analysis information set, a benchmark.”
Path of Bits is now constructing benchmarks for its core expertise. How effectively can we discover bugs on this language? How effectively can we write a press release of labor? Setting up these datasets is actual work, with optimistic and unfavourable circumstances, and comparisons in opposition to the algorithmic instruments that exist already.
Put the reps in
I requested Dan for the highest 5 errors he made. He mentioned there was just one. “You’ll want to allocate an applicable quantity of FAFO time. (That’s F Round and Discover Out.) A product comes out on Friday. There’s no documentation for it. There’s no coaching steerage for it. There’s no course on it. You may’t wait till any individual systematizes the data. You simply have to do it.”
Then he gave an analogy to going to the health club.
The recipe for fulfillment
Dan has a replicable recipe, which he summarized as follows:
- Standardize on one agent workflow which you could help.
- Write an AI handbook in order that threat choices aren’t advert hoc, and that everybody is enjoying the identical recreation.
- Create a functionality ladder that makes clear that enchancment is predicted.
- Run quick adoption sprints that drive hands-on utilization.
- Seize all the things as reusable artifacts: expertise + configs + a curated provide chain.
- Make autonomous brokers secure with sandboxing + guardrails + hardened defaults.
The Path of Bits expertise repository is public. So is the curated market, the configuration repository, the devcontainer, dropkit, and COOP (Continuity of Operations planning). He wrote up the entire playbook on The Path of Bits Weblog and gave a model of it to tl;dr sec. He thinks publishing makes the work higher as a result of it forces the tribal data out into the open the place it may be checked.
Which brings me again to the Solow paradox, which appeared to vanish by the late 90s, when US combination productiveness did lastly go up. That didn’t occur as a result of computer systems bought quicker. It disappeared as a result of firms found out the way to reorganize themselves round what computer systems may do, and ultimately these organizational recipes unfold extensively sufficient to point out up in combination statistics. The identical has to occur in the present day. The present AI discourse is obsessive about mannequin functionality and largely tired of diffusion. The issue just isn’t that the fashions are oversold. It’s that nearly no person has finished the mandatory organizational work, and the few who’ve are largely conserving it to themselves.
If you wish to transcend the spotlight movies proven above, watch Dan’s complete speak right here. His slide deck is right here. And remember to take a look at the Path of Bits Github repository.
