Claude controlled my Mac for half an hour. It was a wild, worrisome ride Giving Claude the wheel of my Mac was a cool and crazy experience. But it’s also a privacy risk and a token hog. , PDT OpenAI’s GPT-5.4 model can use computers when given access to compatible tools. What’s new here is that Anthropic just rolled out computer use on the consumer Claude app, meaning everyday users can try the feature (which is still in “research preview”) right now. There are caveats to consider, of course. For one, computer use on the Claude app is currently for Mac users only, similar to how macOS devices got the first crack at Claude Cowork. (Windows support is “coming soon,” Anthropic says.) Secondly, you must be a paid Claude Pro or Max user to try the computer-use trick, meaning free users need not apply. And third, the privacy implications of allowing Claude to control your Mac are fairly worrying. In order for Claude to take charge of your mouse, it needs to take screenshots to see where it’s mousing and clicking, and that means it can see anything on your screen — open PDF files (like bank statements), chat windows, browser tabs, you name it. You’ll find the Claude’s “computer use” toggle in the Settings > General menu, and you’ll need to grant Claude macOS-level “accessibility” and “screen recording” permissions. You must also give Claude specific access to an app before it can open it. But once Claude does have access to an app, it can use its menus, type inputs using the keyboard, and theoretically do anything it wants. Anthropic says that there are guardrails in place to prevent Claude from trading stocks, scraping facial images, or doing other hair-raising things, but you should still refrain from asking Claude to fire up Quicken. Claude requires broad permissions for computer use, including taking screenshots of your desktop.Ben Patterson/Foundry So for my brief tests, I asked Claude to do some fairly innocuous tasks. For example, I asked Claude to open the macOS Notes app and create a new note that read “Hello World.” The borders of my screen glowed red as Claude took over (similar to what happens in the Chrome browser when Gemini starts browsing) and I watched as the Notes app opened and Claude created the note and began typing. I also tried Claude computer use via Anthropic’s new Dispatch feature, which lets you control remote Claude desktop sessions from the Claude mobile app. “Claude, can you use that same note and add a shopping list with the ingredients for lasagna?” I typed on my iPhone. A few seconds later, Claude did just that, typing the list up on my Mac desktop. “Done! The lasagna shopping list is now in the note, with all the ingredients: noodles, ground beef, Italian sausage, tomato sauce/paste/crushed tomatoes, ricotta, mozzarella, parmesan, egg, garlic, onion, olive oil, and dried herbs.” Then came the Chess experiment, where Claude got hung up trying to move a single chess piece. “The Chess app uses a 3D perspective board, which makes it tricky to click precisely on pieces,” Claude later explained, and it also revealed all the methods it tried, including tinkering with the Settings menu and zooming in on the chessboard. All that thinking and the subsequent failed attempts cost tokens, and once I saw my five-hour usage allotment was almost gone, I halted the task. You’ll need to grant Claude access to an app before it begins controlling it.Ben Patterson/Foundry So, interesting, but so what? Why ask Claude to write up a shopping list for lasagne on my desktop when I could just as easily have it do so in the Claude app, and then transfer the list to Notes on my iPhone? And what’s the good of Claude being able to use Quicken on my desktop if I won’t allow it to do so for privacy reasons? Well, those are very good questions, and personally, I don’t see a Claude computer use case for me–or at least, not yet. Who could make use of Claude’s computer abilities? Good examples would include developers or other advanced users looking to automate repetitive tasks that required clicking around a graphical desktop interface, or perhaps for UI testing. One possibility I’d like to try is using Claude to control Handbrake, the video conversion app I use for processing videos before adding them to my Plex library. That’s a tedious task requiring lots of interface clicks, and I can see offloading that on Claude–that is, once my Claude usage allotment refreshes. Claude’s computer use abilities do point the way to a future I was writing about last week: one where our PCs and Macs are controlled by AI agents, and instead of using apps to perform desktop duties, we simply ask our agents to do them for us. But as things stand now, all the mouse clicking, keyboard taps, and constant screenshot snaps required for Claude computer use (or for any computer-controlling LLM) is slow and expensive. And then there’s the privacy issues as well the risk of prompt injection, where a rogue document or website tries to trick Claude into revealing sensitive data or altering its own “system prompt” instructions. (Anthropic says Claude is trained to detect if it’s being subjected to a prompt injection attack.) In other words, Claude computer use is a fascinating glimpse into the future that–for most of us, anyway–isn’t ready for prime time. : Ben Patterson, , Ben has been writing about consumer technology for more than 20 years, and now focuses his reporting on AI as it relates to the basic human experience. His coverage of artificial intelligence interrogates the latest LLMs, and how they can be used at work and at home to be best prepared for the AI revolution. “AI is going to change our lives sooner than we think,” Ben writes. “Our best way to adapt is by using it every day.” Ben has been a since 2014, and has covered everything from laptops to security cameras before launching ’s AI beat. Ben's articles have also appeared in PC Magazine, TIME, Wired, CNET, Men's Fitness, Mobile Magazine, and more. Ben holds a master's degree in English literature. Recent stories by Ben Patterson: Add this one line to your AI prompts for faster, better answers Your next PC will likely run on AI agents Installing an AI assistant on your PC? 5 do’s and don’ts
