Let the AI assistant control Chrome

Install the S.A.K. Utility Chrome extension so the AI assistant can read and operate web pages, with your approval for each click and typed entry.

To let the AI assistant in S.A.K. Utility work in a web browser, open the AI Assistant tab, press Install extension under Browser Control, and restart Chrome. Then set Local tool access to a Full Access mode and ask. It works with Google Chrome only. The assistant can read a page without asking, but it needs your approval for each click, typed entry, and new address.

When to use this

  • A repair needs steps on a website, such as a router page or a vendor's download page.
  • You want the assistant to read what a web page says, and advise you.

What you need

  • Google Chrome, version 116 or newer.
  • Your OpenAI API key, loaded in the assistant.
  • Assisted Full Access or Unattended Full Access. Browser control is not available in Chat and Research.

No administrator rights are needed.

The extension runs in your own Chrome profile, so it can reach whatever you are signed in to. Sign out of banking and other sensitive sites, or use a Chrome profile without them, before you let the assistant work.

Steps

Install the extension

  1. Open the AI Assistant tab, and find Browser Control at the bottom of the right-hand column.
  2. Press Install extension.
  3. Wait for the status to read Installed. Restart Chrome if it is open.
  4. Close Chrome fully, then open it again.
Browser Control section with the status Not installed and an Install extension button
Browser Control before the extension is installed

Use it

  1. Set Local tool access to Assisted Full Access.
  2. Open the page in Chrome that you want to work on.
  3. Ask the assistant what you want, such as "Read this page and tell me which driver I need."
  4. Answer each approval request.

Remove it

Press Uninstall extension in the same place, then restart Chrome. Use this button instead of Chrome's extensions page, because S.A.K. Utility installed it through a Chrome policy.

How it works

Install extension adds one extension, S.A.K. Utility Browser Control, through a Chrome policy on your own Windows account. It also registers the helper that lets Chrome talk to S.A.K. Utility. Other Chrome policies are left alone.

The assistant works from a filtered list of what is on the page. Its actions go straight to the page, so your own mouse and keyboard stay yours. While it works, it draws its own cursor and an AI CONTROL badge on the page, so you can see it acting.

What asks you:

  • Does not ask, in either Full Access mode: reading a page, taking a screenshot of the tab, and listing tabs.
  • Asks every time, even in Unattended Full Access: clicking, typing, pressing keys, scrolling, opening an address, and most other actions on a page.

The approval window comes from S.A.K. Utility itself. Text on a web page cannot approve anything for you.

Good to know

  • What the assistant reads on a page goes to OpenAI. That includes private details visible on the page.
  • Installing writes outside the S.A.K. Utility folder, unlike the rest of the app. It adds files under %LOCALAPPDATA%\SAK and an entry in your account's Chrome policy settings. Uninstall extension removes the policy entry, the helper, and the generated files.
  • Other browsers, such as Edge and Firefox, are not supported.
  • Beyond Chrome, the Full Access modes also give the assistant tools for other windows on the PC: screenshots, reading text on screen, clicks, and typing. The same rules apply. Looking does not ask, and acting does.

The status line can also say:

Status Meaning
Partly set up. Click to finish. Press Finish setup
Setup status could not be read. S.A.K. Utility will not change anything until it can read the status
Not installed (extension package is missing from this build). The package is not in this copy. Download S.A.K. Utility again