Mouse, Keyboard, and Text Actions

These actions simulate a real person at the keyboard and mouse: they click, press keys, and type into whatever field currently has focus. Before using them, make sure the right window is in front - see Windows and Applications.

Mouse - Find Image and Click

Searches the screen for a previously captured image (such as a button or icon) and clicks it when found. If an exact match is not found, the AI Employee retries with a tolerance-based match that handles small rendering differences, so the action still works over remote desktop sessions. Key settings: Image (the saved picture to look for), Mouse Click Type (Left Click, Right Click, Double Click, Triple Click, or Hover - No Click), Mouse Click Location (Center, Left, or Right of the found image), Leave Mouse at Click Location, and Hold Key While Clicking (for example, hold CONTROL while clicking a link to open it in a new browser tab).

Typing - Press Key

Presses one key, or a combination of up to three keys held together (for example Ctrl+C or Ctrl+Shift+S), in the focused window. The action’s attempts setting controls how many times the key press is repeated. Key settings: Press Key plus up to two additional + Press Key selections, each chosen from a dropdown of keys.

Typing - Type Text

Types the specified text into the field that currently has keyboard focus, one character at a time at human speed. The Text to Type setting supports {{Field}} tokens, so you can type values that come from the process. Key settings: Text to Type, Clear Text Before Typing (select-all and delete first), Verify Text After Typing (the AI Employee copies the text back out of the field and fails the action if it does not match), and Press Key After Typing (for example Tab or Enter). The typed text is saved so later actions can reference it.

Typing - Clear Field (CTRL+A)

Clears the field that currently has keyboard focus by selecting all of its content and deleting it. It has no settings - just make sure the cursor is in the right field before this action runs.

Typing - Find Text (CTRL+F)

Opens the focused application’s Find dialog with Ctrl+F and types your search text into it. The application must support the standard Ctrl+F shortcut (most browsers, editors, and office applications do). Key settings are the same as Typing - Type Text: Text to Type (the search text, with {{Field}} token support), Clear Text Before Typing, Verify Text After Typing, and Press Key After Typing (choose Enter to jump to the first match).

Typing - One-Time Password (OTP)

Generates a time-based one-time password from a stored secret key and types it into the focused field - ideal for logging in to sites that require two-factor authentication. To avoid typing a code that is about to expire, the action waits until at least 20 seconds remain on the current code, then types it slowly for reliability. Key setting: OTP Secret (the authenticator seed key; stored securely and hidden in the user interface).

Find/Wait for Image

Pauses the job until a previously captured image appears on screen - for example, waiting for a page or dialog to finish loading before the next step. The AI Employee checks repeatedly, by default for up to about 10 minutes, and the action fails if the image never appears. Key setting: Image (the saved picture to wait for); the action’s attempts setting controls how long it keeps looking.