microsoft

skill-recorder: Turn Recorded Work into Reusable AI Skills

Skill Recorder captures a desktop work session and uses GitHub Copilot CLI to turn it into ordered steps, then a reusable agent skill or automation. It suits people who want to teach agents workflows by example.

Stars
4.2k
Forks
440
Stars, last 10 days
+45

Our take

Health score

61/100

How it is scored
Activity
77
Community
42
Issues
52
Pull requests
71

+45 stars in the last 10 days

Overview

Skill Recorder is a desktop app for turning a real task demonstration into instructions an AI agent can reuse. It records on-screen activity, reconstructs the user's intent and ordered steps with GitHub Copilot CLI, then creates a Skill or Automation.

It is aimed at people who want to describe a workflow once rather than write agent instructions from scratch. Generated procedures favor an agent's native tools over replaying UI clicks, and can generalize from one recorded example.

Key Features

  • Records screen activity and app or window changes locally during a session.
  • Optionally captures spoken narration and transcribes it on-device.
  • Offers a session-scoped terminal for recording commands and output.
  • Uses GitHub Copilot CLI to analyze a recording into an intent and ordered steps.
  • Lets users review and edit the analysis before creating outputs.
  • Creates reusable SKILL.md procedures or scheduled and triggered automations.
  • Supports Windows 11 and macOS, with Ubuntu also mentioned in installation instructions.

Use Cases

  • A knowledge worker demonstrates a recurring task once and creates a procedure an AI agent can run on demand.
  • An operations team turns a repeatable process into an automation triggered on a schedule or event.
  • A developer records a workflow involving terminal commands so an agent can use the captured context when building instructions.
  • Someone who is unsure how to write agent skills starts from an observed example, then reviews and edits the generated steps.

Getting Started

Install from the latest release. Copy the commit-pinned installation command for your operating system and run it in Terminal or PowerShell. See the README for platform details, sign-in steps, and developer setup.

Alternatives

  • astron-rpa: AstronRPA builds desktop and web automations with a visual workflow editor, rather than recording a work session to generate an agent skill.
ProjectLanguageLicenseStarsStatus
skill-recorderTypeScriptMIT4.2kNot checked yet
astron-rpaPythonApache-2.05.2kActive

Considerations

  • Analysis requires a GitHub account with Copilot access and sends recording data to GitHub's cloud when the user chooses Analyze.
  • Recording can include screen images, window or document titles, URLs, clipboard previews, and optional narration or terminal activity. Avoid capturing credentials or other confidential information.
  • macOS is the primary target. Windows 11 is supported, and Ubuntu is referenced in the installation instructions.
  • Installation builds the source release locally and requires an internet connection to download its components. Review the release instructions and organizational policies before installing.

Found this useful?

Share it with someone who would like skill-recorder.

Comparisons