{"name":"Skill Recorder: Turn Screen Recordings into AI Agent Skills","description":"Skill Recorder is a desktop application that captures your on-screen work sessions, including clicks and app switches. It leverages the GitHub Copilot CLI to analyze these recordings, reconstructing them into an intent and ordered steps. This process allows users to generate reusable AI agent skills or automations for platforms like Microsoft Scout, Copilot Cowork, or Copilot Studio.","github":"https://github.com/microsoft/skill-recorder","url":"https://osrepos.com/repo/microsoft-skill-recorder","source":"osrepos.com","sourceDescription":"This repository profile is provided by osrepos.com, an open source repository discovery platform.","repositoryProfile":"https://osrepos.com/repo/microsoft-skill-recorder","generatedFor":"open source discovery and AI-assisted research","markdown":"https://osrepos.com/repo/microsoft-skill-recorder.md","json":"https://osrepos.com/repo/microsoft-skill-recorder.json","topics":["AI Agents","Automation","Copilot","Screen Recording","TypeScript","Desktop App","Microsoft","Productivity"],"keywords":["AI Agents","Automation","Copilot","Screen Recording","TypeScript","Desktop App","Microsoft","Productivity"],"stars":null,"summary":"Skill Recorder is a desktop application that captures your on-screen work sessions, including clicks and app switches. It leverages the GitHub Copilot CLI to analyze these recordings, reconstructing them into an intent and ordered steps. This process allows users to generate reusable AI agent skills or automations for platforms like Microsoft Scout, Copilot Cowork, or Copilot Studio.","content":"## Introduction\nSkill Recorder is an innovative desktop application developed by Microsoft that transforms your real-world work sessions into actionable AI agent skills. By recording your screen activity, it intelligently reconstructs your actions into a clear intent and a sequence of steps, enabling the creation of reusable automations. This tool is designed to empower users to teach AI agents new tasks efficiently, bridging the gap between human interaction and AI automation.\n\n## Why Use It and Key Benefits\nSkill Recorder offers a unique approach to automation by learning directly from your actions. Instead of manual programming, you simply perform a task once, and the application, powered by GitHub Copilot CLI, translates it into a structured procedure. Key benefits include:\n\n*   **Effortless Skill Creation**: Record any task, from form submissions to complex workflows, and turn it into a reusable skill or automation.\n*   **AI-Powered Analysis**: Utilizes GitHub Copilot CLI to understand the intent and steps of your recorded session.\n*   **Agent Native Tools**: Prioritizes using an agent's native tools, like `gh` CLI or `web_fetch`, over replaying UI clicks, leading to more robust and adaptable automations.\n*   **Generalization**: Learns from a single example to generalize tasks, allowing an agent to perform similar actions in various contexts.\n*   **Integration**: Builds skills compatible with Microsoft Scout, Microsoft Copilot Cowork, or Copilot Studio.\n\n## Installation\nSkill Recorder is distributed as a source release, meaning a single command downloads a pinned Node.js runtime, builds the exact release commit, and adds the application to your system. You will need a GitHub account with Copilot access. The Copilot CLI is bundled with the app. macOS is the primary target, with Windows 11 (x64 and ARM64) also supported.\n\nTo install, visit the [latest release page](https://github.com/microsoft/skill-recorder/releases/latest){target=\"_blank\"} and copy the command for your platform. The commands below are patterns, where `<40-character-release-commit>` must be replaced with the specific commit from the release page.\n\n**macOS / Ubuntu**\n\nbash\ncommit=\"<40-character-release-commit>\"; curl -fsSL \"https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.sh\" | SKILL_RECORDER_COMMIT=\"$commit\" bash\n\n\nTo keep the app running after the terminal closes, add `SKILL_RECORDER_DETACHED=1` after the pipe:\n\nbash\ncommit=\"<40-character-release-commit>\"; curl -fsSL \"https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.sh\" | SKILL_RECORDER_COMMIT=\"$commit\" SKILL_RECORDER_DETACHED=1 bash\n\n\n**Windows (PowerShell)**\n\npowershell\n$commit=\"<40-character-release-commit>\"; $env:SKILL_RECORDER_COMMIT=$commit; irm \"https://raw.githubusercontent.com/microsoft/skill-recorder/$commit/install.ps1\" | iex\n\n\nAfter installation, grant Screen Recording permission on first launch (macOS). Then, you can start recording, analyzing, and creating skills. The first time you analyze, Skill Recorder will prompt you to sign in to Copilot if you haven't already.\n\n**Important Security Note**: Do not record, type, paste, or narrate passwords, tokens, API keys, or other confidential information. Choosing \"Analyze\" sends recording data to GitHub's cloud. Skill Recorder reminds you before every recording.\n\n## Examples\nThe process of creating a skill with Skill Recorder is straightforward:\n\n1.  **Record**: Start recording your task with a click or `??R` / `Ctrl+Shift+R`. Skill Recorder captures your screen and activity locally.\n2.  **Control**: A small, always-on-top bar allows you to manage the recording, including microphone state.\n3.  **Analyze**: Click \"Analyze,\" and GitHub Copilot reconstructs your actions into an overall intent and an ordered list of steps. You can review and edit this analysis.\n4.  **Create**: From an approved analysis, generate a reusable **Skill** (a `SKILL.md` procedure) and/or a scheduled **Automation**.\n\nSkill Recorder captures window tracking, browser URLs, screen video snapshots, short clipboard previews, and optional on-device narration transcription. All data remains local until you explicitly choose \"Analyze,\" at which point relevant event timelines, screen images, and narration text are sent to GitHub's cloud for Copilot processing.\n\n## Links\n*   [GitHub Repository](https://github.com/microsoft/skill-recorder){target=\"_blank\"}\n*   [Latest Release](https://github.com/microsoft/skill-recorder/releases/latest){target=\"_blank\"}\n*   [Report Issues](https://github.com/microsoft/skill-recorder/issues){target=\"_blank\"}\n*   [License (MIT)](https://github.com/microsoft/skill-recorder/blob/main/LICENSE){target=\"_blank\"}","metrics":{"detailViews":3,"githubClicks":0},"dates":{"published":null,"modified":"2026-09-11T15:58:06.000Z"}}