Skip to content

Commit bd05d18

Browse files
authored
Add macos keep eyes open (#15)
* Feat: Add macos agent : keep eyes open
1 parent 3099967 commit bd05d18

14 files changed

+2298
-201
lines changed

.env.example

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
# LiveKit Configuration
2+
LIVEKIT_API_KEY=your_livekit_api_key
3+
LIVEKIT_API_SECRET=your_livekit_api_secret
4+
LIVEKIT_URL=wss://your-livekit-instance.livekit.cloud
5+
6+
# OpenAI API Configuration
7+
OPENAI_API_KEY=your_openai_api_key
8+
9+
# Optional Configuration
10+
# DATA_CHANNEL_TOPIC=macos-remote-control
11+
# TOKEN_DIR=~/mcp_tokens

README.md

Lines changed: 11 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -144,22 +144,22 @@ The server provides Remote MacOs functionality through MCP tools.
144144
The server provides the following tools for remote macOS control:
145145

146146
#### remote_macos_get_screen
147-
Connect to a remote macOS machine and get a screenshot of the remote desktop. Uses environment variables for connection details.
147+
Connect to a remote macOS machine and get a screenshot of the remote desktop.
148148

149149
#### remote_macos_send_keys
150-
Send keyboard input to a remote macOS machine. Uses environment variables for connection details.
150+
Send keyboard input to a remote macOS machine.
151151

152152
#### remote_macos_mouse_move
153-
Move the mouse cursor to specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
153+
Move the mouse cursor to specified coordinates on a remote macOS machine, with automatic coordinate scaling.
154154

155155
#### remote_macos_mouse_click
156-
Perform a mouse click at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
156+
Perform a mouse click at specified coordinates on a remote macOS machine, with automatic coordinate scaling.
157157

158158
#### remote_macos_mouse_double_click
159-
Perform a mouse double-click at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
159+
Perform a mouse double-click at specified coordinates on a remote macOS machine, with automatic coordinate scaling.
160160

161161
#### remote_macos_mouse_scroll
162-
Perform a mouse scroll at specified coordinates on a remote macOS machine, with automatic coordinate scaling. Uses environment variables for connection details.
162+
Perform a mouse scroll at specified coordinates on a remote macOS machine, with automatic coordinate scaling.
163163

164164
#### remote_macos_open_application
165165
Opens/activates an application and returns its PID for further interactions.
@@ -193,6 +193,10 @@ Here's the information converted to a markdown table:
193193

194194
Always use secure, authenticated connections when accessing remote remote MacOs machines. This tool should only be used with servers you trust and have permission to access.
195195

196+
# MacOs Agent Client
197+
198+
A lightweight agent that connects to LiveKit rooms for remote macOS control. Features our proprietary "keep_eyes_open" system that significantly enhances responsiveness and performance by maintaining continuous environment awareness without polling overhead. This allows for near real-time command execution and feedback through efficient bi-directional data channels.
199+
196200
## License
197201

198-
See the LICENSE file for details.
202+
[MIT](LICENSE)

requirements.txt

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
1+
livekit-agents>=1.0.0
2+
livekit>=1.0.0
3+
python-dotenv>=1.0.0
4+
asyncio>=3.4.3
5+
aiohttp>=3.8.4
6+
paramiko>=2.11.0

0 commit comments

Comments
 (0)