Computer use is getting hot — but we @OthersideAI were doing it well before it was cool.
Josh wrote up a nice post with his reflections from building Self-Operating Computer, the first open-source framework for full OS-level self-driving.
Definitely worth a read.
A year ago, I created the Self-Operating Computer Framework—
the first framework to enable multimodal models to operate computers with keyboard and mouse.
This week I wrote a blog post with the story behind the project, reflections on the past year, and thoughts on the future.
Tired of AI that sounds like... well, AI?
Never 'delve' again, with Personas for @HyperWriteAI.
Teach your AI to write exactly like you.
Seamlessly switch between our pre-made personas, or mold your AI's tone and behavior to your unique needs.
Excited to share the Agent Trainer and Agent Studio - coming soon to the @HyperWriteAI platform.
Teaching Agents to work the way you like is difficult. So we built a simple way for your Assistant to shadow you and learn.
Just show it a task once, and the AI can repeat it.
Today, we are open-sourcing the @HyperWriteAI Self-Operating Computer framework.
It works pretty well with GPT-4-Vision, but just wait till you see what will be possible with our upcoming Agent-1-Vision model integration :)
𝗪𝗲 𝗮𝗿𝗲 𝗲𝘅𝗰𝗶𝘁𝗲𝗱 𝘁𝗼 𝗼𝗽𝗲𝗻-𝘀𝗼𝘂𝗿𝗰𝗲 𝘁𝗵𝗲 𝗦𝗲𝗹𝗳-𝗢𝗽𝗲𝗿𝗮𝘁𝗶𝗻𝗴 𝗖𝗼𝗺𝗽𝘂𝘁𝗲𝗿 𝗙𝗿𝗮𝗺𝗲𝘄𝗼𝗿𝗸 𝘁𝗵𝗮𝘁 𝗲𝗻𝗮𝗯𝗹𝗲𝘀 𝗺𝘂𝗹𝘁𝗶𝗺𝗼𝗱𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀, 𝗶𝗻𝗰𝗹𝘂𝗱𝗶𝗻𝗴 𝗚𝗣𝗧-𝟰-𝗩𝗶𝘀𝗶𝗼𝗻 𝘁𝗼 𝘀𝗶𝗺𝘂𝗹𝗮𝘁𝗲 𝗵𝘂𝗺𝗮𝗻-𝗹𝗶𝗸𝗲 𝗺𝗼𝘂𝘀𝗲 𝗰𝗹𝗶𝗰𝗸𝘀 𝗮𝗻𝗱 𝗸𝗲𝘆𝗯𝗼𝗮𝗿𝗱 𝗶𝗻𝗽𝘂𝘁𝘀 𝗼𝗻 𝗮 𝗰𝗼𝗺𝗽𝘂𝘁𝗲𝗿.
Based on a given objective, the model estimates the correct X & Y locations for mouse clicks and the appropriate keyboard inputs at each step.
A vision-based agent working at the OS level allows for maximum context and adaptability.
The framework is designed to work with any vision-text multimodal model to evaluate its ability to operate a computer. While significant improvements are needed to achieve human-level performance, this code repository serves as a plugin framework.
We are also excited to announce we’ll be integrating our `𝗔𝗴𝗲𝗻𝘁-𝟭` model with the framework in the coming weeks.
Help us build the future of agents in public.
𝗚𝗶𝘁𝗵𝘂𝗯: github.com/OthersideAI/se…
𝗛𝗲𝗿𝗲'𝘀 𝗚𝗣𝗧-𝟰-𝗩𝗶𝘀𝗶𝗼𝗻 𝘄𝗿𝗶𝘁𝗶𝗻𝗴 𝗮 𝗽𝗼𝗲𝗺 𝗶𝗻 𝗚𝗼𝗼𝗴𝗹𝗲 𝗗𝗼𝗰𝘀:
Introducing the world's most powerful AI Assistant.
Personal Assistant is NOT just another AI chatbot.
It can:
- Operate your browser to actually complete tasks
- Cite sources, so you can trust what it says
- And so much more.
You won't believe what Personal Assistant can do:
Personal Assistant by @HyperWriteAI is now live on Product Hunt!
The first publicly available AI agent that can operate a browser like a human.
An upvote or share would mean a lot to me :)
producthunt.com/posts/personal…
Introducing `Agent-1`: a breakthrough foundation model that can operate software like a human.
This is the brain powering Personal Assistant.
We’re already well above previous state-of-the-art, and we’re improving massively each week.
More details:
Today, we’re unveiling Personal Assistant - @HyperWriteAI's groundbreaking AI agent that can use a web browser like a human.
One agent to rule them all.
It’s time to reimagine the way we interact with the internet.
I asked our web-surfing AI to solve Wordle.
The result is not what I was expecting, but shows how smart the system we’re building is.
It did what so many people do: it cheated and searched Google for the answer first 🤯
Today, we’re unveiling Personal Assistant - @HyperWriteAI's groundbreaking AI agent that can use a web browser like a human.
One agent to rule them all.
It’s time to reimagine the way we interact with the internet.
Exciting news! @HyperWriteAI now uses GPT-4!
Just hours after GPT-4's release, we have fully integrated it across our platform, bringing you insanely impressive results.
Honored to be featured in @WIRED's piece on how AI is transforming email!
The future of communication is here, and we're excited to be at the forefront of it.
And if you haven't yet tried @HyperWriteAI... chrome.google.com/webstore/detai…
Today, we’re unveiling Personal Assistant - @HyperWriteAI's groundbreaking AI agent that can use a web browser like a human.
One agent to rule them all.
It’s time to reimagine the way we interact with the internet.
So proud of our partnership with @CohereAI and the amazing work we've been able to do together.
Check out this interview with our co-founder @mattshumer_ to learn more about our collaboration and how we're thinking about generative AI.
I’m excited to share an interview I did with @CohereAI on our journey together and my thoughts on generative AI.
Cohere has been an amazing partner, and their low-latency solutions have helped us power the @HyperWriteAI Chrome extension.
Check it out!
txt.cohere.ai/hyperwrite-pow…
We're excited to announce the launch of Custom Templates for @HyperWriteAI!
Now, you can easily create your own AI templates, tailored to your specific needs.
Let's dive in...
Previously, I was an indie hacker.
Since joining @OthersideAI, I've greatly enjoyed seeing how much can be done when you are part of a talented team. I think the next 6 months are going to be exponential.
We're looking for a talented frontend engineer, reach out if interested!
104K Followers 2K Following#1 Most Followed Voice in AI Business (2M followers). Former Amazon, IBM. Time100 AI. Fortune 500 and startup AI advisor, public speaker. AI-First courses in 🔗
3K Followers 8K FollowingWe chose living over shallow connections and value experiences over possessions. We are retired and lifestyle idealists. Enjoying the view.
6 Followers 109 FollowingAirabbit is a AI Agent that manages your entire influencer lifecycle. Discover, negotiate, and deliver campaigns with zero risk and 10x efficiency.
303 Followers 2K FollowingPolítica no Brasil, sem isenção. Análise crítica da conjuntura política, STF e defesa da liberdade. Direita conservadora. Legado de Olavo de Carvalho.
6 Followers 56 FollowingBuilding AI-powered business systems.
Creating impactful music
CEO @ Icr8tiv Digital Solutions
Daily AI insights for business & creative growth
886 Followers 6K FollowingMarried to a wonderful dancer. Works at @WesCFA. Studied at @NYUSPS '24/@wesleyan_u '19/@SU_VPA '99. Fan and seeing shows of @phish since ’95/@U2 since ’92.
14K Followers 5 FollowingYour AI Personal Assistant — writing and productivity tools + ai agents // building self-driving mode for your computer | by @OthersideAI