Adept is developing an AI system, ACT-1, that interprets natural language commands and executes actions on various software tools, APIs, and websites. The company aims to create a general intelligence model that can collaborate with users to accomplish tasks efficiently.

Adept

Adept is an ML research and product lab building general intelligence by enabling humans and computers to work together creatively.

Addition

Root Ventures

Greylock

Andrej Karpathy

Chris Re

Howie Liu

Sarah Meyohas

Scott Belsky

Workday Ventures

Atlassian Ventures

General Catalyst

A.Capital Ventures

Microsoft

Frontiers Capital

NVIDIA

PSP Growth

Introducing Fuyu-Heavy, our newest multimodal model. Fuyu-Heavy is the world’s third-most-capable multimodal model, behind only GPT4-V and Gemini Ultra, which are 10-20 times larger. In particular, it outperforms Gemini Pro at both MMLU and MMMU.

Training Fuyu-Heavy wasn’t easy - in addition to the standard hiccups with model scaling, we had to deal with the extra problems associated with training a new architecture on both text and image data.
Here’s a blog post if you want all the details: https://lnkd.in/gHeUbqRn

We’re working on further scaling up these models and building useful software agents around them - if that sounds exciting to you, please reach out at https://lnkd.in/eT2MhX_f

Today we’re opening access to Adept Experiments 🧪, a new way to explore the technology we are developing at Adept. Each experiment is a self-contained mini-tool or demo that showcases a part of our underlying tech. Read more here: https://lnkd.in/erg2jH5B

The first Experiment we're rolling out is Workflows ⚡️

A foundational skill for an AI teammate is to 1) quickly learn a task from a user and 2) reliably run it. Workflows are designed around this philosophy. So... what can workflows do?

Workflows can do repetitive tasks, turn unstructured data into structured data, trivially hop between tools, or even teach a novice user to navigate the tool like an expert. The example video is a workflow that can turn unstructured data into structured data— Adept opens attached invoices, extracts information, and moves it into accounts payable software.

Workflows is powered by ACT-2, a multimodal model fine-tuned from the Fuyu family and optimized for UI understanding, knowledge worker data comprehension, and action taking. Because Workflows is an Experiment, it often requires some careful prompting to make it do what you want. Some sites work better than others. Stay tuned for more Experiments and research updates as we continue to iterate.

Get on the waitlist at https://lnkd.in/e7kThAAH. We're onboarding folks on a rolling basis. Excited to see what you build! 🚀

We’re open-sourcing a multimodal model: Fuyu-8B! Building useful AI agents requires fast foundation models that can see the visual world.

Fuyu-8B performs well at standard image understanding benchmarks, but it also can do a bunch of new stuff. We think MM models are especially useful for handling unstructured knowledge worker data, so we’ve given Fuyu-8B capabilities in:
- Understanding diagrams, charts, and graphs
- Doing OCR on screens
- Outputting bounding boxes for the locations of objects on screens
- Answering UI-based questions

It actually has an extremely simple architecture. Fuyu-8B doesn’t have an image encoder. This allows easy interleaving of text and images and handling arbitrary image resolutions! And it’s super fast for copilot use cases where latency really matters.

Weights are here https://lnkd.in/ehBWiMRF, and you can also try a demo https://lnkd.in/eN-cXHwE. We can’t wait to see what you build on top of it!

Read more on our blog: https://lnkd.in/eSCJhDHe

We've raised $350M in new funding as part of our Series B led by General Catalyst and co-led by Spark Capital. 

We’re also excited to partner with Atlassian Ventures, Microsoft, NVIDIA, Workday Ventures, Caterina Fake, Frontiers Capital, PSP Growth, SV Angel and A_Capital, and others, with additional participation from our existing investors, Greylock and Addition.

At Adept, we’re building an entirely new way for you to get things done on your computer. You can think of Adept as an “AI teammate” that can supercharge your abilities on any website or software tool. Less time spent on manual, multi-step processes. More time solving the problems that matter most to you.

We’d love to work with you at Adept! Check out https://adept.ai/careers for openings across across software engineering, machine learning, product design, and human-computer interface analyst (non-technical) roles.

More from Forbes on our Series B below:
https://lnkd.in/gshuPHdb
#generativeAI #AI #hiring #llm #machinelearning #openings #softwareengineering #funding


AI:ADEPT

Adept