[go: up one dir, main page]

Skip to content

CodeFromAnywhere/openapi-chat-completion

Repository files navigation

OpenAPI Chat Completion

Turns every OpenAPI into a /chat/completions endpoint, that in itself is exposed as OpenAPI as well.

This is the successor of Agent-Openapi. The biggest difference is it's fully stateless!

Getting started

See https://chat.actionschema.com

Why?

LLM Assistants can be incredibly powerful as a single tool, but there's no easy way to turn an agent into a tool for another agent.

The Agent OpenAPI serves an OpenAPI for talking to an agent, so it can be discovered publicly, and can be used as a tool for other agents.

Orchestration Agent

With the above tooling, we can now create an agent that orchestrates certain taks to downstream agents. Taking response time limitations out of the equation, this "agent stacking" pattern can be done in a deeply nested way.

Goals

  • Easy access to agents
  • API access to your agents
  • Provide an openapi, and details for each agent
  • Provide message api that executes the tools
  • High degree of modularity
  • Remove need for adding an agent; as long as you provide the openapi, the agent should be made available with some default instructions.

Non-goals

  • Testing agents
  • Support for propriatary features like openai image generation, code-interpreter or file-search

Decisions/questions

  • Can I make this embeddable using a little circle turning into a sidebar? That would be a very nice add-on
  • Do access token check on frontend as well as on backend? Can be useful UX wise.
  • Shall I allow for additional tools (that aren't executed, but live alongside it)? For now, respond with 'tools need to be supplied over OpenAPI'.
  • How do I make sure this thing keeps being a top priority? This seems like a great great value-add
  • Description, image, and conversation starters are helpful things to add to the ux. Not sure if we want this though, as it is more oriented for humans, and the prompt + openapi kind of gives enough info.

About

OpenAPI for chat completion

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published