bionic gpt

bionic-gpt/bionic-gpt
1606
153
20
153
11
30
Apache-2.0
Chat Interfaces
BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
2023-07-07EDT 07:Jul:th-14400
2024-05-06EDT 16:May:th-14400
2024-04-30EDT 13:Apr:th-14400

BionicGPT

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality BionicGPT can run on your laptop or scale into the data center.



Alt text

Roadmap

  • [x] Text Generation
    • [x] Connect to Open AI compatible API's i.e. LocalAI
    • [x] Select different prompts
    • [x] Syntax highlighting for code
  • [ ] Image Generation
    • [ ] Connect to stable diffusion
  • [x] Authentication
    • [x] Email/Password sign in and registration
    • [x] SSO
  • [x] Teams
    • [x] Invite Team Members
    • [x] Manage the teams you belong to
    • [x] Create new teams
    • [x] Switch between teams
    • [x] RBAC
  • [x] Document Management
    • [x] Document Upload
    • [x] Allow user to create datasets
    • [x] UI for datasets table
    • [x] Turn documents into 1K batches and generate embeddings
    • [x] OCR for document upload
  • [x] Document Pipelines
    • [x] Allow user to upload docs via API to datasets
    • [x] Process documents and create chunks and embeddings
  • [x] Retrieval Augmented Generation
    • [x] Parse text out of documents
    • [x] Generate Embeddings and store in pgVector
    • [x] Add Embeddings to the prompt using similarity search
  • [x] Prompt Management
    • [x] Create and Edit prompts on a per team basis
    • [x] Associate prompts with datasets
  • [x] Model Management
    • [x] Create/update default prompt fo a model
    • [x] Set model location URL.
    • [x] Switchable LLM backends.
    • [ ] Associate models with a command i.e. /image
  • [ ] Guardrails
    • [ ] Figure out a strategy
  • [x] API
    • [x] Create per team API keys
    • [x] Attach keys to a prompt
    • [ ] Revoke keys
  • [ ] Fine Tuning
    • [ ] QLORA adapters
  • [x] System Admin
    • [x] Usage Statistics
    • [x] Audit Trail
    • [ ] Set API limits
  • [x] Deployment
    • [x] Docker compose so people can test quickly.
    • [x] Kubernetes deployment strategy.
    • [x] Kubernetes Operator
    • [ ] Hardware recommendations.

See the open issues for a full list of proposed features (and known issues).

Enterprise

For companies that need better security, user management and professional support

Talk to the founders

This covers:

  • Help with integrations
  • Feature Prioritization
  • Custom Integrations
  • LTS (Long Term Support) Versions
  • Professional Support
  • Custom SLAs
  • Secure access with Single Sign-On
  • Continuous Batching
  • Data Pipelines

Support / talk with founders

Try it out

follow our guide to running Bionic-GPT on your local machine.

Kubernetes Ready

BionicGPT is optimized to run on Kubernetes and implements the full pipeline of LLM fine tuning from data acquisition to user interface.

Alt text