b60887c71d
Unlike the LMStudio one it also features an API key and proper model auto suggestion
1.8 KiB
| layout | title | nav_order | parent |
|---|---|---|---|
| default | AI features | 6 | Usage |
AI features
Part-DB can utilize large language Models (LLMs) to provide AI-powered features that can assist you in managing your parts and projects. For now this is mostly the ability to extract part information from websites without any structured data.
AI platforms
Part-DB is platform agnostic and can work with different AI platforms, both locally and in the cloud. They can be configured in the "AI" tab in the system settings. Currently, the following platforms are supported:
OpenRouter
OpenRouter is a platform that provides access to various LLMs, including models from OpenAI, Anthropic, and more. You can use OpenRouter to connect to different LLMs and use them for Part-DB's AI features. You need to supply an API key for OpenRouter to use it as an AI platform in Part-DB.
LMStudio
LMStudio is a local LLM hosting solution that allows you to run LLMs on your own hardware. You can use LMStudio to host your own LLM and connect it to Part-DB for AI features. Currently only LMStudio without any authentication is supported. Supply your LMStudio instance URL (including the port) to use it as an AI platform in Part-DB. You have to set a model by hand, as suggestions currently do not work yet. Ensure the context length is suitable for your application.
Ollama
Ollama is another local LLM hosting solution that allows you to run LLMs on your own hardware. You can use Ollama to host your own LLM and connect it to Part-DB for AI features. Supply your Ollama instance URL (including the port) and an optional API key for authentication to use it as an AI platform in Part-DB. The model selector should give you suggestions about available models. Ensure the context length is suitable for your application.