Plotly AI Managed Service

Not all customers are going to bring their own LLM provider to plotly - many customers download plotly studio will expect the product to come with AI providers natively. To support these users, we should enable a pathway for our AI features to work as a service for users, so that they don't need to bring their own keys to external providers to use plotly AI.

We can explore whether we service these requests through our own approach to provisioning keys to our default LLM provider, through a technology such as Openrouter, or by providing locally managed LLMs for these requests. The choice of which provider to use can vary based on the users subscription - we do not have to provide every user with the same option here, just the best quality LLM we can provide at a reasonable price point for the volume of requests they are likely to make and how much they are paying.

Please authenticate to join the conversation.

Upvoters
Status

In Review

Board

Plotly Cloud

Tags

AI

Date

About 1 year ago

Author

Louis Huard

Subscribe to post

Get notified by email when there are changes.