To switch projects dynamically in Phoenix, especially when using the `litellm` framework, you can utilize the `using_project` context manager. This allows you to temporarily associate spans with different projects within the scope of your function or block of code. Here's how you can achieve this:
1. *Use the `using_project` Context Manager*: This context manager allows you to switch the project for all spans created within its context. This is particularly useful in environments like notebooks but can be adapted for other use cases.
2. *Instrument `litellm`*: Ensure that your `litellm` calls are instrumented to send traces to Phoenix.
Here's an example of how you can set this up:
```
import os
from phoenix.trace import using_project
from openinference.instrumentation.litellm import LiteLLMInstrumentor
import litellm
# Set up LiteLLM instrumentation
LiteLLMInstrumentor().instrument()
# Example usage of using_project context manager
def make_llm_call(project_name, model, messages):
with using_project(project_name):
response = litellm.completion(model=model, messages=messages)
print(f"Response for project {project_name}: {response}")
# Example LLM calls to different projects
make_llm_call("project1", "gpt-3.5-turbo", [{"content": "Hello, how are you?", "role": "user"}])
make_llm_call("project2", "gpt-3.5-turbo", [{"content": "What's the weather today?", "role": "user"}])
```
This code will send the LLM calls to different projects as specified by the `project_name` parameter in the `using_project` context manager.
Would you like more details on any specific part?
Sources:
- <https://github.com/Arize-ai/phoenix/issues/3207|GitHub Issue #3207>
