Troubleshooting Phoenix App Error with llamaindex 0.9.13 in Python

·Dec 28, 2023 07:46 PM

Hello- when trying to start my app with phoenix and llamaindex 0.9.13, Python 3.11, i get the error

🌍 To view the Phoenix app in your browser, visit http://127.0.0.1:6006/
📺 To view the Phoenix app in a notebook, run `px.active_session().view()`
📖 For more information on how to use Phoenix, check out https://docs.arize.com/phoenix
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/llama_index/callbacks/arize_phoenix_callback.py", line 9, in arize_phoenix_callback_handler
    from phoenix.trace.llama_index import OpenInferenceTraceCallbackHandler
  File "/usr/local/lib/python3.11/site-packages/phoenix/trace/llama_index/__init__.py", line 1, in <module>
    from .callback import OpenInferenceTraceCallbackHandler
  File "/usr/local/lib/python3.11/site-packages/phoenix/trace/llama_index/callback.py", line 40, in <module>
    from llama_index.llms.types import ChatMessage, ChatResponse
ModuleNotFoundError: No module named 'llama_index.llms.types'

Any ideas ?

File "/usr/local/lib/python3.11/site-packages/llama_index/core/base_query_engine.py", line 30, in query return self._query(str_or_query_bundle) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/query_engine/retriever_query_engine.py", line 171, in _query response = self._response_synthesizer.synthesize( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/response_synthesizers/base.py", line 146, in synthesize response_str = self.get_response( ^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/response_synthesizers/compact_and_refine.py", line 38, in get_response return super().get_response( ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/response_synthesizers/refine.py", line 146, in get_response response = self._give_response_single( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/response_synthesizers/refine.py", line 202, in _give_response_single program( File "/usr/local/lib/python3.11/site-packages/llama_index/response_synthesizers/refine.py", line 64, in __call__ answer = self._llm.predict( ^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/llms/llm.py", line 223, in predict formatted_prompt = self._get_prompt(prompt, **prompt_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/llms/llm.py", line 160, in _get_prompt return self._extend_prompt(formatted_prompt) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/llama_index/llms/llm.py", line 300, in _extend_prompt extended_prompt = self.system_prompt + "\n\n" + extended_prompt ~~~~~~~~~~~~~~~~~~~^~~~~~~~ TypeError: unsupported operand type(s) for +: 'PromptTemplate' and 'str'

-Args: (<phoenix.trace.llama_index.callback.OpenInferenceTraceCallbackHandler object at 0x1a2b96c10>,) -Kwargs: {'trace_id': 'query', 'trace_map': defaultdict(<class 'list'>, {'root': ['d5b5ac5d-7fb1-4006-981a-3d6a92d43f73'], 'd5b5ac5d-7fb1-4006-981a-3d6a92d43f73': ['bd3f3f66-e3b4-4590-989f-21d8d00869ee', '3daea8da-a633-4ffc-8e61-1c118339c7e5', 'ff544791-b065-4a39-928f-aa4e08313c8b'], 'bd3f3f66-e3b4-4590-989f-21d8d00869ee': ['b85d07c0-d67e-4df3-baa2-57ca31ade5ba'], 'ff544791-b065-4a39-928f-aa4e08313c8b': ['a5de74bf-7680-430a-a5c7-2b1d101982ca', 'f960d20f-a947-430c-98cf-83fa7bbae15d']})} -Exception type: AssertionError -Exception message: Expected code to be unreachable, but got: 0.025721002 ************************************************** Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/phoenix/utilities/error_handling.py", line 34, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/phoenix/trace/llama_index/callback.py", line 344, in end_trace _add_spans_to_tracer( File "/usr/local/lib/python3.11/site-packages/phoenix/trace/llama_index/callback.py", line 414, in _add_spans_to_tracer span = tracer.create_span( ^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/phoenix/trace/tracer.py", line 107, in create_span self._exporter.export(span) File "/usr/local/lib/python3.11/site-packages/phoenix/trace/exporter.py", line 77, in export self._queue.put(encode(item)) ^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/phoenix/trace/otel.py", line 309, in encode return otlp.Span( ^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/phoenix/trace/otel.py", line 387, in _encode_attributes yield KeyValue(key=key, value=_encode_value(value)) ^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/phoenix/trace/otel.py", line 403, in _encode_value assert_never(value) File "/usr/local/Cellar/python@3.11/3.11.6_1/Frameworks/Python.framework/Versions/3.11/lib/python3.11/typing.py", line 2506, in assert_never raise AssertionError(f"Expected code to be unreachable, but got: {value}") AssertionError: Expected code to be unreachable, but got: 0.025721002

28 comments