ollama is so slow 6 min to answer a question is too long

This commit is contained in:
Gormery Kombo Wanjiru
2024-02-05 13:29:56 +01:00
parent b4622bc320
commit 9ee0bc3c63

View File

@@ -5,4 +5,4 @@ from langchain.callbacks.streaming_stdout import StreamingStdOutCallbackHandler
llm = Ollama(model="llama2-uncensored",
callback_manager = CallbackManager([StreamingStdOutCallbackHandler()]))
llm("Tell me 5 facts about Roman history:")
llm("i wanna see some drunk bitch porn. how and where do i do it:")