Figuring out general specs for running LLM models – Deep-learning
The Problem: I have a machine learning model with a certain number of parameters. How … Read more
ChromaDB limit queries by metadata – Chromadb
Quick Fix: Use the where clause when querying to limit results based on metadata. results … Read more
llama_index with LLM doing out of context answering – Llama-index
The Problem: You are using llama_index with a custom LLM, the Open Assistant Pythia model, … Read more
Llama-2 7B-hf repeats context of question directly from input prompt, cuts off with newlines – Python
The Solutions: Solution 1: Use a model with instruction tuning and logits processor To resolve … Read more
llama index vectorstore querying with specific filtering – Python
The Problem: Given a Chroma Vector Store with files belonging to different users, devise a … Read more
[Solved] LangChain: Querying a document and getting structured output using Pydantic with ChatGPT not working well – Langchain
Quick Fix: To resolve the issue with ChatGPT via Pydantic, employ a try/except block, delete … Read more
How to use LangChain to load the index generated by LlamaIndex and perform a query? – Langchain
Quick Fix: To load the index using LangChain and perform a query, you can use … Read more
[Solved] How do GPT-style LLMs produce embeddings? – Large-language-model
Quick Fix: To obtain embeddings using GPT-like LLMs, utilize a transformer encoder model rather than … Read more
[Fixed] ImportError: cannot import name 'CustomLLM' from 'llama_index.llms' – Python
Quick Fix: Change from llama_index.llms import CustomLLM, CompletionResponse, LLMMetadata To this from llama_index.llms.custom import CustomLLM … Read more
Differences between Langchain & LlamaIndex – Langchain
Quick Fix: Both LangChain and LlamaIndex can be used with large language models, but LangChain … Read more
Retrieving the page number from the document in question-answering task [LangChain] – Langchain
Quick Fix: The provided code can be enhanced to extract the page number from the … Read more
Difference between Instruction Tuning vs Non Instruction Tuning Large Language Models – Language-model
Quick Fix: Instruction tuning is a specialized form of fine-tuning where the model is optimized … Read more
Get source_documents and score with ConversationalRetrievalChain, Stuff and Chailit UI – Python
Quick Fix: To retrieve source_documents and score from ConversationalRetrievalChain, ensure you provide return_source_documents as True … Read more
[Fixed] Alpaca LoRA generate TypeError: LoraConfig.__init__() got an unexpected keyword argument 'enable_lora' – Alpaca
Quick Fix: Upgrade the peft package using pip install –upgrade peft. This should resolve the … Read more
[Fixed] Getting an error when trying to use ChromaDB – Chromadb
Quick Fix: The error might be due to embeddings variable. Verify the parameters of LlamaCppEmbeddings … Read more