A private LLM proof of concept with Llama2 and ChromaDB within Docker
£20-250 GBP
Paid on delivery
I am looking for a freelancer to help me with a private LLM proof of concept project. The purpose of this project is to demonstrate the capabilities of Llama2 and ChromaDB.
The task I required is a proof of concept on how to work with Llama2, ChromaDB, and HuggingFace using a Docker structure. It must cover the following:
- implement both Llama2 and ChromaDB in a Docker structure using docker compose V2.
- streamline the setup for all containers to be used in the LLM
- an offline and private way of querying the documents ingested into ChromaDB
- OpenAI should NOT be used since this PoC requires that there be no public access to the documents, contexts, and embeddings.
Deliverables:
- a [login to view URL] file with all required containers and their configuration
- dockerfiles that will contain all the container configs that need to be started/initialized accordingly
- a [login to view URL] Python script that is triggered only once and downloads all necessary libraries, files, and structures like the HuggingFace 70B LLM
- a [login to view URL] Python script that when run, ingests all documents in a target folder to ChromaDB and persists the vector structure for it
- a [login to view URL] Python script that when run OFFLINE, interfaces with ChromaDB and the Llama2 LLM and asks it an example question about the documents ingested.
If you have experience in Llama2 and ChromaDB and can showcase their capabilities through a user-friendly interface, please reach out.
Project ID: #37249427
About the project
19 freelancers are bidding on average £174 for this job
Chi SquareX provide services in the domain of Machine Learning, AI, Deep Learning, Computer Vision, Natural Language Processing, Algo Trading. Expertise: Training Machine learning, Deep Learning, Reinforcement Learning More
Hi, I get what you're looking for and I completely understand your needs with over Five years of experience in Python and web frameworks, specifically Django, Flask, Docker, and AWS services. I have gained valuable exp More
I am a data scientist and a python developer, I have around 5 years of data analysis and Machine Learning/Deep Learning experience encompassing computer vision, NLP and Time series, I also have a MS degree in data scie More
Hi, I have experience with open-source Commercially licensed LLMs models with Huggingface. I am not sure if you are planning to use Llama2 for domain specific document then it will require license (for PoC you can use More
I understand that you are looking for someone to help you with a private LLM proof of concept project and I believe I am the perfect fit for the job.I have experience in computer engineering, machine learning, deep lea More
Hi, I had used earlier llama 1 it is developed by Meta, I can do a POC on llama2 with ChromaDB on Docker yaml I will not use OpenAI, I'll deliver three files firstRun, Question and Consume in Python with docker file More
Hey, How are you? I have 5+ years of working experience doing IT jobs. I am full stack developer have a strong working experience of every framework specially Artificial Intelligence and Python. Please start chat, So w More
Hi there, I am a Machine learning engineer and I have worked and developed a lot of applications using llama-2 70b and have also built a RAG systems and your requirements seems similar to that, so I am the right guy fo More
Similar work I did few days back with different llm, Let me give a try if you are ok with. I am exper data engineer with ML/LLM so i can do development and deployment both. Thanks
