Back

Tirush V

Infrastructure/AI en... • 1y

Not fine tuning or pre training. It’s the way of changing pre processing step. What we do now is chunk the data, create embedding then store them in vector db and query it and feed it to llm for response. This has more error prone due to complex documents, like tables, graph elements etc to solve this chunking Doesn’t make as it misses the content by breaking the text of each document text. So changing this with other approach solves the accrueacy in retrieval.

2 Replies
Replies (2)

More like this

Recommendations from Medial

Image Description

Chirotpal Das

Building an AI eco-s... • 9m

Which is the fastest vector db for production in terms of vector similarity search and retrieval?

2 Replies
10
Image Description
Image Description

Sunil Huvanna

Building AI Applicat... • 1y

LLM Capabilities, t2i generation via inference and resonance inside vector DB of the model is what makes images as this possible. Via : Midjourney

6 Replies
1
13

Sanskar

Keen Learner and Exp... • 3m

Day 13 of learning AI/ML as a beginner. Topic: Word Embedding. I have discussed about one hot encoding, Bag of words and TF-IDF in my recent posts. These are the count or frequency tools that are a part of word embedding but before moving forward l

See More
Reply
3
Image Description

Sarthak Pandey

Wake UP V. I. O. N. ... • 25d

🚀 Hiring for V.I.O.N.A. Project — 2 Critical Roles Open 1️⃣ LLM Engineer / AI Systems Developer Looking for someone strong in: Python REST API development Vector Databases (Pinecone / Weaviate / Chroma etc.) Prompt Engineering Token Optimizati

See More
2 Replies
1
8
Image Description
Image Description

Chirotpal Das

Building an AI eco-s... • 9m

I'm working towards building India's first Vector DB and Memory Management System. I'm not yet funded by any VC - bootstrapping everything with a very small team. I need the support of the community to take India's deep-tech products to the Global s

See More
8 Replies
11

Trideb Dey

Exploring • 6m

All are concerned about product development, but none about product sales. In Western Market the founders works on pre sales just by creating a video render of the product and test the product-market-fit. Anyone who knows about pre sales text me.

Reply
3

Saswata Kumar Dash

Buidling FedUp| AI R... • 6m

🚨 Everyone says "RAG is dead" — but I say: It’s just been badly implemented. I’ve worked on AI systems where Retrieval-Augmented Generation (RAG) either changed the game… or completely flopped. Here’s the hard truth 👇 --- 🤯 Most teams mess up

See More
Reply
5
Image Description
Image Description

Ankush

Anku • 8m

other startups face problems like not getting vc not getting funding pre seed and I'm facing problems like not getting full stack developer who can do react frontend backend database server all these things if I find frontend developer then didn't ge

See More
13 Replies
13
Image Description
Image Description

Rahul Agarwal

Founder | Agentic AI... • 7h

Most people don't even know these basics of RAG. I've explained it in a simple way below. 1. 𝗜𝗻𝗱𝗲𝘅𝗶𝗻𝗴 Convert documents into a format that AI can quickly search later. Step-by-step: • 𝗗𝗼𝗰𝘂𝗺𝗲𝗻𝘁: You start with files like PDFs, Word

See More
2 Replies
14
29
4
Image Description

Comet

#freelancer • 1y

Text Generation What It Is: Text generation involves using AI models to create humanlike text based on input prompts. How It Works: Models like GPT-3 use Transformer architectures. They’re pre-trained on vast text datasets to learn grammar, conte

See More
1 Reply
4

Download the medial app to read full posts, comements and news.