Back

Sanskar

Keen Learner and Exp... • 3m

Day 7 of learning AI/ML as a beginner. Topic: One Hot Encoding and Future roadmap. Now that I have learnt how to clean up the text input a little its time for converting that data into vectors (I am so glad that I have learned it despite getting criticism on my approach). There are various processes to convert this data into useful vectors: 1. One hot encoding 2. Bag of words (BOW) 3. TF - IDF 4. Word2vec 5. AvgWord2vec These are some of the ways we can do so. Today lets talk about One hot encoding. This process is pretty much outdated and is rarely used in real word scenarios however it is important to know why we don't use this and why are there different ways? One hot encoding is a technique used for converting a variable into a binary vector. Its advantage is that it is easy to use in python via scitkit learn and pandas library. Its disadvantages however includes. sparse matrix which can lead to overfitting(when a model performs well on the data its been trained and performs poorly with new one). Then it require only fixed sized input in order to get trained. One hot encoding does not capture sematic meaning. And what about a word being out of the vocabulary. Then it is also not practical to use in real world scenarios as it is not much scalable and may lead to problems in future. I have also attached my notes here explaining all these in much details.

Reply
2

More like this

Recommendations from Medial

Image Description
Image Description

Pranav Nirmal on Hiatus

CA Intermediate | Mc... • 1y

I trained myself to drink black coffee without sugar, let it be cold or hot.. Shuru majboori mai kiye the ab maza Ara hai....

7 Replies
6

Sanskar

Keen Learner and Exp... • 3m

Day 11 of learning AI/ML as a beginner. Topic: TF-IDF (Term Frequency - Inverse Document Frequency). Yesterday I have talked about N-grams and how they are useful in Bag of Words (BOW) however it has some serious drawbacks and for that reason I am

See More
Reply
2
Image Description

Ayush Maurya

AI Pioneer • 1m

Google Antigravity is here : let's see how well it performs. Get it from here 👇 https://antigravity.google/product

Reply
6
1

Sanskar

Keen Learner and Exp... • 3m

Day 2 of learning mathematics for AI/ML as a no math person. Topic: vectors and matrices. We use NumPy python library for these. I got introduced to the concept of vectors and matrices. Vectors are like lists and are divided Vectors are divided in

See More
Reply

Sanskar

Keen Learner and Exp... • 3m

Day 2 of learning mathematics for AI/ML as a no math person. Topic: vectors and matrices. We use NumPy python library for these. I got introduced to the concept of vectors and matrices. Vectors are like lists and are divided Vectors are divided in

See More
Reply
1
Image Description

Mridul Das

Introvert! • 8m

Ola ⚡ rolls out its first Roadster X motorcycle—priced from ₹84,999, with deliveries starting April 2025. The top model offers 501 km/charge! .. let's see how it performs

1 Reply
1
12

Sanskar

Keen Learner and Exp... • 3m

Day 13 of learning AI/ML as a beginner. Topic: Word Embedding. I have discussed about one hot encoding, Bag of words and TF-IDF in my recent posts. These are the count or frequency tools that are a part of word embedding but before moving forward l

See More
Reply
3

Galaxynine

Hey I am on Medial • 1y

Thanks @ZeptoNow for its new feature Zepto Cafe making it easy to deliver food within 10min, and the food is meant to be consumed when it's hot. It would be nice if you add more food options like Dosa, Biriyani, and more. #zepto #zeptocafe #Instantfo

See More
Reply
2
7
Image Description
Image Description

Acevolt

ENGIPRENEUR's • 1y

Now a days Indian stock market performs a strange it's gave a approx 5.00 percent return in one month even most of the companies PE ratio is not good . What u think it is a bubble ? It's a best time to invest or exit the market ?

3 Replies
5

Ayush

 • 

Medial • 10m

one of the best articles that I read on deepseek and it's affect on the nvidia stock, it explains in details of how the models is trained and fine tuned to have such strong logical thinking.

Reply
9

Download the medial app to read full posts, comements and news.