Back

Chirotpal Das

Building an AI eco-s... • 9m

🤔 𝐎𝐩𝐞𝐧𝐀𝐈 𝐨𝟏 - 𝐢𝐬 𝐢𝐭 𝐦𝐨𝐫𝐞 𝐛𝐢𝐠𝐠𝐞𝐫 𝐨𝐫 𝐦𝐨𝐫𝐞 𝐟𝐢𝐧𝐞-𝐭𝐮𝐧𝐞𝐝? We're all excited about OpenAI's o1 model and many other such bigger models, but here's what keeps me up at night: Are we witnessing a genuinely larger, more advanced LLM, or is this the result of brilliant engineering and fine-tuning of existing architectures? 𝐓𝐡𝐞 𝐫𝐞𝐚𝐥 𝐪𝐮𝐞𝐬𝐭𝐢𝐨𝐧 𝐢𝐬: Can we, as users and developers, ever truly distinguish between a massive pre-trained model and an expertly fine-tuned one by ourselves? It's like trying to tell if a master chef created a new recipe or perfectly refined an existing one. The taste might be extraordinary either way. What do you think? 🧠

4 Replies

Replies (4)

The next billionaire

Unfiltered and real ... • 9m

It’s too much hype I think

1 Reply

Tanuj Sharma

Python Developer | A... • 9m

Hi, It is trained on more bigger dataset and with more gpu hours so its not fine tuned on earlier versions, its trained with more parameters than the earliest versions, if you have heard its training cost is around 50-100M $, while if you see thier latest offering o3, its training cost till now around 1-1.4B $, while training cost for chat gpt initial version was only around ~10M $, but as per the latest rumours if you heard they already have exhausted all available data on internet in training thier models till now, so future mai its going to be very hard for them to train their models on new data, then it would be mostly fine tuning on older versions with synthetic datasets.

Recommendations from Medial

Vishu Bheda
•

Medial • 6m

𝗣𝗮𝘂𝗹 𝗚𝗿𝗮𝗵𝗮𝗺 𝗼𝗻 𝗪𝗵𝘆 𝗪𝗲𝗮𝗹𝘁𝗵 𝗜𝘀𝗻’𝘁 𝗪𝗵𝗮𝘁 𝗬𝗼𝘂 𝗧𝗵𝗶𝗻𝗸 𝗜𝘁 𝗜𝘀 Most people think wealth is like a pie — if someone gets a bigger slice, there's less left for you. But that’s a lie. 𝐖𝐞𝐚𝐥𝐭𝐡 𝐢𝐬 𝐧𝐨𝐭 𝐦𝐨𝐧𝐞𝐲

3 Replies

Vishu Bheda
•

Medial • 7m

𝗠𝗼𝘀𝘁 𝗽𝗲𝗼𝗽𝗹𝗲 𝘁𝗮𝗹𝗸 𝗮𝗯𝗼𝘂𝘁 𝗭𝘂𝗰𝗸𝗲𝗿𝗯𝗲𝗿𝗴 𝗮𝗻𝗱 𝗕𝗲𝘇𝗼𝘀. But there’s another founder who’s playing a game at a whole different level. He builds 𝐀𝐈 𝐰𝐞𝐚𝐩𝐨𝐧𝐬, 𝐬𝐦𝐚𝐫𝐭 𝐝𝐫𝐨𝐧𝐞𝐬, 𝐚𝐧𝐝 𝐡𝐢𝐠𝐡-𝐭𝐞𝐜𝐡 𝐝𝐞𝐟𝐞