Back

Arnav Aggarwal

Love to Code | React... • 10m

Hit an unexpected 'rate limit' message while creating Studio Ghibli-style images on ChatGPT? You weren't alone.This is a great example of API traffic management techniques like Rate Limiting and Throttling. ➡️Rate Limiting - Sets a hard cap; requests are blocked 🚫 once the limit is reached until the timer resets – like being locked out after too many wrong password attempts. - Prevents abuse, ensures fair usage, and protects servers from overload. ➡️Throttling - Queues or delays excess requests ⏳, processing them at a controlled pace. Queued requests may eventually be rejected if delayed too long. Example: Rate Limiting is like riding 5 rollercoasters max 🎢, while Throttling slows the queue by pacing rides. OpenAI used both to prevent GPU overload and ensure availability. Why use these? ✅Prevent DDoS attacks ✅Avoid server crashes ✅Ensure responsiveness for all users

1 Reply
2
11
Replies (1)

More like this

Recommendations from Medial

Karan Jot Singh

Jack of all trades, ... • 2m

Day 11 of becoming System Design Pro Still wrapping my head around rate limiting Is it a scaling issue? Algorithmic? Max-thread problem? When we already have vertical scaling, load balancing, consistent hashing.. why rate limit at all? #LearnInPu

See More
Reply
4

suraj sharma

Hey I am on Medial • 1y

Developed a backend of blogging application using Express js ,Node and MongoDB, allowing users to register, login, share blogs, and follow others. Implemented secure authentication with Session bases auth and bcrypt for hashing password, ensuring use

See More
Reply

Vansh Khandelwal

Full Stack Web Devel... • 7d

Reactive systems prioritize responsiveness, resilience and elasticity; a core challenge is back-pressure—controlling data flow so producers don’t overwhelm slower consumers. Techniques include buffering to smooth bursts, rate-limiting producers, prio

See More
Reply
1

Harshit tiwari

Be optimistic • 9m

When I started freelancing, I thought success was simple: Send 100 Connection requests, & boom Clients would come flying in And I got a reality check in a month. Out of 100 requests, only 10 accepted, Out of 10, only 5 started conversation while C

See More
Reply
5

Vansh Khandelwal

Full Stack Web Devel... • 6m

In the rapidly evolving digital landscape, APIs (Application Programming Interfaces) serve as essential connectors among software applications, enabling seamless communication between systems. However, their accessibility also makes them prime target

See More
Reply
3
Image Description
Image Description

Swamy Gadila

Founder of Friday AI • 6m

🚀 Should India Start Charging Fees for High-Value UPI Transactions? UPI is a world-class digital payments system — fast, free, and inclusive. But there's a hidden cost: 💸 Infra cost of ₹0.10–₹0.30 per transaction 🏦 Over ₹1,000 crore/month just t

See More
7 Replies
6
18

Rahul Agarwal

Founder | Agentic AI... • 4m

Fine-tune vs Prompt vs Context Engineering. Simple step-by-step breakdown for each approach. 𝗙𝗶𝗻𝗲-𝗧𝘂𝗻𝗶𝗻𝗴 (𝗠𝗼𝗱𝗲𝗹-𝗟𝗲𝘃𝗲𝗹 𝗖𝘂𝘀𝘁𝗼𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻) 𝗙𝗹𝗼𝘄: 1. Collect Data → Gather domain-specific info (e.g., legal docs). 2. Sta

See More
Reply
2
13
Image Description

Rahul Agarwal

Founder | Agentic AI... • 2m

4 different ways of training LLM's. I've given a simple detailed explanation below. 1.) 𝗔𝗰𝗰𝘂𝗿𝗮𝘁𝗲 𝗗𝗮𝘁𝗮 𝗖𝘂𝗿𝗮𝘁𝗶𝗼𝗻 (𝘀𝘁𝗲𝗽-𝗯𝘆-𝘀𝘁𝗲𝗽) Prepares clean, consistent, and useful data so the model learns effectively. 1. Collect text

See More
Reply
1
9
1

Rahul Agarwal

Founder | Agentic AI... • 3d

Most people skip guardrails, their AI systems break. I’ve explained in a very simple way below. 1. 𝗜𝗻𝗽𝘂𝘁 & 𝗢𝘂𝘁𝗽𝘂𝘁 𝗚𝘂𝗮𝗿𝗱𝗿𝗮𝗶𝗹𝘀 This is the 𝗲𝗻𝘁𝗿𝘆 𝗮𝗻𝗱 𝗲𝘅𝗶𝘁 𝗰𝗵𝗲𝗰𝗸 of the system. • User input is checked for safety •

See More
Reply
1
3
Image Description
Image Description

Aditya Arora

 • 

Faad Network • 1y

It was great speaking at the Brand Capital, India (part of Benett Coleman & Co Limited (Times Goup)) town hall yesterday morning. 🙌 I spoke about the growing Direct to Consumer (D2C) ecosystem in India, and teams from all over India joined. My top

See More
5 Replies
5
18

Download the medial app to read full posts, comements and news.