Back

Arnav Aggarwal

Love to Code | React... • 11m

Hit an unexpected 'rate limit' message while creating Studio Ghibli-style images on ChatGPT? You weren't alone.This is a great example of API traffic management techniques like Rate Limiting and Throttling. ➡️Rate Limiting - Sets a hard cap; requests are blocked 🚫 once the limit is reached until the timer resets – like being locked out after too many wrong password attempts. - Prevents abuse, ensures fair usage, and protects servers from overload. ➡️Throttling - Queues or delays excess requests ⏳, processing them at a controlled pace. Queued requests may eventually be rejected if delayed too long. Example: Rate Limiting is like riding 5 rollercoasters max 🎢, while Throttling slows the queue by pacing rides. OpenAI used both to prevent GPU overload and ensure availability. Why use these? ✅Prevent DDoS attacks ✅Avoid server crashes ✅Ensure responsiveness for all users

1 Reply
2
11
Replies (1)

More like this

Recommendations from Medial

Karan Jot Singh

Jack of all trades, ... • 4m

Day 11 of becoming System Design Pro Still wrapping my head around rate limiting Is it a scaling issue? Algorithmic? Max-thread problem? When we already have vertical scaling, load balancing, consistent hashing.. why rate limit at all? #LearnInPu

See More
Reply
4

suraj sharma

Hey I am on Medial • 1y

Developed a backend of blogging application using Express js ,Node and MongoDB, allowing users to register, login, share blogs, and follow others. Implemented secure authentication with Session bases auth and bcrypt for hashing password, ensuring use

See More
Reply

Vansh Khandelwal

Full Stack Web Devel... • 1m

Reactive systems prioritize responsiveness, resilience and elasticity; a core challenge is back-pressure—controlling data flow so producers don’t overwhelm slower consumers. Techniques include buffering to smooth bursts, rate-limiting producers, prio

See More
Reply
1

Harshit tiwari

Be optimistic • 10m

When I started freelancing, I thought success was simple: Send 100 Connection requests, & boom Clients would come flying in And I got a reality check in a month. Out of 100 requests, only 10 accepted, Out of 10, only 5 started conversation while C

See More
Reply
5

Vansh Khandelwal

Full Stack Web Devel... • 7m

In the rapidly evolving digital landscape, APIs (Application Programming Interfaces) serve as essential connectors among software applications, enabling seamless communication between systems. However, their accessibility also makes them prime target

See More
Reply
3

NivroCorp

Your Partner in Web,... • 1m

You’re about to ship. Before you do, check these from a security perspective. These are things that break products later. Authentication Hash passwords with bcrypt. Rate limit logins. 2FA for admins. Why: weak auth becomes stolen accounts once users

See More
Reply
3
Image Description
Image Description

Swamy Gadila

Founder of Friday AI • 7m

🚀 Should India Start Charging Fees for High-Value UPI Transactions? UPI is a world-class digital payments system — fast, free, and inclusive. But there's a hidden cost: 💸 Infra cost of ₹0.10–₹0.30 per transaction 🏦 Over ₹1,000 crore/month just t

See More
7 Replies
6
18

Rahul Agarwal

Founder | Agentic AI... • 3d

Everyone should know how to build safe AI agents. I've explained the key safety checks below. 1. 𝗨𝗻𝗰𝗲𝗿𝘁𝗮𝗶𝗻𝘁𝘆 𝗧𝗵𝗿𝗲𝘀𝗵𝗼𝗹𝗱𝘀 It stops execution when the model’s 𝗰𝗼𝗻𝗳𝗶𝗱𝗲𝗻𝗰𝗲 𝗶𝘀 𝘁𝗼𝗼 𝗹𝗼𝘄 to safely perform an action. R

See More
Reply
1
5

Rahul Agarwal

Founder | Agentic AI... • 5m

Fine-tune vs Prompt vs Context Engineering. Simple step-by-step breakdown for each approach. 𝗙𝗶𝗻𝗲-𝗧𝘂𝗻𝗶𝗻𝗴 (𝗠𝗼𝗱𝗲𝗹-𝗟𝗲𝘃𝗲𝗹 𝗖𝘂𝘀𝘁𝗼𝗺𝗶𝘇𝗮𝘁𝗶𝗼𝗻) 𝗙𝗹𝗼𝘄: 1. Collect Data → Gather domain-specific info (e.g., legal docs). 2. Sta

See More
Reply
2
13
Image Description

Rahul Agarwal

Founder | Agentic AI... • 3m

4 different ways of training LLM's. I've given a simple detailed explanation below. 1.) 𝗔𝗰𝗰𝘂𝗿𝗮𝘁𝗲 𝗗𝗮𝘁𝗮 𝗖𝘂𝗿𝗮𝘁𝗶𝗼𝗻 (𝘀𝘁𝗲𝗽-𝗯𝘆-𝘀𝘁𝗲𝗽) Prepares clean, consistent, and useful data so the model learns effectively. 1. Collect text

See More
Reply
1
9
1

Download the medial app to read full posts, comements and news.