Back

Arnav Aggarwal

Love to Code | React...ย โ€ขย 10m

Hit an unexpected 'rate limit' message while creating Studio Ghibli-style images on ChatGPT? You weren't alone.This is a great example of API traffic management techniques like Rate Limiting and Throttling. โžก๏ธRate Limiting - Sets a hard cap; requests are blocked ๐Ÿšซ once the limit is reached until the timer resets โ€“ like being locked out after too many wrong password attempts. - Prevents abuse, ensures fair usage, and protects servers from overload. โžก๏ธThrottling - Queues or delays excess requests โณ, processing them at a controlled pace. Queued requests may eventually be rejected if delayed too long. Example: Rate Limiting is like riding 5 rollercoasters max ๐ŸŽข, while Throttling slows the queue by pacing rides. OpenAI used both to prevent GPU overload and ensure availability. Why use these? โœ…Prevent DDoS attacks โœ…Avoid server crashes โœ…Ensure responsiveness for all users

1 Reply
2
11
Replies (1)

More like this

Recommendations from Medial

Karan Jot Singh

Jack of all trades, ...ย โ€ขย 3m

Day 11 of becoming System Design Pro Still wrapping my head around rate limiting Is it a scaling issue? Algorithmic? Max-thread problem? When we already have vertical scaling, load balancing, consistent hashing.. why rate limit at all? #LearnInPu

See More
Reply
4

suraj sharma

Hey I am on Medialย โ€ขย 1y

Developed a backend of blogging application using Express js ,Node and MongoDB, allowing users to register, login, share blogs, and follow others. Implemented secure authentication with Session bases auth and bcrypt for hashing password, ensuring use

See More
Reply

Vansh Khandelwal

Full Stack Web Devel...ย โ€ขย 28d

Reactive systems prioritize responsiveness, resilience and elasticity; a core challenge is back-pressureโ€”controlling data flow so producers donโ€™t overwhelm slower consumers. Techniques include buffering to smooth bursts, rate-limiting producers, prio

See More
Reply
1

Harshit tiwari

Be optimisticย โ€ขย 10m

When I started freelancing, I thought success was simple: Send 100 Connection requests, & boom Clients would come flying in And I got a reality check in a month. Out of 100 requests, only 10 accepted, Out of 10, only 5 started conversation while C

See More
Reply
5

Vansh Khandelwal

Full Stack Web Devel...ย โ€ขย 7m

In the rapidly evolving digital landscape, APIs (Application Programming Interfaces) serve as essential connectors among software applications, enabling seamless communication between systems. However, their accessibility also makes them prime target

See More
Reply
3

NivroCorp

Your Partner in Web,...ย โ€ขย 10d

Youโ€™re about to ship. Before you do, check these from a security perspective. These are things that break products later. Authentication Hash passwords with bcrypt. Rate limit logins. 2FA for admins. Why: weak auth becomes stolen accounts once users

See More
Reply
3
Image Description
Image Description

Swamy Gadila

Founder of Friday AIย โ€ขย 7m

๐Ÿš€ Should India Start Charging Fees for High-Value UPI Transactions? UPI is a world-class digital payments system โ€” fast, free, and inclusive. But there's a hidden cost: ๐Ÿ’ธ Infra cost of โ‚น0.10โ€“โ‚น0.30 per transaction ๐Ÿฆ Over โ‚น1,000 crore/month just t

See More
7 Replies
6
18

Rahul Agarwal

Founder | Agentic AI...ย โ€ขย 4m

Fine-tune vs Prompt vs Context Engineering. Simple step-by-step breakdown for each approach. ๐—™๐—ถ๐—ป๐—ฒ-๐—ง๐˜‚๐—ป๐—ถ๐—ป๐—ด (๐— ๐—ผ๐—ฑ๐—ฒ๐—น-๐—Ÿ๐—ฒ๐˜ƒ๐—ฒ๐—น ๐—–๐˜‚๐˜€๐˜๐—ผ๐—บ๐—ถ๐˜‡๐—ฎ๐˜๐—ถ๐—ผ๐—ป) ๐—™๐—น๐—ผ๐˜„: 1. Collect Data โ†’ Gather domain-specific info (e.g., legal docs). 2. Sta

See More
Reply
2
13
Image Description

Rahul Agarwal

Founder | Agentic AI...ย โ€ขย 3m

4 different ways of training LLM's. I've given a simple detailed explanation below. 1.) ๐—”๐—ฐ๐—ฐ๐˜‚๐—ฟ๐—ฎ๐˜๐—ฒ ๐——๐—ฎ๐˜๐—ฎ ๐—–๐˜‚๐—ฟ๐—ฎ๐˜๐—ถ๐—ผ๐—ป (๐˜€๐˜๐—ฒ๐—ฝ-๐—ฏ๐˜†-๐˜€๐˜๐—ฒ๐—ฝ) Prepares clean, consistent, and useful data so the model learns effectively. 1. Collect text

See More
Reply
1
9
1

Rahul Agarwal

Founder | Agentic AI...ย โ€ขย 23d

Most people skip guardrails, their AI systems break. Iโ€™ve explained in a very simple way below. 1. ๐—œ๐—ป๐—ฝ๐˜‚๐˜ & ๐—ข๐˜‚๐˜๐—ฝ๐˜‚๐˜ ๐—š๐˜‚๐—ฎ๐—ฟ๐—ฑ๐—ฟ๐—ฎ๐—ถ๐—น๐˜€ This is the ๐—ฒ๐—ป๐˜๐—ฟ๐˜† ๐—ฎ๐—ป๐—ฑ ๐—ฒ๐˜…๐—ถ๐˜ ๐—ฐ๐—ต๐—ฒ๐—ฐ๐—ธ of the system. โ€ข User input is checked for safety โ€ข

See More
Reply
1
3

Download the medial app to read full posts, comements and news.