Back

Arnav Aggarwal

Love to Code | React... • 8m

Hit an unexpected 'rate limit' message while creating Studio Ghibli-style images on ChatGPT? You weren't alone.This is a great example of API traffic management techniques like Rate Limiting and Throttling. ➡️Rate Limiting - Sets a hard cap; requests are blocked 🚫 once the limit is reached until the timer resets – like being locked out after too many wrong password attempts. - Prevents abuse, ensures fair usage, and protects servers from overload. ➡️Throttling - Queues or delays excess requests ⏳, processing them at a controlled pace. Queued requests may eventually be rejected if delayed too long. Example: Rate Limiting is like riding 5 rollercoasters max 🎢, while Throttling slows the queue by pacing rides. OpenAI used both to prevent GPU overload and ensure availability. Why use these? ✅Prevent DDoS attacks ✅Avoid server crashes ✅Ensure responsiveness for all users

1 Reply
2
11
Replies (1)

More like this

Recommendations from Medial

Karan Jot Singh

Jack of all trades, ... • 23d

Day 11 of becoming System Design Pro Still wrapping my head around rate limiting Is it a scaling issue? Algorithmic? Max-thread problem? When we already have vertical scaling, load balancing, consistent hashing.. why rate limit at all? #LearnInPu

See More
Reply
4

suraj sharma

Hey I am on Medial • 1y

Developed a backend of blogging application using Express js ,Node and MongoDB, allowing users to register, login, share blogs, and follow others. Implemented secure authentication with Session bases auth and bcrypt for hashing password, ensuring use

See More
Reply

Devak K

Hey I am on Medial • 3m

Cyber threats are evolving every day — from phishing attacks to ransomware. Is your business fully protected? At DigitDefence, we provide end-to-end cybersecurity solutions to safeguard your data, prevent breaches, and ensure uninterrupted business

See More
Reply
1

TheLuhas

Never take anyone as... • 10m

Introducing DEV – Digital Enrollment Verification Guyz, I just had this crazy idea—what if we had something like Aadhaar but for social media? I’m calling it DEV (Digital Enrollment Verification). With DEV, every user would have a verified digital

See More
Reply

Sanjoli Khurana

Helping only serious... • 5m

*Are You Hiring AI Cheaters Without Knowing It?* We’re working on something unique to enhance hiring integrity and prevent cheating in your recruitment process, making it more stringent. Today’s hiring tools aren’t enough. ❌ No foolproof proctori

See More
Reply
3

Sheikh Ayan

Founder of VistaSec:... • 9m

🚨 Critical Alert: Ransomware Attack on Ardent Health Services 🚨 In November 2023, Ardent Health Services fell victim to a ransomware attack, forcing the healthcare provider to take its network offline to contain the damage. This led to operational

See More
Reply
1

Harshit tiwari

Be optimistic • 7m

When I started freelancing, I thought success was simple: Send 100 Connection requests, & boom Clients would come flying in And I got a reality check in a month. Out of 100 requests, only 10 accepted, Out of 10, only 5 started conversation while C

See More
Reply
5

Anubhav Sharma

Rooted in Linux. Dri... • 1m

🚀 Async Transformation Completed (Almost!) Recently converted a synchronous Hostinger software package into a fully asynchronous architecture using httpx.AsyncClient. 📈 Performance Outcome: 4.34× faster compared to sequential execution Zero err

See More
Reply
1
1

Vansh Khandelwal

Full Stack Web Devel... • 4m

In the rapidly evolving digital landscape, APIs (Application Programming Interfaces) serve as essential connectors among software applications, enabling seamless communication between systems. However, their accessibility also makes them prime target

See More
Reply
3
Image Description
Image Description

Vishu Bheda

 • 

Medial • 11m

Flipkart sold for $16 billion, but the founders got almost nothing. After looking at 100+ startup deals, I found some toxic terms that hurt founders: 1. Liquidation Preferences: Investors get their money back first. If the sale price is low, founde

See More
10 Replies
19
23

Download the medial app to read full posts, comements and news.