๐Ÿš€ Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. ๐Ÿ”ฅ
Login

Back

Sudarshan Pal

Data Engineer @Quant...ย โ€ขย 1y

The Data engineering life cycle has the following 5 stages Generation: This is where data is created. Think of it as information being born. It can come from various sources like e-commerce sites, weather sensors, or even your favourite video games scores. Storage: This stage is all about saving data in a secure place, such as big databases or cloud storage, so it can be easily accessed later. Ingestion: Ingestion is like gathering all the data from different places and putting it into one big bucket. This stage involves taking data from various sources and moving it into a central storage system where it can be processed. Transformation: It involves cleaning and organizing the data, removing errors, joining multiple tables, removing duplicates, applying business rules, and converting it into a useful format. Serving Data: This stage ensures that data is easy to access and use, whether it's for creating reports, running apps, or making decisions.

Reply
7

More like this

Recommendations from Medial

Shuvodip Ray

ย โ€ขย 

YouTubeย โ€ขย 1y

AI relies on robust data management across 7 key components to build effective AI models: 1. sources, 2. ingestion, 3. storage, 4. transformation, 5. analytics, 6. governance and security, and 7. orchestration.

Reply
1
7

Xinetee

Decentralised , Secu...ย โ€ขย 8m

Hello everyone this is Xinetee. Aim to provide decentralised data storage at an affordable rate .

Reply
1

Gigaversity

Gigaversity.inย โ€ขย 4m

Ever wondered how enterprises store petabytes of unstructured data efficiently? From powering streaming platforms to scaling AI-driven applications, modern businesses rely on advanced storage solutions to manage massive data volumes. Understanding ho

See More
Reply
2

Account Deleted

Hey I am on Medialย โ€ขย 1y

This is how you create content that stands out - removing noise , removing unnecessary details and simplifying

Reply
4
Image Description
Image Description

Lingeshwaran

Looking at objective...ย โ€ขย 1y

IDEA : AI Training Data generator A Developer Platform which is much specify for AI-ML field to achieve various tasks like Analysis, Generation and Segmentation of real time data across data like text, image, audio, video that requires heavy and hig

See More
6 Replies
5
Image Description

Raghu

Tech Enthusiastย โ€ขย 1y

Is it really safe for startups to depend on cloud storage? My answer is below ๐Ÿ‘‡๐Ÿป "Cloud storage can be a boon for startups, offering scalability and accessibility. However, it's not without risks. Data breaches, downtime, and compliance issues are

See More
1 Reply
5
Image Description
Image Description

Hawk

ย โ€ขย 

Medialย โ€ขย 4m

Another day, another automation. This one scrapes Google Maps business data and pushes it straight into Airtable, no manual effort, no fluff. โš™๏ธ Built with: - Apify Actor for location scraping - Field mapping via N8N - Airtable for structured stora

See More
5 Replies
5
16

Download the medial app to read full posts, comements and news.