๐Ÿš€ Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. ๐Ÿ”ฅ
Login

Back

Sudarshan Pal

Data Engineer @Quant...ย โ€ขย 1y

The Data engineering life cycle has the following 5 stages Generation: This is where data is created. Think of it as information being born. It can come from various sources like e-commerce sites, weather sensors, or even your favourite video games scores. Storage: This stage is all about saving data in a secure place, such as big databases or cloud storage, so it can be easily accessed later. Ingestion: Ingestion is like gathering all the data from different places and putting it into one big bucket. This stage involves taking data from various sources and moving it into a central storage system where it can be processed. Transformation: It involves cleaning and organizing the data, removing errors, joining multiple tables, removing duplicates, applying business rules, and converting it into a useful format. Serving Data: This stage ensures that data is easy to access and use, whether it's for creating reports, running apps, or making decisions.

Reply
7

More like this

Recommendations from Medial

Shuvodip Ray

ย โ€ขย 

YouTubeย โ€ขย 1y

AI relies on robust data management across 7 key components to build effective AI models: 1. sources, 2. ingestion, 3. storage, 4. transformation, 5. analytics, 6. governance and security, and 7. orchestration.

Reply
1
7

Rahul Agarwal

Founder | Agentic AI...ย โ€ขย 18d

Most AI projects donโ€™t fail because of models. They fail because data never flows properly. Without reliable data movement, even the smartest AI system becomes useless infrastructure. Everything begins with pipelines. They quietly power modern ana

See More
Reply
1
3

Gigaversity

Gigaversity.inย โ€ขย 8m

Ever wondered how enterprises store petabytes of unstructured data efficiently? From powering streaming platforms to scaling AI-driven applications, modern businesses rely on advanced storage solutions to manage massive data volumes. Understanding ho

See More
Reply
2

Xinetee

Decentralised , Secu...ย โ€ขย 11m

Hello everyone this is Xinetee. Aim to provide decentralised data storage at an affordable rate .

Reply
1
Image Description
Image Description

Lingeshwaran

Looking at objective...ย โ€ขย 1y

IDEA : AI Training Data generator A Developer Platform which is much specify for AI-ML field to achieve various tasks like Analysis, Generation and Segmentation of real time data across data like text, image, audio, video that requires heavy and hig

See More
6 Replies
5

Account Deleted

Hey I am on Medialย โ€ขย 1y

This is how you create content that stands out - removing noise , removing unnecessary details and simplifying

Reply
4
Image Description

Raghu

Tech Enthusiastย โ€ขย 1y

Is it really safe for startups to depend on cloud storage? My answer is below ๐Ÿ‘‡๐Ÿป "Cloud storage can be a boon for startups, offering scalability and accessibility. However, it's not without risks. Data breaches, downtime, and compliance issues are

See More
1 Reply
5
Image Description
Image Description

Varun Bhambhani

ย โ€ขย 

Medialย โ€ขย 8m

Another day, another automation. This one scrapes Google Maps business data and pushes it straight into Airtable, no manual effort, no fluff. โš™๏ธ Built with: - Apify Actor for location scraping - Field mapping via N8N - Airtable for structured stora

See More
5 Replies
5
16

Download the medial app to read full posts, comements and news.