Post on Medial

Sudarshan Pal

Stealth • 4m

The Data engineering life cycle has the following 5 stages Generation: This is where data is created. Think of it as information being born. It can come from various sources like e-commerce sites, weather sensors, or even your favourite video games scores. Storage: This stage is all about saving data in a secure place, such as big databases or cloud storage, so it can be easily accessed later. Ingestion: Ingestion is like gathering all the data from different places and putting it into one big bucket. This stage involves taking data from various sources and moving it into a central storage system where it can be processed. Transformation: It involves cleaning and organizing the data, removing errors, joining multiple tables, removing duplicates, applying business rules, and converting it into a useful format. Serving Data: This stage ensures that data is easy to access and use, whether it's for creating reports, running apps, or making decisions.

0 replies6 likes

More like this

Recommendations from Medial

Shuvodip Ray

 • 

YouTube • 5m

AI relies on robust data management across 7 key components to build effective AI models: 1. sources, 2. ingestion, 3. storage, 4. transformation, 5. analytics, 6. governance and security, and 7. orchestration.

0 replies7 likes
1
Image Description

Raghu

Stealth • 5m

Is it really safe for startups to depend on cloud storage? My answer is below 👇🏻 "Cloud storage can be a boon for startups, offering scalability and accessibility. However, it's not without risks. Data breaches, downtime, and compliance issues are

See More
1 replies5 likes
Anonymous
Image Description
Image Description

How is this early stage startups finding data to train their AI models?

12 replies5 likes
Image Description
Image Description

Lingeshwaran

Stealth • 6m

IDEA : AI Training Data generator A Developer Platform which is much specify for AI-ML field to achieve various tasks like Analysis, Generation and Segmentation of real time data across data like text, image, audio, video that requires heavy and hig

See More
6 replies5 likes
Image Description
Image Description

PRATHAM

 • 

Apple • 8m

As The Data thing is growing ( context: giants are buying Data of users ) so opportunities on data science will be increasing soon and demand will increase soon as I feel. for example data analyst, data engineer, data scientist, etc. I think it's

See More
5 replies17 likes
Image Description
Image Description

FED KIIT

Stealth • 2m

In which stage of a startup’s lifecycle is it most important to focus on scaling the business? A) Seed Stage B) Growth Stage C) Ideation Stage D) Exit Stage

4 replies6 likes
Image Description
Image Description

Dinakar

Stealth • 5m

Is there anyone who is into crypto and web3 here? I know some basics of it, I want to dig deeper and learn more. Can anyone suggest me some good sources to learn more about crypto.

17 replies3 likes
Image Description
Image Description

Teja Surishetti

 • 

18startup • 7m

One piece of advice that I got from a wise person is, if your only way of gaining knowledge is by asking "Why" then it's stupidity you should capture knowledge through various sources, and it made sense. 🫡 How do you gain knowledge by the way?

4 replies5 likes
Image Description

Rahul Gupta

Stealth • 6m

Data is a natural resource of a country and to harness it requires translating energy into intelligence with AI factories. ~ NVIDIA CEO Jensen Huang

1 replies5 likes

Vansh Khandelwal

Stealth • 11d

In modern app development, new database trends like GraphQL and Redis are transforming data management. 𝐆𝐫𝐚𝐩𝐡𝐐𝐋 is a query language for APIs that allows clients to request specific data, avoiding over-fetching. Advantages include flexible da

See More
0 replies1 like

Download the medial app to read full posts, comements and news.