🚀 Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. 🔥
Login

Back

Sudarshan Pal

Data Engineer @Quant... • 11m

The Data engineering life cycle has the following 5 stages Generation: This is where data is created. Think of it as information being born. It can come from various sources like e-commerce sites, weather sensors, or even your favourite video games scores. Storage: This stage is all about saving data in a secure place, such as big databases or cloud storage, so it can be easily accessed later. Ingestion: Ingestion is like gathering all the data from different places and putting it into one big bucket. This stage involves taking data from various sources and moving it into a central storage system where it can be processed. Transformation: It involves cleaning and organizing the data, removing errors, joining multiple tables, removing duplicates, applying business rules, and converting it into a useful format. Serving Data: This stage ensures that data is easy to access and use, whether it's for creating reports, running apps, or making decisions.

0 replies6 likes

More like this

Recommendations from Medial

Shuvodip Ray

 • 

YouTube • 1y

AI relies on robust data management across 7 key components to build effective AI models: 1. sources, 2. ingestion, 3. storage, 4. transformation, 5. analytics, 6. governance and security, and 7. orchestration.

0 replies7 likes
1

Xinetee

Decentralised , Secu... • 1m

Hello everyone this is Xinetee. Aim to provide decentralised data storage at an affordable rate .

0 replies1 like
Image Description

Raghu

Tech Enthusiast • 12m

Is it really safe for startups to depend on cloud storage? My answer is below 👇🏻 "Cloud storage can be a boon for startups, offering scalability and accessibility. However, it's not without risks. Data breaches, downtime, and compliance issues are

See More
1 replies5 likes
Image Description
Image Description

Lingeshwaran

Looking at objective... • 1y

IDEA : AI Training Data generator A Developer Platform which is much specify for AI-ML field to achieve various tasks like Analysis, Generation and Segmentation of real time data across data like text, image, audio, video that requires heavy and hig

See More
6 replies5 likes
Anonymous
Image Description
Image Description

Anonymous

Hey I am on Medial • 1y

How is this early stage startups finding data to train their AI models?

12 replies5 likes

Vipul Bagga

Hey I am on Medial • 3m

Just a thought: The side line on the post is taking a lot of space conside removing it.

0 replies1 like
Image Description
Image Description

Teja Surishetti

 • 

18startup • 1y

One piece of advice that I got from a wise person is, if your only way of gaining knowledge is by asking "Why" then it's stupidity you should capture knowledge through various sources, and it made sense. 🫡 How do you gain knowledge by the way?

4 replies5 likes

Depak Jaiswal

Hey I am on Medial • 1m

Traditional Layer 1 blockchains struggle with storing real-world files on-chain storage is often costly, slow, and limited in capacity. Most weren't built for dynamic content at scale. Xenea changes that. By integrating a Layer 1 blockchain with dec

See More
0 replies2 likes
Image Description
Image Description

Dinakar

Nobody • 1y

Is there anyone who is into crypto and web3 here? I know some basics of it, I want to dig deeper and learn more. Can anyone suggest me some good sources to learn more about crypto.

17 replies3 likes
Image Description

Comet

#freelancer • 5m

Essential Python Topics for Data Analysts 😄👇 - Data Structures: Lists, Dictionaries, Sets, and Tuples. - NumPy: Array manipulation for numerical operations. - Pandas: Data manipulation and analysis with DataFrame. - Data Cleaning: Handling missin

See More
2 replies5 likes
1

Download the medial app to read full posts, comements and news.