🚀 Medial just raised $500k in Pre-Series A. Tap to read the announcement. 🎉

Download App

Home

Switch theme

Blog . Feedback . Privacy
Community Guidelines

Back to feeds

Sudarshan Pal

Stealth • 5m

The Data engineering life cycle has the following 5 stages Generation: This is where data is created. Think of it as information being born. It can come from various sources like e-commerce sites, weather sensors, or even your favourite video games scores. Storage: This stage is all about saving data in a secure place, such as big databases or cloud storage, so it can be easily accessed later. Ingestion: Ingestion is like gathering all the data from different places and putting it into one big bucket. This stage involves taking data from various sources and moving it into a central storage system where it can be processed. Transformation: It involves cleaning and organizing the data, removing errors, joining multiple tables, removing duplicates, applying business rules, and converting it into a useful format. Serving Data: This stage ensures that data is easy to access and use, whether it's for creating reports, running apps, or making decisions.

0 replies6 likes

Recommendations from Medial

Shuvodip Ray
•

YouTube • 6m

AI relies on robust data management across 7 key components to build effective AI models: 1. sources, 2. ingestion, 3. storage, 4. transformation, 5. analytics, 6. governance and security, and 7. orchestration.

0 replies7 likes

Chamarti Sreekar

Stealth • 4m

This is how you create content that stands out - removing noise , removing unnecessary details and simplifying

0 replies4 likes

Anonymous

Stealth • 8m

How is this early stage startups finding data to train their AI models?

12 replies5 likes

Lingeshwaran

Stealth • 7m

IDEA : AI Training Data generator A Developer Platform which is much specify for AI-ML field to achieve various tasks like Analysis, Generation and Segmentation of real time data across data like text, image, audio, video that requires heavy and hig

6 replies5 likes

Raghu

Stealth • 6m

Is it really safe for startups to depend on cloud storage? My answer is below 👇🏻 "Cloud storage can be a boon for startups, offering scalability and accessibility. However, it's not without risks. Data breaches, downtime, and compliance issues are

yes,safer

No, not safer

Votes: 14

1 replies5 likes

pathak yash

Stealth • 23d

🚀 Transforming Data Storage with Quantum Computing | By Yash Pathak Imagine a future where quantum chips seamlessly connect to modern databases like MongoDB, revolutionizing the way we store, process, and secure data. With quantum computing, we unl

0 replies5 likes

Anonymous

Stealth • 8m

A decentralised marketplace where different startups, institutions, and big companies are connected and where they can share their data. The platform provides pre-processing, compliance checks and data licensing to provide a safe harbour for AI compa

2 replies6 likes

Anonymous

Stealth • 6m

Breakthrough discovery could charge your dead phone in 60 seconds and your car in 10 minutes • Scientists at CU Boulder have made a groundbreaking discovery in energy storage, potentially enabling phones to charge in 60 seconds and electric cars in

2 replies3 likes

PRATHAM
•

Apple • 9m

As The Data thing is growing ( context: giants are buying Data of users ) so opportunities on data science will be increasing soon and demand will increase soon as I feel. for example data analyst, data engineer, data scientist, etc. I think it's

5 replies17 likes