🚀 Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. 🔥

News

Messages

Try our Valuation Calculator →

Back

Sanskar

Keen Learner and Exp... • 3m

Day 28 of learning python as a beginner. Topic: web scraping with postgreSQL database. When I posted my first web scraping project I just had the result on console however I wanted it to be stored somewhere where it can be reviewed later that's when my learning from postgreSQL proved useful I successfully created a database that can store my parsed data. Also someone reminded me that I should use if __name__ == "__main__" (which I forgot to used) so I have also wrapped the scraping process into functions and then imported it in the main.py file (this also improved the overall structure of the code) so now I have code for collecting raw html data, code for parsing the raw data, code for saving that data into a database and finally code for calling all the other codes. All in their dedicated file. Here's my github so you can check it out: https://github.com/Sanskar334/Web_Scraping.git go to the using beautiful soup folder you will find all the files there. While I fixed every bug I could find however I believer there may be some other bugs as well which I may have missed, do let me know about such bugs which I left accidentally. And here's my code and it's result.

Recommendations from Medial

Sanskar

Keen Learner and Exp... • 3m

Day 27 of learning python as a beginner. Topic: web scraping using beautiful soup. A few days ago I got introduced to requests library in python which can scan the html from websites. At that time I was confused on what might be the real life impli

Sanskar

Keen Learner and Exp... • 2m

Day 1 of learning Data Science as a beginner. Topic: data science life cycle and reading a json file data dump. What is data science life cycle? The data science lifecycle is the structured process of extracting useful actionable insights from raw

2 Replies

Sanskar

Keen Learner and Exp... • 3m

Day 25 of learning python as a beginner. Topic: database handling. I used to write simple programs which just showed some text in the console when I started learning python. I didn't used to store that data somewhere because I didn't know how to.

Tuhin Subhra Biswas

Building in 🥷🏻• Pr... • 1y

As there are irregularities in the NEET 2024 exam results, in order to investigate this, Harkirat Bhaiya shared his 1Hour long session of scraping data from NEET RESULT website and building a web where users can enter their roll number, application n

1 Reply

Vansh Khandelwal

Full Stack Web Devel... • 1y

𝐄𝐱𝐩𝐥𝐨𝐫𝐢𝐧𝐠 𝐏𝐨𝐬𝐭𝐠𝐫𝐞𝐒𝐐𝐋: 𝐓𝐡𝐞 𝐀𝐝𝐯𝐚𝐧𝐜𝐞𝐝 𝐎𝐩𝐞𝐧-𝐒𝐨𝐮𝐫𝐜𝐞 𝐑𝐃𝐁𝐌𝐒 PostgreSQL, or Postgres, is a powerful, open-source relational database management system (RDBMS) with over 30 years of development. Known for its SQL

Sanskar

Keen Learner and Exp... • 1m

Day 11 of learning Data science as a beginner Topic: creating data structure In my previous post I discussed about the difference between panda's series and data frames we typically use data frames more often as compared to series There are a lot

Anonymous

Hey I am on Medial • 5m

My App Stack: Backend: Railway / Render Frontend: Vercel Auth: Firebase Database: Supabase Code: Github Am I missing anything?

Sanskar

Keen Learner and Exp... • 3m

Day 26 of learning python as a beginner. Topic: CRUD operations in python postgreSQL. I had tried to explore SQL database handling in python and someone suggested me that I should also try performing CRUD (Create, Read, Update and Delete) operation

Anwin Babu

Web Developer in Tra... • 3m

can you please help what are the data scraping tools that u guys use

Suraj Dusane

Hey I am on Medial • 1y

How I Complete My 5-Day Boring Task in Less Than Half an Hour👇🏻 1. Eureka Moment: So, I was stuck making PowerPoint slides manually, which was a real pain. Then, I had this genius idea to make things easier by automating the whole process. 2. Hun