๐Ÿš€ Medial Secures Investment on Shark Tank India - Fueling the Future of Professional Social Networking. ๐Ÿ”ฅ
Login

Back

Sanskar

Keen Learner and Exp...ย โ€ขย 17h

Day 28 of learning python as a beginner. Topic: web scraping with postgreSQL database. When I posted my first web scraping project I just had the result on console however I wanted it to be stored somewhere where it can be reviewed later that's when my learning from postgreSQL proved useful I successfully created a database that can store my parsed data. Also someone reminded me that I should use if __name__ == "__main__" (which I forgot to used) so I have also wrapped the scraping process into functions and then imported it in the main.py file (this also improved the overall structure of the code) so now I have code for collecting raw html data, code for parsing the raw data, code for saving that data into a database and finally code for calling all the other codes. All in their dedicated file. Here's my github so you can check it out: https://github.com/Sanskar334/Web_Scraping.git go to the using beautiful soup folder you will find all the files there. While I fixed every bug I could find however I believer there may be some other bugs as well which I may have missed, do let me know about such bugs which I left accidentally. And here's my code and it's result.

Reply
1

More like this

Recommendations from Medial

Sanskar

Keen Learner and Exp...ย โ€ขย 1d

Day 27 of learning python as a beginner. Topic: web scraping using beautiful soup. A few days ago I got introduced to requests library in python which can scan the html from websites. At that time I was confused on what might be the real life impli

See More
Reply
1
Image Description

Tuhin Subhra Biswas

Building in ๐Ÿฅท๐Ÿปโ€ข Pr...ย โ€ขย 1y

As there are irregularities in the NEET 2024 exam results, in order to investigate this, Harkirat Bhaiya shared his 1Hour long session of scraping data from NEET RESULT website and building a web where users can enter their roll number, application n

See More
1 Reply
3
7

Sanskar

Keen Learner and Exp...ย โ€ขย 3d

Day 25 of learning python as a beginner. Topic: database handling. I used to write simple programs which just showed some text in the console when I started learning python. I didn't used to store that data somewhere because I didn't know how to.

See More
Reply

Vansh Khandelwal

Full Stack Web Devel...ย โ€ขย 9m

๐„๐ฑ๐ฉ๐ฅ๐จ๐ซ๐ข๐ง๐  ๐๐จ๐ฌ๐ญ๐ ๐ซ๐ž๐’๐๐‹: ๐“๐ก๐ž ๐€๐๐ฏ๐š๐ง๐œ๐ž๐ ๐Ž๐ฉ๐ž๐ง-๐’๐จ๐ฎ๐ซ๐œ๐ž ๐‘๐ƒ๐๐Œ๐’ PostgreSQL, or Postgres, is a powerful, open-source relational database management system (RDBMS) with over 30 years of development. Known for its SQL

See More
Reply
4

Sanskar

Keen Learner and Exp...ย โ€ขย 2d

Day 26 of learning python as a beginner. Topic: CRUD operations in python postgreSQL. I had tried to explore SQL database handling in python and someone suggested me that I should also try performing CRUD (Create, Read, Update and Delete) operation

See More
Reply

Suraj Dusane

Hey I am on Medialย โ€ขย 1y

How I Complete My 5-Day Boring Task in Less Than Half an Hour๐Ÿ‘‡๐Ÿป 1. Eureka Moment: So, I was stuck making PowerPoint slides manually, which was a real pain. Then, I had this genius idea to make things easier by automating the whole process. 2. Hun

See More
Reply
9

Adarsh Gupta

Co-Founder Apploydย โ€ขย 3m

Introducing Apployd DB: Next-Generation Serverless PostgreSQL We're excited to announce Apployd DB, our modern serverless PostgreSQL platform designed to revolutionize how developers work with databases. ๐Ÿš€ After extensive development and testing,

See More
Reply
1

Subhajit Nath

Hey I am on Medialย โ€ขย 1m

๐ŸŸฆ Part 1: Data Extraction โ€“ Starting the ETL Pipeline ๐Ÿš€ Welcome to Part 1 of my Azure-based ETL project series! In this part, I walk through how to extract raw data from a GitHub link and load it into Azure Data Lake (Gen2) using Azure Data Factor

See More
Reply
3

Download the medial app to read full posts, comements and news.