Back
Sanskar
Keen Learner and Exp... • 20d
Day 28 of learning python as a beginner. Topic: web scraping with postgreSQL database. When I posted my first web scraping project I just had the result on console however I wanted it to be stored somewhere where it can be reviewed later that's when my learning from postgreSQL proved useful I successfully created a database that can store my parsed data. Also someone reminded me that I should use if __name__ == "__main__" (which I forgot to used) so I have also wrapped the scraping process into functions and then imported it in the main.py file (this also improved the overall structure of the code) so now I have code for collecting raw html data, code for parsing the raw data, code for saving that data into a database and finally code for calling all the other codes. All in their dedicated file. Here's my github so you can check it out: https://github.com/Sanskar334/Web_Scraping.git go to the using beautiful soup folder you will find all the files there. While I fixed every bug I could find however I believer there may be some other bugs as well which I may have missed, do let me know about such bugs which I left accidentally. And here's my code and it's result.
More like this
Recommendations from Medial
Sanskar
Keen Learner and Exp... • 21d
Day 27 of learning python as a beginner. Topic: web scraping using beautiful soup. A few days ago I got introduced to requests library in python which can scan the html from websites. At that time I was confused on what might be the real life impli
See More
Tuhin Subhra Biswas
Building in 🥷🏻• Pr... • 1y
As there are irregularities in the NEET 2024 exam results, in order to investigate this, Harkirat Bhaiya shared his 1Hour long session of scraping data from NEET RESULT website and building a web where users can enter their roll number, application n
See More
Download the medial app to read full posts, comements and news.