Back

Day 2 of learning Data Science as a beginner. Topic: Data Cleaning and Structuring Today I decided to try my hands on cleaning raw data using pure python and my task was to 1. remove the data where there is no username present or if any other detail is missing. 2. remove any duplicate value from the user's details. 3. just take only one page in 104 (id of pages) out of the two different pages whom the id allotted is 104. for this I first created a function in which I created a loop which goes through every user's details and then I created an if condition using all keyword which checks whether every value is truly or not if all the values of a user is true then his details get printed however if there is any value which is not truly a valid dictionary value then that user's details will get omitted. Then I converted this details into a set in order to avoid any duplicate values in the final cleaned data. I also created program to avoid duplicate pages and for this I used a dictionary' key value pair because there can be only a unique key and it can contain only one value therefore using this I put each page and its unique page id into a dictionary. using these I was able to get a cleaned and more processed data using only pure python (as I said earlier I want to experience the problem before learning its solution). I am also open for any suggestions, recommendations and challenges which can help me in my learning process. Also here's my code and its result.