<transcript><audio_27>subsequently try to detect it in that way but in certain cases like it can go a bit wrong so this is why like we also want to check whether the data type is correct or not yeah then next um sometimes we want to understand like what are the unique values uh</transcript><transcript><audio_28>for each variable that we have okay and this is um really uh one way to identify unclean data you know like for example uh you you know like for a particular categorical variable that you have</transcript><transcript><audio_29>you you only have say for example for for gender you have like um female male and disclosed okay and then somehow like during the data collection process say for example it's not um collected through system or</transcript><transcript><audio_30>it allows like manual entry kind of stuff and then you have people are keeping in like m or f you know so they are similar in a way like you know male and m is like referring to the same</transcript><transcript><audio_31>thing but they are treated currently as two separate categories in terms of unique values so this is where you know like we want to eventually do some correction over there and then first this is why we need to know what</transcript> subsequently try to detect it in that way but in certain cases like it can go a bit wrong so this is why like we also want to check whether the data type is correct or not yeah then next um sometimes we want to understand like what are the unique values uh for each variable that we have okay and this is um really uh one way to identify unclean data you know like for example uh you you know like for a particular categorical variable that you have you you only have say for example for for gender you have like um female male and disclosed okay and then somehow like during the data collection process say for example it's not um collected through system or it allows like manual entry kind of stuff and then you have people are keeping in like m or f you know so they are similar in a way like you know male and m is like referring to the same thing but they are treated currently as two separate categories in terms of unique values so this is where you know like we want to eventually do some correction over there and then first this is why we need to know what
{"source": "grass-yt-cc-by.-Vlqwtbg1wg|shard_10024_31|create_multimodal_data.extract_yt_and_generate_transcripts.35|shard_10024|create_multimodal_data.generate_captions.17|shard_10024|create_multimodal_data.generate_captions.26", "params": {"id": "-Vlqwtbg1wg", "channel_id": "UC98CzaYuFNAA_gOINFB0e4Q", "duration": 1517, "view_count": 482, "age_limit": 0, "chapters": [{"start_time": 0.0, "title": "Intro", "end_time": 20.0}, {"start_time": 20.0, "title": "Welcome", "end_time": 270.0}, {"start_time": 270.0, "title": "High Level Overview", "end_time": 583.0}, {"start_time": 583.0, "title": "Complex Transformations", "end_time": 750.0}, {"start_time": 750.0, "title": "Context", "end_time": 855.0}, {"start_time": 855.0, "title": "Materials", "end_time": 870.0}, {"start_time": 870.0, "title": "Libraries", "end_time": 922.0}, {"start_time": 922.0, "title": "Mock Data", "end_time": 929.0}, {"start_time": 929.0, "title": "Preview Data", "end_time": 951.0}, {"start_time": 951.0, "title": "Viewability Matrix", "end_time": 1021.0}, {"start_time": 1021.0, "title": "Fake Data", "end_time": 1033.0}, {"start_time": 1033.0, "title": "Jupyter", "end_time": 1517}], "like_count": 9, "channel_follower_count": 33300, "license": "Creative Commons Attribution license (reuse allowed)", "uploader_id": "@EuroPythonConference", "yt_tar_file": "/leonardo_work/EUHPC_E03_068/audio/fixed_download/grass-yt-cc-by//shard_10024/-Vlqwtbg1wg.tar.gz"}}