<transcript><audio_19>real world data and also with open data uh i yeah i um keep going back to the same um stack overflow answers uh to find out like you know how to do certain tasks like how to do certain</transcript><transcript><audio_20>operations which is why like i eventually came up with um this this framework i would say like this process this um guide which i'm going to talk to you later on under 15 tips yeah so uh without further ado i will</transcript><transcript><audio_21>just give a high level overview first before going down into the code what this um 15 processors i mean 15 tasks is yeah so mainly like whenever we get the data set um</transcript><transcript><audio_22>we are interested in knowing like what data variables there are in in the data set so usually we'll query to find out what the column name is and then subsequently we also want to know like whether the data that we read in</transcript><transcript><audio_23>um using python is uh correct or not like you know whether python loaded the data correctly so it can be in various ui say for example if you use um spider or say in my case i like to use jupiter notebook so if i</transcript> real world data and also with open data uh i yeah i um keep going back to the same um stack overflow answers uh to find out like you know how to do certain tasks like how to do certain operations which is why like i eventually came up with um this this framework i would say like this process this um guide which i'm going to talk to you later on under 15 tips yeah so uh without further ado i will just give a high level overview first before going down into the code what this um 15 processors i mean 15 tasks is yeah so mainly like whenever we get the data set um we are interested in knowing like what data variables there are in in the data set so usually we'll query to find out what the column name is and then subsequently we also want to know like whether the data that we read in um using python is uh correct or not like you know whether python loaded the data correctly so it can be in various ui say for example if you use um spider or say in my case i like to use jupiter notebook so if i
{"source": "grass-yt-cc-by.-Vlqwtbg1wg|shard_10024_31|create_multimodal_data.extract_yt_and_generate_transcripts.35|shard_10024|create_multimodal_data.generate_captions.17|shard_10024|create_multimodal_data.generate_captions.26", "params": {"id": "-Vlqwtbg1wg", "channel_id": "UC98CzaYuFNAA_gOINFB0e4Q", "duration": 1517, "view_count": 482, "age_limit": 0, "chapters": [{"start_time": 0.0, "title": "Intro", "end_time": 20.0}, {"start_time": 20.0, "title": "Welcome", "end_time": 270.0}, {"start_time": 270.0, "title": "High Level Overview", "end_time": 583.0}, {"start_time": 583.0, "title": "Complex Transformations", "end_time": 750.0}, {"start_time": 750.0, "title": "Context", "end_time": 855.0}, {"start_time": 855.0, "title": "Materials", "end_time": 870.0}, {"start_time": 870.0, "title": "Libraries", "end_time": 922.0}, {"start_time": 922.0, "title": "Mock Data", "end_time": 929.0}, {"start_time": 929.0, "title": "Preview Data", "end_time": 951.0}, {"start_time": 951.0, "title": "Viewability Matrix", "end_time": 1021.0}, {"start_time": 1021.0, "title": "Fake Data", "end_time": 1033.0}, {"start_time": 1033.0, "title": "Jupyter", "end_time": 1517}], "like_count": 9, "channel_follower_count": 33300, "license": "Creative Commons Attribution license (reuse allowed)", "uploader_id": "@EuroPythonConference", "yt_tar_file": "/leonardo_work/EUHPC_E03_068/audio/fixed_download/grass-yt-cc-by//shard_10024/-Vlqwtbg1wg.tar.gz"}}