<transcript><audio_100>bit you know about kind of the the differences uh between in memory versus disk based processing for this class we're focusing exclusively on disk based processing so uh these these function call overheads</transcript><transcript><audio_101>don't really matter for us they're masked by disk io stuff but um when you're in memory those those sorts of overheads start to add up so the other other side of things um it's less good for olap queries because these they typically have really large intermediate results you have to compute</transcript><transcript><audio_102>you know an entire join materialize that that can grow quite large uh so there are some systems that do it for example monetb um it has these these vectorized operator at a time uh processing engine and basically it will</transcript><transcript><audio_103>do uh so it's a it's a column store dsm store and basically it will operate on an entire column produce that output and then that column will be the input to a</transcript><transcript><audio_104>so the the question is is the materialization model easier to work with if you want to aggressively pre-fetch pages uh i think probably it makes prefetching</transcript><transcript><audio_105>easier if everything's sort of a sequential scan but i think the the drawback is it depends on how much um room you have in your buffer pool uh in memory to to handle stuff because if you imagine you know if i have to materialize</transcript> bit you know about kind of the the differences uh between in memory versus disk based processing for this class we're focusing exclusively on disk based processing so uh these these function call overheads don't really matter for us they're masked by disk io stuff but um when you're in memory those those sorts of overheads start to add up so the other other side of things um it's less good for olap queries because these they typically have really large intermediate results you have to compute you know an entire join materialize that that can grow quite large uh so there are some systems that do it for example monetb um it has these these vectorized operator at a time uh processing engine and basically it will do uh so it's a it's a column store dsm store and basically it will operate on an entire column produce that output and then that column will be the input to a so the the question is is the materialization model easier to work with if you want to aggressively pre-fetch pages uh i think probably it makes prefetching easier if everything's sort of a sequential scan but i think the the drawback is it depends on how much um room you have in your buffer pool uh in memory to to handle stuff because if you imagine you know if i have to materialize
{"source": "grass-yt-cc-by.0K0kI1H2KTE|shard_1004_48|create_multimodal_data.extract_yt_and_generate_transcripts.60|shard_1004|create_multimodal_data.generate_captions.50|shard_1004|create_multimodal_data.generate_captions.55", "params": {"id": "0K0kI1H2KTE", "channel_id": "UCHnBsf2rH-K7pn09rb3qvkA", "duration": 4701, "view_count": 4624, "age_limit": 0, "chapters": [{"start_time": 0.0, "title": "Introduction", "end_time": 108.0}, {"start_time": 108.0, "title": "Recap", "end_time": 278.0}, {"start_time": 278.0, "title": "Overview", "end_time": 435.0}, {"start_time": 435.0, "title": "Iterator", "end_time": 709.0}, {"start_time": 709.0, "title": "Runthrough", "end_time": 846.0}, {"start_time": 846.0, "title": "Iterator Approach", "end_time": 1104.0}, {"start_time": 1104.0, "title": "Materialization Approach", "end_time": 1581.0}, {"start_time": 1581.0, "title": "Vectorization Approach", "end_time": 2253.0}, {"start_time": 2253.0, "title": "Vectorization Model", "end_time": 2475.0}, {"start_time": 2475.0, "title": "Query Processing Models", "end_time": 2606.0}, {"start_time": 2606.0, "title": "Access Methods", "end_time": 2701.0}, {"start_time": 2701.0, "title": "Sequential Scan", "end_time": 2796.0}, {"start_time": 2796.0, "title": "Optimizations", "end_time": 2915.0}, {"start_time": 2915.0, "title": "Zone Maps", "end_time": 3180.0}, {"start_time": 3180.0, "title": "Late Materialization", "end_time": 3302.0}, {"start_time": 3302.0, "title": "Index Scan", "end_time": 3388.0}, {"start_time": 3388.0, "title": "Index Scan Example", "end_time": 3507.0}, {"start_time": 3507.0, "title": "Multiindex Scan Example", "end_time": 4701}], "like_count": 46, "channel_follower_count": 71100, "license": "Creative Commons Attribution license (reuse allowed)", "uploader_id": "@CMUDatabaseGroup", "yt_tar_file": "/leonardo_work/EUHPC_E03_068/audio/fixed_download/grass-yt-cc-by//shard_1004/0K0kI1H2KTE.tar.gz"}}