<transcript><audio_180>so here are the six things that we need to worry about first we'll talk about why failures happen then we'll talk about buffer poool policies because that is at the heart of why we need to do these fancy new things and then talk about two different mechanisms Shadow</transcript><transcript><audio_181>paging and right ahead logging as a way of keeping track of changes that we make and I'll tell you Shadow paging is a bad idea it's what old system used to use it has all kinds of issues I would only touch upon it and then move to right ahead logging which is the main part that we need uh and then we'll talk</transcript><transcript><audio_182>about some of the logging schemes what do you put in these logs and then checkpointing so first is we're going to have to concern ourselves with these different storage types and we've talked about this I'm going to go to the next slide and come back to to it you</transcript><transcript><audio_183>remember this slide on the right that we had which is which talked about data is in different places and there's a reason why we are processor caches and dram and ssds and slow ssds and fast ssds because as you go down this hierarchy you get</transcript><transcript><audio_184>more capacity but it's also slower and you don't want to have all the data be in the lowest capacity let's say SSD or a spinning disc if you didn't have a buffer pool the database system would be very slow so we want to use the highest level which is going to be volatile</transcript><transcript><audio_185>storage which is Dam because that's where you want to make all of your changes that's fast uh but it's volatile the non-volatile storage the SST layer is where you want to make sure you make put your changes in there so</transcript> so here are the six things that we need to worry about first we'll talk about why failures happen then we'll talk about buffer poool policies because that is at the heart of why we need to do these fancy new things and then talk about two different mechanisms Shadow paging and right ahead logging as a way of keeping track of changes that we make and I'll tell you Shadow paging is a bad idea it's what old system used to use it has all kinds of issues I would only touch upon it and then move to right ahead logging which is the main part that we need uh and then we'll talk about some of the logging schemes what do you put in these logs and then checkpointing so first is we're going to have to concern ourselves with these different storage types and we've talked about this I'm going to go to the next slide and come back to to it you remember this slide on the right that we had which is which talked about data is in different places and there's a reason why we are processor caches and dram and ssds and slow ssds and fast ssds because as you go down this hierarchy you get more capacity but it's also slower and you don't want to have all the data be in the lowest capacity let's say SSD or a spinning disc if you didn't have a buffer pool the database system would be very slow so we want to use the highest level which is going to be volatile storage which is Dam because that's where you want to make all of your changes that's fast uh but it's volatile the non-volatile storage the SST layer is where you want to make sure you make put your changes in there so
{"source": "grass-yt-cc-by.-mY8ALcJVTk|shard_1_1|create_multimodal_data.extract_yt_and_generate_transcripts.62|shard_1|create_multimodal_data.generate_captions.62|shard_1|create_multimodal_data.generate_captions.62", "params": {"id": "-mY8ALcJVTk", "channel_id": "UCHnBsf2rH-K7pn09rb3qvkA", "duration": 5000, "view_count": 4483, "age_limit": 0, "like_count": 50, "channel_follower_count": 71100, "license": "Creative Commons Attribution license (reuse allowed)", "uploader_id": "@CMUDatabaseGroup", "yt_tar_file": "/leonardo_work/EUHPC_E03_068/audio/fixed_download/grass-yt-cc-by//shard_1/-mY8ALcJVTk.tar.gz"}}