Looking for Patterns: understanding the role of the Data Librarian - 27th May 2013
Martinez-Uribe, Luis
Luis Martinez-Uribe explains the role of a Data Librarian through a use case where the Data Librarian recognizes patterns that allow for the development of scraping scripts to return PDFs of newspaper articles.
 As part of my role as a data librarian at the Institute of Juan March in Madrid, Spain, I help researchers in the creation of their data sets. The researchers that I'm working with is looking at how the identification of Catalonians in Spain is affected by the news in the newspapers. The challenge for the researcher here is to have all those front pages from the newspapers so that he can start doing the coding. What I'm doing to help is actually scripting a data scrapper that will actually download all those PDFs for the dates required for the front pages of those newspapers so that the researcher can actually use them without having to download them one by one. In order to do these, I use a web tool called Scrapper Weekend. That allows me to look for patterns in the websites that actually hold all those newspapers and identify the way in which they've actually coded their website and almost de-engineered that so that I can figure out the way in which they store the PDFs so that I can actually download them all. I guess the researcher is trying to see whether when this a lot of news with a negative connotation about the relationship between Spain and Catalonia, whether that actually has an effect on those opinion pools and that particular question that he's asking those opinion pools about the feeling of being Catalonia in Spain.
 As part of my role as a data librarian at the Institute of Juan March in Madrid, Spain,  I help researchers in the creation of their data sets. The researchers that I'm working with  is looking at how the identification of Catalonians in Spain is affected by the news in the newspapers.  The challenge for the researcher here is to have all those front pages from the newspapers so that  he can start doing the coding. What I'm doing to help is actually scripting a data scrapper that  will actually download all those PDFs for the dates required for the front pages of those  newspapers so that the researcher can actually use them without having to download them one by one.  In order to do these, I use a web tool called Scrapper Weekend. That allows me to look for  patterns in the websites that actually hold all those newspapers and identify the way in which  they've actually coded their website and almost de-engineered that so that I can  figure out the way in which they store the PDFs so that I can actually download them all.  I guess the researcher is trying to see whether when this a lot of news with a negative connotation  about the relationship between Spain and Catalonia, whether that actually has an effect  on those opinion pools and that particular question that he's asking those opinion pools  about the feeling of being Catalonia in Spain.
Looking_for_Patterns__understanding_the_role_of_the_Data_Librarian_03NhkXfjwds_0_1631.png Looking_for_Patterns__understanding_the_role_of_the_Data_Librarian_03NhkXfjwds_1632_2687.png Looking_for_Patterns__understanding_the_role_of_the_Data_Librarian_03NhkXfjwds_2688_2755.png
As part of my role as a data librarian at the Institute of Juan March in Madrid, Spain, I help researchers in the creation of their data sets. The researchers that I'm working with is looking at how the identification of Catalonians in Spain is affected by the news in the newspapers. The challenge for the researcher here is to have all those front pages from the newspapers so that he can start doing the coding. What I'm doing to help is actually scripting a data scrapper that will actually download all those PDFs for the dates required for the front pages of those newspapers so that the researcher can actually use them without having to download them one by one. In order to do these, I use a web tool called Scrapper Weekend. That allows me to look for patterns in the websites that actually hold all those newspapers and identify the way in which they've actually coded their website and almost de-engineered that so that I can figure out the way in which they store the PDFs so that I can actually download them all. I guess the researcher is trying to see whether when this a lot of news with a negative connotation about the relationship between Spain and Catalonia, whether that actually has an effect on those opinion pools and that particular question that he's asking those opinion pools about the feeling of being Catalonia in Spain.
As part of my role as a data librarian at the will actually download all those PDFs for the use them without having to download them one by for patterns in the websites that actually hold