# Free Stuff For Devs¶

Use Images, Text, Webarchive and Catalogue Data from the Austrian National Library in Jupyter Notebooks

Workshop 2019-05-03 - PyDays19

https://labs.onb.ac.at

https://labs.onb.ac.at/gitlab/labs-team/pydays19

Georg Petz, Stefan Karner - Austrian National Library

# 1 - Overview¶

https://labs.onb.ac.at

https://labs.onb.ac.at/gitlab/labs-team/pydays19

### What's gonna happen here?¶

- Part 1: Overview
  - What's this all about?
  - Who are these people?
  - What do I need?
  - How do we want to do this?
- Part 2: Metadata and Catalogue
- Part 3: Images and Text
- Part 4: Webarchive

### What's this all about?¶

- The Austrian National Library offers data, free to use
- We want to show you roughly what data you can expect
- We want to show you how to work with the data interfaces

#### Why?¶

- If you ever need this kind of data
- For fun
- If you do something interesting with ONB's assets, there's a good chance you get to present it at the ONB Labs symposium on the 13th of June 2019 live, if you want that

#### Data and Interfaces¶

- Metadata: catalogue data, metadata for historic postcards and historic newspapers, SPARQL
- Images and text: Text for historic newspapers, images and text for historic newspapers and historic postcards
- Webarchive: Saved Austrian pages from roughly 2009 up until now; search: yes, view: no

### Who are these people?¶

- Presenters

- Participants

#### What are you interested in?¶

### What do I need?¶

- The repository at https://labs.onb.ac.at/gitlab/labs-team/pydays19 in its freshest form
- A working Python3 installation
- A venv with the requirements installed
- A `jupyter notebook` running inside the venv

### How do we want to do this?¶

## Used Libraries¶

- requests - HTTP for humans https://2.python-requests.org/en/master/
- pandas - spreadsheets for Python on steroids https://pandas.pydata.org/
- jsonpath - xpath for json https://github.com/h2non/jsonpath-ng
- lxml - xml parser and xpath (version 1) implementation https://lxml.de/
- sickle - OAI-PMH for humans https://sickle.readthedocs.io/en/latest/
- pyswagger - dynamic OpenAPI / Swagger client https://github.com/pyopenapi/pyswagger
- sparqlwrapper - SPARQL endpoint interface to python https://rdflib.github.io/sparqlwrapper/