University of Gonder

24 September - 25 September, 2018

9:00 am - 5:00 pm

Instructors: Alehegn Adane, Dagim Yoseph, Mesfin Diro

Helpers: TBA

Ethiopian Research and Education Network The Education Strategy Center Deutsche Gesellschaft für Internationale Zusammenarbeit

General Information

Library Carpentry is made by librarians to help you:

Library Carpentry introduces you to the fundamentals of computing and provides you with a platform for further self-directed learning.

Who: The course is for those in charge to work or intentended to work with digital libraries, faculty and university repositories and other information workers. You don't need to have any previous knowledge of the tools that will be presented at the workshop.

Where: University of Gonder. Get directions with OpenStreetMap or Google Maps.

When: 24 September - 25 September, 2018. Add to your Google Calendar.

Requirements: Participants must bring a laptop with a Mac, Linux, or Windows operating system (not a tablet, Chromebook, etc.) that they have administrative privileges on. They should have a few specific software packages installed (listed below). They are also required to abide by Library Carpentry's Code of Conduct.

Contact: Please email mesfin.diro@aau.edu.et for more information.

Schedule

Surveys

Ask your instructor about pre- and post-workshop Survey details.

Day 1

09:00 Data Intro for Librarians
10:30 Coffee
11:00 Data Intro ...
12:30 Lunch break
13:30 Shell Lessons for Libraries
14:30 Coffee
15:00 Shell Lessons ...
16:00 Wrap-up
17:00 END

Day 2

09:00 Intro to Git
10:30 Coffee
11:00 Intro to Git ...
12:30 Lunch break
13:30 SQL for Librarians
14:30 Coffee
15:00 SQL for ...
16:30 Wrap-up
17:00 END

We will use this collaborative document for chatting, taking notes, and sharing URLs and bits of code.

Syllabus

Data Intro

  • Intro to data
  • Jargon busting
  • Keyboard shortcuts
  • Plain text formats
  • Naming files
  • Regular expressions
  • Reference...

The Unix Shell

  • Files and directories
  • History and tab completion
  • Counting and sorting contents in files
  • Pipes and redirection
  • Mining or searching in files
  • Reference...

Tidy data with Spreadsheet

  • Using spreadsheet programs for data wrangling
  • Formatting data tables in Spreadsheets
  • Formatting problems
  • Dates as data
  • Basic quality assurance and control, and data manipulation in spreadsheets
  • Exporting data from spreadsheets
  • Caveats of popular data and file formats
  • Reference...

Open Refine

Managing Data with SQL

  • Reading and sorting data
  • Filtering with where
  • Calculating new values on the fly
  • Handling missing values
  • Combining values using aggregation
  • Combining information from multiple tables using join
  • Creating, modifying, and deleting data
  • Programming with databases
  • Reference...

Requirements: Library Carpentry's teaching is hands-on, so participants are encouraged to bring in and use their own laptops to insure the proper setup of tools for an efficient workflow once you leave the workshop. (We will provide instructions on setting up the required software several days in advance) There are no pre-requisites, and we will assume no prior knowledge about the tools.

Software Setup

To participate in a Library Carpentry workshop, you will need working copies of the software described below. Please make sure to install everything and try opening it to make sure it works before the start of your workshop. If you run into any problems, please feel free to email the instructor or arrive early to your workshop on the first day. Participants should bring and use their own laptops to insure the proper setup of tools for an efficient workflow once you leave the workshop.

We maintain a list of common issues that occur during installation as a reference for instructors that may be useful on the Configuration Problems and Solutions wiki page.

A spreadsheet program

For this workshop you will need a spreadsheet program. Many people already have Microsoft Excel installed, and if you do, you're set! If you need a spreadsheet program, there are a few other options, like OpenOffice and LibreOffice. Install instructions for LibreOffice, which is free and open source, are here.

Windows

  1. Download the LibreOffice installer.
  2. Double click to install
  3. Double click on icon to open.

Mac OS X

  1. Download the LibreOffice installer.
  2. Double click to install
  3. Double click on icon to open.

Linux

  1. Download the LibreOffice installer.
  2. Double click to install
  3. Double click on icon to open.

OpenRefine

OpenRefine (previously Google Refine) is a tool for data cleaning that runs through a web browser, and any browser - Safari, Firefox, Chrome, Explorer - should work fine. You will need to download OpenRefine and install it, and when you open it, it will run through the browser, but you don't need an internet connection, and the data will all be stored on your computer.

Windows

  1. Download OpenRefine Windows kit installer.
  2. To use it, unzip, and double-click on openrefine.exe (if you're having issues with openrefine.exe try refine.bat instead)
  3. OpenRefine will then open in your web browser.
  4. If it doesn't open automatically, open a web broswer after you've started the program and go to the URL http://localhost:3333 and you should see OpenRefine.

Mac OS X

  1. Download OpenRefine Mac kit installer.
  2. Open the downloaded .dmg file
  3. Drag the icon in to the Applications folder
  4. Double click on the icon and Google Refine will then open in your web browser.
  5. If it doesn't open automatically, open a web broswer after you've started the program and go to the URL http://localhost:3333 and you should see OpenRefine.

Linux

  1. Download OpenRefine Linux kit installer.
  2. To use it, extract, and type ./refine
  3. OpenRefine will then open in your web browser.
  4. If it doesn't open automatically, open a web broswer after you've started the program and go to the URL http://localhost:3333 and you should see OpenRefine.

Text Editor

When you're writing code, it's nice to have a text editor that is optimized for writing code, with features like automatic color-coding of key words. The default text editor on Mac OS X and Linux is usually set to Vim, which is not famous for being intuitive. if you accidentally find yourself stuck in it, try typing the escape key, followed by :q! (colon, lower-case 'q', exclamation mark), then hitting Return to return to the shell.

Windows

Video Tutorial

nano is a basic editor and the default that instructors use in the workshop. To install it, download the Software Carpentry Windows installer and double click on the file to run it. This installer requires an active internet connection.

Others editors that you can use are Notepad++ or Sublime Text. Be aware that you must add its installation directory to your system path. Please ask your instructor to help you do this.

Mac OS X

nano is a basic editor and the default that instructors use in the workshop. See the Git installation video tutorial for an example on how to open nano. It should be pre-installed.

Others editors that you can use are Text Wrangler or Sublime Text.

Linux

nano is a basic editor and the default that instructors use in the workshop. It should be pre-installed.

Others editors that you can use are Gedit, Kate or Sublime Text.

The Bash Shell

Bash is a commonly-used shell that gives you the power to do simple tasks more quickly.

Windows

Video Tutorial
  1. Download the Git for Windows installer.
  2. Run the installer and follow the steps bellow:
    1. Click on "Next".
    2. Click on "Next".
    3. Keep "Use Git from the Windows Command Prompt" selected and click on "Next". If you forgot to do this programs that you need for the workshop will not work properly. If this happens rerun the installer and select the appropriate option.
    4. Click on "Next".
    5. Keep "Checkout Windows-style, commit Unix-style line endings" selected and click on "Next".
    6. Keep "Use Windows' default console window" selected and click on "Next".
    7. Click on "Install".
    8. Click on "Finish".
  3. If your "HOME" environment variable is not set (or you don't know what this is):
    1. Open command prompt (Open Start Menu then type cmd and press [Enter])
    2. Type the following line into the command prompt window exactly as shown:

      setx HOME "%USERPROFILE%"

    3. Press [Enter], you should see SUCCESS: Specified value was saved.
    4. Quit command prompt by typing exit then pressing [Enter]

This will provide you with both Git and Bash in the Git Bash program.

Mac OS X

The default shell in all versions of Mac OS X is Bash, so no need to install anything. You access Bash from the Terminal (found in /Applications/Utilities). See the Git installation video tutorial for an example on how to open the Terminal. You may want to keep Terminal in your dock for this workshop.

Linux

The default shell is usually Bash, but if your machine is set up differently you can run it by opening a terminal and typing bash. There is no need to install anything.

The SQLite

DB Browser for SQLite

You will need to install DB Browser for SQLite to complete these lessons. DB Browser for SQLite provides a graphical user interface for connecting to and interacting with a SQLite database. This application bundles SQLite, so you won’t need to install SQLite separately.

Note: on Windows, the PortableApp download is recommended as the regular version may take a long time to install on certain systems.

SQLite

This step is optional. If you are completing the tutorial with DB Browser for SQLite, you won’t need to install SQLite separately. If you would like to run SQLite commands directly on the command line, you may need to install SQLite separately.

Linux and Mac OS x

SQLite command line tools come preinstalled on Linux and Mac OS x.

In order to check they are available type sqlite3 at the terminal command line. To exit type .exit.

Windows

On Windows download the Windows Installer Copy the file to a directory and open the directory using the windows command line. Type sqlite3.

For a more detailed explanation see this tutorial.