Learn Data with Bash Shell | Scientific Programmmer | Skillshare
Play Speed
  • 0.5x
  • 1x (Normal)
  • 1.25x
  • 1.5x
  • 2x
15 Videos (37m)
    • Class introduction

    • Exploring US University Ranks with Bash Shell (Data Preview)

    • Uniranks: Find the colleges in the ranklist (grep, pipe and wc)

    • Uniranks: Find the number of Institutes from a given and all states (cut and sort)

    • Uniranks: Finding the correlation between university tuition and ranks (tail and redirect)

    • Demonstration (Exploring US Uniranks)

    • Facebook data mining - Data preview (head command)

    • Facebook Data: Find the number of status and most popular status entry (cut, sort, grep, awk)

    • Facebook Data: Building a function to find the most vibrant Facebook status (Bash functions)

    • Facebook Data Mining (Demonstration)

    • Data mining Australian cities crime statistics (Data Preview)

    • AU Data: Finding rows and columns stats (wc, sed, csvstat)

    • AU Data: Finding the top most crime per city (awk)

    • Au Data: Finding the best city in Australia (Bash shell programming)

    • AU Crime Data Mining (Demonstration)


About This Class


This beginner friendly course is specifically designed to show you how to use Bash commands and shell programming to handle textual data which can be a csv format data or systems log file. In this course you will  learn Bash by doing projects. 

However, you need to understand the fact that Bash may not the best way to handle all kinds of data! But there often comes a time when you are provided with a pure Bash environment, such as what you get in the common Linux based Super-computers and you just want an early result or view of the data before you drive into the real programming, using Python, R and SQL, SPSS, and so on. Expertise in these data-intensive languages also comes at the price of spending a lot of time on them.

In contrast, bash scripting is simple, easy to learn and perfect for mining textual data! Particularly if you deal with genomics, microarrays, social networks, life sciences, and so on. It can help you to quickly sort, search, match, replace, clean and optimise various aspect of your data, and you wouldn’t need to go through any tough learning curves. We strongly believe, learning and using Bash shell scripting should be the first step if you want to say, Hello Big Data!

Authored by Ahmed Arefin, PhD and thankfully voiced by A. Collinwood (voice artist). This course is a core component of the 'Learn Scientific Programming' initiative.





  • --
  • Beginner
  • Intermediate
  • Advanced
  • All Levels
  • Beg/Int
  • Int/Adv


Community Generated

The level is determined by a majority opinion of students who have reviewed this class. The teacher's recommendation is shown until at least 5 student responses are collected.

Scientific Programmmer

Scientific Coding & Linux Expert

Learn Scientific Programming is an innovative E-Learning school that aims to demonstrate the use of scientific programming languages, e.g., Julia, OpenMP, MPI, C++, Matlab, Octave, Bash, Python Sed and AWK including RegEx in processing scientific and real-world data. 

We help you to solve large-scale science biological, engineering, and humanities problems, gain adequate understanding through the analysis of mathematical models imp...

See full profile

Report class