Complete Guide to Programming Automation with R and RStudio from Udemy

What's inside

Learning objectives

Automate tasks with r
Manipulate data from local, web and cloud sources
Read and write csv, txt, xlsx
Create formatted excel spreadsheets
Create dynamic reports (powerpoint, word, pdf, html)
Parse web and pdf files
Parse email content and attachments

Schedule automation - cloud or local
Send automated emails
Cloud solutions - dropbox and amazon s3
Github repository management
Linux server and aws ec2
Show more
Show less

Automate tasks with r
Manipulate data from local, web and cloud sources
Read and write csv, txt, xlsx
Create formatted excel spreadsheets
Create dynamic reports (powerpoint, word, pdf, html)
Parse web and pdf files
Parse email content and attachments
Schedule automation - cloud or local
Send automated emails
Cloud solutions - dropbox and amazon s3
Github repository management
Linux server and aws ec2
Show more
Show less

Syllabus

Introduction

Course Structure Overview

Install the necessary software to program in R

https://www.r-project.org/

Rstudio

https://www.rstudio.com/

R and RStudio: Base Commands and Interface

It is time to learn about packages in R and install some very useful ones necessary for this course.

Attached is a script which can help to install all packages at once.

Note for MAC OS

Please run brew install poppler before installing the package pdftools

Read and Transform Files using R and RStudio Programming

Overview of RStudio and Folder Navigation

The lecture covers basics functions that list files in folders, retrieve names, paths and perform sanity checks.

In this lecture we learn how to write simple loops to read all files and aggregate data:

For loop with itterations
Bind data by rows

In this lecture we learn how to work with data frames:

Remove duplicate lines
Extract information on content, type, data structures
Use pipe operator for clean code
Data type conversions (from String to Date)
Add or edit column data in a data frame

In this lecture we learn how to Analyze, Subset and Write Data:

Count by categories
Subset and filter by categories or by values
Create Folders
Write CSV files

In this lecture we learn how to Extract and Calculate Metrics from Data:

Subset by year/month
Pull values from a column
Compute sum, mean, median, max, min

Read Files of Different Formats

In this lecture we cover in detail the csv and txt formats, encodings, arguments to the functions.

In this lecture we learn how to read XLSX files:

Load Workbook and retrive Information
Load Data from Sheets

In this lesson we learn how to parse PDF files:

Parse content as text
Parse text using regex tools

Data from Web

In this lecture we learn how to Download Files from Web:

Download from URL
Read directly from URL

In this lecture we learn how to scrap tables from public webpages without any complex html tools.

In this lecture we learn how to read public files from Cloud locations:

Read open Google Sheets
Read open Dropbox Files

For private files please see the Extra lessons.

Parse Emails

In this lecture we learn how to configure the connection to the Email box:

IMAP configuration
Gmail security settings
List folders of an Email box

In this lecture we learn how to search emails:

Filtering by dates
Filtering by sender, recipients, keywords

In this lecture we learn how to manipulate the content of an email with Text Manipulation Tools

Retrive content using Text Patterns
Extract Values with String Manipulation functions

In this lecture we learn how to fetch the attachments from an Email.

Write Emails

In this lecture we learn how to configure the connection to an Email box.

In this lecture we learn how to create emails and send them:

Create Body and Title
Add styles to Body with HTML
Add attachments

Use all skills learned previously in one script

In this lecture we create a complex project in which we cover the skills we learned previously:

Create a Config file
Setup the Script

In this lecture we read and aggregate the data.

We also learn how to manipulate Date objects in R.

In this lecture we learn how to create a custom email:

Automatic subject text
Add text content to body
Add HTML table with CSS formatting

Formatted MS Excel Report

In this lecture we learn how to work with XLSX files:

Load or Create Excel Workbook
Save the files as XLSX
Write basic Data

In this lecture we learn how to Style content in a XLSX file:

Custom position of a Table
Format of Numbers and Dates
Custom Borders
Cell Font Size, Colors, Background, Alignment
Apply styles to specific Cells
Cell Height, Width

In this lecture we learn the Conditional Formatting feature:

Rule based on Value
Databar with custom Color

In this lecture we learn how to Create Excel with Multiple Pages and we go through some functions that aren't covered in details in this course.

Loop and Backward Loop
Sheet Visibility
File Paths

Extra functions.

Introduction to MS Powerpoint Reporting

In this lecture we learn how to create Powerpoint documents:

Read and Write Slide
Add slide with Content
Temporary Files

In this lecture we learn how to create nicely Formatted Content in our PowerPoint:

Add Title and Body Text
Format Text: Font, Size, Color
Paragraphs Formatting
Add Default Table
Add Flextable in Body

Introduction to MS Word Reporting

In this lecture we learn how to create nicely Formatted Content in our Word:

Format Text: Font, Size, Color
Paragraphs Formatting
Add Flextable in Body
Add Multiple Pages

Github

In this lecture we learn how to use Github and Git:

Create an Account
Create a Token
Install Git and connect to RStudio
Create a Repository

In this lecture we learn how to manage a Repository with Code:

Clone Repo to RStudio
Add Code, Commit and Push

Dropbox as Cloud Data Source

In this lecture we learn how to use Dropbox as a Cloud Data source:

Connect Account and Create Token
List Files and Download Locally
Upload Files from Local Drive

Complex Reporting Tool and Automation

In this lecture we aggregate previously learned skills and create a complex report with Email Body, Attachments and Dropbox as Data Source.

Automate and Schedule Job Locally

In this lecture we learn how to Schedule Tasks on a Windows machine:

Configure Scripts
Schedule Timed Tasks
Windows Options

Schedule Automation Job on Cloud - Advanced

In this lecture we learn how to work with Amazon Web Services:

Region Configuration
Free Tier Solutions
Overview of Services
Putty Software https://www.putty.org/

In this lecture we learn how to create a EC2 Instance:

Ubuntu Server
Overview of Instance Types
Configure New Instance
Create .pem Key
Convert Key using Puttyy
Connect using SSH
Install R Demo (optimal way covered in next lesson)

In this lecture we learn how to Configure R on a Server Automatically:

Install Ubuntu and R Libraries on Launch

In this lecture we learn how to work with the Linux Terminal:

Run R and R commands
Linux Commands to Navigate through Folders and Files
Clone Repo from Github
Run Rscripts
Update Folder with Git Pull

In this lecture we learn how to run complex script on the Server:

Install a Package Manually on Linux
Repository For Linux
Gmail Security on Linux
Configure Correctly the Paths to Folders
Amend Script and Push-Pull

In this lecture we learn how to schedule a CRON (scheduled repetitive tasks) in Linux:

Configure path to home
Create CRON Job
Configure schedule using crontab.guru
Task in Crontab
Linux Commands
Read Logs

Commands and Tricks

Store your Files on AWS

Create Formatted PDF Files

More Learning

Bonus Article - Learn More with Arkadi

Good to know

Know what's good

, what to watch for

, and possible dealbreakers

Taught by Arkadi Avanesyan, who is recognized for their work in automation, R programming, and finance

Develops core skills for finance, consulting, and banking

Teaches R programming, which is highly relevant in the finance

Covers a wide range of topics, including data manipulation, automation, and reporting

Provides hands-on practice through exercises and projects

Requires no prior knowledge of programming or R

Activities

Be better prepared before your course. Deepen your understanding during and after it. Supplement your coursework and achieve mastery of the topics covered in Complete Guide to Programming Automation with R and RStudio with these activities:

Review Basic Data Manipulation Techniques in R

Show steps

Mastering data manipulation is crucial in data automation tasks for any business. Take some time to refresh your mind with the basics you might have learned in previous courses.

Browse courses on Data Manipulation

Show steps

Refer to your study materials on data manipulation with R.
Go through practice exercises that involve loading, cleaning, and exploring datasets.

Connect with R Experts

Show steps

Seek guidance from experienced professionals in the R community. Mentors can provide valuable insights, support, and advice on your learning journey.

Browse courses on Mentorship

Show steps

Identify potential mentors through online platforms or professional networks.
Reach out to them, expressing your interest in their mentorship and outlining your learning goals.

Attend Meetups or Conferences on R and Automation

Show steps

Connect with other professionals in the field by attending meetups or conferences dedicated to R and automation. This will provide insights into industry trends and best practices.

Show steps

Research upcoming meetups or conferences related to R and automation.
Register and attend the events, actively participating in discussions and networking with attendees.

Two other activities

Expand to see all activities and additional details

Show all five activities

Automate Office Tasks with R

Show steps

To fully immerse yourself in automating office tasks with R, seek out tutorials that guide you through creating your own scripts.

Browse courses on Task Automation

Show steps

Research online tutorials on automating office tasks with R.
Follow along with the tutorials, practicing the steps and implementing them in your own scripts.

Practice Data Manipulation and Transformation in R

Show steps

Reinforce your understanding of data manipulation by engaging in practice drills that challenge you to solve data-related problems using R.

Browse courses on Data Manipulation

Show steps

Complete online coding challenges or exercises that focus on data manipulation in R.
Create your own datasets and practice manipulating and transforming them using R functions.

Career center

Learners who complete Complete Guide to Programming Automation with R and RStudio will develop knowledge and skills that may be useful to these careers:

Data Analyst

Data Analysts are responsible for collecting, cleaning, and analyzing data to help businesses make informed decisions. This course can help you develop the skills needed to be a successful Data Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Data Analysts.

See salaries and explore the career path for Data Analyst

Business Analyst

Business Analysts help businesses improve their performance by analyzing data and making recommendations. This course can help you develop the skills needed to be a successful Business Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Business Analysts.

See salaries and explore the career path for Business Analyst

Operations Research Analyst

Operations Research Analysts use mathematical and analytical techniques to solve problems in business and industry. This course can help you develop the skills needed to be a successful Operations Research Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Operations Research Analysts.

See salaries and explore the career path for Operations Research Analyst

Market Research Analyst

Market Research Analysts collect and analyze data to help businesses understand their customers and make better decisions. This course can help you develop the skills needed to be a successful Market Research Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Market Research Analysts.

See salaries and explore the career path for Market Research Analyst

Financial Analyst

Financial Analysts use data to make recommendations on investments and financial decisions. This course can help you develop the skills needed to be a successful Financial Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Financial Analysts.

See salaries and explore the career path for Financial Analyst

Software Engineer

Software Engineers design, develop, and maintain software applications. This course can help you develop the skills needed to be a successful Software Engineer, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Software Engineers.

See salaries and explore the career path for Software Engineer

Data Scientist

Data Scientists use data to solve problems and make predictions. This course can help you develop the skills needed to be a successful Data Scientist, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Data Scientists.

See salaries and explore the career path for Data Scientist

Web Developer

Web Developers design and develop websites. This course can help you develop the skills needed to be a successful Web Developer, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Web Developers.

See salaries and explore the career path for Web Developer

Database Administrator

Database Administrators manage and maintain databases. This course can help you develop the skills needed to be a successful Database Administrator, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Database Administrators.

See salaries and explore the career path for Database Administrator

Technical Writer

Technical Writers create documentation for software and other technical products. This course can help you develop the skills needed to be a successful Technical Writer, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Technical Writers.

See salaries and explore the career path for Technical Writer

Project Manager

Project Managers plan and execute projects. This course can help you develop the skills needed to be a successful Project Manager, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Project Managers.

See salaries and explore the career path for Project Manager

Systems Analyst

Systems Analysts analyze and design computer systems. This course can help you develop the skills needed to be a successful Systems Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Systems Analysts.

See salaries and explore the career path for Systems Analyst

Computer Programmer

Computer Programmers write and maintain computer programs. This course can help you develop the skills needed to be a successful Computer Programmer, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Computer Programmers.

See salaries and explore the career path for Computer Programmer

Quality Assurance Analyst

Quality Assurance Analysts test and evaluate software and other products to ensure they meet quality standards. This course can help you develop the skills needed to be a successful Quality Assurance Analyst, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Quality Assurance Analysts.

See salaries and explore the career path for Quality Assurance Analyst

Technical Support Specialist

Technical Support Specialists provide technical support to users of software and other products. This course can help you develop the skills needed to be a successful Technical Support Specialist, including how to read and write files from various sources, manipulate data, and create formatted reports. Additionally, you will learn how to use R and RStudio, which are popular tools used by Technical Support Specialists.

See salaries and explore the career path for Technical Support Specialist