Welcome! If you want to start diving into data science and statistics, then data frames, CSV files, and R will be essential tools for you. Let’s see how you can use their amazing capabilities.
In this article, you will learn:
We will use RStudio, an open-source IDE (Integrated Development Environment) to run the examples.
Let’s begin! 🔅
CSV (Comma-separated Values) files can be considered one of the building blocks of data analysis because they are used to store data represented in the form of a table. In this file, values are separated by commas to represent the different columns of the table, like in this example:
CSV File
We will generate this file using Google Sheets.
Let’s create your first CSV file using Google Sheets.
Step 1: Go to the Google Sheets Website and click on “Go to Google Sheets”:
💡 Tip: You can access Google Sheets by clicking on the button located at the top-right edge of Google’s Home Page:
If we zoom in, we see the “Sheets” button:
💡 Tip: To use Google Sheets, you need to have a Gmail account. Alternatively, you can create a CSV file using MS Excel or another spreadsheet editor.
You will see this panel:
Step 2: Create a blank spreadsheet by clicking on the “+” button.
Now you have a new empty spreadsheet:
Step 3: Change the name of the spreadsheet to students_data
. We will need to use the name of the file to work with data frames. Write the new name and click enter to confirm the change.
Step 4: In the first row of the spreadsheet, write the titles of the columns.
When you import a CSV file in R, the titles of the columns are called variables. We will define six variables: first_name
, last_name
, age
, num_siblings
, num_pets
, and eye_color
, as you can see right here below:
💡 Tip: Notice that the names are written in lowercase and words are separated with an underscore. This is not mandatory, but since you will need to access these names in R, it’s very common to use this format.
Step 5: Enter the data for each one of the columns.
When you read the file in R, each row is called an observation, and it corresponds to data taken from an individual, animal, object, or entity that we collected data from.
In this case, each row corresponds to the data of a student:
Step 6: Download the CSV file by clicking on File -> Download -> Comma-separated values
, as you can see below:
Step 7: Rename the file CSV file. You will need to remove “Sheet1” from the default name because Google Sheet will automatically add this to the name of the file.
Great work! Now you have your CSV file and it’s time to start working with it in R.
In RStudio, the first step before reading a CSV file is making sure that your current working directory is the directory where the CSV file is located.
💡 Tip: If this is not the case, you will need to use the full path to the file.
You can change your current working directory in this panel:
If we zoom in, you can see the current path (1) and select the new one by clicking on the ellipsis (...
) button to the right (2):
💡 Tip: You can also check your current working directory with getwd()
in the interactive console.
Then, click “More” and “Set As Working Directory”.
Once you have your current working directory set up, you can read the CSV file with this command:
In R code, we have this:
> students_data <- read.csv("students_data.csv")
💡 Tip: We assign it to the variable students_data
to access the data of the CSV file with this variable. In R, we can separate words using dots .
, underscores _
, UpperCamelCase
, or lowerCamelCase
.
After running this command, you will see this in the top right panel:
Now you have a variable defined in the environment!Let’s see what data frames are and how they are closely related to CSV files.
Data frames are the standard digital format used to store statistical data in the form of a table. When you read a CSV file in R, a data frame is generated.
We can confirm this by checking the type of the variable with the class
function:
> class(students_data)
[1] "data.frame"
It makes sense, right? CSV files contain data represented in the form of a table and data frames represent that tabular data in your code, so they are deeply connected.
If you enter this variable in the interactive console, you will see the content of the CSV file:
> students_data
first_name last_name age num_siblings num_pets eye_color
1 Emily Dawson 15 2 5 BLUE
2 Rose Patterson 14 5 0 GREEN
3 Alexander Smith 16 0 2 BROWN
4 Nora Navona 16 4 10 GREEN
5 Gino Sand 17 3 8 BLUE
You have several different alternatives to see the number of variables and observations of the data frame:
nrow
and ncol
in the interactive console or in your program, passing the data frame as argument. We get the same results: 5 rows and 6 columns.> nrow(students_data)
[1] 5
> ncol(students_data)
[1] 6
str
function:> str(students_data)
'data.frame': 5 obs. of 6 variables:
$ first_name : Factor w/ 5 levels "Alexander","Emily",..: 2 5 1 4 3
$ last_name : Factor w/ 5 levels "Dawson","Navona",..: 1 3 5 2 4
$ age : int 15 14 16 16 17
$ num_siblings: int 2 5 0 4 3
$ num_pets : int 5 0 2 10 8
$ eye_color : Factor w/ 3 levels "BLUE","BROWN",..: 1 3 2 3 1
This function (applied to a data frame) tells you:
You can see that this function is really great when you want to know more about the data that you are working with.
💡 Tip: In R, a “Factor” is a qualitative variable, which is a variable whose values represent categories. For example, eye_color
has the values "BLUE"
, "BROWN"
, "GREEN"
which are categories, so as you can see in the output of str
above, this variable is automatically defined as a “factor” when the CSV file is read in R.
Now you know how to see more information about the data frame. But the magic of data frames lies in the amazing capabilities and functionality that they offer, so let’s see this in more detail.
Data frames are like matrices, so you can access individual values using two indices surrounded by square brackets and separated by a comma to indicate which rows and which columns you would like to include in the result, like this:
For example, if we want to access the value of eye_color
(column 6) of the fourth student in the data (row 4):
We need to use this command:
> students_data[4, 6]
💡 Tip: In R, indices start at 1
and the first row with the names of the variables is not counted.
This is the output:
[1] GREEN
Levels: BLUE BROWN GREEN
You can see that the value is "GREEN"
. Variables of type “factor” have “levels” that represent the different categories or values that they can take. This output tells us the levels of the variable eye_color
.
We can also use this syntax to access a range of rows and columns to get a portion of the original matrix, like this:
For example, if we want to get the age and number of siblings of the third, fourth, and fifth student in the list, we would use:
> students_data[3:5, 3:4]
age num_siblings
3 16 0
4 16 4
5 17 3
💡 Tip: The basic syntax to define an interval in R is <start>:<end>
. Note that these indices are inclusive, so the third and fifth elements are included in the example above when we write 3:5
.
If we want to get all the rows or columns, we simply omit the interval and include the comma, like this:
> students_data[3:5,]
first_name last_name age num_siblings num_pets eye_color
3 Alexander Smith 16 0 2 BROWN
4 Nora Navona 16 4 10 GREEN
5 Gino Sand 17 3 8 BLUE
We did not include an interval for the columns after the comma in students_data[3:5,]
, so we get all the columns of the data frame for the three rows that we specified.
Similarly, we can get all the rows for a specific range of columns if we omit the rows:
> students_data[, 1:3]
first_name last_name age
1 Emily Dawson 15
2 Rose Patterson 14
3 Alexander Smith 16
4 Nora Navona 16
5 Gino Sand 17
💡 Tip: Notice that you still need to include the comma in both cases.
There are three ways to access an entire column:
For example:
> students_data["first_name"]
first_name
1 Emily
2 Rose
3 Alexander
4 Nora
5 Gino
💡 Tip: Notice the use of the $
symbol.
For example:
> students_data$first_name
[1] Emily Rose Alexander Nora Gino
Levels: Alexander Emily Gino Nora Rose
> students_data[["first_name"]]
[1] Emily Rose Alexander Nora Gino
Levels: Alexander Emily Gino Nora Rose
#r #data-science #machine-learning