A general-purpose programming language widely used for data science, machine learning, web development, and automation. It acts as the glue that connects data libraries and tools.

A web-based interactive environment where you combine code, text, and outputs (tables, charts) in one document, supporting experimentation, storytelling, and reproducible analysis.

A core Python library for fast numerical computing, providing efficient n-dimensional arrays and vectorized operations. Many other data libraries are built on top of it.

A Python library for working with tabular data (DataFrames). It is used for loading, cleaning, transforming, and summarizing data from sources like CSV, Excel, and SQL.

A plotting library for creating charts such as line, bar, histogram, and scatter plots. It is the foundation for many higher-level visualization tools.

A Python library that provides fast, efficient arrays and numerical operations for scientific computing.

A general-purpose programming language that is popular for data science, machine learning, web development, and automation.

A Python library for working with tabular data, offering DataFrame and Series structures for data cleaning and analysis.

A 2D labeled data structure in pandas, similar to a spreadsheet or SQL table, with rows and columns.

Meet the Tools: Python, Jupyter, and Core Data Libraries — Data Science Foundations: From Raw Data to Insight

Big Picture: Why These Tools Matter

From Ideas to Tools

You have seen how messy questions become data problems, and how analytics, machine learning, and AI differ. Now we zoom in on the tools that make those ideas work in practice.

Kitchen Analogy

Imagine a data project like cooking: your computer is the kitchen, Python is the language of recipes, Jupyter is your cooking journal, and libraries are your knives, pans, and blender.

What You Will Get

In this short module you will not write code. Instead, you will learn where Python fits, what Jupyter feels like, and what libraries like NumPy, pandas, Matplotlib, and scikit-learn roughly do.

Why Python for Data Science?

Python Dominance

As of 2026, Python is one of the most widely used languages in data science and machine learning. It is often chosen as a first language for beginners.

Readable and Friendly

Python code is relatively readable and close to plain English. This makes it easier to learn, and easier for teams to share and review each other's work.

Rich Ecosystem

Python has a huge ecosystem of open-source libraries for data: NumPy, pandas, Matplotlib, scikit-learn, TensorFlow, PyTorch, and many others built over the last decade.

General-Purpose Power

Python is not just for stats. You can clean data, build web apps, automate reports, and connect to cloud AI services all in the same language.

Other Languages

You will still use SQL for databases, maybe R in some fields, and might hear about Julia. But for most beginners in 2026, Python is the most practical starting point.

A Day in the Life: Python in a Data Project

The Business Question

Your manager asks: Are weekend discounts increasing sales, or just moving purchases from weekdays? You decide to explore this using Python.

From Data to Notebook

You pull order data from a database with SQL, then open a Jupyter notebook named `weekenddiscountsanalysis` to document your work and results.

pandas and NumPy in Action

Using pandas, you load the CSV, inspect columns, clean dates, and label orders as weekend or weekday. With pandas and NumPy, you compute averages and percent changes.

Visuals and Models

With Matplotlib, you plot daily sales and highlight weekends. With scikit-learn, you try a simple regression model to see if discounts plus weekends affect sales.

Storytelling

You write explanations between code cells, so the notebook becomes a readable report you can share with your manager as HTML or PDF.

Jupyter Notebooks: Your Interactive Lab Notebook

What is a Jupyter Notebook?

A Jupyter notebook is a web-based tool where you mix code cells, text cells, and outputs like tables and charts, all in one document that runs in your browser.

Interactive Cells

You run code cell by cell, change a line, and instantly see new results. This makes notebooks ideal for exploring data and trying out ideas quickly.

Story plus Code

Because you can add headings, text, and equations between code, a notebook becomes a readable story: question, method, results, and conclusions.

Reproducible Work

If someone runs your notebook cells in order with the same data, they should get the same outputs. This supports scientific and business transparency.

Where Notebooks Live

As of 2026, notebooks run locally via JupyterLab or VS Code, and in the cloud via services like Google Colab, Kaggle Notebooks, or university JupyterHub servers.

What a Simple Notebook Might Look Like

You do not need to understand the code yet. Just focus on how code, text, and output appear together in a Jupyter notebook.

Below is a tiny example of what three cells in a notebook might look like when exploring monthly sales data.

Cell 1: a text cell describing the goal.

```markdown

Monthly Sales Exploration

Goal: Compare average monthly sales for 2024 before and after the new marketing campaign.

```

Cell 2: a code cell loading and summarizing data.

```python

import pandas as pd

sales = pd.readcsv("monthlysales_2024.csv")

sales.head()

```

Expected output (shown below the code cell):

```text

month revenue campaign_active

0 1 12000 0

1 2 13500 0

2 3 14000 0

3 4 16000 1

4 5 18000 1

```

Cell 3: a code cell making a simple chart.

```python

import matplotlib.pyplot as plt

plt.plot(sales["month"], sales["revenue"])

plt.xlabel("Month")

plt.ylabel("Revenue ($)")

plt.title("Monthly Revenue in 2024")

plt.show()

```

Below this cell, the notebook would show a line chart of revenue by month. In a real notebook, you would add more text cells explaining what you see.

Notice how the notebook combines:

A heading and goal (text)
Data loading (code)
A table preview (output)
A chart (output)

all in one place.

NumPy: Fast Number-Crunching Engine

What is NumPy?

NumPy is a core Python library for fast numerical computing. It adds efficient n-dimensional arrays and math operations that are much faster than plain Python lists.

Arrays and Speed

NumPy arrays store numbers compactly in memory and support vectorized operations, where you apply math to whole arrays at once instead of looping in Python.

Under the Hood

Many other tools, like pandas, scikit-learn, and deep learning libraries, are built on top of NumPy arrays. When you use them, you are often using NumPy indirectly.

Everyday Use

Think of having a year's daily temperatures in one array. With NumPy, you can compute averages or convert all values from Celsius to Fahrenheit in a single step.

pandas: Tables and Data Cleaning

What is pandas?

pandas is a Python library for working with tabular data, like spreadsheets or database tables. Its main structure, the DataFrame, holds rows and columns with labels.

Input and Output

With pandas you can read data from CSV, Excel, SQL, JSON, and more, and write cleaned data back out. It is your main tool for getting data in and out of Python.

Cleaning Messy Data

pandas helps you handle missing values, fix data types, filter rows, select columns, and merge tables. This is crucial because real data is often messy.

Summaries and Groups

You can quickly compute summary stats, group by categories like country or month, and make pivot tables to reshape your data for analysis.

Everyday Scenario

Given orders with date, customer, country, and amount, pandas lets you find total revenue per country, average order size by month, and unique customers per quarter.

Matplotlib: Visualizing Your Data

What is Matplotlib?

Matplotlib is a Python library for making charts and figures. It helps you turn tables of numbers into visual stories that reveal patterns and trends.

Types of Plots

With Matplotlib you can create line charts, bar charts, histograms, and scatter plots, which cover many common analysis and reporting needs.

Customizing Figures

You can change titles, labels, colors, and markers to make your plots clear and professional, suitable for reports or presentations.

Under Other Tools

Higher-level libraries like Seaborn and pandas plotting often rely on Matplotlib under the hood, so learning its basics pays off widely.

scikit-learn: Classic Machine Learning Toolkit

What is scikit-learn?

scikit-learn is a Python library for classic machine learning: regression, classification, clustering, and model evaluation, not deep learning.

Fit and Predict

Most scikit-learn models use the same pattern: you create a model, `fit` it on training data, then call `predict` to get outputs on new data.

Algorithms and Tools

It includes many algorithms plus utilities for train-test splits, cross-validation, metrics, and pipelines that combine preprocessing and modeling.

Typical Use Case

Given customer data and a label like "responded to promotion", you can build a classifier that scores new customers on how likely they are to respond.

Activity: Match the Tool to the Task

Read each task below and decide which tool is most central: Python (as a language), Jupyter, NumPy, pandas, Matplotlib, or scikit-learn.

Write down your answers, then compare with the suggested ones.

You want to share a document that mixes explanations, code, and charts, so your teammate can rerun everything step by step.
You have a CSV of 100,000 rows of customer orders and need to clean missing values and compute total revenue per country.
You want to predict tomorrow's sales based on features like day of week, holiday flag, and recent sales history.
You have a large array of sensor readings (millions of numbers) and need to quickly compute averages and standard deviations.
You want to see whether revenue jumped after a new marketing campaign by plotting daily revenue for the last six months.
You want a general language that lets you connect to databases, call APIs, and glue all these libraries together.

Suggested answers (do not peek until you try):

Jupyter
pandas
scikit-learn
NumPy
Matplotlib
Python (the language)

Check Understanding: Core Concepts

Answer this question to check your understanding of how the tools fit together.

In a typical data science project using Python, which description is most accurate?

Jupyter cleans the data, pandas trains models, and Matplotlib stores the results.
Python is the language; Jupyter is the interactive environment; pandas handles tables; Matplotlib makes plots; scikit-learn trains classic ML models.
NumPy replaces Python, Jupyter, and pandas so you only need one tool for everything.

Show Answer

Answer: B) Python is the language; Jupyter is the interactive environment; pandas handles tables; Matplotlib makes plots; scikit-learn trains classic ML models.

Option 2 is correct. Python is the programming language. Jupyter is the interactive notebook environment. pandas focuses on tabular data and cleaning. Matplotlib creates visualizations. scikit-learn provides classic machine learning models and evaluation tools. NumPy underpins numerical operations but does not replace all the others.

Review Key Terms

Use these flashcards to reinforce the main tools and their roles.

Python: A general-purpose programming language widely used for data science, machine learning, web development, and automation. It acts as the glue that connects data libraries and tools.
Jupyter Notebook: A web-based interactive environment where you combine code, text, and outputs (tables, charts) in one document, supporting experimentation, storytelling, and reproducible analysis.
NumPy: A core Python library for fast numerical computing, providing efficient n-dimensional arrays and vectorized operations. Many other data libraries are built on top of it.
pandas: A Python library for working with tabular data (DataFrames). It is used for loading, cleaning, transforming, and summarizing data from sources like CSV, Excel, and SQL.
Matplotlib: A plotting library for creating charts such as line, bar, histogram, and scatter plots. It is the foundation for many higher-level visualization tools.
scikit-learn: A Python library for classical machine learning, offering algorithms for regression, classification, clustering, and tools for model evaluation and pipelines.
DataFrame: The main pandas table structure: a two-dimensional grid of data with labeled rows and columns, similar to a spreadsheet or SQL table.

Key Terms

NumPy: A Python library that provides fast, efficient arrays and numerical operations for scientific computing.
Python: A general-purpose programming language that is popular for data science, machine learning, web development, and automation.
pandas: A Python library for working with tabular data, offering DataFrame and Series structures for data cleaning and analysis.
DataFrame: A 2D labeled data structure in pandas, similar to a spreadsheet or SQL table, with rows and columns.
Matplotlib: A Python plotting library used to create static, animated, and interactive visualizations such as line and bar charts.
scikit-learn: A Python library for classical machine learning algorithms and tools, including regression, classification, clustering, and model evaluation.
Jupyter Notebook: An interactive, browser-based document that can contain code, text, and outputs, used for data exploration and reporting.
Vectorized Operation: An operation applied to an entire array or column at once, rather than looping through individual elements in Python code.