You are viewing a public preview
Sign in to save your progress, do assignments, join discussions and get feedback.
This page restates the official course syllabus prepared by the instructor (draft of 7 November 2026). The course code and the alignment with programme learning outcomes (PLOs) are still to be completed by the responsible unit, so they are not shown here.
| Item | Detail |
|---|---|
| Course title | Data Cleaning and Preprocessing with Python |
| Programme | MICRO4ASIA micro-credential |
| Credits | 1 |
| Class time | 15 periods, organised as 5 sessions of 3 periods |
| Allocation | 7.5 periods of theory and instruction; 7.5 periods of practice, discussion and assessment |
| Prerequisite | Python Programming for Data Science |
| Instructor | Dr Tran Duc Minh — minhdt@neu.edu.vn |
| Faculty | Faculty of Data Science and Artificial Intelligence, College of Technology, National Economics University |
This course equips you with foundational techniques for exploring, cleaning, preprocessing and interpreting data with Python. You use Pandas, NumPy, Matplotlib and Seaborn to examine tabular data, apply descriptive statistics and visualisation, address data quality issues and prepare data for reporting. Through a sales case study, you develop a rerunnable data processing workflow, validate the results and formulate evidence-based observations that support problem-solving in organisations.
| Goal | Description |
|---|---|
| G1 | Understand data quality and use Python to load and examine tabular data. |
| G2 | Apply descriptive statistics and visualisation to explore data. |
| G3 | Select and implement data cleaning techniques based on business context. |
| G4 | Perform preprocessing and create variables appropriate to the analytical objectives. |
| G5 | Develop a rerunnable workflow, validate outputs and report findings. |
| CLO | Learning outcome | Bloom level |
|---|---|---|
| CLO1.1 | Explain the role of data quality and distinguish completeness, validity, consistency, uniqueness and accuracy. | 2 – Understand |
| CLO1.2 | Read CSV/Excel files, examine data structure and profile data quality using Pandas. | 3 – Apply |
| CLO2.1 | Calculate and interpret the mean, median, standard deviation, quantiles and IQR as appropriate to the data. | 3 – Apply |
| CLO2.2 | Analyse distributions, group differences and relationships using charts, summary tables and correlation. | 4 – Analyse |
| CLO3.1 | Handle missing values, duplicate records and inconsistent labels using explicit rules. | 3 – Apply |
| CLO3.2 | Convert data types, identify business rule violations and analyse outliers to propose appropriate treatments. | 4 – Analyse |
| CLO4.1 | Apply Min–Max scaling, Z-score standardisation and categorical encoding, and explain the purpose of each transformation. | 3 – Apply |
| CLO4.2 | Create revenue variables, time variables, value bands and summary tables for reporting. | 3 – Apply |
| CLO5.1 | Organise rerunnable notebooks, validate outputs and document changes before and after processing. | 3 – Apply |
| CLO5.2 | Interpret findings, evaluate data limitations and defend processing choices in a report. | 5 – Evaluate |
| Method | Description | When | CLOs | Weight |
|---|---|---|---|---|
| Class participation | Attendance, contributions to discussions and practical activities, and following class rules. | Throughout the course | CLO1.1–CLO5.2 | 10% |
| Individual tests | Two computer-based tests in class, 20% each. Test 1: data loading, quality profiling, descriptive statistics and EDA. Test 2: missing values, duplicates, inconsistent labels, invalid types and outliers, with basic transformations and variable creation. You implement solutions in Python and briefly justify your choices. | Test 1: Session 2, Period 6. Test 2: Session 4, Period 12. | Test 1: CLO1.1–CLO2.2. Test 2: CLO3.1–CLO4.2. | 40% |
| Final exam | A 90-minute computer-based exam: explore, clean, preprocess and interpret a supplied dataset in Python, and submit a rerunnable notebook with quality checks, justified processing decisions, summary statistics and visualisations, and a concise interpretation. Eligibility: more than 80% attendance and both individual tests completed. | University examination schedule | CLO1.1–CLO5.2 | 50% |
Assessment indicators: correctness of Python operations, appropriateness of methods, accuracy of results, output validation, rerunnability and clarity of evidence-based explanations.
| Session | Periods and content | CLOs | Practice and evidence |
|---|---|---|---|
| 1 | P1 Data quality and the workflow from raw data to reports. P2 DataFrame and Series; reading CSV/Excel; head, info, dtypes, shape; filtering and selecting. P3 Quality profiling with isna, duplicated, nunique, value_counts; business rules. | CLO1.1, CLO1.2 | Exploration notebook and error table — short assignment 1 |
| 2 | P4 Mean, median, variance, standard deviation, quantiles, IQR. P5 Histograms, boxplots, bar charts and scatter plots. P6 groupby, agg, pivot_table; correlation and its limits. | CLO2.1, CLO2.2 | Preliminary EDA report — short assignment 2; Test 1 |
| 3 | P7 Standardising missing markers; keeping, removing or imputing. P8 Full-row and key-based duplicates; standardising labels. P9 to_numeric, to_datetime; validating values and conversion errors. | CLO3.1, CLO3.2 | Cleaned data and processing log — short assignment 3 |
| 4 | P10 IQR-based outliers versus data errors. P11 Min–Max, Z-score, one-hot and ordinal encoding. P12 Revenue, month/quarter and value bands; aggregating for reports. | CLO3.2, CLO4.1, CLO4.2 | Preprocessing notebook and summary tables — short assignment 4; Test 2 |
| 5 | P13 Notebook organisation, functions, assert, logs and export. P14 Reporting findings, evidence and limitations. P15 Review, feedback and discussion. | CLO5.1, CLO5.2 | Notebook, cleaned data, quality table and 1–2 page report — integrated assignment |
Revenue in this course is defined as quantity × unit price × (1 − discount rate), with the discount rate in [0, 1].