INTRODUCTION

Data cleaning is the process of identifying and correcting errors, anomalies and inconsistencies in raw data sets to improve the quality of the data and get it ready for advanced analysis and modeling. In today’s data-driven world, raw data is often messy and rarely ready for analysis. The real value of a data analyst lies not just in collecting data, but in their ability to prepare it for meaningful insights. Data cleaning and transformation is essential because it organize tables, remove duplicates, simplify complicated columns through merging or appending, remove duplicates and null values, improve result accuracy for better and informed decision making. This is where ETL (Extract, Transform, Load) becomes essential. Power Query Editor in Power BI Desktop allows you to shape (transform) your imported data. Power Query Editor only modifies a view of your data, so you can be confident that your original data source remains unchanged.
Using Microsoft Power BI, analysts can efficiently clean, transform, and load data into a structured model ready for visualization and reporting.
This guide walks you through the step-by-step practical process of preparing data in Power BI from cleaning messy datasets to transforming the data into analysis-ready format and finally loading it into the data model for modeling and visualization.

ARCHITECTURE OVERVIEW

Power BI’s data preparation workflow through the Power Query Editor is where:
• Data Cleaning occurs
• Data Transformations are performed
• Data Loading for analysis is applied

Each step performed is recorded, making your workflow reproducible and easy to modify.

Working with Power Query Editor
The Power Query Editor is the central workspace for data transformation.
Steps:
• Access it via Transform Data in Power BI Desktop

• Each transformation step is recorded in the Applied Steps pane

• Changes are repeatable and refresh automatically with new data
Key advantage: It enables a no-code/low-code approach while still supporting advanced transformations.

1. Promoting Headers
Often, datasets load with the first row as data instead of column names.
To promote header,
Steps:

1. Go to Home Column
2. Use “Use First Row as Headers”
3. Ensure columns are properly labeled for easier analysis

2. Creating Index Columns
Index columns help to assign unique integer to each row in a table for easy row identification, sorting and modeling.

Steps:

1. Go to Add Column → Index Column
2. Choose: From 0, From 1 or Custom increment (which define a starting value and increment, e.g., 3, 6, 9…)

3. Conditional Columns and Logic
Conditional columns is used in the creation of new columns based on rule (IF-THEN-ELSE logic) applied to the existing columns

Steps:

1. Navigate to Add Column → Conditional Column
2. Define logic like:
3. If Salary = 50,000 → “Full Employee”
4. Else → “Contract Worker”

4. Column from Examples
It automatically creates new columns by providing one or more example values from existing columns in the table.

Steps:

1. Go to Add Column → Column from Examples
2. Provide sample outputs
3. Power BI automatically detects the transformation logic.

5. Unpivot and Pivot Columns
These operations reorganize dataset making dataset more flexible, consistent and compatible for analysis. Pivot Columns: turn long data (category values) from rows into wide format (separate columns). Unpivot Columns: Converts wide data (columns) into long format (rows).

Steps:

1. Go to Home → Transform
2. Select column to unpivot/pivot
3. Click Pivot column to convert
4. Chose value column (e.g., Sales) to populate the pivoted data
5. Click Ok
6. To Unpivot, click unpivot and unpivot columns
7. Press Ok

6. Grouping and Aggregation
Grouping helps summarize data by primarily using the “Group By”.
Steps:

1. Go to Transform → Group By
2. Apply aggregations like: Sum, Count, Average, Min/Max Example:
3. Total sales by region
4. Average revenue per customer

7. Merge and Append Queries
Used for combining datasets:
Merge Queries (Join) extract a particular column from one table to join another table through the use of a common key. E.g. merging customer and transaction tables.
Append Queries (Union) concatenate rows from two tables with the same structure into a single table. E.g. appending monthly datasets.

• Merging increases the number of columns in the table while Appending increases the number of rows in the table.

Step: To Merge

1. Open Power query editor through the transform data
2. Select the table to merge from the left pane (e.g., CodeSphere Hub Sales 2019)
3. Click on the Home Tab and select the Merge Queries
4. Choose “Merge Queries” to merge directly into selected table or “Merge Queries as New” to create a new merged table
5. Select the data table from the first drop down and select the common column (e.g., Product_Key)
6. Select the second table from the second drop down and chose the matching column (I.e. Product_Key)
7. Click ok

Step: To Append

1. Open Power query editor through the transform data
2. Select the table to append (e.g., CodeSphere Hub Sales 2019)
3. Click on the Home Tab and select the Append Queries
4. Choose “Append Queries” to append directly into selected table or “Append Queries as New” to create a new appended table
5. Select the first query from the first drop down selection (e.g., CodeSphere Hub Sales 2019)
6. Select the second query from the second drop down selection (e.g., CodeSphere Hub Sales 2020)
7. Click ok

8. Date and Time Transformations
It is essential for creating time-intelligence calculations like, year-to-date, same-period-last-year, extracting year, month and day, calculating durations, date differences and standardizing date format for time series analysis and trend reporting.
Step:

1. Open Power query editor
2. Navigate to Transform → Date or Navigate to Transform → Time to extract values (Day, week, month, quarter, year).

1. To standardize date format, Navigate to Data Type, Select Date/Time, Date or Time to ensure accurate modeling.

1. Using DAX functions like DATEDIF to calculate differences

9. Adding Prefix and Suffix Using Power Query
You can modify text fields by adding prefixes or suffixes.
Steps:

1. Click on Transform data to open Power Query Editor
2. Select the column to edit
3. Navigate to the Transform Tab
4. Click Format
5. Add Prefix or Suffix
6. Enter the desired text/character in the dialog box (e.g. add “NGN” before currency values)
7. Also enter desired text/character for suffix and Click OK
8. Or use Custom Column with formulas

10. Data Profiling Techniques
Power Query includes built-in data profiling tools for understanding the structure, quality and distribution of data before loading into the model. These tools help quickly assess data health and identify issues.
The 3 concepts of data profiling techniques in power BI are;

• Column Profile: which shows the entire statistics of a selected column and it shows statistics like Count, Error, Empty, Distinct Unique, Not Available Number (NAN), Min, Max, Zero, Avg, Standard Deviation, Even and Odd.
• Column Distribution: shows a small histogram under the column header that visualize the frequency and distribution of values. It explicitly list out the number of distinct values and Unique values in a selected column
• Column Quality: displays valid data, empty values and percentage of errors

Steps:

1. Click on Transform data to open Power Query Editor
2. Select the column to profile
3. Navigate to the View Tab
4. Enable the option to preview by checking the box and unchecking others (e.g. check the box to preview column quality)
5. Column Profile
6. Column Distribution
7. Column Quality

11. Handling Missing or Null Values
Missing data can distort analysis if not handled properly.

Steps:

1. First, identify missing data through the column quality to see the percentage of valid, error and empty (null) values in every column
2. Click the filter arrow on the column header
3. Select null (or blank) to view only rows with missing data
4. To replace manually,
5. To replace null and empty value by filling down,
6. To remove Missing Data
   • Select column
   • Click on filter arrow and chose remove Empty.

CONCLUSION

Data preparation is the most critical step in any analytics workflow. Power BI’s Power Query Editor provides a robust and flexible environment to clean, transform, and load data efficiently.
By mastering these techniques from basic cleaning to advanced transformations you position yourself to build accurate models, insightful dashboards, and impactful data stories.
The difference between average and exceptional analysis often lies not in visualization but in how well the data was prepared.