Data Preprocessing

Duration: 3 min

This video lesson is available to enrolled students.

Return to /learn/COGNIZANT-PREPARATION/dbms/data-warehousing-mining/data-modelling-in-warehouses/asset-data-preprocessing after enrolling

Inside: a video lesson and guided study material.

Module outline

  1. Communication Round: Vocabulary, Subject Verb Agreement (Verb Noun Agreement), Tenses, Comprehension / Reading Comprehension / Unseen Passages (Critical Reasoning) (Paragraph Questions), Cloze Test (Cloze Passage), Sentence Correction (Error Correction), Sentence Completion (Fill in the blanks), Sentence Re-arrangements (Para Jumbles) (Narrative Sequencing), Direct and Indirect Speech, Active Passive Voice (Voice), Verbal Analogy (Word Based Analogy), Articles, Preposition, Conjunction, Sentence Construction, English Writing Ability, Communication Assessment
  2. Quantitative Aptitude: Ratio and Proportion (Ratios), Divisibility Rules, Data Interpretation, Mixture and Alligation, Permutation and Combination, Logarithm, Number System, HCF LCM, Speed Time and Distance, Percentage, Average, Powers and Exponents (Surds and Indices), Time and Work, Mensuration and Geometry, Age Problems, Pipe and Cistern, Probability, Profit and Loss, Simple Interest and Compound Interest, Algebra
  3. Analytical and Logical Reasoning: Series (Number and Letter Series) (Numerical Relations and Reasoning), Coding Decoding, Data Sufficiency, Non Verbal Reasoning (Spatial Aptitude) (Spatial Reasoning) (Visual Reasoning), Directions (Direction Test), Ranking, Order and Sequence, Deductive and Inductive Reasoning (Logical Deduction and Induction) (Prepositional Reasoning), Selection Decision Table (Decision Making), Logical Sequence Of Words, Puzzle Solving (Puzzles), Syllogisms, Seating Arrangements, Calendar, Clock, Blood Relations, Cubes & Dices, Venn Diagram, Analytical Reasoning (Counting Figures Reasoning)
  4. Cognizant Gaming Aptitude: Gamified / Game Based Aptitude
  5. Java (Cluster 1): Java
  6. ANSI SQL MySQL (Cluster 1,2,3): SQL
  7. HTML, CSS, JavaScript (Cluster 1,3): HTML, CSS, JavaScript
  8. Python (Cluster 2): Python for Placements by Yash Sir
  9. Cloud Fundamentals (Cluster 2): Emerging Tech Trends
  10. C# (Cluster 3): C#
  11. OOPs: Object Oriented Programming (OOPS)
  12. Technical Assessment (Coding): Coding Questions by Yash Sir, C Programming by Yash Sir, Programming in C++, Pseudo Codes
  13. Data Structures: Introduction to DS, Array, Stack, Queue, Linked List, Tree, Graphs, Hashing
  14. DBMS: Basics of DBMS, ER Diagram, Relational Model & Functional Dependencies, Keys & Integrity Constraints, Normalization (1NF - BCNF), Decomposition Properties & 4NF, File Organization & Indexing, Relational Algebra, Relational Calculus, Transaction Management, Concurrency Control, Database Recovery, ORDBMS, Database Security & Authorization, Query Processing & Optimization, Enhanced Data Models, Data Warehousing & Mining, Big Data Systems, NoSQL
  15. Operating Systems: Introduction to OS, Process Management, CPU Scheduling, Process Synchronization, Deadlock, Threads & Process Creation, Memory Management, Virtual Memory, Disc Scheduling, File Management, Windows OS, Linux OS, Security, Distributed Systems, Virtual Machines
  16. Computer Networks: Introduction to CN, Data Communication, DLL: Access Control, DLL: Flow Control, DLL: Error Control, DLL: Framing, Data Link Layer - Ethernet, Net Layer: IPv4 & Proto, Net Layer: IP Addressing, Net Layer:Routing Protocol, Transport Layer Services, TL: Congestion & UDP, Application Layer, Hardware basics, Network Security, Mobile Technology, Cloud Computing and IoT, Cyber and Info Security
AI summary & chapters

AI Summary

An AI-generated summary of this video lecture.

The video is a lecture on data preprocessing, presented as a slide deck. The first part explains why data preprocessing is necessary, stating that real-world data is 'dirty' and can be incomplete (missing values), noisy (errors or outliers), or inconsistent (differences in codes or names). The instructor emphasizes that 'No quality data, no quality mining results!' and that quality decisions and data warehouse integration depend on quality data. The second part, titled 'Major Tasks in Data Preprocessing,' lists and explains five key tasks: Data cleaning (filling missing values, smoothing noisy data, removing outliers, and resolving inconsistencies), Data integration (combining data from multiple sources like databases, data cubes, or files), Data transformation (normalization and aggregation), and Data reduction (obtaining a reduced representation in volume while preserving analytical results). The instructor uses a digital pen to write on the slides, adding notes like 'Data mining functionality' and '2020 Covid' to illustrate points.

Chapters

  1. 0:00 – 2:00 00:00-02:00

    The video begins with a slide titled 'Why Data Preprocessing?' which explains that real-world data is 'dirty'. It defines three types of data issues: incomplete (lacking attribute values or attributes of interest), noisy (containing errors or outliers), and inconsistent (containing differences in codes or names). The slide emphasizes that 'No quality data, no quality mining results!' and that quality decisions and data warehouse integration must be based on quality data. The instructor writes 'Data mining functionality' and '2020 Covid' on the slide to illustrate the need for clean data in real-world applications.

  2. 2:00 – 3:21 02:00-03:21

    The slide changes to 'Major Tasks in Data Preprocessing'. The instructor lists and explains five tasks. First, 'Data cleaning' involves filling in missing values, smoothing noisy data, identifying or removing outliers, and resolving inconsistencies. Second, 'Data integration' is the integration of multiple databases, data cubes, or files. Third, 'Data transformation' includes normalization and aggregation. Fourth, 'Data reduction' aims to obtain a reduced representation in volume while producing the same or similar analytical results. The instructor uses a digital pen to write '2020 Covid' and 'Aug' on the slide, and draws a diagram to illustrate data reduction, showing a transformation from 1000 to 0.1, and then to 0.01, to represent a significant reduction in data volume.

The lecture systematically builds the case for data preprocessing. It starts by establishing the problem: real-world data is inherently flawed with issues of incompleteness, noise, and inconsistency, which directly undermine the quality of any data mining or analytical outcome. This foundational understanding leads to the core message that high-quality results are impossible without high-quality data. The second part of the lecture provides the solution by outlining the five major tasks of data preprocessing—cleaning, integration, transformation, and reduction—as the essential steps to convert raw, 'dirty' data into a reliable, consistent, and manageable form suitable for effective analysis.

Loading lesson…