Paper 6
WAREHOUSING AND DATA MINING
This unit specifies competencies required to perform warehousing and data mining. It enables the learner to identify key concepts in warehousing and data, design and implement a data warehouse, mine and manage data and apply mined data
On completion, a candidate should be able to
- Identify key concepts in Warehousing and Data
- Design and implement a data warehouse
- Mine and Manage Data
- Utilize mined data
Content
- 1
Identify key concepts in Warehousing and Data
Identify key concepts in Warehousing and Data
❑ Definition of data warehousing ❑ Characteristics of a data warehouse ❑ The Data Warehousing Process ❑ Components of Data warehouse ✓ Load manager ✓ Warehouse Manager ✓ Query Manager ✓ End-user access tools ❑ Users and Uses of Data warehouse ❑ Basic Data Warehouse Architecture ❑ Data warehousing and online transaction processing systems (OLTP) ❑ Online Analytical Processing (OLAP) ✓ Basic analytical
perations of OLAP - Roll-up - Drill-down - Slice and dice - Pivot (rotate) ❑ Data Warehousing Schemas ✓ Star Schema ✓ Snowflake Schema ✓ Fact Constellation Schema Advantages and Disadvantages Data warehousing
- 2
Design and implement a data warehouse
Design and implement a data warehouse
❑ Definition of: ✓ Metadata ✓ Data Mart ❑ Importance of metadata in data warehouses ❑ Types of Metadata ✓ Operational Metadata ✓ Extraction and Transformation Metadata ✓ End-User Metadata ❑ Metadata Interchange Initiative ❑ Metadata Interchange Standard Framework ❑ Metadata Repository ❑ Reasons for creating a data mart ❑ Types of Data Marts ✓ Dependent Data Marts ✓ Independent Data Marts ✓ Hybrid Data Marts ❑ Steps in Implementing a Data Mart ❑ Steps to Implement Data Warehouse ❑ Coping with business risks associated with a Data warehouse implementation ✓ Enterprise strategy ✓ Phased delivery ✓ Iterative Prototyping ❑ Data Warehouse Tools ✓ MarkLogic ✓ Oracle ✓ Amazon RedShift ❑ Best practices to implement a Data Warehouse
- 3
Mine and Manage Data
Mine and Manage Data
❑ Definition of Data Mining ❑ Data Mining tools ✓ R ✓ Python ✓ Orange Data Mining ✓ SAS Data Mining ✓ DataMelt Data Mining ✓ Rattle ✓ Rapid Miner ❑ Data Mining Functions ❑ Data Mining Techniques ✓ Cluster Analysis ✓ Induction ✓ Decision trees ✓ Rule induction ✓ Neural networks ❑ Criteria for choosing a Data Mining Software ❑ Data mining functionalities and the variety of knowledge they discover ✓ Characterization ✓ Discrimination ✓ Association analysis ✓ Classification ✓ Prediction ✓ Clustering ✓ Outlier analysis ✓ Evolution and deviation analysis ❑ Issues in Data Mining ✓ Security and social issues ✓ User interface issues ✓ Mining methodology issues ✓ Performance issues ✓ Data source issues
- 4
Utilize mined data
Utilize mined data
❑ Data Mining Applications Financial Analysis Telecommunication Industry Intrusion Detection Retail Industry Higher Education Energy Industry Spatial Data Mining Biological Data Analysis Other Scientific Applications Manufacturing Engineering Criminal Investigation Counter-Terrorism ❑ Technology Trends in Data Mining