Evaluation of Predictive Modelling

Dr Johannes De Smedt, Sofia Varypati, EdinburghX

Gain an in-depth understanding of evaluation and sampling approaches for effective predictive modelling.

We can only succeed in capturing insights from data if we first know how to measure the effectiveness of models. In this course, you will learn appropriate measures that are used to evaluate predictive models in a variety of contexts. You will also learn about procedures that are used to ensure that models do not cheat through, for example, overfitting or predicting incorrect distributions. 
A predictive exercise is not finished when a model is built. It is important to construct a vast number of models, not only to find the best one, but to ensure that they point in the same direction. This course will equip you with essential skills and knowledge for understanding performance evaluation metrics, to determine whether a model is performing adequately or not.  
You will also discover the ways that different model evaluation criteria illustrate how one model excels over another, and how to identify when to use certain criteria over others. This is the foundation to performing successful predictive analysis.

It allows business owners to create robust models that are capable of only using the most relevant data, for example: customer purchasing behaviour, past sales, and so on. Many of the techniques you'll learn about in the course are used within powerful applications such as recommender systems.

The concepts will be brought together in a comprehensive case study that deals with a churn case. You will be tasked with selecting suitable variables to predict whether a customer will leave a telecommunications provider or not, by looking into their calling behaviour, creating various models and benchmarking them by using the appropriate evaluation criteria.

What will you learn

In this course, you will:

  • Develop knowledge of the most popular and effective measure and sampling strategies  
  • Implement effective measures and strategies to evaluate predictive models 
  • Use evaluation concepts on datasets to determine appropriateness and strength of techniques

  • 12 November 2019
Course properties:
  • Free:
  • Paid:
  • Certificate:
  • MOOC:
  • Video:
  • Audio:
  • Email-course:
  • Language: English Gb


No reviews yet. Want to be the first?

Register to leave a review

More on this topic:
D6fd079b-e8c1-476c-97d9-d7e4bbb1ecc4-33710a165fbe.small Predictive Analytics Final Project
Apply your predictive modelling acumen in a business case setting. The final...
Dark-blue Asset Pricing, Part 1
This course is part one of a two-part introductory survey of graduate-level...
Climate_literacy-coursera-460pixels Climate Literacy: Navigating Climate Change Conversations
Climate Literacy tackles the scientific and socio-political dimensions of climate...
Dynamical_modeling_logo_460x270_v2 Dynamical Modeling Methods for Systems Biology
An introduction to dynamical modeling techniques used in contemporary Systems...
Intro-to-physics-icon600x340 Introductory Physics I with Laboratory
Explore motion in the real world using modern tools and techniques (video capture...
More from 'Mathematics, Statistics and Data Analysis':
Ef5dcb87-b65b-46a6-bb2a-c5a3f7807845-7cb915944555.small Engineering Calculus and Differential Equations
Learn fundamental concepts of single-variable calculus and ordinary differential...
20fedd71-34f4-4084-9fde-49f5d2d224a5-2f0bdb8c45f3.small Microsoft Professional Capstone : Big Data
Validate the skills you learned in the Microsoft Professional Program for Big...
07bd7954-0593-43cb-b0c4-0f18f5c25ee1-a5d93e120a6d.small Microsoft Professional Capstone : Data Science
Solve a real-world data science problem in this capstone project for the Microsoft...
86814127-5973-4549-884e-c8d6ea3514cb-8092d5a682f0.small Microsoft Professional Capstone : Artificial Intelligence
Solve a real-world artificial intelligence problem in this capstone project...
520f308b-128f-4d2c-af91-f646e1e312a8-df630e95f440.small Microsoft Professional Capstone: Data Analysis
Showcase the knowledge you acquired in the Data Analysis MPP in this Capstone...
More from 'edX':
4178fda1-e8c7-476c-81e8-8a6b453a6a76-569208c21635.small Humanitarian Response to Conflict and Disaster
Learn the principles guiding humanitarian response to modern emergencies, and...
695ff980-b45a-425f-bee6-51bf6e962d90-de2d1a1c22e0.small Video Game Design History
Learn about the evolution of video games from experts at The Strong National...
595aa0b6-077d-439b-a651-95a9ee65c51a-fc966dc2648f.small Video Game Design and Balance
Learn about the video game design process and experiment with effective methods...
Fcd236ea-68ae-46f7-b991-849a41cebc64-0ea84acf6bad.small Video Game Asset Creation and Process
Learn about the tools, processes and platforms that allow video game assets...
A3940ac0-0757-4181-8b9d-5741f8a934fc-87e2da858ee6.small Minds and Machines
An introduction to philosophy of mind, exploring consciousness, reality, AI...

© 2013-2019