QUESTION 1: Current research indicates that most companies…
The problem with conducting mostly level 1 and level 2 evaluations is that it limits the ability to fully measure the effectiveness of the learning experiences. Level 3 and 4 evaluations help determine whether the training program is delivering the intended results and producing a positive return on investment (ROI).

By educating leaders and stakeholders, providing resources, aligning evaluations with organizational goals, and using data to drive decision-making, organizations can increase the use of level 3 and 4 evaluations and make better-informed decisions about their training programs.

QUESTION 2: On page 102…
Donald’s perspective, how do I think the meeting went? At first I feel like Donald thought the meeting was going well, but as Sydney kept asking questions about the type data he’s collected to validate his new course, he probably started to worry about the true success of his courses. With all the courses he was working on, without substantial feedback with data, he might have become worried about return on investment (ROI).

Sydney’s perspective, how do I think the meeting went? I do not think Sydney thought the meeting went well at all. I feel like she was worried Donald was wasting resources and time developing new courses without feedback to justify designing more new courses.

Describe at least four types of data analytics…
Level 1: Reaction and Planned Action data includes data that reflects the value of program content, measure relevance and willingness to recommend it others

Level 2: Learning data includes data reflecting level of confidence as each participant apply their newly acquired skill, or knowledge

Level 4: Business Impact data help determine the extent to which applications of acquired knowledge and positively influence the key measures for what they were intended to improve as a result of the learning experience. Example in the case of Donald and Sydney's meeting: Job engagement, cycle time, sales and operating costs 

Level 5: Return on investment (ROI) measures improvement, converted to monetary value, and compared to the cost of the program

QUESTION 3: Chapter 12 talks about data analytics…
How can you use what you…
By incorporating learning analytics into the design of a course, instructors can identify areas where students are struggling and adjust the course content and delivery to better support student learning. If learning analytics data shows that students are consistently struggling with a particular topic, the instructor can revise the course materials or provide additional resources to help students understand the material more effectively.

Learning analytics helps instructors identify students who may be falling behind. By using data to identify these students early on, instructors can intervene with targeted support and resources to help them be more successful in the class.

In short, incorporating learning analytics into the design of a course can lead to more personalized and effective learning experiences for students, and can help instructors identify areas where improvements can be made. Therefore, there should be more emphasis on designing courses that leverage learning analytics to better support student learning and success.

What types of design alternatives…

For a successful online science course there are two alternative course designs I would recommend, Gamification and Collaborative Learning.

Gamification: Gamification is a design alternative that uses game-like elements to engage students and make learning more fun. By incorporating game elements such as points, badges, and leaderboards into a course, instructors can increase student motivation and engagement. Learning analytics can be used to track student progress and identify areas where additional game elements could be incorporated to improve student learning outcomes.

Collaborative Learning: Collaborative learning is a design alternative that encourages students to work together to solve problems and complete assignments. Learning analytics can be used to track student participation and identify opportunities for collaboration. 

What type of data could be…
Various types of data can be collected and analyzed to measure its success or failure:

1. Student performance data

2. Course evaluations

3. Engagement data

4. Retention and completion data

5. Post-course survey data